Robot control method, device and equipment and storage medium

By planning the desired operating space task and the whole-body dynamic model, the control wheel-leg robot moves in a dynamic equilibrium state with alternating swing of mechanical leg sets, solving the problem of insufficient efficiency and accuracy in the prior art, achieving high efficiency, Accurate obstacles cross.

CN118990466APending Publication Date: 2024-11-22TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Patent Information

Application Number
CN202310558206.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-17
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing wheel-leg robots are not efficient when climbing obstacles such as stairs and lack control accuracy, which is mainly due to the restriction of the center of gravity projection in the support area, resulting in slow movement.

Method used

By planning the expected operating space tasks and whole-body dynamic model, the expected joint moment set is obtained, and the robot is controlled to move in a dynamic equilibrium state in the alternating swing of the mechanical leg set, so as to achieve the center of gravity exceeding the support area, improve movement efficiency, and improve control accuracy .

Benefits of technology

It improves the movement efficiency and control accuracy of the robot, and realizes rapid movement and accurate operation in dynamic equilibrium state.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118990466A_ABST
    Figure CN118990466A_ABST
Patent Text Reader

Abstract

The invention discloses a robot control method and device, equipment and a storage medium, and relates to the technical field of artificial intelligence. The method comprises the steps that for the robot with a first mechanical leg set and a second mechanical leg set, an expected operation space task of the robot on a supporting face is obtained, and the expected operation space task is used for guiding the robot to alternately swing the first mechanical leg set and the second mechanical leg set so as to move on the supporting face; according to the expected operation space task and a whole-body kinetic model of the robot, an expected joint torque set corresponding to the expected operation space task is obtained, and the expected joint torque set comprises expected joint torques used for controlling all parts of the robot; and according to the expected joint torque set, the robot is controlled to move under the guidance of the expected operation space task. According to the embodiment of the invention, the control accuracy of the robot is improved through the whole-body dynamic model, and the moving efficiency of the robot is improved through the expected operation space task.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of artificial intelligence technology, and in particular to a robot control method, device, equipment and storage medium. Background Art

[0002] With the development of robot control technology, some organizations and research institutions have successively launched wheel-legged robots with wheels as feet. These wheel-legged robots can not only slide quickly on the wheels, but also climb stairs and overcome obstacles.

[0003] Taking wheel-legged robots climbing stairs as an example, related technologies use heuristic methods to control wheel-legged robots, such as planning the positions of the wheel-legged robots' mechanical legs on the stairs and controlling the projection of the wheel-legged robots' center of gravity to move slowly within its support area to achieve stair climbing. This type of method belongs to static stair climbing, that is, the projection of the robot's center of gravity will not exceed the robot's support area, which results in low efficiency of the robot climbing stairs. Summary of the invention

[0004] The embodiments of the present application provide a robot control method, device, equipment and storage medium, which can improve the robot's movement efficiency and the robot's control accuracy. The technical solution is as follows:

[0005] According to one aspect of an embodiment of the present application, a control method for a robot is provided, wherein the robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, wherein at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and a rotation center of a hip joint corresponding to the first mechanical leg group and a rotation center of a hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the method comprises:

[0006] Acquire an expected operation space task of the robot on a support surface, wherein the expected operation space task includes expected accelerations of various parts of the robot in the operation space of the robot, and the expected operation space task is used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to move on the support surface;

[0007] According to the expected operation space task and the whole body dynamics model of the robot, an expected joint torque set corresponding to the expected operation space task is acquired, wherein the expected joint torque set includes expected joint torques for controlling various parts of the robot;

[0008] According to the expected joint torque set, the robot is controlled to move under the guidance of the expected operation space task.

[0009] According to one aspect of an embodiment of the present application, a control device of a robot is provided, wherein the robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, wherein at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and a rotation center of a hip joint corresponding to the first mechanical leg group and a rotation center of a hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the device comprises:

[0010] an expected task acquisition module, used to acquire an expected operation space task of the robot on a support surface, wherein the expected operation space task includes expected accelerations of various parts of the robot in the operation space of the robot, and the expected operation space task is used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to move on the support surface;

[0011] An expected torque acquisition module, used for acquiring an expected joint torque set corresponding to the expected operation space task according to the expected operation space task and the whole body dynamics model of the robot, wherein the expected joint torque set includes expected joint torques for controlling various parts of the robot;

[0012] The robot movement module is used to control the robot to move under the guidance of the expected operation space task according to the expected joint torque set.

[0013] According to one aspect of an embodiment of the present application, a computer device is provided, wherein the robot comprises a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the control method of the robot.

[0014] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the above-mentioned robot control method.

[0015] According to one aspect of the embodiments of the present application, a computer program product is provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the control method of the robot.

[0016] The technical solution provided by the embodiments of the present application may have the following beneficial effects:

[0017] For a robot with a first mechanical leg group and a second mechanical leg group, since the rotation centers of the corresponding hip joints are located in the same vertical plane, the robot can be made to stand with one set of mechanical legs and move quickly in a dynamic equilibrium state (i.e., the center of gravity of the robot can exceed the support area of ​​the robot) by planning the expected operation space task, thereby improving the robot's movement efficiency. At the same time, controlling the movement of the robot by alternating the swinging of the first mechanical leg group and the second mechanical leg group can further improve the robot's movement efficiency.

[0018] In addition, by adopting the robot's whole-body dynamics model, the expected joint torque set corresponding to the expected operating space task can be accurately obtained according to the expected operating space task, and then the expected operating space task can be accurately achieved according to the expected joint torque set, thereby improving the control accuracy of the robot. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 It is a schematic diagram of an implementation environment of a solution provided by an embodiment of the present application;

[0021] Figure 2 is a schematic diagram of a quadruped wheel-legged robot provided by an embodiment of the present application;

[0022] Figure 3 is a schematic diagram of a wheel-legged robot climbing stairs provided by an embodiment of the present application;

[0023] Figure 4 is a schematic diagram of a wheel-legged robot crossing a road shoulder provided by an embodiment of the present application;

[0024] Figure 5 is a schematic diagram of a wheel-legged robot crossing a pit provided by an embodiment of the present application;

[0025] Figure 6 is a schematic diagram of a robot control method provided by an embodiment of the present application;

[0026] Figure 7 is a flowchart of a method for acquiring a desired operation space task provided by an embodiment of the present application;

[0027] Figure 8 is a schematic diagram of an inverted pendulum model of a wheel-legged robot provided by an embodiment of the present application;

[0028] Fig. 9 is a flow chart of a method for obtaining a desired joint torque set provided by an embodiment of the present application;

[0029] Figure 10-12 A schematic diagram of a quadruped wheeled-legged robot climbing stairs is shown as an example;

[0030] Fig.13 is a block diagram of a control device of a robot provided by an embodiment of the present application;

[0031] Fig.14 is a block diagram of a control device of a robot provided by another embodiment of the present application;

[0032] Fig.15 It is a simplified structural block diagram of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0033] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0034] Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.

[0035] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0036] The technical solution of this application mainly involves the robot technology in artificial intelligence technology, mainly involving robot intelligent control. Robots are mechanical and electronic devices that can imitate certain human skills by combining mechanical transmission and modern microelectronics technology. Robots are developed on the basis of electronic, mechanical and information technology. Robots do not necessarily have to look like humans. As long as they can independently complete the tasks and commands assigned to them by humans, they are members of the robot family. A robot is an automated machine that has some intelligent abilities similar to those of humans or organisms, such as perception, planning, movement and coordination. It is an automated machine with high flexibility. With the development of computer technology and artificial intelligence technology, robots have been greatly improved in terms of function and technical level. Mobile robots and robot vision and touch technologies are typical representatives.

[0037] In the technical solution provided in the embodiment of the present application, the executor of each step may be a computer device, which refers to an electronic device with data calculation, processing and storage capabilities.

[0038] Optionally, the computer device may be a PC (Personal Computer) device such as a desktop computer or a laptop computer for controlling the robot; or a server for controlling the robot. The server may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The computer device and the robot may be connected via a physical line, a network, etc. For example, refer to Figure 1 The computer device 101 can calculate the expected joint torque set corresponding to the robot 103 according to the expected operation space task of the robot 103 (the expected operation space task includes the expected accelerations of various parts of the robot 103 in the operation space of the robot 103), and control the movement of the robot 103 through the network 102 according to the expected joint torque set. For example, the computer device 101 can control the first mechanical leg group 104 and the second mechanical leg group 105 of the robot 103 to swing alternately according to the expected joint torque set corresponding to the expected operation space task of the robot 103, so that the robot 103 moves on the support surface.

[0039] Optionally, the computer device may also be a robot itself, that is, the execution subject of each step in the technical solution provided in the embodiment of the present application is a robot. Figure 1, the computer device 101 can send the expected operation space task of the robot 103 to the robot 103 through the network 102, and the robot 103 calculates the corresponding expected joint torque set according to the expected operation space task, and then moves according to the expected joint torque set. Optionally, the robot 103 can also automatically plan the expected operation space task according to the real environment to perform different tasks in the real environment, which is not limited in the embodiment of the present application.

[0040] The robot in the embodiments of the present application may refer to a wheel-legged robot, a leg-footed robot, etc. A wheel-legged robot refers to a robot with wheels as feet, and a leg-footed robot refers to a robot with feet as feet. The embodiments of the present application do not limit this.

[0041] In one example, a robot may include a body, a first mechanical leg group and a second mechanical leg group connected to the body through a hip joint, at least one of the first mechanical leg group and the second mechanical leg group includes at least two mechanical legs, such as the first mechanical leg group includes at least two mechanical legs, the first mechanical leg group may also include at least two mechanical legs, there are at least two mechanical legs in the first mechanical leg group, which are respectively located on both sides of the central axis (i.e., the sagittal plane) of the robot, and there are at least two mechanical legs in the second mechanical leg group, which are respectively located on both sides of the central axis of the robot, and the first mechanical leg group and the second mechanical leg group are distributed side by side, that is, the rotation center of the hip joint corresponding to the first mechanical leg group and the rotation center of the hip joint corresponding to the second mechanical leg group are located in the same vertical plane.

[0042] Exemplarily, a wheel-legged robot is taken as an example to illustrate the robot in the embodiments of the present application.

[0043] The wheel-legged robot in the embodiment of the present application may include a fuselage, an outer mechanical leg group (i.e., a first mechanical leg group) connected to the fuselage through a hip joint, and an inner mechanical leg group (i.e., a second mechanical leg group), wherein the outer mechanical leg group may include two outer mechanical legs, and the inner mechanical leg group may include at least one inner mechanical leg. Exemplarily, the wheel-legged robot is a four-legged wheel-legged robot, i.e., the wheel-legged robot includes two outer mechanical legs and two inner mechanical legs; the wheel-legged robot is also a three-legged wheel-legged robot, i.e., the wheel-legged robot includes two outer mechanical legs and one inner mechanical leg. Among them, the hip joint corresponding to at least one inner mechanical leg in the inner mechanical leg group is located between the hip joints corresponding to the two outer mechanical legs in the outer mechanical leg group, and the rotation center of the hip joint corresponding to the outer mechanical leg and the rotation center of the hip joint corresponding to the inner mechanical leg are located in the same vertical plane. The wheel-legged robot can stand on a supporting surface by means of outer mechanical legs or inner mechanical legs, the wheel-legged robot can also slide on the supporting surface by means of the wheels on the outer mechanical legs or the wheels on the inner mechanical legs, and can also move (i.e. walk) on the supporting surface by controlling the outer mechanical leg group and the inner mechanical leg group to swing alternately.

[0044] For example, Figure 2 As shown, it exemplarily shows a structural schematic diagram of a quadruped wheel-legged robot. The quadruped wheel-legged robot 200 may include: a body, a hip joint and mechanical legs.

[0045] The quadruped wheel-legged robot 200 has four mechanical legs: two outer mechanical legs 201 (i.e., the first mechanical leg group) and two inner mechanical legs 202 (i.e., the second mechanical leg group), the two inner mechanical legs 202 are located between the two outer mechanical legs 201, and the four mechanical legs can be extended and retracted individually along the direction shown in the figure. A wheel 203 is installed at the end of each of the four mechanical legs, and each wheel 203 can be driven individually. The quadruped wheel-legged robot 200 can stand up through the two inner mechanical legs 202 or the two outer mechanical legs 201 to be in a double-wheel support state; the quadruped wheel-legged robot 200 can stand up through the two inner mechanical legs 202 and the two outer mechanical legs 201 at the same time to be in a quadruped wheel support state, which is not limited in the embodiments of the present application.

[0046] Optionally, the two inner mechanical legs 202 may be implemented as a whole, that is, the quadruped wheel-legged robot 200 may be implemented as a tripod wheel-legged robot having only one inner mechanical leg.

[0047] The other ends of the four mechanical legs are each connected to a hip joint 204, and each mechanical leg can rotate around its own hip joint 204 and maintain linkage. In the embodiment of the present application, the rotation centers of the hip joints 204 corresponding to the quadruped wheel-legged robot 200 are located in the same vertical plane 205, and the rotation planes of the mechanical legs corresponding to the quadruped wheel-legged robot 200 are parallel. The hip joints 204 corresponding to the two inner mechanical legs 202 are located between the hip joints 204 corresponding to the two outer mechanical legs 201.

[0048] Optionally, the hip joints 204 corresponding to the quadruped wheel-legged robot 200 may be coaxial, that is, the rotation centers of the hip joints 204 are located in the same straight line. The hip joints 204 corresponding to the quadruped wheel-legged robot 200 may also be coaxial, such as the hip joints 204 corresponding to the two inner mechanical legs 202 are coaxial, and the hip joints 204 corresponding to the two outer mechanical legs 201 are coaxial, but the hip joints 204 corresponding to the two inner mechanical legs 202 are not coaxial with the hip joints 204 corresponding to the two outer mechanical legs 201.

[0049] Optionally, the hip joints 204 corresponding to the two outer mechanical legs 201 share a driving motor so that the two outer mechanical legs 201 move synchronously; the hip joints 204 corresponding to the two inner mechanical legs 202 share a driving motor so that the two inner mechanical legs 202 move synchronously. In a feasible example, each hip joint 204 corresponding to the quadruped wheel-legged robot 200 can also be independently driven by its own corresponding driving motor, which is not limited in the embodiment of the present application.

[0050] The body of the quadruped wheeled-legged robot 200 may include a waist 206 , a trunk 207 , a head 208 and upper limbs 209 .

[0051] The hip joints 204 corresponding to the quadruped wheeled leg robot 200 are connected to the same end of the waist 206, and the other end of the waist 206 is connected to one end of the trunk 207. The waist 206 has two rotation centers: a pitch rotation center that can make the trunk 207 pitch, and a sway rotation center that can make the trunk 207 sway sideways. The sway rotation center is designed in series with the pitch rotation center, and is located at the upper end of the pitch rotation center and connected to the trunk 207.

[0052] The other end of the torso 207 is connected to the head 208 and the upper limb 209, and the upper limb 209 can be an upper limb with multiple degrees of freedom. In some embodiments, an end effector, such as a mechanical gripper, a suction cup, etc., is deployed on the upper limb 209. A data acquisition device can be deployed in the head 208 to perceive the real environment, such as an image acquisition device, a video shooting device, an IMU (Inertial Measurement Unit), etc. Among them, the IMU can be placed at the geometric center of the torso 207, the center point of the hip joint (i.e., the rotation center of the hip joint), etc., which can be used to measure the actual acceleration, actual attitude angular velocity, actual Euler angle, etc. of the torso 207.

[0053] In the technical solution provided in the embodiment of the present application, the wheels, mechanical legs, hip joints, waist and torso (including IMU) of the four-legged wheeled robot 200 are necessary hardware for the control algorithm, and the rest are non-essential hardware.

[0054] Compared with the two-legged wheel-legged robot, the four-legged wheel-legged robot has a more stable structure and a stronger ability to resist external impact disturbances. Compared with the six-legged wheel-legged robot, it has fewer redundant joints and a lower design complexity. It can bear large loads, pass through narrow spaces, and perform tasks on objects of different heights. The four-legged wheel-legged robot has a strong ability to adapt to the environment.

[0055] The robot control method provided in the embodiment of the present application can be applied to a variety of scenarios, such as the robot climbing stairs, the robot crossing thresholds, the robot crossing shoulders, the robot crossing pits, and any scenario of crossing obstacles. The robot using the technical solution provided in the embodiment of the present application has a stronger ability to adapt to the environment. The robot control method provided in the embodiment of the present application can improve the robot's mobility efficiency and the robot's control accuracy.

[0056] The following will take a wheel-legged robot as an example to illustrate the application scenarios of the technical solution provided in the embodiments of the present application.

[0057] In some embodiments, reference Figure 3 When the wheel-legged robot 301 needs to climb stairs, it can first plan the expected operation space task according to the stairs, then calculate the expected joint torque set corresponding to the expected operation space task, and then control the outer mechanical leg group 302 (i.e., the first mechanical leg group) and the inner mechanical leg group 303 (i.e., the second mechanical leg group) to swing alternately according to the expected joint torque set to complete the stair climbing. For example, the outer mechanical leg group 302 is first used as the supporting mechanical leg group, and the inner mechanical leg group 303 is used as the swinging mechanical leg group, so that the robot 301 climbs the first step, and then the inner mechanical leg group 303 is used as the supporting mechanical leg group, and the outer mechanical leg group 302 is used as the swinging mechanical leg group, so that the robot 301 climbs the second step, and the outer mechanical leg group 302 and the inner mechanical leg group 303 swing alternately in turn to complete the stair climbing task.

[0058] In some embodiments, reference Figure 4 When the wheel-legged robot 401 needs to cross the shoulder, it can first plan the expected operation space task according to the shoulder, then calculate the expected joint torque set corresponding to the expected operation space task, and then control the outer mechanical leg group 402 and the inner mechanical leg group 403 to swing alternately according to the expected joint torque set to complete the crossing of the shoulder. For example, the inner mechanical leg group 403 is first used as the supporting mechanical leg group, and the outer mechanical leg group 402 is used as the swinging mechanical leg group, so that the outer mechanical leg group 402 of the robot 401 climbs onto the shoulder, and then the outer mechanical leg group 402 is used as the supporting mechanical leg group, and the inner mechanical leg group 403 is used as the swinging mechanical leg group, so that the robot 401 completely crosses the shoulder, and the inner mechanical leg group 403 and the outer mechanical leg group 402 swing alternately in turn to complete the crossing of the shoulder task.

[0059] In some embodiments, reference Figure 5When the wheel-legged robot 501 needs to cross a pit, it can first plan the expected operation space task according to the pit, then calculate the expected joint torque set corresponding to the expected operation space task, and then control the outer mechanical leg group 502 and the inner mechanical leg group 503 to swing alternately according to the expected joint torque set to complete the crossing of the pit. For example, the inner mechanical leg group 503 is first used as the supporting mechanical leg group, and the outer mechanical leg group 502 is used as the swinging mechanical leg group, so that the outer mechanical leg group 502 of the robot 501 crosses the pit, and then the outer mechanical leg group 502 is used as the supporting mechanical leg group, and the inner mechanical leg group 503 is used as the swinging mechanical leg group, so that the robot 501 completely crosses the pit, and the inner mechanical leg group 503 and the outer mechanical leg group 502 swing alternately in turn to complete the crossing of the pit task.

[0060] The following will use a method embodiment to illustrate the control method of the robot provided in the embodiment of the present application.

[0061] Please refer to Figure 6 , which shows a flow chart of a robot control method provided by an embodiment of the present application. In the embodiment of the present application, the robot control method is described by taking the robot as an example of the execution subject of each step. The method may include the following steps (601-603):

[0062] Step 601, obtain the expected operation space task of the robot on the support surface, the expected operation space task includes the expected acceleration of each part of the robot in the operation space of the robot, and the expected operation space task is used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to move on the support surface.

[0063] The expected operation space task refers to the task of the robot in the operation space, which can be planned according to the robot and the real environment in which the robot is located. For example, by planning the expected movement of the robot on the supporting surface, the expected operation space task corresponding to the scene can be obtained.

[0064] The robot can control the movement of various parts of the robot through the expected acceleration in the above-mentioned expected operation space task, so as to realize the movement of the robot on the support surface, such as the robot alternately swinging the first mechanical leg group and the second mechanical leg group to move on the support surface in the form of walking. The robot in the embodiment of the present application is the same as that described in the above embodiment, and will not be repeated here.

[0065] The expected acceleration refers to the acceleration obtained in combination with the real environment and used to actually control the robot, while the reference acceleration below is a planned value, which is the acceleration used to guide the robot. The robot follows the expected acceleration and can achieve the action corresponding to the expected acceleration. For example, if the expected acceleration corresponding to the mechanical leg is used to guide the mechanical leg to swing, the robot controls the mechanical leg to follow the expected acceleration to achieve the swing of the mechanical leg.

[0066] Optionally, the expected operation space task includes the expected acceleration of each part of the robot at each control moment, so as to realize the movement of the robot as a whole according to the planned movement trajectory. The control moment refers to the moment when the robot is controlled by the control signal, and the control moment is arranged at a specified time interval, which can be set and adjusted according to actual use requirements.

[0067] In the embodiment of the present application, the support surface may include only one plane, such as a flat ground, a road, etc., or may include multiple planes of different heights, such as stairs, a road surface with a shoulder, a ground with a pit, etc., which is not limited in the embodiment of the present application. Then the expected acceleration in the above-mentioned expected operation space task can be used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to perform tasks such as walking, climbing stairs, crossing shoulders, crossing pits, etc.

[0068] The operating space of the robot is the Cartesian space corresponding to the robot. In the task-oriented whole body control of the robot, the Cartesian space corresponding to the robot can be called the operating space of the robot. In the embodiment of the present application, each position in the operating space of the robot can be characterized based on the world coordinate system of the robot.

[0069] Exemplarily, the world coordinate system of the robot can be constructed with the contact point between the foot of the robot and the supporting surface in the initial state as the origin, the horizontal direction as the x-axis direction, the vertical direction as the z-axis direction, and the direction perpendicular to both the horizontal and vertical directions as the y-axis direction. The position of the robot in the operating space can be characterized based on the three-dimensional coordinates of the robot in the world coordinate system. Optionally, the calculation processes in the embodiments of the present application all occur in the world coordinate system of the robot.

[0070] In one example, the above-mentioned parts may include the first mechanical leg group, the second mechanical leg group and the body of the robot, and the expected operation space task includes the expected accelerations corresponding to the first mechanical leg group, the second mechanical leg group and the body respectively.

[0071] Optionally, during the movement of the robot, the mechanical leg group used for swinging is the swinging mechanical leg group, and the mechanical leg group used for supporting is the supporting mechanical leg group. For example, if the first mechanical leg group is used as support and the second mechanical leg group is swung in the forward direction of the robot, the first mechanical leg group is the supporting mechanical leg group and the second mechanical leg group is the swinging mechanical leg group; if the second mechanical leg group is used as support and the first mechanical leg group is swung in the forward direction of the robot, the second mechanical leg group is the supporting mechanical leg group and the first mechanical leg group is the swinging mechanical leg group.

[0072] Among them, the supporting mechanical leg group and the swinging mechanical leg group corresponding to each step of the robot can be determined from the first mechanical leg group and the second mechanical leg group according to the gait information of the robot. The gait information can be used to indicate whether the mechanical leg of the robot is a swinging mechanical leg in each step cycle. The gait information can be planned in real time or pre-set, and this application does not limit this in real time. The step cycle is used to indicate the time length for the first mechanical leg group or the second mechanical leg group to complete a swing.

[0073] For example, refer to Figure 3 During the process of the robot 301 climbing stairs, the first mechanical leg group 302 and the second mechanical leg group 303 are used alternately for swinging, and at the same time, the second mechanical leg group 303 and the first mechanical leg group 302 are synchronously and alternately used for support, so that the robot 301 completes the climbing of stairs.

[0074] Optionally, the expected acceleration included in the expected operation space task can be calculated by a feedback controller based on the reference movement trajectory of each part of the robot and the actual state of the robot, such as a PD (Proportional Derivative) feedback controller, and other feedback controllers.

[0075] refer to Figure 7 , the above step 601 may also include the following sub-steps:

[0076] Step 601a, obtaining a first expected acceleration of the swinging mechanical leg group in the operating space according to a swinging reference movement trajectory corresponding to the swinging mechanical leg group, wherein the swinging reference movement trajectory is obtained by planning the movement trajectory of the swinging mechanical leg group according to the supporting surface.

[0077] The swing reference movement trajectory refers to the reference movement trajectory of the swing mechanical leg in the swing mechanical leg group, such as the reference movement trajectory of the foot on the swing mechanical leg. The reference movement trajectory is used to guide the movement of the robot, such as the reference movement trajectory can include the reference position of the robot at each control moment, and the reference position refers to the position that the robot is expected to reach.

[0078] For example, the initial position and end position of the swinging mechanical leg in a step cycle can be planned according to the size information of the supporting surface, and then the initial position and end position in the step cycle can be interpolated using the spline curve interpolation method to obtain the swinging reference movement trajectory in the step cycle, and then the swinging reference movement trajectory in each step cycle can be spliced ​​to obtain the final swinging reference movement trajectory.

[0079] For example, taking a four-legged wheeled robot climbing stairs as an example, based on the size information of each step of the stairs (such as width, height, length, etc.), the reference position of the swinging mechanical leg on each step can be planned (represented by three-dimensional coordinates in the world coordinate system), and then interpolation is performed between each reference position to obtain the swinging reference movement trajectory.

[0080] The first expected acceleration refers to the expected acceleration of the swinging mechanical leg at each control moment. For example, the expected acceleration of the foot of the swinging mechanical leg at each control moment can be determined as the first expected acceleration.

[0081] Exemplarily, when the robot stops moving after a plurality of control moments, the process of acquiring the first expected acceleration may be as follows:

[0082] 1. For each control moment, according to the swing reference movement trajectory, obtain the reference position, reference speed and reference acceleration of the swing mechanical leg group at the control moment.

[0083] Optionally, the reference position of the swinging mechanical leg group at a certain control moment can be directly determined according to the swinging reference movement trajectory, and then the reference speed and reference acceleration of the swinging mechanical leg group at the control moment can be obtained according to the reference position of the swinging mechanical leg group at the control moment. For example, the reference speed and reference acceleration of the swinging mechanical leg group at the control moment can be obtained by taking the first-order derivative and the second-order derivative of the reference position of the swinging mechanical leg group at the control moment. Among them, the reference speed refers to the speed expected to be reached, and the reference acceleration refers to the acceleration expected to be reached, which are not directly used to control the robot.

[0084] 2. Using a PD feedback controller, the first expected acceleration at the control moment is calculated based on the reference position, reference speed and reference acceleration of the swinging mechanical leg group at the control moment, as well as the actual position and actual speed of the swinging mechanical leg group at the control moment.

[0085] Optionally, based on the IMU on the fuselage, the acceleration, angular velocity and posture (i.e., actual Euler angle) of the fuselage can be measured, and then combined with the actual angles and actual accelerations of all joints of the robot, as well as the contact information between the robot and the supporting surface, the actual position, actual speed, actual posture and actual angular velocity of the fuselage in the world coordinate system can be obtained by using the state estimation algorithm. If the relative position, relative speed and relative angular velocity between the hip joint center point and the IMU of the hip joint are known, the state of the hip joint center point can be calculated according to the state of the fuselage (i.e., the actual position, actual speed, actual posture and actual angular velocity of the fuselage in the world coordinate system).

[0086] In the embodiment of the present application, the center point of the hip joint is the origin of the floating base coordinate system of the robot. According to the state of the center point of the hip joint, the state of the floating base coordinate system can be obtained. Combined with the actual angles and actual angular velocities of all joints of the robot, the forward kinematics of the full model of the robot can be used to calculate the actual position, actual speed, actual posture and actual angular velocity of all the connecting rods corresponding to the robot in the world coordinate system. All the connecting rods include the swinging mechanical legs, and the actual position and actual speed of the swinging mechanical legs in the operating space can be obtained. Among them, the actual position refers to the actual position of the swinging machine leg, which is the true value, and the actual speed refers to the actual speed of the swinging machine leg, which is the true value. The forward dynamics model can be used to indicate the relationship between the acceleration of the robot in the operating space and the speed and acceleration of the robot in the joint space of the robot.

[0087] Exemplarily, the first expected acceleration may be expressed as follows:

[0088]

[0089] in, and are the reference position, reference velocity and reference acceleration of the swinging mechanical leg in the operating space at the control time t, and are the actual position and actual speed of the swinging mechanical leg in the operating space at the control time t, K p,swing and K d,swing They correspond to the proportional coefficient and differential coefficient of the swinging mechanical leg respectively.

[0090] In some examples, the mechanical legs in the first mechanical leg group move synchronously, and the mechanical legs in the second mechanical leg group move synchronously, that is, the swinging mechanical legs in the swinging mechanical leg group move synchronously. If the robot has no displacement in the y-axis direction, then after ignoring the y-axis direction, the swinging reference movement trajectory of each swinging mechanical leg in the swinging mechanical leg group is the same. By calculating the first expected acceleration for any swinging mechanical leg, the first expected acceleration corresponding to the swinging mechanical leg group can be obtained, which can reduce the calculation amount of the first expected acceleration, thereby improving the control efficiency of the robot.

[0091] Step 601b, obtaining a second expected acceleration of the supporting mechanical leg group in the operating space according to a supporting reference movement trajectory corresponding to the supporting mechanical leg group, wherein the supporting reference movement trajectory is planned according to the movement trajectory of the supporting mechanical leg group by the supporting surface.

[0092] The support reference movement trajectory refers to the reference movement trajectory of the support mechanical leg in the support mechanical leg group, such as the reference movement trajectory of the foot on the support mechanical leg. The second expected acceleration includes the expected acceleration of the support mechanical leg at each control moment.

[0093] In an embodiment of the present application, in each step cycle, the reference position of the supporting mechanical leg on the supporting surface is a fixed value, and during the supporting process of the supporting mechanical leg, there is no relative sliding between the foot of the supporting mechanical leg and the supporting surface, so the value of the second expected acceleration is always zero.

[0094] Exemplarily, the second expected acceleration may be expressed as follows:

[0095]

[0096] Among them, N c is the number of supporting mechanical legs (the feet of each supporting mechanical leg in the supporting mechanical leg group are in contact with the supporting surface, N c It can also be recorded as the number of supporting contact points).

[0097] Step 601c, obtaining a third expected acceleration of the center of mass in the operating space according to a center of mass reference movement trajectory corresponding to the center of mass of the robot, wherein the center of mass reference movement trajectory is planned according to the movement trajectory of the support surface to the center of mass.

[0098] The mass center reference movement trajectory refers to the reference movement trajectory of the mass center of the robot. The third expected acceleration includes the reference position of the mass center of the robot at each control time.

[0099] Optionally, during the movement of the robot, the center of mass of the robot not only needs to move continuously along the forward direction, but also needs to help the robot maintain dynamic balance. Therefore, a balance controller needs to be built to calculate the expected acceleration of the center of mass in the forward direction.

[0100] Exemplarily, the center of mass reference movement trajectory may be divided into a sub-reference movement trajectory in the forward direction and a sub-reference movement trajectory in the vertical direction, and then the third sub-expected acceleration in the forward direction is determined according to the sub-reference movement trajectory in the forward direction, and the third sub-expected acceleration in the vertical direction is determined according to the sub-reference movement trajectory in the vertical direction. The process may include the following contents:

[0101] 1. According to the sub-reference moving trajectory of the center of mass reference moving trajectory in the first direction, obtain the third sub-expected acceleration of the center of mass in the first direction.

[0102] The first direction may be the forward direction of the robot, such as the x-axis direction of the world coordinate system.

[0103] Optionally, the robot can be converted into an inverted pendulum model for the construction of a balancing controller.

[0104] For example, since the robot always moves in the first direction (e.g., no displacement occurs in the y-axis direction of the above-mentioned world coordinate system), and the mechanical legs in the supporting mechanical leg group move synchronously, the mechanical legs in the swinging mechanical leg group move synchronously, and the hip joints of the robot are coaxial, the robot can be simplified into a sagittal plane (e.g., Figure 2 Plane model under the sagittal plane).

[0105] refer to Figure 8 When the gravity field in which the robot is located is uniform, the mass of the robot is concentrated at the center of mass 802 of the robot. The center of the line between the feet of the two supporting mechanical legs is set as the virtual support contact point 801 between the inverted pendulum model of the robot and the supporting surface. By connecting the center of mass 802 and the virtual support contact point 801, the plane model of the robot can be converted into an inverted pendulum model 800 of the robot.

[0106] After constructing the inverted pendulum model of the robot, a balance controller can be constructed according to the inverted pendulum model, and then the third sub-expected acceleration in the first direction is calculated based on the balance controller. The process can be as follows:

[0107] 1) With the position of the center of mass, the speed of the center of mass, the distance between the center of mass and the support contact point in the first direction, and the derivative of the distance as state variables, and the acceleration of the center of mass relative to the support contact point in the first direction as the control variable, the dynamic equation of the robot's inverted pendulum is constructed. The support contact point refers to the contact point between the foot corresponding to the supporting mechanical leg group and the support surface.

[0108] In the inverted pendulum model, the support contact point is represented by a virtual support contact point. For example, the inverted pendulum dynamics equation of the robot can be expressed as follows:

[0109]

[0110] Among them, Δx and are the distance between the center of mass and the support contact point in the first direction, and the derivative of the distance, x com and are the position and velocity of the center of mass in the first direction, is the acceleration of the center of mass relative to the virtual support contact point in the first direction, z com is the position of the center of mass in the second direction, and g is the acceleration due to gravity.

[0111] 2) Using the linear quadratic programming regulator, calculate the feedback gain matrix of the inverted pendulum dynamics equation.

[0112] The Linear Quadratic Regulator (LQR) is constructed based on the Quadratic Programming optimization method. Its essence is to find a multidimensional vector under linear constraints so that the quadratic objective function of the multidimensional vector is minimized (or maximized).

[0113] Exemplarily, a linear quadratic programming regulator is used to construct an objective function of the inverted pendulum dynamics equation, and then the feedback gain matrix of the inverted pendulum dynamics equation is iteratively obtained with the goal of minimizing the objective function.

[0114] 3) For each control moment, according to the sub-reference movement trajectory in the first direction, obtain the reference position, reference speed, reference distance and reference speed between the center of mass and the support contact point at the control moment and in the first direction.

[0115] Optionally, the sub-reference movement trajectory of the center of mass in the first direction can be obtained by using a planning method such as heuristic (i.e., a trajectory is given based on experience and the real environment) or an inverted pendulum model (the trajectory is planned using an inverted pendulum model), and is planned based on the reference position of the supporting mechanical leg. This is not limited to the embodiments of the present application.

[0116] Exemplarily, based on the sub-reference movement trajectory in the first direction, the reference position of the center of mass at the control time and in the first direction can be directly obtained, and then the reference position of the center of mass at the control time and in the first direction is derived first-order, to obtain the reference speed of the center of mass at the control time and in the first direction.

[0117] According to the support reference movement trajectory, the reference position and reference speed of the support contact point at the control time and the first direction can be obtained, and then the reference position of the virtual support contact point can be obtained by taking the geometric average of the reference position of the support contact point at the control time and the first direction, and the reference speed of the virtual support contact point can be obtained by taking the geometric average of the reference speed of the support contact point at the control time and the first direction, and then the reference distance between the center of mass and the virtual support contact point can be obtained by subtracting the reference position of the virtual support contact point at the control time and the first direction from the reference position of the center of mass at the control time and the first direction, and the reference speed between the center of mass and the virtual support contact point can be obtained by subtracting the reference speed of the virtual support contact point at the control time and the first direction from the reference speed of the center of mass at the control time and the first direction.

[0118] 4) According to the feedback gain matrix, the reference position of the center of mass at the control time and in the first direction, the reference speed, the reference distance and the reference speed between the center of mass and the support contact point, the third sub-expected acceleration at the control time and in the first direction is obtained.

[0119] Optionally, the reference position of the center of mass at the control time and in the first direction, the reference speed, the reference distance between the center of mass and the support contact point, and the reference speed are used as reference values ​​of the control variables, and then the control variables of the inverted pendulum dynamics equation can be obtained based on the reference values ​​of the control variables through LQR. The process can be expressed as follows:

[0120] in, is the actual value of the state variable.

[0121] Control variables of the inverted pendulum dynamics equation This is the third sub-expected acceleration in the first direction, recorded as The third sub-expected acceleration in the first direction obtained in this way can not only ensure the following of the reference moving trajectory of the center of mass in the first direction, but also maintain the dynamic balance of the robot during the movement, thereby improving the movement stability of the robot.

[0122] Optionally, the third sub-expected acceleration in the first direction can also be calculated using a PD feedback controller based on the reference position, reference velocity and reference acceleration of the center of mass in the first direction at the control moment, and the actual position and actual velocity of the center of mass in the first direction at the control moment. This embodiment of the present application is not limited to this.

[0123] 2. According to the sub-reference moving trajectory of the center of mass reference moving trajectory in the second direction, obtain the third sub-expected acceleration of the center of mass in the second direction, where the second direction is perpendicular to the first direction.

[0124] Optionally, the second direction may refer to a vertical direction, such as a z-axis direction of a world coordinate system.

[0125] In the embodiment of the present application, the height between the center of mass of the robot and the foot of the supporting mechanical leg of the robot is set to a constant value, and the constant value may refer to the distance between the center of mass of the robot and the center of the foot corresponding to the supporting mechanical leg (such as the wheel center) in the z-axis direction. Therefore, according to the supporting reference moving trajectory and the constant value, the sub-reference moving trajectory of the center of mass in the second direction can be planned. For example, using the spline curve interpolation method, based on the sum of the reference position in the supporting reference moving trajectory and the constant value, the sub-reference moving trajectory of the center of mass in the second direction is interpolated.

[0126] Optionally, the sub-reference movement trajectory in the second direction may be equivalent to the reference movement trajectory of the robot's body in the second direction. By following the sub-reference movement trajectory in the second direction, the body can be moved in the vertical direction to complete the adjustment of the center of mass position. Especially in the stair climbing scenario, by following the sub-reference movement trajectory in the second direction, the robot can climb the stairs in the vertical direction.

[0127] Exemplarily, when the robot stops moving after a plurality of control moments, the process of acquiring the third sub-expected acceleration in the second direction may be as follows:

[0128] 1. For each control moment, according to the sub-reference movement trajectory in the second direction, obtain the reference position, reference velocity and reference acceleration of the center of mass at the control moment and in the second direction.

[0129] Optionally, the reference position of the center of mass in the second direction at a certain control moment can be determined directly based on the sub-reference movement trajectory in the second direction, and then the first-order derivative and second-order derivative of the reference position of the center of mass at the control moment and the second direction are respectively performed to obtain the reference velocity and reference acceleration of the center of mass at the control moment and the second direction.

[0130] 2. Using a PD feedback controller, the third sub-expected acceleration at the control time and the second direction is calculated based on the reference position, reference velocity and reference acceleration of the center of mass at the control time and the second direction, as well as the actual position and actual velocity of the center of mass at the control time and the second direction.

[0131] Optionally, based on the IMU on the fuselage, the acceleration, angular velocity and posture (i.e., the actual Euler angle) of the fuselage can be measured, and then combined with the actual angles, actual accelerations of all joints of the robot, and the contact information between the robot and the supporting surface, the state estimation algorithm can be used to obtain the actual position, actual velocity, actual posture and actual angular velocity of the fuselage in the world coordinate system. Finally, the actual position and actual velocity of the fuselage in the world coordinate system are directly determined as the actual position and actual velocity of the center of mass in the world coordinate system, thereby obtaining the actual position and actual velocity of the center of mass in the second direction.

[0132] Exemplarily, the third sub-expected acceleration in the second direction may be expressed as follows:

[0133]

[0134] in, and are the reference position, reference velocity and reference acceleration of the center of mass at the control time t and the second direction, respectively. and The actual position and actual speed of the center of mass at the control time t and the second direction, K p,base and K d,base They correspond to the proportional coefficient and differential coefficient of the center of mass respectively.

[0135] 3. Obtain a third expected acceleration according to the third sub-expected acceleration of the center of mass in the first direction and the third sub-expected acceleration of the center of mass in the second direction.

[0136] For each control moment, the third expected acceleration of the center of mass in the first direction and the third expected acceleration of the center of mass in the second direction are combined to obtain the third expected acceleration.

[0137] Step 601d, obtaining a fourth expected acceleration of the body in the operation space according to a reference change trajectory of the body attitude of the robot, wherein the reference change trajectory of the body attitude is obtained by planning the change trajectory of the body.

[0138] The attitude reference change trajectory refers to the reference change trajectory of the attitude of the robot's body, which can be used to describe the attitude change of the robot's body, such as it can include the reference attitude of the robot's body at each control moment. Optionally, the attitude of the body can be expressed by Euler angles, such as Euler angles composed of roll, pitch and yaw of the body, and the above attitude reference change trajectory can refer to the Euler angle reference movement trajectory corresponding to the robot's body, and the Euler angle reference movement trajectory includes the reference attitude angle (i.e., reference Euler angle) at each control moment.

[0139] The fourth expected acceleration includes the expected acceleration of the robot body at each control moment. When the posture of the body is expressed by Euler angles, the expected acceleration may refer to the expected posture angular acceleration (ie, expected Euler angle acceleration).

[0140] In one example, when the robot stops moving after a plurality of control moments, the process of acquiring the fourth expected acceleration may be as follows:

[0141] 1. For each control moment, according to the attitude reference change trajectory, obtain the reference attitude angle, reference attitude angular velocity and reference attitude angular acceleration of the fuselage at the control moment.

[0142] In the embodiment of the present application, the body of the robot remains vertical during the movement of the robot, and the value of the reference attitude angle, the value of the reference attitude angular velocity, and the value of the reference attitude angular acceleration corresponding to the body are all zero. Exemplarily, the value of the reference attitude angle, the value of the reference attitude angular velocity, and the value of the reference attitude angular acceleration can be expressed as:

[0143] and

[0144] 2. Using a PD feedback controller, the fourth expected acceleration at the control moment is calculated based on the reference attitude angle, reference attitude angular velocity and reference attitude angular acceleration of the fuselage at the control moment, as well as the actual attitude angle and actual attitude angular velocity of the fuselage at the control moment.

[0145] Optionally, based on the IMU on the fuselage, the acceleration, angular velocity and posture (i.e., actual Euler angle) of the fuselage can be measured, and then combined with the actual angles, actual accelerations of all joints of the robot, and the contact information between the robot and the supporting surface, the state estimation algorithm can be used to obtain the actual position, actual speed, actual posture and actual angular velocity (i.e., actual state) of the fuselage in the world coordinate system. Finally, based on the actual state of the fuselage in the world coordinate system, the actual posture angle (i.e., actual Euler angle) and actual posture angular velocity (i.e., actual Euler angular velocity) of the fuselage can be obtained.

[0146] Exemplarily, the fourth expected acceleration may be expressed as follows:

[0147]

[0148] in, and are the actual attitude angle and actual attitude angular velocity of the fuselage in the operating space at the control time t, K p,base and K d,base They correspond to the proportional coefficient and differential coefficient of the fuselage attitude respectively.

[0149] Step 601e, obtaining the expected operation space task according to the first expected acceleration, the second expected acceleration, the third expected acceleration and the fourth expected acceleration.

[0150] Alternatively, the desired action space task can be expressed as follows:

[0151]

[0152] Step 602 : acquiring an expected joint torque set corresponding to the expected operation space task according to the expected operation space task and the whole body dynamics model of the robot, wherein the expected joint torque set includes expected joint torques for controlling various parts of the robot.

[0153] Optionally, the above-mentioned expected operation space task can be used for task-oriented whole body control of the robot, that is, considering the mass, inertia and other dynamic information of all the links of the robot, mobilizing all the degrees of freedom of the robot, and controlling the robot to complete one or more set tasks.

[0154] For example, based on the rigid body dynamics of the robot, the whole body dynamics model of the robot in the joint space system can be expressed as follows:

[0155]

[0156] in, represents the robot's joint space inertia matrix, represents the joint space offset force vector of the robot, which is the sum of the Coriolis force, centrifugal force and gravity corresponding to the robot. represents the robot's selection matrix, represents the Jacobian matrix of the contact points between the robot and the support surface, represents the active joint torque vector of the robot, represents the robot's contact force vector, q, Represents the generalized position vector, generalized velocity vector and generalized acceleration vector at each degree of freedom of the robot, N G Represents the total degree of freedom of the robot, that is, the floating basis degree of freedom N F and the active joint degrees of freedom N J sum, N c Indicates the number of contact forces corresponding to the robot, that is, the number of contact points n C With the dimension N of a single contact force D ∈{0, 1, 2, 3}.

[0157] by Figure 2Taking the quadruped wheeled leg robot in as an example, the connecting rods of the quadruped wheeled leg robot may include 4 mechanical legs, 4 wheels, the waist in the fuselage (as a separate connecting root) and the torso, upper limbs and head in the fuselage (the three are a whole). Among them, the active joints of the quadruped wheeled leg robot may include 2 hip joints, linear telescopic joints corresponding to the 4 mechanical legs, rotation joints of the 4 wheels, and 1 pitch rotation joint (pitch + roll). Optionally, the robot's active joint degrees of freedom are the degrees of freedom corresponding to the above 11 active joints.

[0158] The floating base degrees of freedom refer to the six degrees of freedom of the robot's floating base coordinate system in the world coordinate system, namely, position px-py-pz and posture yaw-roll-pitch. The floating base coordinate system is constructed with the hip joint rotation center as the origin, and the coordinate axis direction of the floating base coordinate system in the initial state is the same as that of the world coordinate system. The number of contact points can refer to the number of mechanical legs used for support, such as the number of contact points is 2 during the swinging process of the swinging mechanical leg group.

[0159] In one example, reference Fig. 9 , step 602 may also include the following sub-steps:

[0160] Step 602a, obtaining a forward dynamics model of the robot, where the forward dynamics model is used to indicate the relationship between the acceleration of the robot in the operation space and the velocity and acceleration of the robot in the joint space of the robot.

[0161] Alternatively, from rigid body dynamics, the forward dynamics model of the robot can be expressed as follows:

[0162]

[0163] in, represents the acceleration of the robot in the operating space at the control time t, and They represent the velocity and acceleration of the robot in the joint space, that is, the generalized position vector and generalized velocity vector at each degree of freedom of the robot, J t and Represents the Jacobian matrix and the first-order derivative of the Jacobian matrix corresponding to the operation space.

[0164] Step 602b, the whole body dynamics model and the forward dynamics model are combined to obtain the dynamics equation to be solved, and the dynamics equation to be solved uses the acceleration of the robot in the joint space as an unknown variable.

[0165] The whole body dynamics model and the forward dynamics model are combined and simplified to obtain:

[0166] in, is an unknown variable, and the rest are known variables.

[0167] Step 602c, bringing the expected operation space task into the dynamic equation to be solved, and solving to obtain the expected joint torque set.

[0168] Optionally, during the movement of the robot, it is also subject to the physical limitations of the robot's body structure and the drive motor. In order to improve the rationality and accuracy of the expected joint torque set, the present application also sets constraints in the process of solving the expected joint torque set. Then step 602c may also include the following content:

[0169] 1. Replace the desired operation space task with the acceleration of the robot in the operation space in the dynamic equation to be solved to obtain the intermediate dynamic equation.

[0170] Optionally, the above , and the acceleration of the robot in the operation space in the dynamic equation to be solved By substituting, we can obtain the intermediate kinetic equation.

[0171] 2. Construct the joint physical constraint expression and friction constraint expression of the robot. The joint physical constraint expression is used to constrain the various joints of the robot. The contact force between the robot and the supporting surface under the constraint of the friction constraint expression satisfies the friction cone constraint.

[0172] Optionally, according to the actual physical characteristics of the robot's drive motor, the active joint torque in the unknown variable is limited by τ, that is, the joint physical constraint expression can be: τ lb ≤τ≤τ ub ; where τ lb and τ ub Respectively represent the minimum and maximum value of the driving motor torque.

[0173] Optionally, the contact force corresponding to the foot of the robot's mechanical leg should satisfy the friction cone constraint. In order to reduce nonlinearity, the friction cone can be approximated as a friction angle cone, and the friction constraint expression can be:

[0174]

[0175] Among them, n x 、n y and n z They represent the unit orthogonal basis along the contact surface in the world coordinate system, μ i represents the friction coefficient corresponding to the i-th contact force, f i represents the ith contact force, f z,1b and f z,ubRespectively represent the minimum and maximum values ​​of the non-negative positive pressure perpendicular to the contact surface.

[0176] 3. Under the constraints of the robot's joint physical constraint expressions and friction constraint expressions, the intermediate dynamic equations are solved to obtain the desired joint torque set.

[0177] Alternatively, the intermediate kinetic equation can be rewritten in the form of AX = B;

[0178] in,

[0179] The essence of the solution process of AX=B is to find the solution of the linear equations. Here, the quadratic programming optimization method can be used to construct the objective function of the intermediate dynamics equation.

[0180] Alternatively, the objective function of the intermediate kinetic equation can be expressed as follows:

[0181] J = min(AX-B) T Q(AX-B)+X T RX;

[0182] Among them, Q and R represent weight matrices.

[0183] Under the constraints of the joint physical constraint expression and the friction constraint expression of the robot, the desired joint torque set is obtained by minimizing the objective function as the optimization goal. For example, through the quadratic programming optimizer, under the constraints of the joint physical constraint expression and the friction constraint expression of the robot, the unknown variable X can be obtained by minimizing the objective function as the optimization goal, and the active joint torque τ in the unknown variable X can be directly determined as the desired joint torque set.

[0184] by Figure 2 Taking a quadruped wheel-legged robot as an example, the expected joint torque set can include the expected joint torques corresponding to two hip joints, the linear telescopic joints corresponding to four mechanical legs, the rotation joints of four wheels, and one pitch rotation joint (pitch + roll).

[0185] Alternatively, if the robot model structure is relatively simple, the robot dynamics equation is also relatively simple, and the intermediate dynamics equation can be solved directly by using the matrix inversion method, that is, X = A -1 B, to obtain the desired joint torque set.

[0186] Step 603, according to the expected joint torque set, control the robot to move under the guidance of the expected operation space task.

[0187] The expected joint torque set includes the expected joint torques of each active joint of the robot at each control moment. At any control moment, it is only necessary to drive the drive motors corresponding to each active joint according to the expected joint torque of each active joint at that control moment, so as to achieve the following of the expected operation control task. That is, the robot can move under the guidance of the expected operation space task, follow the various reference movement trajectories corresponding to the expected operation space task, and realize the control of the robot.

[0188] In summary, the technical solution provided by the embodiment of the present application is that for a robot having a first mechanical leg group and a second mechanical leg group, since the rotation centers of the corresponding hip joints are located in the same vertical plane, the robot can be made to stand with one set of mechanical legs and move quickly in a dynamic equilibrium state (i.e., the center of gravity of the robot can exceed the support area of ​​the robot) by planning the expected operation space task. At the same time, the robot's movement can be controlled by alternating the swinging of the first mechanical leg group and the second mechanical leg group, which can further improve the robot's movement efficiency.

[0189] Among them, the center of gravity of the robot refers to the point where the gravity of the robot is concentrated, and the center of mass of the robot is the weighted average of the position of the mass point with respect to its mass. If the gravity is uniform, the center of mass and the center of gravity can coincide. The support area of ​​the robot refers to the area enclosed by the contact points between the feet on each mechanical leg of the robot and the support surface. The related technology needs to always control the projection of the center of gravity within the support area, resulting in a very small center of mass speed of the robot and a very slow entire movement. The center of gravity of the robot in the embodiment of the present application can exceed the support area of ​​the robot, and the entire movement is very fast, thereby improving the movement efficiency of the robot.

[0190] In addition, by adopting the robot's whole-body dynamics model, the expected joint torque set corresponding to the expected operating space task can be accurately obtained according to the expected operating space task, and then the expected operating space task can be accurately achieved according to the expected joint torque set, thereby improving the control accuracy of the robot.

[0191] In addition, under the constraints of the robot's joint physical constraint expressions and friction constraint expressions, solving the intermediate dynamic equations can obtain a reasonable and accurate set of expected joint torques, which can further improve the robot's control accuracy.

[0192] In addition, the inverted pendulum model is used to calculate the third expected acceleration of the center of mass in the forward direction, so that the center of mass of the robot can not only move continuously along the forward direction, but also help the robot maintain dynamic balance, so that the robot can move stably and quickly, further improving the control stability and movement efficiency of the robot.

[0193] In some embodiments, reference Figure 10-12 Taking a four-legged wheeled robot climbing stairs as an example, the technical solution provided by the embodiment of the present application is described, which may include the following contents:

[0194] The quadruped wheel-legged robot 1000 climbs a step in each step cycle, and the reference position (including the coordinates in the x-axis direction and the z-axis direction) of the quadruped wheel-legged robot 1000 on each step can be planned based on the size information of each step and the radius of the wheel. Then, based on the reference position, the support movement reference trajectory of the support mechanical leg group, the swing movement reference trajectory of the swing mechanical leg group, and the robot's center of mass reference movement trajectory are planned. Since the quadruped wheel-legged robot 1000 always remains vertical during the movement, the posture change reference trajectory of the quadruped wheel-legged robot 1000 can be planned.

[0195] The quadruped wheeled-legged robot 1000 adopts the technical solution provided by the above-mentioned embodiment, and obtains the first expected acceleration of the swinging mechanical leg group at each control moment according to the swinging reference movement trajectory, obtains the second expected acceleration of the supporting mechanical leg group at each control moment according to the supporting reference movement trajectory, obtains the third expected acceleration of the center of mass at each control moment according to the center of mass reference movement trajectory, and obtains the fourth expected acceleration of the body at each control moment according to the posture reference change trajectory, and then obtains the expected operation space task of the quadruped wheeled-legged robot 1000 based on the first expected acceleration, the second expected acceleration, the third expected acceleration and the fourth expected acceleration at each control moment.

[0196] The quadruped wheel-legged robot 1000 continues to adopt the technical solution provided in the above-mentioned embodiment to obtain the expected joint torque set corresponding to the expected operation space task, which includes the expected joint torques of the two hip joints, the expected joint torques of the linear telescopic joints corresponding to the four mechanical legs, the expected joint torques of the rotation joints of the four wheels, and the expected joint torque of one pitch rotation joint at each control moment.

[0197] The quadruped wheeled leg robot 1000 is controlled to climb stairs according to the desired joint torque set. The specific contents may be as follows:

[0198] The initial state of the quadruped wheel-legged robot 1000 climbing stairs is an overlapping standing state, that is, the four mechanical legs of the quadruped wheel-legged robot 1000 in the initial state are synchronously close together in the forward direction (such as horizontally to the right). The embodiment of the present application does not limit the initial state of the quadruped wheel-legged robot 1000, for example, it can be a four-legged support standing state or a two-legged support standing state.

[0199] 1. In the first step cycle (i.e. Fig.10 ), the four-legged wheeled robot 1000 is supported by the outer mechanical leg group 1001 (i.e. the first mechanical leg group) and swings the inner mechanical leg group 1002 (i.e. the second mechanical leg group) in the forward direction, so that the four-legged wheeled robot 1000 climbs the first step of the stairs.

[0200] Among them, for the two inner mechanical legs in the inner mechanical leg group 1002, the inner hip joint is controlled to rotate according to the desired joint torque of its corresponding hip joint (hereinafter referred to as the inner hip joint), so that the two inner mechanical legs swing synchronously in the forward direction, and at the same time, the inner linear telescopic joint is controlled to contract according to the desired joint torque of its corresponding linear telescopic joint (hereinafter referred to as the inner linear telescopic joint), and the leg length of the two inner mechanical legs is shortened synchronously, so that the two inner mechanical legs are higher than the first step and do not contact the first step.

[0201] Then, the desired joint torque of the inner hip joint is continued to control the rotation of the inner hip joint so that the two inner mechanical legs continue to swing synchronously in the forward direction. At the same time, the desired joint torque of the inner linear telescopic joint is used to control the extension of the inner linear telescopic joint to synchronously extend the leg length of the two inner mechanical legs so that the inner mechanical leg group 1002 reaches the reference position of the first step.

[0202] In this process, the quadruped wheeled leg robot 1000 controls the two outer mechanical legs in the outer mechanical leg group 1001 to adaptively and synchronously extend through the desired joint torque of the outer linear telescopic joint, and keeps the two outer mechanical legs standing through the desired joint torque of the outer hip joint. The quadruped wheeled leg robot 1000 controls the body to remain vertical through the desired joint torque of the pitch rotation joint.

[0203] 2. In the second step cycle (i.e. Fig.11 ), the quadruped wheeled leg type robot 1000 uses the inner mechanical leg group 1002 as support and swings the outer mechanical leg group 1001 in the forward direction so that the quadruped wheeled leg type robot 1000 climbs onto the second step of the stairs.

[0204] Among them, for the two outer mechanical legs in the outer mechanical leg group 1001, the rotation of the outer hip joint is controlled by the desired joint torque of the outer hip joint, so that the two outer mechanical legs swing synchronously in the forward direction. At the same time, the contraction of the outer linear telescopic joint is controlled by the desired joint torque of the outer linear telescopic joint, and the leg length of the two outer mechanical legs is controlled to be shortened synchronously, so that the two outer mechanical legs are higher than the first step and do not contact the first step.

[0205] Then, the desired joint torque of the outer hip joint is continued to control the rotation of the outer hip joint, so that the two outer mechanical legs continue to swing synchronously in the forward direction. At the same time, the desired joint torque of the outer linear telescopic joint is continued to control the contraction of the outer linear telescopic joint to control the synchronous shortening of the leg lengths of the two outer mechanical legs, so that the two outer mechanical legs are higher than the second step and do not touch the second step.

[0206] Finally, the desired joint torque of the external hip joint is continued to control the rotation of the external hip joint, so that the two external mechanical legs continue to swing synchronously in the forward direction. At the same time, the desired joint torque of the external linear telescopic joint is used to control the extension of the external linear telescopic joint, and the leg length of the two external mechanical legs is synchronously extended, so that the external mechanical leg group 1001 reaches the reference position of the second step.

[0207] In this process, the quadruped wheel-legged robot 1000 controls the two inner mechanical legs in the inner mechanical leg group 1002 to extend adaptively and synchronously through the desired joint torque of the inner linear telescopic joint, and keeps the two inner mechanical legs standing through the desired joint torque of the inner hip joint. The quadruped wheel-legged robot 1000 controls the body to remain vertical through the desired joint torque of the pitch rotation joint. The body of the quadruped wheel-legged robot 1000 follows the extension of the two inner mechanical legs and moves in the vertical and forward directions at the same time to achieve the adjustment of the center of mass of the quadruped wheel-legged robot 1000.

[0208] 3. In the third step cycle (i.e. Fig.12 ), the quadruped wheeled leg robot 1000, supported by the outer mechanical leg group 1001, swings the inner mechanical leg group 1002 in the forward direction so that the quadruped wheeled leg robot 1000 climbs the third step of the stairs.

[0209] Among them, for the two inner mechanical legs in the inner mechanical leg group 1002, the rotation of the inner hip joint is controlled by the desired joint torque of the inner hip joint, so that the two inner mechanical legs swing synchronously in the forward direction. At the same time, the contraction of the inner linear telescopic joint is controlled by the desired joint torque of the inner linear telescopic joint, and the leg length of the two inner mechanical legs is controlled to be shortened synchronously, so that the two inner mechanical legs are higher than the second step and do not contact the second step.

[0210] Then, the desired joint torque of the inner hip joint is continued to control the rotation of the inner hip joint, so that the two inner mechanical legs continue to swing synchronously in the forward direction. At the same time, the desired joint torque of the inner linear telescopic joint is continued to control the contraction of the inner linear telescopic joint to control the synchronous shortening of the leg lengths of the two inner mechanical legs, so that both inner mechanical legs are higher than the third step and do not touch the third step.

[0211] Finally, the desired joint torque of the inner hip joint is continued to control the rotation of the inner hip joint, so that the two inner mechanical legs continue to swing synchronously in the forward direction. At the same time, the desired joint torque of the inner linear telescopic joint is used to control the extension of the inner linear telescopic joint, and the leg length of the two inner mechanical legs is synchronously extended, so that the inner mechanical leg group 1002 reaches the reference position of the third step.

[0212] In this process, the quadruped wheel-legged robot 1000 controls the two outer mechanical legs in the outer mechanical leg group 1001 to extend adaptively and synchronously through the desired joint torque of the outer linear telescopic joint, and keeps the two outer mechanical legs standing through the desired joint torque of the outer hip joint. The quadruped wheel-legged robot 1000 controls the body to remain vertical through the desired joint torque of the pitch rotation joint. The body of the quadruped wheel-legged robot 1000 follows the extension of the two outer mechanical legs and moves in the vertical and forward directions at the same time to achieve the center of mass adjustment of the quadruped wheel-legged robot 1000.

[0213] In the subsequent stepping cycle, the inner mechanical leg group 1002 and the outer mechanical leg group 1001 swing alternately, so that the quadruped wheel-legged robot 1000 climbs up the stairs.

[0214] In summary, the technical solution provided by the embodiment of the present application is that for a four-legged wheeled robot with an inner mechanical leg group and an outer mechanical leg group, since the rotation centers of the corresponding hip joints are located in the same vertical plane, a set of mechanical legs can be used to keep the robot standing, and the other set of mechanical legs can be swung, so that the robot can quickly climb stairs in a dynamic balance state (i.e., the center of gravity of the robot can exceed the support area of ​​the robot), thereby improving the robot's mobility. At the same time, the robot can be controlled to climb stairs by alternating the swinging of the inner mechanical leg group and the outer mechanical leg group, which can further improve the robot's stair climbing efficiency.

[0215] In addition, by adopting the robot's whole-body dynamics model, the expected joint torque set corresponding to the expected operating space task can be accurately obtained according to the expected operating space task, and then the expected operating space task can be accurately achieved according to the expected joint torque set, thereby improving the control accuracy of the quadruped wheeled-legged robot.

[0216] The following are device embodiments of the present application, which can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0217] refer to Fig.13, which shows a block diagram of a robot control device provided by an embodiment of the present application. The device has the function of implementing the above-mentioned robot control method, and the function can be implemented by hardware, or by hardware executing corresponding software. The device can be the computer device introduced above (such as a wheel-legged robot), or it can be placed in a computer device. Fig.13 As shown, the device 1300 includes: a desired task acquisition module 1301 , a desired torque acquisition module 1302 and a robot movement module 1303 .

[0218] The expected task acquisition module 1301 is used to obtain the expected operating space task of the robot on the supporting surface, and the expected operating space task includes the expected acceleration of each part of the robot in the operating space of the robot. The expected operating space task is used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to move on the supporting surface.

[0219] The expected torque acquisition module 1302 is used to acquire the expected joint torque set corresponding to the expected operation space task according to the expected operation space task and the whole body dynamics model of the robot, and the expected joint torque set includes the expected joint torques for controlling various parts of the robot.

[0220] The robot movement module 1303 is used to control the robot to move under the guidance of the expected operation space task according to the expected joint torque set.

[0221] In some embodiments, Fig.14 As shown, the desired torque acquisition module 1302 includes: a forward model acquisition submodule 1302a, a dynamic model simultaneous submodule 1302b and a desired torque acquisition submodule 1302c.

[0222] The forward model acquisition submodule 1302a is used to acquire the forward dynamics model of the robot, and the forward dynamics model is used to indicate the relationship between the acceleration of the robot in the operation space and the velocity and acceleration of the robot in the joint space of the robot.

[0223] The dynamic model simultaneous submodule 1302b is used to simultaneously simulate the whole-body dynamic model and the forward dynamic model to obtain the dynamic equation to be solved, wherein the dynamic equation to be solved uses the acceleration of the robot in the joint space as an unknown variable.

[0224] The expected torque acquisition submodule 1302c is used to bring the expected operation space task into the dynamic equation to be solved, and solve it to obtain the expected joint torque set.

[0225] In some embodiments, the desired torque acquisition submodule 1302c is used to:

[0226] Substituting the desired operation space task with the acceleration of the robot in the operation space in the dynamic equation to be solved to obtain an intermediate dynamic equation;

[0227] Constructing a joint physical constraint expression and a friction constraint expression of the robot, wherein the joint physical constraint expression is used to constrain each joint of the robot, and the contact force between the robot and the support surface constrained by the friction constraint expression satisfies a friction cone constraint;

[0228] Under the constraints of the joint physical constraint expressions and friction constraint expressions of the robot, the intermediate dynamics equations are solved to obtain the desired joint torque set.

[0229] In some embodiments, the expected torque acquisition submodule 1302c is further used to:

[0230] Using a quadratic programming optimization method to construct an objective function of the intermediate dynamics equation;

[0231] Under the constraints of the joint physical constraint expressions and the friction constraint expressions of the robot, the desired joint torque set is obtained by taking minimization of the objective function as the optimization goal.

[0232] In some embodiments, during the movement of the robot, the mechanical leg group used for swinging is a swinging mechanical leg group, and the mechanical leg group used for supporting is a supporting mechanical leg group; Fig.14 As shown, the expected task acquisition module 1301 includes: a first acceleration acquisition submodule 1301a, a second acceleration acquisition submodule 1301b, a third acceleration acquisition submodule 1301c, a fourth acceleration acquisition submodule 1301d and an expected task acquisition submodule 1301e.

[0233] The first acceleration acquisition submodule 1301a is used to obtain the first expected acceleration of the swinging mechanical leg group in the operating space according to the swinging reference movement trajectory corresponding to the swinging mechanical leg group, and the swinging reference movement trajectory is obtained by planning the movement trajectory of the swinging mechanical leg group according to the supporting surface.

[0234] The second acceleration acquisition submodule 1301b is used to obtain the second expected acceleration of the supporting mechanical leg group in the operating space according to the supporting reference movement trajectory corresponding to the supporting mechanical leg group, and the supporting reference movement trajectory is planned according to the movement trajectory of the supporting surface to the supporting mechanical leg group.

[0235] The third acceleration acquisition submodule 1301c is used to obtain the third expected acceleration of the center of mass in the operating space according to the center of mass reference movement trajectory corresponding to the center of mass of the robot, and the center of mass reference movement trajectory is planned according to the movement trajectory of the support surface to the center of mass.

[0236] The fourth acceleration acquisition submodule 1301d is used to acquire a fourth expected acceleration of the body in the operation space according to a reference change trajectory of the posture of the body of the robot, wherein the reference change trajectory of the posture is obtained by planning the change trajectory of the body.

[0237] The expected task acquisition submodule 1301e is used to acquire the expected operation space task according to the first expected acceleration, the second expected acceleration, the third expected acceleration and the fourth expected acceleration.

[0238] In some embodiments, the robot stops moving after a plurality of control moments; the first acceleration acquisition submodule 1301a is used to:

[0239] For each of the control moments, according to the swing reference movement trajectory, a reference position, a reference speed and a reference acceleration of the swing mechanical leg group at the control moment are obtained;

[0240] A proportional differential PD feedback controller is used to calculate the first expected acceleration at the control moment according to the reference position, reference speed and reference acceleration of the swinging mechanical leg group at the control moment, as well as the actual position and actual speed of the swinging mechanical leg group at the control moment.

[0241] In some embodiments, during the supporting process of the supporting mechanical leg, there is no relative sliding between the foot of the supporting mechanical leg and the supporting surface, and the value of the second expected acceleration is always zero.

[0242] In some embodiments, the robot moves in a first direction; the third acceleration acquisition submodule 1301c is used to:

[0243] Acquire a third sub-expected acceleration of the center of mass in the first direction according to a sub-reference moving trajectory of the center of mass reference moving trajectory in the first direction;

[0244] acquiring, according to a sub-reference moving trajectory of the reference moving trajectory of the center of mass in a second direction, a third sub-expected acceleration of the center of mass in the second direction, wherein the second direction is perpendicular to the first direction;

[0245] The third expected acceleration is obtained according to the third sub-expected acceleration of the center of mass in the first direction and the third sub-expected acceleration of the center of mass in the second direction.

[0246] In some embodiments, the robot stops moving after a plurality of control moments; the third acceleration acquisition submodule 1301c is further used for:

[0247] The position of the center of mass, the speed of the center of mass, the distance between the center of mass and the support contact point in the first direction, and the derivative of the distance are used as state variables, and the acceleration of the center of mass relative to the support contact point in the first direction is used as a control variable to construct the inverted pendulum dynamics equation of the robot, wherein the support contact point refers to the contact point between the foot corresponding to the supporting mechanical leg group and the support surface;

[0248] Utilizing a linear quadratic programming regulator, calculating a feedback gain matrix of the inverted pendulum dynamics equation;

[0249] For each of the control moments, according to the sub-reference movement trajectory in the first direction, obtain a reference position, a reference speed, a reference distance and a reference speed between the center of mass and a support contact point in the first direction at the control moment;

[0250] According to the feedback gain matrix, the reference position, reference speed, reference distance and reference speed between the center of mass and the support contact point at the control moment and the first direction, the third sub-expected acceleration at the control moment and the first direction is obtained.

[0251] In some embodiments, the robot stops moving after a plurality of control moments; the third acceleration acquisition submodule 1301c is further used for:

[0252] For each of the control moments, according to the sub-reference movement trajectory in the second direction, obtaining a reference position, a reference velocity, and a reference acceleration of the center of mass in the second direction at the control moment;

[0253] A proportional differential PD feedback controller is used to calculate the third sub-expected acceleration at the control moment and the second direction based on the reference position, reference velocity and reference acceleration of the center of mass at the control moment and the second direction, as well as the actual position and actual velocity of the center of mass at the control moment and the second direction.

[0254] In some embodiments, the robot stops moving after a plurality of control moments; the fourth acceleration acquisition submodule 1301d is used to:

[0255] For each of the control moments, according to the reference attitude change trajectory, obtaining a reference attitude angle, a reference attitude angular velocity, and a reference attitude angular acceleration of the fuselage at the control moment;

[0256] A proportional differential PD feedback controller is adopted to calculate the fourth expected acceleration at the control moment according to the reference attitude angle, reference attitude angular velocity and reference attitude angular acceleration of the fuselage at the control moment, and the actual attitude angle and actual attitude angular velocity of the fuselage at the control moment.

[0257] In some embodiments, the body of the robot remains vertical during the movement of the robot, and the value of the reference posture angle, the value of the reference posture angular velocity, and the value of the reference posture angular acceleration corresponding to the body are all zero.

[0258] In some embodiments, the hip joints of the robot are coaxial.

[0259] In some embodiments, the robotic legs in the first robotic leg group move synchronously, and the robotic legs in the second robotic leg group move synchronously.

[0260] In summary, the technical solution provided by the embodiment of the present application is that for a robot having a first mechanical leg group and a second mechanical leg group, since the rotation centers of the corresponding hip joints are located in the same vertical plane, the robot can be made to stand with one set of mechanical legs and move quickly in a dynamic equilibrium state (i.e., the center of gravity of the robot can exceed the support area of ​​the robot) by planning the expected operation space task. At the same time, the robot's movement can be controlled by alternating the swinging of the first mechanical leg group and the second mechanical leg group, which can further improve the robot's movement efficiency.

[0261] In addition, by adopting the robot's whole-body dynamics model, the expected joint torque set corresponding to the expected operating space task can be accurately obtained according to the expected operating space task, and then the expected operating space task can be accurately achieved according to the expected joint torque set, thereby improving the control accuracy of the robot.

[0262] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0263] Please refer to Fig.15, which shows a simplified structural block diagram of a computer device provided by an embodiment of the present application. The computer device may refer to any electronic device with data calculation, processing and storage capabilities.

[0264] Alternatively, if Fig.15 As shown, the computer device includes a processor 1501 and a memory 1502. The processor 1501 includes but is not limited to any of the following: CPU (Central Processing Unit), GPU (Graphics Processing Unit) and FPGA (Field Programmable Gate Array). The memory 1502 may include storage devices such as RAM (Random-Access Memory) and ROM (Read-Only Memory). The processor 1501 and the memory 1502 may be connected via a system bus.

[0265] In some embodiments, a computer program is stored in the memory 1502 , and the computer program is loaded and executed by the processor 1501 to implement the above-mentioned robot control method.

[0266] In some embodiments, a computer-readable storage medium is also provided, in which a computer program is stored. When the computer program is executed by a processor of a computer device, the control method of the robot is implemented.

[0267] Optionally, the computer readable storage medium may include: ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives) or optical disks, etc. Among them, the random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0268] In some embodiments, a computer program product is further provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the above-mentioned robot control method.

[0269] It should be noted that, before collecting the relevant data of the user and during the process of collecting the relevant data of the user, the embodiment of the present application can display a prompt interface, a pop-up window or output a voice prompt information, and the prompt interface, pop-up window or voice prompt information is used to prompt the user that the relevant data is currently being collected, so that the present application only starts to execute the relevant steps of obtaining the relevant data of the user after obtaining the confirmation operation issued by the user on the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user on the prompt interface or pop-up window is not obtained), the relevant steps of obtaining the relevant data of the user are terminated, that is, the relevant data of the user is not obtained. In other words, all user data collected by this application are processed strictly in accordance with the requirements of the laws and regulations of relevant countries, and the informed consent or separate consent of the subject of personal information is obtained with the consent and authorization of the user. The subsequent data use and processing behavior is carried out within the scope of authorization of laws and regulations and the subject of personal information, and the collection, use and processing of relevant user data need to comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the real environment involved in this application is obtained with full authorization.

[0270] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0271] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A robot control method, characterized in that: The robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and a rotation center of a hip joint corresponding to the first mechanical leg group and a rotation center of a hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the method comprises: Acquire an expected operation space task of the robot on a support surface, wherein the expected operation space task includes expected accelerations of various parts of the robot in the operation space of the robot, and the expected operation space task is used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to move on the support surface; According to the expected operation space task and the whole body dynamics model of the robot, an expected joint torque set corresponding to the expected operation space task is acquired, wherein the expected joint torque set includes expected joint torques for controlling various parts of the robot; According to the expected joint torque set, the robot is controlled to move under the guidance of the expected operation space task.

2. The method according to claim 1, characterized in that The step of obtaining an expected joint torque set corresponding to the expected operation space task according to the expected operation space task and the whole body dynamics model of the robot includes: Acquire a forward dynamics model of the robot, wherein the forward dynamics model is used to indicate a relationship between an acceleration of the robot in the operation space and a velocity and acceleration of the robot in a joint space of the robot; The whole-body dynamics model and the forward dynamics model are combined to obtain a dynamics equation to be solved, wherein the dynamics equation to be solved uses the acceleration of the robot in the joint space as an unknown variable; The desired operation space task is introduced into the dynamic equation to be solved, and the desired joint torque set is obtained by solving the equation.

3. The method according to claim 2, characterized in that The step of bringing the expected operation space task into the dynamic equation to be solved and solving the expected joint torque set includes: Substituting the desired operation space task with the acceleration of the robot in the operation space in the dynamic equation to be solved to obtain an intermediate dynamic equation; Constructing a joint physical constraint expression and a friction constraint expression of the robot, wherein the joint physical constraint expression is used to constrain each joint of the robot, and the contact force between the robot and the support surface constrained by the friction constraint expression satisfies a friction cone constraint; Under the constraints of the joint physical constraint expressions and friction constraint expressions of the robot, the intermediate dynamics equations are solved to obtain the desired joint torque set.

4. The method according to claim 3, characterized in that The intermediate dynamic equation is solved under the constraints of the joint physical constraint expression and the friction constraint expression of the robot to obtain the desired joint torque set, including: Using a quadratic programming optimization method to construct an objective function of the intermediate dynamics equation; Under the constraints of the joint physical constraint expressions and the friction constraint expressions of the robot, the desired joint torque set is obtained by taking minimization of the objective function as the optimization goal.

5. The method according to claim 1, characterized in that During the movement of the robot, the mechanical leg group used for swinging is the swinging mechanical leg group, and the mechanical leg group used for supporting is the supporting mechanical leg group; The obtaining of the expected operation space task of the robot on the support surface comprises: According to the swing reference movement trajectory corresponding to the swing mechanical leg group, a first expected acceleration of the swing mechanical leg group in the operation space is obtained, wherein the swing reference movement trajectory is obtained by planning the movement trajectory of the swing mechanical leg group according to the support surface; According to the support reference movement trajectory corresponding to the support mechanical leg group, a second expected acceleration of the support mechanical leg group in the operation space is obtained, wherein the support reference movement trajectory is obtained by planning the movement trajectory of the support mechanical leg group according to the support surface; Obtaining a third expected acceleration of the center of mass in the operation space according to a center of mass reference movement trajectory corresponding to the center of mass of the robot, wherein the center of mass reference movement trajectory is planned according to the movement trajectory of the center of mass of the support surface; acquiring a fourth expected acceleration of the body in the operation space according to a reference change trajectory of the posture of the body of the robot, wherein the reference change trajectory of the posture is obtained by planning the change trajectory of the body; The expected operation space task is acquired according to the first expected acceleration, the second expected acceleration, the third expected acceleration and the fourth expected acceleration.

6. The method according to claim 5, characterized in that The robot stops moving after a plurality of control moments; The step of obtaining a first expected acceleration of the swinging mechanical leg group in the operating space according to the swinging reference movement trajectory corresponding to the swinging mechanical leg group includes: For each of the control moments, according to the swing reference movement trajectory, a reference position, a reference speed and a reference acceleration of the swing mechanical leg group at the control moment are obtained; A proportional differential PD feedback controller is used to calculate the first expected acceleration at the control moment based on the reference position, reference speed and reference acceleration of the swinging mechanical leg group at the control moment, as well as the actual position and actual speed of the swinging mechanical leg group at the control moment.

7. The method according to claim 5, characterized in that During the supporting process of the supporting mechanical leg, there is no relative sliding between the foot of the supporting mechanical leg and the supporting surface, and the value of the second expected acceleration is always zero.

8. The method according to claim 5, characterized in that The robot moves in a first direction; The obtaining, according to the center of mass reference movement trajectory corresponding to the center of mass of the robot, a third expected acceleration of the center of mass in the operation space includes: Acquire a third sub-expected acceleration of the center of mass in the first direction according to a sub-reference moving trajectory of the center of mass reference moving trajectory in the first direction; acquiring, according to a sub-reference moving trajectory of the reference moving trajectory of the center of mass in a second direction, a third sub-expected acceleration of the center of mass in the second direction, wherein the second direction is perpendicular to the first direction; The third expected acceleration is obtained according to the third sub-expected acceleration of the center of mass in the first direction and the third sub-expected acceleration of the center of mass in the second direction.

9. The method according to claim 8, characterized in that The robot stops moving after a plurality of control moments; The acquiring, according to the sub-reference moving trajectory of the center of mass reference moving trajectory in the first direction, a third sub-expected acceleration of the center of mass in the first direction comprises: The position of the center of mass, the speed of the center of mass, the distance between the center of mass and the support contact point in the first direction, and the derivative of the distance are used as state variables, and the acceleration of the center of mass relative to the support contact point in the first direction is used as a control variable to construct the inverted pendulum dynamics equation of the robot, wherein the support contact point refers to the contact point between the foot corresponding to the supporting mechanical leg group and the support surface; Utilizing a linear quadratic programming regulator, calculating a feedback gain matrix of the inverted pendulum dynamics equation; For each of the control moments, according to the sub-reference movement trajectory in the first direction, obtain a reference position, a reference speed, a reference distance and a reference speed between the center of mass and a support contact point in the first direction at the control moment; According to the feedback gain matrix, the reference position, reference speed, reference distance and reference speed between the center of mass and the support contact point at the control moment and the first direction, the third sub-expected acceleration at the control moment and the first direction is obtained.

10. The method according to claim 8, characterized in that The robot stops moving after a plurality of control moments; The acquiring, according to the sub-reference moving trajectory of the center of mass reference moving trajectory in the second direction, a third sub-expected acceleration of the center of mass in the second direction comprises: For each of the control moments, according to the sub-reference movement trajectory in the second direction, obtaining a reference position, a reference velocity, and a reference acceleration of the center of mass in the second direction at the control moment; A proportional differential PD feedback controller is used to calculate the third sub-expected acceleration at the control moment and the second direction based on the reference position, reference velocity and reference acceleration of the center of mass at the control moment and the second direction, as well as the actual position and actual velocity of the center of mass at the control moment and the second direction.

11. The method according to claim 5, characterized in that The robot stops moving after a plurality of control moments; The acquiring, according to the reference change trajectory of the posture of the robot body, a fourth expected acceleration of the body in the operation space includes: For each of the control moments, according to the reference attitude change trajectory, obtaining a reference attitude angle, a reference attitude angular velocity, and a reference attitude angular acceleration of the fuselage at the control moment; A proportional differential PD feedback controller is adopted to calculate the fourth expected acceleration at the control moment according to the reference attitude angle, reference attitude angular velocity and reference attitude angular acceleration of the fuselage at the control moment, and the actual attitude angle and actual attitude angular velocity of the fuselage at the control moment.

12. The method according to claim 11, characterized in that The body of the robot remains vertical during the movement of the robot, and the value of the reference posture angle, the value of the reference posture angular velocity and the value of the reference posture angular acceleration corresponding to the body are all zero.

13. The method according to any one of claims 1 to 12, characterized in that: The hip joints of the robot are coaxial.

14. The method according to any one of claims 1 to 12, characterized in that: The mechanical legs in the first mechanical leg group move synchronously, and the mechanical legs in the second mechanical leg group move synchronously.

15. A robot control device, characterized in that: The robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and the rotation center of the hip joint corresponding to the first mechanical leg group and the rotation center of the hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the device comprises: an expected task acquisition module, used to acquire an expected operation space task of the robot on a support surface, wherein the expected operation space task includes expected accelerations of various parts of the robot in the operation space of the robot, and the expected operation space task is used to guide the robot to alternately swing the first mechanical leg group and the second mechanical leg group to move on the support surface; An expected torque acquisition module, used for acquiring an expected joint torque set corresponding to the expected operation space task according to the expected operation space task and the whole body dynamics model of the robot, wherein the expected joint torque set includes expected joint torques for controlling various parts of the robot; The robot movement module is used to control the robot to move under the guidance of the expected operation space task according to the expected joint torque set.

16. A computer device, characterized in that: The computer device includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the robot control method according to any one of claims 1 to 14.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the robot control method according to any one of claims 1 to 14.

18. A computer program product, characterized in that The computer program product comprises a computer program, the computer program is stored in a computer-readable storage medium, and a processor reads and executes the computer program from the computer-readable storage medium to implement the robot control method according to any one of claims 1 to 14.

Citation Information

Patent Citations

  • Stable walking control method and device for biped robot, equipment and readable medium

    CN111674486A

  • Self-adaption method for pavement posture of quadruped robot

    CN115951696A

  • Four-leg mobile robot

    JP2005046950A

  • Generated torque control method for leg body exercise assistive apparatus

    US20070054777A1

Cited By

  • Control method and system of wheel-legged balance robot

    CN120540362A

  • Robot control method and apparatus, device and storage medium

    EP4678346A1