Robot action planning method, device and equipment and storage medium
By constructing joint information calculation under the objective function and constraints, the problem of high energy consumption when climbing stairs by the wheel-leg robot is solved, joint energy minimization and motion trajectory generation are achieved, and task execution efficiency is improved.
Patent Information
- Application Number
- CN202310657988.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-05
- Publication Date
- 2024-12-06
AI Technical Summary
The existing wheel-leg robots require motors of each joint to provide more energy when climbing stairs, resulting in high energy consumption and complex action planning, making it difficult to generate effective motion trajectories.
By constructing the objective function as the sum of the joint torque norms of each stage of the stair climbing task, and compute joint information, including joint torque, angle and angular velocity under the constraints of the objective function, to achieve action planning and reduce the energy consumption of joint motors. Generate motion trajectory.
The sum of torques of each joint in the stair climbing task is minimized, the energy consumption of joint motors is reduced, and the effective motion trajectory of the robot climbing stairs is generated, improving the task execution efficiency.
Smart Images

Figure CN119077721A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of artificial intelligence technology, and in particular to a robot motion planning method, device, equipment and storage medium. Background Art
[0002] With the development of robot control technology, some organizations and scientific research institutions have successively launched wheel-legged robots with wheels as feet. These wheel-legged robots can not only slide quickly on the wheels, but also climb stairs, overcome obstacles, etc.
[0003] Taking the wheel-legged robot climbing stairs as an example, the relevant technology adopts heuristic methods to control the wheel-legged robot, such as by planning the position of the wheel-legged robot's mechanical legs on the stairs, controlling the projection of the wheel-legged robot's center of gravity to move slowly within its support area to achieve stair climbing. This type of method belongs to static stair climbing, that is, the projection of the robot's center of gravity will not exceed the robot's support area.
[0004] However, the above static stair climbing method requires each joint motor to provide more energy. Summary of the invention
[0005] The present application provides a method, device, equipment and storage medium for motion planning of a robot. The technical solution is as follows:
[0006] According to one aspect of an embodiment of the present application, a method for motion planning of a robot is provided, wherein the robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, wherein at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and a rotation center of a hip joint corresponding to the first mechanical leg group and a rotation center of a hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the method comprises:
[0007] According to the stair climbing task to be performed by the robot, construct an objective function, wherein the objective function is the sum of the norms of the torques of the joints of the robot at each moment in each stage of the stair climbing task;
[0008] Under the constraints of the objective function, with the goal of minimizing the value of the objective function, the joint information of the robot is calculated, and the joint information includes at least one of joint torque information, joint angle information and joint angular velocity information; wherein the joint torque information includes the torque of each joint of the robot at each moment of each stage of the stair climbing task; the joint angle information includes the angle of each joint of the robot at each moment of each stage of the stair climbing task; and the joint angular velocity information includes the angular velocity of each joint of the robot at each moment of each stage of the stair climbing task.
[0009] According to one aspect of an embodiment of the present application, a motion planning device for a robot is provided, wherein the robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, wherein at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and a rotation center of a hip joint corresponding to the first mechanical leg group and a rotation center of a hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the device comprises:
[0010] An objective function construction module, used to construct an objective function according to the stair climbing task to be performed by the robot, wherein the objective function is the sum of the norms of the torques of the joints of the robot at various moments in various stages of the stair climbing task;
[0011] A joint information calculation module is used to calculate the joint information of the robot under the constraints of the objective function and with the goal of minimizing the value of the objective function, wherein the joint information includes at least one of joint torque information, joint angle information and joint angular velocity information; wherein the joint torque information includes the torque of each joint of the robot at each moment in each stage of the stair climbing task; the joint angle information includes the angle of each joint of the robot at each moment in each stage of the stair climbing task; and the joint angular velocity information includes the angular velocity of each joint of the robot at each moment in each stage of the stair climbing task.
[0012] According to one aspect of an embodiment of the present application, a computer device is provided, comprising a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the above-mentioned robot motion planning method.
[0013] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the above-mentioned robot motion planning method.
[0014] According to one aspect of an embodiment of the present application, a computer program product is provided, wherein the computer program product comprises a computer program, and the computer program is loaded and executed by a processor to implement the above-mentioned robot motion planning method.
[0015] The technical solution provided in the embodiments of the present application can bring the following beneficial effects:
[0016] By constructing a corresponding objective function for the stair climbing task to be performed by the robot, and under the constraint conditions of the objective function, calculating the robot's joint torque information, joint angle information and joint angular velocity information when the value of the objective function is minimized, the robot's action planning for the stair climbing task is realized according to the obtained joint information. The technical solution minimizes the sum of the torques of the robot's joints in the action planning of the stair climbing task to be performed by the robot, thereby reducing the energy required by the motors of each joint when performing the stair climbing task, and generates a motion trajectory for the robot's stair climbing task, so that the robot can better perform the stair climbing task. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 It is a schematic diagram of an implementation environment of a solution provided by an embodiment of the present application;
[0018] Figure 2 is a schematic diagram of a quadruped wheel-legged robot provided by an embodiment of the present application;
[0019] Figure 3 is a schematic diagram of a quadruped wheel-legged robot provided by an embodiment of the present application;
[0020] Figure 4 is a schematic diagram of a quadruped wheel-legged robot in a two-wheel mode provided by an embodiment of the present application;
[0021] Figure 5 is a schematic diagram of a quadruped wheel-legged robot climbing stairs provided by an embodiment of the present application;
[0022] Figure 6 is a block diagram of a robot control system provided by an embodiment of the present application;
[0023] Figure 7 is a flow chart of a robot motion planning method provided by an embodiment of the present application;
[0024] Figure 8 This is a schematic diagram of a robot's planar motion when climbing stairs provided by an embodiment of the present application;
[0025] Fig. 9 is a schematic diagram of an action sequence of a robot going up and down stairs provided by an embodiment of the present application;
[0026] Fig.10 is a schematic diagram of various joint parameters of a robot in a world coordinate system provided by an embodiment of the present application;
[0027] Fig.11 is a schematic diagram of a simulation result without adding wheel constraints provided by an embodiment of the present application;
[0028] Fig.12is a schematic diagram of a simulation result of adding wheel constraint conditions provided by an embodiment of the present application;
[0029] Fig.13 It is a state quantity trajectory diagram of each floating base provided by an embodiment of the present application;
[0030] Fig.14 It is a state quantity trajectory diagram of each joint provided by an embodiment of the present application;
[0031] Fig.15 It is a state quantity trajectory diagram of each joint speed provided by an embodiment of the present application;
[0032] Fig.16 It is a state quantity trajectory diagram of the torque and force of each joint provided by an embodiment of the present application;
[0033] Fig.17 This is a diagram of an actual application scenario of a robot performing a stair climbing task provided by an embodiment of the present application;
[0034] Fig.18 is a block diagram of a robot motion planning device provided by another embodiment of the present application;
[0035] Fig.19 It is a structural block diagram of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION
[0036] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.
[0037] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.
[0038] Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that machines have the functions of perception, reasoning and decision-making.
[0039] Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies. The basic technologies of artificial intelligence generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, mechatronics and other technologies. Artificial intelligence software technology mainly includes computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.
[0040] The technical solution of this application mainly involves the robot technology in artificial intelligence technology, mainly involving robot intelligent control. Robots are mechanical and electronic devices that can imitate certain human skills by combining mechanical transmission and modern microelectronics technology. Robots are developed on the basis of electronic, mechanical and information technology. Robots do not necessarily have to look like humans. As long as they can independently complete the tasks and commands assigned to them by humans, they are members of the robot family. A robot is an automated machine that has some intelligent abilities similar to those of humans or organisms, such as perception, planning, movement and coordination. It is an automated machine with high flexibility. With the development of computer technology and artificial intelligence technology, robots have been greatly improved in terms of function and technical level. Mobile robots and robot vision and touch technologies are typical representatives.
[0041] In the technical solution provided in the embodiment of the present application, the executor of each step may be a computer device, which refers to an electronic device with data calculation, processing and storage capabilities.
[0042] Optionally, the computer device may be a PC (Personal Computer) device such as a desktop computer or a laptop computer for controlling the robot; or a server for controlling the robot. The server may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The computer device and the robot may be connected via a physical line, a network, etc. For example, refer to Figure 1 The computer device 101 can construct an objective function corresponding to the stair climbing task to be performed by the robot 103 (the stair climbing task includes three stages of movement of the robot 103), thereby obtaining the sum of the norms of the torques of the joints of the robot 103 at each moment in each stage of the stair climbing task, and under the constraints of the objective function, with the goal of minimizing the value of the objective function, calculate the joint torque information of the robot 103, so that the computer device 101 can control the first mechanical leg group 104 and the second mechanical leg group 105 of the robot 103 to swing alternately through the network 102 according to the joint torque information, so that the robot 103 performs the stair climbing task.
[0043] Optionally, the computer device may also be a robot itself, that is, the execution subject of each step in the technical solution provided in the embodiment of the present application is a robot. Figure 1 , the computer device 101 can send the stair climbing task to be performed by the robot 103 to the robot 103 through the network 102, and the robot 103 constructs a corresponding objective function according to the stair climbing task, and then controls each joint of the robot 103 to perform the stair climbing task according to the joint torque information of the robot 103 when the value of the objective function is minimized. Optionally, the robot 103 can also automatically construct an objective function according to the stair climbing task according to the real environment to minimize the value of the objective function in different real environments, which is not limited in the embodiment of the present application.
[0044] The robot in the embodiments of the present application may refer to a wheel-legged robot, a leg-footed robot, etc. A wheel-legged robot refers to a robot that has both a wheeled structure and leg-like capabilities, and a leg-footed robot refers to a robot with feet as its feet. The embodiments of the present application do not limit this.
[0045] In one example, a robot may include a body, a first mechanical leg group and a second mechanical leg group connected to the body through a hip joint, at least one of the first mechanical leg group and the second mechanical leg group includes at least two mechanical legs, such as the first mechanical leg group includes at least two mechanical legs, the first mechanical leg group may also include at least two mechanical legs, there are at least two mechanical legs in the first mechanical leg group, which are respectively located on both sides of the central axis (i.e., the sagittal plane) of the robot, and there are at least two mechanical legs in the second mechanical leg group, which are respectively located on both sides of the central axis of the robot, and the first mechanical leg group and the second mechanical leg group are distributed side by side, that is, the rotation center of the hip joint corresponding to the first mechanical leg group and the rotation center of the hip joint corresponding to the second mechanical leg group are located in the same vertical plane.
[0046] Exemplarily, a wheel-legged robot is taken as an example to illustrate the robot in the embodiments of the present application.
[0047] The wheel-legged robot in the embodiment of the present application may include a fuselage, an outer mechanical leg group (i.e., a first mechanical leg group) connected to the fuselage through a hip joint, and an inner mechanical leg group (i.e., a second mechanical leg group), wherein the outer mechanical leg group may include two outer mechanical legs, and the inner mechanical leg group may include at least one inner mechanical leg. Exemplarily, the wheel-legged robot is a four-legged wheel-legged robot, i.e., the wheel-legged robot includes two outer mechanical legs and two inner mechanical legs; the wheel-legged robot is also a three-legged wheel-legged robot, i.e., the wheel-legged robot includes two outer mechanical legs and one inner mechanical leg. Among them, the hip joint corresponding to at least one inner mechanical leg in the inner mechanical leg group is located between the hip joints corresponding to the two outer mechanical legs in the outer mechanical leg group, and the rotation center of the hip joint corresponding to the outer mechanical leg and the rotation center of the hip joint corresponding to the inner mechanical leg are located in the same vertical plane. The wheel-legged robot can stand on a supporting surface by means of outer mechanical legs or inner mechanical legs, the wheel-legged robot can also slide on the supporting surface by means of the wheels on the outer mechanical legs or the wheels on the inner mechanical legs, and can also move (i.e. walk) on the supporting surface by controlling the outer mechanical leg group and the inner mechanical leg group to swing alternately.
[0048] For example, Figure 2 As shown, it exemplarily shows a schematic diagram of the structure of a quadruped wheel-legged robot. The quadruped wheel-legged robot 200 may include: a body, a hip joint and mechanical legs.
[0049] The quadruped wheel-legged robot 200 has four mechanical legs: two outer mechanical legs 201 (i.e., the first mechanical leg group) and two inner mechanical legs 202 (i.e., the second mechanical leg group), the two inner mechanical legs 202 are located between the two outer mechanical legs 201, and the four mechanical legs can be extended and retracted individually along the direction shown in the figure. A wheel 203 is installed at the end of each of the four mechanical legs, and each wheel 203 can be driven individually. The quadruped wheel-legged robot 200 can stand up through the two inner mechanical legs 202 or the two outer mechanical legs 201 to be in a double-wheel support state; the quadruped wheel-legged robot 200 can stand up through the two inner mechanical legs 202 and the two outer mechanical legs 201 at the same time to be in a quadruped wheel support state, which is not limited in the embodiments of the present application.
[0050] Optionally, the two inner mechanical legs 202 may be implemented as a whole, that is, the quadruped wheel-legged robot 200 may be implemented as a tripod wheel-legged robot having only one inner mechanical leg.
[0051] The other ends of the four mechanical legs are each connected to a hip joint 204, and each mechanical leg can rotate around its own hip joint 204 and maintain linkage. In the embodiment of the present application, the rotation centers of the hip joints 204 corresponding to the quadruped wheel-legged robot 200 are located in the same vertical plane 205, and the rotation planes of the mechanical legs corresponding to the quadruped wheel-legged robot 200 are parallel. The hip joints 204 corresponding to the two inner mechanical legs 202 are located between the hip joints 204 corresponding to the two outer mechanical legs 201.
[0052] Optionally, the hip joints 204 corresponding to the quadruped wheel-legged robot 200 may be coaxial, that is, the rotation centers of the hip joints 204 are located in the same straight line. The hip joints 204 corresponding to the quadruped wheel-legged robot 200 may also be coaxial, such as the hip joints 204 corresponding to the two inner mechanical legs 202 are coaxial, and the hip joints 204 corresponding to the two outer mechanical legs 201 are coaxial, but the hip joints 204 corresponding to the two inner mechanical legs 202 are not coaxial with the hip joints 204 corresponding to the two outer mechanical legs 201.
[0053] Optionally, the hip joints 204 corresponding to the two outer mechanical legs 201 share a driving motor so that the two outer mechanical legs 201 move synchronously; the hip joints 204 corresponding to the two inner mechanical legs 202 share a driving motor so that the two inner mechanical legs 202 move synchronously. In a feasible example, each hip joint 204 corresponding to the quadruped wheel-legged robot 200 can also be independently driven by its own corresponding driving motor, which is not limited in the embodiment of the present application.
[0054] The body of the quadruped wheeled-legged robot 200 may include a waist 206 , a trunk 207 , upper limbs 208 and a head 209 .
[0055] The hip joints 204 corresponding to the quadruped wheeled leg robot 200 are connected to the same end of the waist 206, and the other end of the waist 206 is connected to one end of the trunk 207. The waist 206 has two rotation centers: a pitch rotation center that can make the trunk 207 pitch, and a sway rotation center that can make the trunk 207 sway sideways. The sway rotation center is designed in series with the pitch rotation center, and is located at the upper end of the pitch rotation center and connected to the trunk 207.
[0056] For example, if Figure 2 The body 207 in the robot rotates 90 degrees along the side swing rotation center. Figure 2 Convert to Figure 3 The robot shown.
[0057] The other end of the torso 207 is connected to the upper limb 208 and the head 209, and the upper limb 208 can be a multi-degree-of-freedom upper limb. In some embodiments, an end effector, such as a mechanical gripper, a suction cup, etc., is deployed on the upper limb 208. A data acquisition device can be deployed in the head 209 to perceive the real environment, such as an image acquisition device, a video shooting device, an IMU (Inertial Measurement Unit), etc. Among them, the IMU can be placed at the geometric center of the torso 207, the center point of the hip joint (i.e., the rotation center of the hip joint), etc., which can be used to measure the actual acceleration, actual attitude angular velocity, actual Euler angle, etc. of the torso 207.
[0058] In the technical solution provided in the embodiment of the present application, the wheels, mechanical legs, hip joints, waist and torso (including IMU) of the four-legged wheeled robot 200 are necessary hardware for the control algorithm, and the rest are non-essential hardware.
[0059] Compared with the two-legged wheel-legged robot, the four-legged wheel-legged robot has a more stable structure and a stronger ability to resist external impact disturbances. Compared with the six-legged wheel-legged robot, it has fewer redundant joints and a lower design complexity. It can bear large loads, pass through narrow spaces, and perform tasks on objects of different heights. The four-legged wheel-legged robot has a strong ability to adapt to the environment.
[0060] The robot motion planning method provided in the embodiment of the present application can be applied to a variety of scenarios, such as the robot going up and down stairs, the robot going up and down steps, etc. The robot using the technical solution provided in the embodiment of the present application has a stronger ability to adapt to the environment. The robot motion planning method provided in the embodiment of the present application can reduce the energy required by each joint motor when driving the robot to perform the task of climbing stairs based on the dynamic characteristics of the robot, and generate a motion trajectory for the robot's task of climbing stairs, so that the robot can better perform the task of climbing stairs.
[0061] When moving on flat ground, the robot can maintain Figure 2 The four-wheel motion pattern shown can also be formed through the rotation center of the hip joint as shown in Figure 4 The two-wheel dynamic smooth motion mode shown. In the four-wheel motion mode, the robot is always in a stable state (does not fall), which makes it easier for the upper limbs to follow the operation instructions to perform some operation tasks. However, when moving on flat ground, switching from the four-wheel motion mode to the two-wheel motion mode can reduce the robot's footprint and match it with a bipedal robot. When moving on non-flat ground, such as when the robot goes up stairs or crosses a threshold, the robot can be moved by Figure 5 The dual-wheel alternating pattern shown enables dynamic obstacle traversal.
[0062] The following will take a wheel-legged robot as an example to illustrate the application scenarios of the technical solution provided in the embodiments of the present application.
[0063] In some embodiments, reference Figure 5 When the wheel-legged robot 501 needs to climb stairs, it can first construct an objective function corresponding to the stair climbing task according to the stair climbing task to be performed, and then control the outer mechanical leg group 502 (i.e., the first mechanical leg group) and the inner mechanical leg group 503 (i.e., the second mechanical leg group) of the robot 501 to swing alternately according to the joint torque information of the robot 501 when the value of the objective function is minimized, so as to perform the stair climbing task. For example, the outer mechanical leg group 502 is first used as the supporting mechanical leg group, and the inner mechanical leg group 503 is used as the swinging mechanical leg group, so that the robot 501 climbs the first step, and then the inner mechanical leg group 503 is used as the supporting mechanical leg group, and the outer mechanical leg group 502 is used as the swinging mechanical leg group, so that the robot 501 climbs the second step, and the outer mechanical leg group 502 and the inner mechanical leg group 503 swing alternately in sequence to complete the stair climbing task.
[0064] Please refer to Figure 6 , which shows a block diagram of a robot control system provided by an embodiment of the present application. The robot body can refer to Figure 2 . The four wheels of the robot are driven by four rotary motors separately, and the length of the four mechanical legs is driven by four linear motors separately. Usually, the driving modes of the linear motors of the two outer mechanical legs (i.e., the first mechanical leg group) are the same, and the driving modes of the linear motors of the two inner mechanical legs (i.e., the second mechanical leg group) are the same. The two outer mechanical legs are driven by the same rotary motor, and the two inner mechanical legs are driven by the same rotary motor. In addition, each joint of the waist of the robot and each joint of the fuselage are driven by a rotary motor. For all the rotary motors mentioned above, the rotary motor can receive a rotation angle instruction, a rotation speed instruction, a rotation torque instruction, etc., and the bottom drive board of the rotary motor will drive the motor to rotate according to the received instruction signal, thereby driving each joint to move. For all the linear motors mentioned above, the linear motor can receive a linear movement position instruction, a linear movement speed instruction, a driving force instruction, etc., and the bottom drive board of the linear motor will drive the motor to move linearly according to the received instruction signal, thereby driving the mechanical legs to move telescopically. The rotation and movement of the rotary motor and the linear motor change the posture of the robot and the position of the robot in three-dimensional space, and realize the motion planning of the robot. Rapidly changing joint angle commands can also cause highly dynamic changes in the robot's posture to change the robot's contact with the environment.
[0065] The state of the robot can be obtained by different sensors installed on the robot body. For example: the current posture of the robot can be obtained by using the IMU sensor, including the position information and posture information of the robot; the position information of the rotation and movement of each joint of the robot in the current state can be obtained by using the motor encoder, as well as the speed information of the rotation and movement; the force / torque sensor can be used to obtain the force magnitude of the joint where the sensor is located at the current moment, as well as the magnitude and direction of the torque; the tactile sensor can be used to obtain the pressure magnitude of the robot's soles, body surface, hands, fingertips and other body parts, as well as the changing characteristics of the pressure over a period of time; the use of visual sensors such as cameras can identify obstacles in the robot's field of view, and obtain the position information of the robot's center of mass and the speed information corresponding to the robot's center of mass.
[0066] The function of the State Estimation module is to fuse the posture information and state information obtained by the robot. For example, the current posture of the robot obtained by the IMU sensor, the mileage information obtained by the rotation of the foot wheel, and the visual positioning information can be integrated to obtain the position of the robot in the world coordinate system; the information obtained by the force / torque sensor and the tactile sensor can be integrated to obtain the contact between the robot and the external environment; the current posture of the robot obtained by the IMU sensor and the angle information of each motor joint encoder can be integrated, and combined with the robot's own model parameters, the center of mass position of the robot can be estimated. These fused robot state information will be used as feedback for the robot's motion generation, planning, and control.
[0067] For the Motion Generation module, different motion generation strategies will be used depending on the working mode of the robot when completing the action. The working modes of the robot include but are not limited to: four-wheel motion mode, two-wheel motion mode, four-wheel to two-wheel conversion mode, stair climbing mode, four-wheel active suspension mode, folding mode, etc. Considering the complexity of the upper body, it can be used to complete a variety of tasks. The robot can contain more motion modes, which are not listed here one by one.
[0068] In different modes, the way of action generation is different. In these modes, some common basic technologies and algorithm modules will be called, including but not limited to: model-free controller, model-based controller, etc. Model-based controllers include LQR (Linear Quadratic Regulator), MPC (Model Predictive Control), adaptive controller, robust controller, etc. For example, in the two-wheel mode, the balance of the wheels needs to be controlled, and the PID control (Proportional-Integral-Derivative control) of the model-free controller can be used to generate the reference trajectory of the foot wheel and the center of mass of the robot. The specific method can call one or more of the model-free controller, model-based controller (LQR, MPC, etc.), adaptive controller, and robust controller. In the two-wheel control stage of the four-wheel to two-wheel mode, similar control modules are also required. In the four-wheel mode, if the mechanical legs extending in front of the body are equivalent to the mechanical legs extending behind the body, the dynamics of the equivalent mechanical legs and upper body can be described by a first-order or second-order inverted pendulum, and the control trajectory obtained in this way can keep the robot balanced in the four-wheel state. Once the road surface is uneven, potholes or obstacles appear, the actions generated by similar controllers can achieve relative stability of the robot body, which is also a way to implement the four-wheel active suspension mode.
[0069] The action generation module obtains a series of robot task information, including but not limited to: center of mass tasks, supporting leg tasks, swinging leg tasks, waist tasks, etc. Similarly, considering the complexity of the upper body, it can be used to complete a variety of actions and tasks. The robot can include even more tasks, which are not listed here one by one. These tasks are used as the input of the whole-body motion control module (Whole-body Controller). In the whole-body motion control module, the robot will be modeled and calibrated in detail, and the robot's dynamic model and external force conditions will be used as optimization constraints. After the optimization process, the target joint angle command, target joint angular velocity command, target joint torque command, etc. of each joint of the robot are calculated. Finally, the target joint angle command, target joint angular velocity command, target joint torque command, etc. of each joint will be sent to the driver of each joint of the robot, thereby completing the control closed loop of the robot.
[0070] Please refer to Figure 7 , which shows a flow chart of a robot motion planning method provided by an embodiment of the present application. The execution subject of each step of the method may be a computer device. The method may include at least one of the following steps 710 to 720:
[0071] Step 710, constructing an objective function according to the stair climbing task to be performed by the robot, the objective function being the sum of the norms of the torques of the joints of the robot at each moment in each stage of the stair climbing task.
[0072] The stair climbing task refers to the task of climbing stairs that the robot is controlled to perform.
[0073] It should be noted that in addition to the stair climbing task, the robot can also perform tasks including but not limited to the robot going down stairs, the robot crossing thresholds, the robot crossing curbs, the robot crossing pits, and any other robot crossing obstacles. According to the real scene of the task to be performed by the robot, the objective function corresponding to the task is constructed. The objective function can be used to characterize the energy required by the motors of each joint of the robot at each moment of each stage of the task to be performed.
[0074] The task to be performed by the robot includes at least two stages, each stage includes at least two moments, and different tasks can be divided into different stages and different moments. The specific division of stages and moments can be determined according to the stage division requirements of each task to be performed by the robot in actual application, and this application does not limit this.
[0075] The joint motors of the robot include linear motors and rotary motors, wherein the lengths of the first mechanical leg group and the second mechanical leg group are controlled by the linear motors for extension and retraction, and the rotation of each joint is controlled by the rotary motors.
[0076] Step 720, under the constraints of the objective function, with the goal of minimizing the value of the objective function, calculate the joint information of the robot, the joint information including at least one of joint torque information, joint angle information and joint angular velocity information; wherein the joint torque information includes the torque of each joint of the robot at each moment of each stage of the stair climbing task; the joint angle information includes the angle of each joint of the robot at each moment of each stage of the stair climbing task; the joint angular velocity information includes the angular velocity of each joint of the robot at each moment of each stage of the stair climbing task.
[0077] The constraints of the objective function include but are not limited to at least one of the following: dynamic constraints, path constraints, bounded constraints, continuity constraints, wheel constraints, etc. Among them, the dynamic constraints are used to regulate the dynamic process in the stair climbing task; the path constraints are used to constrain the contact relationship between the wheels of the mechanical leg group and the support surface in the stair climbing task; the bounded constraints are used to constrain the torque and angle of each joint motor in the stair climbing task; the continuity constraints are used to constrain the continuity relationship between different task stages in the stair climbing task; the wheel constraints are used to constrain the positional relationship between the wheels and the contact surface in the stair climbing task.
[0078] Under the constraints of the objective function, the minimum value of the objective function is taken, and the joint information of the robot is calculated based on the minimum value of the objective function.
[0079] The technical solution provided by the embodiment of the present application constructs a corresponding objective function for the stair climbing task to be performed by the robot, and under the constraint conditions of the objective function, calculates the robot's joint torque information, joint angle information, and joint angular velocity information when the value of the objective function is minimized, thereby realizing the motion planning of the robot to perform the stair climbing task based on the obtained joint information. The technical solution minimizes the sum of the torques of the robot's joints for the motion planning of the stair climbing task to be performed by the robot, thereby reducing the energy required by the motors of each joint when performing the stair climbing task, and generates a motion trajectory for the robot's stair climbing task, so that the robot can better perform the stair climbing task.
[0080] Next, the constraints of the stair climbing task are introduced and explained.
[0081] First, in some embodiments, the stair climbing task includes a first stage, a second stage, and a third stage; the first stage is the process of the robot switching from a first state to a second state, the second stage is the process of the robot switching from the second state to a third state, and the third stage is the process of the robot switching from the third state to a fourth state.
[0082] In the first state, the first mechanical leg group and the second mechanical leg group overlap in the vertical direction, and one of the first mechanical leg group and the second mechanical leg group is in contact with the support surface, while the other mechanical leg group is not in contact with the support surface.
[0083] In the first stage, one robotic leg group maintains contact with the support surface, and the other robotic leg group swings until it contacts the support surface, entering the second state.
[0084] In the second stage, one mechanical leg group and the other mechanical leg group maintain contact with the support surface, and the center of mass of the fuselage changes until one mechanical leg group leaves the support surface and enters the third state.
[0085] In the third stage, the other mechanical leg group maintains contact with the supporting surface, and one mechanical leg group swings until one mechanical leg group overlaps with the other mechanical leg group in the vertical direction, entering the fourth state.
[0086] The first mechanical leg group may refer to an outer mechanical leg group connected to the body at the hip joint, or may refer to an inner mechanical leg group connected to the body at the hip joint. For example, the outer mechanical leg group connected to the body at the hip joint is the first mechanical leg group, and the inner mechanical leg group is the second mechanical leg group, to explain the above-mentioned stair climbing task.
[0087] Figure 8 The figure shows a schematic diagram of the robot's planar action when climbing stairs. In the figure, the robot's left mechanical wheel leg and right mechanical wheel leg completely overlap. Therefore, the two wheels of the robot in the figure can represent the robot's first mechanical leg group and the second mechanical leg group respectively. Considering the specific form of the process of climbing stairs, Figure 8 The robot shown in the figure will not touch the same support surface at the same time when the wheels are on the ground, so as to conform to the actual motion state of the stairs. The motion phase of the robot during the entire motion process can also be divided into a single support phase (Single Support Phase, SSP) and a double support phase (Double Support Phase, DSP).
[0088] Figure 8 The first state shown is the single-leg support stage, the first mechanical leg group 801 of the robot is in contact with the support surface, the second mechanical leg group 802 is not in contact with the support surface, and the first mechanical leg group 801 uses the wheels and the joints of the fuselage to coordinate control to maintain the balance of the robot. In the first stage, the robot swings the second mechanical leg group 802, gradually lifting it up from the vertical downward gravity direction at the beginning until it is placed on the upper step, entering the second state, which is the double-leg support stage. During the first stage, the first mechanical leg group 801 is the supporting wheel leg, and the second mechanical leg group 802 is the swinging wheel leg. In the second stage, the robot always keeps the wheels and the support surface at two contact points in the plane. During this process, the robot changes the angles of each joint of the fuselage, and on the premise of keeping the contact points of the two wheels with the support surface unchanged, gradually moves the projection of the center of mass of the fuselage on the support surface from the vicinity of the center of the rear wheel on the next step to the vicinity of the center of the front wheel on the previous step, and enters the third state, which is the double-leg support stage. In the third stage, the robot lifts the first mechanical leg group 801 from the lower step and uses the second mechanical leg group 802 to maintain the balance of the robot until the first mechanical leg group 801 and the second mechanical leg group 802 overlap in the vertical direction, entering the fourth state, which is the single-leg support stage. During the third stage, the second mechanical leg group 802 is a supporting wheel leg, and the first mechanical leg group 801 is a swinging wheel leg.
[0089] When the robot moves up one step, the mechanical leg groups corresponding to the supporting wheel legs and the swing wheel legs will be interchanged. In the periodic movement of going up the stairs, the mechanical leg groups corresponding to the supporting wheel legs and the swing wheel legs will also be interchanged periodically.
[0090] Similarly, the stage division of the task of the robot going down stairs is the same as the stage division of the task of going up stairs, except that the movement direction of each mechanical leg group is opposite to the movement direction of each mechanical leg group in the task of going up stairs. Therefore, the task of the robot going down stairs will not be described in detail here. The specific process can be referred to Fig. 9 Schematic diagram of the robot's action sequence of going up and down stairs.
[0091] By dividing the stair climbing task into three stages and analyzing the state transitions in each stage, we can clearly understand the state of the robot at different moments in the stair climbing task. Therefore, we can set more detailed constraints for the robot according to different task stages and different states, making the final joint torque information more accurate.
[0092] In some embodiments, the objective function can be expressed as:
[0093]
[0094] Among them, the value range of i is [1, P], i is a positive integer, P represents the three stages corresponding to the stair climbing task; t represents the time length from the starting time point to the ending time point of each stage, t is a positive number; N j represents all the drivable joints of the robot; τ represents the vector composed of the torque of each joint. The objective function represents the sum of the norms of the torque of each joint of the robot at each moment in each stage of the stair climbing task, and under the constraints of the objective function, the value of J is minimized.
[0095] In some embodiments, the constraints include dynamic constraints, which include: satisfying a first dynamic constraint equation in a first stage, the first dynamic constraint equation including the dynamic equations satisfied by a mechanical leg group in the first stage; satisfying a second dynamic constraint equation in a second stage, the second dynamic constraint equation including the dynamic equations satisfied by a mechanical leg group and another mechanical leg group in the second stage; satisfying a third dynamic constraint equation in a third stage, the third dynamic constraint equation including the dynamic equations satisfied by another mechanical leg group in the third stage.
[0096] Exemplarily, the following first dynamic constraint equation is satisfied in the first stage:
[0097]
[0098] In the second stage, the following second dynamic constraint equation is satisfied:
[0099]
[0100] In the third stage, the following third dynamic constraint equation is satisfied:
[0101]
[0102] Where q = [x, z, pitch, q H0 ,q L0 ,q W0 ,q H1 ,q L1 ,q W1 ], x and z represent the coordinates of the hip joint in the world coordinate system, pitch represents the angle between the midline of the robot body and the z-axis in the world coordinate system, q H0 Represents the rotation angle of a mechanical leg group relative to the z-axis in the world coordinate system, q L0 represents the length of a robotic leg group, q W0 represents the rotation angle of a mechanical leg group, q H1 Indicates the rotation angle of the other mechanical leg group relative to the z-axis in the world coordinate system, q L1 represents the length of another robotic leg group, q W1 represents the rotation angle of the other mechanical leg group, f C0 represents the force between a robotic leg group and the supporting surface, f C1 represents the force between another mechanical leg group and the supporting surface, J C0 The Jacobian matrix J represents the contact point between a robot leg group and the support surface to the center of mass of the robot. C1 represents the Jacobian matrix from the contact point between another mechanical leg group and the supporting surface to the center of mass of the robot, M represents the joint space inertia matrix of the robot, S represents the mapping relationship between the torque of each joint and the various parameters represented by q, τ represents the vector composed of the torque of each joint, and c represents the joint space offset force vector.
[0103] Fig.10 The schematic diagram of each joint parameter of the robot in the world coordinate system is shown. Fig.10 Taking the origin of the world coordinate system as the robot's hip joint, the x and z coordinates are 0, and pitch represents the midline of the robot's body 1001 relative to Fig.10 The angle of the z axis, q H0 represents the rotation angle of the first mechanical leg group 1003 relative to the z-axis, q L0 represents the length of the first mechanical leg group 1003, q W0represents the rotation angle of the first mechanical leg group 1003, q H1 represents the rotation angle of the second mechanical leg group 1002 relative to the z-axis, q L1 represents the length of the second mechanical leg group 1002, q W1 represents the rotation angle of the second mechanical leg group 1002, f C0 represents the force between the first mechanical leg group 1003 and the supporting surface, f C1 represents the force between the second mechanical leg group 1002 and the support surface, J C0 The Jacobian matrix from the contact point between the first mechanical leg group 1003 and the support surface to the center of mass of the robot, J C1 The Jacobian matrix representing the contact point between the second robotic leg group 1002 and the support surface to the center of mass of the robot.
[0104] For the first stage, the contact between the robot and the support surface only exists between the first mechanical leg group and the support surface, and the second mechanical leg group is suspended. At this time, the first line of the first dynamic constraint equation represents the standard dynamic equation of the robot system, which only involves the force f between the first mechanical leg group and the support surface C0 , and the corresponding Jacobian matrix J C0 , does not involve the force f between the second mechanical leg group and the supporting surface C1 , and the corresponding Jacobian matrix J C1 At the same time, c = C(q,qdot) + G(q), where C(q,qdot) represents the sum of the Coriolis force and the centrifugal force, and qdot can also be expressed as qdot means including xdot, zdot, pitchdot, and A vector of xdot, zdot, pitchdot, Represents x, z, pitch, q respectively H0 ,q L0 ,q W0 ,q H1 ,q L1 ,q W1 The change per unit time. Then c is the embodiment of the Coriolis force, centrifugal force and gravity in the system model. The second line of the equation shows that when the wheels of the first mechanical leg group contact the support surface, the wheels do not slip in the x direction and do not leave the support surface in the z direction.
[0105] For the second stage, the contact between the robot and the support surface exists simultaneously with the first mechanical leg group and the second mechanical leg group. At this time, the first line of the second dynamic constraint equation represents the standard dynamic equation of the robot system, which involves both the force f between the first mechanical leg group and the support surface C0, and the corresponding Jacobian matrix J C0 , which also involves the force f between the second mechanical leg group and the support surface C1 , and the corresponding Jacobian matrix J C1 , and c=C(q,qdot)+G(q), that is, c includes the manifestation of Coriolis force, centrifugal force and gravity in the system model. The second line of the equation indicates that when the wheels of the first robotic leg group are in contact with the support surface, the wheels do not slip in the x direction and do not leave the support surface in the z direction. The third line of the equation indicates that when the wheels of the second robotic leg group are in contact with the support surface, the wheels do not slip in the x direction and do not leave the support surface in the z direction.
[0106] For the third stage, the contact between the robot and the support surface only exists between the second mechanical leg group and the support surface, and the first mechanical leg group is suspended. At this time, the first line of the third dynamic constraint equation represents the standard dynamic equation of the robot system, which only involves the force f between the second mechanical leg group and the support surface. C1 , and the corresponding Jacobian matrix J C1 , does not involve the force f between the first mechanical leg group and the supporting surface C0 , and the corresponding Jacobian matrix J C0 , and c=C(q,qdot)+G(q), that is, c includes the manifestation of Coriolis force, centrifugal force and gravity in the system model. The second line of the equation shows that when the wheels of the second mechanical leg group contact the support surface, the wheels do not slip in the x direction and do not leave the support surface in the z direction.
[0107] By constraining the dynamic process in the stair climbing task and the contact relationship between the wheels of the mechanical leg group and the supporting surface, the various joints of the robot in the stair climbing task can meet the robot's own dynamic characteristics. Therefore, based on the final joint information, the action planning of the robot to perform the stair climbing task can be realized, and the motion trajectory of the robot's stair climbing task can be generated.
[0108] In some embodiments, the constraints include path constraints, which include at least one of the following: the contact points between the first mechanical leg group and the supporting surface satisfy the friction cone constraint; the contact points between the second mechanical leg group and the supporting surface satisfy the friction cone constraint; the wheels of the first mechanical leg group do not make unnecessary contact with the supporting surface; the wheels of the second mechanical leg group do not make unnecessary contact with the supporting surface.
[0109] The friction cone refers to the cone surface formed by the total reaction force rotating around the common normal line when the two components begin to slide relative to each other. For example, the path constraint condition can be expressed as:
[0110] D μ f C0 ≤0
[0111] D μ f C1 ≤0
[0112] The first row of inequalities indicates that the contact points between the first robot leg group and the support surface satisfy the friction cone constraint, and the second row of inequalities indicates that the contact points between the second robot leg group and the support surface satisfy the friction cone constraint. μ represents the friction cone formed between the contact points of the first and second robotic leg groups and the support surface, f C0 represents the force between the first mechanical leg group and the supporting surface, f C1 Represents the force between the second robotic leg group and the supporting surface.
[0113] Optionally, the path constraints also include, in a geometrically described manner, listing the range limits of the forward and backward movement of the wheels of the supporting wheel mechanical leg group on the supporting surface, for example, may include: when moving forward, do not stick to the edge of the previous step; when moving backward, stay on a certain step without falling; when the suspended wheels move in the air, they do not collide with the geometric contours of the stairs, and a certain safety distance may be considered; after the action is completed, the position of the suspended wheels is above the target step of the previous step.
[0114] By constraining the contact relationship between the wheels and the supporting surface during the stair climbing task, the friction relationship between the wheels of the mechanical leg group and the contact surface can be ensured to meet the friction cone constraint, thus preventing the robot from slipping off the stairs when climbing the stairs. At the same time, the contact relationship between the wheels and the rest of the stairs is constrained to prevent the robot from failing to climb the stairs successfully.
[0115] In some embodiments, the constraints include bounded constraints, which include at least one of the following: the torque of each joint of the robot is within the effective torque range of the corresponding joint motor; the angle of each joint of the robot is within the effective angle range of the corresponding joint motor.
[0116] Since the motor cannot output infinite torque for a long time, the torque of each joint of the robot is constrained, and the torque range is determined by the physical limit of the motor. Although the motor itself can rotate the entire axis, for the joint motors installed on the robot, due to the constraints of factors such as the tasks to be performed by the robot and the structural design of the robot, each joint motor often has a rotation range. For example, the bounded constraint condition can be expressed as:
[0117] τ min ≤τ≤τ max
[0118] x min ≤x≤x max
[0119] Among them, τ represents the torque of each joint, τ min Represents the minimum value of the torque corresponding to each joint, τ max represents the maximum value of the torque of each joint, x represents the angle of each joint, and x min Indicates the minimum value of the torque of each joint, x max Indicates the maximum value of the torque of each joint.
[0120] For different joints of different robots, due to different motors selected, the corresponding reduction ratios are different, and the specific values selected for the upper and lower limits of the torque and angle are also different. For example, for the effective angle range of each joint motor, the angle of rotation of the first mechanical leg relative to the z-axis in the world coordinate system can be set between 40 degrees and 180 degrees, and the angle of rotation of the second mechanical leg relative to the z-axis in the world coordinate system can be set between -40 degrees and 180 degrees. It can be set according to the actual application situation, and this application does not limit it.
[0121] Optionally, the bounded constraint condition may also include that the motion trajectory of the center of the robot wheel is within a valid trajectory range in the world coordinate system. For example, the deviation of the center of the wheel relative to the projection of the robot's center of mass coordinate system on the support surface may be within a certain interval.
[0122] By constraining the torque and angle of each joint motor in the stair climbing task, the robot's joints can meet the robot's own dynamic characteristics in the stair climbing task, avoiding the failure of each joint to meet certain torque and angle requirements. This can obtain more accurate joint information to generate the robot's motion trajectory for the stair climbing task, and then control the robot to perform the stair climbing task.
[0123] In some embodiments, the constraints include continuity constraints, which include at least one of the following: for two adjacent stages of the stair climbing task, the angles of each joint of the robot at the end of the previous stage are equal to the angles of each joint at the initial time of the next stage; for two adjacent stages of the stair climbing task, the task space state of the robot at the end of the previous stage is equal to the task space state at the initial time of the next stage.
[0124] Specifically, the angles of each joint of the robot at the end of the first stage are equal to the angles of each joint at the beginning of the second stage; the angles of each joint of the robot at the end of the second stage are equal to the angles of each joint at the beginning of the third stage. The task space state of the robot at the end of the first stage is equal to the task space state at the beginning of the second stage; the task space state of the robot at the end of the second stage is equal to the task space state at the beginning of the third stage.
[0125] The task space state refers to the state of various parameters of the robot when performing the stair climbing task, including but not limited to the position of each wheel, the position of the hip joint, the position of the robot's center of mass, the position of the center of mass corresponding to each body part of the robot, etc. For example, for two adjacent stages of the stair climbing task, the position of each wheel of the robot at the end of the previous stage is equal to the position of each wheel at the beginning of the next stage.
[0126] Exemplarily, the bounded constraint can be expressed as:
[0127]
[0128]
[0129] Among them, q represents the angle of each joint, t i+1,s Indicates that at time s in the i+1th stage, t i,f represents the time s in the i-th stage, and x represents the task space state.
[0130] By constraining the continuity relationship between different task stages in the stair climbing task, it is ensured that the states of various parameters of the robot in two adjacent stages of the stair climbing task remain the same, avoiding incoherent movements during the robot's execution of the stair climbing task, and making the robot's stair climbing task implementation reach the optimal state.
[0131] In some embodiments, the constraint condition includes a wheel constraint condition, and the wheel constraint condition includes: when the robot is performing a stair climbing task, the position of the wheels of the mechanical leg group in contact with the support surface remains unchanged.
[0132] The wheel position remains unchanged means that after the wheel contacts the supporting surface, the relative position of the wheel and the supporting surface remains unchanged. It can also be interpreted as the wheel does not slide forward, backward, left or right on the supporting surface.
[0133] Fig.11 The following figure shows the simulation results without adding wheel constraints. It can be seen that when the wheels are not locked, the wheels can easily slide backwards when the robot goes up the stairs. Fig.11In sub-graphs a and b, the robot is in the double-leg support stage and at the beginning of the third stage, the robot is ready to lift a mechanical leg group from the lower step, but because the wheels are not locked, the wheels to be lifted slide backwards, and there is a risk that the wheels in sub-graph b will slide off the step. Similarly, the robot in sub-graph f is at the end of the first stage and is ready to put a mechanical leg group on the upper step, but because the wheels are not locked, the wheels slide backwards after the mechanical leg group is put on the step, and there is a risk that the mechanical leg group cannot be stably put on the upper step.
[0134] In contrast, Fig.12 A schematic diagram of the simulation results with wheel constraints added is shown. It can be seen that when the wheels are locked, the wheels will not slip on the steps when the robot goes up the stairs, thus ensuring stability at each stage of the stair climbing task.
[0135] By constraining the positional relationship between the wheels and the contact surface during the stair climbing task, the wheels will not slip when performing the stair climbing task, avoiding the situation where the wheels slide down the steps due to precision control problems, thereby improving the stability of the robot system.
[0136] In some embodiments, the wheel constraints also include: when the robot is performing a stair climbing task, the center of mass of the wheels of one mechanical leg group increases by a first height in the opposite direction of gravity, the center of mass of the wheels of another mechanical leg group increases by a second height in the opposite direction of gravity, and the center of mass of the wheels of the first mechanical leg group and the second mechanical leg group increases by a first width in the extension direction of the stairs.
[0137] For the first stage to the third stage of the stair climbing task, the center of mass of the robot increases the height of one step in the opposite direction of gravity, the center of mass of the support wheel and the swing wheel of the robot increases the width of one step in the extension direction of the step, the center of mass of the support wheel in the first stage increases the first height in the opposite direction of gravity, and the center of mass of the swing wheel in the first stage (i.e., the support wheel in the third stage) increases the second height in the opposite direction of gravity. Among them, the first height is greater than or equal to the height of one step, and the second height is less than or equal to the height of one step.
[0138] In some embodiments, joint control instructions corresponding to the joint information are generated based on the joint information of the robot, and the joint control instructions include joint torque instructions, joint angle instructions and joint angular velocity instructions; each joint of the robot is controlled according to the joint control instructions so that the robot performs a stair climbing task.
[0139] The joint torque command is used to control the torque of each joint of the robot at each moment of each stage of the stair climbing task. The joint angle command is used to control the angle of each joint of the robot at each moment of each stage of the stair climbing task. The joint angular velocity command is used to control the angular velocity of each joint of the robot at each moment of each stage of the stair climbing task.
[0140] According to the joint control instructions, joint torque instructions, joint angle instructions and joint angular velocity instructions are sent to the drivers of each joint of the robot, so that the drivers of each joint can control each joint of the robot according to the received joint control instructions to enable the robot to perform the stair climbing task.
[0141] In addition, the trajectory of some parameters of the robot during the stair climbing task was simulated. Fig.13 The state quantity trajectories of various floating bases are shown, including the state quantity trajectories of the floating bases of x, z, pitch, xdot, zdot, and pitchdot, where the horizontal axis is time in seconds and the vertical axis is the unit of the state quantity of each parameter. Fig.14 The state trajectory of each joint is shown, including q H0 ,q L0 ,q W0 ,q H1 ,q L1 ,q W1 The state trajectory of . Fig.15 The state trajectory of each joint velocity is shown, where Indicates the change of each parameter. The unit of the ordinate is the unit of the state of each parameter per second. For example, and The unit is m / s, which indicates the speed of length change. The other joints are rotational joints. The figure shows the angular velocity, and the corresponding unit is rad / s. Fig.16 The state quantity trajectories of the torque and force of each joint are shown, among which L0 and L1 are linear drive joints, so the driving physical quantity is force, and the corresponding vertical coordinate unit is N; the remaining joints are rotational joints, and the driving physical quantity is torque, and the corresponding vertical coordinate unit is Nm.
[0142] In addition, the limit values of the maximum rotation speed and maximum torque of the joint under simulation conditions are shown in Table 1 below.
[0143] Table 1
[0144] index Numeric Wheel motor maximum torque 20Nm Wheel motor maximum speed 26rad / s Maximum torque of rotating motor 100Nm Maximum speed of rotating motor 15rad / s Linear motor maximum torque 300N Linear motor maximum speed 3m / s
[0145] By changing the values of the mass and moment of inertia of each link of the robot, the above simulation results will also change accordingly. The results in Table 1 above can be used as a rough basis for motor selection. The maximum speed and rated torque of the selected motor must be within the range of the motor speed and torque required for the specific action of the robot. Considering that the torque of the motor is divided into peak value (instantaneous value) and rated value. In some high-dynamic actions, the motor needs to reach a larger peak value in a short period of time. In this scenario, it is necessary to know the time series information of the motor torque and speed, so that it can be based on Figure 13 to Figure 16 The data curve shown comprehensively completes the tasks such as motor selection and reduction ratio determination in the robot design process.
[0146] The actual application scenarios of robots performing stair climbing tasks can be referred to Fig.17 Based on the technical solution proposed in the embodiment of the present application, robot 1701 can construct an objective function according to the stair climbing task to be performed, and set various constraints of the objective function. Under the constraints, the joint torque information of robot 1701 when the objective function is minimized is calculated, thereby controlling robot 1701 to perform the stair climbing task according to the joint torque information.
[0147] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.
[0148] Please refer to Fig.18 , which shows a block diagram of a robot motion planning device provided by an embodiment of the present application. The device has the function of implementing the above-mentioned robot motion planning method, and the function can be implemented by hardware, or by hardware executing corresponding software. The device can be the computer device introduced above, or it can be set in a computer device. Fig.18 As shown, the device 1800 may include: an objective function construction module 1810 and a joint information calculation module 1820.
[0149] The objective function construction module 1810 is used to construct an objective function according to the stair climbing task to be performed by the robot, and the objective function is the sum of the norms of the torques of each joint of the robot at each moment in each stage of the stair climbing task.
[0150] The joint information calculation module 1820 is used to calculate the joint information of the robot under the constraints of the objective function, with the goal of minimizing the value of the objective function, wherein the joint information includes at least one of joint torque information, joint angle information and joint angular velocity information; wherein the joint torque information includes the torque of each joint of the robot at each moment in each stage of the stair climbing task; the joint angle information includes the angle of each joint of the robot at each moment in each stage of the stair climbing task; and the joint angular velocity information includes the angular velocity of each joint of the robot at each moment in each stage of the stair climbing task.
[0151] In some embodiments, the stair climbing task includes a first stage, a second stage, and a third stage;
[0152] The first stage is a process of the robot switching from the first state to the second state, the second stage is a process of the robot switching from the second state to the third state, and the third stage is a process of the robot switching from the third state to the fourth state;
[0153] In the first state, the first mechanical leg group and the second mechanical leg group overlap in the vertical direction, and one of the first mechanical leg group and the second mechanical leg group is in contact with a support surface, while the other mechanical leg group is not in contact with the support surface;
[0154] In the first stage, the one mechanical leg group maintains contact with the support surface, and the other mechanical leg group swings until it contacts with the support surface, entering the second state;
[0155] In the second stage, the one mechanical leg group and the other mechanical leg group both maintain contact with the support surface, and the center of mass of the fuselage changes until the one mechanical leg group leaves the support surface and enters the third state;
[0156] In the third stage, the other mechanical leg group maintains contact with the support surface, and the one mechanical leg group swings until the one mechanical leg group and the other mechanical leg group overlap in the vertical direction, entering the fourth state.
[0157] In some embodiments, the constraint condition includes a dynamic constraint condition, and the dynamic constraint condition includes:
[0158] Satisfying a first dynamic constraint equation in the first stage, the first dynamic constraint equation comprising a dynamic equation satisfied by the one mechanical leg group in the first stage;
[0159] Satisfying a second dynamic constraint equation in the second stage, the second dynamic constraint equation comprising a dynamic equation satisfied by the one mechanical leg group and the other mechanical leg group in the second stage;
[0160] A third dynamic constraint equation is satisfied in the third stage, and the third dynamic constraint equation includes a dynamic equation satisfied by the other mechanical leg group in the third stage.
[0161] In some embodiments, the constraint condition includes a path constraint condition, and the path constraint condition includes at least one of the following:
[0162] The contact points between the first mechanical leg group and the support surface satisfy the friction cone constraint;
[0163] The contact points between the second mechanical leg group and the support surface satisfy the friction cone constraint;
[0164] The wheels of the first mechanical leg group do not make unnecessary contact with the support surface;
[0165] The wheels of the second mechanical leg group do not make unnecessary contact with the supporting surface.
[0166] In some embodiments, the constraint condition includes a bounded constraint condition, and the bounded constraint condition includes at least one of the following:
[0167] The torque of each joint of the robot is within the effective torque range of the corresponding joint motor;
[0168] The angle of each joint of the robot is within the effective angle range of the corresponding joint motor.
[0169] In some embodiments, the constraint condition includes a continuity constraint condition, and the continuity constraint condition includes at least one of the following:
[0170] For two adjacent stages of the stair climbing task, the angles of the joints of the robot at the end of the previous stage are equal to the angles of the joints at the beginning of the next stage;
[0171] For two adjacent stages of the stair climbing task, the task space state of the robot at the end time of the previous stage is equal to the task space state at the initial time of the next stage.
[0172] In some embodiments, the constraint condition includes a wheel constraint condition, and the wheel constraint condition includes at least one of the following:
[0173] When the robot is performing the stair climbing task, the position of the wheels of the mechanical leg group in contact with the support surface remains unchanged;
[0174] When the robot performs the stair climbing task, the center of mass of the wheels of one mechanical leg group increases by a first height in the opposite direction of gravity, the center of mass of the wheels of the other mechanical leg group increases by a second height in the opposite direction of gravity, and the center of mass of the wheels of the first mechanical leg group and the second mechanical leg group increases by a first width in the extension direction of the stairs.
[0175] In some embodiments, the device further comprises a joint control module, wherein the joint control module is configured to:
[0176] Generate a joint control instruction corresponding to the joint information according to the joint information of the robot, wherein the joint control instruction includes a joint torque instruction, a joint angle instruction and a joint angular velocity instruction;
[0177] Each joint of the robot is controlled according to the joint control instruction so that the robot performs the stair climbing task.
[0178] The technical solution provided by the embodiment of the present application constructs a corresponding objective function for the stair climbing task to be performed by the robot, and under the constraint conditions of the objective function, calculates the robot's joint torque information, joint angle information, and joint angular velocity information when the value of the objective function is minimized, thereby realizing the motion planning of the robot to perform the stair climbing task based on the obtained joint information. The technical solution minimizes the sum of the torques of the robot's joints for the motion planning of the stair climbing task to be performed by the robot, thereby reducing the energy required by the motors of each joint when performing the stair climbing task, and generates a motion trajectory for the robot's stair climbing task, so that the robot can better perform the stair climbing task.
[0179] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the content structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.
[0180] Please refer to Fig.19 , which shows a block diagram of a computer device 1900 provided in one embodiment of the present application. The computer device 1900 may be any electronic device with data calculation, processing and storage functions. The computer device 1900 may be used to implement the robot motion planning method provided in the above embodiment.
[0181] Typically, the computer device 1900 includes a processor 1901 and a memory 1902 .
[0182] The processor 1901 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1901 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1901 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 1901 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1901 may also include an AI processor for processing computing operations related to machine learning.
[0183] The memory 1902 may include one or more computer-readable storage media, which may be non-transitory. The memory 1902 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1902 is used to store a computer program, which is configured to be executed by one or more processors to implement the above-mentioned robot motion planning method.
[0184] Those skilled in the art will understand that Fig.19 The structure shown in the figure does not constitute a limitation on the computer device 1900, and the computer device 1900 may include more or less components than shown in the figure, or combine some components, or adopt a different arrangement of components.
[0185] In an illustrative embodiment, a computer-readable storage medium is also provided, wherein a computer program is stored in the storage medium, and when the computer program is executed by a processor of a computer device, the robot motion planning method is implemented. Optionally, the computer-readable storage medium may be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, etc.
[0186] In an exemplary embodiment, a computer program product is also provided, the computer program product includes a computer program, the computer program is stored in a computer-readable storage medium. A processor of a computer device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the computer device executes the above-mentioned robot motion planning method.
[0187] It should be noted that this application can display a prompt interface, pop-up window or output voice prompt information before collecting relevant data of users and during the process of collecting relevant data of users. The prompt interface, pop-up window or voice prompt information is used to prompt the user that relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining relevant data of users after obtaining the confirmation operation issued by the user to the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user to the prompt interface or pop-up window is not obtained), the relevant steps of obtaining relevant data of users are terminated, that is, the relevant data of users are not obtained. In other words, all user data collected by this application are processed strictly in accordance with the requirements of relevant national laws and regulations, and the informed consent or separate consent of the subject of personal information is obtained with the consent and authorization of the user. The subsequent data use and processing behavior is carried out within the scope of authorization of laws and regulations and the subject of personal information, and the collection, use and processing of relevant user data shall comply with the relevant laws, regulations and standards of relevant countries and regions.
[0188] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.
[0189] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. A robot motion planning method, characterized in that: The robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and a rotation center of a hip joint corresponding to the first mechanical leg group and a rotation center of a hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the method comprises: According to the stair climbing task to be performed by the robot, construct an objective function, wherein the objective function is the sum of the norms of the torques of the joints of the robot at each moment in each stage of the stair climbing task; Under the constraints of the objective function, with the goal of minimizing the value of the objective function, the joint information of the robot is calculated, and the joint information includes at least one of joint torque information, joint angle information and joint angular velocity information; wherein the joint torque information includes the torque of each joint of the robot at each moment of each stage of the stair climbing task; the joint angle information includes the angle of each joint of the robot at each moment of each stage of the stair climbing task; and the joint angular velocity information includes the angular velocity of each joint of the robot at each moment of each stage of the stair climbing task.
2. The method according to claim 1, characterized in that The stair climbing task includes a first stage, a second stage and a third stage; The first stage is a process of the robot switching from the first state to the second state, the second stage is a process of the robot switching from the second state to the third state, and the third stage is a process of the robot switching from the third state to the fourth state; In the first state, the first mechanical leg group and the second mechanical leg group overlap in the vertical direction, and one of the first mechanical leg group and the second mechanical leg group is in contact with a support surface, while the other mechanical leg group is not in contact with the support surface; In the first stage, the one mechanical leg group maintains contact with the support surface, and the other mechanical leg group swings until it contacts with the support surface, entering the second state; In the second stage, the one mechanical leg group and the other mechanical leg group both maintain contact with the support surface, and the center of mass of the fuselage changes until the one mechanical leg group leaves the support surface and enters the third state; In the third stage, the other mechanical leg group maintains contact with the support surface, and the one mechanical leg group swings until the one mechanical leg group and the other mechanical leg group overlap in the vertical direction, entering the fourth state.
3. The method according to claim 2, characterized in that The constraint conditions include dynamic constraint conditions, and the dynamic constraint conditions include: Satisfying a first dynamic constraint equation in the first stage, the first dynamic constraint equation comprising a dynamic equation satisfied by the one mechanical leg group in the first stage; Satisfying a second dynamic constraint equation in the second stage, the second dynamic constraint equation comprising a dynamic equation satisfied by the one mechanical leg group and the other mechanical leg group in the second stage; A third dynamic constraint equation is satisfied in the third stage, and the third dynamic constraint equation includes a dynamic equation satisfied by the other mechanical leg group in the third stage.
4. The method according to claim 1, characterized in that: The constraint condition includes a path constraint condition, and the path constraint condition includes at least one of the following: The contact points between the first mechanical leg group and the support surface satisfy the friction cone constraint; The contact points between the second mechanical leg group and the support surface satisfy the friction cone constraint; The wheels of the first mechanical leg group do not make unnecessary contact with the support surface; The wheels of the second mechanical leg group do not make unnecessary contact with the supporting surface.
5. The method according to claim 1, characterized in that The constraint condition includes a bounded constraint condition, and the bounded constraint condition includes at least one of the following: The torque of each joint of the robot is within the effective torque range of the corresponding joint motor; The angle of each joint of the robot is within the effective angle range of the corresponding joint motor.
6. The method according to claim 1, characterized in that The constraint condition includes a continuity constraint condition, and the continuity constraint condition includes at least one of the following: For two adjacent stages of the stair climbing task, the angles of the joints of the robot at the end of the previous stage are equal to the angles of the joints at the beginning of the next stage; For two adjacent stages of the stair climbing task, the task space state of the robot at the end time of the previous stage is equal to the task space state at the initial time of the next stage.
7. The method according to any one of claims 1 to 6, characterized in that: The constraint condition includes a wheel constraint condition, and the wheel constraint condition includes at least one of the following: When the robot is performing the stair climbing task, the position of the wheels of the mechanical leg group in contact with the support surface remains unchanged; When the robot performs the stair climbing task, the center of mass of the wheels of one mechanical leg group increases by a first height in the opposite direction of gravity, the center of mass of the wheels of the other mechanical leg group increases by a second height in the opposite direction of gravity, and the center of mass of the wheels of the first mechanical leg group and the second mechanical leg group increases by a first width in the extension direction of the stairs.
8. The method according to claim 1, characterized in that The method further comprises: Generate a joint control instruction corresponding to the joint information according to the joint information of the robot, wherein the joint control instruction includes a joint torque instruction, a joint angle instruction and a joint angular velocity instruction; Each joint of the robot is controlled according to the joint control instruction so that the robot performs the stair climbing task.
9. A robot motion planning device, characterized in that: The robot comprises a body, a first mechanical leg group and a second mechanical leg group connected to the body via a hip joint, at least one of the first mechanical leg group and the second mechanical leg group comprises at least two mechanical legs, and the rotation center of the hip joint corresponding to the first mechanical leg group and the rotation center of the hip joint corresponding to the second mechanical leg group are located in the same vertical plane; the device comprises: An objective function construction module, used to construct an objective function according to the stair climbing task to be performed by the robot, wherein the objective function is the sum of the norms of the torques of the joints of the robot at various moments in various stages of the stair climbing task; A joint information calculation module is used to calculate the joint information of the robot under the constraints of the objective function and with the goal of minimizing the value of the objective function, wherein the joint information includes at least one of joint torque information, joint angle information and joint angular velocity information; wherein the joint torque information includes the torque of each joint of the robot at each moment in each stage of the stair climbing task; the joint angle information includes the angle of each joint of the robot at each moment in each stage of the stair climbing task; and the joint angular velocity information includes the angular velocity of each joint of the robot at each moment in each stage of the stair climbing task.
10. A computer device, characterized in that: The computer device includes a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the robot motion planning method according to any one of claims 1 to 8.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the robot motion planning method according to any one of claims 1 to 8.
12. A computer program product, characterized in that The computer program product comprises a computer program, which is loaded and executed by a processor to implement the robot motion planning method according to any one of claims 1 to 8.
