A biomimetic artificial muscle bundle structure and its control method
By using a silicone support structure, a bundled design of electrically driven bionic fibers, and an intelligent control method, the problem of low control precision in bionic artificial muscles has been solved, achieving high-precision bionic motion control suitable for precision control scenarios.
Patent Information
- Application Number
- CN202511468803.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-10-15
- Publication Date
- 2026-03-06
- Estimated Expiration
- 2045-10-15
AI Technical Summary
Existing bionic artificial muscles have low control precision, resulting in poor trajectory tracking performance, and their control strategies are complex, making them difficult to widely apply in the field of intelligent drive materials.
By employing a silicone support structure and a bundled design of multiple electrically driven biomimetic fibers, combined with multi-spectral signal data collection and sequence-generative reinforcement learning algorithms, and through error compensation and Kalman filtering optimization control strategies, high-precision trajectory tracking is achieved.
It improves the control precision and motion stability of bionic muscles, making it suitable for precision control scenarios and enabling high-precision tracking of complex trajectories.
Smart Images

Figure CN120941368B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of bionic artificial muscle technology, and in particular to a bionic artificial muscle bundle structure and its control method. Background Technology
[0002] With the deepening development of flexible robots and the emergence of electro-actuated polymer materials and smart materials, artificial muscles, as a key component of flexible robots and intelligent actuation, have become a research focus in the field of bionics. Most existing muscle components in flexible robots are rigid devices, lagging significantly behind biological muscles in terms of compliance, power density, energy efficiency, and structural-functional integration. However, electro-actuated polymer materials have become a hot research topic in recent years, capable of generating reversible bending deflection and output force under electrical excitation. Compared to traditional polymer materials, electro-actuated polymers offer advantages such as large deformation, low driving voltage, light weight, and good flexibility, demonstrating enormous potential in many engineering fields such as bionic artificial muscles, biomedicine, underwater robots, and bionic robots. However, as a driving component, bionic artificial muscles also suffer from drawbacks such as small strain, weak output force, and a single deformation direction. Furthermore, increasing functionality leads to more complex control strategies, preventing the widespread application of bionic artificial muscles in the current field of intelligent actuation materials. Therefore, developing a biomimetic artificial muscle structure with stable configuration, large response output force, and high degree of deformation freedom, along with a relatively simple electric drive control strategy, is of great value and significance for promoting the widespread application of biomimetic artificial muscle devices.
[0003] Currently, Chinese patent CN115960396B discloses a method for preparing a biomimetic artificial muscle bundle structure and an electro-drive control method. The method involves preparing a biomimetic artificial muscle electro-actuation membrane solution, an electrode membrane solution, high-twist multi-walled carbon nanotube yarn, biomimetic artificial muscle fibers, and bundling the biomimetic artificial muscle fibers to obtain hexagonal prism-shaped artificial muscle fibers. Finally, the fiber cross-section is divided into eight independently electrified regions. This invention provides a biomimetic artificial muscle bundle structure with the above-mentioned structure. Its hexagonal prism configuration is stable, has high strength, is easy to assemble, has a simple manufacturing process, rapid response, stable structure, and high degree of freedom of movement.
[0004] The aforementioned existing technical solutions have the following drawbacks: they solve the structural problems, but do not solve the problem of accuracy compensation for the control method of muscle bundles, resulting in insufficient accuracy during end-effector control. Summary of the Invention
[0005] The purpose of this invention is to provide a biomimetic artificial muscle bundle structure and its control method to solve the problems of low control accuracy and poor trajectory tracking performance of biomimetic muscles caused by strong nonlinearity of the execution system, difficulty in measuring material physical parameters, and measurement errors in the prior art.
[0006] The above-mentioned technical objective of the present invention is achieved through the following technical solution:
[0007] A biomimetic artificial muscle bundle structure includes a silicone support structure and multiple electrically driven biomimetic fibers. The silicone support structure is a cylindrical structure with a vertically oriented axis. Multiple annular grooves are formed at the top of the silicone support structure from top to bottom. A through-hole is located at the center of the top of the silicone support structure, and an annular groove is also formed on the outer side of the bottom end. The silicone support structure serves to form a basic workspace for providing six degrees of freedom of motion. The multiple electrically driven biomimetic fibers are attached to the silicone support structure and drive the ends of the silicone support structure to generate multi-directional motion through electrically controlled contraction. The top end of each electrically driven biomimetic fiber is fixedly connected to the top end of the silicone support structure, and a fixing block is fixedly installed at the bottom end of each electrically driven biomimetic fiber. The silicone support structure is made of silicone material and achieves complex trajectory motion through the coordinated contraction of the electrically driven biomimetic fibers. The electrically driven biomimetic fibers are made of electroactive materials and can generate axial contraction under current stimulation, thereby pulling the top end of the silicone support structure.
[0008] By adopting the above technical solution, the silicone support structure constitutes a basic workspace with six degrees of freedom, possessing flexibility and elasticity, capable of multi-directional deformation under external force. Multiple electro-driven bionic fibers are evenly aligned with the top of the silicone support structure, and their electro-controlled contraction drives the ends of the silicone support structure to generate multi-directional movement. The silicone support structure, with its flexibility and elasticity, can deform under external force and achieve complex trajectory movements through the coordinated contraction of the electro-driven bionic fibers. The integrated design of the silicone support structure and the electro-driven bionic fibers gives the entire structure the flexibility and high load-bearing capacity of bionic muscles, making it suitable for precision control scenarios. The electro-driven bionic fibers, made of electroactive materials, are attached to the silicone support structure and undergo axial contraction under electrical stimulation, thereby driving the end effector points of the silicone support structure to generate spatial movement. The silicone support structure provides the necessary flexibility and workspace, while the electro-driven bionic fibers, as actuators, achieve a contraction-driven function similar to biological muscles. This bundled structure combines the adaptability of flexible materials and the rapid response characteristics of electro-driven fibers, providing a hardware foundation for high-precision bionic motion control.
[0009] In a further embodiment, the number of the multiple electro-driven bionic fibers is three, and the three electro-driven bionic fibers are symmetrically arranged at a 120-degree angle to each other on the silicone support structure; one end of the electro-driven bionic fiber is fixed to the base of the silicone support structure 1, and the other end is connected to the end actuation point of the silicone support structure; by the independent contraction of a single electro-driven bionic fiber, the end actuation point can be driven to move in the direction of the corresponding fiber; by the simultaneous contraction of two electro-driven bionic fibers, the end actuation point can be driven to move in the area of the angle between the two fibers; by the coordinated contraction of the three electro-driven bionic fibers, the end actuation point can be driven to move in the vertical direction or in the spatial range; the arrangement of the electro-driven bionic fibers optimizes the workspace coverage and improves the motion accuracy and stability.
[0010] By adopting the above technical solution, the symmetrical layout of the root fibers can realize the complex and multi-directional movement of the end execution point in space through different contraction combinations, which optimizes the coverage and movement flexibility of the workspace. The contraction combination methods include single-fiber contraction, two-fiber contraction or three-fiber coordinated contraction, etc.
[0011] This invention also discloses a method for controlling a biomimetic artificial muscle bundle structure, comprising the following steps:
[0012] Step 1: Collect dynamic response data of the bionic artificial muscle bundle system through multi-spectral input signals to obtain a dataset corresponding to the current input signal and the motion position; the multi-spectral input signals include DC current signals of different frequencies and amplitudes, which are applied to one or more electrically driven bionic fibers 2 in a step-by-step manner, and three-dimensional motion position data are recorded.
[0013] Step 2: Based on the dataset, a sequence-generative reinforcement learning algorithm is used for trajectory control and matching to generate a control sequence for the target pose; the reinforcement learning algorithm optimizes the control strategy through a reward function to ensure that the trajectory of the end point is consistent with the desired trajectory.
[0014] Step 3: Error compensation is performed on the measurement data through repeated experiments and filtering to improve the reliability of trajectory data and control accuracy; the error compensation includes calculating the average trajectory, estimating the process noise variance, and applying Kalman filtering to enhance the data.
[0015] By adopting the above technical solution, this method combines system identification, intelligent control and error compensation, effectively overcoming the challenges brought by system nonlinearity and measurement noise, and realizing high-precision trajectory tracking in a high-uncertainty environment.
[0016] In a further embodiment, the multi-spectral input signal in step one specifically includes a DC current signal that increments at a fixed frequency. The input current of a single electrically driven bionic fiber increases in increments according to a preset step size, and the current value and the corresponding three-dimensional motion position vector are recorded simultaneously. For the joint input of multiple electrically driven bionic fibers, sinusoidal current signals of different frequencies and amplitudes are applied to the three fibers simultaneously, and the three-dimensional current vector and the three-dimensional motion position vector are recorded. The data collection process is carried out in a test scenario, capturing the motion of the end effector point through a binocular vision system and calibrating the pose using an image recognition algorithm.
[0017] By adopting the above technical solutions, multi-spectral excitation can fully stimulate the dynamic characteristics of the system, collect a more comprehensive dataset, and provide a rich information foundation for subsequent modeling and control.
[0018] In a further embodiment, the sequence-generative reinforcement learning algorithm in step two learns a control strategy by constructing a state space, an action space, and a reward function. The state space includes the current end position, the target pose, and historical trajectory information; the action space is a current control signal; and the reward function is designed based on trajectory error and energy consumption. The algorithm generates control sequences through iterative training, enabling the system to achieve high-precision trajectory tracking in complex dynamic environments. The reinforcement learning algorithm also utilizes the collected dataset for offline pre-training and online fine-tuning to adapt to real-world application scenarios.
[0019] By adopting the above technical solutions, reinforcement learning can autonomously learn complex control strategies and adapt to the nonlinear dynamic characteristics of the system, achieving high-precision control without the need for an accurate physical model.
[0020] In a further embodiment, the repeated experiments in step three refer to conducting more than ten experiments under the same current input signal and recording the time-space coordinate data of the end execution point; by calculating the average position trajectory and variance at each time point, the statistical characteristics of the system's dynamic characteristics are extracted; the error compensation also involves correcting the calibration error and material response uncertainty of the vision measurement system, including camera parameter deviation, image distortion and temperature drift compensation.
[0021] By adopting the above technical solution and extracting the common features of the system response through statistical methods, the influence of random errors in a single experiment is effectively reduced, and the representativeness of the data is improved.
[0022] In a further embodiment, the filtering process in step three includes a Kalman filter algorithm for smoothing and suppressing outliers in the average trajectory data; the Kalman filter is calculated based on the system linear model and measurement noise covariance, and reduces random errors through prediction and update steps; the filtered data serves as the true label for reinforcement learning training, improving the accuracy and robustness of the control sequence.
[0023] By adopting the above technical solutions, Kalman filtering can effectively fuse predicted and observed values, reduce random noise in the data, and further improve the quality of trajectory data used to train control models.
[0024] In a further embodiment, the control method also includes a pose construction and recognition stage in a real-world scenario; in a test scenario, markers at the end effector point are identified using a binocular camera and the YOLO algorithm, and their three-dimensional coordinates are calibrated; in an application scenario, a control sequence is directly generated based on pose requirements, without the need for real-time recognition; the pose construction and recognition process is combined with error compensation to ensure the system's stable performance in dynamic environments.
[0025] By adopting the above technical solution, a smooth transition from experimental calibration to practical application is achieved, ensuring the practicality and effectiveness of the control method at different stages.
[0026] In summary, the present invention has the following beneficial effects:
[0027] 1. Through the biomimetic design of silicone support structure and electro-driven biomimetic fiber bundles, it can simulate biological muscle movement patterns, provide compliant drive and flexible movement with multiple degrees of freedom;
[0028] 2. By using multi-spectral signals for system data collection and combining sequence generative reinforcement learning for control, it is possible to effectively handle system nonlinearity and achieve high-precision tracking of complex trajectories.
[0029] 3. The error compensation method, which combines repeated experiments with Kalman filtering, can significantly suppress measurement noise and random errors, and improve the system control accuracy and robustness. Attached Figure Description
[0030] Figure 1 This is a schematic diagram of a biomimetic artificial muscle bundle structure according to the present invention;
[0031] In the diagram: 1. Silicone support structure; 2. Electro-driven bionic fiber. Detailed Implementation
[0032] The present invention will be further described in detail below with reference to the accompanying drawings.
[0033] Identical parts are indicated by the same reference numerals. It should be noted that the terms "front," "rear," "left," "right," "upper," and "lower" used in the following description refer to the attached figures. Figure 1In this specification, the terms "bottom surface" and "top surface," "inner" and "outer" refer to the direction toward or away from the geometry of a specific component. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this specification, "a plurality of" means two or more, unless otherwise explicitly and specifically defined by the direction of the center.
[0034] Example 1:
[0035] like Figure 1 As shown, a biomimetic artificial muscle bundle structure includes a silicone support structure 1 and multiple electrically driven biomimetic fibers 2. The silicone support structure 1 forms the basic workspace for providing six degrees of freedom of motion. The multiple electrically driven biomimetic fibers 2 are attached to the silicone support structure 1 and drive the ends of the silicone support structure 1 to generate multi-directional motion through electrically controlled contraction. The silicone support structure 1 is flexible and elastic, capable of deformation under external force, and achieves complex trajectory motion through the coordinated contraction of the electrically driven biomimetic fibers 2. The electrically driven biomimetic fibers 2 are made of electroactive materials and can generate axial contraction under current stimulation, thereby pulling the silicone support structure 1. The integrated design of the silicone support structure 1 and the electrically driven biomimetic fibers 2 gives the entire structure the flexibility and high load-bearing capacity of a biomimetic muscle, suitable for… For precision control applications; the system comprises three electrically driven bionic fibers 2, symmetrically arranged at a 120-degree angle to each other on a silicone support structure 1; one end of each electrically driven bionic fiber 2 is fixed to the base of the silicone support structure 1, and the other end is connected to the end effector of the silicone support structure 1; the independent contraction of a single electrically driven bionic fiber 2 can drive the end effector to move in the direction of the corresponding fiber; the simultaneous contraction of two electrically driven bionic fibers 2 can drive the end effector to move in the area between the two fibers; the coordinated contraction of the three electrically driven bionic fibers 2 can drive the end effector to move in the vertical direction or within a spatial range; the arrangement of the electrically driven bionic fibers 2 optimizes the workspace coverage and improves motion accuracy and stability.
[0036] Specific implementation process: The silicone support structure 1 constitutes a basic workspace with six degrees of freedom, possessing flexibility and elasticity, capable of multi-directional deformation under external force. Multiple electro-driven bionic fibers 2 are evenly arranged along their axes at the connection points between their tips and the top of the silicone support structure 1. Through electrically controlled contraction, they drive the ends of the silicone support structure 1 to generate multi-directional movement. The silicone support structure 1, with its flexibility and elasticity, can deform under external force and achieve complex trajectory movements through the coordinated contraction of the electro-driven bionic fibers 2. The integrated design of the silicone support structure 1 and the electro-driven bionic fibers 2 gives the entire structure the flexibility and high load-bearing capacity of bionic muscles, making it suitable for precision control scenarios. The electro-driven bionic fibers 2 are made of electroactive materials, attached to the silicone support structure 1, and generate axial contraction under electrical stimulation, thereby driving the end actuator of the silicone support structure 1 to generate spatial movement. The silicone support structure 1 provides the necessary flexibility and workspace, while the electro-driven bionic fibers 2, as actuators, realize a contraction-driven function similar to biological muscles. This bundled structure combines the adaptability of flexible materials with the rapid response characteristics of electric drive fibers, providing a hardware foundation for high-precision bionic motion control. The ring groove is designed to enable the top of the driving silicone support structure 1 to have better deformation capability when it is pulled by the electric drive bionic fibers 2 at different positions.
[0037] Example 2:
[0038] A method for controlling a biomimetic artificial muscle bundle structure includes the following steps:
[0039] Step 1: Collect dynamic response data of the bionic artificial muscle bundle system using multi-spectral input signals to obtain a dataset corresponding to the current input signal and the motion position. The multi-spectral input signals include DC current signals of different frequencies and amplitudes, which are applied to one or more electrically driven bionic fibers 2 in a step-by-step manner, and the three-dimensional motion position data is recorded. Specifically, the multi-spectral input signals include DC current signals that step at a fixed frequency. The input current of a single electrically driven bionic fiber 2 increases according to a preset step size, and the current value and the corresponding three-dimensional motion position vector are recorded. For the joint input of multiple electrically driven bionic fibers 2, sinusoidal current signals of different frequencies and amplitudes are applied to three fibers simultaneously, and the three-dimensional current vector and the three-dimensional motion position vector are recorded. The data collection process is carried out in a test scenario, capturing the motion of the end effector point through a binocular vision system and calibrating the pose using an image recognition algorithm.
[0040] Step 2: Based on the dataset, a sequence-generative reinforcement learning algorithm is used for trajectory control and matching to generate a control sequence for the target pose. The reinforcement learning algorithm optimizes the control strategy through a reward function to ensure that the trajectory of the end effector point is consistent with the desired trajectory. The sequence-generative reinforcement learning algorithm learns the control strategy by constructing a state space, an action space, and a reward function. The state space includes the current end effector position, the target pose, and historical trajectory information; the action space is the current control signal; and the reward function is designed based on trajectory error and energy consumption. The algorithm generates control sequences through iterative training, enabling the system to achieve high-precision trajectory tracking in complex dynamic environments. The reinforcement learning algorithm also utilizes the collected dataset for offline pre-training and online fine-tuning to adapt to real-world application scenarios.
[0041] Step 3: Error compensation is performed on the measurement data through repeated experiments and filtering to improve the reliability of trajectory data and control accuracy. Error compensation includes calculating the average trajectory, estimating the process noise variance, and applying Kalman filtering to enhance the data. Repeated experiments refer to conducting more than ten experiments under the same current input signal, recording the time-space coordinate data of the end execution point. By calculating the average position trajectory and variance at each time point, statistical features of the system's dynamic characteristics are extracted. Error compensation also involves correcting the calibration error and material response uncertainty of the vision measurement system, including compensation for camera parameter deviation, image distortion, and temperature drift. Filtering includes the Kalman filtering algorithm, used to smooth the average trajectory data and suppress outliers. Kalman filtering is calculated based on the system's linear model and measurement noise covariance, reducing random errors through prediction and update steps. The filtered data serves as the true label for reinforcement learning training, improving the accuracy and robustness of the control sequence.
[0042] The control method also includes a pose construction and recognition stage in real-world scenarios; in test scenarios, markers at the end effector point are identified and their three-dimensional coordinates are calibrated using a binocular camera and the YOLO algorithm; in application scenarios, control sequences are generated directly based on pose requirements without the need for real-time recognition; the pose construction and recognition process is combined with error compensation to ensure the system's stable performance in dynamic environments.
[0043] In addition, this invention also includes the extraction of dynamic statistical features of biomimetic muscle units: to suppress random errors and improve measurement accuracy, it is necessary to conduct multiple repeated experiments (more than 10 times) under the same current input signal and record the time-space coordinate dataset of the end. (End of current signal) Spatial coordinates under action ,in It's a timestamp. (This refers to the number of trials), where: ;
[0044] in and These are the maximum experimental step size and the number of trials, respectively. and These are the three-dimensional end-position coordinates and the three-dimensional current input signal, respectively. Nonlinear transformation and Koopman linear expansion are performed on the coordinates at each time point to calculate the global linear mode, average trajectory, and its variance. This yields the global linear characteristics of the current signal, the covariance of the average end-position trajectory and process noise, and the main process is as follows:
[0045] 1. Calculation of average state trajectory: ;
[0046] 2. Global linear mode calculation: observation function Selection: Select a polynomial function for nonlinear coordinate transformation, that is:
[0047] Where L represents the dimension increase, and the observation function g will... The 3D coordinates are mapped to the 3L-dimensional state space.
[0048] 3. Data Matrix Transformation: Construct forward / backward data matrices based on the average state trajectory. The format is as follows:
[0049] ;
[0050] ;
[0051] 4. Global Linear Mode Calculation: For forward / backward data matrices Mean mode The calculation is as follows: ;
[0052] in Represents the Pencemore generalized inverse of a matrix, a matrix ;
[0053] 5. System Reconfiguration Form: For the system's average mode, the global linear expansion form of the system is as follows:
[0054] ;where the matrix ;
[0055] 6. Process noise Variance estimation: .
[0056] To further improve data accuracy, Kalman filtering was used to cross-validate the experimental data under the condition of calculating the global linear expansion. The random error band of the average trajectory was reduced by calculating the filter gain to avoid the influence of extreme outliers on the average trajectory. The process is as follows:
[0057] Camera measurement variance calibration: Three-dimensional coordinates of preset target points on the calibration map Measure the coordinates of the points using a camera Coordinate points are constructed after multiple samplings. -Dataset Then the camera measurement covariance value is: ;
[0058] Based on the above calculations Calculate the Kalman filter gain The process is as follows:
[0059] Prediction equation: ;
[0060] Update equation: ; ;
[0061] Covariance recurrence relation: ;
[0062] Based on the above calculation process, Kalman filtering is used sequentially to enhance the data.
[0063] Ultimately, the mean-compensated trajectory data will serve as the true labels for reinforcement learning training, used for training and validating the control model. This compensation method, with a limited number of experiments, simplifies the computational complexity of filtering through recursive filtering, significantly improving the accuracy of control sequence generation and the actual motion performance of the system, making it suitable for biomimetic control tasks requiring high precision.
[0064] In the embodiments disclosed in this invention, the terms "installation," "connection," "linking," and "fixing" should be interpreted broadly. For example, "connection" can be a fixed connection, a detachable connection, or an integral connection; "linking" can be a direct connection or an indirect connection through an intermediate medium. Those skilled in the art can understand the specific meaning of the above terms in the embodiments disclosed in this invention according to the specific circumstances.
[0065] This specific embodiment is merely an explanation of the present invention and is not intended to limit the invention. After reading this specification, those skilled in the art can make modifications to this embodiment without contributing any inventive step, but such modifications are protected by patent law as long as they are within the scope of the claims of the present invention.
Claims
1. A control method of a biomimetic artificial muscle bundle structure, characterized by: The bionic artificial muscle bundle structure includes a silica gel support structure (1) and a plurality of electrically driven bionic fibers (2); the silica gel support structure (1) is a cylindrical structure, the axis of the silica gel support structure (1) is vertically arranged, a plurality of ring grooves are arranged from top to bottom at the top end of the silica gel support structure (1), an upper and lower through shaft hole is arranged at the center of the top of the silica gel support structure (1), and a ring groove is also arranged at the bottom end of the silica gel support structure (1); the silica gel support structure (1) is used to form a basic working space for providing six-degree-of-freedom motion; a plurality of electrically driven bionic fibers (2) are attached to the silica gel support structure (1) and drive the silica gel support structure (1) to produce multidirectional motion through electric control contraction; the top end of each electrically driven bionic fiber (2) is fixedly connected with the top end of the silica gel support structure (1), and a fixed block is fixedly installed at the bottom end of each electrically driven bionic fiber (2); the silica gel support structure (1) is made of silica gel and can realize complex trajectory motion through the coordinated contraction of the electrically driven bionic fibers (2); the electrically driven bionic fibers (2) are made of electroactive materials and can produce axial contraction under current stimulation, thereby pulling the top end of the silica gel support structure (1); the number of the electrically driven bionic fibers (2) is three, and the three electrically driven bionic fibers (2) are uniformly arranged around the axis of the silica gel support structure (1) in the axial direction; The control method comprises the following steps: Step one, collecting dynamic response data of the bionic artificial muscle bundle system through multi-spectrum input signals to obtain a data set corresponding to the current input signal and the motion position; the multi-spectrum input signal includes direct current signals with different frequencies and amplitudes, which are applied to a single or multiple electrically driven bionic fibers (2) in a step-by-step manner, and three-dimensional motion position data is recorded; the multi-spectrum input signal specifically includes direct current signals with fixed frequency steps, wherein the input current of a single electrically driven bionic fiber (2) increases by a preset step size, and the current value and the corresponding three-dimensional motion position vector are recorded; for the joint input of multiple electrically driven bionic fibers (2), sinusoidal current signals with different frequencies and amplitudes are applied to the three fibers at the same time, and three-dimensional current vectors and three-dimensional motion position vectors are recorded; the data collection process is carried out in a test scene, the motion of the end execution point is captured by a binocular vision system, and the pose is calibrated by combining an image recognition algorithm; Step two, based on the data set, a sequence generation reinforcement learning algorithm is used for trajectory control and matching to generate a control sequence for the target pose; the reinforcement learning algorithm optimizes the control strategy through a reward function to make the end execution point trajectory consistent with the expected trajectory; Step three, error compensation is performed on the measurement data through multiple repeated experiments and filtering processing to improve the reliability and control accuracy of the trajectory data; the error compensation includes calculating the average trajectory, estimating the process noise variance, and applying Kalman filtering to enhance the data.
2. The control method according to claim 1, characterized by: One end of the electrically driven bionic fiber (2) is fixed to the top of the silica gel support structure (1), the other end is connected to the end execution point of the silica gel support structure (1), and there is a gap between the end execution point of the silica gel support structure (1) and the body of the silica gel support structure (1); through the independent contraction of a single electrically driven bionic fiber (2), the end execution point can be driven to move in the direction corresponding to the fiber; through the simultaneous contraction of two electrically driven bionic fibers (2), the end execution point can be driven to move in the region of the included angle between the two fibers; through the coordinated contraction of three electrically driven bionic fibers (2), the end execution point can be driven to move in the vertical direction or the spatial range.
3. The control method according to claim 1, characterized by: The sequence generation reinforcement learning algorithm in step two learns the control strategy by constructing a state space, an action space, and a reward function; the state space includes the current end position, the target pose, and the historical trajectory information, the action space is the current control signal, and the reward function is designed based on the trajectory error and the energy consumption; the algorithm generates the control sequence through iterative training, so that the system can achieve high-precision trajectory tracking in a complex dynamic environment; The reinforcement learning algorithm also uses the collected data set for offline pre-training and online fine-tuning to adapt to actual application scenarios.
4. The control method according to claim 1, characterized by: The multiple repeated experiments in step three refer to more than ten experiments under the same current input signal, and the time-space coordinate data of the end execution point are recorded; the statistical characteristics of the system dynamic characteristics are extracted by calculating the average position trajectory and the variance at each time point; the error compensation also involves correcting the calibration error of the visual measurement system and the material response uncertainty, including camera parameter deviation, image distortion, and temperature drift compensation.
5. The control method according to claim 1, characterized by: The filtering process in step three includes the Kalman filtering algorithm, which is used for smoothing and outlier suppression of the average trajectory data; the Kalman filtering is based on the system linear model and the measurement noise covariance, and reduces random errors through prediction and update steps; the filtered data are used as the true labels for reinforcement learning training, which improves the accuracy and robustness of the control sequence.
6. The control method according to claim 1, characterized by: The control method also includes the pose construction and identification stage in the real scene; in the test scene, the markers of the end execution point are identified by a binocular camera and a YOLO algorithm, and their three-dimensional coordinates are calibrated; in the application scene, the control sequence is generated directly according to the pose requirement without real-time identification; the pose construction and identification process is combined with error compensation to ensure the stable performance of the system in a dynamic environment.
Citation Information
Patent Citations
A method for fabricating and electrically driving a biomimetic artificial muscle bundle structure.
CN115960396B
Flexible mechanical arm based on coupling of memory alloy and pneumatic artificial muscle
CN116038679A
Manipulator grabbing planning system and method based on visual identification
CN120382479A
Bionic moving mechanism driven by artificial muscle
CN1623742A