Mechanical arm pose control system and method based on gesture recognition
By introducing information collection and transmission risk supervision analysis into the robotic arm control system, the impact of gesture information collection and transmission on the robotic arm posture control is solved, the control effect and fluency are improved, and the effectiveness of gesture recognition and information reliability are ensured. sex.
Patent Information
- Application Number
- CN202411167346.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-23
- Publication Date
- 2024-12-03
AI Technical Summary
The prior art cannot effectively supervise the collection and transmission of gesture information of the robotic arm controller, resulting in poor control of the robotic arm posture, difficulty in supervising synchronization and fluency, affecting the control effect.
Design a robotic arm posture control system based on gesture recognition, including an information acquisition unit, an identification interference unit, a timeliness transmission unit, a display management unit, a control error analysis unit and a response supervision unit. Through risk assessment and feedback analysis, supervision gesture recognition and collection and the risks of information transmission, improve control effect and fluency.
By analyzing the risks of gesture recognition collection and information transmission, the impact on the control of the robot arm posture is reduced, the control effect and control fluency of the robot arm posture is improved, the effectiveness of gesture recognition and information reliability are ensured, and the synchronization of the robot arm is improved. Sex and fluency.
Smart Images

Figure CN119057773A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of robot arm control, and in particular to a robot arm posture control system and method based on gesture recognition. Background Art
[0002] A robotic arm is a complex system with high precision, multiple inputs and multiple outputs and high nonlinearity. Due to its unique operational flexibility, it has been widely used in industrial assembly, safety and explosion-proof fields. However, the robotic arm still has uncertainties such as parameter perturbation, external interference and unmodeled dynamics. Therefore, the modeling model of the robotic arm also has uncertainties. For different tasks, it is necessary to plan the motion trajectory of the robotic arm joint space, so as to cascade and form the terminal posture.
[0003] At present, the gesture recognition remote control based on sensors requires external devices to realize the recognition of gestures and control the robot arm. However, in the existing technology, it is impossible to safely supervise the gesture information collection and information transmission of the external robot arm controller, resulting in the gesture information collection and information transmission affecting the robot arm posture control effect, which is not conducive to the precise control of the robot arm posture. At the same time, it is impossible to further supervise and analyze the synchronization and smoothness of the robot arm control response, which reduces the synchronization and smoothness of the robot arm control.
[0004] In view of the above technical defects, a solution is now proposed. Summary of the invention
[0005] The purpose of the present invention is to provide a robot arm posture control system and method based on gesture recognition, which is to initially analyze from the two points of gesture recognition acquisition and information transmission to understand the current gesture recognition information acquisition risk level, so as to make reasonable and targeted management adjustments according to the feedback information to ensure the effectiveness of gesture recognition and information reliability, and to perform posture control risk feedback evaluation analysis by means of information feedback to understand whether gesture recognition acquisition and information transmission have an impact on the robot arm posture control as a whole, so as to perform rational management according to the information feedback situation, so as to reduce the impact of gesture recognition acquisition and information transmission on the robot arm posture control, which is helpful to improve the control effect and control fluency of the robot arm posture, and analyze the posture synchronization and fluency of the robot arm under the premise that the acquisition and transmission are normal, so as to manage the control of the robot arm according to the information feedback situation, so as to improve the control effect and control fluency of the robot arm, so as to solve the above-mentioned technical defects.
[0006] The object of the present invention can be achieved by the following technical solutions: A robotic arm posture control system based on gesture recognition, comprising an IoT control platform, an information acquisition unit, an interference identification unit, a timeliness transmission unit, a display management unit, a control error analysis unit, a response supervision unit, and an early warning response unit;
[0007] The information collection unit is used to collect the state evaluation data and transmission data of the robot arm controller, and send the state evaluation data and the transmission data to the interference identification unit and the timeliness transmission unit respectively. After receiving the state evaluation data, the interference identification unit immediately performs identification information collection risk supervision analysis on the state evaluation data to obtain the collection state index CZ;
[0008] After receiving the transmission data, the timeliness transmission unit immediately performs information transmission timeliness supervision analysis on the transmission data, compares and analyzes the obtained transmission interference evaluation coefficient Ri, and obtains the transmission impact index;
[0009] The control error analysis unit is used to perform posture control risk feedback evaluation analysis on the transmission impact index and the acquisition state index CZ, and compare and analyze the obtained posture control risk coefficient P to obtain a normal signal and an impact signal;
[0010] The response supervision unit is used to respond to normal signals, collect control response data of the robot arm, and perform synchronization smoothness supervision evaluation and analysis on the control response data, and send the obtained synchronization signal and delay signal to the early warning response unit.
[0011] Preferably, the identification information collection risk supervision and analysis process of the interference identification unit is as follows:
[0012] Set the monitoring cycle and set it as the time threshold to obtain the status evaluation data of the robot arm controller within the time threshold. The status evaluation data represents the collection performance value and the deviation risk value. The collection performance value and the deviation risk value are compared and analyzed with the preset collection performance value threshold and the preset deviation risk value threshold that are stored in the internal entry:
[0013] If the collection performance value is less than the preset collection performance value threshold, and the deviation risk value is less than the preset deviation risk value threshold, it is determined to be a level 1 state;
[0014] If the collection performance value is greater than or equal to the preset collection performance value threshold, and the deviation risk value is less than the preset deviation risk value threshold, or the collection performance value is less than the preset collection performance value threshold, and the deviation risk value is greater than or equal to the preset deviation risk value threshold, it is determined to be a secondary state;
[0015] If the collection performance value is greater than or equal to the preset collection performance value threshold, and the deviation risk value is greater than or equal to the preset deviation risk value threshold, it is judged as the third-level state, and the first-level state, the second-level state and the third-level state are set as the collection state index CZ, CZ = 1, 2, 3.
[0016] Preferably, the collected performance value indicates that the difference between the maximum operating temperature and the initial operating temperature of the sensor in the robotic arm controller is greater than the number corresponding to a preset threshold; the deviation risk value indicates the product of the proportion of delayed maintenance times in the total historical maintenance times of the robotic arm controller and the total number of failures after data normalization processing.
[0017] Preferably, the information transmission timeliness supervision and analysis process of the timeliness transmission unit is as follows:
[0018] The time threshold is divided into i sub-time periods, where i is a natural number greater than zero, and the transmission data of the robot arm controller in each sub-time period is obtained, the transmission data including the environmental interference index and the transmission interference index, the environmental interference index and the transmission interference index are labeled as HGi and CGi respectively, and the environmental interference index HGi and the transmission interference index CGi are substituted into the formula to obtain the transmission interference evaluation coefficient Ri of each sub-time period;
[0019] The transmission interference assessment coefficient Ri is compared and analyzed with the preset transmission interference assessment coefficient threshold value recorded and stored internally, and the ratio of the number of sub-time periods corresponding to which the transmission interference assessment coefficient Ri is greater than or equal to the preset transmission interference assessment coefficient threshold value to the total number of sub-time periods is set as the transmission impact index.
[0020] Preferably, the environmental interference index indicates the length of overlap corresponding to the value of the environmental data of the environmental area where the robot arm is located in a sub-time period exceeding a preset threshold, and the environmental data includes environmental temperature change values and environmental electromagnetic change values; the transmission interference index indicates the number of times that the transmission delay value of the robot arm transmission network in the sub-time period exceeds the preset transmission delay value threshold and the duration corresponding to the preset duration threshold is greater than the preset duration threshold.
[0021] Preferably, the posture control risk feedback evaluation and analysis process of the control error analysis unit is as follows:
[0022] The acquisition state index CZ of the robot controller within the time threshold is obtained, and the transmission influence index of the robot controller within the time threshold is obtained at the same time. The transmission influence index is labeled as CY, and the acquisition state index CZ and the transmission influence index CY are substituted into the formula P = (CZ × CY) 2 ×f1×f2×f3 to obtain the posture control risk coefficient, where f1 and f2 are the preset weight factor coefficients of the acquisition state index CZ and the transmission impact index CY respectively, f3 is the preset correction factor coefficient, f1, f2 and f3 are all greater than zero, P is the posture control risk coefficient, and the posture control risk coefficient P is compared and analyzed with the preset posture control risk coefficient threshold value stored in the internal input:
[0023] If the ratio between the posture control risk coefficient P and the preset posture control risk coefficient threshold is less than 1, a normal signal is generated;
[0024] If the ratio between the posture control risk coefficient P and the preset posture control risk coefficient threshold is greater than or equal to 1, an influence signal is generated.
[0025] Preferably, the synchronization fluency supervision evaluation and analysis process of the response supervision unit is as follows:
[0026] The control response data of the robot arm within the time threshold is obtained. The control response data includes the action response value and the synchronization evaluation value. The action response value and the synchronization evaluation value are compared and analyzed with the preset action response value threshold and the preset synchronization evaluation value threshold stored in the internal input:
[0027] If the action response value is less than the preset action response value threshold, and the synchronization evaluation value is less than the preset synchronization evaluation value threshold, a synchronization signal is generated;
[0028] If the action response value is greater than or equal to the preset action response value threshold, or the synchronization evaluation value is greater than or equal to the preset synchronization evaluation value threshold, a delay signal is generated;
[0029] The action response value represents the difference between the maximum and minimum values in the duration between the start time of the operation gesture and the time when the robot arm responds to the synchronization gesture;
[0030] The synchronization evaluation value represents the difference between the maximum and minimum values of the difference between the operation duration of the operation gesture and the execution duration of the robotic arm, the operation duration represents the duration between the start and end times of the operation gesture, and the execution duration represents the duration between the start and end times of the robotic arm's response to the synchronization gesture.
[0031] The beneficial effects of the present invention are as follows:
[0032] (1) The present invention is to conduct preliminary analysis from the two points of gesture recognition acquisition and information transmission to understand the current gesture recognition information acquisition risk level, so as to make reasonable and targeted management adjustments based on the feedback information to ensure the effectiveness of gesture recognition and the reliability of information, and to conduct posture control risk feedback assessment analysis through information feedback to understand whether gesture recognition acquisition and information transmission as a whole have an impact on the robot arm posture control, so as to conduct rational management based on the information feedback to reduce the impact of gesture recognition acquisition and information transmission on the robot arm posture control, which is helpful to improve the control effect and control fluency of the robot arm posture;
[0033] (2) The present invention analyzes the posture synchronization and smoothness of the robot arm under the premise that the collection and transmission are normal, so as to manage the control of the robot arm according to the information feedback, so as to improve the control effect and control smoothness of the robot arm. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] The present invention will be further described below in conjunction with the accompanying drawings;
[0035] Figure 1 It is a flowchart of the system of the present invention;
[0036] Figure 2 It is a reference diagram of the method of the present invention. DETAILED DESCRIPTION
[0037] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0038] Example 1: Please refer to Figure 1 to Figure 2 As shown, the present invention is a robotic arm posture control system based on gesture recognition, including an IoT control platform, an information acquisition unit, an interference identification unit, a timeliness transmission unit, a display management unit, a control error analysis unit, a response supervision unit, and an early warning response unit;
[0039] The IoT control platform is connected to the information collection unit in a one-way communication manner, the information collection unit is connected to the interference identification unit and the timeliness transmission unit in a one-way communication manner, the interference identification unit is connected to the display management unit in a one-way communication manner, the interference identification unit and the timeliness transmission unit are connected to the control error analysis unit in a one-way communication manner, the control error analysis unit is connected to the response supervision unit and the early warning response unit in a one-way communication manner, and the response supervision unit is connected to the early warning response unit in a one-way communication manner;
[0040] When the IoT control platform generates a supervision instruction and sends it to the information collection unit, the information collection unit immediately collects the state evaluation data and transmission data of the robot controller after receiving the supervision instruction, and sends the state evaluation data and transmission data to the identification interference unit and the timeliness transmission unit respectively. After receiving the state evaluation data, the identification interference unit immediately performs identification information collection risk supervision analysis on the state evaluation data to understand the current gesture recognition information collection risk level, so as to make reasonable and targeted management adjustments based on the feedback information to ensure the effectiveness of gesture recognition and information reliability. The specific identification information collection risk supervision analysis process is as follows:
[0041] In an embodiment of the present invention, a user wears a robotic arm controller to control the position and posture of the robotic arm. The robotic arm controller transmits signals to the robotic arm via a wireless network or a signal line to recognize changes in gestures of the user wearing the robotic arm to control the synchronous changes in the position and posture of the robotic arm.
[0042] Set the monitoring cycle and set it as the time threshold to obtain the status evaluation data of the robot arm controller within the time threshold. The status evaluation data represents the collection performance value and the deviation risk value. The collection performance value and the deviation risk value are compared and analyzed with the preset collection performance value threshold and the preset deviation risk value threshold that are stored in the internal entry:
[0043] If the collection performance value is less than the preset collection performance value threshold, and the deviation risk value is less than the preset deviation risk value threshold, it is determined to be a level 1 state;
[0044] If the collection performance value is greater than or equal to the preset collection performance value threshold, and the deviation risk value is less than the preset deviation risk value threshold, or the collection performance value is less than the preset collection performance value threshold, and the deviation risk value is greater than or equal to the preset deviation risk value threshold, it is determined to be a secondary state;
[0045] If the acquisition performance value is greater than or equal to the preset acquisition performance value threshold, and the deviation risk value is greater than or equal to the preset deviation risk value threshold, it is determined to be a third-level state, wherein the acquisition risk levels corresponding to the first-level state, the second-level state, and the third-level state increase in sequence, and the first-level state, the second-level state, and the third-level state are set as acquisition state indexes CZ, CZ = 1, 2, 3, that is, the acquisition state index CZ = 1, which indicates the first-level state, the acquisition state index CZ = 2, which indicates the second-level state, and the acquisition state index CZ = 3, which indicates the third-level state, and the acquisition state index CZ is sent to the control error analysis unit and the display management unit. After receiving the acquisition state index CZ, the display management unit immediately displays the preset warning text corresponding to the acquisition state index CZ, so as to make reasonable and targeted management adjustments according to the feedback information to ensure the effectiveness of gesture recognition and the reliability of information;
[0046] In the embodiment of the present invention, the collection performance value indicates that the difference between the maximum operating temperature and the initial operating temperature of the sensor in the robot arm controller is greater than the number corresponding to the preset threshold value. It should be noted that the analysis is performed from the perspective of the operation of the sensor to ensure the validity of the collected data and the working safety of the sensor. The sensors in the robot arm controller include but are not limited to: somatosensory sensors, speed sensors;
[0047] In the embodiment of the present invention, the deviation risk value represents the product value obtained by multiplying the ratio of the number of delayed maintenance times in the total number of historical maintenance times of the robot arm controller and the total number of failures after data normalization. It should be noted that the potential risk situation of the robot arm controller is analyzed from the perspective of historical information to improve the comprehensiveness of the analysis data;
[0048] After receiving the transmission data, the timeliness transmission unit immediately performs information transmission timeliness supervision analysis on the transmission data to understand the information transmission delay risk of the robot controller, so as to provide data support for subsequent analysis. The specific information transmission timeliness supervision analysis process is as follows:
[0049] The time threshold is divided into i sub-time periods, where i is a natural number greater than zero, and the transmission data of the robot arm controller in each sub-time period is obtained. The transmission data includes an environmental interference index and a transmission interference index. The environmental interference index and the transmission interference index are labeled HGi and CGi, respectively. The environmental interference index HGi and the transmission interference index CGi are substituted into the formula Ri = (HGi×a1+CGi×a2) 2 ×a3 obtains the transmission interference evaluation coefficient of each sub-time period, wherein a1 and a2 are preset proportional factor coefficients of the environmental interference index and the transmission interference index respectively, and the proportional factor coefficient is used to correct the deviation of various parameters in the formula calculation process, so as to make the calculation result more accurate, a3 is the preset fault tolerance factor coefficient, a1, a2 and a3 are all greater than zero, and Ri is the transmission interference evaluation coefficient of each sub-time period;
[0050] The transmission interference assessment coefficient Ri is compared and analyzed with the preset transmission interference assessment coefficient threshold value recorded and stored internally, and the ratio of the number of sub-time periods corresponding to which the transmission interference assessment coefficient Ri is greater than or equal to the preset transmission interference assessment coefficient threshold value to the total number of sub-time periods is set as the transmission impact index, and the transmission impact index is sent to the control error analysis unit;
[0051] In the embodiment of the present invention, the environmental interference index indicates the overlap time corresponding to the value of the environmental data of the environmental area where the manipulator is located in the sub-time period exceeding the preset threshold, and the environmental data includes the environmental temperature change value, the environmental electromagnetic change value, etc. It should be noted that the analysis is performed from the perspective of the transmission environment of the manipulator to understand the impact of the environment on the timeliness of the transmission of the transmission network;
[0052] In an embodiment of the present invention, the transmission interference index represents the number of times that the transmission delay value of the robot arm transmission network in a sub-time period exceeds the time corresponding to the preset transmission delay value threshold and is greater than the time corresponding to the preset time threshold. It should be noted that the analysis is performed from the perspective of the transmission delay of the transmission network to understand the impact of the transmission network on the posture control of the robot arm.
[0053] Embodiment 2: The control error analysis unit is used to perform posture control risk feedback evaluation and analysis on the transmission impact index and the acquisition state index CZ to understand whether the gesture recognition acquisition and information transmission as a whole have an impact on the posture control of the manipulator, so as to perform rational management according to the information feedback to ensure the posture control effect of the manipulator. The specific posture control risk feedback evaluation and analysis process is as follows:
[0054] The acquisition state index CZ of the robot controller within the time threshold is obtained, and the transmission influence index of the robot controller within the time threshold is obtained at the same time. The transmission influence index is labeled as CY, and the acquisition state index CZ and the transmission influence index CY are substituted into the formula P = (CZ × CY) 2 ×f1×f2×f3 to obtain the posture control risk coefficient, where f1 and f2 are the preset weight factor coefficients of the acquisition state index CZ and the transmission impact index CY respectively, f3 is the preset correction factor coefficient, f1, f2 and f3 are all greater than zero, P is the posture control risk coefficient, and the posture control risk coefficient P is compared and analyzed with the preset posture control risk coefficient threshold value stored in the internal input:
[0055] If the ratio between the posture control risk coefficient P and the preset posture control risk coefficient threshold is less than 1, a normal signal is generated;
[0056] If the ratio between the posture control risk coefficient P and the preset posture control risk coefficient threshold is greater than or equal to 1, an impact signal is generated, and the normal signal and the impact signal are sent to the early warning response unit. After receiving the normal signal and the impact signal, the early warning response unit immediately makes the preset early warning operation corresponding to the normal signal and the impact signal, so as to adjust the manipulator controller according to the information feedback, so as to reduce the influence of gesture recognition acquisition and information transmission on the posture control of the manipulator, thereby helping to improve the accuracy and stability of the posture control of the manipulator;
[0057] The response supervision unit is used to respond to normal signals, collect the control response data of the robot arm, and perform synchronization and fluency supervision evaluation and analysis on the control response data to understand whether the posture synchronization and fluency of the robot arm are qualified under the premise that the collection and transmission are normal, so as to conduct feedback management in time to improve the control effect and control fluency of the robot arm. The specific synchronization and fluency supervision evaluation and analysis process is as follows:
[0058] The control response data of the robot arm within the time threshold is obtained. The control response data includes the action response value and the synchronization evaluation value. The action response value and the synchronization evaluation value are compared and analyzed with the preset action response value threshold and the preset synchronization evaluation value threshold stored in the internal input:
[0059] If the action response value is less than the preset action response value threshold, and the synchronization evaluation value is less than the preset synchronization evaluation value threshold, a synchronization signal is generated;
[0060] If the action response value is greater than or equal to the preset action response value threshold, or the synchronization evaluation value is greater than or equal to the preset synchronization evaluation value threshold, a delay signal is generated, and the synchronization signal and the delay signal are sent to the early warning response unit. After receiving the synchronization signal and the delay signal, the early warning response unit immediately performs the preset early warning operation corresponding to the synchronization signal and the delay signal, so as to manage the control of the robot arm according to the information feedback, so as to improve the control effect and control fluency of the robot arm;
[0061] In the embodiment of the present invention, the action response value represents the difference between the maximum value and the minimum value in the duration between the start time of the operation gesture and the time when the robot arm responds to the synchronization gesture. It should be noted that the analysis is performed from the perspective of the synchronization smoothness of the robot arm to understand the synchronization smoothness of the robot arm, so as to improve the control effect and control smoothness of the robot arm;
[0062] In an embodiment of the present invention, the synchronization evaluation value represents the difference between the maximum and minimum values of the difference between the operation duration of the operation gesture and the execution duration of the robotic arm, the operation duration represents the duration between the start and end times of the operation gesture, and the execution duration represents the duration between the start and end times of the robotic arm's response to the synchronization gesture. It should be noted that the analysis is performed from the perspective of the posture change process of the operation gesture to understand the risk of synchronization error of the robotic arm, which helps to improve the posture control accuracy of the robotic arm.
[0063] Embodiment 3: The present invention also proposes a method for controlling the posture of a robotic arm based on gesture recognition, comprising the following steps:
[0064] Step 1: Collect the state evaluation data and transmission data of the robot controller and send them to step 2 and step 3;
[0065] Step 2: Used to identify information collection risk supervision analysis on the status assessment data, obtain the collection status index CZ, and substitute the collection status index CZ into step 4, and at the same time feedback the preset warning text corresponding to the status index CZ;
[0066] Step 3: Perform information transmission timeliness supervision analysis on the transmission data to obtain the transmission impact index, and substitute the transmission impact index into step 4;
[0067] Step 4: Perform posture control risk feedback assessment and analysis through information feedback and information fusion, and compare and analyze the posture control risk coefficient P. If a normal signal is obtained, proceed to step 5. If an impact signal is obtained, feedback warning management is performed;
[0068] Step 5: Under the premise that the collection and transmission are normal, collect the control response data of the robot arm, and conduct synchronization and smoothness supervision and evaluation analysis on the control response data to determine whether the posture synchronization and smoothness of the robot arm are qualified, and make corresponding preset warning operations according to the feedback information;
[0069] In summary, the present invention is to preliminarily analyze from two points of gesture recognition acquisition and information transmission, that is, to perform recognition information acquisition risk supervision analysis on the state assessment data from the perspective of gesture recognition acquisition, so as to understand the current gesture recognition information acquisition risk level, so as to make reasonable and targeted management adjustments according to the feedback information, so as to ensure the effectiveness of gesture recognition and information reliability, and to perform information transmission timeliness supervision analysis from the perspective of information transmission, so as to understand the information transmission delay risk of the robot arm controller, and to perform posture control risk feedback assessment analysis by means of information feedback, so as to understand whether the gesture recognition acquisition and information transmission as a whole have an impact on the posture control of the robot arm, so as to perform rational management according to the information feedback, so as to reduce the impact of gesture recognition acquisition and information transmission on the posture control of the robot arm, thereby helping to improve the accuracy and stability of the posture control of the robot arm, and at the same time helping to improve the control effect and control fluency of the posture of the robot arm, and to analyze the posture synchronization and fluency of the robot arm under the premise that the acquisition and transmission are normal, so as to manage the control of the robot arm according to the information feedback, so as to improve the control effect and control fluency of the robot arm.
[0070] The threshold is set to facilitate comparison. The size of the threshold depends on the amount of sample data and the number of bases set by technicians in this field for each group of sample data; as long as it does not affect the proportional relationship between the parameter and the quantized value.
[0071] The above formulas are obtained by collecting a large amount of data for software simulation and selecting a formula that is close to the actual value. The coefficients in the formula are set by technical personnel in this field according to actual conditions. The above is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited to this. Any technical personnel familiar with the technical field within the technical scope disclosed by the present invention, according to the technical solution and inventive concept of the present invention, make equivalent replacement or change, which should be covered within the protection scope of the present invention.
Claims
1. A robotic arm posture control system based on gesture recognition, characterized in that: It includes an IoT control platform, an information collection unit, an interference identification unit, a timeliness transmission unit, a display management unit, a control error analysis unit, a response supervision unit, and an early warning response unit; The information collection unit is used to collect the state evaluation data and transmission data of the robot arm controller, and send the state evaluation data and the transmission data to the interference identification unit and the timeliness transmission unit respectively. After receiving the state evaluation data, the interference identification unit immediately performs identification information collection risk supervision analysis on the state evaluation data to obtain the collection state index CZ; After receiving the transmission data, the timeliness transmission unit immediately performs information transmission timeliness supervision analysis on the transmission data, compares and analyzes the obtained transmission interference evaluation coefficient Ri, and obtains the transmission impact index; The control error analysis unit is used to perform posture control risk feedback evaluation analysis on the transmission impact index and the acquisition state index CZ, and compare and analyze the obtained posture control risk coefficient P to obtain a normal signal and an impact signal; The response supervision unit is used to respond to normal signals, collect control response data of the robot arm, and perform synchronization smoothness supervision evaluation and analysis on the control response data, and send the obtained synchronization signal and delay signal to the early warning response unit.
2. The robotic arm position control system based on gesture recognition according to claim 1, characterized in that: The risk supervision and analysis process of the identification information collection of the interference identification unit is as follows: Set the monitoring cycle and set it as the time threshold to obtain the status evaluation data of the robot arm controller within the time threshold. The status evaluation data represents the collection performance value and the deviation risk value. The collection performance value and the deviation risk value are compared and analyzed with the preset collection performance value threshold and the preset deviation risk value threshold that are stored in the internal entry: If the collection performance value is less than the preset collection performance value threshold, and the deviation risk value is less than the preset deviation risk value threshold, it is determined to be a level 1 state; If the collection performance value is greater than or equal to the preset collection performance value threshold, and the deviation risk value is less than the preset deviation risk value threshold, or the collection performance value is less than the preset collection performance value threshold, and the deviation risk value is greater than or equal to the preset deviation risk value threshold, it is determined to be a secondary state; If the collection performance value is greater than or equal to the preset collection performance value threshold, and the deviation risk value is greater than or equal to the preset deviation risk value threshold, it is judged as the third-level state, and the first-level state, the second-level state and the third-level state are set as the collection state index CZ, CZ = 1, 2, 3.
3. The robotic arm posture control system based on gesture recognition according to claim 2, characterized in that: The collection performance value indicates that the difference between the maximum operating temperature and the initial operating temperature of the sensor in the robotic arm controller is greater than the number corresponding to the preset threshold; the deviation risk value indicates the product of the proportion of delayed maintenance times in the total historical maintenance times of the robotic arm controller and the total number of failures after data normalization.
4. The robotic arm position control system based on gesture recognition according to claim 3, characterized in that: The information transmission timeliness supervision and analysis process of the timeliness transmission unit is as follows: The time threshold is divided into i sub-time periods, where i is a natural number greater than zero, and the transmission data of the robot arm controller in each sub-time period is obtained, the transmission data including the environmental interference index and the transmission interference index, the environmental interference index and the transmission interference index are labeled as HGi and CGi respectively, and the environmental interference index HGi and the transmission interference index CGi are substituted into the formula to obtain the transmission interference evaluation coefficient Ri of each sub-time period; The transmission interference assessment coefficient Ri is compared and analyzed with the preset transmission interference assessment coefficient threshold value recorded and stored internally, and the ratio of the number of sub-time periods corresponding to which the transmission interference assessment coefficient Ri is greater than or equal to the preset transmission interference assessment coefficient threshold value to the total number of sub-time periods is set as the transmission impact index.
5. The robotic arm position control system based on gesture recognition according to claim 4, characterized in that: The environmental interference index indicates the length of overlap corresponding to the value of the environmental data of the environmental area where the robot arm is located in the sub-time period exceeding the preset threshold, and the environmental data includes the environmental temperature change value and the environmental electromagnetic change value; the transmission interference index indicates the number of times that the transmission delay value of the robot arm transmission network in the sub-time period exceeds the preset transmission delay value threshold and the duration corresponding to the preset duration threshold is greater than the preset duration threshold.
6. The robotic arm position control system based on gesture recognition according to claim 5, characterized in that: The posture control risk feedback evaluation and analysis process of the control error analysis unit is as follows: The acquisition state index CZ of the robot controller within the time threshold is obtained, and the transmission influence index of the robot controller within the time threshold is obtained at the same time. The transmission influence index is labeled as CY, and the acquisition state index CZ and the transmission influence index CY are substituted into the formula P = (CZ × CY) 2 ×f1×f2×f3 to obtain the posture control risk coefficient, where f1 and f2 are the preset weight factor coefficients of the acquisition state index CZ and the transmission impact index CY respectively, f3 is the preset correction factor coefficient, f1, f2 and f3 are all greater than zero, P is the posture control risk coefficient, and the posture control risk coefficient P is compared and analyzed with the preset posture control risk coefficient threshold value stored in the internal input: If the ratio between the posture control risk coefficient P and the preset posture control risk coefficient threshold is less than 1, a normal signal is generated; If the ratio between the posture control risk coefficient P and the preset posture control risk coefficient threshold is greater than or equal to 1, an influence signal is generated.
7. The robotic arm position control system based on gesture recognition according to claim 6, characterized in that: The synchronous fluency supervision evaluation and analysis process of the response supervision unit is as follows: The control response data of the robot arm within the time threshold is obtained. The control response data includes the action response value and the synchronization evaluation value. The action response value and the synchronization evaluation value are compared and analyzed with the preset action response value threshold and the preset synchronization evaluation value threshold stored in the internal input: If the action response value is less than the preset action response value threshold, and the synchronization evaluation value is less than the preset synchronization evaluation value threshold, a synchronization signal is generated; If the action response value is greater than or equal to the preset action response value threshold, or the synchronization evaluation value is greater than or equal to the preset synchronization evaluation value threshold, a delay signal is generated; The action response value represents the difference between the maximum and minimum values in the duration between the start time of the operation gesture and the time when the robot arm responds to the synchronization gesture; The synchronization evaluation value represents the difference between the maximum and minimum values of the difference between the operation duration of the operation gesture and the execution duration of the robotic arm, the operation duration represents the duration between the start and end times of the operation gesture, and the execution duration represents the duration between the start and end times of the robotic arm's response to the synchronization gesture.
8. A robot arm posture control method based on gesture recognition, applied to the robot arm posture control system based on gesture recognition according to claim 7, characterized in that: The following steps are involved: Step 1: Collect state evaluation data and transmission data of the robot controller and send them to step 2 and step 3; Step 2: Used to identify information collection risk supervision analysis on the status assessment data, obtain the collection status index CZ, and substitute the collection status index CZ into step 4, and at the same time feedback the preset warning text corresponding to the status index CZ; Step 3: Perform information transmission timeliness supervision analysis on the transmission data to obtain the transmission impact index, and substitute the transmission impact index into step 4; Step 4: Perform posture control risk feedback assessment and analysis through information feedback and information fusion, and compare and analyze the posture control risk coefficient P. If a normal signal is obtained, proceed to step 5. If an impact signal is obtained, feedback warning management is performed; Step 5: Under the premise that the collection and transmission are normal, collect the control response data of the robot arm, and conduct synchronization and smoothness supervision evaluation and analysis on the control response data to determine whether the posture synchronization and smoothness of the robot arm are qualified, and make corresponding preset warning operations based on the feedback information.
Citation Information
Cited By
Portable blood vessel puncture scanner
CN120052816A
A portable vascular puncture scanner
CN120052816B
