Multi-Device Universal Gesture Input System Based on Triboelectric Nanogenerator

By introducing wear detection, drive adjustment and control modules into the gesture input system, the wear problem of gesture board caused by long-term friction by users is solved, and the stability and service life of the system are improved.

CN119883004BActive Publication Date: 2025-06-17FUZHOU UNIV ZHICHENG COLLEGE
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510373654.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-03-27
Publication Date
2025-06-17
Estimated Expiration
2045-03-27

AI Technical Summary

Technical Problem

Some users rub the input in a small area of ​​the gesture board for a long time, causing wear in this area, affecting the accuracy and stability of gesture recognition. The existing systems lack effective wear detection and response mechanisms.

Method used

A multi-device general gesture input system based on friction nanogenerator is designed, including a flexible gesture board body, wear detection module, drive adjustment module and control module. The wear detection module collects the electric signal waveform characteristics of the power generation unit in real time to build a dynamic wear evaluation model; the drive adjustment module adaptively switches to the low-wear area through a micro linear motor array and a shape memory alloy bracket; the control module plans gesture board displacement strategy based on patient historical operation data and real-time physiological characteristics.

Benefits of technology

It realizes accurate identification and adaptive processing of gesture board wear, extends the service life of gesture board, and improves the stability and reliability of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119883004B_ABST
    Figure CN119883004B_ABST
Patent Text Reader

Abstract

The present invention discloses a multi-device universal gesture input system based on a triboelectric nanogenerator, belonging to the technical field of gesture recognition. Specifically, it includes: The flexible gesture board body is composed of a slidable substrate and a triboelectric nanogenerator unit matrix. The power generation units are connected by flexible wires to form a dynamic network. The substrate is a multi-layer structure, having an anti-bending support layer, a deformation conduction layer, and a replaceable friction interface layer; The wear detection module collects the electrical signal characteristics of the power generation units, combines the response differences of adjacent units, and constructs a local dynamic wear assessment model; The drive adjustment module has a micro linear motor array and a shape memory alloy bracket. When the wear exceeds the threshold, the motor drives the gesture board to translate in multiple directions, and the bracket adjusts the curvature of the board surface to switch to a low wear area; The control module establishes a spatial wear map according to the patient's historical and real-time physiological characteristics, plans a displacement strategy, and selects a low wear area as the new operation interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of gesture recognition, and particularly to a multi-device universal gesture input system based on a triboelectric nanogenerator. Background Art

[0002] In today's digital age, the technology of human-computer interaction has developed rapidly, and various intelligent devices are widely used in all aspects of people's lives. As a natural and intuitive way of human-computer interaction, gesture input has gradually become a research hotspot. It enables users to interact with devices through simple hand movements without complex button operations, greatly improving the convenience and efficiency of interaction. In many fields such as medical rehabilitation, smart home, and virtual reality, gesture input systems have broad application prospects, bringing a more intelligent and user-friendly experience to people.

[0003] Currently, gesture input systems based on triboelectric nanogenerators (TENGs) have attracted the attention of many researchers due to their advantages such as self-power supply and high sensitivity. Such systems utilize the coupled effect of triboelectrification and electrostatic induction to convert mechanical energy into electrical energy to achieve the perception and recognition of gesture movements. Existing TENG-based gesture input systems usually consist of a gesture board and a detection circuit. Multiple triboelectric nanogeneration units are distributed on the gesture board. When a user performs operations such as sliding and clicking on the gesture board, the generation units will generate corresponding electrical signals, and these electrical signals are analyzed and processed by the detection circuit to achieve gesture recognition. Thus, it provides convenience for some elderly and seriously ill patients to express their needs through gesture input.

[0004] However, due to the difficulty of finger movement for some patients, they can only rub and input in a small area of the gesture board for a long time, causing wear in this small area. Wear problems are likely to occur, resulting in a decline in the performance of the generation units and affecting the accuracy and stability of gesture recognition. Moreover, existing systems lack effective wear detection and response mechanisms and cannot detect and handle wear situations in a timely manner. Summary of the Invention

[0005] The purpose of the present invention is to provide a multi-device universal gesture input system based on a triboelectric nanogenerator to solve the following technical problems:

[0006] Some users rub and input in a small area of the gesture board for a long time, causing wear in this small area. Wear problems are likely to occur, affecting the accuracy and stability of gesture recognition. Moreover, existing systems lack effective wear detection and response mechanisms and cannot detect and handle wear situations in a timely manner.

[0007] The purpose of the present invention can be achieved through the following technical solutions:

[0008] The multi-device universal gesture input system based on friction nanogenerator includes a flexible gesture board body, a wear detection module, a drive adjustment module and a control module, wherein:

[0009] The flexible gesture board body includes a slidable substrate and a friction nano-power generation unit matrix. Each power generation unit forms a dynamic connection network through flexible wires. The substrate adopts a multi-layer stacking design, including a bottom anti-bending support layer, a middle deformation conduction layer and a top replaceable friction interface layer.

[0010] The wear detection module collects the electrical signal waveform characteristics of each power generation unit in real time, extracts the charge peak attenuation rate, contact impedance nonlinear change and signal noise spectrum characteristics, and combines the collaborative response differences of adjacent power generation units to build a dynamic wear assessment model for the local area;

[0011] The drive adjustment module includes a micro linear motor array and a shape memory alloy bracket. When it is detected that the wear level of the target area exceeds a preset threshold, the linear motor array drives the gesture board to translate in multiple directions along the guide rail, and at the same time uses the pre-programmed deformation characteristics of the shape memory alloy bracket to adjust the curvature of the board surface, so that the patient's finger contact area is adaptively switched to a low-wear area;

[0012] The control module establishes a spatial wear probability distribution map based on the patient's historical operation data and real-time physiological characteristics, generates a gesture board displacement strategy through a dynamic path planning algorithm, and preferentially selects the area with the lowest wear accumulation risk as the new operation interface.

[0013] As a further solution of the present invention: the friction nano power generation unit of the flexible gesture board body is divided into a high-frequency contact area and a low-frequency contact area;

[0014] The surface of the power generation unit in the high-frequency contact area is covered with a self-healing composite material layer, which includes a flowable repair agent encapsulated in microcapsules and a photoresponsive polymer matrix. When triggered by mechanical friction or external light, the repair agent seeps out and fills the micro cracks, and the photoresponsive polymer solidifies and repairs the interface through a cross-linking reaction.

[0015] The surface of the power generation unit in the low-frequency contact area is etched with radial micro grooves, and the wear is guided to spread to the edge of the power generation unit through directional texture, and a redundant electrode array is pre-set;

[0016] Each power generation unit is connected by an elastic hinge structure. When stress is applied, a small relative displacement occurs between the power generation units, and a porous energy absorption layer is set at the bottom of the power generation unit.

[0017] As a further solution of the present invention: the flexible gesture board body includes a plurality of independently detachable sub-modules, and when a sub-module reaches the life limit standard, it is replaced through a magnetic suction interface.

[0018] As a further solution of the present invention, the process for the wear detection module to construct a dynamic wear assessment model for a local area is as follows:

[0019] Normalize the peak charge amount of each triboelectric nanogenerator unit within consecutive triggering cycles, calculate its decay slope relative to the initial value, and when the decay slope exceeds twice the average value of adjacent generator units, mark it as a potentially worn generator unit;

[0020] Detect the dynamic change of the contact impedance between generator units by applying a microcurrent. If the correlation between the impedance growth rate and the charge decay rate in a certain area exceeds a preset threshold and the impedance continuously increases for more than a set duration, it is determined as structural wear;

[0021] Collect the sliding trajectory data of the patient's finger in the target area, extract the characteristics of the trajectory length, curvature, and speed distribution. When the trajectory repeatability is higher than the set threshold and the signal recognition error rate synchronously rises to the set threshold, confirm that this area enters the high wear state;

[0022] According to the markings of potentially worn generator units, structural wear, and high wear states, grade-mark the wear areas. Only when the signal attenuation, impedance change, and trajectory repeatability simultaneously meet the set conditions, trigger the drive adjustment module to perform area switching.

[0023] As a further solution of the present invention, the process for the drive adjustment module to adaptively switch areas is as follows:

[0024] The micro linear motor array drives the gesture board in an asymmetric stepping mode, alternately moving along the X / Y axis directions. Each displacement amount is dynamically adjusted according to the real-time wear degree to ensure that the natural placement position of the patient's finger always covers the unworn area;

[0025] During the translation process, the shape memory alloy bracket generates a preset deformation according to the curvature requirement of the target area, forming a micro-protrusion or depression structure on the surface of the gesture board to guide the patient's finger to naturally shift towards the low wear area; when the translation operation is not sufficient to cover the available area, the micro motor drives the gesture board to rotate around the central axis, and the rotation angle matches the range of motion of the patient's finger joint, redistributing the contact pressure by changing the angle distribution of the board surface;

[0026] Automatically perform a reverse micro-displacement after each switching action to release the internal stress, and monitor the temperature rise and vibration signals of the drive components. When the temperature rise and vibration signals are abnormal, give a prompt.

[0027] As a further solution of the present invention, before the drive adjustment module drives the gesture board to perform a translation action, it generates a micro-vibration with a specific frequency through a piezoelectric brake to prompt the patient that an area switch is about to occur.

[0028] As a further solution of the present invention: The process for the control module to establish a spatial wear probability distribution map is as follows:

[0029] Integrate the daily operation time distribution of the patient, the heat map of finger pressure intensity, and the historical data of environmental temperature and humidity to establish a multi-dimensional wear correlation model;

[0030] Use time series analysis to predict the wear accumulation trend of all operation areas, calculate the remaining life of each power generation unit in combination with the fatigue characteristics of the board surface material, and generate a risk level stratification map;

[0031] According to the risk level stratification map, plan the movement path of the gesture board, and preferentially select the diagonal direction or the edge area as the new operation interface. When the available area decreases, enable the spiral diffusion strategy, and migrate the usage area in stages from the wear center to the periphery;

[0032] Record the patient's adaptability to area switching, and automatically adjust the path planning weight coefficient when a decrease in operation efficiency is detected.

[0033] As a further solution of the present invention: It further includes an intelligent self-maintenance module:

[0034] When it is detected that the patient has not operated continuously, automatically reset the position of the gesture board, so that the starting position of the next operation cycle deviates from the historical wear area by at least the distance between two power generation units, and at the same time remove the wear debris adsorbed on the surface through a micro vibrator;

[0035] Apply a high-voltage pulsed electric field during the displacement process to charge the particles generated by wear and capture them by a preset electrostatic adsorption layer;

[0036] Regularly activate the benchmark test mode of all power generation units, and dynamically update the parameter thresholds of the wear assessment model by comparing the signal output consistency of each power generation unit under standard pressure; Perform a full-stroke homing operation at a fixed time every day to eliminate the cumulative displacement error and lubricate the guide rail structure.

[0037] The beneficial effects of the present invention:

[0038] By collecting the waveform characteristics of the electrical signals of the power generation unit in real time, extracting the peak decay rate of the charge quantity, the non-linear change amount of the contact impedance, and the spectral characteristics of the signal noise, and combining the collaborative response differences of adjacent units to construct a dynamic wear assessment model, the present invention can accurately identify potential wear units, structural wear, and high wear states, providing a basis for subsequent adjustments. For wear problems, the micro linear motor array of the drive adjustment module drives the gesture board to translate in multiple directions in an asymmetric stepping mode, the shape memory alloy bracket adjusts the curvature of the board surface, and the gesture board can also be driven to rotate, enabling self-adaptive switching to low wear areas. After each switch, reverse micro-displacement releases stress and monitors the component state. The control module establishes a spatial wear probability distribution map based on the patient's historical operations and real-time physiological characteristics, plans the displacement strategy of the gesture board, preferentially selects low wear areas, and adjusts the path planning weight according to the operation efficiency. It effectively solves the problems of insufficient wear detection, inability to self-adaptively adjust, and lack of self-maintenance in the existing gesture input system, improving the stability, reliability, and service life of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The present invention will be further described below with reference to the accompanying drawings.

[0040] Figure 1 is a schematic diagram of the modules of the present invention;

[0041] Figure 2 is a schematic diagram of the process of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0042] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0043] Please refer to Figure 1 - Figure 2 As shown, the present invention is a multi-device universal gesture input system based on a triboelectric nanogenerator, including a flexible gesture board body, a wear detection module, a drive adjustment module, and a control module, wherein:

[0044] The flexible gesture board body, as the core component, consists of a slidable substrate and a triboelectric nanogenerator unit matrix. A dynamic connection network is constructed between the power generation units by means of flexible wires to ensure the smooth transmission of electrical signals under different gesture operations. The substrate adopts a multi-layer structure. The bottom anti-bending support layer can enhance the overall structural stability and reduce damage caused by daily bending; the middle deformation conduction layer can accurately transmit finger movements to the power generation units; the top replaceable friction interface layer directly contacts the fingers and can be conveniently replaced after wear to maintain the system performance.

[0045] The wear detection module plays a monitoring role, collecting the waveform characteristics of the electrical signals of the power generation unit in real time, extracting the peak attenuation rate of the charge quantity, the non-linear change quantity of the contact impedance, and the spectral characteristics of the signal noise, synthesizing the collaborative response differences of adjacent power generation units, constructing a local area dynamic wear assessment model, and detecting wear hazards in a timely manner.

[0046] The drive adjustment module includes a micro linear motor array and a shape memory alloy bracket. Once the wear detection module determines that the wear in the target area exceeds the preset threshold, the micro linear motor array drives the gesture board to translate in multiple directions along the guide rail. At the same time, the shape memory alloy bracket adjusts the curvature of the board surface according to the pre-programmed deformation characteristics, so that the finger contact area of the patient can be adaptively switched to the low-wear area, effectively coping with the wear problem and extending the service life of the gesture board.

[0047] The control module is like the "command center" of the system. Based on the patient's historical operation data and real-time physiological characteristics, it constructs a spatial wear probability distribution map, uses a dynamic path planning algorithm to generate a displacement strategy for the gesture board, and preferentially selects the area with a low risk of wear accumulation as the new operation interface, improving the use efficiency and stability of the system.

[0048] In a preferred embodiment of the present invention, the triboelectric nanogenerator units of the flexible gesture board body are scientifically divided into a high-frequency contact area and a low-frequency contact area to adapt to the wear characteristics in different usage scenarios.

[0049] The high-frequency contact area, as the part where the user operates most frequently, bears a large amount of mechanical friction. To effectively improve the durability of this area, the surface of the power generation unit is covered with a self-healing composite material layer. This composite material layer consists of a flowable repair agent encapsulated in microcapsules and a photo-responsive polymer matrix. When the high-frequency contact area encounters mechanical friction during daily use or is triggered by external light, the flowable repair agent encapsulated in the microcapsules will quickly ooze out. These repair agents can accurately fill the microscopic cracks generated on the surface of the power generation unit, effectively preventing the cracks from further expanding. At the same time, the photo-responsive polymer matrix undergoes a cross-linking reaction under corresponding conditions, making the repaired interface solidify and restoring the integrity and functionality of the surface of the power generation unit, greatly extending the service life of the power generation units in the high-frequency contact area.

[0050] For the low-frequency contact area, considering its relatively low usage frequency, the wear mode is different. Radial micro-grooves are etched on the surface of the power generation units in this area. The design of these micro-grooves is ingenious. Through their directional texture, the wear can be guided to spread towards the edge of the power generation unit, avoiding local excessive wear. And a redundant electrode array is preset in the low-frequency contact area. Once some electrodes of the power generation unit are damaged due to long-term use, the redundant electrode array can quickly come into operation to ensure that the power generation function of this area is not affected and maintain the stable operation of the system.

[0051] In addition, elastic hinge structures are used to connect the power generation units. This structure enables the power generation units to produce small relative displacements when stress is applied. This characteristic helps to disperse the concentrated stress generated by external forces and prevent a certain power generation unit from being damaged due to excessive stress. At the same time, a porous energy-absorbing layer is provided at the bottom of the power generation unit. This energy-absorbing layer can effectively absorb the energy generated by external impacts, further protecting the power generation unit from mechanical damage and improving the reliability of the entire flexible gesture board body.

[0052] In a more optimized case of this embodiment, the flexible gesture board body is composed of several independently detachable sub-modules. Each sub-module has a relatively independent function. When a certain sub-module reaches the service life limit standard due to long-term use, there is no need to replace the entire flexible gesture board body, which greatly reduces the maintenance cost. The user only needs to use the magnetic attraction interface to easily and conveniently disassemble the sub-module that has reached the service life limit and replace it with a new one. The design of the magnetic attraction interface not only makes the replacement operation of the sub-module simple and efficient, but also can ensure that the newly replaced sub-module is firmly and well electrically connected to other parts, ensuring that the performance of the entire flexible gesture board body is not affected and continuously providing stable gesture input services for users.

[0053] In another preferred embodiment of the present invention, the wear detection module undertakes the important task of constructing an accurate local area dynamic wear assessment model.

[0054] First of all, for each triboelectric nanogenerator unit, the system will deeply analyze the peak value of the charge quantity within its continuous triggering cycle. In this link, normalization processing is the key first step. By normalizing the peak value of the charge quantity, the differences in the initial performance of different power generation units can be eliminated, making subsequent comparisons and analyses more scientific and comparable. On this basis, calculate the attenuation slope of the peak value of the charge quantity of this power generation unit relative to the initial value. This attenuation slope intuitively reflects the change trend of the performance of the power generation unit over time. When the attenuation slope of a certain power generation unit exceeds twice the average value of adjacent power generation units, the system will keenly mark it as a potentially worn power generation unit. This means that this power generation unit may have started to show signs of performance decline due to wear and needs to be focused on.

[0055] Next, the system detects the dynamic changes in the contact impedance between power generation units by applying a microcurrent. During actual operation, the change in contact impedance is closely related to the wear condition of the power generation units. When the correlation between the impedance growth rate and the charge decay rate in a certain area exceeds a preset threshold, it indicates a strong association between the two, which is likely caused by wear. Moreover, if the impedance in this area continues to increase for more than a set duration, the system will determine that structural wear has occurred in this area. This structural wear often means that the physical structure inside the power generation unit has been severely damaged, posing a significant threat to the stability and reliability of the system.

[0056] In addition, the wear detection module also actively collects the sliding trajectory data of the patient's finger in the target area. Through advanced data acquisition technology, the system can accurately extract key information such as the trajectory length, curvature, and speed distribution characteristics. When the trajectory repeatability in the target area is higher than the set threshold, it indicates that this area is frequently used and prone to wear. At the same time, if the signal recognition error rate also rises to the set threshold synchronously, this is a strong signal indicating that the wear in this area has seriously affected the system's accurate recognition of gesture signals. At this time, the system will confirm that this area has entered a high-wear state.

[0057] Finally, based on the accurate marking of potentially worn power generation units, structural wear, and high-wear states, the wear detection module grades and marks the worn areas. This grading and marking provides a clear basis for subsequent processing. It should be noted that the system sets strict triggering conditions. Only when the three key factors of signal attenuation, impedance change, and trajectory repeatability all meet the set conditions will the drive adjustment module be triggered to execute area switching. Such a design ensures the accuracy and necessity of the area switching operation, avoids unnecessary actions caused by misjudgment, and thus guarantees the stable and efficient operation of the entire multi-device universal gesture input system based on triboelectric nanogenerators, providing continuous and reliable gesture input services for users.

[0058] In another preferred embodiment of the present invention, the drive adjustment module undertakes the extremely crucial task of adaptively switching areas, and its operation process is highly intelligent and accurate.

[0059] As one of the core components for driving the gesture board to move, the micro linear motor array works in a unique asymmetric stepping mode. During actual operation, the array alternately drives the gesture board to move along the X / Y axis directions. The displacement amount each time is not fixed, but dynamically adjusted according to the wear degree data collected in real time. In this way, it can skillfully ensure that when the patient's finger is placed naturally, its position always covers the unworn area. For example, when the system detects a high wear degree in a certain area of the gesture board, the micro linear motor array will correspondingly increase the displacement amount, quickly adjust the unworn area under the patient's finger, and ensure the smoothness of user operation and the reliability of the system.

[0060] Meanwhile, during the translation of the gesture board, the shape memory alloy bracket plays an indispensable auxiliary role. The shape memory alloy bracket can accurately generate a preset deformation according to the curvature requirements of the target area. This deformation will cause micro - protrusions or depressions on the surface of the gesture board. When the patient operates on the gesture board, these special structures can guide the patient's finger to naturally shift towards the low - wear area. For example, if the low - wear area is located at the edge of the gesture board, the shape memory alloy bracket can make the edge area slightly protrude, and using the principle of ergonomics, guide the patient's finger to move towards this area subconsciously, thereby reducing the usage frequency of the high - wear area and further extending the service life of the gesture board.

[0061] When the translation operation cannot meet the requirement of covering all available areas, the drive adjustment module will activate another important function. At this time, the micro - motor will drive the gesture board to rotate around the central axis. The rotation angle is carefully designed to highly match the range of motion of the patient's finger joints. Through this rotation operation, the angular distribution of the gesture board surface can be changed, and then the contact pressure can be redistributed. For example, if there is excessive wear in a certain corner area of the gesture board, by rotating the gesture board, this corner area can be adjusted to a position where the patient's finger is not easily accessible, and at the same time, the unworn or low - wear area can be placed at a more convenient operation angle, achieving a reasonable optimization of the contact pressure and improving the overall performance of the system.

[0062] After each switching action, to ensure the stability and safety of the system, the drive adjustment module will automatically perform a reverse micro - displacement operation. The purpose of this operation is to release the stress accumulated in the system due to frequent driving and avoid damage to system components caused by stress concentration. In addition, the system will also monitor the temperature rise and vibration signals of the drive components in real time. When it is detected that the temperature rise is abnormally high, exceeding the normal working temperature range, or the vibration signal shows abnormal fluctuations, it indicates that there may be a potential failure risk in the drive components. At this time, the system will immediately give a prompt to remind the maintenance personnel to check and maintain in time to ensure the stable operation of the entire multi - device general gesture input system based on triboelectric nanogenerators.

[0063] It is worth emphasizing that before the driving adjustment module drives the gesture board to perform a translation action, a micro-vibration with a specific frequency is generated by the piezoelectric brake. This micro-vibration signal can prompt the patient about the upcoming area switch in a timely and effective manner. This user-friendly design enables the patient to be aware of the system's actions in advance during the operation, avoiding operation errors caused by sudden area switches, and greatly enhancing the friendliness of the user experience and the accuracy of operation. Through the above series of closely coordinated operations, the driving adjustment module realizes the efficient and intelligent adaptive switching of the gesture board area, providing a strong guarantee for the stable operation and durability of the entire system.

[0064] In another preferred embodiment of the present invention, the control module shoulders the important task of establishing an accurate spatial wear probability distribution map, and its construction process involves complex and delicate technical logic.

[0065] First of all, the control module is committed to collecting multi-source data to establish a multi-dimensional wear correlation model. It systematically integrates the daily operation time distribution data of the patient, which details the patient's usage of the gesture board at different time periods, and can reflect the activity level and time pattern of the operation. At the same time, it collects the finger pressure intensity heat map data, which intuitively shows the distribution of the pressure exerted by the patient's fingers on each area of the gesture board during the operation. Areas with greater pressure are more likely to experience wear. In addition, the historical data of environmental temperature and humidity are also included, because environmental factors have an undeniable impact on the performance of the board material. Excessive humidity or temperature may accelerate material aging and thus affect the wear process. Through the in-depth fusion and analysis of these data, the control module successfully constructs a comprehensive and detailed multi-dimensional wear correlation model, laying a solid foundation for subsequent wear prediction and evaluation.

[0066] Next, the control module uses time series analysis to predict the wear accumulation trend of all operation areas. Time series analysis can uncover the laws of data changes over time. By analyzing historical wear data, it predicts the future wear development trend of each area. On this basis, combined with the fatigue characteristics of the gesture board surface material, the remaining life of each power generation unit is further accurately calculated. Different materials have different fatigue characteristics. The control module fully considers this factor and combines the fatigue loss of the material with the wear generated by actual operations using relevant knowledge and algorithms in the field of materials science, thus generating a detailed risk level stratification map. This map clearly shows the wear risk levels of each operation area, providing an intuitive and accurate basis for subsequent path planning.

[0067] Based on the risk-level stratified map, the control module begins to meticulously plan the movement path of the gesture board. During the planning process, the diagonal direction or the edge area is preferentially selected as the object for the new operation interface. This is because in actual use, the diagonal direction and the edge area usually have a lower usage frequency and a relatively lighter wear degree compared to the central area. Selecting these areas as the new operation interface can effectively utilize the unworn or lightly worn parts of the gesture board, extending the overall service life. When the available area gradually decreases with the increase in usage time, the control module will enable the spiral diffusion strategy. This strategy starts from the wear center and migrates the usage area to the periphery in stages according to the pre-set rules. This strategy can methodically guide the user operations to transfer to the remaining lightly worn areas, maximizing the usage efficiency of the gesture board and ensuring that the system always maintains good performance during long-term use.

[0068] In addition, the control module also attaches great importance to the user experience. It continuously records the patient's adaptability to the area switch, and judges the patient's adaptability to each area switch by analyzing the patient's operation behavior data, such as operation fluency, the number of misoperations, etc. When it detects a decrease in the patient's operation efficiency, the control module will automatically adjust the path planning weight coefficient. For example, if it is found that the patient frequently makes operation mistakes under a certain specific path planning, the control module will reduce the weight of this path planning and increase the weight of other paths more suitable for the patient's operation, so as to achieve the dynamic optimization of path planning and continuously improve the user's usage experience.

[0069] In another preferred embodiment of the present invention, the system is also equipped with an intelligent self-maintenance module, which provides all-round guarantee for the stable operation of the system.

[0070] When the intelligent self-maintenance module detects that the patient has not operated continuously, it will automatically start a series of maintenance operations. First, it performs the gesture board position reset operation, adjusting the position of the gesture board to a starting position for the next operation cycle that is at least two power generation unit spacings away from the historical wear area. The purpose of this is to ensure that when the patient uses it again, the starting operation area is an unworn or lightly worn area, avoiding exacerbating the wear degree due to continuous operation in the same wear area. At the same time, the micro vibrator is used to remove the adsorbed wear debris on the surface. The micro vibrator generates vibrations at a specific frequency, causing the tiny wear debris adsorbed on the surface of the gesture board to break away due to the vibration, and then the debris is cleaned out through a pre-designed collection device, keeping the surface of the gesture board clean and preventing the debris from interfering with subsequent operations.

[0071] During the displacement of the gesture board, the intelligent self-maintenance module applies a high-voltage pulsed electric field. This electric field can charge the particles generated by wear, and the electrostatic adsorption layer preset in the system will use electrostatic attraction to capture the charged particles. In this way, the diffusion of wear particles inside the system is effectively avoided, preventing them from damaging other components and further improving the stability and reliability of the system.

[0072] The intelligent self-maintenance module also regularly activates the benchmark test mode of all power generation units. In this mode, by comparing the signal output consistency of each power generation unit under standard pressure, the performance status of the power generation unit can be accurately judged. If it is found that the signal output of some power generation units deviates from the standard value, it indicates that these power generation units may have a performance decline or a fault. Based on this, the intelligent self-maintenance module dynamically updates the parameter thresholds of the wear assessment model, enabling the model to more accurately reflect the current actual wear situation of the system and providing a more reliable basis for subsequent wear detection and control. In addition, the intelligent self-maintenance module performs a full-stroke homing operation at a fixed time every day. This operation can eliminate the displacement error accumulated due to long-term use and ensure the position accuracy of the gesture board during movement. At the same time, during the homing process, the system will automatically lubricate the guide rail structure, reduce the friction between the guide rail and the moving parts, extend the service life of the guide rail, and ensure the smooth operation of the entire system.

[0073] The above has described in detail an embodiment of the present invention, but the content described is only a preferred embodiment of the present invention and cannot be considered as limiting the scope of implementation of the present invention. All equivalent changes and improvements made according to the scope of the application of the present invention should still fall within the scope covered by the patent of the present invention.

Claims

1. A multi-device universal gesture input system based on friction nanogenerators, characterized in that: It includes a flexible gesture board body, a wear detection module, a drive adjustment module and a control module, wherein: The flexible gesture board body includes a slidable substrate and a friction nano-power generation unit matrix. Each power generation unit forms a dynamic connection network through flexible wires. The substrate adopts a multi-layer stacking design, including a bottom anti-bending support layer, a middle deformation conduction layer and a top replaceable friction interface layer. The wear detection module collects the electrical signal waveform characteristics of each power generation unit in real time, extracts the charge peak attenuation rate, contact impedance nonlinear change and signal noise spectrum characteristics, and combines the collaborative response differences of adjacent power generation units to build a dynamic wear assessment model for the local area; The drive adjustment module includes a micro linear motor array and a shape memory alloy bracket. When it is detected that the wear level of the target area exceeds a preset threshold, the linear motor array drives the gesture board to translate in multiple directions along the guide rail, and at the same time uses the pre-programmed deformation characteristics of the shape memory alloy bracket to adjust the curvature of the board surface, so that the patient's finger contact area is adaptively switched to a low-wear area; The control module establishes a spatial wear probability distribution map based on the patient's historical operation data and real-time physiological characteristics, generates a gesture board displacement strategy through a dynamic path planning algorithm, and preferentially selects the area with the lowest wear accumulation risk as the new operation interface; The specific process of the control module establishing the spatial wear probability distribution map is as follows: Integrate the patient's daily operation time distribution, finger pressure intensity heat map and environmental temperature and humidity historical data to establish a multi-dimensional wear correlation model; Use time series analysis to predict the cumulative wear trend of all operating areas, calculate the remaining life of each power generation unit based on the fatigue characteristics of the panel material, and generate a risk level stratification map; Plan the movement path of the gesture board according to the risk level layered map, give priority to the diagonal direction or edge area as the new operation interface, and when the available area decreases, enable the spiral diffusion strategy to migrate the use area in stages from the wear center to the periphery; The patient's adaptability to area switching is recorded, and when a decrease in operating efficiency is detected, the path planning weight coefficient is automatically adjusted.

2. The multi-device universal gesture input system based on friction nanogenerator according to claim 1 is characterized in that: The friction nano power generation unit of the flexible gesture board body is divided into a high-frequency contact area and a low-frequency contact area; The surface of the power generation unit in the high-frequency contact area is covered with a self-healing composite material layer, which includes a flowable repair agent encapsulated in microcapsules and a photoresponsive polymer matrix. When triggered by mechanical friction or external light, the repair agent seeps out and fills the micro cracks, and the photoresponsive polymer solidifies and repairs the interface through a cross-linking reaction. The surface of the power generation unit in the low-frequency contact area is etched with radial micro grooves, and the wear is guided to spread to the edge of the power generation unit through directional texture, and a redundant electrode array is pre-set; Each power generation unit is connected by an elastic hinge structure. When stress is applied, a small relative displacement occurs between the power generation units, and a porous energy absorption layer is set at the bottom of the power generation unit.

3. The multi-device universal gesture input system based on friction nanogenerator according to claim 2 is characterized in that: The flexible gesture board body includes a plurality of independently detachable sub-modules. When a sub-module reaches the life limit standard, it can be replaced through a magnetic suction interface.

4. The multi-device universal gesture input system based on friction nanogenerator according to claim 1 is characterized in that: The process of constructing the dynamic wear assessment model of the local area by the wear detection module is as follows: The peak value of the charge of each friction nano-power generation unit in the continuous triggering cycle is normalized, and its decay slope relative to the initial value is calculated. When the decay slope exceeds twice the average value of the adjacent power generation units, it is marked as a potential wear power generation unit; By applying a micro-current to detect the dynamic changes in the contact impedance between the power generation units, if the correlation between the impedance growth rate and the charge decay rate in a certain area exceeds the preset threshold, and the impedance continues to grow for more than the set time, it is determined to be structural wear; Collect the sliding trajectory data of the patient's finger in the target area, extract the trajectory length, curvature and speed distribution characteristics, and when the trajectory repetition rate is higher than the set threshold and the signal recognition error rate rises to the set threshold simultaneously, it is confirmed that the area has entered a high wear state; According to the marking of potential wear power generation units, structural wear and high wear conditions, the wear areas are graded and marked. Only when the signal attenuation, impedance change and trajectory repeatability meet the set conditions at the same time, the drive adjustment module is triggered to perform area switching.

5. The multi-device universal gesture input system based on friction nanogenerator according to claim 1 is characterized in that: The process of adaptively switching the area of ​​the drive adjustment module is as follows: The micro linear motor array drives the gesture board in an asymmetric stepping mode, moving alternately along the X / Y axis direction, and the displacement of each time is dynamically adjusted according to the real-time wear degree to ensure that the natural placement position of the patient's finger always covers the unworn area; During the translation process, the shape memory alloy bracket produces a preset deformation according to the curvature requirements of the target area, so that a micro-convex or concave structure is formed on the surface of the gesture board, guiding the patient's fingers to naturally deviate to the low-wear area; When the translation operation is not enough to cover the available area, the micro-motor drives the gesture board to rotate around the central axis. The rotation angle matches the range of motion of the patient's finger joints, and the contact pressure is redistributed by changing the angle distribution of the board surface. After each switching action, reverse micro-displacement is automatically performed to release internal stress, and the temperature rise and vibration signals of the drive components are monitored, and prompts are given when the temperature rise and vibration signals are abnormal.

6. The multi-device universal gesture input system based on friction nanogenerator according to claim 5 is characterized in that: Before the driving adjustment module drives the gesture board to move horizontally, it generates micro-vibration of a specific frequency through the piezoelectric brake to prompt the patient that a zone switch is about to occur.

7. The multi-device universal gesture input system based on friction nanogenerator according to claim 1 is characterized in that: Also includes intelligent self-maintenance module: When it is detected that the patient has not operated continuously, the gesture board position is automatically reset, so that the starting position of the next operation cycle deviates from the historical wear area by at least two power generation unit spacings, and the wear debris adsorbed on the surface is removed by a micro vibrator; A high-voltage pulse electric field is applied during the displacement process, so that the particles generated by wear are charged and captured by the preset electrostatic adsorption layer; The benchmark test mode of all power generation units is activated regularly, and the parameter threshold of the wear assessment model is dynamically updated by comparing the consistency of the signal output of each power generation unit under standard pressure. The full-stroke homing operation is performed at a fixed time every day to eliminate the accumulated displacement error and lubricate the guide structure.

Citation Information

Patent Citations

  • Gesture recognition sensor based on friction nanometer generator and preparation method thereof

    CN115268632A

  • Man-machine interaction system, method and equipment and storage medium

    CN116795220A