Flexible transparent triboelectric eye movement control system for ar glasses rapid deployment and construction method thereof

Abstract

The application discloses a flexible transparent triboelectric eye movement control system for AR glasses rapid deployment and a construction method thereof, and comprises an eye sensing module and an external data export module. The eye sensing module is arranged in a near-eye area corresponding to at least one eye of the AR glasses, and comprises a first flexible transparent triboelectric layer, an electrode layer and a second flexible transparent triboelectric layer which are sequentially stacked, and the electrode layer is arranged between the first flexible transparent triboelectric layer and the second flexible transparent triboelectric layer. When the mechanical movement of the eye tissue changes the contact state of the eye tissue and the first flexible transparent triboelectric layer, the electrode layer outputs a dynamic triboelectric signal. The external data export module is detachably arranged at a temple position of the AR glasses, and is used for collecting and processing the dynamic triboelectric signal. The application can rapidly deploy the eye movement control function without changing the internal structure and circuit of the AR glasses, and has the advantages of thin structure, transparent and non-obstructive vision, detachable reuse and adaptation to different models of glasses.

Description

Technical Field

[0001] This invention relates to the field of eye-tracking technology, and in particular to a flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses and its construction method. Background Technology

[0002] Eye-tracking control is a human-computer interaction technology that uses the user's eye movements to input information and control devices. With the rapid development of augmented reality (AR) technology, eye-tracking control, as an important interaction method for AR glasses, has received increasing attention.

[0003] Existing eye-tracking control solutions primarily employ cameras, infrared light sources, optical imaging devices, and image processing algorithms to continuously image the eyeball, pupil, or periocular region. Based on changes in feature positions or motion trajectories within the images, the user's gaze direction and input intent are determined. These optical eye-tracking solutions typically require the installation of cameras, infrared emitters, and optical receivers on glasses or near-eye devices, along with corresponding imaging, image processing, and calibration modules. This significantly increases the structural complexity, weight, and hardware cost of near-eye devices. Furthermore, these solutions are highly coupled with the AR glasses themselves; adding eye-tracking functionality usually necessitates redesigning the frame, optical path, main control circuitry, or internal power supply structure, hindering the rapid migration of the same eye-tracking control solution to different AR glasses models. Additionally, optical solutions require continuous acquisition and processing of eye images, resulting in high power consumption and significant susceptibility to ambient light conditions.

[0004] In addition to the optical eye-tracking methods mentioned above, there are also some attempts to achieve eye-tracking perception by detecting mechanical movements in the eye area. However, in existing solutions, the devices used to sense eye mechanical movements are mostly made of opaque materials or have relatively significant structural thickness. When placed near the eye, they can easily obstruct the user's vision or increase the burden of wearing them, making it difficult to meet the requirements of optical transparency and structural thinness for AR glasses in near-eye scenarios. Summary of the Invention

[0005] In view of the aforementioned deficiencies of the prior art, the technical problem to be solved by the present invention is to provide a flexible transparent triboelectric eye-tracking control system for rapid deployment in AR glasses and a method for constructing the same, with the aim of achieving non-destructive, rapid, and detachable deployment of eye-tracking control functions on existing AR glasses.

[0006] To achieve the above objectives, the first aspect of this invention discloses a flexible, transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, comprising: An eye-sensing module is disposed in at least one near-eye region corresponding to the eye of the AR glasses. It comprises a first flexible transparent friction layer, an electrode layer, and a second flexible transparent friction layer stacked sequentially. The electrode layer is sandwiched between the first and second flexible transparent friction layers. All three layers are transparent and flexible structures. When the contact state between the eye tissue and the first flexible transparent friction layer changes due to mechanical movement of the user's eye tissue, the induced charge distribution in the electrode layer changes accordingly, thereby outputting a dynamic triboelectric signal. The contact state includes at least one of separation distance, contact area, and contact position. An external data export module is detachably installed on the temple of the AR glasses and connected to the eye sensor module. It is used to collect the dynamic triboelectric signal and convert it into digital time series data, and send the digital time series data to an external terminal via wireless communication. The external data export module includes a housing and a signal processing unit disposed inside the housing. The housing has a detachable mounting structure adapted to the temples of the AR glasses. The signal processing unit is used to sample, convert analog to digital and transmit the dynamic triboelectric signal wirelessly.

[0007] Optionally, the eye sensing module further includes a secondary electrode layer, which is stacked on the second flexible transparent friction layer, such that the second flexible transparent friction layer is located between the electrode layer and the secondary electrode layer, serving as a dielectric layer between the electrode layer and the secondary electrode layer, and thus the three together constitute a capacitor structure. The capacitor structure is used to detect changes in ambient humidity. Specifically, the capacitor structure generates a capacitance value when a high-frequency carrier signal is applied. The dielectric constant of the second flexible transparent friction layer changes with humidity, and the capacitance value changes accordingly with the change in dielectric constant. The signal processing unit determines the humidity compensation coefficient of the dynamic triboelectric signal based on the change in capacitance value, and uses the compensation coefficient to perform amplitude compensation on the dynamic triboelectric signal. When humidity increases, the capacitance value increases and the dynamic triboelectric signal attenuates. The compensation coefficient is monotonic with the capacitance value and is used to perform reverse amplitude compensation on the dynamic triboelectric signal.

[0008] Optionally, both the first flexible transparent friction layer and the second flexible transparent friction layer are composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; the electrode layer is composed of a silver nanowire conductive network; the sub-electrode layer is composed of indium tin oxide or graphene; and the overall optical transmittance of the eye sensing module is greater than a preset value.

[0009] Optionally, the frequency of the high-frequency carrier signal is higher than the frequency of the dynamic triboelectric signal, and the two are transmitted on the same signal transmission path through the electrode layer via frequency division multiplexing. The signal processing unit separates the two signals through a filter.

[0010] Optionally, the eye sensing module adopts a single-eye single-sensor deployment method and is set in the upper area of ​​the frame corresponding to the left or right eye of the AR glasses.

[0011] Optionally, the detachable mounting structure is an open slot, which is located on the side of the housing near the temple of the AR glasses. The opening size and vertical height of the slot are adapted to the corresponding mounting area of ​​the temple of the AR glasses. The housing is inserted into or slid into the mounting position from the side of the temple through the open slot. The housing is an integrated structure prepared using 3D printing technology.

[0012] Optionally, the wireless communication method is WiFi wireless communication; the external terminal is a computer terminal, which is configured to perform signal preprocessing, feature extraction and action classification on the received digital time series data, and output corresponding eye-tracking control commands according to the classification results and a preset action-command mapping relationship.

[0013] Optionally, the eye tissue mechanical movements are selected from at least one of the following: eyelid closure, eyelid opening, single blink, multiple consecutive blinks, upward eye movement, and downward eye movement; the dynamic triboelectric signal includes time-series electrical signals generated by different eye tissue mechanical movements that exhibit distinguishable differences in signal peak value, polarity, duration, peak spacing, and waveform combination.

[0014] A second aspect of this invention discloses a method for constructing a flexible, transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, characterized in that the method includes: Step S1: Prepare a first flexible transparent friction layer; wherein the first flexible transparent friction layer is composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; Step S2: A transparent electrode layer is formed on the surface of the first flexible transparent friction layer; wherein the transparent electrode layer is composed of a silver nanowire conductive network; Step S3: Cover the surface of the transparent electrode layer with a second flexible transparent friction layer, so that the electrode layer is sandwiched between the first flexible transparent friction layer and the second flexible transparent friction layer to obtain the eye sensing module; wherein, the second flexible transparent friction layer is composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; Step S4: Prepare a housing with a detachable mounting structure according to the outline dimensions of the AR glasses temples; set a signal processing unit inside the housing; Step S5: Deploy the eye sensing module in at least one near-eye area of ​​the AR glasses; install the housing on the temple of the AR glasses using the mounting structure; Step S6: Connect the eye sensing module to the signal processing unit to obtain a flexible transparent triboelectric eye movement control system; The flexible transparent triboelectric eye-tracking control system responds to the user's mechanical movements of the eye tissue. The eye-sensing module generates the dynamic triboelectric signal, the signal processing unit collects the dynamic triboelectric signal and converts it into digital time-series data, and sends the digital time-series data to an external terminal via wireless communication. The external terminal classifies the digital time-series data into actions and outputs corresponding eye-tracking control commands according to the classification results and a preset action-command mapping relationship.

[0015] Optionally, after step S3, the method further includes: A sub-electrode layer is formed on the surface of the second flexible transparent friction layer away from the electrode layer. The sub-electrode layer is composed of indium tin oxide or graphene. The sub-electrode layer, the second flexible transparent friction layer, and the electrode layer together constitute a capacitor structure. The capacitor structure detects changes in ambient humidity by varying the dielectric constant of the second flexible transparent friction layer with humidity.

[0016] The beneficial effects of this invention are as follows: 1. This invention adopts a three-layer stacked structure consisting of a first flexible transparent friction layer, an electrode layer, and a second flexible transparent friction layer. Both the first and second flexible transparent friction layers are composed of a transparent polydimethylsiloxane-perfluorodecyltrichlorosilane (PDMS-FDTS) composite material, and the electrode layer is composed of a transparent conductive network of silver nanowires (AgNWs). The overall optical transmittance is greater than 80%. Compared with existing eye-tracking devices that use opaque materials or have significant structural thickness, this invention will not obstruct the user's vision or increase the wearing burden when placed in the near-eye area, thus meeting the stringent requirements of AR glasses for optical transparency and wearing comfort. 2. This invention separates the eye-sensing module from the external data export module. The external data export module is detachably installed on the temple of the AR glasses via an opening slot on the housing, while the eye-sensing module is attached to the near-eye area. The installation and removal process does not require any modification to the frame, optical path, main control circuit, or internal power supply structure of the AR glasses. Compared to existing solutions that require redesigning frames, circuits, and optical components, or modifying the internal hardware of the glasses, this invention achieves "zero-intrusion" rapid deployment of eye-tracking control functions on existing AR glasses. It can be easily added to completed AR glasses products and can be removed at any time according to usage needs, significantly reducing the deployment threshold and modification costs of eye-tracking control functions. 3. This invention further sets up a secondary electrode layer below the second flexible transparent friction layer, making the second flexible transparent friction layer, as a dielectric layer, together with the electrode layer and the secondary electrode layer to form a capacitor structure. This capacitor structure determines the humidity compensation coefficient in real time and performs reverse amplitude compensation on the triboelectric signal by detecting the change in capacitance value caused by the change in the dielectric constant of the second flexible transparent friction layer with humidity. In existing triboelectric eye-tracking sensing solutions, when the ambient humidity increases, water molecules form conductive paths on the surface of the friction layer, leading to surface charge dissipation and significant signal amplitude attenuation. This invention effectively eliminates the interference of humidity changes on eye-tracking signal acquisition through in-situ humidity detection and signal compensation, significantly improving the signal stability and eye-tracking recognition accuracy of the system in actual wearing scenarios such as sweating and high humidity, without requiring an additional independent humidity sensor and without sacrificing the transparency and flexibility of the device. 4. In this invention, the high-frequency carrier signal and the dynamic triboelectric signal are transmitted on the same signal transmission path using frequency division multiplexing and separated by a filter. The frequency of the high-frequency carrier signal is much higher than the frequency band of the dynamic triboelectric signal, ensuring complete separation in the frequency domain and preventing interference. This design allows humidity detection and eye-tracking signal acquisition to be performed synchronously on the same electrode layer and the same conductor, eliminating the need for additional signal transmission lines, simplifying system wiring, and reducing hardware complexity.5. This invention employs a single-eye, single-sensor deployment method. Only one eye-sensing module needs to be placed in the near-eye region corresponding to one eye (left or right eye). It can distinguish various eye-tracking control commands by recognizing differences in peak value, polarity, duration, peak spacing, and waveform combinations of dynamic triboelectric signals generated by different eye tissue mechanical movements (such as blinking and eyeball rotation). Compared to existing solutions requiring dual-eye multi-channel sensors or binocular cameras, this invention significantly reduces the number of sensors, signal leads, and data acquisition channels, further simplifying the deployment structure of AR glasses and reducing hardware costs and system power consumption. 6. This invention samples and converts the dynamic triboelectric signals to digital data via a signal processing unit in an external data export module, and sends the digital time-series data to an external terminal via wireless communication methods such as WiFi. The external terminal can preprocess the data, extract features, and classify actions according to actual application requirements, and output corresponding eye-tracking control commands according to a preset action-command mapping relationship. Wireless transmission avoids the constraints of wired connections on user activities, while terminal-side processing allows eye-tracking control logic to be flexibly adjusted according to different AR application scenarios without requiring modifications to the hardware or firmware of the glasses.

[0017] In summary, this invention provides a transparent and flexible triboelectric eye-tracking control solution for existing AR glasses that can be quickly deployed without modifying the internal structure. At the same time, it effectively solves the technical problem that triboelectric signals are easily interfered with by humidity in actual use environments through a humidity self-compensation mechanism. It has outstanding advantages such as lightweight and thin structure, transparent and unobstructed design, detachable and reusable design, strong environmental adaptability, and simple deployment cost. Attached Figure Description

[0018] Figure 1 This is a schematic diagram of the main view structure of a flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, provided in a specific embodiment of the present invention. Figure 2 This is a schematic diagram of the three-view structure of a flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, provided in a specific embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of an eye sensing module provided in a specific embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of an eye sensing module incorporating a capacitor structure according to a specific embodiment of the present invention; Figure 5 This is a flowchart illustrating a method for constructing a flexible, transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, according to a specific embodiment of the present invention. Detailed Implementation

[0019] This invention discloses a flexible, transparent triboelectric eye-tracking control system for rapid deployment of AR glasses and its construction method. Those skilled in the art can refer to the content of this document and appropriately modify the technical details to achieve the desired implementation. It is particularly important to note that all similar substitutions and modifications are obvious to those skilled in the art and are considered to be included in this invention. The methods and applications of this invention have been described through preferred embodiments. Those skilled in the art can clearly modify or appropriately change and combine the methods and applications described herein without departing from the content, spirit, and scope of this invention to implement and apply the technology of this invention.

[0020] The applicant's research revealed that while triboelectric eye-tracking solutions can generate electrical signals through the mechanical movement of eye tissue to detect eye movements, their output performance is easily affected by environmental humidity. When users are sweating or in high-humidity environments, water molecules adsorbed on the surface of the triboelectric layer form charge dissipation channels, leading to a significant attenuation of the signal amplitude and a decrease in eye-tracking accuracy. However, existing solutions lack technologies that can effectively eliminate humidity interference with triboelectric signals without adding an additional humidity sensor or sacrificing the device's transparency and flexibility, limiting the reliability and environmental adaptability of triboelectric eye-tracking control solutions in practical AR glasses wearing scenarios.

[0021] Therefore, embodiments of the present invention provide a flexible, transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, such as... Figure 1 , Figure 2 as well as Figure 3 As shown, the system includes: An eye-sensing module 1 is disposed in at least one near-eye region corresponding to the eye of the AR glasses 3. It comprises a first flexible transparent friction layer 101, an electrode layer 103, and a second flexible transparent friction layer 103 stacked sequentially. The electrode layer 103 is sandwiched between the first and second flexible transparent friction layers 101. All three layers are transparent and flexible. When the contact state between the eye tissue and the first flexible transparent friction layer 101 changes due to the mechanical movement of the user's eye tissue, the induced charge distribution in the electrode layer 103 changes accordingly, thereby outputting a dynamic triboelectric signal in the electrode layer 103. The contact state includes at least one of separation distance, contact area, and contact position. The external data export module 2 is detachably installed on the temple of the AR glasses 3 and is connected to the eye sensor module 1. It is used to collect dynamic triboelectric signals and convert them into digital time series data, and send the digital time series data to an external terminal via wireless communication. The external data export module 2 includes a housing and a signal processing unit located inside the housing. The housing has a detachable mounting structure that is compatible with the temples of the AR glasses 3. The signal processing unit is used to sample, convert analog to digital and transmit dynamic triboelectric signals wirelessly.

[0022] It should be noted that the eye sensing module 1 adopts a three-layer structure consisting of a first flexible transparent friction layer 101, an electrode layer 103, and a second flexible transparent friction layer 103 stacked sequentially, with the electrode layer 103 completely sandwiched between the two friction layers. All three layers are transparent and flexible, allowing the sensor to conform to the curved surface of the AR glasses 3 frame without obstructing vision. Its working principle is as follows: When the user's eye tissue (such as the eyelid or periocular skin) comes into contact with the first flexible transparent friction layer 101, due to the different electron binding capacities of the two layers, charge transfer occurs at the contact interface, causing the friction layer surface to acquire a net charge, which in turn induces an equal amount of opposite charge in the electrode layer 103. When the eye tissue undergoes mechanical movement due to blinking or eyeball rotation, the contact state (including separation distance, contact area, or contact position) between it and the first flexible transparent friction layer 101 changes accordingly, and the induced charge distribution in the electrode layer 103 dynamically changes, thereby outputting a dynamic triboelectric signal corresponding to the eye movement. Different types of eye movements (such as single blinks, continuous blinks, and upward or downward eye movements) generate triboelectric signals with different waveform characteristics, which provides a basis for subsequent action recognition.

[0023] In this specific embodiment, such as Figure 4 As shown, the eye sensing module 1 also includes a secondary electrode layer 104, which is stacked on the second flexible transparent friction layer 103, such that the second flexible transparent friction layer 103 is located between the electrode layer 103 and the secondary electrode layer 104, serving as a dielectric layer between the electrode layer 103 and the secondary electrode layer 104, and thus the three together constitute a capacitor structure. The capacitor structure is used to detect changes in ambient humidity. Specifically, when a high-frequency carrier signal is applied to the capacitor structure, a capacitance value is generated. The dielectric constant of the second flexible transparent friction layer 103 changes with humidity, and the capacitance value changes accordingly with the change in dielectric constant. The signal processing unit determines the humidity compensation coefficient of the dynamic triboelectric signal based on the change in capacitance value, and uses the compensation coefficient to perform amplitude compensation on the dynamic triboelectric signal. Among them, the capacitance increases when the humidity increases and the dynamic triboelectric signal attenuates. The compensation coefficient is monotonically related to the capacitance value and is used to perform reverse amplitude compensation for the dynamic triboelectric signal.

[0024] It should be noted that a secondary electrode layer 104 is added outside the second flexible transparent friction layer 103, so that the second flexible transparent friction layer 103 is sandwiched between the electrode layer 103 and the secondary electrode layer 104 as a dielectric layer, and the three together constitute a capacitor structure. The capacitance value of this capacitor structure changes with the dielectric constant of the second flexible transparent friction layer 103, and the dielectric constant changes with the ambient humidity—when the humidity increases, the friction layer adsorbs water molecules, which increases the dielectric constant and the capacitance value accordingly. Since the increase in humidity also causes the amplitude of the triboelectric signal to attenuate, the signal processing unit determines the degree of signal attenuation under the current humidity based on the change in capacitance value, calculates a compensation coefficient that is monotonically related to the capacitance value, and performs reverse amplitude compensation on the triboelectric signal, that is, amplifies it accordingly when the signal attenuates. Through this mechanism, the system can eliminate the interference of humidity changes on eye-tracking signal acquisition in real time without the need for an additional independent humidity sensor.

[0025] Furthermore, both the first flexible transparent friction layer 101 and the second flexible transparent friction layer 103 are composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; the electrode layer 103 is composed of a silver nanowire conductive network; the sub-electrode layer 104 is composed of indium tin oxide or graphene; and the overall optical transmittance of the eye sensing module 1 is greater than a preset value.

[0026] It should be noted that the first flexible transparent friction layer 101 and the second flexible transparent friction layer 103 are made of polydimethylsiloxane-perfluorodecyltrichlorosilane composite material. This material enhances triboelectric output performance by doping the polydimethylsiloxane matrix with fluorine-containing components, while maintaining excellent flexibility and light transmittance. The electrode layer 103 uses a silver nanowire conductive network, balancing high conductivity, flexibility, and light transmittance. The secondary electrode layer 104 uses indium tin oxide or graphene. With the above material combination, the overall optical transmittance of the eye sensing module 1 is greater than 80%, ensuring that it does not affect the AR display effect when placed in the near-eye area.

[0027] Furthermore, the frequency of the high-frequency carrier signal is higher than that of the dynamic triboelectric signal. The two signals are transmitted on the same signal transmission path through the electrode layer 103 via frequency division multiplexing. The signal processing unit separates the two signals through a filter.

[0028] It should be noted that the frequency of the high-frequency carrier signal is much higher than the frequency band of the dynamic triboelectric signal. Both are transmitted in parallel along the same signal transmission path (i.e., the same electrode layer 103 and the same conductor) using frequency division multiplexing. The signal processing unit is equipped with filters at its front end: a low-pass filter extracts the low-frequency dynamic triboelectric signal, and a high-pass filter extracts the high-frequency carrier signal. After demodulation, the capacitance information is obtained for humidity compensation. Frequency division multiplexing allows humidity detection and eye-tracking signal acquisition to be performed synchronously without crosstalk, eliminating the need for additional signal transmission lines.

[0029] In this specific embodiment, the eye sensing module 1 adopts a single-eye single-sensor deployment method and is set in the upper area of ​​the frame corresponding to the left or right eye of the AR glasses 3.

[0030] It should be noted that the eye sensing module 1 adopts a single-eye, single-sensor deployment, meaning that only one sensor is placed in the upper area of ​​the frame corresponding to the left or right eye of the AR glasses 3. Different types of eye movements (such as a single blink, two consecutive blinks, upward eye movement, and downward eye movement) generate triboelectric signals with distinguishable differences in peak value, polarity, duration, and waveform morphology. Therefore, a single sensor is sufficient to recognize multiple eye movement commands. The single-eye solution reduces the number of sensors and signal channels, simplifies the deployment structure, and lowers hardware costs and added weight.

[0031] In this specific embodiment, the detachable mounting structure is an open bracket, which is located on the side of the box body near the temple of the AR glasses 3. The opening size and vertical height are adapted to the corresponding mounting area of ​​the temple of the AR glasses 3. The box body can be inserted into or slid into the mounting position from the side of the temple through the open bracket. The box body is an integrated structure prepared using 3D printing technology.

[0032] It should be noted that the external data export module 2 is a one-piece structure fabricated using 3D printing technology, with an open slot on the side near the temple. The opening size and vertical height of the slot are designed according to the contour dimensions of the target AR glasses 3 temple. During installation, it can be secured by snapping it in from the side of the temple or sliding it in vertically. Disassembly is done by reversing the direction of insertion, requiring no tools. By modifying the opening slot size parameters in the 3D printed data, it can be adapted to different models of AR glasses 3 temples, enabling rapid, non-destructive, and reversible deployment of the eye-tracking control module.

[0033] In this specific embodiment, the wireless communication method is WiFi wireless communication; the external terminal is a computer terminal, which is configured to perform signal preprocessing, feature extraction and action classification on the received digital time series data, and output the corresponding eye-tracking control command according to the classification result and the preset action-command mapping relationship.

[0034] It should be noted that the external data export module 2 transmits data wirelessly with the external terminal via WiFi. After the signal processing unit completes sampling and analog-to-digital conversion, it sends the digital time-series data to the computer terminal via WiFi. The terminal is responsible for signal preprocessing, feature extraction, and action classification, and outputs control commands according to a preset mapping relationship. This "eyeglass-end acquisition, terminal-end processing" architecture delegates computationally intensive tasks to the terminal, reducing the power consumption and hardware requirements of the external module, while also facilitating flexible upgrades to the control logic.

[0035] Furthermore, the ocular tissue mechanical movements are selected from at least one of the following: eyelid closure, eyelid opening, single blink, multiple consecutive blinks, upward eye movement, and downward eye movement; the dynamic triboelectric signal includes time-series electrical signals generated by different ocular tissue mechanical movements that exhibit distinguishable differences in signal peak value, polarity, duration, peak spacing, and waveform combination.

[0036] It should be noted that identifiable ocular tissue mechanical movements include, but are not limited to, eyelid closure, eyelid opening, single blink, multiple consecutive blinks, upward eye movement, and downward eye movement. The differences in direction, amplitude, speed, and repetition frequency of these different movements cause the corresponding triboelectric signals to exhibit distinguishable characteristics in terms of peak value, polarity, duration, peak spacing, and waveform combinations, which are then used by the signal processing unit or external terminal for action classification and command mapping.

[0037] Based on the system provided above, embodiments of the present invention also provide a method for constructing a flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, such as... Figure 5 As shown, the method includes: Step S1: Prepare the first flexible transparent friction layer.

[0038] The first flexible transparent friction layer is composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material.

[0039] It should be noted that the preparation of the first flexible transparent friction layer requires the preparation of a dimethylsiloxane-perfluorodecyltrichlorosilane (PDMS-FDTS) mixture.

[0040] In this specific embodiment, dimethylsiloxane (FDTS) is added to perfluorodecyltrichlorosilane (PDMS) elastomer and mixed using magnetic stirring. First, magnetic stirring is performed for 3 hours; then, PDMS curing agent is added at a PDMS elastomer to curing agent mass ratio of 10:1, and magnetic stirring is performed again for 4 hours to ensure thorough mixing of the PDMS elastomer, FDTS, and curing agent. FDTS is used to introduce fluorine-containing components into the PDMS system to adjust the triboelectric properties of the resulting film. The mixture is placed in an ultrasonic device for degassing. In one specific embodiment, the ultrasonic treatment time is 10 minutes. The degassed PDMS-FDTS mixture is spin-coated onto the surface of a glass substrate and thermo-cured. The mixture is cured at 80°C for 60 minutes. After curing, the resulting film is peeled off from the glass substrate surface to obtain a PDMS-FDTS flexible transparent film. The PDMS-FDTS flexible transparent film can be used as both a first flexible transparent friction layer and a second flexible transparent friction layer.

[0041] Step S2: Form a transparent electrode layer on the surface of the first flexible transparent friction layer.

[0042] The transparent electrode layer is composed of a silver nanowire conductive network.

[0043] In this specific embodiment, the PDMS-FDTS flexible transparent film is subjected to plasma treatment, and the treated film is placed in a spin-coating device. An AgNWs solution is provided. In one specific embodiment, the AgNWs solution with an initial concentration of 10 mg / mL is diluted to 1 mg / mL, and the diluted AgNWs solution is spin-coated onto the surface of the PDMS-FDTS flexible transparent film. The spin-coating speed of the AgNWs solution is 1000 rpm. After spin-coating, the film is placed on a 100°C constant temperature hot stage for 5 min to allow the AgNWs to form a conductive network on the surface of the PDMS-FDTS flexible transparent film, thereby obtaining an AgNWs flexible transparent electrode.

[0044] Step S3: Cover the surface of the transparent electrode layer with a second flexible transparent friction layer, so that the electrode layer is sandwiched between the first flexible transparent friction layer and the second flexible transparent friction layer to obtain the eye sensing module.

[0045] The second flexible transparent friction layer is composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material.

[0046] In this specific embodiment, another PDMS-FDTS flexible transparent film is disposed on the PDMS-FDTS film with AgNWs flexible transparent electrode, so that the AgNWs flexible transparent electrode is sandwiched between the two PDMS-FDTS films.

[0047] This results in a stacked structure of a PDMS-FDTS flexible transparent film and an AgNWs flexible transparent electrode, ultimately yielding the FT-TES flexible transparent triboelectric eye sensor. The AgNWs flexible transparent electrode is equipped with signal output terminals for connection to subsequent data acquisition modules. Compared to triboelectric sensors using fabric, metal sheets, or opaque composite materials, the FT-TES, employing a PDMS-FDTS transparent elastic film and an AgNWs conductive network, gives the sensor both flexibility and transparency. The flexibility allows the FT-TES to bend and adapt to the limited space of AR glasses frames and the near-eye area; the transparency helps reduce visual obstruction caused when the sensor is placed in the near-eye area.

[0048] Experiments have verified that the sensor maintains an overall optical transmittance of over 80% within the wavelength range of 190–1100 nm. These experimental results demonstrate the feasibility of deploying a flexible, transparent sensor near the eye.

[0049] Step S4: Prepare a housing with a detachable mounting structure according to the contour dimensions of the AR glasses temples; set a signal processing unit inside the housing.

[0050] In this specific embodiment, an external mounting box structure is established based on the temple size and local contour of the AR glasses to be deployed. The external mounting box includes a main body and a mounting structure for connecting to the temple of the AR glasses. The interior of the main body forms a circuit-accommodating space for installing a miniaturized data acquisition card and a wireless communication module. The mounting structure preferably employs an open slot. The open slot is located on the side of the external mounting box near the temple of the AR glasses and has an opening size and vertical height adapted to the corresponding mounting area of ​​the AR glasses temple. Through the open slot, the external mounting box can be snapped into or slid into the temple mounting position from the side.

[0051] 3D Printed Attachment Case. Based on the formed 3D model of the attachment case, 3D printing is used to prepare an integrated attachment case with a main body and an opening slot. 3D printing allows for adjustment of the opening slot structure according to the temple size of different AR glasses, enabling the attachment case to adapt to different eyeglass frames. The attachment case uses a detachable installation method, eliminating the need for drilling, cutting, or remanufacturing the AR glasses temples. Therefore, when eye-tracking control functionality needs to be added to existing AR glasses, the attachment case can be directly installed to the temples; when not in use, the attachment case can be removed.

[0052] A miniaturized data acquisition card is housed within the internal space of the external casing. The signal output terminals of the FT-TES are connected to the signal input terminals of the miniaturized data acquisition card via signal connection cables. Since this application employs a single-eye, single-sensor structure, the data acquisition card has at least one channel for acquiring eye mechanical motion signals. The miniaturized data acquisition card is used to sample the analog electrical signals output by the FT-TES and convert them into digital time-series data.

[0053] A WiFi wireless communication unit is installed inside the external casing. This unit connects to a miniaturized data acquisition card and is used to read sampled time-series data of eye mechanical movements and wirelessly transmit the data to a computer terminal. In one embodiment, the miniaturized data acquisition function and the WiFi wireless communication function can be integrated onto the same miniaturized circuit board. In another embodiment, the miniaturized data acquisition card and the WiFi wireless communication unit can be separate circuit modules.

[0054] This results in an external data export module for AR glasses.

[0055] Step S5: Deploy the eye sensing module in at least one near-eye area corresponding to the eye of the AR glasses; install the housing on the temple of the AR glasses using the mounting structure.

[0056] In this specific embodiment, based on the frame structure of the AR glasses and the user's eye position, an FT-TES is positioned in the near-eye region corresponding to one of the eyes. In a specific application, the FT-TES is positioned in the upper region of the frame corresponding to the left eye. This embodiment employs a monocular single-sensor structure, without providing dual-channel sensors for the left and right eyes. The FT-TES is positioned to detect the mechanical movements of the user's single eye.

[0057] The term "eye mechanical movement" refers to the mechanical displacement, contact state changes, or local deformation of the eyelids, periorbital tissues, and local physiological structures associated with eye movement during the processes of opening the eyes, closing the eyes, blinking, looking upwards, looking downwards, or continuous blinking.

[0058] It should be noted that when a user performs eye-mechanical movements, the distance, contact area, or contact state between the local eye structure and the FT-TES sensing surface changes. During contact, eye-mechanical movements act on the PDMS-FDTS sensing surface, forming interface charges under contact electrification. As the contact area or separation distance of the sensing interface changes due to eye-mechanical movements, the induced charge state in the AgNWs flexible transparent electrode changes accordingly, forming a dynamic electrical signal at the signal output terminal. Different eye-mechanical movements have different directions, amplitudes, durations, and repetitions, thus the resulting dynamic triboelectric signals differ in peak value, polarity, duration, peak spacing, and waveform combinations.

[0059] In this specific embodiment, the 3D-printed add-on box is installed onto the temple of the AR glasses via an open slot. After the add-on box is installed, the miniaturized data acquisition card and WiFi wireless communication unit are located on the outside of the temple. The FT-TES signal connection cable is laid along the frame or temple and connected to the miniaturized data acquisition card inside the add-on box.

[0060] Therefore, the deployment of the eye mechanical motion sensing and data export module can be completed without changing the internal display module, optical system, and original control circuit of the AR glasses.

[0061] Step S6: Connect the eye sensing module to the signal processing unit to obtain a flexible transparent triboelectric eye movement control system.

[0062] The flexible transparent triboelectric eye-tracking control system responds to the user's mechanical movements of the eye tissue. The eye sensing module generates dynamic triboelectric signals, the signal processing unit collects the dynamic triboelectric signals and converts them into digital time-series data, and sends the digital time-series data to an external terminal via wireless communication. The external terminal classifies the digital time-series data into actions and outputs corresponding eye-tracking control commands according to the classification results and the preset action-command mapping relationship.

[0063] In this specific embodiment, after step S3, the method further includes: A secondary electrode layer is formed on the surface of the second flexible transparent friction layer away from the electrode layer. The secondary electrode layer is composed of indium tin oxide or graphene. The secondary electrode layer, the second flexible transparent friction layer, and the electrode layer together constitute a capacitor structure. The capacitor structure detects changes in ambient humidity by varying the dielectric constant of the second flexible transparent friction layer with humidity.

[0064] This invention employs a three-layer stacked structure consisting of a first flexible transparent friction layer, an electrode layer, and a second flexible transparent friction layer. Both the first and second flexible transparent friction layers are composed of a transparent polydimethylsiloxane-perfluorodecyltrichlorosilane (PDMS-FDTS) composite material, and the electrode layer is composed of a transparent conductive network of silver nanowires (AgNWs). The overall optical transmittance is greater than 80%. Compared to existing eye-tracking devices that use opaque materials or have significant structural thickness, this invention, when placed in the near-eye area, does not obstruct the user's vision or increase wearing burden, thus meeting the stringent requirements of AR glasses for optical transparency and wearing comfort.

[0065] This invention separates the eye-sensing module from the external data export module. The external data export module is detachably installed on the temple of the AR glasses via an opening slot on the housing, while the eye-sensing module is attached to the near-eye area. Installation and removal require no modifications to the AR glasses' frame, optical path, main control circuitry, or internal power supply structure. Compared to existing solutions that require redesigning the frame, circuitry, and optical components, or modifying the internal hardware of the glasses, this invention achieves "zero-intrusion" rapid deployment of eye-tracking control functionality on existing AR glasses. It can be easily added to existing AR glasses products and can be removed at any time as needed, significantly reducing the deployment threshold and modification costs of eye-tracking control functionality.

[0066] In this embodiment of the invention, a secondary electrode layer is further disposed below the second flexible transparent friction layer, so that the second flexible transparent friction layer, as a dielectric layer, together with the electrode layer and the secondary electrode layer, constitutes a capacitor structure. This capacitor structure determines the humidity compensation coefficient in real time and performs reverse amplitude compensation on the triboelectric signal by detecting the change in capacitance value caused by the change in the dielectric constant of the second flexible transparent friction layer with humidity. In existing triboelectric eye-tracking sensing schemes, when the ambient humidity increases, water molecules form conductive paths on the surface of the friction layer, leading to surface charge dissipation and significant signal amplitude attenuation. This embodiment of the invention, through in-situ humidity detection and signal compensation, effectively eliminates the interference of humidity changes on eye-tracking signal acquisition, significantly improving the signal stability and eye-tracking recognition accuracy of the system in actual wearing scenarios such as sweating and high humidity, without requiring an additional independent humidity sensor and without sacrificing the transparency and flexibility of the device.

[0067] In this embodiment of the invention, the high-frequency carrier signal and the dynamic triboelectric signal are transmitted on the same signal transmission path via frequency division multiplexing and separated by a filter. The frequency of the high-frequency carrier signal is much higher than the frequency band of the dynamic triboelectric signal, and the two are fully separated in the frequency domain, without interfering with each other. This design allows humidity detection and eye-tracking signal acquisition to be performed synchronously on the same electrode layer and the same conductor, without the need for additional signal transmission lines, simplifying system wiring and reducing hardware complexity.

[0068] This invention employs a single-eye, single-sensor deployment method. Only one eye-sensing module needs to be placed in the near-eye region corresponding to one eye (left or right eye). By identifying differences in peak value, polarity, duration, peak spacing, and waveform combinations of dynamic triboelectric signals generated by different eye tissue mechanical movements (such as blinking and eye rotation), it can distinguish between various eye-tracking control commands. Compared to existing solutions requiring dual-eye multi-channel sensors or binocular cameras, this invention significantly reduces the number of sensors, signal leads, and data acquisition channels, further simplifying the deployment structure of AR glasses and reducing hardware costs and system power consumption.

[0069] This invention utilizes an external data export module with a signal processing unit to sample and convert dynamic triboelectric signals into digital data. The digital time-series data is then transmitted to an external terminal via wireless communication methods such as WiFi. The external terminal can preprocess the data, extract features, and classify actions according to specific application requirements, outputting corresponding eye-tracking control commands based on a preset action-command mapping. The wireless transmission method avoids the constraints of wired connections on user activities, while terminal-side processing allows the eye-tracking control logic to be flexibly adjusted for different AR application scenarios without requiring modifications to the glasses' hardware or firmware.

[0070] In summary, the embodiments of the present invention provide a transparent and flexible triboelectric eye-motion control scheme for existing AR glasses that can be quickly deployed without modifying the internal structure. At the same time, it effectively solves the technical problem that triboelectric signals are easily interfered with by humidity in actual use environments through a humidity self-compensation mechanism. It has outstanding advantages such as lightweight and thin structure, transparent and unobstructed design, detachable and reusable design, strong environmental adaptability, and simple deployment cost.

[0071] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.

[0072] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.

[0073] The above are merely preferred embodiments of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention are included within the scope of protection of the present invention.

Claims

1. A flexible, transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, characterized in that, The system includes: An eye-sensing module is disposed in at least one near-eye region corresponding to the eye of the AR glasses. It comprises a first flexible transparent friction layer, an electrode layer, and a second flexible transparent friction layer stacked sequentially. The electrode layer is sandwiched between the first and second flexible transparent friction layers. All three layers are transparent and flexible structures. When the contact state between the eye tissue and the first flexible transparent friction layer changes due to mechanical movement of the user's eye tissue, the induced charge distribution in the electrode layer changes accordingly, thereby outputting a dynamic triboelectric signal. The contact state includes at least one of separation distance, contact area, and contact position. An external data export module is detachably installed on the temple of the AR glasses and connected to the eye sensor module. It is used to collect the dynamic triboelectric signal and convert it into digital time series data, and send the digital time series data to an external terminal via wireless communication. The external data export module includes a housing and a signal processing unit disposed inside the housing. The housing has a detachable mounting structure adapted to the temples of the AR glasses. The signal processing unit is used to sample, convert analog to digital and transmit the dynamic triboelectric signal wirelessly.

2. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 1, characterized in that, The eye sensing module also includes a sub-electrode layer, which is stacked on the second flexible transparent friction layer, such that the second flexible transparent friction layer is located between the electrode layer and the sub-electrode layer, serving as a dielectric layer between the electrode layer and the sub-electrode layer, and thus the three together constitute a capacitor structure. The capacitor structure is used to detect changes in ambient humidity. Specifically, the capacitor structure generates a capacitance value when a high-frequency carrier signal is applied. The dielectric constant of the second flexible transparent friction layer changes with humidity, and the capacitance value changes accordingly with the change in dielectric constant. The signal processing unit determines the humidity compensation coefficient of the dynamic triboelectric signal based on the change in capacitance value, and uses the compensation coefficient to perform amplitude compensation on the dynamic triboelectric signal. When humidity increases, the capacitance value increases and the dynamic triboelectric signal attenuates. The compensation coefficient is monotonic with the capacitance value and is used to perform reverse amplitude compensation on the dynamic triboelectric signal.

3. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 2, characterized in that, Both the first and second flexible transparent friction layers are composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; the electrode layer is composed of a silver nanowire conductive network; the sub-electrode layer is composed of indium tin oxide or graphene; and the overall optical transmittance of the eye sensing module is greater than a preset value.

4. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 2, characterized in that, The frequency of the high-frequency carrier signal is higher than the frequency of the dynamic triboelectric signal. The two signals are transmitted on the same signal transmission path through the electrode layer via frequency division multiplexing. The signal processing unit separates the two signals through a filter.

5. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 1, characterized in that, The eye sensing module adopts a single-eye single-sensor deployment method and is set in the upper area of ​​the frame corresponding to the left or right eye of the AR glasses.

6. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 1, characterized in that, The detachable mounting structure is an open slot, which is located on the side of the housing near the temple of the AR glasses. The opening size and vertical height are adapted to the corresponding mounting area of ​​the temple of the AR glasses. The housing can be inserted into or slid into the mounting position from the side of the temple through the open slot. The housing is an integrated structure prepared using 3D printing technology.

7. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 1, characterized in that, The wireless communication method is WiFi wireless communication; the external terminal is a computer terminal, which is configured to perform signal preprocessing, feature extraction and action classification on the received digital time series data, and output the corresponding eye-tracking control command according to the classification result and a preset action-command mapping relationship.

8. The flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 7, characterized in that, The eye tissue mechanical movements are selected from at least one of the following: eyelid closure, eyelid opening, single blink, multiple consecutive blinks, upward eye movement, and downward eye movement; the dynamic triboelectric signal includes time-series electrical signals generated by different eye tissue mechanical movements that exhibit distinguishable differences in signal peak value, polarity, duration, peak spacing, and waveform combination.

9. A method for constructing a flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses, characterized in that, The method includes: Step S1: Prepare a first flexible transparent friction layer; wherein the first flexible transparent friction layer is composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; Step S2: A transparent electrode layer is formed on the surface of the first flexible transparent friction layer; wherein the transparent electrode layer is composed of a silver nanowire conductive network; Step S3: Cover the surface of the transparent electrode layer with a second flexible transparent friction layer, so that the electrode layer is sandwiched between the first flexible transparent friction layer and the second flexible transparent friction layer to obtain the eye sensing module; wherein, the second flexible transparent friction layer is composed of a polydimethylsiloxane-perfluorodecyltrichlorosilane composite material; Step S4: Prepare a housing with a detachable mounting structure according to the outline dimensions of the AR glasses temples; install a signal processing unit inside the housing; Step S5: Deploy the eye sensing module in at least one near-eye area of ​​the AR glasses; install the housing on the temple of the AR glasses using the mounting structure; Step S6: Connect the eye sensing module to the signal processing unit to obtain a flexible transparent triboelectric eye movement control system; The flexible transparent triboelectric eye-tracking control system responds to the user's mechanical movements of the eye tissue. The eye-sensing module generates the dynamic triboelectric signal, the signal processing unit collects the dynamic triboelectric signal and converts it into digital time-series data, and sends the digital time-series data to an external terminal via wireless communication. The external terminal classifies the digital time-series data into actions and outputs corresponding eye-tracking control commands according to the classification results and a preset action-command mapping relationship.

10. The method for constructing a flexible transparent triboelectric eye-tracking control system for rapid deployment of AR glasses according to claim 9, characterized in that, After step S3, the method further includes: A sub-electrode layer is formed on the surface of the second flexible transparent friction layer away from the electrode layer. The sub-electrode layer is composed of indium tin oxide or graphene. The sub-electrode layer, the second flexible transparent friction layer, and the electrode layer together constitute a capacitor structure. The capacitor structure detects changes in ambient humidity by varying the dielectric constant of the second flexible transparent friction layer with humidity.

Images