Method and system for controlling a touch terminal without authority based on a light guide interaction layer

Abstract

This invention discloses a method and system for controlling a permissionless eye-tracking touch terminal based on a photoconductive interaction layer, relating to the field of smart terminal interaction. The photoconductive interaction layer is a disposable structure; if it fails, the entire film can be directly replaced. The core display area is a pure optical structure without chips, circuits, or power supplies, using a polyimide composite photodeformation material containing nano-silica, with a hydrophobic coating and flow channels on the surface. The edge of the film integrates signal acquisition, micro-AI processing, and multi-source passive power supply modules, which have no electrical connection to the terminal. The system achieves eye tracking through optical liveness detection, adapting to special physiological states, and determines permissionless screen access through dual-dimensional calibration, using photodeformation to purely physically trigger the capacitive terminal. The eye signals are doubly encrypted and have an anti-tampering self-destruct mechanism; it does not request permissions or read data throughout the process, is compatible with multiple touch screen forms and multiple systems, can operate at -25℃ to 75℃, and has a protection level of no less than IP67.

Description

Technical Field

[0001] This invention relates to the field of intelligent terminal interaction and optical engineering technology, specifically to a permissionless, passive, purely optical eye-tracking touch control method and system based on a disposable photoconductor interaction layer. It is applicable to all types of capacitive touch devices, including smartphones, tablets, desktop PC touchscreens, industrial control touchscreens, vehicle central control systems, smart bracelets, and ultra-large screen industrial control terminals, and is compatible with mainstream operating systems such as Android, iOS, Windows, and macOS. By attaching a disposable standardized photoconductor film, permissionless eye-tracking touch control is achieved without hardware modification, software installation, or system permissions. It features simple deployment, privacy and security, adaptability to extreme environments, friendliness to special user groups, and low mass production costs. Background Technology

[0002] Existing eye-tracking solutions for touch terminals generally rely on front-facing cameras, external recognition devices, or require access to sensitive permissions such as system cameras, storage, and touch control, which can lead to issues such as privacy leaks, system blocking, poor cross-platform compatibility, and unavailability in special environments. Traditional photoconductor film interaction only achieves simple physical triggering and does not have the capabilities of eye tracking, liveness detection, or command parsing.

[0003] Currently, the industry lacks an integrated solution that can simultaneously meet the following requirements: access without authorization, pure optical sensing, passive power supply, compatibility with all terminals, rapid screen protector deployment, adaptation to special physiological groups, stability in extreme environments, and privacy self-protection. At the same time, it suffers from defects such as large signal loss, unreliable liveness detection, easy accidental triggering of commands, unsustainable power supply, insufficient adaptation of touch protocols, weak protection capabilities, no rollback for firmware updates, difficulty in fault location, and poor mass production consistency.

[0004] In addition, existing products mostly adopt repairable and upgradeable structures, which result in high maintenance costs and low reliability in scenarios such as industrial control, automotive, disposable consumption, high pollution, and high salt spray. There is still a gap in the availability of a truly standardized disposable film form that requires no maintenance and can be directly replaced without authorization. Summary of the Invention

[0005] This invention aims to solve the following problems in the prior art: 1. Eye-tracking interaction relies on permissions, cameras, and APIs, posing high privacy risks and being easily restricted by the system; 2. The optical guide film lacks eye tracking and liveness detection, making it impossible to control the gaze. 3. Poor compatibility across sizes, materials, and systems, unable to cover ultra-small to ultra-large screens; 4. Passive power supply is prone to interruption under low temperature, low light, and strong vibration conditions; 5. Lack of compatibility with specific physiological populations, resulting in a high barrier to entry for use; 6. The triggering method is prone to damaging the screen and lacks light, heat, and capacitance safety control; 7. Insufficient data security and anti-tampering capabilities; 8. Insufficient adaptability to extreme environments (high and low temperatures, high humidity, high altitude, high salt spray, strong electromagnetic fields); 9. The use of a repairable structure leads to low reliability and high maintenance costs; This invention addresses a series of technical pain points by employing a disposable optical guide interaction layer architecture. It eliminates the need for maintenance and hardware upgrades, allowing for direct replacement upon failure, thus reducing total lifecycle costs while ensuring extremely high reliability.

[0006] A permissionless eye-tracking touch control method based on a disposable optical guide interaction layer includes: 1) Apply a disposable standardized light guide film: the core area is purely optical and has no electricity, while the edge integrates data acquisition, AI processing, and multi-source passive power supply; there is no electrical connection with the terminal; the hardware is a disposable design, cannot be repaired, and replacement is done by simply replacing the film.

[0007] 2) Ocular optical acquisition and passive liveness detection: Acquires ocular signals through 850nm infrared reflection; Four-feature liveness detection: micro-tremor, pupil constriction, iris texture, blinking; Full coverage of special physiological populations with error tolerance; Adaptive infrared supplementary lighting, human eye safety and compliance, and close-range protection.

[0008] 3) Screen calibration without permission and eye command parsing: Dual-dimensional calibration enables screen calibration without permission; nine types of core commands + priority + superimposed judgment; supports adaptation for the elderly / children / special physiological / monocular.

[0009] 4) Touch protocol adaptive + pure physical photo-induced deformation trigger: automatically recognizes the protocol and screen parameters; dynamically triggers capacitance + deformation + photothermal temperature control; no permissions, no intrusion, no data reading, no API access.

[0010] 5) Low power consumption, self-test, safety, and prompts: automatic sleep mode + dual wake-up; end-to-end encryption + automatic temporary data clearing + anti-tamper self-destruction; periodic self-test + software fault repair; clear fault prompts, and direct prompts to replace the entire membrane when hardware fails.

[0011] A permissionless eye-touch system based on a disposable light guide interaction layer contains only disposable light guide film hardware, including a pure optical core display area, an edge integration area, a permissionless eye-touch command parsing module, a touch protocol adaptive and pure physical triggering module, a privacy and security module, a power management module, and a wake-up and prompting module; the system is permissionless, passive, has no electrical connection, is disposable, and is easy to replace.

[0012] 1. Ultimate privacy and security: No permissions, no data reading, end-to-end encryption, temporary data is cleared immediately, and it is self-destructive and tamper-proof.

[0013] 2. Truly permissionless cross-platform compatibility: It does not depend on the system, does not require installing an app, and does not use APIs. It is fully compatible with Android / iOS / Windows / MacOS.

[0014] 3. The disposable structure brings extremely high reliability: no maintenance, no disassembly, no upgrades, no contact wear, and stability is greatly improved in harsh environments.

[0015] 4. Suitable for all groups, all scenarios, and all populations: suitable for ordinary people, the elderly, children, monocular people, people with tremors, people with ptosis, and people with small pupils.

[0016] 5. Strong adaptability to extreme environments: It can work stably in wide temperature ranges, wide humidity ranges, high altitudes, high salt spray, high vibration, and strong electromagnetic fields.

[0017] 6. Extremely simple deployment and mass production friendly: ready to use after applying film, multi-specification standardized templates, automated production, high yield, and controllable cost.

[0018] 7. High compliance with human eye safety standards: Strictly complies with national standards, provides close-range protection for children, and is safe for prolonged use without causing harm. Detailed Implementation

[0019] The present invention will be further described in detail below with reference to specific embodiments.

[0020] A disposable light guide interaction layer is attached to the surface of a 5.5-inch Android curved flexible screen smartphone, with automatic air venting to prevent air bubbles. A multi-source passive power supply module collects ambient light and electromagnetic energy for startup, while a micro-film battery provides backup. The light guide film undergoes dual-dimensional error calibration to determine the screen size and automatically adapts to the resolution parameters. When a user with high myopia in one eye looks at an application icon, the system performs four-feature liveness detection using 850nm pulsed infrared, still recognizing a valid liveness even if the iris is obscured. User eye contact triggers pre-confirmation of the command, while continued eye contact triggers confirmation. The touch protocol adaptive module identifies private protocols, matches trigger capacitance and deformation, and opens the application through photo-induced deformation using purely physical means without authorization. In strong outdoor light and high humidity environments, the system automatically increases the supplementary light intensity and reduces power to protect the eyes at close range. After a period of inactivity, it enters low-power sleep mode, which is awakened by eye contact. In case of hardware failure or material fatigue, a solid red light indicates that the entire film should be replaced.

[0021] A disposable photoconductive interaction layer from the PC series is attached to the 27-inch Windows desktop PC touchscreen, and the power supply module provides stable power. For users with nystagmus, a special compatibility mode is activated, and the system uses a filtering algorithm to separate valid trajectories. When a user gazes at an icon to trigger a confirmation command, the system recognizes the touch protocol and completes the physical trigger; when triggering overlays, commands are executed according to priority. When the original translucent tempered glass film is overlaid, the system automatically activates optical interference compensation to ensure stable recognition.

[0022] A high-protection, disposable light-guiding interactive layer is attached to the 12-inch curved center console to enhance vibration resistance and salt spray protection. The power supply module collects light, electromagnetic, and vehicle vibration energy, and the battery continues to supply power after the engine is turned off. The driver can perform navigation, volume adjustment, and other operations through eye movements, and it still works stably in bumpy and electromagnetic interference environments; it automatically adjusts power consumption and light intensity in low light and high humidity conditions to ensure driving safety.

[0023] When the 12-inch in-vehicle screen is in a low-temperature, low-light environment (-20°C), the battery stops charging and discharging, relying solely on passive capacitors for power, thus extending the fault self-diagnosis cycle. For elderly users, the system relaxes physiological characteristic thresholds to ensure core commands are available. It enters deep sleep mode when the voltage is too low, waking up upon eye contact after returning to normal temperature, and automatically resuming full functionality once energy is restored.

[0024] The 8-inch tablet features a disposable light-guiding interaction layer and a privacy film, with the system automatically compensating for optical loss. In child mode, command parameters adapt automatically, reducing light and providing a warning when the device is at close range to protect eyesight. In low-light environments, it is powered by electromagnetic and vibration energy, providing sufficient battery life for extended use, and automatically enters sleep mode after inactivity.

[0025] The 15-inch industrial control screen is fitted with an industrial-grade disposable photoconductive interactive layer, providing dust resistance, high-frequency vibration resistance, and strong electromagnetic shielding. Operators can perform parameter adjustments, pause operations, and other functions via eye-tracking commands. The system performs periodic self-checks and can repair soft faults such as signal loss and contact misalignment; it prompts for replacement of the entire membrane when material fatigue exceeds the limit, eliminating the need for maintenance.

[0026] The 6.7-inch phone operates in extremely cold environments down to -25°C. The disposable photoconductor film relies on passive capacitors to maintain core functions, ensuring stability of the material and adhesive layer at low temperatures. Single-eye user commands are adaptive, resulting in error-free operation. In scenarios combining extreme cold, low light, and high humidity, the system dynamically adjusts light intensity and power consumption to meet outdoor usage needs.

[0027] The 6.8-inch foldable screen phone features a dedicated disposable photoconductive interaction layer for foldable screens, supporting repeated bending. It automatically adapts parameters between folded and unfolded states, ensuring stable photodeformation and a 100% trigger success rate. The material can recover from fatigue after resting, and its lifespan meets the entire lifespan of the device. In case of failure, the entire film can be replaced.

[0028] The 3.5-inch smart bracelet features a disposable, ultra-small screen light guide interaction layer, with command thresholds adaptively adjusted to the small size. Powered by low-light and electromagnetic energy with extremely low power consumption, it offers sufficient battery life for extended use. Users complete selections, confirmations, and page turning via eye movements—a completely contactless, permission-free, convenient, and secure process.

[0029] The 65-inch ultra-large screen industrial control terminal features a disposable light guide interaction layer, enabling adaptive control of command parameters over long distances and large sizes. Under extreme electromagnetic interference, it activates a core command retention mode to ensure the availability of critical operations. Light and heat temperatures are strictly controlled to prevent damage to the large screen; the material exhibits no permanent deformation under high-frequency operation, ensuring a lifespan suitable for industrial applications.

[0030] The 8-inch tablet features a dedicated disposable photoconductive interaction layer applied in high-altitude, low-pressure environments, with adhesive layers designed to prevent bubble formation and edge warping. The photoelectric module activates in low-light conditions, ensuring stable power supply. The system automatically compensates for signal loss due to humidity and air pressure, resulting in zero-delay command recognition and stable, reliable hardware.

[0031] The 12-inch in-vehicle central control screen utilizes a highly protective disposable optical guide interaction layer in high-salt-fog coastal environments, enhancing the corrosion resistance of metal components and improving overall protection. Even after prolonged exposure to salt spray, the hardware shows no corrosion, and the signal remains stable. Drivers control the air conditioning and multimedia systems via eye movements, and the system automatically adjusts supplementary lighting and power consumption to ensure safe use and driving in coastal environments.

[0032] The core innovation of this invention lies in the integrated architecture of "disposable light guide interaction layer + permissionless pure physical triggering". Unlike existing eye-tracking interaction solutions that rely on system permissions and external devices, its disposable structure design not only reduces maintenance costs but also improves reliability in extreme environments. It is especially suitable for scenarios with high requirements for maintenance convenience, such as industrial control, automotive, and disposable consumer products.

[0033] All parameters in this invention (such as trigger capacitor 20-150pF, operating temperature and humidity -25℃~75℃, and optical guide layer edge width 1-2mm) are preferred embodiments and are not intended to limit the invention. Those skilled in the art can reasonably adjust the parameters within the scope defined by the claims of this invention according to actual application scenarios, and all such adjustments shall fall within the protection scope of this invention.

[0034] Furthermore, the disposable photoconductive interaction layer of the present invention can be mass-produced in a standardized manner, cut to different terminal sizes and scenario requirements, and the film application and deployment do not require professional personnel, which greatly reduces the cost of industrialization and promotion and has broad application prospects.

Claims

1. A method and system for controlling a permissionless eye-tracking touch terminal based on an optical guide interaction layer, characterized in that, Includes the following steps: S1: A standardized disposable photoconductive interaction layer is attached to the touch surface of the touch terminal; the photoconductive interaction layer has no hardware update or repair path, and the entire film is directly replaced when the function fails or needs to be iterated. Firmware / algorithm fine-tuning is completed only through factory pre-programming, and the pre-programming configuration includes a fault rollback mechanism; the photoconductive interaction layer is divided into a pure optical core display area and a 1-2mm non-display edge integration area around the film. The core display area has no chips, circuits, or power supply, while the edge integration area integrates a signal acquisition area, a micro AI processing unit, and a multi-source passive power supply module. The edge components are physically isolated from the core display area and have no electrical connection with the touch terminal; S2: The micro AI processing unit receives the reflected light signal from the eyeball through the total internal reflection optical path of the light guide interaction layer. After color temperature compensation and ambient light filtering, it performs four-feature passive optical liveness detection. The intensity of the pulsed infrared supplementary light is adjusted in a graded gradient according to the signal attenuation. The supplementary light parameters meet the human eye safety requirements of the national standard GB / T30117-2013. Eye movement recognition is initiated through a command pre-confirmation mechanism, a minimum effective command interval is set, and screen size-free determination is achieved through dual-dimensional error calibration. Nine types of core eye movement command parameters are adaptively matched based on screen size and resolution. It supports preset parameters for three groups of people: ordinary, elderly, and children, compatibility with all types of special physiological groups, and command replacement solutions for single-eye users. S3: The micro AI processing unit detects the terminal's touch protocol type and screen parameters through a touch protocol adaptive recognition module, converting valid eye movement commands into pure physical trigger commands corresponding to the protocol; it non-invasively triggers the capacitive touch terminal through photodeformation, dynamically adjusting the trigger capacitance, deformation, and trigger duration according to the screen material, sensitivity, and touch sampling rate, and is equipped with a real-time photothermal temperature detection and over-temperature protection mechanism; it does not request any permissions from the terminal system, read system data, or access underlying APIs throughout the entire process; S4: After a single trigger is completed, if no new valid command is detected within a preset time, the system will automatically enter a low-power sleep mode, supporting automatic wake-up by eye gaze and manual wake-up by edge pressure sensor; the system periodically performs comprehensive detection of hardware, materials, signals and fatigue through built-in fault self-test module, which can automatically calibrate and repair some soft faults, and visually prompt the working status and fault type through three-color LEDs. When hardware fails or material fatigue exceeds the standard, it prompts to directly replace the entire membrane.

2. The method according to claim 1, characterized in that... The signal acquisition area is equipped with several optical coupling contacts arranged in an array, a miniature distance sensor, an optical filtering module, a signal amplification module, a binocular optical sensor, and a color temperature compensation module; the surface of the optical coupling contacts is equipped with an ultra-hard wear-resistant coating and a waterproof and anti-oxidation coating, and a special anti-salt spray coating is configured for high salt spray scenarios; the sensor is surrounded by a light-shielding and light-blocking structure and an anti-obstruction detection ring.

3. The method according to claim 1, characterized in that... The micro AI processing unit is packaged in low-pressure injection molding, with a built-in micro heat dissipation channel and electromagnetic shielding structure. It is equipped with a MEMS processor, encrypted storage unit, fault self-diagnosis module, grayscale threshold segmentation algorithm, and touch protocol adaptive algorithm. It supports automatic switching between I2C / SPI dual-mode communication, and reuses the acceleration detection function as a hardware carrier for eye signal analysis. The instruction recognition delay, computational load, and operating temperature are controlled within a preset range. It has a built-in one-time programmable encryption key storage area, and the key is generated by a unique hardware code and the physical texture of the optical guide layer.

4. The method according to claim 1, characterized in that... The multi-source passive power supply module integrates a photoelectric power generation module, an electromagnetic induction module, a micro-layered passive capacitor, and a micro-flexible thin-film battery, supporting visible light and infrared light energy harvesting and wide-band vibration energy harvesting. The system dynamically adjusts the energy supply priority and power consumption strategy according to the ambient illuminance, temperature, and vibration state, ensuring stable power supply for core functions even in scenarios with overlapping low temperature, low light, and extreme environments, and is configured with multi-level low power consumption and deep sleep mechanisms.

5. The method according to claim 1, characterized in that... The core display area uses a polyimide + 5% nano-silica composite photodeformation material containing temperature and humidity stabilizers, toughening agents, cold-resistant plasticizers, and moisture-proof agents. The surface is covered with a MgF2 anti-reflective coating and a micro-nano directional grating. The trigger area is equipped with a micro stress groove and a temperature detection unit. The light guide layer uses a flexible substrate to adapt to curved surfaces and foldable screens, and its bending life meets the requirements for large-scale use. The light guide interaction layer is bonded to the terminal through optical pressure-sensitive adhesive. The adhesive layer has a micro-mesh breathable structure and is equipped with adaptation solutions such as anti-ultraviolet, anti-exudation, low-pressure anti-bubbling, and oleophobic layer to enhance adhesion. There is no adhesive residue after peeling.

6. The method according to claim 1, characterized in that... The four-feature passive optical liveness detection includes nystagmus, pupil contraction rate, iris texture contour, and eyelid blinking physiological characteristics; corresponding fault tolerance and threshold relaxation mechanisms are set for special physiological states such as iris non-recognition, nystagmus, ptosis, and congenital micropupils to ensure normal use by special groups.

7. The method according to claim 1, characterized in that... The infrared supplementary light is adjusted in stages according to the signal attenuation and is linked to the distance to the human eye, the sensor occlusion status, and the ambient light intensity; it automatically reduces power protection when used at close range, and automatically reduces the irradiation level after continuous irradiation for an extended period of time, with the total radiation and power density strictly meeting human eye safety standards.

8. The method according to claim 1, characterized in that... The nine core eye movement commands include selection, confirmation, exit, swipe / page turning, long press, drag, zoom in, zoom out, and pause / continue; command configuration priority and overlay judgment logic, supports adaptive parameters based on population, physiological state, and screen size, and provides complete command alternatives for monocular users.

9. The method according to claim 1, characterized in that... During the touch triggering phase, temperature and humidity compensation is performed on the trigger capacitor according to the material. The photo-induced deformation response and recovery time are controlled. Different safety thresholds for photothermal temperature are set according to screen types such as LCD / OLED to avoid overheating damage to the terminal. The system is compatible with the original translucent film for superposition and initiates optical interference compensation and adaptive light intensity adjustment.

10. The method according to claim 1, characterized in that... The original eye signals and transmitted data are protected by optical frequency modulation encryption and AES-128 encryption across the entire link; temporary data is only stored briefly during instruction parsing, and is automatically cleared and redundantly verified immediately after execution. Hardware-level data erasure is triggered in abnormal conditions; the micro AI processing unit is equipped with a multi-dimensional physical anti-tampering detection mechanism, which immediately triggers data self-destruction and system lock when illegal disassembly is detected.

11. The method according to claim 1, characterized in that... The optical guide interaction layer is divided into mobile phones, tablets, PCs, industrial control, automotive, ultra-small screens, and ultra-large screens according to application scenarios. It provides multiple standardized cutting templates according to the width of the black border of the screen, covering all sizes of terminals. The automotive and industrial control models have enhanced protection levels, vibration damping and salt spray resistance, while the foldable screen model adopts a special flexible substrate and fatigue-resistant structure.

12. A permissionless eye-tracking touch terminal control system based on a light guide interaction layer, characterized in that, For implementing the method of any one of claims 1-11, it comprises only a single core hardware component of a disposable photoconductor interaction layer, without external modules, without hardware maintenance and update paths, and directly replaces the entire film when upgrades are needed or failures occur; the photoconductor interaction layer includes: The pure optical core display area has no chips, no circuits, and no power supply. It uses composite photodeformation materials and is equipped with an anti-reflective coating, directional grating, temperature sensor, and color temperature compensation module. It is bonded to the touch terminal through optical pressure-sensitive adhesive. The edge integration area, located in the narrow edge area around the membrane, integrates a signal acquisition unit, a micro AI processing unit, a multi-source passive power supply module, an optical prompt module, and a manual wake-up unit. It is physically isolated from the core display area and has no electrical connection with the terminal. It is equipped with an anti-disassembly, electromagnetic shielding, and vibration-resistant fixing structure. The unauthorized eye command parsing module enables liveness detection, special population error tolerance, dual-dimensional screen calibration, command recognition, priority determination, monocular adaptation, fault self-checking, and soft repair. The touch protocol adaptive and pure physical triggering module realizes protocol recognition, parameter matching, photo-induced deformation triggering, dynamic capacitance adjustment, photothermal temperature control, and full sampling rate adaptation. The privacy and security module enables end-to-end encryption, automatic deletion of temporary data, self-destruction of data to prevent tampering, secure key storage, and firmware burning verification. The power management module enables multi-source energy harvesting, dynamic power allocation, low-temperature and low-light fault tolerance, multi-level low power consumption and sleep control; The wake-up and prompt module enables eye-tracking wake-up, manual wake-up, ambient light adaptive brightness prompts, graded fault prompts, and guidance for replacing the entire membrane.