Equivalent implementation method and device for light guide type unauthorized interaction

Abstract

The invention discloses an equivalent implementation method and device for light guide type unauthorized interaction, and belongs to the technical field of unauthorized man-machine interaction. The method comprises the following steps: acquiring interface state information in an unauthorized perception mode (ultrasonic waves, low-frequency electromagnetic induction and the like), transmitting the interface state information to an external AI processing unit to generate operation guidance, and converting the operation guidance into an optical signal; optical signals are directionally focused to a target position through a cover plate integrated micro-nano structure, a temporary attachment optical patch, an air gap light guide channel and other optical guide carriers; the optical signal triggers physical changes such as light-induced refractive index change, microbubble generation (based on light addressing and a microcavity array) and the like, and the capacitive screen is triggered to realize unauthorized interaction; stability is guaranteed through anti-interference schemes such as frequency hopping, polarization coding and phase locking. Complete implementation details of all core technologies are disclosed, multiple equivalent technical features are covered, the protection range is wide, logic is rigorous, scene adaptability is high, an avoidance path is effectively blocked, patent authorization stability and right protection effectiveness are high, and the method is suitable for unauthorized interaction scenes of various touch screen devices.

Description

Technical Field

[0001] This invention relates to the field of permissionless human-computer interaction technology, and in particular to a method and apparatus for achieving permissionless interaction based on optical guidance. It is specifically applicable to various touch screen devices such as smartphones, vehicle touch screens, industrial control touch screens, smartwatches, and smart home appliance touch panels, and is compatible with multiple operating systems such as HarmonyOS, Android, iOS, Windows, Mac OS, and Linux. Background Technology

[0002] Existing permissionless interaction technologies primarily rely on specific optical guiding carriers such as photoconductor films and microlens arrays. They acquire interface information through visual perception or radio frequency / millimeter-wave sensing, and then achieve interaction by combining physical triggering mechanisms such as photothermal micro-deformation and photoelectric field changes. However, these technologies have significant drawbacks: Optical guiding carriers are limited to fixed structures such as optical guide films and microlens arrays, lacking coverage of integrated cover plate structures, temporary bonding patches, air gap optical guide channels, etc., making them easy for competitors to circumvent by replacing the carrier. The physical triggering mechanism is limited to photothermal micro-deformation and photoelectric field changes, and does not cover equivalent mechanisms that can achieve the same touch effect, such as photoinduced refractive index changes and microbubble generation, thus the scope of protection has loopholes. Anti-interference schemes mostly adopt a fixed combination of electromagnetic shielding + digital coding + timing lock, which does not cover effective anti-interference methods such as frequency hopping, polarization coding, and phase locking, and has insufficient adaptability in complex electromagnetic environments. The lack of sufficient disclosure of implementation details for some key technologies, such as process parameters of equivalent carriers and precise control logic of physical triggers, casts doubt on the feasibility of the technical solutions and leaves room for competitors to circumvent them.

[0003] To address the aforementioned technical problems, this application provides a permissionless interaction method and apparatus that covers multiple equivalent technical features, is fully disclosed, logically consistent, and has strong anti-interference capabilities, filling the protection gap in the prior art and enhancing the practicality and patent protection of the technical solution. Summary of the Invention Purpose of the invention

[0005] This invention aims to address the problems of existing unauthorized interaction technologies, such as narrow protection scope, susceptibility to equivalent substitution and circumvention, insufficient disclosure of key details, and inadequate adaptability to anti-interference scenarios. It provides an unauthorized interaction method and device that covers multiple equivalent carriers, triggering mechanisms, and anti-interference schemes, and is fully disclosed and logically rigorous, ensuring the stability of patent authorization and the effectiveness of subsequent rights protection. Technical solution

[0006] Methods section A method for achieving permissionless interaction via optical guidance, characterized by the following steps: S1. Obtaining the interface status information of the target device screen through an external permissionless sensing method, wherein the external permissionless sensing method is defined as "not reading the target device system data, not requesting system auxiliary function permissions, not accessing the system API interface, and not establishing any communication connection with the target device", specifically including at least one of ultrasonic sensing and low-frequency electromagnetic induction sensing (<1GHz), or any combination of two non-visual sensing methods; S2. Transmitting the interface status information to an external AI processing unit, generating operation guidance information containing operation coordinates and operation type based on preset interaction logic, and converting the operation guidance information into a light signal with preset parameters; S3. Orienting and focusing the light signal to the target touch position through an equivalent optical guiding carrier, wherein the equivalent optical guiding carrier includes any one of an integrated micro-nano structure of a cover plate, a temporary adhesive optical patch, and an air gap optical guiding channel; S4. The optical signal acts on the physical triggering unit, triggering a preset physical change at the target touch position. The physical change causes the capacitive screen to recognize it as a user operation, enabling unauthorized interaction. The physical change includes at least one of photothermal deformation, photoinduced deformation, local electric field change, photoinduced refractive index change, and microbubble generation. S5. The stability of optical signal transmission and physical triggering is ensured by an equivalent anti-interference scheme, which includes at least one of frequency hopping, polarization coding, and phase locking.

[0007] Furthermore, in step S3: The integrated micro / nano structure of the cover glass is realized by forming a grating array on the inner side of the cover glass of the target device screen through magnetron sputtering and nanoimprinting. The grating period is 0.6-1.0 times the center wavelength of the corresponding transmitted optical signal, forming an inseparable composite structure with the cover glass, and the light transmittance is ≥92%. The thickness of the temporary bonding optical patch is 0.1-0.3mm. It uses a re-adhesive optical adhesive layer, which is applied to the screen surface when in use and can be removed when not in use. The surface of the patch is coated with an anti-fingerprint coating. The air gap optical guide channel is implemented by forming a 0.5-2mm sealed air gap between the screen surface and the optical emission module through a support structure set on the screen bezel. An optical coupling layer (refractive index 1.5-1.6) is set at both ends of the air gap to ensure that the optical signal transmission efficiency is ≥70%.

[0008] Furthermore, in step S4: The specific implementation of microbubble generation is as follows: the physical trigger unit adopts a "optical addressing + microcavity array" design. The microcavity array is uniformly distributed according to the screen pixel density (100-300 PPI), and each microcavity has a volume of 5-10 μL, containing deionized water and a titanium nitride heat-absorbing layer (thickness 50-100 nm). The optical signal is precisely focused by the optical guide carrier and acts only on the microcavity corresponding to the target operation coordinate. After absorbing the light energy, the heat-absorbing layer heats up at a rate of ≥5℃ / ms, causing the water to vaporize and form microbubbles with a diameter of 1-3 mm. Microcavities at non-target coordinates do not generate bubbles because there is no optical signal focusing. The bubbles exist for 5-10 ms and quickly dissipate through the heat dissipation channel at the bottom of the microcavity without leaving any residue, thus avoiding affecting subsequent interactions. The method for achieving the photoinduced refractive index change is as follows: liquid crystal microbeads (diameter 1-5μm) are added to the optical guiding carrier. When the light signal is irradiated, the molecular arrangement direction of the liquid crystal microbeads changes, resulting in a local refractive index change of 0.05-0.1, which is adapted to the capacitive touch screen recognition threshold. All physical change parameters meet the following requirements: click accuracy ≥ 99%, false touch rate ≤ 0.1%, single trigger energy ≤ 0.5mJ, local temperature rise ≤ 0.1℃, and no damage to the target device screen.

[0009] Furthermore, in step S5: The frequency switching is implemented as follows: the optical signal frequency is dynamically switched in the range of 1kHz-10kHz, the switching period is synchronized with the touch detection period of the target device (20ms), the switching step size is 1kHz, and the environmental interference frequency band is avoided by a preset algorithm. The polarization encoding is implemented as follows: linear polarization light encoding is used, and interactive commands are carried by adjusting the polarization direction of the optical signal (switching between four levels: 0° / 90° / 180° / 270°). Signal decoding is achieved in conjunction with the polarization filter at the receiving end, with a crosstalk rate of ≤5%. The phase locking is implemented by locking the optical signal trigger window with the target device touch detection cycle, executing the trigger within a 5-10ms interval after the touch detection is completed, and disabling the trigger decision during non-window periods. Device section

[0010] An equivalent implementation device for optical guide-based permissionless interaction, characterized in that it comprises: Unauthorized Perception Module: Used to obtain interface status information through at least one of ultrasonic sensing, low-frequency electromagnetic induction sensing (<1GHz), or any combination of two non-visual sensing methods; the module has no electrical connection with the target device and is independently powered (standby power consumption ≤10μW, operating power consumption ≤1mW). Communication interface: Used to establish a data connection with an external AI processing unit and receive operation guidance information. The communication methods include wired (USB-C) or wireless (Bluetooth BLE 5.0), and the data transmission rate is ≥1Mbps. Equivalent optical guidance module: used to direct and focus light signals to the target touch position, including any one of the following: integrated micro-nano structure of cover plate, temporary bonding optical patch, air gap light guide channel; the module transmittance is ≥85% and the light signal focusing accuracy is ≤0.5mm; Physical trigger module: Corresponding to the output of the equivalent optical guidance module, it includes at least one of the following: microcavity array structure (containing titanium nitride heat absorption layer, deionized water and heat dissipation channel), liquid crystal microbead doped layer, and photopolarized material layer, used to generate a preset physical change under the action of optical signal; Equivalent anti-interference module: Integrated into the optical signal transmitter, including at least one of a frequency hopping unit, a polarization coding unit, and a phase-locking unit, used to ensure the stability of optical signal transmission, with a bit error rate ≤10⁻ in strong electromagnetic environments. 6 .

[0011] Furthermore, in the microcavity array of the physical triggering module, the photothermal conversion efficiency of a single microcavity is ≥80%, and after 10,000 cycles of testing, the bubble generation success rate is ≥98%, and the deformation attenuation is ≤5%; the response time of the liquid crystal microbead doped layer is ≤10ms, and the recovery time is ≤5ms.

[0012] Furthermore, the frequency switching unit of the equivalent anti-interference module supports dynamic switching in the 1kHz-10kHz range, the polarization direction recognition accuracy of the polarization coding unit is ≥99.5%, and the timing synchronization error of the phase locking unit is ≤0.1ms. Beneficial effects

[0013] It offers broad protection and blocks loopholes: It covers a variety of equivalent carriers such as integrated micro-nano structures, temporary optical patches, and air gap optical guide channels; multiple triggering mechanisms such as photoinduced refractive index changes and microbubble generation; and multiple anti-interference schemes such as frequency jumps and polarization encoding. It comprehensively covers equivalent implementation forms not covered by existing technologies, preventing competitors from circumventing infringement by replacing technical features. Full disclosure and high authorization stability: Detailed disclosure of the implementation details of each core technology, including the process parameters of the integrated cover plate structure, the "optical addressing + microcavity array" design for microbubble generation, and the specific operating logic of the anti-interference scheme, etc., meets the "full disclosure" requirement of the Patent Law and greatly reduces the risk of examination rejection and subsequent invalidation; The logic is self-consistent and the basis for rights protection is sufficient: a complete technical link is constructed, which is "unauthorized perception → external AI decision-making → optical signal focusing and transmission → physical triggering → anti-interference protection". The functions of each module are complementary and the parameters are matched. The claims are completely consistent with the description in the specification, and a complete chain of evidence can be directly formed when rights are protected. Strong scene adaptability and outstanding practicality: It is compatible with a variety of devices such as smartphones, vehicles, industrial control, and smart home appliances, and is compatible with multiple operating systems. Its anti-interference solution can cope with various scenarios such as daily environment and strong electromagnetic environment. The technical solution has strong commercial value and market competitiveness. Detailed Implementation Example 1: Smartphone interaction without permissions triggered by microbubbles

[0014] The permissionless sensing module uses ultrasonic sensing (working frequency 40kHz, transmission power -10dBm~0dBm), is installed in the built-in groove of the phone case, 10mm away from the phone screen, and obtains the position information of the phone screen interface controls through ultrasonic scanning, without establishing any connection with the phone system; The interface status information is transmitted to the external AI terminal via Bluetooth BLE 5.0 communication interface to generate operation guidance information for "clicking the WeChat icon" (operation coordinates x=200px, y=400px, operation type is single click), and is converted into a light signal with a wavelength of 630nm and a power of 2mW; The equivalent optical guiding carrier uses a temporary bonding optical patch (0.2mm thick, 93% transmittance). The light signal is oriented and focused to the target coordinates through the focusing structure of the patch, with a focusing accuracy of 0.3mm. In the microcavity array of the physical trigger module, the microcavity corresponding to the target coordinate receives the light signal, and the titanium nitride heat-absorbing layer (thickness 80nm) is rapidly heated to 100℃, causing the water in the cavity to vaporize and form microbubbles with a diameter of 2mm. The bubbles simulate the finger click pressure (80-120g), and the capacitive screen recognizes it as a valid operation; the microcavities at non-target coordinates remain stationary because there is no light signal focused. The equivalent anti-interference module adopts a frequency hopping scheme, dynamically switching the optical signal frequency between 5kHz and 8kHz with a switching period of 20ms, synchronized with the mobile phone touch detection period. Under normal ambient light interference, the bit error rate is ≤10⁻ 6 ; The microbubbles dissipate within 8ms through the heat dissipation channel at the bottom of the cavity, leaving no residue. The interaction is completed in a single step, with a click accuracy rate of 99.3%. Example 2: Vehicle-mounted permissionless interaction based on integrated cover structure

[0015] The unauthorized perception module adopts a low-frequency electromagnetic induction perception method (working frequency 500MHz, transmission power 0dBm~3dBm), is integrated into the frame of the vehicle's central control screen, and has no electrical connection with the central control screen system. It obtains the distribution information of interface controls through electromagnetic induction. The interface information is transmitted to the vehicle's local AI unit via a wired USB-C interface, generating an operation guide for "adjusting the air conditioning temperature to 24℃" (operation coordinates x=350px, y=500px, operation type is sliding), which is then converted into an optical signal with a wavelength of 850nm and a power of 3mW. The equivalent optical guiding carrier is an integrated micro-nano structure of the cover plate (a grating array is etched on the inner side of the central control screen cover glass with a period of 510nm, which matches the center wavelength of the 850nm optical signal). The optical signal is directionally focused to the position of the air conditioning temperature control via the grating array, with a focusing accuracy of 0.4mm. The physical trigger module adopts a photoinduced refractive index change mechanism. The integrated cover plate structure is doped with liquid crystal microspheres (3μm in diameter). After being irradiated by a light signal, the refractive index of the liquid crystal microspheres changes by 0.08, which triggers a change in the local electric field (intensity 5-8V / m). The capacitive screen recognizes this as a sliding operation and completes the temperature adjustment. The equivalent anti-interference module adopts a polarization coding scheme, with the optical signal polarization direction set to 90°. With the receiver equipped with a polarization filter, the signal recognition accuracy is ≥99.2% in the strong electromagnetic interference (60-77GHz) environment of vehicle radar. During the interaction process, the local temperature rise is ≤0.08℃, which does not affect the normal operation of the central control screen and meets the automotive-grade reliability requirements. Example 3: Permissionless Interaction in Industrial Control Based on Air Gap Optical Guide Channel

[0016] The unauthorized sensing module adopts a hybrid sensing method (ultrasound + low-frequency electromagnetic induction combination), and is installed on the external bracket of the industrial control touch screen at a distance of 15mm from the screen. It obtains interface status information through the complementary dual sensing methods, thereby improving the sensing stability in complex industrial environments. The interface information is transmitted to the cloud AI processing unit via a wireless Bluetooth interface to generate an operation guide for "starting the device running program" (operation coordinates x=400px, y=600px, operation type is long press), which is then converted into a light signal with a wavelength of 670nm and a power of 4mW. The equivalent optical guiding carrier is an air gap optical guide channel (a 1mm sealed air gap is formed by a bracket, and optical coupling layers with a refractive index of 1.55 are set at both ends). The optical signal is directionally focused to the target touch position through the air gap, with a transmission efficiency of 72% and a focusing accuracy of 0.5mm. The physical trigger module employs a combined mechanism of photothermal deformation and microbubble generation. The light signal first induces photothermal deformation (amplitude 20-30μm) to assist in microbubble positioning. Then, focused light generates microbubbles with a diameter of 1.5mm to enhance the touch signal, achieving a capacitive screen recognition accuracy of 99.1%. The equivalent anti-interference module adopts a phase-locking scheme, locking the optical signal trigger window within the 6-10ms interval of the industrial control screen touch detection cycle to avoid false triggering caused by industrial power frequency interference (50Hz); This solution has an IP65 protection rating and can withstand industrial oil and dust environments, and can operate continuously for 2000 hours without failure.

Claims

1. A method for implementing permissionless interaction via optical guidance, characterized in that, Includes the following steps: S1. Obtain the interface status information of the target device screen through an external non-permission sensing method, wherein the external non-permission sensing method is defined as "not reading the target device system data, not requesting system auxiliary function permissions, not accessing the system API interface, and not establishing any communication connection with the target device", specifically including at least one of ultrasonic sensing and low-frequency electromagnetic induction sensing (<1GHz), or any combination of two non-visual sensing methods; S2. Transmit the interface status information to an external AI processing unit, generate operation guidance information containing operation coordinates and operation type based on preset interaction logic, and convert the operation guidance information into a light signal with preset parameters; S3. The optical signal is directed and focused to the target touch position by an equivalent optical guiding carrier, wherein the equivalent optical guiding carrier includes any one of the following: an integrated micro-nano structure of the cover plate, a temporary adhesive optical patch, and an air gap optical guiding channel; S4. The optical signal acts on the physical triggering unit to induce a preset physical change at the target touch position. The physical change enables the capacitive screen to recognize the user operation and realize permissionless interaction. The physical change includes at least one of photothermal deformation, photoinduced deformation, local electric field change, photoinduced refractive index change, and microbubble generation. S5. The stability of optical signal transmission and physical triggering is ensured by an equivalent anti-interference scheme, wherein the equivalent anti-interference scheme includes at least one of frequency hopping, polarization coding, and phase locking.

2. The method according to claim 1, characterized in that, In step S3: The integrated micro / nano structure of the cover glass is realized by forming a grating array on the inner side of the cover glass of the target device screen through magnetron sputtering and nanoimprinting. The grating period is 0.6-1.0 times the center wavelength of the corresponding transmitted optical signal, forming an inseparable composite structure with the cover glass, and the light transmittance is ≥92%. The temporary bonding optical patch has a thickness of 0.1-0.3 mm, uses a re-adhesive optical adhesive layer, and has an anti-fingerprint coating on its surface. The air gap optical guide channel is implemented as follows: a 0.5-2mm sealed air gap is formed between the screen surface and the optical emission module through a support structure set by the screen bezel, and an optical coupling layer (refractive index 1.5-1.6) is set at both ends of the air gap, with an optical signal transmission efficiency ≥70%.

3. The method according to claim 1, characterized in that, In step S4, the specific implementation of microbubble generation is as follows: the physical triggering unit adopts a "optical addressing + microcavity array" design. The microcavity array is uniformly distributed at a density of 100-300 PPI. Each microcavity contains 5-10 μL of deionized water and a 50-100 nm thick titanium nitride heat-absorbing layer. The optical signal is focused onto the microcavity corresponding to the target coordinate through an optical guiding carrier. The heat-absorbing layer heats up at a rate of ≥5℃ / ms, causing the water to vaporize and form microbubbles with a diameter of 1-3 mm. No optical signal is focused on the microcavities at non-target coordinates, and no bubbles are generated. The bubbles exist for 5-10 ms and dissipate quickly through the heat dissipation channel without leaving any residue.

4. The method according to claim 1, characterized in that, In step S4, the photoinduced refractive index change is achieved by adding liquid crystal microbeads with a diameter of 1-5 μm to the optical guiding carrier. When the light signal is irradiated, the molecular arrangement direction of the liquid crystal microbeads changes, and the local refractive index change range is 0.05-0.1, which is adapted to the capacitive touch screen recognition threshold.

5. The method according to claim 1, characterized in that, In step S5: The frequency switching is implemented as follows: the optical signal frequency is dynamically switched within the range of 1kHz-10kHz, the switching period is synchronized with the touch detection period of the target device (20ms), and the switching step size is 1kHz. The polarization encoding is implemented by using linearly polarized light encoding, with the polarization direction set to four levels: 0° / 90° / 180° / 270°, and decoding with a polarization filter at the receiving end, achieving a crosstalk rate of ≤5%. The phase locking is implemented as follows: the optical signal trigger window is locked within a 5-10ms interval after the touch detection is completed, and the trigger decision is closed during non-window periods.

6. The method according to claim 1, characterized in that, All physical changes must meet the following parameters: click accuracy ≥ 99%, false touch rate ≤ 0.1%, single trigger energy ≤ 0.5mJ, local temperature rise ≤ 0.1℃, and no damage to the target device screen.

7. An equivalent implementation device for optical guide-type permissionless interaction, characterized in that, include: Unauthorized Perception Module: Used to obtain interface status information through at least one of ultrasonic sensing, low-frequency electromagnetic induction sensing (<1GHz), or any combination of two non-visual sensing methods; the module has no electrical connection with the target device, is independently powered, has a standby power consumption of ≤10μW, and an operating power consumption of ≤1mW; Communication interface: Used to establish a data connection with an external AI processing unit and receive operation guidance information. The communication methods include wired (USB-C) or wireless (Bluetooth BLE 5.0), and the data transmission rate is ≥1Mbps. Equivalent optical guidance module: used to direct and focus light signals to the target touch position, including any one of the following: integrated micro-nano structure of cover plate, temporary bonding optical patch, air gap light guide channel, light transmittance ≥85%, light signal focusing accuracy ≤0.5mm; Physical trigger module: Corresponding to the output of the equivalent optical guidance module, it includes at least one of the following: microcavity array structure (containing titanium nitride heat absorption layer, deionized water and heat dissipation channel), liquid crystal microbead doped layer, and photopolarized material layer, used to generate a preset physical change under the action of optical signal; Equivalent anti-interference module: integrated into the optical signal transmitter, including at least one of a frequency hopping unit, a polarization coding unit, and a phase-locked unit, with a bit error rate ≤10⁻ in strong electromagnetic environments. 6 .

8. The apparatus according to claim 7, characterized in that, In the microcavity array of the physical triggering module, the photothermal conversion efficiency of a single microcavity is ≥80%, and after 10,000 cycles of testing, the bubble generation success rate is ≥98%, and the deformation attenuation is ≤5%; the response time of the liquid crystal microbead doped layer is ≤10ms, and the recovery time is ≤5ms.

9. The apparatus according to claim 7, characterized in that, The frequency switching unit of the equivalent anti-interference module supports dynamic switching in the 1kHz-10kHz range, the polarization direction recognition accuracy of the polarization coding unit is ≥99.5%, and the timing synchronization error of the phase locking unit is ≤0.1ms.