Display module control method, display module control device and near-eye display device

Abstract

The present application provides a display module control method and control device and a near-eye display device. The display module control method comprises: monitoring the motion state of a display module on a lens to which the display module is currently connected; and when a target motion state is detected, controlling the display module to image a graphical interface of a target logic function on the lens, wherein the target motion state is preset to trigger a trigger condition for the target logic function. A user can control a display module to make a motion, capable of triggering a logic function to be triggered, on a lens to which the display module is connected, so as to trigger said logic function to start to operate, and then control the display module to image a graphical interface of the triggered logic function on the lens to which the display module is connected, so that the user can quickly interact with virtual information presented by the display module.

Description

Display module control method, display module control device, and near-eye display device

[0001] This application claims priority to the patent application number 2023115480693 filed with the China Patent Office on November 17, 2023, and entitled “Near-eye display module and device”; the patent application number 2023115809662 filed with the China Patent Office on November 22, 2023, and entitled “Optical module, near-eye display device and optical module processing method”; the patent application number 2023117335355 filed with the China Patent Office on December 15, 2023, and entitled “Control method of display module, near-eye display device, electronic device and medium”; the patent application number 2023118680668 filed with the China Patent Office on December 29, 2023 , the priority right of the patent application with the application name “Control method of display module, near-eye display device”; the priority right of the patent application with application number 2023118679567, filed with the China Patent Office on December 29, 2023, and the application name “Control method of display module and near-eye display device”; the priority right of the patent application with application number 2024201197317, filed with the China Patent Office on January 17, 2024, and the application name “Near-eye display device and charging box”; the priority right of the patent application with application number 2024105440675, filed with the China Patent Office on April 30, 2024, and the application name “Near-eye display device and control method, near-eye display system”; all of the above contents are incorporated into this application by reference. Technical Field

[0002] The present application belongs to the field of near-eye display technology, and more specifically, relates to a display module control method, a display module control device, and a near-eye display device. Background Art

[0003] Near-eye display refers to imaging at a shorter imaging distance from the eyes for sensory perception. For example, virtual reality (VR) glasses and augmented reality (AR) glasses both image at a shorter distance from the eyes. In other words, near-eye display is a relative concept, relative to traditional televisions, monitors, etc. Obviously, the imaging distance from the display panel of devices such as televisions and monitors to the eyes is usually much greater than the imaging distance of near-eye display devices such as VR glasses or AR glasses.

[0004] Currently, near-eye displays can generally be divided into VR, AR, mixed reality (MR) and extended reality (XR).

[0005] VR, also known as computer-simulated reality, is an experience created through human-computer interaction and computer-generated three-dimensional simulations. We interact with the environment using virtual reality equipment, such as headsets and controllers. In other words, VR is a computer simulation system that allows us to create and experience a virtual world. It uses computers to generate a simulated environment and immerse us in it.

[0006] AR is a real-time, direct or indirect observation of the physical world. It fuses what we see in the real world with digital content generated by computer software, enhancing our surroundings in some way. AR systems transmit virtual information in real time through a camera to headphones, smart glasses, or mobile devices, allowing us to view clear 3D images.

[0007] MR is the fusion of the real and virtual worlds to create new environments and visualizations. Physical and digital objects coexist and interact in real time. This means that if a new image is placed in real space, it will, to some extent, interact with real objects in our physical environment.

[0008] XR refers to the integration of all real and virtual environments, as well as human-computer interactions, generated by computing technology and wearable devices. XR integrates the world by digitally augmenting our senses. Furthermore, it provides a wide range of virtual sensory inputs for immersive virtual experiences. XR encompasses the three aforementioned emerging technologies: VR, AR, and MR.

[0009] Summary of the Invention

[0010] In the related art, users have a need to interact quickly with virtual information. The purpose of the embodiments of the present application is to provide a control method for a display module, an electronic device, a near-eye display device, a medium, a chip and a computer program product, so as to independently or semi-independently solve the technical problem that users cannot quickly interact with virtual information in near-eye display technology to a certain extent. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect that users can quickly interact with virtual information in near-eye display technology. The semi-independent solution refers to providing a hardware construction scheme that, when working in conjunction with a near-eye display, such as software for users to interact with virtual information, can achieve the effect that users can quickly interact with virtual information in near-eye display technology.

[0011] A first aspect of an embodiment of the present application provides a method for controlling a display module, wherein the display module is connected to an optical lens and configured to output image content, the method comprising:

[0012] Monitoring the motion state of the display module on the lens currently connected;

[0013] When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

[0014] A second aspect of an embodiment of the present application provides a control device for a display module, wherein the display module is connected to a lens of glasses and is used to form an image on the connected lens, the device comprising:

[0015] A first monitoring module is used to monitor the movement state of the display module on the lens to which it is currently connected;

[0016] The first execution module is used to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected; the target motion state is preset as a trigger condition for triggering the target logic function.

[0017] A third aspect of an embodiment of the present application provides a near-eye display device, comprising: a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, a method for controlling a display module is implemented, the method comprising:

[0018] Monitoring the motion state of the display module on the lens currently connected;

[0019] When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

[0020] In an embodiment of the present application, a display module used for augmented reality display imaging on the lenses of glasses can perform some movements on the lenses to which it is connected, rather than fixing the display module on the lenses. Furthermore, the motion states of some of the motions that the display module can perform are preset as trigger conditions for triggering some logical functions. When the motion state of the display module on the lenses to which it is connected is detected to meet the trigger conditions of a certain logical function, the display module is controlled to image a graphical interface of the triggered logical function on the lenses to which it is connected. Compared to the solution of fixing the display module on the lenses in the related art, the user can control the display module to perform a movement on the lenses to which it is connected that can trigger the desired logical function, thereby triggering the desired logical function to start running, and then controlling the display module to image a graphical interface of the triggered logical function on the lenses to which it is connected, allowing the user to quickly interact with the virtual information presented by the display module.

[0021] More relevant beneficial technical effects of this application will be described in the following embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the implementation. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0023] FIG1 is a schematic diagram of a connection between a display module and a lens provided in an embodiment of the present application;

[0024] 2-3 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

[0025] FIG4 is a schematic diagram of a connection relationship between a display module and a smart terminal provided in an embodiment of the present application;

[0026] FIG5 is a schematic diagram of a main imaging interface of a display module provided in an embodiment of the present application;

[0027] FIG6 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

[0028] 7-14 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

[0029] FIG15 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

[0030] FIG16 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

[0031] FIG17 is a schematic diagram of an application scenario of a display module provided in an embodiment of the present application;

[0032] FIG18 is a schematic structural diagram of a control device for a display module provided in an embodiment of the present application;

[0033] FIG19 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0034] FIG20 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0035] FIG21 is a schematic structural diagram of a near-eye display device provided in an embodiment of the present application;

[0036] 22-23 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

[0037] FIG24 is a schematic diagram of the steps of a method for controlling a display module according to an embodiment of the present application;

[0038] 25-30 are schematic diagrams of various application scenarios of a display module provided by an embodiment of the present application;

[0039] FIG31 is a schematic diagram of the steps of a method for controlling a display module according to an embodiment of the present application;

[0040] 32-33 are schematic diagrams of various application scenarios of a display module provided by an embodiment of the present application;

[0041] 34-39 are schematic diagrams of the steps of various control methods for a display module provided in an embodiment of the present application;

[0042] FIG40 is a schematic diagram of a main imaging interface of a display module provided in an embodiment of the present application;

[0043] FIG41 is a schematic diagram of the steps of a method for controlling a display module according to an embodiment of the present application;

[0044] 42-48 are schematic diagrams of different application scenarios of a display module provided by an embodiment of the present application;

[0045] Figure 49 is a schematic diagram of the structure of the glasses of the present application;

[0046] FIG50 is a schematic structural diagram of an example of a near-eye display module of the present application;

[0047] Figure 51 is an exploded view of Figure 50;

[0048] FIG52 is a structural diagram of an example of an assembled state of the first connecting portion and the mounting seat in FIG50;

[0049] Figure 53 is a top view of Figure 50;

[0050] FIG54 is a cross-sectional view taken along line AA in FIG53;

[0051] FIG55 is a schematic structural diagram of a first cover body in an example of the present application;

[0052] FIG56 is a schematic structural diagram of a second cover body in an example of the present application;

[0053] FIG57 is a schematic structural diagram of another example of a near-eye display module of the present application;

[0054] FIG58 is a partial exploded view of FIG57;

[0055] FIG59 is a schematic structural diagram of an example of the second connecting portion of the present application;

[0056] FIG60 is a schematic structural diagram of an optical module according to an embodiment of the present application;

[0057] FIG61 is a schematic structural diagram of another embodiment of an optical module provided in an embodiment of the present application;

[0058] FIG62 is a schematic diagram illustrating the profiles of relevant surfaces of an optical module according to an embodiment of the present application;

[0059] FIG63 is a schematic diagram of the three-dimensional structure of an optical module according to an embodiment of the present application;

[0060] FIG64 is a schematic diagram of the three-dimensional structure of another embodiment of the optical module provided in an embodiment of the present application;

[0061] FIG65 is a schematic diagram of the three-dimensional structure of another embodiment of the optical module provided in the embodiments of the present application;

[0062] FIG66 is a schematic diagram of the three-dimensional structure of another embodiment of the optical module provided in the embodiments of the present application;

[0063] FIG67 is a schematic structural diagram of an optical module with an optical path according to an embodiment of the present application;

[0064] FIG68 is a schematic structural diagram of yet another embodiment of an optical module provided in an embodiment of the present application;

[0065] FIG69 is a schematic structural diagram of another embodiment of an optical module with an optical path provided in an embodiment of the present application;

[0066] FIG70 is a schematic structural diagram of yet another embodiment of an optical module provided in an embodiment of the present application;

[0067] FIG71 is a schematic diagram of the three-dimensional structure of another embodiment of the optical module provided in the embodiments of the present application;

[0068] FIG72 is a schematic structural diagram of another embodiment of an optical module provided in an embodiment of the present application;

[0069] FIG73 is a schematic diagram of the structure of an optical module provided by an embodiment of the present application in an eyeball application scenario;

[0070] FIG74 is a schematic flow chart of an embodiment of an optical module processing method provided in an embodiment of the present application;

[0071] FIG75 is a schematic diagram of the overall structure of an embodiment of a near-eye display device of the present application;

[0072] FIG76 is a schematic diagram of the overall structure of an embodiment of a near-eye display device of the present application without temples;

[0073] FIG77 is a schematic diagram of the embodiment of FIG75 from another perspective;

[0074] FIG78 is a schematic diagram showing the overall structure of a plurality of display modules and first coils;

[0075] FIG79 is a schematic cross-sectional view of a structure of an embodiment of a display module provided with a coil support;

[0076] FIG80 is a schematic diagram of the display module provided with a second battery in the embodiment of FIG79;

[0077] FIG81 is a schematic diagram showing the disassembly of the structure of the display module in the embodiment of FIG79;

[0078] FIG82 is a schematic cross-sectional view of the structure of another embodiment of a display module;

[0079] FIG83 is a schematic diagram of the display module provided with a second battery in the embodiment of FIG82;

[0080] FIG84 is a schematic diagram showing the structure of the display module in the embodiment of FIG83;

[0081] Figure 85 is a schematic diagram of the overall structure of an embodiment of a charging box of the present application;

[0082] FIG86 is a schematic structural diagram of an embodiment of a near-eye display device provided by the present application;

[0083] FIG87 is a schematic diagram of the configuration structure of the movable area of ​​a lens according to an embodiment of the present application;

[0084] FIG88 is a schematic diagram of the configuration structure of the movable area of ​​another embodiment of the lens provided by the present application;

[0085] FIG89 is a schematic diagram of the configuration structure of the movable area of ​​another embodiment of the lens provided by the present application;

[0086] FIG90 is a schematic diagram of display content when a display assembly according to an embodiment of the present application is located in different movement zones;

[0087] FIG91 is a schematic block diagram of the structure of an embodiment of a display assembly provided by the present application;

[0088] FIG92 is a block diagram showing the structure of an output unit according to an embodiment of the present application;

[0089] FIG93 is a block diagram showing the structure of a sensing unit according to an embodiment of the present application;

[0090] FIG94 is a schematic diagram of the exploded structure of an embodiment of a display assembly provided by the present application;

[0091] FIG95 is a block diagram showing the structure of a terminal according to an embodiment of the present application;

[0092] FIG96 is a flowchart of an embodiment of a method for controlling a near-eye display device provided by the present application;

[0093] Figure 97 is a structural schematic diagram of an embodiment of the near-eye display system provided in this application. DETAILED DESCRIPTION

[0094] In order to make the technical problems, technical solutions and beneficial effects to be solved by this application more clearly understood, this application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0095] It should be noted that when an element is referred to as being “fixed on” or “disposed on” another element, it may be directly on the other element or indirectly on the other element. When an element is referred to as being “connected to” another element, it may be directly connected to the other element or indirectly connected to the other element.

[0096] It should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on this application.

[0097] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Therefore, features specified as "first" or "second" may explicitly or implicitly include one or more of those features. In the description of this application, "plurality" means two or more, unless otherwise specifically defined. The term "and / or" is used to describe an association between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A alone, A and B together, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects are in an "or" relationship. References to "one embodiment" or "some embodiments" in this application mean that the specific features, structures, or characteristics described in conjunction with that embodiment are included in one or more embodiments of the application. Therefore, phrases such as "one embodiment," "some embodiments," "another embodiment," or "some other embodiments" appearing in various places in this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "include", "comprising", "having" and variations thereof mean "including but not limited to", unless specifically emphasized otherwise.

[0098] The embodiments of the present application provide a control method, device, equipment, near-eye display device, storage medium, chip and computer program product for a display module, which can effectively solve the technical problem that users cannot quickly interact with virtual information in AR or near-eye display technology. The following is an explanation with reference to the accompanying drawings. In order to facilitate (correct) understanding of the embodiments of the present application, the technical terms that may be involved in the embodiments of the present application are defined and explained below. Unless otherwise specified in the following text, the semantics of the corresponding technical terms follow the definitions here:

[0099] Computers or computing devices refer to any electronic device based on Turing computability, the von Neumann architecture, or the Harvard architecture. For example, mobile phones, smart watches, and single-chip microcomputer systems are all computers, not just the narrow definition of computers in everyday life, such as personal computers (PCs).

[0100] Application: A computer program or application software, written in a programming language and designed to run on a computer system with a specific target architecture. A computer application is a sequence of coded instructions that can be executed by a computer or other information processing device to achieve a specific result, or a sequence of symbolic instructions or symbolic statements that can be automatically converted into a coded instruction sequence.

[0101] Logical functions: refers to various functions provided by various electronic devices such as near-eye display devices (with independent computing capabilities), computers or computing devices. These functions can be user-oriented functions or system (or device)-oriented functions. For example, user-oriented logical functions can be: Graphical User Interface (GUI) output function, audio output function, main interface or desktop, program / application, sub-functions in program / application, etc. Among them, the main interface or desktop, application, etc. can provide a GUI to the user for the user to interact with it. System-oriented logical functions can be: defragmentation of fragmented files, system error diagnosis, etc.

[0102] Running in the foreground and running in the background: Running in the foreground and running in the background are two relative concepts. Both are used to describe how an application / program or process runs in an operating system (generally speaking, an operating system refers to the software in a computer that enables applications to communicate with the computer's underlying hardware). The following uses a traditional computer as an example to explain running in the foreground and running in the background. In AR technology, the characteristics of running in the foreground and running in the background are similar to those of running in the foreground and running in the background on a traditional computer. In a traditional computer, when an application runs in the foreground, the application's GUI is usually displayed on the display screen, and the user can see the application's GUI or window. The user can interact or communicate with the application directly based on the GUI. At this time, the application usually occupies the input device (such as a mouse and keyboard); the application running in the foreground usually blocks the user interface, and the user needs to wait for the application running in the foreground to complete execution or interact according to the needs of the application running in the foreground; it is suitable for tasks that require real-time user feedback or user input. In traditional computers, when an application runs in the background, the GUI is usually not output on the display screen, that is, it is invisible to the user, and the user usually cannot directly interact or communicate with the application. When the application runs in the background, the user can continue to use the computer to perform other tasks, while the application runs silently in an invisible state to the user, such as processing files, executing system services, etc. Applications running in the background usually do not occupy input devices and do not require the user to directly participate in the execution of tasks. This allows users to continue other tasks while the application is running, improving the system's multitasking capabilities.

[0103] Display module: refers to a display component, display device or display equipment based on optical imaging technology. Therefore, the display module is a physical hardware module. In some optional embodiments, the display module can be connected to the lens and powered on for imaging through the display module. The lens can be, for example, common sunglasses in daily life, glasses for vision correction, goggles or masks with lenses, etc., or lenses of smart glasses with audio, sensing, etc. The display module can be connected to the lens by means of magnetism, clips or other adsorption, so that the display module can move freely on the lens to which it is connected or move in a specified setting area. For example, the display module can move in a straight line or curve, rotate on an axis, etc. on the lens on which it is placed.

[0104] In the related art, users have a need to interact quickly with virtual information. The purpose of the embodiments of the present application is to provide a control method for a display module, an electronic device, a near-eye display device, a medium, a chip and a computer program product, so as to independently or semi-independently solve the technical problem that users cannot quickly interact with virtual information in near-eye display technology to a certain extent. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect that users can quickly interact with virtual information in near-eye display technology. The semi-independent solution refers to providing a hardware construction scheme that can achieve the effect that users can quickly interact with virtual information in near-eye display technology when working in conjunction with near-eye display, such as software for users to interact with virtual information in AR technology.

[0105] For example, as shown in Figure 1, Figure 1 is a schematic diagram of the connection between a display module and a lens provided in an embodiment of the present application. Referring to Figure 1, the lens of glasses is used as an example for illustration, but the present application is not limited to glasses. The lenses may also be lenses used on head-mounted devices such as helmets, eye protection, vision correction, and sports equipment. The glasses 1 may be ordinary glasses, AR glasses, smart glasses, and the like. The glasses 1 include a frame 11, a lens 12 embedded in the frame 11, and temples 13 movably connected to the frame 11. The lens 12 includes an environment side 24 and a glasses side 22. The user's eyes can see the physical environment on the environment side through the lens 12 from the eye side. Optionally, the display module 2 is provided with a first magnetic component at the end of the lens 12 facing the environment side 24, and the display module 2 is provided with a second magnetic component at the end of the lens 12 facing the eye side 22. It can be understood that two mutually attracted magnetic components are provided on both sides of the lens 12 to realize pre-fixation of the display module on the lens, wherein the first magnetic component and the second magnetic component can be magnets that attract each other, of course, one of them can be a magnet and the other can be a metal that can be attracted by a magnet, etc., so that the display module 2 is adsorbed on the lens 12 as a whole. At this time, the display module 2 can also slide freely on the lens 12 or rotate on the axis without detaching from the lens 12. Of course, other solutions such as adsorption and movement are also feasible here.

[0106] For example, as shown in Figures 2 and 3, Figures 2 and 3 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. Figure 3 can be a front view of the glasses 1 observed from the direction of the temples 13 of the glasses 1 (i.e., the side of the glasses). Please refer to Figures 1, 2, and 3 in combination. The direction indicated by the straight arrow a in Figure 1 is the direction from which the eye observes the virtual image formed by the display module 2 on the lens 12. When the user observes the end face of the display module 2 from the direction indicated by arrow a, they can see the virtual image or graphical interface formed on the lens 12 based on AR technology. That is, the end face of the display module 2 seen from the direction of arrow a shown in Figure 1 is the display area 21 of the display module 2. When the display module 2 is in operation, the display area 21 can be in a "lit" state, that is, it can form image content, for example, it can include text, interactive interface, video, image, and other related display content. The area on the lens 12 not occupied by the display module still retains the properties of the lens 12 itself, for example, the user can see the environment through the lens 12 through the eye side, such as eye protection, vision correction, etc., which are the properties of the lens itself.

[0107] In some optional embodiments, the center of the lens 12 is a calibration position, which serves as a reference position for the display module 2. When the display module 2 is stationary at this calibration position, the main interface or a preset logical function interface is imaged on the lens 12. The center of the lens 12 is determined as the calibration position because the display module 2 can be moved in a variety of circumferential directions and distances from the center, making it easier for users to operate the display module 2 and customize the preset imaging area.

[0108] After wearing the glasses 1, the user can press (or pinch) the touch portion of the display module 2 to drag the display module 2 on the lens 12 or rotate the display module 2 to rotate the display module 2 on its axis. In some embodiments, the display module 2 can be located on the environment side, and light from the display area 21 can pass through the lens to the user's eye on the eye side to form an image. In this case, the touch portion can be located on the environment side, allowing the user to interact more effectively. In other embodiments, the display module 2 can be located on the glasses side. In this case, light from the display area 21 can directly enter the user's eye to form an image. In this case, the touch portion can be located on the eye side, allowing the user to interact more discreetly.

[0109] FIG22 is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application. Referring to FIG22 , the touch portion of display module 2 is located on ambient side 24 . A user can press (or pinch) the touch portion of display module 2 to drag display module 2 on lens 12 or rotate display module 2 to rotate the display module 2 about its axis.

[0110] In some optional embodiments, the virtual image or graphical interface imaged by the display area 21 of the display module 2 on the lens 12 may originate from the display module 2 itself, or from the glasses 1 communicatively connected to the display module 2. Alternatively, in other embodiments, the virtual image or graphical interface may originate from another electronic device relatively independent of both the glasses 1 and the display module 2, such as a mobile phone, tablet computer, or other smart terminal or computer. If the glasses 1 are conventional glasses, the virtual image or graphical interface imaged by the display module 2 on the lens 12 may originate from another electronic device relatively independent of both the glasses 1 and the display module 2, such as a mobile phone, tablet computer, or other smart terminal or computer.

[0111] For example, as shown in FIG4 , FIG4 is a schematic diagram of a connection relationship between a display module and a smart terminal provided in an embodiment of the present application. Referring to FIG4 , the display module 2 is (physically) connected to a near-eye display device 10, which may be the aforementioned glasses 1, and the smart terminal 4 may be a PC, laptop, smart phone, tablet computer, smart speaker, server, etc. A wired or wireless communication connection is established between the display module 2 and the smart terminal 4. For example, the display module 2 and the smart terminal 4 communicate based on the Wifi protocol or the BlueTooth protocol; or, the display module 2 and the smart terminal 4 communicate based on the USB transmission protocol with the aid of a USB cable, and the display module 2 also obtains power from the smart terminal 4 with the aid of a USB cable. Of course, it is not limited to the aforementioned example. The display module 2 and the smart terminal 4 may also establish a wired or wireless communication connection based on other communication protocols, such as the NFC communication protocol, a P2P (point-to-point) network, and the like. The display module 2 and the near-eye display device 10 together constitute the “display device” of the smart terminal 4 . The GUI output by the smart terminal 4 is imaged on the near-eye display device 10 through the display module 2 .

[0112] In some optional embodiments, a touch sensor or a pressure or capacitance sensor may be provided on the touch portion of the display module 2 to detect whether the touch portion of the display module 2 is touched. In some optional embodiments, a micro camera is also provided on the touch portion of the display module 2 to collect image / video data from the environment. In some optional embodiments, a micro microphone is also provided on the touch portion of the display module 2 to collect ambient sound from the environment. In some optional embodiments, a micro camera is also provided on one side of the display area 21 of the display module 2 to collect eye images of the user wearing the glasses 1 in order to track the user's eyeballs.

[0113] Trigger condition: refers to the condition preset in advance for triggering the operation or execution of a logical function. In some optional implementations of the embodiments of the present application, certain motion states of the display module are preset as trigger conditions for certain logical functions. For example, the display module is preset to be stationary at a set position on the lens to which it is connected as a trigger output main interface function. Then, when the display module is subsequently monitored to be stationary at the set position, the display module will image the main interface on the lens to which it is connected, and the user can observe the main interface imaged on the lens by observing the display area of ​​the display module. Optionally, there can be at least one icon (thumbnail) of an application (or file) in the main interface. The set position can be the center of the lens, and of course it can also be a position that is easier to remember and identify, such as the four corners of the frame.

[0114] Preset imaging area: refers to the imaging area pre-set for the display module on the lens to which the display module is connected. In some optional embodiments, the preset imaging area can be a regular area on the lens to which the display module is connected, such as a rectangular area, a circular area, or an elliptical area. In some optional embodiments, the preset imaging area can also be an irregular area on the lens to which the display module is connected. In some optional embodiments, the preset imaging area can also be the entire lens area of ​​the lens to which the display module is connected.

[0115] For example, as shown in FIG5 , FIG5 is a schematic diagram of a display module imaging main interface provided by an embodiment of the present application. Referring to FIG5 , after the user puts on the glasses 1, he or she observes the lens 12 from the side of the temple 13 (please refer to FIG1 and FIG2 ) (i.e., the glasses side). The user can observe the display area 21 of the display module 2, thereby observing the main interface imaged by the display module 2 on the lens 12. That is, in the example of FIG5 , when the display module 2 is stationary at the illustrated position on the lens 12 (this position is not limited to the position shown in FIG5 , and the user can set the display module 2 to be stationary at any position on the lens 12 to trigger the logical function of outputting the main interface), the logical function of outputting the main interface is triggered. In the example of Figure 5, the preset imaging area 121 is the entire lens area of ​​the lens 12. The preset imaging area 121 is divided into multiple sub-areas (for example, the 6 sub-areas shown in Figure 5). In each sub-area, an icon (thumbnail) of the application or file mapped to the sub-area is imaged. For example, the icon of application F is imaged in sub-area 1211, and the icon of application E is imaged in sub-area 1212. In Figure 5, a total of six sub-areas are shown in which icons of application AI are imaged. In some other optional embodiments, at least one of the icons AI can be a file icon (thumbnail) such as video, picture, audio, text, etc. In some optional embodiments, when the display module 2 is first connected to the lens 12 and the display module 2 is turned on, the display module 2 defaults to imaging the main interface on the lens 12.

[0116] It should be noted that in FIG. 5 , in order to facilitate explanation of the division of the main interface into multiple sub-areas, grid lines (i.e., the dotted grid on the lens 12) are schematically shown to indicate each sub-area. However, these grid lines should not be interpreted as necessarily requiring the main interface imaged by the display module 2 provided in the embodiment of the present application to have grid lines. Obviously, these grid lines are not required, that is, the imaged main interface can be absent. In other words, after the display module 2 is placed on the lens 12, the grid lines cannot be seen on the lens 12 itself, and the lens 12 still retains its own properties. Of course, if the lens itself uses a holographic lens, such as an optical waveguide, they can be combined to provide a simple prompt, etc. Of course, a setting option can also be provided for the user to choose whether to also image the grid lines when imaging the main interface. If the user sets the grid lines to be imaged when imaging the main interface, the display module will image the grid lines when imaging the main interface. If the user sets the grid lines not to be imaged when imaging the main interface, the display module will not image the grid lines when imaging the main interface. Of course, the grid lines can also correspond to a graphical interface on a smart terminal (such as a mobile phone app), allowing users to use the terminal's graphical interface to divide or customize the grid lines of the preset imaging area 121. In addition, the line type of the grid lines is not limited to the dotted lines shown in Figure 5, and can also be solid lines, center lines, etc.

[0117] An embodiment of the present application provides a method for controlling a display module, which is used to be connected to the lenses of glasses and to form an image on the connected lenses. The method for controlling the display module may be performed by at least one of the glasses 1, display module 2, near-eye display device 10 or smart terminal in Figures 1 to 5, which can realize the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 6, Figure 6 is a schematic diagram of the step flow of the method for controlling the display module provided by the embodiment of the present application. Referring to Figure 6, the method for controlling the display module includes:

[0118] S11, monitoring the movement state of the display module on the currently connected lens;

[0119] The lens is the lens on the glasses to which the display module is currently connected, which may be as described in the above embodiment and will not be described again here.

[0120] In some optional embodiments, an inertial sensor or an acceleration sensor (or a gyroscope) is built into the display module. Such a sensor can collect the instantaneous velocity and acceleration of the display module, thereby determining the motion state of the display module based on the collected instantaneous velocity and acceleration and combined with parameters such as time.

[0121] S12, when a target motion state is detected, controlling the display module to image a graphic interface of a target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

[0122] The target logical function may be at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by the device or system.

[0123] For example, the target logical function may be a function of outputting a main interface, a function of outputting a chat interface of a social application, a function of outputting a search interface of a browser, and the like.

[0124] In the embodiment of the present application, the motion state of the display module on the lens can be roughly divided into the following two categories: 1. The display module is relatively stationary on the lens; 2. The display module is in relative motion on the lens. Among them, the display module in relative motion on the lens can be roughly divided into two categories: the display module can move on the lens (movement refers to movement from one point on the lens to another point) or rotate (around its own central axis - in the example shown in Figure 1, the axis coincident with arrow a). The target motion state can be a motion state that can trigger the target logical function that is determined in advance from various possible motion states of the display module. In other embodiments, the motion can also include multi-segment motion, that is, a combination of multiple straight lines on the lens, or "pattern-like" motion, such as trajectory-like motion in the shape of broken line segments, letters L, Z, etc.

[0125] In some optional embodiments, when the motion state of the display module is determined to be the target motion state based on the collected instantaneous velocity and acceleration and combined with parameters such as time, the target logic function whose trigger condition is the target motion state will be triggered. After the target logic function is triggered, it will start to run or execute (if the triggered target logic function is an application that is already running in the background, the target logic function will be switched to the foreground to run). When the target logic function is executed or running, it will correspondingly control the display module to image the graphical interface of the target logic function on the lens.

[0126] For example, taking the embodiment shown in Figures 1 to 3 as an example, the target motion state can be the display module 2 performing linear motion on the lens 12, the display module 2 remaining stationary at a set position on the lens 12 (the set position is a pre-selected fixed position), or the display module 2 moving along a diagonal line of the lens 12 (assuming the lens has four corners, the line connecting any two non-adjacent corners is the diagonal line), etc. At the same time, the display module 2 performing linear motion on the lens 12 is preset as a trigger condition for outputting the chat interface of a social application, the display module 2 remaining stationary at a set position on the lens 12 is preset as a trigger condition for outputting the main interface function, and the display module 2 moving along a diagonal line of the lens 12 is preset as a trigger condition for outputting the browser's search interface.

[0127] For example, when it is detected that the display module 2 moves in a straight line on the lens 12, the display module 2 is controlled to image a chat interface of a social application on the lens 12; when it is detected that the display module 2 is stationary at a set position on the lens 12, the set position may be a well-recognized position such as the center of the lens, or a position defined by the user according to his or her preferences, the display module 2 is controlled to image a main interface on the lens 12 at the set position (please refer to Figure 5 and related implementation instructions); when it is detected that the display module 2 moves diagonally on the lens 12, the display module 2 is controlled to image a search interface of a browser on the lens 12.

[0128] In an embodiment of the present application, a display module used for augmented reality display imaging on the lenses of glasses can perform some movements on the lenses to which it is connected, rather than fixing the display module on the lenses. Furthermore, the motion states of some of the motions that the display module can perform are preset as trigger conditions for triggering some logical functions. When the motion state of the display module on the lenses to which it is connected is detected to meet the trigger conditions of a certain logical function, the display module is controlled to image a graphical interface of the triggered logical function on the lenses to which it is connected. Compared to the solution of fixing the display module on the lenses in the related art, the user can control the display module to perform a movement on the lenses to which it is connected that can trigger the desired logical function, thereby triggering the desired logical function to start running, and then controlling the display module to image a graphical interface of the triggered logical function on the lenses to which it is connected, allowing the user to quickly interact with the virtual information presented by the display module.

[0129] In some optional embodiments, the target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logical function includes: a first logical function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logical function; step S12 includes:

[0130] When it is detected that the movement of the display module on the lens satisfies a first preset condition, the display module is controlled to form an image of a first graphic interface of the first logical function on the lens.

[0131] In some optional embodiments, detecting movement of the display module may be detecting a process in which the instantaneous speed of the display module suddenly changes from 0 to a value not equal to 0 and then returns to 0 (referred to as a first process, and the first process described hereinafter refers to the process in which the instantaneous speed of the display module suddenly changes from 0 to a value not equal to 0 and then returns to 0). If the detected sudden change in instantaneous speed satisfies a first preset condition, the display module is controlled to image a first graphical interface of the first logical function on the lens.

[0132] In some optional implementations, the first logical function may generally refer to at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by a device or system.

[0133] Exemplarily, the first logical function may be outputting a main interface, phone dialing, smart assistant, music player, video player, camera, photo album, social application, etc.

[0134] In some optional implementations, the first preset condition may be any one or a combination of the following six conditions ① to ⑥:

[0135] Condition ①: The displacement distance ΔS of the movement is not less than a preset first threshold length S_1;

[0136] The displacements described in the embodiments of this application all follow the definition in physics. Specifically, displacement refers to the movement of an object from an initial position to a final position over a period of time. A directed line segment from the initial position to the final position is the displacement. The length of the directed line segment is the displacement distance, and the direction of the directed line segment is the displacement direction.

[0137] In some optional implementations, when it is detected that ΔS≧S_1 of the display module in the first process, the display module is controlled to image a first graphic interface of the first logical function on the lens.

[0138] Exemplarily, the first logical function is a telephone dialing function. As shown in FIG7 , FIG7 is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application. Referring to FIG7 , upon detecting that the display module 2 undergoes a first process on the lens 12 , and ΔS of the display module 2 during the first process is ≥ S_1 , the telephone dialing function is triggered, and the display module 2 is controlled to image a dialing interface for the telephone dialing function on the lens 12 .

[0139] Condition ②: The displacement distance ΔS of the movement is not less than the preset first threshold length S_1, and the displacement direction of the movement is Preset first direction

[0140] In some optional embodiments, when the ΔS of the display module is monitored to be ≥ S_1 in the first process, and the display module in the first process is If the directions are the same, the display module is controlled to form a first graphic interface of the first logic function on the lens.

[0141] For example, the first logic function is an intelligent assistant function. Referring to FIG7 , after detecting that the display module 2 has a first process on the lens 12 , and in the first process ΔS of the display module 2 ≥ S_1 and the display module 2 If the directions are the same, the smart assistant function is triggered, and the display module 2 is controlled to image the (voice or text) instruction acquisition interface of the smart assistant function on the lens 12.

[0142] Condition ③: the displacement distance ΔS of the movement is not less than a preset first threshold length S_1, and the starting point (SP) of the movement is a preset first position (P1), and the first position (P1) is a fixed position selected on the lens;

[0143] In some optional embodiments, when it is monitored that ΔS ≥ S_1 of the display module in the first process, and at time point t when the instantaneous speed of the display module is monitored to suddenly change from 0 to not 0 in the first process, the display module is at position P1, that is, the starting point SP of the movement of the display module in the first process is the position P1 pre-selected on the lens, then the display module is controlled to image the first graphical interface of the first logical function on the lens.

[0144] For example, the first logical function is a music player function. Referring to FIG. 7 , upon detecting that the display module 2 is performing a first process on the lens 12 and that the starting point SP of the movement of the display module 2 during the first process is a pre-selected position P1 on the lens 12 (e.g., P1 is the center point on the lens 12), the music player function is triggered, and the display module 2 is controlled to image a song playback interface of the music player function on the lens 12.

[0145] Condition ④: The displacement distance ΔS of the movement is not less than the preset first threshold length S1, and the displacement direction of the movement is Preset first direction and the starting point (SP) of said movement is said first position;

[0146] In some optional embodiments, when the ΔS of the display module is monitored to be ≥ S_1 in the first process, and the display module in the first process is The direction is the same, and at the time point t when the instantaneous speed of the display module is monitored to suddenly change from 0 to non-zero in the first process, the display module is at the position P1, that is, the starting point SP of the movement of the display module in the first process is the position P1 selected in advance on the lens, then the display module is controlled to image the first graphical interface of the first logic function on the lens.

[0147] For example, the first logic function is a video player function. Please refer to FIG7 , after monitoring the display module 2 on the lens 12, the first process occurs, and the display module 2 in the first process The direction is the same, and the starting point SP of the movement of the display module 2 in the first process is a position P1 pre-selected on the lens 12 (for example, P1 is the center point on the lens 12), then the music player function is triggered, and the display module 2 is controlled to image the video playback interface of the video player function on the lens 12.

[0148] Condition ⑤: the end point (EP) of the movement is a preset second position (P2), and the second position (P2) is a fixed position selected on the lens;

[0149] In some optional embodiments, during the first process, when the instantaneous speed of the display module is monitored to suddenly change from 0 to non-zero and then suddenly return to 0 at time t, the display module is at position P2, i.e., the end point EP of the display module's movement during the first process is a pre-selected position P2 on the lens. The display module is then controlled to image a first graphical interface of the first logic function on the lens. In other words, no matter how the display module moves on the lens, as long as the display module moves to a pre-selected position P2 on the lens, the first logic function is triggered.

[0150] Exemplarily, the first logical function is a camera function. As shown in FIG8 , FIG8 is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application. Referring to FIG8 , upon detecting that the display module 2 has undergone a first process on the lens 12 , and the end point EP of the display module 2 during the first process is at the upper boundary of the lens 12 (or the preset imaging area), the camera function is triggered, and the display module 2 is controlled to image a camera function interface on the lens 12 .

[0151] Exemplarily, the first logical function is an album function. As shown in FIG9 , FIG9 is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application. Referring to FIG9 , upon detecting that the display module 2 has undergone a first process on the lens 12 , and the end point EP of the display module 2 during the first process is at the lower boundary of the lens 12 (or the preset imaging area), the album function is triggered, and the display module 2 is controlled to image an album functional interface on the lens 12 .

[0152] Exemplarily, the first logical function is a social application function. As shown in FIG10 , FIG10 is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application. Referring to FIG10 , upon detecting that the display module 2 undergoes a first process on the lens 12 , and the end point EP of the display module 2 during the first process is at the left edge of the lens 12 (or the preset imaging area), the social application function is triggered, and the display module 2 is controlled to image the functional interface of the social application on the lens 12 .

[0153] Exemplarily, the first logical function is a navigation function. As shown in FIG11 , FIG11 is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application. Referring to FIG11 , upon detecting that the display module 2 undergoes a first process on the lens 12 , and the end point EP of the display module 2 during the first process is at the right edge of the lens 12 (or the preset imaging area), the navigation function is triggered, and the display module 2 is controlled to image the navigation function interface on the lens 12 .

[0154] For example, the first logic function is to output the main interface. Upon detecting that the display module 2 has undergone a first process on the lens 12, and that the end point EP of the display module 2 during the first process is at the center of the lens 12 (or the predetermined imaging area), the output main interface function is triggered, and the display module 2 is controlled to image the output main interface on the lens 12.

[0155] Condition ⑥: The shape similarity (Sim) between the moving trajectory l and the preset trajectory l_1 is not less than a preset first threshold α.

[0156] In some optional embodiments, if it is monitored in the first process that the shape similarity Sim between the moving trajectory l and the preset trajectory l_1 is not less than a preset first threshold α, the display module is controlled to image a first graphical interface of the first logical function on the lens.

[0157] For example, as shown in FIG12 , which is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application, when a first process is detected in which the display module 2 is moved on the lens 12 and the shape similarity Sim between the trajectory l and the preset trajectory l_1 during the first process is not less than a preset first threshold α, a first logic function is triggered, and the display module 2 is controlled to image a functional interface of the first logic function on the lens 12.

[0158] Among them, the shape similarity Sim between the trajectory l and the preset trajectory l_1 can be calculated by methods such as Euclidean distance, dynamic time warping, cosine similarity, Pearson correlation coefficient, Manhattan distance, dynamic kernel correlation, and mean absolute error.

[0159] In some optional implementations, different first preset conditions may correspond to the same first logical function, or may correspond to different first logical functions.

[0160] For example, still taking the scenarios shown in Figures 1 to 3 as an example, the movement of the display module 2 on the lens 12 that satisfies the above conditions ① to ⑥ can be preset as trigger conditions for different logical functions (as described in the above examples). Alternatively, the movement of the display module 2 on the lens 12 that satisfies at least two of the above conditions ① to ⑥ can be preset as trigger conditions for the same logical function. For example, the movement of the display module 2 on the lens 12 that satisfies the above condition ① can be preset as a trigger condition for the phone dialing function, and the movement of the display module 2 on the lens 12 that satisfies the above condition ⑥ can be preset as a trigger condition for the camera function; the movement of the display module 2 on the lens 12 that satisfies the above condition ① can be preset as a trigger condition for the phone dialing function, and the movement of the display module 2 on the lens 12 that satisfies the above condition ⑥ can be preset as a trigger condition for the phone dialing function.

[0161] It should be noted that in the embodiment of the present application, the first preset condition is not limited to the six items listed above. Those skilled in the art can flexibly set the first preset condition according to actual needs. For example, the first preset condition can also be that the display module moves along a preset trajectory on the lens. Specifically, the first preset condition can be that the aforementioned display module moves along the diagonal of the lens.

[0162] In some optional embodiments, the target motion state includes: the display module being stationary at a third position on the lens, the third position being a fixed position selected on the lens; the target logical function includes: a second logical function; the display module being stationary at the third position on the lens is preset as a trigger condition for triggering the second logical function; step S12 includes:

[0163] In a case where it is detected that the display module is stationary at a third position on the lens, the display module is controlled to form an image of a second graphic interface of the second logical function on the lens.

[0164] In some optional implementations, the second logical function may generally refer to at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by the device or system. The second logical function may be different from or the same as the first logical function.

[0165] Exemplarily, the second logical function may be outputting a main interface, phone dialing, smart assistant, music player, video player, camera, photo album, social application, etc.

[0166] The third position may be the same as or different from the second position.

[0167] Exemplarily, the third position is a center point on the lens, an upper boundary point of the lens (or a preset imaging area), a lower boundary point of the lens (or a preset imaging area), and the like.

[0168] For example, still taking Figures 1 to 12 of the aforementioned example as an example, when it is monitored that the display module 2 is stationary at the center point on the lens 12, the display module 2 is controlled to image the main interface on the lens 12; when it is monitored that the display module 2 is stationary at the upper boundary point on the lens 12, the display module 2 is controlled to image the functional interface of the navigation application on the lens 12.

[0169] In some optional embodiments, the target motion state includes: the display module performing axial rotation; the target logical function includes: a third logical function, and the third logical function is the logical function currently running in the foreground; step S12 includes:

[0170] When the display module is detected to be performing axial rotation, the display module is controlled to update the target area in the third graphic interface currently imaged on the lens; the third graphic interface is the graphic interface of the third logical function, and the target area is the graphic area corresponding to the sub-function in the third logical function; the axial rotation of the display module is preset as a trigger condition for triggering the sub-function in the third logical function.

[0171] In some optional implementations, the third logical function may generally refer to at least one logical function running in the foreground from among all (user-oriented and system-oriented) logical functions provided by the device or system.

[0172] Exemplarily, the third logical function may be outputting a main interface, phone dialing, smart assistant, music player, video player, camera, photo album, social application, and the like.

[0173] In some optional implementations, the sub-function in the third logical function may be a page turning function, a scrolling (forward / backward) operation, etc. in the logical function currently running in the foreground.

[0174] For example, as shown in Figures 13 and 14, Figures 13 and 14 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. For example, if the third logical function is to output the main interface function, the display module 2 can be preset to rotate along the counterclockwise axis shown in Figure 13 as a trigger condition for triggering the main interface to turn up (or down) the page, and the display module 2 can be preset to rotate along the clockwise axis shown in Figure 14 as a trigger condition for triggering the main interface to turn down (or up) the page. When it is detected that the display module 2 is rotating counterclockwise (or clockwise), the display module 2 is controlled to update the main interface currently imaged on the lens 12, that is, the display module 2 is controlled to image the previous page (or next page) of the main interface on the lens 12.

[0175] For another example, if the third logical function is a music player function, the counterclockwise rotation of the display module 2 as shown in FIG13 can be preset as a trigger condition for switching to the previous song (or the next song), and the clockwise rotation of the display module 2 as shown in FIG14 can be preset as a trigger condition for switching to the next song (or the previous song). When the counterclockwise (or clockwise) rotation of the display module 2 is detected, the song currently being played is switched, and the display module 2 is controlled to update the music player interface currently imaged on the lens 12, that is, the display module 2 is controlled to update the song information in the music player interface imaged on the lens 12 to the information of the previous song (or the next song).

[0176] In some optional embodiments, when the display module is detected to be rotating about its axis, controlling the display module to update a target area in a third graphical interface currently imaged on the lens includes:

[0177] When it is detected that the display module rotates at an angle not less than a preset first threshold angle β, the display module is controlled to update a target area in a third graphic interface currently imaged on the lens.

[0178] The first threshold angle β can be flexibly set by those skilled in the art or users according to actual needs, for example, it can be 15°, 20°, 25° or 30°.

[0179] For example, referring to FIG. 14 , upon detecting that the display module 2 has rotated clockwise by an angle no less than a first threshold angle β, the display module 2 is controlled to update the target area of ​​the third graphical interface currently imaged on the lens 12. This prevents the sub-functions of the third logic function from being triggered when the display module 2 is slightly rotated, causing the display module 2 to begin updating the third interface imaged on the lens 12. Consequently, the possibility of erroneous triggering of the sub-functions of the third logic function can be reduced to a certain extent.

[0180] In other optional implementations, the third logic function can also be a background logic function. For example, if the imaging module in the display module is in standby mode, but the music playback function is still running in the background, the display module's axis rotation can still be preset as a trigger condition for the song switching operation, allowing the user to quickly switch songs, that is, facilitating quick user interaction with the device. However, in this case, there is no need to control the display module to update the graphical interface (because the logic function is running in the background and no graphical interface is output).

[0181] An embodiment of the present application provides a method for controlling a display module, which is used to be connected to the lenses of glasses and to form an image on the connected lenses. The control method of the display module may be performed by at least one of the glasses 1, display module 2, near-eye display device 10 or smart terminal in Figures 1 to 5, which can realize the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 15, Figure 15 is a schematic diagram of the step flow of the control method of the display module provided by the embodiment of the present application. Referring to Figure 15, the control method of the display module includes:

[0182] S11, monitoring the movement state of the display module on the currently connected lens;

[0183] Please refer to the description of S11 in the previous article and will not repeat it here.

[0184] S13, detecting contact of a touch portion of the display module;

[0185] For step S13 , please refer to the above description of the display module 2 in the embodiments of FIG. 1 to FIG. 3 , which will not be repeated here.

[0186] It should be noted that there is no sequential relationship between S11 and S13, that is, S11 and S13 can be executed in parallel.

[0187] S14 , when it is detected that the touch portion is touched for a duration ΔT that is not less than a preset first threshold duration T_1 and a target motion state is detected, controlling the display module to image a graphic interface of the target logical function on the lens.

[0188] Comparing step S14 with step S12, in step S14, the conditions for triggering the target logic function and thus controlling the display module to image the target logic function's graphical interface on the lens are expanded. Not only must the display module's motion state be detected as the target motion state, but the touch portion of the display module must also be detected to be touched for a duration ΔT that is not less than a preset first threshold duration T_1. In other words, the target logic function is triggered only when the display module is not detected to have moved on the lens, but also when the display module is touched. This can avoid the possibility of false triggering in certain scenarios. For example, in Figure 2, if the user is wearing glasses 1 while exercising, the display module 2 may experience jitter with the user's movement, which may be consistent with the target motion state. However, if the user is not detected touching the touch portion of the display module, or if a touch is detected but the duration ΔT is less than the preset first threshold duration T_1, the target logic function will not be triggered, and the display module will not be controlled to image the target logic function's graphical interface on the lens. This effectively avoids false triggering.

[0189] An embodiment of the present application provides a method for controlling a display module, which is used to be connected to the lenses of glasses and to form an image on the connected lenses. The method for controlling the display module may be performed by at least one of the glasses 1, display module 2, near-eye display device 10 or smart terminal in Figures 1 to 5, which can realize the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 16, Figure 16 is a schematic diagram of the step flow of the method for controlling the display module provided by an embodiment of the present application. Referring to Figure 16, the method for controlling the display module includes:

[0190] S11, monitoring the movement state of the display module on the currently connected lens;

[0191] S13, detecting contact of a touch portion of the display module;

[0192] S14, controlling the display module to image a graphical interface of the target logical function on the lens when it is detected that the touch portion is touched for a duration ΔT that is not less than a preset first threshold duration T_1 and a target motion state is detected;

[0193] Please refer to the above description for steps S11-S14, which will not be repeated here.

[0194] S15, when it is detected that the touch portion is touched for a duration ΔT that is not less than a preset second threshold duration T_2 and it is monitored that the display module is always stationary on the lens, or when it is not detected that the touch portion is touched for a duration that is not less than a third threshold duration T_3, the anti-false touch mode is started.

[0195] The anti-mistouch mode refers to a mode in which the display module is controlled to maintain imaging on the lens a graphical interface of a logic function currently running in the foreground.

[0196] When it is detected that the touch portion is touched for a duration ΔT that is not less than a preset second threshold duration T_2 and it is monitored that the display module is always stationary on the lens, the anti-accidental touch mode is activated. That is, in the embodiment of the present application, the user is provided with a functional option of actively activating the anti-accidental touch mode. The user only needs to touch the touch portion of the display module for at least T_2 and not move the display module during this process to enter the anti-accidental touch mode, so that the user can switch the graphical interface presented by the display module on the lens to the interface required by the user before wearing glasses for exercise (please refer to Figure 2). For example, before the user rides, the graphical interface presented by the display module on the lens is switched to the navigation interface, and the anti-accidental touch mode is activated so that the user can use the navigation function during the ride.

[0197] If the touch portion is not detected to be touched for a duration not less than a third threshold duration T_3, the anti-accidental touch mode is activated. That is, in this embodiment of the application, a function option for passively activating the anti-accidental touch mode is also provided. If the user does not interact with the display module for a long period (i.e., duration T_3), i.e., does not touch the display module, it can be assumed that the user does not need to interact with the device temporarily, and the anti-accidental touch mode can be passively activated to stop monitoring the motion state of the display module. After the anti-accidental touch mode is released, the motion state of the display module can be resumed to save device power.

[0198] In some optional embodiments, the first threshold duration is less than the second threshold duration. Assuming the first threshold duration is 1 second and the second threshold duration is 0.5 seconds, that is, if the first threshold duration is greater than the second threshold duration, a situation may arise: the user has not yet decided how to move the display module within the first 0.6 seconds of touching the display module, and the anti-mistouch mode has already been activated. Even if the user moves the display module in the last 0.4 seconds, and the movement of the display module is a target motion state, because the device enters the anti-mistouch mode when touching the display module 0.5 seconds, the target logic function corresponding to the target motion state (i.e., the trigger condition is the target logic function of the target motion state) will not be triggered. Accordingly, the display module will not image the graphical interface of the target logic function on the lens. Furthermore, it is difficult for the user to accurately perceive the touch duration, which may cause inconvenience to the user. However, if the first threshold duration is less than the second threshold duration, this possible "awkward" phenomenon mentioned above can be avoided, thereby facilitating user interaction with the display module.

[0199] In some optional embodiments, a prompt is outputted to inform the user that the accidental touch prevention mode has been activated. This prompt may be a text, image, or video animation displayed on the lens by the display module, so that the user knows that the device has activated the accidental touch prevention mode.

[0200] S16: When it is detected again in the false touch prevention mode that the touch portion is touched for a duration not less than a fourth threshold duration T_4, cancel the false touch prevention mode.

[0201] After entering the accidental touch prevention mode, if the device detects that the touch portion of the display module is touched again and the touch duration reaches the fourth threshold duration T_4, the accidental touch prevention mode is canceled to allow the user to interact with the display module again.

[0202] In some optional implementations, the fourth threshold duration is less than or equal to the first threshold duration.

[0203] If the first threshold duration is less than the fourth threshold duration, after entering the accidental touch prevention mode, the user must first touch the display module for the fourth threshold duration to release the accidental touch prevention mode before interacting with the display module, causing inconvenience to the user. However, if the fourth threshold duration is less than or equal to the first threshold duration, the user can quickly release the accidental touch prevention mode so that the user can interact with the display module again.

[0204] In some optional embodiments, a prompt is outputted to inform the user that the anti-accidental touch mode has been deactivated. This prompt may be text, an image, or a video animation displayed on the lens by the display module, so that the user knows that the anti-accidental touch mode has been deactivated.

[0205] In some optional embodiments, when the anti-mistouch mode is released, when it is monitored that the display module is stationary on the lens and the touch portion is detected to be touched, the display module is controlled to image moving prompt content around the display module on the lens.

[0206] For example, as shown in FIG17 , which is a schematic diagram illustrating an application scenario of a display module provided by an embodiment of the present application, when the display module 2 is detected to be stationary on the lens 12 and a touch portion of the display module 2 is detected, the display module 2 is controlled to form an image on the lens 12 around the display module 2, as shown in FIG17 , prompting the user to move the display module 2 in multiple directions.

[0207] In some optional embodiments, the control method of the display module provided in the embodiments of the present application further provides some other ways for the user to interact with the glasses (or near-eye display device) or device connected to the display module based on the aforementioned embodiments. These methods mainly involve various ways for the user to interact with the glasses (or near-eye display device) or device connected to the display module when the display module is in a stationary state without moving the lenses. Specifically, the following steps are included:

[0208] Acquire multimedia data and eye-tracking data;

[0209] When it is detected that the display module is stationary on the lens and the touch portion is touched according to the target touch pattern, or when it is detected that the display module is stationary on the lens and a target instruction is identified from the multimedia data, or when it is detected that the display module is stationary on the lens and a target eye movement pattern is identified from the eye tracking data, the display module is controlled to image the graphical interface of the target logical function on the lens, or the display module is controlled to update the target area in the third graphical interface currently imaged on the lens; the third graphical interface is the graphical interface of the third logical function, the third logical function is the logical function currently running in the foreground, and the target area is the graphical area corresponding to the sub-function in the third logical function; the target touch pattern, the target instruction and the target eye movement pattern are preset as trigger conditions for triggering the target logical function or are preset as trigger conditions for a sub-function of the third logical function.

[0210] Among them, the multimedia data can be image / video data collected by the micro camera built into the display module or voice data collected by the micro microphone, and the eye tracking data is the user's eye image data collected by the micro camera built into the display module.

[0211] The target touch pattern can be a single click, double click, triple click, etc. The target instruction can be a preset target gesture, target voice, etc. The target eye movement pattern can be the movement of the eyeball according to a preset pattern. Similarly, the target touch pattern, the target instruction, and the target eye movement pattern are similar to the aforementioned target motion state, and they can also be preset as trigger conditions for triggering the target logical function or preset as trigger conditions for sub-functions of the third logical function. When the display module is detected to be stationary on the lens and the touch portion is touched according to the target touch pattern, or when the display module is detected to be stationary on the lens and a target instruction is recognized from the multimedia data, or when the display module is detected to be stationary on the lens and a target eye movement pattern is recognized from the eye tracking data, the (preset) trigger condition is triggered, which is the target touch pattern, the target instruction, and the target eye movement pattern. The graphical interface of the triggered target logical function (or the target area of ​​the third logical function) is thereby controlled to be imaged on the lens (or the display module is controlled to update the target area in the third graphical interface currently imaged on the lens). The principle is similar to that of the aforementioned target motion state triggering the target logic function (or a sub-function of the third logic function), thereby controlling the display module to image the triggered target logic function's graphical interface on the lens (or controlling the display module to update the target area in the third graphical interface currently imaged on the lens). Details will not be given here, and those skilled in the art can understand it by referring to the above text.

[0212] In some optional embodiments, a preset imaging area is pre-set on the lens to which the display module is connected. The display module only images within this preset imaging area, not across the entire lens. Therefore, only when target motion is detected within the preset imaging area on the lens is the display module controlled to image the graphical interface of the target logical function on the lens. If the display module is detected moving outside of the preset imaging area, a low-power mode is activated. This conserves device power and extends both battery life and service life.

[0213] It should be noted that although the above examples are all described with monocular (i.e., the display module provided by the embodiment of the present application is connected to only one lens of the glasses) as an example, it is obvious that all the implementation methods provided in the present application can also be applied to binocular scenarios (i.e., the display modules provided by the embodiment of the present application are connected to both lenses of the glasses).

[0214] The connection method of the projection device provided in the embodiment of the present application can be executed by the control device of the display module. In the embodiment of the present application, the control device of the display module executing the control method of the display module is used as an example to illustrate the control device of the display module provided in the embodiment of the present application.

[0215] FIG18 is a schematic diagram illustrating the structure of a control device for a display module provided in an embodiment of the present application. Referring to FIG18 , the control device 50 for the display module is configured to be connected to a pair of eyeglass lenses and to produce an image on the connected lens. The control device 50 includes:

[0216] A first monitoring module 501 is used to monitor the motion state of the display module on the lens to which it is currently connected;

[0217] The first control module 502 is configured to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected; the target motion state is preset as a trigger condition for triggering the target logic function.

[0218] In some optional embodiments, the target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logical function includes: a first logical function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logical function; the first control module 502 includes:

[0219] The first control submodule is configured to control the display module to image a first graphical interface of the first logical function on the lens when it is detected that the movement of the display module on the lens satisfies a first preset condition.

[0220] In some optional implementations, the first preset condition is one of the following:

[0221] The displacement distance of the movement is not less than a preset first threshold length;

[0222] The displacement distance of the movement is not less than a preset first threshold length, and the displacement direction of the movement is a preset first direction;

[0223] The displacement distance of the movement is not less than a preset first threshold length, and the starting point of the movement is a preset first position, which is a fixed position selected on the lens;

[0224] The displacement distance of the movement is not less than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position;

[0225] The end point of the movement is a preset second position, which is a fixed position selected on the lens;

[0226] The shape similarity between the moving trajectory and the preset trajectory is not less than a preset first threshold.

[0227] In some optional embodiments, the target motion state includes: the display module being stationary at a third position on the lens, the third position being a fixed position selected on the lens; the target logical function includes: a second logical function; the display module being stationary at the third position on the lens is preset as a trigger condition for triggering the second logical function; and the first control module 502 includes:

[0228] The second control submodule is configured to control the display module to image a second graphic interface of the second logical function on the lens when it is detected that the display module is stationary at a third position on the lens.

[0229] In some optional embodiments, the target motion state includes: the display module performing axial rotation; the target logical function includes: a third logical function, the third logical function being the logical function currently running in the foreground; the first control module 502 includes:

[0230] The third control submodule is used to control the display module to update the target area in the third graphic interface currently imaged on the lens when the display module is monitored to be rotating along its axis; the third graphic interface is the graphic interface of the third logical function, and the target area is the graphic area corresponding to the sub-function in the third logical function; the axial rotation of the display module is preset as a trigger condition for triggering the sub-function in the third logical function.

[0231] In some optional implementations, the third control submodule includes:

[0232] The first control unit is configured to control the display module to update a target area in a third graphic interface currently imaged on the lens when detecting that the display module rotates at an axial angle not less than a preset first threshold angle.

[0233] In some optional embodiments, the control device 50 further includes:

[0234] a first detection module, configured to detect contact of a touch portion of the display module;

[0235] The first control module 502 includes:

[0236] The fourth control submodule is used to control the display module to image the graphical interface of the target logical function on the lens when it is detected that the touch portion is touched for a duration not less than a preset first threshold duration and the target motion state is monitored.

[0237] In some optional embodiments, the control device 50 further includes:

[0238] The first startup module is used to start the anti-mistouch mode when it is detected that the touch portion is touched for a duration not less than a preset second threshold duration and the display module is monitored to always remain stationary on the lens, or when it is not detected that the touch portion is touched for a duration not less than a third threshold duration; the anti-mistouch mode refers to a mode in which the display module is controlled to maintain imaging on the lens a graphical interface of the logical function currently running in the foreground.

[0239] In some optional implementations, the first threshold duration is smaller than the second threshold duration.

[0240] In some optional embodiments, the control device 50 further includes:

[0241] The first releasing module is configured to release the false touch prevention mode when it is detected again in the false touch prevention mode that the touch portion is touched for a duration not less than a fourth threshold duration.

[0242] In some optional implementations, the fourth threshold duration is less than or equal to the first threshold duration.

[0243] In some optional embodiments, the control device 50 further includes:

[0244] A first prompt module is used to output a prompt for prompting a user that the anti-accidental touch mode has been activated when the anti-accidental touch mode is activated;

[0245] The second prompt module is used to output a prompt for prompting the user that the accidental touch prevention mode has been released when the accidental touch prevention mode is released.

[0246] In some optional embodiments, the control device 50 further includes:

[0247] The second control module is configured to control the display module to image moving prompt content around the display module on the lens when it is detected that the display module is stationary on the lens and the touch portion is touched.

[0248] In some optional embodiments, the control device 50 further includes:

[0249] The third control module is used to control the display module to image the graphic interface of the target logical function on the lens, or control the display module to update the target area in the third graphic interface currently imaged on the lens when it is detected that the display module is stationary on the lens and the touch portion is touched according to the target touch mode; the third graphic interface is the graphic interface of the third logical function, the third logical function is the logical function currently running in the foreground, and the target area is the graphic area corresponding to the sub-function in the third logical function; the target touch mode is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

[0250] In some optional embodiments, the control device 50 further includes:

[0251] A first acquisition module, configured to acquire multimedia data;

[0252] A third control module is configured to control the display module to image the graphical interface of the target logical function on the lens, or to control the display module to update the target area in the third graphical interface currently imaged on the lens, when it is detected that the display module is stationary on the lens and a target instruction is identified from the multimedia data; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target instruction is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

[0253] In some optional embodiments, the control device 50 further includes:

[0254] A second acquisition module is used to acquire eye tracking data;

[0255] A fourth control module is configured to control the display module to image the graphical interface of the target logical function on the lens, or to control the display module to update the target area in a third graphical interface currently imaged on the lens, when the display module is detected to be stationary on the lens and a target eye movement pattern is identified from the eye tracking data; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target eye movement pattern is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

[0256] In some optional embodiments, the control device 50 includes:

[0257] a second monitoring module, configured to control the display module to image a graphical interface of the target logic function on the lens when a target motion state is detected within a preset imaging area on the lens;

[0258] The second starting module is used to start the low power consumption mode when it is detected that the display module moves out of the preset imaging area.

[0259] The control device 50 of the display module in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile Internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0260] The display module control device 50 in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0261] The control device 50 of the display module provided in the embodiment of the present application can implement each process implemented in the embodiments of Figures 1 to 17. To avoid repetition, they are not described here.

[0262] In some optional embodiments, as shown in Figure 19, the embodiment of the present application also provides an electronic device 130, including a processor 131 and a memory 132, and the memory 132 stores a program or instruction that can be run on the processor 131. When the program or instruction is executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0263] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0264] FIG20 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0265] The electronic device 140 includes, but is not limited to, components such as a radio frequency unit 141, a network module 142, an audio output unit 143, an input unit 144, a sensor 145, a display unit 146, a user input unit 147, an interface unit 148, a memory 149, and a processor 1410. Those skilled in the art will appreciate that the electronic device 140 may also include a power supply (such as a battery) to power each component. The power supply may be logically connected to the processor 1410 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. The electronic device structure shown in FIG14 does not constitute a limitation of the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be described in detail here.

[0266] The processor 1410 is configured to:

[0267] Monitoring the motion state of the display module on the lens currently connected;

[0268] When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

[0269] It should be understood that in an embodiment of the present application, the input unit 144 may include a graphics processing unit (GPU) 1441 and a microphone 1442, and the graphics processor 1441 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 146 may include a display panel 1461, and the display panel 1461 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 147 includes a touch panel 1471 and at least one of other input devices 1472. The touch panel 1471 is also called a touch screen. The touch panel 1471 may include two parts: a touch detection device and a touch controller. Other input devices 1472 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0270] The memory 149 can be used to store software programs and various data. The memory 149 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 149 may include a volatile memory or a non-volatile memory, or the memory 149 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 149 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0271] Processor 1410 may include one or more processing units. Optionally, processor 1410 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1410.

[0272] The control method of the display module provided in the embodiment of the present application can be executed by AR glasses. In the embodiment of the present application, the control method of the display module executed by a near-eye display device is used as an example to illustrate the electronic system provided in the embodiment of the present application.

[0273] In some optional embodiments, as shown in Figure 21, the embodiment of the present application also provides an AR glasses 150, including a processor 151 and a memory 152, and the memory 152 stores a program or instruction that can be run on the processor 151. When the program or instruction is executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0274] In the related art, the size of the lenses of some glasses (such as goggles) may be much larger than the field of view of the human eye, so that the user wearing the glasses cannot see or see clearly some areas on the lenses, that is, there may be some areas (i.e., blind spots) on the lenses of the glasses that are outside the field of view of the user wearing the glasses; if the display module connected to the lens of the glasses is imaged in the blind spot on the lens, it will cause the user wearing the glasses to be unable to see or see clearly. The purpose of the embodiments of the present application is to provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product for a display module, so as to independently or semi-independently solve to a certain extent the technical problem that if the display module connected to the lens of the glasses is imaged in the blind spot on the lens, it will cause the user wearing the glasses to be unable to see or see clearly. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect that the display module connected to the lens of the glasses will not be imaged in the blind spot on the lens in the near-eye display technology. The semi-independent solution refers to providing a hardware construction scheme, which, when working in conjunction with near-eye display software - such as software in AR technology that allows users to interact with virtual information - can achieve the effect that the display module connected to the lens of the glasses in near-eye display technology will not form an image in the blind spot on the lens.

[0275] As shown in Figure 23, Figure 23 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. In this exemplary scenario, a main view of a pair of goggles is schematically shown. In order to enable the goggles to protect the wearer's eyes as much as possible, manufacturers usually make the lenses larger so that they can more comprehensively cover the eye area for protection without affecting the wearer's line of sight. Please refer to Figure 7. After the user wears the exemplary goggles 5, the edge areas of the lens 52 that are closer to the frame 51 are less likely to be seen by the user, or even impossible to see clearly, that is, some edge areas on the lens 52 are blind spots in the user's field of vision.

[0276] For example, it is assumed that after user A wears the goggles 5, the area of ​​the lens 52 that can be clearly seen is shown as the area 521 surrounded by the dotted line in the figure (this area is called the visible area of ​​user A) (obviously, in practice, there is usually no dotted line ring on the goggles. The dotted line ring is used to schematically illustrate the virtual boundary between the blind area and the visible area), and the other areas on the lens 52 except the area 521 are the blind areas of user A; then the display module 2 is only located in the area 521 and the imaging in the area 521 is , user A can clearly see the display module 2 (the display area 21 thereof), and the user can also clearly see the image formed by the display module 2 in the area 521 through the display area 21 of the display module 2; however, if the display module 2 is in the blind spot on the lens 52 (for example, the position shown in FIG7 ), user A cannot even see the display module 2 clearly, and of course cannot clearly see the display area 21 of the display module 2, and naturally cannot see the image formed by the display module 2 on the lens 52 by viewing the display area 21 of the display module 2.

[0277] Therefore, in the related art, some glasses (such as the goggles shown in Figure 23) may have lenses that are much larger than the field of view of the human eye for protection or styling reasons, making it impossible for the user wearing the glasses to see or see clearly some areas on the lenses, that is, there may be some areas (i.e., blind spots) on the lenses of the glasses that are outside the field of view of the user wearing the glasses; if the display module connected to the lenses of the glasses forms an image in the blind spots on the lenses, the user wearing the glasses will not be able to see or see clearly.

[0278] The embodiments of the present application provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product for a display module, which can independently or semi-independently solve to a certain extent the technical problem that if the display module connected to the lens of the glasses is imaged in the blind spot on the lens, it will cause the user wearing the glasses to be unable to see or see clearly.

[0279] On this basis, the embodiments of the present application are described in detail below.

[0280] The embodiment of the present application provides a control method for a display module, wherein the display module is configured to be placed on an optical lens, and the display module is configured to output image content. For example, as shown in Figures 1 to 5 and Figure 22, the display module can be the display module 2 shown in Figures 1 to 5 and Figure 22, and the display module 2 can output image content on the lens 12 or the lens 52. The control method of the display module can be performed by at least one of the glasses 1 in Figures 1 to 5, the display module 2 in Figures 1 to 5, the near-eye display device 10 in Figure 4, or the smart terminal 4, which can realize the specific information of the GUI imaged by the control display module 2 on the glasses 1 (or near-eye display device 10 or goggles 5) to which it is connected. As shown in Figure 24, Figure 24 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. In order to facilitate understanding of the control method of the display module provided in the embodiment of the present application, the step flow shown in Figure 24 will be described below using the goggles 5 illustrated in Figure 23 as an example. Referring to FIG. 24 , the control method of the display module includes:

[0281] S101 , detecting the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module.

[0282] The lens is the lens on the glasses to which the display module is currently connected. For example, it can be described in the above embodiment, which will not be repeated here.

[0283] In an embodiment of the present application, the display module used to display augmented reality images on the lenses of the glasses can move on the lenses to which it is connected, rather than fixing the display module to the lenses. In some optional embodiments, an inertial sensor or an acceleration sensor (or a gyroscope) is built into the display module. Such a sensor can collect the instantaneous velocity and acceleration of the display module, thereby determining the motion trajectory of the display module based on the collected instantaneous velocity and acceleration and combining parameters such as time.

[0284] Optionally, a fixed reference point is pre-selected on the lens to which the display module is connected as the origin. The display module moves from this origin, and the movement trajectory of the display module is continuously monitored. The position of any point on this movement trajectory relative to the origin can be expressed as the relative position of the display module relative to the connected lens.

[0285] For example, as shown in Figure 25, Figure 25 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. For example, point P0 on the lens 52 is a pre-selected origin, and the display module 2 moves from the origin along the path l1 to point P1, then moves along the path l2 to point P2, then moves along l3 to point P3, and finally moves along l4 to point P4. The motion trajectory l of the display module 2 at any time t in the motion process can be determined by monitoring the motion parameters of the display module 2 (such as speed, acceleration, etc.). The positional relationship of the end point of the motion trajectory at any time t relative to the origin P0 can represent the relative position of the display module 2 on the lens 52. For example, at time t1, the display module 2 moves to point P1. According to the determined path l1, the positional relationship of point P1 relative to the origin P0 can be determined, that is, the relative position of the display module 2 on the lens 52, which is exemplarily represented as Indicates that point P1 is located at the vector At the end point, the vector The starting point is P0.

[0286] Similarly, when the motion trajectory of the display module 2 from point P1 to point P2 is l2, the position relationship of P2 relative to P1 can be expressed as Indicates that point P2 is located at the vector At the end point, the vector The starting point is P1. Based on the mathematical vector relationship, Therefore, there is Accordingly, Obviously, the above vector actually shows the displacement of module 2 during this process.

[0287] It should be noted that in the above examples, when describing the path and movement trajectory of the display module 2, a straight trajectory (path) is used as an example. Obviously, the display module 2 can be moved arbitrarily and is not limited to the form of the straight trajectory in the above examples, such as a curved trajectory.

[0288] Regarding the detection of contact of the touch portion of the display module, please refer to the relevant description above and will not be repeated here.

[0289] S102: In the imaging area setting mode, when it is detected that the touch portion is touched according to a first touch pattern at a first relative position of the display module while the display module is stationary on the lens, the first relative position is marked as a first fitting point. The first relative position is an arbitrary position of the display module on the lens. In the imaging area setting mode, the first touch pattern is a touch pattern used to indicate that a user has confirmed that the display area of ​​the display module is clearly visible.

[0290] Imaging area setup mode allows users to set a preset imaging area on the lens to which the display module is connected. In some optional embodiments, imaging area setup mode automatically enters when the display module is first connected to the lens and powered on. In some optional embodiments, a smart terminal connected to the display module provides an app for controlling the display module. Users can activate imaging area setup mode through the imaging area setup function within the app. Once the display module enters this mode, it proceeds to the preset imaging area setup process.

[0291] For example, the near-eye display device 10 shown in FIG23 is the goggles 5 shown in FIG25 , which automatically enters the imaging area setting mode when the display module 2 is connected to the lens 52 for the first time and turned on. The user can also start the imaging area setting mode of the display module 2 through the imaging area setting function option in the APP that controls the display module on the smart terminal 4.

[0292] When the instantaneous speed of the display module is monitored to be 0, it can be confirmed that the display module is stationary on the lens.

[0293] For example, in the example shown in FIG25 , the display module 2 may be initially detected as being stationary at point P0, and then may be detected again as being stationary at point P1. Subsequently, the display module may be detected as being stationary at points P2, P3, and P4, respectively. In other words, P1, P2, P3, and P4 are all first relative positions.

[0294] The first touch pattern can be a pre-set touch pattern, such as a single, double, or triple tap on the touch portion of the display module. When a touch is detected at a certain location on the lens while the display module is stationary according to the first touch pattern, the location of the display module is marked as a first fitting point. The fitting point is used to fit the boundary of the preset imaging area.

[0295] For example, in the example in Figure 25, when it is detected that the display module 2 moves from point P0 to points P1, P2, P3 and P4, and stops at points P1, P2, P3 and P4, it is also detected that the touch part is touched according to the first touch mode (for example, a single click), and therefore, points P1, P2, P3 and P4 are all marked as first fitting points.

[0296] S103 : When at least three first fitting points are marked, fit the at least three first fitting points into a closed area.

[0297] S104: setting the closed area as a preset imaging area of ​​the display module on the lens.

[0298] Mathematical knowledge indicates that at least three points are required to enclose a closed area in space. Therefore, after marking at least three first fitting points, all of the marked first fitting points can be fitted into a closed area. The closed area fitted using all of the first fitting points is then set as the preset imaging area for the display module on the currently connected lens.

[0299] Fitting refers to enclosing multiple points into a closed area, and the line between any two points does not intersect the line between any other two points. In some optional embodiments, at least three first fitting points can be fitted into a closed area of ​​a preset shape. For example, the preset shape can be an ellipse (a circle is a special ellipse), a rectangle, a triangle, etc. In some optional embodiments, when performing area fitting, any two first fitting points with the shortest straight-line distance can be connected by a curve or a straight line. When connecting with a curve, a smooth curve is preferably used.

[0300] For example, as shown in Figures 26 and 27, Figures 26 and 27 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. Fitting into an elliptical area, which is set as the preset imaging area 522 of the display module 2 on the lens 52. Referring to FIG. 27 , the four first fitting points P1, P2, P3, and P4 are fitted into a quadrilateral area, which is set as the preset imaging area 522 of the display module 2 on the lens 52.

[0301] In some optional implementations, in order to facilitate the user to set the preset imaging area, the above steps S101-S104 can be assisted by a smart terminal (see FIG4 ) that is communicatively connected to the display module, which is exemplarily described below.

[0302] As shown in Figures 28 and 29, Figures 28 and 29 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. Referring to Figures 28 and 29, the display module 2 maintains a communication connection with the smart terminal 6, and the smart terminal 6 has pre-acquired a virtual outline model of the goggles 5. This virtual outline model can be obtained by scanning the goggles 5 with a 3D scanner, or it can be obtained from the manufacturer of the goggles 5. After the display module 2 is connected (placed) on the lens 52, when the display module 2 activates the imaging area setting mode, the virtual outline model of the goggles 5 is output on the screen of the smart terminal 6, and the relative position of the display module 2 on the goggles 5 is traced on the virtual outline model of the goggles 5. The display module 2 can be moved to different positions on the connected lens 52 for positioning, and each positioning point (i.e., fitting point) is determined based on the user wearing the glasses 5 confirming that it can be seen clearly. That is, the user places the display module 2 at different positions on the lens 52 to perform “aiming point” positioning, displays these positioning points on the smart terminal 6, and then fits all the positioning points into a preset imaging area.

[0303] Referring to Figure 28 , when the display module 2 first enters the imaging area setting mode, the initial position P0 of the display module 2 is displayed on the virtual outline model of the goggles 5 on the screen of the smart terminal 6. When the display module 2 moves from P0 to P1, position P1 is displayed on the virtual outline model of the goggles 5 on the screen of the smart terminal 6. If the user confirms that the display module 2 is clearly visible at point P1, the position of P1 relative to the origin P0 is recorded. Referring to Figure 29 , after completing the "aim point" positioning, all found positioning points are displayed on the virtual outline model of the goggles 5 on the screen of the smart terminal 6, such as P1, P2, P3, and P4 in the example of Figure 29 . Referring to Figure 30 , a fitted elliptical enclosed area is displayed on the virtual outline model of the goggles 5 on the screen of the smart terminal 6, and this enclosed area is set as the preset imaging area 522 for the image formed by the display module 2 on the lens 52.

[0304] In some optional embodiments, when selecting the first relative position, priority is given to selecting extreme points on the lens close to the frame, such as points on the lens near the edge of the frame. If the user confirms that the display module cannot be clearly seen at these points, the user is prompted to gradually move the display module closer to the center of the lens, so that the final fitted preset imaging area is as large as possible, thereby increasing the area of ​​the preset imaging area. Obviously, the more data is calibrated for the first fitting points, the closer the fitted preset imaging area will be to the user's visual area. Therefore, the number of first fitting points for fitting the preset imaging area can be flexibly set.

[0305] In an embodiment of the present application, in the imaging area setting mode, by detecting the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module, at least three first fitting points confirmed by the user to be clearly visible are found on the lens to which the display module is currently connected. The at least three fitting points found are then fitted into a closed area. Since the boundary points of the closed area (obviously, these boundary points include the first fitting points) can be clearly seen by the user, the user can naturally also see the closed area clearly. The closed area is set as the preset imaging area of ​​the display module on the lens. Afterwards, the display module will image within the preset imaging area on the lens, and will not image within the blind area of ​​the lens, thereby effectively solving the technical problem that the display module connected to the lens of the glasses is imaged within the blind area of ​​the lens, which will cause the user wearing the glasses to be unable to see or see the virtual information in the blind area.

[0306] The embodiment of the present application provides a control method for a display module, wherein the display module is configured to be placed on an optical lens, and the display module is configured to output image content. For example, as shown in Figures 1 to 5 and Figures 22-23, the display module can be the display module 2 shown in Figures 1 to 5, and the display module 2 can output image content on the lens 12 or the lens 52. The control method of the display module can be performed by at least one of the glasses 1 in Figures 1 to 5, the display module 2 in Figures 1 to 5, the near-eye display device 10 in Figure 4, or the smart terminal 4, which can realize the specific information of the GUI imaged by the control display module 2 on the glasses 1 (or near-eye display device 10 or goggles 5) to which it is connected. As shown in Figure 25, Figure 25 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. In order to facilitate understanding of the control method of the display module provided in the embodiment of the present application, the step flow shown in Figure 25 will be described below using the goggles 5 illustrated in Figure 23 and the scene shown in Figure 32 as an example. Referring to FIG. 25 , the control method of the display module includes:

[0307] S21, obtaining a first virtual contour model of the lens and a second virtual contour model of the user's eye;

[0308] S22: Scan a contour area identical or similar to the second virtual contour model on the first virtual contour model, and set the contour area as a preset imaging area of ​​the display module on the lens.

[0309] Please refer to Figure 32. The description of how the smart terminal 6 obtains the first virtual contour model 5' of the lens is described above and will not be repeated here. Similarly, a 3D scanner can be used to obtain a second virtual contour model of the eye of user A wearing the goggles 5. The smart terminal 6 obtains the second virtual contour model from the 3D scanner. The smart terminal 6 overlaps the second virtual contour model with the first virtual contour model 5' and scans a contour area 522' on the first virtual contour model 5' that is identical or similar to the second virtual contour model. The contour area 522' is then set as the preset imaging area 522 of the display module 2 on the lens 52.

[0310] This method of setting a preset imaging area is faster than the previous method, but it is more challenging because for each pair of glasses, each user must simultaneously obtain the virtual outline of the glasses' lenses and the virtual outline of the user's eyes. Therefore, in practice, users can flexibly choose the method of setting the preset imaging area based on their actual needs.

[0311] After the preset imaging area is set, the display module can image within the preset imaging area on the connected lens when it is located within the preset imaging area. However, the display module cannot image on the connected lens when it is located outside the preset imaging area. Therefore, in some optional embodiments, if the display module is detected to be outside the preset imaging area, a low power consumption mode is activated.

[0312] For example, in FIG27 , after the preset imaging area is set, when the display module 2 moves outside the area 522 on the lens 52, the display module 2 activates low-power mode. This saves device power and extends the device's battery life and service life. In low-power mode, the display module 2 can be in a completely inoperative state, a standby state, or a partially operational state. When the display module 2 moves back into the area 522, the display module 2 turns off low-power mode and resumes operation. In some optional embodiments, the user can also set the specific state of low-power mode corresponding to different time periods in the non-preset imaging area (i.e., in the example of FIG27 , the area outside the area 522 on the lens 52). For example, the low-power mode from 11 pm to 7 pm the next day is set to a completely inoperative state, the low-power mode from 7 am to 9 pm, 12 pm to 2 pm, and 5 pm to 8 pm is set to a standby state, and the remaining time periods are set to a partially operational state (e.g., the hardware monitoring the motion status of the display module is in operation).

[0313] In some optional implementations, based on the aforementioned implementations, the control method of the display module provided in the embodiment of the present application further includes:

[0314] When receiving a partitioning instruction, dividing the preset imaging area into at least two sub-imaging areas;

[0315] Upon receiving a mapping instruction to image a first graphic interface in a first sub-imaging area, the display module is controlled to image the first graphic interface in the first sub-imaging area; the first sub-imaging area is any one of the at least two sub-imaging areas.

[0316] The user can divide the preset imaging area into multiple sub-imaging areas and present different images in different sub-imaging areas. The image presented in each sub-area can also be set by the user. When the display module receives a partitioning instruction input by the user, the display module responds to the number of areas in the partitioning instruction and divides the preset imaging area into sub-imaging areas of the same number of areas (for example, as shown in Figure 33, the preset imaging area 522 is divided into 6 sub-imaging areas). When the display module receives a mapping instruction for a sub-imaging area, it images a graphical interface corresponding to the data mapped in the mapping instruction in the sub-imaging area according to the data mapped in the mapping instruction.

[0317] For example, as shown in FIG33 , FIG33 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG33 , the user sets a preset imaging area 522 for the display module 2 on the lens 52 . The preset imaging area 522 is divided into six sub-imaging areas, and a graphical interface of the data mapped in each sub-imaging area is imaged in each sub-imaging area. The icon AI shown in FIG33 can be an icon (thumbnail) of an application or file, or other content, such as a currently playing video.

[0318] In an embodiment of the present application, in order to fully enable such traditional glasses to have augmented reality display functions and to achieve efficient interaction thereon, users can customize the layout of specific preset imaging areas as needed. For example, the lenses of the glasses are generally round, square, or other shapes, and have a lens area that is larger than the field of view of the human eye. At this time, the user can take a position with a better field of view as the preset imaging area. The preset imaging area can be divided into multiple sub-imaging areas, each of which can be configured to output a corresponding graphical interface, and multiple sub-areas can realize multi-channel output of multiple graphical interfaces.

[0319] Obviously, for a specific pair of glasses, the blind spots and visible areas will be different for each user because of the different users who wear them. And for a specific user, the blind spots and visible areas will be different for each pair of glasses because of the different glasses they wear. That is to say, the setting method of the preset imaging area provided in the aforementioned embodiment needs to vary from person to person and from glasses to glasses. In other words, the preset imaging area A set when user A wears glasses A may not be suitable for user B wearing glasses A. User B may not be able to see some areas within the preset imaging area A when wearing glasses A. User B may need to reset the preset imaging area B when wearing glasses A. Therefore, in some optional embodiments, for the lenses currently connected to the display module, the identity information of the user who sets the preset imaging area can be associated with the preset imaging area set by the user, so that when different users wear glasses subsequently, the display module performs imaging based on the preset imaging area associated with the user. Therefore, in some optional embodiments, on the basis of the aforementioned embodiments, the control method of the display module provided in the embodiment of the present application also includes:

[0320] Obtaining identity information of the user;

[0321] A mapping rule is established between the identity information and the preset imaging area and saved.

[0322] The user here is the user who sets the preset imaging area on the lens currently connected to the display module, and can be the user who touches the touch portion of the display module according to the first touch pattern in the aforementioned step S102, or the user corresponding to the second virtual contour model in the aforementioned step S21.

[0323] The user's identity information can be the user's account / password, voiceprint, fingerprint, iris, etc.

[0324] When a user completes the setting of a preset imaging area while wearing a pair of glasses, a mapping rule can be established between the user's identity information and the preset imaging area set by the user, and the mapping rule can be saved. The next time the user uses the glasses, the preset imaging area set by the user on the glasses can be directly obtained according to the mapping rule.

[0325] For example, for display module 2, if user A sets a preset imaging area A1 on goggles 5, user A's identity information ID-A is mapped to preset imaging area A1. If user A sets a preset imaging area A2 on glasses 1, user A's identity information ID-A is mapped to preset imaging area A2. For display module 2, if user B sets a preset imaging area B1 on goggles 5, user B's identity information ID-B is mapped to preset imaging area B1. These mapping rules are then saved.

[0326] As shown in FIG34, FIG34 is a schematic diagram of the steps of the control method of the display module provided by the embodiment of the present application. Referring to FIG34, the embodiment of the present application provides a control method of the display module, which, based on the above embodiment, further includes:

[0327] S105, when the imaging area setting mode is exited and then re-activated, if it is detected that the display module is stationary at a second relative position on the lens and the touch portion is touched according to the first touch pattern, marking the second relative position as a second fitting point; the second relative position is an arbitrary position on the lens different from the first relative position;

[0328] S106, when at least one second fitting point is marked, fitting the at least three first fitting points and the at least one second fitting point into a first new closed area, and updating the first new closed area to be a preset imaging area of ​​the display module on the lens; or

[0329] S107 , when at least three second fitting points are marked, fitting the at least three second fitting points into a second new closed area, and updating the second new closed area to be a preset imaging area of ​​the display module on the lens.

[0330] After setting the preset imaging area, the user may feel that the preset imaging area is not ideal and want to partially update or completely reset the preset imaging area. Therefore, after setting the preset imaging area, the user can re-enter the imaging area setting mode to update or reset the preset imaging area. That is, when the user re-enters the imaging area setting mode, they can perform "aim point" positioning on the lens again, find some positioning points different from the first fitting points (i.e., second fitting points), add the second fitting points to the first fitting points, and re-fit the preset imaging area (i.e., step S106) to update the preset imaging area, or find at least three second fitting points and re-fit a new preset imaging area based on these at least three second fitting points (i.e., step S107) to reset the preset imaging area.

[0331] As shown in FIG35 , FIG35 is a schematic diagram of the steps of the control method of the display module provided in an embodiment of the present application. Referring to FIG35 , an embodiment of the present application provides a control method of the display module, which, based on the above-mentioned embodiment, further includes:

[0332] S31, identifying a first identity of a first user wearing a first pair of glasses, where the first pair of glasses includes the lenses;

[0333] S32, searching a preset mapping set for a mapping rule that matches the first identity;

[0334] S33. When only one mapping rule is found from the mapping set, the preset imaging area in the found mapping rule is set as the imaging area for the display module to form an image on the lens. Each mapping rule in the mapping set is a pre-set mapping relationship between a user identity and a preset imaging area, and each mapping rule in the mapping set is different.

[0335] The first user can be any user.

[0336] In some optional embodiments, the user's login account / password and fingerprint information can be obtained through a smart terminal communicated with the display module to identify the first identity of the first user wearing the first glasses, or the first user's iris information can be collected through a camera on the display module to identify the identity information of the first user.

[0337] The display module can be connected to any pair of glasses, so a mapping set is associated with each pair of glasses. For example, mapping set A can be configured for pair of glasses A, recording at least one mapping rule for the preset imaging areas set by each user when wearing pair of glasses A. Mapping set B can be configured for pair of glasses B, recording at least one mapping rule for the preset imaging areas set by each user when wearing pair of glasses B.

[0338] After identifying the first identity of the first user, a mapping rule matching the first identity may be searched from the mapping set of the first pair of glasses. If only one mapping rule is found from the mapping set of the first pair of glasses, the preset imaging area in the found mapping rule is set as the imaging area for the display module to image on the lenses.

[0339] As shown in FIG36, FIG36 is a schematic diagram of the steps of the control method of the display module provided in an embodiment of the present application. Referring to FIG36, the control method of the display module provided in an embodiment of the present application is based on the embodiment shown in FIG35, and further includes:

[0340] S34, in the case where at least two mapping rules are searched from the mapping set, detecting a selection instruction for each preset imaging area in the at least two mapping rules, and setting the preset imaging area selected by the selection instruction as the imaging area for the display module to form an image on the lens, or setting the first preset imaging area in the at least two mapping rules as the imaging area for the display module to form an image on the lens, wherein the first preset imaging area is the preset imaging area last selected in the historical selection record of the first user selecting the preset imaging area.

[0341] If at least two mapping rules are found in the mapping set of the first pair of glasses, it indicates that the first user has set multiple preset imaging areas on the first pair of glasses. These preset imaging areas can be displayed on the smart terminal in communication with the display module for selection by the first user, and the preset imaging area selected by the user's selection instruction can be set as the imaging area for the display module to image on the glasses. Alternatively, the preset imaging area most recently selected in the history of the first user's selection of preset imaging areas can be set as the imaging area for the display module to image on the glasses.

[0342] As shown in FIG37, FIG37 is a schematic diagram of the steps of the control method of the display module provided by the embodiment of the present application. Referring to FIG37, the control method of the display module provided by the embodiment of the present application is based on the embodiment shown in FIG36, and further includes:

[0343] S35, initiating the imaging area setting mode when no mapping rule is found from the mapping set;

[0344] S36, when it is detected in the imaging area setting mode that the display module is stationary at a third relative position on the lens and the touch portion is touched according to the first touch pattern, marking the third relative position as a third fitting point; the third relative position is an arbitrary position of the display module on the lens;

[0345] S37, when at least three third fitting points are marked, fitting the at least three third fitting points into a third closed area;

[0346] S38, setting the third closed area as a third preset imaging area of ​​the display module on the lens.

[0347] If no mapping rule is found in the mapping set, it indicates that the first user has not yet set a preset imaging area on the first pair of glasses. Therefore, the imaging area setting mode is activated so that the first user can set a preset imaging area for the display module on the first pair of glasses. The specific process of the first user finding the third fitting point on the first lens and fitting the found third fitting point to the third preset imaging area can be referred to the above description of setting the preset imaging area and will not be repeated here.

[0348] In some optional embodiments, based on the embodiment shown in FIG. 20 above, the control method of the display module further includes: establishing a third mapping rule between the first identity and the third preset imaging area, and incorporating the third mapping rule into the mapping set.

[0349] A third mapping rule is established between the first identity of the first user and the third preset imaging area, and is included in the mapping set of the first glasses, so that the first user can quickly determine the preset imaging area corresponding to the first glasses when using the first glasses next time.

[0350] As shown in FIG38 , FIG38 is a schematic diagram of the steps of the control method of the display module provided by the embodiment of the present application. Referring to FIG38 , the embodiment of the present application provides a control method of the display module, which, based on the above embodiment, further includes:

[0351] S41, when the imaging area setting mode is exited and then re-activated, if it is detected that the display module is stationary at a fourth relative position on the lens and the touch portion is touched according to the first touch pattern, marking the fourth relative position as a fourth fitting point; the fourth relative position is an arbitrary position of the display module on the lens;

[0352] S42, when at least three fourth fitting points are marked, determining a repetition rate between the at least three fourth fitting points and the at least three first fitting points;

[0353] S43: When it is determined that the repetition rate is not less than the preset threshold, the preset imaging area is set as the current imaging area of ​​the display module on the lens.

[0354] In some optional embodiments, the user may have forgotten that he or she has set a preset imaging area for the glasses currently worn. When the display module detects that the preset imaging area setting mode is entered again, and the repetition rate of the relative positions of the detected fourth fitting point and the first fitting point on the lens reaches a preset threshold (for example, 90%), the setting of the preset imaging area is abandoned, and the preset imaging area fitted according to the first fitting point is directly configured as the current imaging area of ​​the display module on the lens.

[0355] In some optional embodiments, based on the embodiment shown in Figure 37 above, the control method of the display module further includes: when it is determined that the repetition rate is less than a preset threshold, fitting the at least three fourth fitting points into a fourth closed area, and setting the fourth closed area as the current imaging area of ​​the display module on the lens.

[0356] It should be noted that although the above examples are all described with monocular (i.e., the display module provided by the embodiment of the present application is connected to only one lens of the glasses) as an example, it is obvious that all the implementation methods provided in the present application can also be applied to binocular scenarios (i.e., the display modules provided by the embodiment of the present application are connected to both lenses of the glasses).

[0357] The control method of the display module provided in the embodiment of the present application can be executed by a control device of the display module. In the embodiment of the present application, the control device of the display module performing the control method of the display module is taken as an example to illustrate the control device of the display module provided in the embodiment of the present application.

[0358] FIG39 is a schematic diagram showing the structure of a control device for a display module provided in an embodiment of the present application. Referring to FIG39 , the control device 7 of the display module is configured to be placed on an optical lens and to output image content. The control device 7 includes:

[0359] A first detection module 71 is used to detect the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module;

[0360] A first marking module 72 is configured to mark a first relative position as a first fitting point when detecting that the display module is stationary at a first relative position on the lens and the touch portion is touched according to a first touch pattern in an imaging area setting mode. The first relative position is an arbitrary position of the display module on the lens. In the imaging area setting mode, the first touch pattern is a touch pattern used to indicate that the user has confirmed that the display area of ​​the display module can be clearly seen.

[0361] A first fitting module 73 is configured to fit the at least three first fitting points into a closed area when at least three first fitting points are marked;

[0362] The first setting module 74 is configured to set the enclosed area as a preset imaging area of ​​the display module on the lens.

[0363] In some optional embodiments, the control device 7 further includes:

[0364] When it is detected that the display module is outside the preset imaging area, a low power consumption mode is started.

[0365] In some optional embodiments, the control device 7 further includes:

[0366] A first division module is configured to divide the preset imaging area into at least two sub-imaging areas when a division instruction is received;

[0367] The first imaging module is used to control the display module to image the first graphic interface in the first sub-imaging area when receiving a mapping instruction to image the first graphic interface in the first sub-imaging area; the first sub-imaging area is any sub-imaging area of ​​the at least two sub-imaging areas.

[0368] In some optional embodiments, the control device 7 further includes:

[0369] a second marking module, configured to, when the imaging area setting mode is exited and then re-activated, mark the second relative position as a second fitting point when it is detected that the display module is stationary at a second relative position on the lens and the touch portion is touched according to the first touch pattern; the second relative position being an arbitrary position on the lens different from the first relative position;

[0370] The second fitting module is used to fit the at least three first fitting points and the at least one second fitting point into a first new closed area when at least one second fitting point is marked, and update the first new closed area to be the preset imaging area of ​​the display module on the lens; or to fit the at least three second fitting points into a second new closed area when at least three second fitting points are marked, and update the second new closed area to be the preset imaging area of ​​the display module on the lens.

[0371] In some optional embodiments, the control device 7 further includes:

[0372] a first identification module, configured to identify a first identity of a first user wearing a first pair of glasses, the first pair of glasses including the lenses;

[0373] A first search module, configured to search a preset mapping set for a mapping rule that matches the first identity;

[0374] The second setting module is configured to, when only one mapping rule is found from the mapping set, set the preset imaging area in the found mapping rule as the imaging area for the display module to form an image on the lens; each mapping rule in the mapping set is a pre-set mapping relationship between a user identity and a preset imaging area, and each mapping rule in the mapping set is different.

[0375] In some optional embodiments, the control device 7 further includes:

[0376] a third setting module, configured to, when at least two mapping rules are searched from the mapping set, detect a selection instruction for each preset imaging area in the at least two mapping rules, and set the preset imaging area selected by the selection instruction as the imaging area for the display module to form an image on the lens, or set the first preset imaging area in the at least two mapping rules as the imaging area for the display module to form an image on the lens, where the first preset imaging area is the preset imaging area last selected in the historical selection record of the preset imaging area selected by the first user.

[0377] In some optional embodiments, the control device 7 further includes:

[0378] a first starting module, configured to start the imaging area setting mode if no mapping rule is found in the mapping set;

[0379] a third marking module, configured to, when detecting that the display module is stationary at a third relative position on the lens and the touch portion is touched according to the first touch pattern in the imaging area setting mode, mark the third relative position as a third fitting point; the third relative position is an arbitrary position of the display module on the lens;

[0380] a third fitting module, configured to fit the at least three third fitting points into a third closed area when at least three third fitting points are marked;

[0381] The fourth setting module is used to set the third closed area as a third preset imaging area of ​​the display module on the lens.

[0382] In some optional embodiments, the control device 7 further includes:

[0383] The first establishing module is configured to establish a third mapping rule between the first identity and the third preset imaging area, and include the third mapping rule in the mapping set.

[0384] In some optional embodiments, the control device 7 further includes:

[0385] a fourth marking module, configured to, when the imaging area setting mode is exited and then re-activated, mark the fourth relative position as a fourth fitting point when it is detected that the display module is stationary at a fourth relative position on the lens and the touch portion is touched according to the first touch pattern; the fourth relative position is an arbitrary position of the display module on the lens;

[0386] a fourth fitting module, configured to, when at least three fourth fitting points are marked, determine a repetition rate between the at least three fourth fitting points and the at least three first fitting points;

[0387] The fifth setting module is configured to set the preset imaging area as the current imaging area of ​​the display module on the lens when it is determined that the repetition rate is not less than a preset threshold.

[0388] In some optional embodiments, the control device 7 further includes:

[0389] The sixth setting module is used to fit the at least three fourth fitting points into a fourth closed area when it is determined that the repetition rate is less than a preset threshold, and set the fourth closed area as the current imaging area of ​​the display module on the lens.

[0390] In some optional embodiments, the control device 7 further includes:

[0391] A first acquisition module is used to acquire a first virtual contour model of the lens and a second virtual contour model of the user's eye;

[0392] The seventh setting module is used to scan a contour area that is identical or similar to the second virtual contour model on the first virtual contour model, and set the contour area as a preset imaging area of ​​the display module on the lens.

[0393] In some optional embodiments, the control device 7 further includes:

[0394] A second acquisition module is used to obtain the identity information of the user;

[0395] The second establishing module is used to establish and save a mapping rule between the identity information and the preset imaging area.

[0396] The control device 7 of the display module in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (Television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0397] The control device 7 of the display module in the embodiment of the present application can be a device having an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0398] The control device 7 of the display module provided in the embodiment of the present application can implement the various processes implemented in the embodiments of Figures 1 to 5 and Figures 22 to 38. To avoid repetition, they will not be described here.

[0399] An embodiment of the present application also provides an electronic device 130. As shown in FIG19 , the electronic device 130 may include a processor 131 and a memory 132. The memory 132 stores programs or instructions that can be run on the processor 131. When the program or instruction is executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0400] An embodiment of the present application also provides an electronic device, the hardware structure of which is a schematic diagram as shown in Figure 20, and components with the same functions are not repeated here, wherein the processor 1410 is used to: detect the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module; in the imaging area setting mode, when it is detected that the display module is stationary at a first relative position on the lens and the touch portion is touched according to a first touch pattern, mark the first relative position as a first fitting point; the first relative position is an arbitrary position of the display module on the lens, and in the imaging area setting mode, the first touch pattern is a touch pattern used to indicate that the user confirms that he can see the display area of ​​the display module clearly; when at least three first fitting points are marked, fit the at least three first fitting points into a closed area; and set the closed area as a preset imaging area of ​​the display module on the lens.

[0401] In some optional embodiments, the embodiments of the present application also provide a near-eye display device 150. The near-eye display device 150 can be as shown in Figure 21 above. The display device 150 may include a processor 151 and a memory 152. The memory 152 stores programs or instructions that can be run on the processor 151. When the program or instruction is executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0402] Continuing with Figure 40 , two thumbnails [A] and [B] are simultaneously imaged in the center of the preset imaging area, and three thumbnails [D1], [D2], and [D3] are simultaneously imaged in the area near the edge of the frame 11. Appropriate interactive means are required to allow the user to select the desired thumbnail from these (icon) thumbnails, thereby enabling user interaction with the display module. At the same time, it is necessary to ensure that the user can quickly and accurately select the desired thumbnail without making an incorrect selection or confusion.

[0403] In the related art, a display module may simultaneously image multiple thumbnails of applications or files (icons) in a certain area on a near-eye display device. How to enable users to interact with these thumbnails accurately without confusion or errors is a technical problem that needs to be solved urgently. The purpose of the embodiments of the present application is to provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product for a display module, so as to independently or semi-independently solve to a certain extent the technical problem that if a display module connected to a near-eye display device simultaneously images multiple thumbnails of applications or files (icons) in a certain area of ​​the near-eye display device, the user is prone to confusion or errors when interacting with these thumbnails. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect of the display module connected to the near-eye display device in the near-eye display technology simultaneously imaging multiple thumbnails of applications or files (icons) in a certain area of ​​the near-eye display device, and the user can accurately interact with these thumbnails without being prone to confusion or errors. The semi-independent solution refers to providing a hardware construction scheme, which, when working in conjunction with near-eye display software - such as software in AR technology that allows users to interact with virtual information - can achieve the near-eye display technology in which a display module connected to a near-eye display device simultaneously images thumbnails of multiple applications or files (icons) in a certain area of ​​the near-eye display device, and users can interact with these thumbnails accurately without easily causing confusion or errors.

[0404] The embodiments of the present application provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product for a display module, which can independently or semi-independently solve to a certain extent the technical problem that if a display module connected to a near-eye display device simultaneously images thumbnails of multiple applications or files (icons) in a certain area of ​​the near-eye display device, confusion or errors may easily occur when a user interacts with these thumbnails.

[0405] On this basis, the embodiments of the present application are described in detail below.

[0406] An embodiment of the present application provides a method for controlling a display module, wherein the display module is configured to be placed on an optical lens, and the display module is configured to output image content. Exemplarily, as shown in Figures 1 to 48, the display module may be the display module 2 shown in Figures 1 to 48, and the display module 2 may output image content on the lens 12. The method for controlling the display module may be performed by at least one of the glasses 1, the display module 2, the near-eye display device 10 or the smart terminal 4 in Figures 1 to 48, which can realize the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 41, Figure 41 is a schematic diagram of the step flow of the method for controlling the display module provided by an embodiment of the present application. The method for controlling the display module comprises:

[0407] S111, when the image formed by the display module in the preset imaging area on the lens is a main interface, detecting the relative position between the display module and each thumbnail on the main interface;

[0408] S112 : When it is detected that the display module is placed on a thumbnail, run an application associated with the thumbnail, and enlarge and display the thumbnail on the display module.

[0409] The lens is the lens on the glasses to which the display module is currently connected. For example, it can be described in the above embodiment, which will not be repeated here.

[0410] In an embodiment of the present application, the display module used to display augmented reality images on the lenses of the glasses can move on the lenses to which it is connected, rather than fixing the display module to the lenses. In some optional embodiments, an inertial sensor or an acceleration sensor (or a gyroscope) is built into the display module. Such a sensor can collect the instantaneous velocity and acceleration of the display module, thereby determining the motion trajectory of the display module based on the collected instantaneous velocity and acceleration and combining parameters such as time.

[0411] Operating systems typically provide users with a desktop or main interface, where users can customize icons (thumbnails) for certain files, applications, or programs. For example, in the example shown in FIG40 , the display module 2 images the main interface provided by the display module 2 on the lens 12, where users can customize icons (thumbnails) for certain files, applications, or programs.

[0412] Optionally, a fixed reference point is pre-selected on the lens to which the display module is connected as the origin. The display module moves from this origin, and its motion trajectory is continuously monitored. The position of any point on this motion trajectory relative to the origin can be used to represent the relative position of the display module relative to the connected lens. The relative positions of the thumbnails on the main interface on the lens are determined when the display module generates the image, meaning that the relative positions of the thumbnails on the lens are known.

[0413] For example, as shown in FIG42 , FIG42 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. For example, point P0 on the lens 12 is a pre-selected origin, and the display module 2 moves from the origin along the path l1 to point P1, and then moves to point P2 along the path l2. The motion trajectory l of the display module 2 at any time t in the motion process can be determined by monitoring the motion parameters of the display module 2 (such as speed, acceleration, etc.). The positional relationship of the end point of the motion trajectory at any time t relative to the origin P0 can represent the relative position of the display module 2 on the lens 12. For example, at time t1, the display module 2 moves to point P1. According to the determined path l1, the positional relationship of point P1 relative to the origin P0 can be determined, that is, the relative position of the display module 2 on the lens 12, which is exemplarily represented as Indicates that point P1 is located at the vector At the end point, the vector The starting point is P0.

[0414] Similarly, when the motion trajectory of the display module 2 from point P1 to point P2 is l2, the position relationship of P2 relative to P1 can be expressed as Indicates that point P2 is located at the vector At the end point, the vector The starting point is P1. Based on the mathematical vector relationship, Therefore, there is Obviously, the above vector actually shows the displacement of module 2 during this process.

[0415] It should be noted that in the above examples, when describing the path and movement trajectory of the display module 2, a straight trajectory (path) is used as an example. Obviously, the display module 2 can be moved arbitrarily and is not limited to the form of the straight trajectory in the above examples, such as a curved trajectory.

[0416] When the display module 2 images the main interface on the lens 12, the relative positions of the thumbnails on the main interface on the lens 12 are known. Based on the known relative positions of the thumbnails on the lens 12 and the monitored relative position of the display module 2 on the lens 12, the relative position relationship between the display module 2 and the thumbnails on the main interface can be determined.

[0417] When it is detected that the display module is placed on a thumbnail, the thumbnail is enlarged and displayed on the display module.

[0418] For example, in FIG40 , the user moves the display module 2 onto the thumbnail [A], and the thumbnail [A] is displayed in an enlarged manner in the display area 21 of the display module 2 .

[0419] In this embodiment of the present application, when the display module images the main interface on the connected lens, the relative position between the display module and each thumbnail on the main interface is detected. If the display module is detected to be positioned over a thumbnail, the thumbnail is enlarged. This allows the user to confirm whether to select the thumbnail. This allows the user to interact with the thumbnails accurately to a certain extent without confusion or errors.

[0420] In some optional embodiments, the control method of the display module provided in the embodiment of the present application further includes: when it is detected that the display module is placed on at least one thumbnail, enlarging and displaying the thumbnail of the at least one thumbnail closest to the display module on the display module.

[0421] For example, in FIG43 , the display module 2 is moved and placed above the thumbnails [D1], [D2], and [D3]. When determining the distance between the display module 2 and the thumbnails, the distance between the center point of the thumbnail and the center point of the display area of ​​the display module 2 is used as a basis. Obviously, the thumbnail [D1] is closer to the display module 2, so the thumbnail [D1] is enlarged and displayed in the display area 21 of the display module 2.

[0422] In some optional implementations, the control method of the display module provided in the embodiment of the present application further includes:

[0423] In the case where the thumbnail is enlarged, detecting contact of a touch portion on the display module;

[0424] When it is detected that the touch portion is touched according to a first touch pattern, the display module is controlled to image a graphical interface of an application associated with the enlarged thumbnail in a preset imaging area on the lens; the first touch pattern is preset as a trigger condition for the application associated with the enlarged thumbnail

[0425] The first touch mode may be a single tap, a double tap, a triple tap, or the like.

[0426] When a thumbnail is magnified and displayed on the display module, and the user touches the touch portion of the display module according to the first touch pattern, it is determined that the user intends to launch (or enter) the application associated with the magnified thumbnail. Therefore, when a thumbnail is magnified and displayed on the display module, and it is detected that the touch portion of the display module has been touched according to the first touch pattern, the application associated with the thumbnail is run in the foreground, and the display module is controlled to image the graphical interface of the application associated with the magnified thumbnail within the preset imaging area on the lens. If the application associated with the thumbnail is already running in the background, it is switched to the foreground. This facilitates the user's selection of a thumbnail on the main interface to enter the associated application and access its associated functions.

[0427] For example, in the aforementioned example where the thumbnail [A] is magnified and displayed, if it is detected that the touch portion of the display module 2 is touched according to the first touch pattern while the thumbnail [A] is magnified and displayed, the application associated with the thumbnail [A] is run in the foreground, and the display module 2 is controlled to image the graphical interface of the application associated with the magnified thumbnail [A] in the preset imaging area 121 on the lens. For example, in the aforementioned example where the thumbnail [D1] is magnified and displayed, the application associated with the thumbnail [D1] is run in the foreground, and the display module 2 is controlled to image the graphical interface of the application associated with the magnified thumbnail [D1] in the preset imaging area 121 on the lens.

[0428] In an embodiment of the present application, when the display module images the main interface on the connected lens, the relative position between the display module and each thumbnail on the main interface is detected. When it is detected that the display module is placed on a thumbnail, the thumbnail is enlarged. This allows the user to confirm whether the thumbnail needs to be selected. When the user touches the touch portion of the display module according to the first touch mode again, it is determined that the user wants to start (or enter) the application associated with the enlarged thumbnail, enter the application, and image its graphical interface. This achieves the goal of assisting the user in selecting a thumbnail in the main interface to enter the application associated with the thumbnail and use the related functions, thereby enabling the user to interact with these thumbnails accurately to a certain extent without confusion or errors.

[0429] In some optional implementations, the control method of the display module provided in the embodiment of the present application further includes:

[0430] When the display module images the main interface in the preset imaging area on the lens, monitoring the movement state of the display module, detecting contact of the touch portion on the display module, and acquiring multimedia data;

[0431] When the display module is monitored to be rotating along its axis, or when it is detected that the touch portion is touched in accordance with the second touch mode, or when a page turning instruction is recognized in the multimedia data, the display module is controlled to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface imaged; the display module is rotating along its axis, the second touch mode and the page turning instruction are preset as trigger conditions for triggering a page turning function.

[0432] When the display module images the main interface within the preset imaging area on the lens, the display module's motion state is monitored, contact with a touch portion on the display module is detected, and multimedia data is acquired. The description of monitoring the display module's motion state and detecting touch portions on the display module is previously described and will not be repeated here. The display module can acquire multimedia data through its own camera, microphone, etc., or from a network or a connected smart terminal or near-eye display device.

[0433] For example, as shown in Figures 44 and 45, Figures 44 and 45 are schematic diagrams of an application scenario of a display module provided in an embodiment of the present application. The display module 2 can be rotated counterclockwise along the axis shown in Figure 47 as a trigger condition for triggering the main interface to turn up (or down), and the display module 2 can be rotated clockwise along the axis shown in Figure 45 as a trigger condition for triggering the main interface to turn down (or up). When the display module 2 is detected to be rotating counterclockwise (or clockwise), the display module 2 is controlled to update the main interface currently imaged on the lens 12, that is, the display module 2 is controlled to image the previous page (or next page) of the main interface on the lens 12.

[0434] For example, the second touch mode may include two different touch modes, such as a single click and a double click, or a double click and a triple click. One of the two different touch modes is a trigger for turning the page up, and the other is a trigger for turning the page down. For example, when a single click is detected, the main interface page turns up, i.e., the display module 2 is controlled to image the previous page of the main interface on the lens 12; when a triple click is detected, the main interface page turns down, i.e., the display module 2 is controlled to image the next page of the main interface on the lens 12.

[0435] It should be noted that the first touch mode and the second touch mode should be two completely different touch modes to ensure that the application is launched from the main interface and the page turning function of the main interface is carried out in an orderly manner without errors.

[0436] For example, the multimedia data is voice data or gesture data. When a voice command or target gesture for turning a page is recognized therefrom, the main interface turns a page, that is, the display module 2 is controlled to image the previous page (or next page) of the main interface on the lens 12.

[0437] In some optional embodiments, detecting that the display module is rotated when it is placed on a thumbnail is preset as a trigger condition for the main interface zoom function. Clockwise (or counterclockwise) rotation of the display module is preset as a trigger condition for zooming in on the thumbnail below the display module; and counterclockwise (or clockwise) rotation of the display module is preset as a trigger condition for zooming in on the main interface.

[0438] Exemplarily, as shown in FIG46 , in the scenario shown in FIG45 , when the display module 2 rotates clockwise, the thumbnail is enlarged [J]; as shown in FIG46 , in the scenario shown in FIG45 , when the display module 2 rotates counterclockwise, the current page of the main interface is scaled.

[0439] In some optional implementations, the control method of the display module provided in the embodiment of the present application further includes:

[0440] When the display module images a graphical interface of an application within a preset imaging area on the lens, monitoring the motion state of the display module, detecting contact of a touch portion on the display module, and acquiring multimedia data;

[0441] When it is detected that the motion state is the axial rotation of the display module, or when it is detected that the touch portion is touched according to the target touch pattern, or when a target instruction is recognized in the multimedia data, the display module is controlled to update the first target area of ​​the graphical interface of the application imaged in the preset imaging area on the lens; the first target area is the graphic area corresponding to the sub-function in the application, and the axial rotation of the display module, the target touch pattern and the target instruction are preset as trigger conditions for triggering the sub-function of the application.

[0442] For example, if the image currently represents a graphical interface for a music player function, the counterclockwise rotation of the display module 2 can be preset as a trigger condition for switching to the previous song (or the next song), and the clockwise rotation of the display module 2 can be preset as a trigger condition for switching to the next song (or the previous song). When the counterclockwise (or clockwise) rotation of the display module 2 is detected, the song currently being played is switched, and the display module 2 is controlled to update the music player interface currently imaged on the lens 12, that is, the display module 2 is controlled to update the song information in the music player interface imaged on the lens 12 to the information of the previous song (or the next song).

[0443] Among them, the multimedia data can be image / video data collected by the micro camera built into the display module or voice data collected by the micro microphone, and the eye tracking data is the user's eye image data collected by the micro camera built into the display module.

[0444] The target touch pattern can be a single click, a double click, a triple click, and the like. The target instruction can be a preset target gesture, a target voice, and the like. The target eye movement pattern can be the movement of the eyeballs according to a preset rule. Similarly, the target touch pattern and the target instruction are similar to the aforementioned display module axis rotation, and they can also be preset as trigger conditions for the sub-functions of the application. In the case where it is detected that the touch portion of the display module is touched according to the target touch pattern, or in the case where a target instruction is identified from the multimedia data, the trigger (preset) trigger condition is the target touch pattern, the target instruction, and the sub-function of the application of the display module axis rotation, thereby controlling the display module to update the area in the graphic interface currently imaged on the lens. The principle is similar to the principle of the aforementioned display module axis rotation triggering the sub-function of the application, thereby controlling the display module to update the area in the graphic interface currently imaged on the lens, and will not be repeated here. Those skilled in the art can refer to the above text for understanding.

[0445] In some optional implementations, the method for controlling the display module further includes:

[0446] When it is detected that the display module rotates at an angle not less than a preset first threshold angle β, the display module is controlled to update the graphic interface imaged in the preset imaging area on the lens.

[0447] The first threshold angle β can be flexibly set by those skilled in the art or users according to actual needs, for example, it can be 15°, 20°, 25° or 30°.

[0448] This can prevent the display module 2 from being slightly driven to rotate its axis and then starting to update the graphic interface imaged on the lens 12. Therefore, the sub-functions of the third logic function that are falsely triggered can be reduced to a certain extent.

[0449] It should be noted that although the above examples are all described with monocular (i.e., the display module provided by the embodiment of the present application is connected to only one lens of the glasses) as an example, it is obvious that all the implementation methods provided in the present application can also be applied to binocular scenarios (i.e., the display modules provided by the embodiment of the present application are connected to both lenses of the glasses).

[0450] The connection method of the projection device provided in the embodiment of the present application can be executed by the control device of the display module. In the embodiment of the present application, the control device of the display module executing the control method of the display module is used as an example to illustrate the control device of the display module provided in the embodiment of the present application.

[0451] FIG48 is a schematic diagram showing the structure of a control device for a display module provided in an embodiment of the present application. Referring to FIG48 , the control device 500 for the display module is configured to be placed on an optical lens and to output image content. The control device 500 includes:

[0452] A first detection module 510 is configured to detect relative positions between the display module and each thumbnail on the main interface when the image formed by the display module in the preset imaging area on the lens is the main interface;

[0453] The first magnifying module 520 is configured to magnify and display a thumbnail on the display module when detecting that the display module is placed on a thumbnail.

[0454] In some optional implementations, the apparatus 500 further includes:

[0455] The second magnifying module is configured to magnify and display on the display module a thumbnail of the at least one thumbnail that is closest to the display module when detecting that the display module is placed on at least one thumbnail.

[0456] In some optional implementations, the apparatus 500 further includes:

[0457] a second detection module, configured to detect contact of a touch portion on the display module when the thumbnail is enlarged;

[0458] The first control module is configured to control the display module to image a graphical interface of an application associated with the enlarged thumbnail in a preset imaging area on the lens when detecting that the touch portion is touched according to a first touch pattern; the first touch pattern is preset as a trigger condition for the application associated with the enlarged thumbnail.

[0459] In some optional embodiments, the device 5 further includes:

[0460] a first monitoring module, configured to monitor the motion state of the display module when the image formed by the display module in the preset imaging area on the lens is a main interface;

[0461] The second control module is used to control the display module to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface when the display module is detected to be undergoing axial rotation; the axial rotation of the display module is preset as a trigger condition for triggering a page turning function.

[0462] In some optional embodiments, the device 5 further includes:

[0463] a third detection module, configured to detect contact of a touch portion on the display module when the image formed by the display module in the preset imaging area on the lens is a main interface;

[0464] The third control module is configured to control the display module to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface imaged when detecting that the touch portion is touched in accordance with a second touch mode; the second touch mode is preset as a trigger condition for triggering a page turning function.

[0465] In some optional implementations, the apparatus 500 further includes:

[0466] A first acquisition module is configured to acquire multimedia data when the image formed by the display module in the preset imaging area on the lens is a main interface;

[0467] A fourth control module is configured to control the display module to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface imaged when a page turning instruction is recognized in the multimedia data; the page turning instruction is preset as a trigger condition for triggering the page turning function.

[0468] In some optional implementations, the apparatus 500 further includes:

[0469] a second monitoring module, configured to monitor the motion state of the display module when the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application;

[0470] A fifth control module is configured to control the display module to update a first target area of ​​the graphical interface of the application imaged within a preset imaging area on the lens when it is detected that the motion state is axial rotation of the display module; the first target area is a graphic area corresponding to a sub-function in the application, and the axial rotation of the display module is preset as a trigger condition for triggering the sub-function of the application.

[0471] In some optional implementations, the apparatus 500 further includes:

[0472] a fourth control module, configured to detect contact of a touch portion on the display module when the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application;

[0473] a sixth control module, configured to control the display module to update a first target area of ​​the graphical interface of the application imaged within a preset imaging area on the lens when detecting that the touch portion is touched according to a target touch pattern; the first target area is a graphical area corresponding to a sub-function in the application, and the target touch pattern is preset as a trigger condition for triggering the sub-function of the application.

[0474] In some optional implementations, the apparatus 500 further includes:

[0475] a second acquisition module, configured to acquire multimedia data when the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application;

[0476] a seventh control module, configured to control the display module to update a first target area of ​​the graphical interface of the application imaged within a preset imaging area on the lens when a target instruction is identified in the multimedia data; the first target area being a graphical area corresponding to a sub-function in the application, and the target instruction being preset as a trigger condition for triggering the sub-function of the application.

[0477] The control device 5 of the display module in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a car electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (Ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (Personal Digital Assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (Personal Computer, PC), a television (Television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

[0478] The control device 5 of the display module in the embodiment of the present application can be a device having an operating system. The operating system can be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0479] The control device 500 of the display module provided in the embodiment of the present application can implement each process implemented in the embodiments of Figures 1 to 46. To avoid repetition, they will not be described here.

[0480] In some optional embodiments, as shown in Figure 19, the embodiment of the present application also provides an electronic device 130, including a processor 131 and a memory 132, and the memory 132 stores a program or instruction that can be run on the processor 131. When the program or instruction is executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0481] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0482] FIG20 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0483] The electronic device 140 includes, but is not limited to, components such as a radio frequency unit 141, a network module 142, an audio output unit 143, an input unit 144, a sensor 145, a display unit 146, a user input unit 147, an interface unit 148, a memory 149, and a processor 1410. Those skilled in the art will appreciate that the electronic device 140 may also include a power supply (such as a battery) to power each component. The power supply may be logically connected to the processor 1410 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system. The electronic device structure shown in FIG48 does not constitute a limitation of the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be described in detail here.

[0484] The processor 1410 is configured to:

[0485] When the image formed by the display module in the preset imaging area on the lens is a main interface, detecting the relative position between the display module and each thumbnail on the main interface;

[0486] When it is detected that the display module is placed on a thumbnail, an application associated with the thumbnail is run, and the display module is controlled to image a graphic interface of the application in a preset imaging area on the lens.

[0487] It should be understood that in an embodiment of the present application, the input unit 144 may include a graphics processing unit (GPU) 1441 and a microphone 1442, and the graphics processor 1441 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 146 may include a display panel 1461, and the display panel 1461 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 147 includes a touch panel 1471 and at least one of other input devices 1472. The touch panel 1471 is also called a touch screen. The touch panel 1471 may include two parts: a touch detection device and a touch controller. Other input devices 1472 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0488] The memory 149 can be used to store software programs and various data. The memory 149 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 149 may include a volatile memory or a non-volatile memory, or the memory 149 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 149 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0489] Processor 1410 may include one or more processing units. Optionally, processor 1410 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1410.

[0490] The control method of the display module provided in the embodiment of the present application can be executed by a near-eye display device. In the embodiment of the present application, the near-eye display device is used as an example to illustrate the near-eye display device provided in the embodiment of the present application.

[0491] In some optional embodiments, as shown in Figure 21, the embodiment of the present application also provides a near-eye display device 150, including a processor 151 and a memory 152, and the memory 152 stores a program or instruction that can be run on the processor 151. When the program or instruction is executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0492] Any of the above-mentioned product embodiments can implement the various processes of the above-mentioned display module control method embodiment through its own processor operation, and can achieve the same technical effect. To avoid repetition, they will not be described one by one.

[0493] Any of the above-mentioned product embodiments can implement the various processes of the above-mentioned display module control method embodiment through its own processor operation, and can achieve the same technical effect. To avoid repetition, they will not be described one by one.

[0494] The present application also provides a readable storage medium having a program or instruction stored thereon. When the program or instruction is executed by a processor, each process of the control method embodiment of the display module described above is implemented, and the same technical effect is achieved. To avoid repetition, the details are not described here. The processor is the processor in the electronic device or electronic system described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0495] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned display module control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0496] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0497] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the control method embodiment of the display module as described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0498] In the embodiments provided in the examples of the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device implementation described above is only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0499] In addition, each functional unit in each implementation of the embodiment of the present application may be integrated into a processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The above-mentioned integrated units may be implemented in the form of hardware or software functional units.

[0500] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0501] Near-eye display devices, also known as head-mounted displays or wearable displays, are applied to optical lenses. In some cases, at the technical level, augmented reality (AR), virtual reality (VR), mixed reality (MR), and extended reality (XR) can all be referred to as near-eye displays. The optical lenses in the examples of this application can be goggles, smart glasses, myopia glasses, hyperopia glasses, sports glasses, or other near-eye or head-mounted optical lenses, etc. The user's optical lenses can be facing the human eye. The near-eye display device has an optical machine, which may include a microdisplay, such as Micro-LED (Micro Light-Emitting Diode), uLED (Micro Light-Emitting Diode), Micro-oled (Micro Organic Light-Emitting Diode), LCoS (Liquid Crystal On Silicon), LCD (Liquid Crystal Display), DMD (Digital Micromirror Device) / DLP (Digital Light Processing) or LBS (Laser Beam Scanning), etc., or any combination of these technologies. It can be understood that the optical machine may also include a micro-optical module, etc. The micro-optical module is arranged in front of the microdisplay, and the light of the display is emitted after passing through the micro-optical module. The description of the microdisplay in other embodiments of the present application can refer to this relevant description.

[0502] The near-eye display device may also include a circuit board, a battery for supplying power to the optical engine and the circuit board, and electrical components for achieving electrical connection between the components and the battery. Taking AR glasses as an example, under normal circumstances, the circuit board and electrical components such as the battery are installed on the temples of the AR glasses, the optical engine is installed on the optical lens, and a channel for wiring is provided on the outside of the optical engine to facilitate power supply to the optical engine. Because in some cases, the temples of AR glasses need to rotate relative to the frame, the connection between the optical engine and electrical components such as the battery is affected by the relative movement of the temples, resulting in relative misalignment and short circuit in the wiring of the optical engine and electrical components such as the battery; with the relative movement of the temples, the wiring parts of the optical engine and electrical components such as the battery are also prone to water ingress and other problems, affecting the use of AR glasses. Under normal circumstances, the near-eye display device is usually a head-mounted display or other wearable display, which is set in front of the human eye's field of vision. The structure is relatively complex, which increases the difficulty of fixing the product, affecting the production efficiency of the product.

[0503] In response to the above-mentioned problems, the present application proposes a near-eye display module for optical lenses, which can be directly mounted on a frame or an optical lens. The near-eye display module includes a first connecting portion for connecting the optical lens and a mounting seat for mounting an optical engine; a first electrical compartment for mounting electrical components is provided on the first connecting portion, and a mounting seat is formed with a mounting groove for mounting the optical engine. The mounting seat is located on one side of the first connecting portion along a first direction, and the first direction is set at an angle to the axial direction of the mounting groove. In the example of the present application, a first electrical compartment is set in the first connecting portion, which can facilitate the installation of electrical components such as batteries on the first connecting portion, reducing the need for a separate wiring structure for connecting the battery and the optical engine outside the optical lens, thereby reducing problems such as water ingress at the electrical connection part caused by the movement of the temple relative to the frame; since the axial direction of the mounting groove is set at an angle to the first direction, the mounting seat and the first electrical compartment are set along the first direction, which can facilitate the reduction of the thickness of the near-eye display device. After being installed on the optical lens, the visual pressure on the human eye can be reduced, thereby improving the comfort of the product.

[0504] Please refer to Figure 49. For the convenience of description, the following is an example of the near-eye display module 2 in the example of this application being used for glasses. The glasses may include a frame 11, an optical lens 12 and a temple 13. The optical lens 12 may be mounted on the frame 11, and the temple is connected to the frame 11. The near-eye display module 2 may be mounted on the frame 11 and / or the optical lens 12, which may reduce the need for overly large power supply modules such as batteries on the temples, or reduce the need for wiring parts between the temples and the optical lens 12 for connecting power supply modules such as batteries and the near-eye display module 2. This may reduce problems such as water ingress, disconnection, and short circuits in the wiring parts caused by the relative movement of the temples and the lenses. The display component 1 can be combined with existing ordinary glasses such as myopia, hyperopia, eye protection, and sports glasses to achieve the function of enhanced display, so that ordinary glasses have the augmented reality function of smart glasses.

[0505] 50 , 51 and 52 , the present application discloses an example of a near-eye display module 2 , which will be described in detail below.

[0506] The near-eye display module 2 includes a first connecting portion 101 and a mounting base 105. The first connecting portion 101 is used to connect to the optical lens 12 and / or the frame. The first connecting portion 101 is provided with a first electrical compartment 1110 for installing electrical components; the mounting base 105 is connected to one side of the first connecting portion 101 along the first direction 2a. The mounting base 105 is formed with a mounting groove 1401 for installing the optical machine 400. The first direction 2a is set at an angle to the axial direction of the mounting groove 1401.

[0507] Please refer to Figures 51 and 52 in combination. The first connecting part 101 can serve as the main structure of the near-eye display module 2 and is used to be connected to the optical lens 12. In this example, a fixing surface 1203 can be provided on the first connecting part 101. The fixing surface 1203 can be made of plastic or other materials. The fixing surface 1203 is used to connect to the optical lens 12 or to the frame. The first connecting part 101 in this example can be directly connected to the optical lens 12, or it can be connected to the optical lens 12 through other intermediate connecting parts such as magnetism, hooks, etc. The first connecting part 101 in this example can be fixedly connected to the optical lens 12. For example, the first connecting part 101 can be bonded to the optical lens 12 so that the first connecting part 101 maintains a relatively fixed position on the optical lens 12. The first connecting part 101 in this example can be movably mounted on the optical lens 12. For example, the first connecting part 101 can be connected to the optical lens 12 in a relatively sliding manner or in a relatively rotatable manner. In this example, the first connecting portion 101 can also be detachably mounted on the optical lens 12. For example, the first connecting portion 101 can be snapped or adsorbed on the optical lens 12. The fixing surface 1203 can also be provided with a buffer layer to reduce wear on the optical lens 12.

[0508] Referring to Figures 51, 5, and 54, the first connecting portion 101 is at least partially hollow, and the first electrical compartment 1110 is a hollow cavity defined within the first connecting portion 101. The first electrical compartment 1110 is used to house electrical components. The electrical components in this example include, but are not limited to, batteries 8 and circuit boards. For ease of description, the following description assumes that the first electrical compartment 1110 is equipped with batteries 8.

[0509] The mounting base 105 is used to mount the optical engine 400 . A mounting groove 1401 is defined on the mounting base 105 . The mounting groove 1401 may be a through groove penetrating the mounting base 105 or a recessed groove defined on the mounting base 105 .

[0510] The mounting groove 1401 has an axial direction, and the optical engine 400 has a light-emitting surface and an optical axis perpendicular to the light-emitting surface. In some examples, the light-emitting surface of the optical engine 400 is located on one side of the axial direction of the mounting groove 1401. In this example, the light-emitting surface of the optical engine 400 can be perpendicular to the axial direction of the mounting groove 1401, and the optical axis of the corresponding optical engine 400 can be parallel to the axis of the mounting groove 1401; or, the light-emitting surface of the optical engine 400 is not perpendicular to the axis of the mounting groove 1401, and the optical axis of the optical engine 400 is set at an angle to the first direction, and the optical axis of the optical engine 400 can be neither parallel to nor coincident with the first direction. As shown in Figure 50, the 2b direction can be the axial direction of the mounting groove 1401, and the optical axis of the optical engine 400 can be set along the 2b direction. The mounting seat 105 in this example can be separately set from the first connecting part 101 and connected to each other, or the mounting seat 105 can be set integrally with the first connecting part 101.

[0511] The mounting seat 105 is connected to one side of the first connecting portion 101 along the first direction 2a, so that the mounting seat 105 and the first connecting portion 101 are arranged along the first direction 2a. The first direction 2a is set at an angle to the axial direction of the mounting groove 1401, which means that the first direction 2a and the axial direction of the mounting groove 1401 are neither parallel nor overlapped. As shown in Figures 50 and 54, the axial direction of the mounting groove 1401 can be perpendicular to the first direction 2a. In this example, since the first connecting portion 101 is provided with the first electrical compartment 1110 and the mounting seat 105 is provided with the mounting groove 1401, when the mounting seat 105 and the first connecting portion 101 are arranged along the first direction 2a, the first electrical compartment 1110 and the mounting groove 1401 can be arranged roughly along the first direction 2a, so that the first electrical compartment 1110 and the mounting groove 1401 can be staggered with each other along the first direction 2a. It is understandable that the axial direction of the installation groove 1401 may not be perpendicular to the first direction 2a. When the installation groove 1401 and the first electrical compartment 1110 are arranged along the first direction 2a, the thickness of the near-eye display module 2 in the axial direction of the installation groove 1401 can also be reduced to a certain extent. After the optical engine 400 is installed in the installation groove 1401 and the battery 8 is installed in the first electrical compartment 1110, since the battery 8 and the optical engine 400 can be roughly distributed along the first direction 2a, the axial side of the installation groove 1401 can be used as the light output side of the optical engine 400. When the near-eye display module 2 is installed on the outside of the optical lens 12 and the light passes through the optical lens 12 to enter the human eye, the overall thickness of the near-eye display module 2 on the optical lens 12 is relatively small, and the optical engine 400 can be powered without increasing the overall thickness of the AR device; when the near-eye display module 2 is installed on the inside of the optical lens 12, the light does not pass through the lens, and the light can directly enter the human eye. Since the overall thickness of the near-eye display module 2 does not need to be increased, the sense of intrusion of the near-eye display module 2 on the human eyeball can be reduced, thereby reducing the sense of oppression brought to the user by the near-eye display module 2 and improving the comfort of the product. In the example of the present application, the first electrical compartment 1110 and the mounting slot 1401 are arranged along the first direction 2a, so that the electrical structures such as the battery 8 in the first electrical compartment 1110 and the optical machine 400 in the mounting slot 1401 can maintain relative balance on the near-eye display module 2 to balance the counterweight of the near-eye display module 2, which helps to improve the stability of the near-eye display module 2 on the optical lens 12.

[0512] In this example, since the battery 8 or the related circuit board can be directly installed in the first electrical compartment 3, the additional electrical components for connecting the optical machine 400 and the battery 8 at the connection between the temple 13 and the frame 11 of the AR device can be reduced. On the one hand, the problem of water ingress or wear of the electrical components caused by the relative movement of the temple and the frame 11 can be reduced; on the other hand, the complexity of the connection between the temple and the frame 11 can be reduced, and the structure of the AR device can be simplified. In some application scenarios, the near-eye display module 2 can work independently (for example, displaying image content, etc.) without being connected to the electrical components of the temple, which greatly improves the portability and mobility of the display component 1, and is compatible with other traditional head-mounted devices such as myopia and hyperopia, eye protection, helmets, etc., and the application scenarios are more diverse.

[0513] In this example, a first wire hole 15 can be opened on the first connecting portion 101 to directly connect the first electrical compartment 1110 and the mounting groove 1401, so as to connect the battery 8 and the optical machine 400 from the inside of the near-eye display module 2 through electrical components; by installing the battery 8 inside the first connecting portion 101, the need for wiring structures outside the first connecting portion 101 or the mounting seat 105 can be reduced, and when packaging the near-eye display module 2, the packaging steps can be simplified, thereby improving the production efficiency of the product. In this example, a first wire hole 15 can also be opened on the first connecting portion 101 to connect the first electrical compartment 1110 and the outer wall of the first connecting portion 101, and the battery 8 and the optical machine 400 in the first electrical compartment 1110 can be connected by the electrical structure passing through the first wire hole 15.

[0514] The optical engine 400 in the example of the present application may include an optical module 42 and a micro display 41 . The optical module 42 and the micro display 41 may be connected and fixed to each other, or the optical module 42 and the micro display 41 may be connected and fixed to the mounting base 105 separately.

[0515] Please refer to Figures 50, 51 and 55 to 58. In some examples, the first connecting part 101 includes a first cover body 102 and a second cover body 103; the first cover body 102 is provided with a first electrical appliance compartment 1110; the second cover body 103 covers the first cover body 102, and the second cover body 103 is used to close the first electrical appliance compartment 1110; at least one of the first cover body 102 and the second cover body 103 is connected to the mounting base 105.

[0516] The first electrical appliance compartment 1110 may be a groove formed on the first cover 102 . The first electrical appliance compartment 1110 may have an opening, and the battery 8 may be placed into the first electrical appliance compartment 1110 through the opening.

[0517] The second cover 103 is connected to the first cover 102 and can be used to close the opening of the first electrical appliance compartment 1110 .

[0518] Referring to Figures 50, 51, 55, and 56, in this example, the opening of the first electrical compartment 1110 can be opened on one side of the first cover body 102 along the second direction 2b, and the second cover body 103 can be covered on the first cover body 102 along the second direction 2b. The second direction 2b can be parallel to the axial direction of the mounting groove 1401. In this example, the end surface of the first cover body 102 facing away from the second cover body 103 can serve as the fixing surface 1203 of the first connecting portion 101, or the end surface of the second cover body 103 facing away from the first cover body 102 can serve as the fixing surface 1203 of the first connecting portion 101.

[0519] Please refer to Figures 57 and 58. In this example, the opening of the first electrical appliance compartment 1110 can be opened on one side of the first cover body 102 along the first direction 2a, and the opening of the first electrical appliance compartment 1110 can be set away from the mounting seat, and the second cover body 103 can cover the first connecting part 101 along the first direction 2a.

[0520] In this example, by combining the first cover 102 and the second cover to form the first connecting portion 101, it is convenient to open the first electrical compartment 1110 on the first cover 102, which can facilitate molding and mold opening when processing the first cover 102. In this example, the first cover 102 and the second cover 103 can be fixedly connected to each other, for example, the first cover 102 and the second cover 103 can be adhesively fixed to each other. In this example, the first cover 102 and the second cover 103 can also be detachably connected, for example, the first cover 102 and the second cover 103 can be clipped or threaded to each other. In some examples, one of the first cover 102 and the second cover 103 is provided with a positioning column 1204, and the other is provided with a positioning hole 117. The positioning column 1204 can be embedded in the positioning hole 117 to facilitate the mutual positioning and installation of the first cover 102 and the second cover 103.

[0521] In this example, at least one of the first cover 102 and the second cover 103 is connected to the mounting base 105, which means that the mounting base 105 is connected to one of the first cover 102 or the second cover 103, or the mounting base 105 is connected to both the first cover 102 and the second cover 103. Taking the mutual engagement of the mounting base 105 and the first connecting portion 101 in this example as an example, the mounting base 105 can be mutually engaged with one of the first cover 102 or the second cover 103, or the mounting base 105 can be simultaneously engaged with the first cover 102 and the second cover 103.

[0522] Please refer to Figures 52, 54 and 55. In some examples, a first wiring groove 113 connecting the installation groove 1401 and the first electrical compartment 1110 is opened on the first cover body 102. The first wiring groove 113 is used for the conductive module of the optical machine 400 to pass through and connect to the electrical device.

[0523] For the convenience of explanation, in this example, the electrical device is taken as a battery 8, and the conductive module can be connected to the corresponding electrode of the battery 8. The first wiring groove 113 connects the mounting groove 1401 and the first electrical compartment 1110, so that the conductive module of the optical machine 400 can enter the first electrical compartment 1110 through the first wiring groove 113. The conductive module of the optical machine 400 in the example of this application can be a wire, a metal sheet, a flexible circuit board or a copper-plated layer, etc. By providing a first wiring groove 113 for arranging the conductive module on the first cover body 102, it is convenient to arrange the conductive module inside the first connecting part 101, and the conductive module of the optical machine 400 is not exposed to the outside of the first connecting part 101, so as to reduce the problem of water ingress and short circuit in the wiring part. The wiring groove in this example can be a through groove that passes through the first cover body 102 near one end of the mounting seat 105. In this example, the first wiring groove 113 can be used to allow the conductive module of the light engine 400 to pass through and connect to the positive terminal of the battery 8. The first wiring groove 113 can also be used to allow the conductive module of the light engine 400 to pass through and connect to the negative terminal of the battery 8. The first wiring groove 113 can also be used to allow the conductive module of the light engine 400 to pass through and connect to the positive and negative terminals of the battery 8. In some examples, the second cover 103 is covered on the first cover 102 along the second direction 2b described in the above example. The first wiring groove 113 can have an opening facing the second cover 103. The second cover 103 can cover the opening of the first wiring groove 113 so that one end of the first wiring groove 113 is connected to the mounting groove 1401 and the other end is connected to the first electrical compartment 1110.

[0524] In some examples, a first wire passing hole 15 is opened on the first cover body 102, one end of the first wire passing hole 15 is connected to the first wiring groove 113, and the other end is connected to the installation groove 1401. The first wire passing hole 15 is used to accommodate the conductive module of the optical machine 400. The conductive module of the optical machine 400 passes through the first wire passing hole 15 and is connected to the electrical device via the first wiring groove 113.

[0525] Please refer to Figure 55. In some examples, the first cover body 102 is provided with a first recess 112 for accommodating the electrode. The first recess 112 is connected to the first wiring groove 113 and the first electrical compartment 1110. The electrode can be used to connect the conductive module and the electrical device. For example, the electrode can be used to connect the corresponding electrode of the battery 8.

[0526] The first sink 112 is connected to the first wiring groove 113 and the first electrical compartment 1110, which means that the first sink 112 has at least an opening that is respectively connected to the first wiring groove 113 and the first electrical compartment 1110, so that the pole piece in the first sink 112 can be used to connect the electrical device and the conductive module in the first wiring groove 113. The pole piece described in this example can be a metal sheet or other structure that can be used for conduction. The first sink 112 in this example can serve as an intermediate connector between the electrical device and the conductive module to facilitate the connection between the conductive module and the electrical device. Taking the electrical device as a battery 8 as an example, since the pole piece can be installed in the first wiring groove 113, the pole piece does not occupy the space of the first electrical compartment 1110, which can reduce the interference of the pole piece on the battery 8, improve the convenience of installing the battery 8, and also help to improve the stability of the battery 8.

[0527] Referring to Figures 51, 52, and 55, in some examples, assuming the electrical device is a battery 8, the first electrical compartment 1110 has an opening facing the second cover 103 and a bottom wall disposed opposite the opening. A first recess 112 is defined in the bottom wall of the first electrical compartment 1110. The opening of the first electrical compartment 1110 allows the battery 8 to enter the first electrical compartment 1110. The bottom wall of the first electrical compartment 1110 is disposed opposite the opening of the first electrical compartment 1110, and the bottom wall of the first electrical compartment 1110 can be located at the deepest installation position of the battery 8 within the first electrical compartment 1110. The first recess 112 is defined in the bottom wall of the first electrical compartment 1110 so that after the electrodes are installed in the first recess 112, they do not occupy the internal space of the first electrical compartment 1110. In some examples, the opening of the first electrical appliance compartment 1110 can be located on a side of the first cover 102 away from the mounting seat 105 along the first direction 2a, the second cover 103 can cover the opening of the first electrical appliance compartment 1110 along the first direction 2a, the bottom wall of the first electrical appliance compartment 1110 can be located on a side of the first electrical appliance compartment 1110 closer to the mounting seat 105 along the first direction 2a, and the first wiring groove 113 can connect the mounting groove 1401 and the first sink 112 nearby. In some examples, the second cover 103 covers the opening of the first electrical appliance compartment 1110 along the second direction 2b, the bottom wall of the first electrical appliance compartment 1110 can be located on an end surface of the first electrical appliance compartment 1110 along the second direction 2b, and the first wiring groove 113 can be located partially on the bottom wall of the first electrical appliance compartment 1110 and partially on the side wall of the first electrical appliance compartment 1110, and connected to the mounting groove 1401.

[0528] In some examples, the first cover 102 further defines a second wiring slot 116 that connects the mounting slot 1401 and the first electrical compartment 1110. The second wiring slot 116 is used to allow the conductive module of the optical engine 400 to pass through and connect to the electrical component. In this example, the electrical component is a battery. In this example, the second wiring slot 116 cooperates with the first wiring slot 113 to allow the conductive module of the optical engine 400 to connect to the positive and negative terminals of the battery 8, respectively. For example, if the conductive module of the optical engine 400 passes through the first wiring slot 113 and connects to the positive terminal of the battery 8, the second wiring slot 116 is used to allow the conductive module of the optical engine 400 to pass through and connect to the negative terminal of the battery 8. In this example, the electrical component is also a combination of a battery 8 and a circuit board. The second wiring slot 116 can be used to allow the conductive module of the optical engine to pass through and connect to the circuit board and the optical engine 400. In this example, the first wiring slot 113 and the second wiring slot 116 can be interconnected, or the first wiring slot 113 and the second wiring slot 116 can be provided independently of each other. In some examples, the first wire hole 15 described in any of the above examples is opened at one end of the first cover 102 close to the mounting groove 1401 , and the first wiring groove 113 and the second wiring groove 116 can be connected to the first wire hole 15 respectively.

[0529] Referring to Figures 54 and 56, in some examples, a second recess 1201 is provided on the side of the second cover 103 facing the first cover 102. The second recess 1201 is used to accommodate at least one of the battery 8, the circuit board, the magnet 53, and the counterweight. After the first cover 102 and the second cover 103 are covered with each other, the first cover 102 can seal the second recess 1201 of the second cover 103 so that the battery 8, the circuit board, the magnet 53, or the counterweight in the second recess 1201 will not be exposed outside the first connecting portion 101. In this example, by providing the second recess 1201, it is convenient to add structures such as the battery 8 inside the first connecting portion 101 to extend the battery life of the near-eye display module 2. The circuit board structure of the near-eye display module 2 can be installed in the second sink 1201. While balancing the counterweight of the near-eye display module 2 through the circuit board, the circuit board and other structures are stored inside the first connecting part 101, reducing the laying of the circuit board outside the near-eye display module 2, which helps to simplify the structure of the near-eye display module 2 and improve its assembly performance. The second sink 1201 can also be used to install magnets 53 and / or counterweights, and the near-eye display module 2 can be adsorbed to a preset position on the optical lens 12 through the magnet 53, so that the position of the near-eye display module 2 on the optical lens 12 can be adjusted as needed to accommodate users with different pupil distances. The second sink 1201 in this example can also be used to install other functional modules.

[0530] Continuing with Figures 54 and 56 , in some examples, the second cover 103 overlies the first cover 102 along a second direction 2b, which is arranged at an angle to the first direction 2a. A third wiring slot 1202 is defined in the second cover 103, connecting the mounting slot 1401 and the second recessed slot 1201. In this example, the third wiring slot 1202 has at least an opening connecting the mounting slot 1401 and the second recessed slot 1201, facilitating electrical connection between the electrical components within the second recessed slot 1201 and the optical engine 400. In this example, the second cover 103 overlies the first cover 102 along a second direction 2b, which can be parallel to the axial direction of the mounting slot 1401. The depth of the second recessed slot 1201 in this example can be determined based on the number, shape, and volume of batteries 8, circuit boards, magnets 53, and / or counterweights to be installed. Optionally, the second sink 1201 and the first sink 112 are arranged relative to each other to save space inside the first connecting part 101. The second sink 1201 in this example can provide sufficient space inside the near-eye display module 2 to facilitate the expansion of functional components of the near-eye display module 2 when needed. In some application scenarios, for example, the adsorption force of a single magnetic attraction on the battery may not be sufficient to support the near-eye display module 2 on the optical lens 12. In order to achieve greater suction clamping, a metal block or magnet can be added to the second sink 1201 to achieve a more stable magnetic clamping between the first connecting part 101 and the external magnet.

[0531] Referring to Figures 50, 51, and 55, in some examples, a through hole 114 is defined in the first connection portion 101. One end of the through hole 114 communicates with the first electrical compartment 1110, and the other end extends through the outer wall of the first connection portion 101. The through hole 114 is used to allow electrical components to move in and out of the first connection portion 101. The near-eye display module 2 also includes a sealed compartment cover 115, which is used to seal the through hole 114. In this example, the through hole 114 extends through the side wall of the first connection portion 101 and connects to the first electrical compartment 1110, allowing electrical components within the first electrical compartment 1110 to move outward from the first connection portion 101 through the through hole 114. For example, the battery 8 can enter the first electrical compartment 1110 through the through hole 114, facilitating installation of the battery 8. The sealed compartment cover 115 is mounted on the first connection portion 101 to facilitate sealing the through hole 114 when needed. The sealed compartment cover 115 can be annular or have a mounting groove, and the battery 8 can be installed in the sealed compartment cover 115. Since the sealed compartment cover 115 surrounds the battery 8 in the entire circumference, the battery 8 can be put in and taken out. The sealed compartment cover 115 can also be provided with a handle position so that it can be exposed relative to the first cover body 102, which is convenient for user operation. When the battery 8 is installed in the first electrical compartment 1110, the battery 8 can be embedded in the first electrical compartment 1110 through the through hole 114, and the through hole 114 can be closed with the sealed compartment cover. The sealed compartment cover in this example can be consistent with the shape and size of the through hole 114 so that the sealed compartment cover can completely close the through hole 114; the sealed compartment cover in this example can also cover the outer surface of the first connecting part 101 to cover the through hole 114 from the outer surface of the first connecting part 101; the sealed compartment cover in this example can also be partially embedded in the through hole 114 and partially cover the outer surface of the first connecting part 101 to facilitate the fixing of the sealed compartment cover. Optionally, the first connecting portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples. The through hole 114 can be provided on the first cover 102 or the second cover 103. For ease of description, the following description uses the example of the through hole 114 provided on the first cover 102. In some examples, the first cover 102 is provided with the first recessed groove 112 described in any of the above examples. The first recessed groove 112 is used to mount a pole piece, and the first recessed groove 112 can be staggered with the through hole 114.

[0532] Referring to Figures 51 and 54, in some examples, the near-eye display module 2 further includes an annular fixing portion 1151 connected to the sealed compartment cover 115. The annular fixing portion 1151 is configured to be sleeved around the periphery of the electrical component, and the through-hole 114 is also configured to allow the annular fixing portion 1151 to move toward the outside of the first connecting portion 101. In this example, the annular fixing portion 1151 is configured to be sleeved around the periphery of the electrical component. When the sealed compartment cover 115 moves toward the outside of the first connecting portion 101 through the through-hole 114, the annular fixing portion 1151 can drive the electrical component to move synchronously, thereby facilitating the assembly and disassembly of the electrical component. In this example, the annular fixing portion 1151 can be integrally provided with the sealed compartment cover 115, or the annular fixing portion 1151 can be separate from the sealed compartment cover 115 and connected to each other. In this example, the annular fixing portion 1151 can be a complete annular structure or a partially disconnected annular structure.

[0533] Referring to Figures 50 and 51 , in some examples, through-hole 114 is provided at an end of first connecting portion 101 away from mounting base 105. Through-hole 114 is used to allow the electrical device to move along first direction 2a. In this example, since mounting base 105 is provided on one side of first connecting portion 101 along first direction 2a, allowing the electrical device to move along first direction 2a via through-hole 114 can reduce interference with the electrical device during assembly and disassembly.

[0534] Referring to Figures 57 and 58 , in some examples, the first connecting portion 101 includes a first cover 102 and a second cover 103. The first cover 102 is connected to the mounting base 105 and defines a first electrical compartment 1110. The first cover 102 has an opening on the side of the first cover 102 facing away from the mounting base 105, which communicates with the first electrical compartment 1110. The second cover 103 covers the first cover 102 and covers the opening of the first cover 102 along the first direction 2a. The second cover 103 covers the side of the first cover 102 facing away from the mounting base 105 to seal the first electrical compartment 1110. The opening is used to allow electrical components such as the battery 8 to enter the first electrical compartment 1110. In this example, by covering the second cover 103 on the first cover 102 along the first direction 2a, the interference of the mounting base 105 on the second cover 103 can be reduced, thereby improving the installation performance of the first cover 102 and the second cover 103. In some examples, a second recessed groove 1201 can be opened on the second cover 103 at a position corresponding to the first electrical compartment 1110. When the first cover 102 and the second cover 103 cover each other to form the first connecting portion 101, the electrical device can be partially located in the second recessed groove 1201. Optionally, the second recessed groove 1201 can also be used to install other functional modules such as circuit boards and magnets. In some examples, the first wiring groove 113 described in any of the above examples is opened on the first cover 102 to facilitate the connection between the conductive module of the optical machine 400 and the electrical device; the first wiring groove 113 can be located on the side of the first cover 102 away from the second cover 103. In some examples, the first sinking groove 112 described in any of the above examples may be further provided on the first cover 102 , and the first sinking groove 112 may be connected to the first wiring groove 113 .

[0535] Referring to Figures 52 and 58, in some examples, a protrusion 104 is provided on one side of the first connecting portion 101 near the mounting seat 105. There are two protrusions 104, which are spaced apart. The mounting seat 105 is connected to the two protrusions 104, respectively. The two protrusions 104 and the mounting seat 105 together form a mounting groove 1401. In this example, the two protrusions 104 are spaced apart so that the optical engine 400 can be partially located between the two protrusions 104. The mounting seat 105 is connected to the two protrusions 104, respectively, and together with the two protrusions 104, forms a mounting groove 1401. In some examples, a groove is provided on the side of the mounting seat 105 facing the first connecting portion 101. The groove of the mounting seat 105 and the gap between the two protrusions 104 together form the mounting groove 1401. The protrusion 104 in this example can serve as a connection point between the first connection part 101 and the mounting base 105 to enhance the firmness of the connection point between the first connection part 101 and the mounting base 105. When wiring the optical machine 400, optionally, a first wire-passing hole 15 is provided on the first connection part 101 to connect the mounting groove 1401 and the first electrical compartment 1110. The first wire-passing hole 15 is used to accommodate the conductive module of the optical machine 400; the end of the first wire-passing hole 15 away from the first electrical compartment 1110 is located between the two protrusions 104. Since the two protrusions 104 are spaced apart from each other, the first wire-passing hole 15 can be hidden between the two protrusions 104 to reduce the exposure of the conductive module of the optical machine 400 assembly, thereby reducing the problem of water ingress into the near-eye display module 2.

[0536] In some examples, one of the mounting base 105 and the protrusion 104 is provided with a snap-in member 1402, and the other is provided with a slot 1301, and the snap-in member 1402 is snap-fitted to the slot 1301. The snap-in member 1402 and the slot 1301 in this example are adapted to each other to mount the mounting base 105 on the protrusion 104. For ease of description, the following is an example in which the slot 1301 is provided on the protrusion 104 and the snap-in member 1402 is provided on the mounting base 105. Optionally, the slot 1301 in this example can be a straight slot, a T-slot, or a slot structure of other shapes. Optionally, the snap-in member 1402 in this example can be provided integrally with the mounting base 105, or can be provided separately from the mounting base 105 and connected to the mounting base 105.

[0537] 57 and 58 , in some examples, the first connection portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, with the second cover 103 covering the first cover 102 along the first direction 2a. The protrusion 104 is provided on a side of the first cover 102 away from the second cover 103.

[0538] Referring to Figures 50 to 56 , in some examples, the first connecting portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, with the second cover 103 covering the first cover 102 along the second direction 2b. The protrusion 104 is provided on one end of the first cover 102 or the second cover 103 near the mounting seat 105.

[0539] Referring to Figures 50 to 56, in some examples, the first connecting portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, with the second cover 103 covering the first cover 102 along the second direction 2b. The first cover 102 and the second cover 103 are respectively provided with the aforementioned protrusions 104 at one end near the mounting base 105, and the engaging member 1402 on the mounting base 105 is simultaneously engaged with the protrusions 104 of the first cover 102 and the second cover 103. Optionally, the clamping member 1402 can be a T-shaped structure, and the protrusions 104 on the first cover body 102 and the second cover body 103 are respectively provided with clamping grooves 1301. When the second cover body 103 is covered on the first cover body 102, the clamping grooves 1301 on the first cover body 102 and the second cover body 103 are enclosed to form a T-shaped groove, and the clamping member 1402 is clamped in the T-shaped groove to prevent the mounting seat from moving relative to the first connecting portion 101 along the first direction 2a.

[0540] Please refer to Figures 50 to 54. In some examples, the near-eye display module 2 also includes a fixing base 600, which is installed in the installation groove 1401. The fixing base 600 is provided with a fixing groove 610 for installing the optical machine 400; the fixing base 600 is provided with a second wire hole 620, and the second wire hole 620 is used to accommodate the conductive module of the optical machine 400; one end of the second wire hole 620 is connected to the fixing groove 610, and the other end passes through the outer wall of the fixing base 600.

[0541] The fixing base 600 is used to mount the optical engine 400 on the mounting base 105 and also protects the optical engine 400. The fixing groove 610 can be a through groove or a recessed groove formed in the fixing base 600. In this example, the fixing base 600 can be fixedly connected to the mounting base 105 or can be removably mounted on the mounting base 105. The second wire hole 620 serves as a channel for accommodating the conductive module of the optical engine 400, facilitating the wiring of the optical engine 400.

[0542] In some examples, the first connection portion 101 is provided with a first wire passing hole 15 as described in any of the above examples, and the second wire passing hole 620 can be connected to the first wire passing hole 15 .

[0543] In some examples, the axial direction of the second wire-passing hole 620 is set at an angle to the axial direction of the fixing groove 610. The second wire-passing hole 620 in this example is used for the conductive module of the optical machine 400 to pass through, so that the conductive module of the optical machine 400 is connected to the electrical components in the first electrical compartment 1110. The shape of the fixing groove 610 in this example can be adapted to the shape of the optical machine 400, and the fixing groove 610 has an opening. The opening of the fixing groove 610 can be set on the same side as the light-emitting side of the optical machine 400, and the axial direction of the fixing groove 610 is set at an angle to the first direction 2a. Optionally, the axial direction of the fixing groove 610 can be perpendicular to the plane where the opening of the fixing groove 610 is located. The axial direction of the second wire-passing hole 620 is set at an angle to the axial direction of the fixing groove 610, which means that the axial direction of the second wire-passing hole 620 is not parallel to nor coincident with the axial direction of the fixing groove 610. In this example, the above arrangement allows the conductive module of the optical engine 400 to be extended from the side of the fixing base 600, thereby shortening the distance between the conductive module of the optical engine 400 and the first electrical compartment 1110. Since the conductive module can be extended from the side of the fixing base 600, the fixing groove 610 can be configured as a sunken groove structure in this example to facilitate sealing between the optical engine 400 and the inner wall surface of the fixing groove 610.

[0544] In some examples, the fixing base 600 is provided with a second electrical compartment 630, and the second wire hole 620 is connected to the fixing groove 610 through the second electrical compartment 630. The second electrical compartment 630 in this example can be used to accommodate structures such as the optical machine and the circuit board, so that the circuit module of the optical machine 400 can be built into the fixing base 600, thereby simplifying the structure of the near-eye display module 2, improving the compactness of the product, facilitating the packaging of the product, and facilitating the functional expansion of the near-eye display module 2. The second electrical compartment 630 in this example is connected to the second wire hole 620, which can facilitate the conductive module and circuit board of the optical machine 400 to be led out through the second wire hole 620 for easy wiring.

[0545] Referring to Figures 52 and 54 , in some examples, one of the outer wall of the mounting base 600 and the inner wall of the mounting slot 1401 is a convex curved surface, while the other is a concave curved surface that matches the convex curved surface. The mounting slot 1401 is configured to allow the mounting base 600 to rotate within it to adjust the light output angle of the optical engine 400. In this example, the convex and concave curved surfaces are adapted to each other, meaning that the convex curved surface can fit together to allow the mounting base 600 to rotate relative to the mounting slot 1401. When the mounting base 600 rotates relative to the mounting base 105, the optical engine 400 on the mounting base 600 can also rotate synchronously, thereby causing the light output angle of the optical engine 400 to change synchronously. In this example, by adjusting the position of the optical engine 400 relative to the human eye's field of view, the position of the optical engine 400 can be accurately adjusted to meet the needs of different users with different interpupillary distances or fields of view, and to meet the viewing needs and preferences of different users. Furthermore, this also provides flexible position testing during early R&D to achieve the desired design effect.

[0546] In this example, the outer surface of the fixing base 600 can be at least partially spherical, and the inner wall surface of the mounting groove 1401 can be a concave arc surface, so that the fixing base 600 can rotate relative to the mounting base 105 within the mounting groove 1401. Optionally, in this example, the outer surface of the fixing base 600 can also be a concave arc surface, and the inner wall surface of the mounting groove 1401 can be a convex arc surface, so that the fixing base 600 can rotate relative to the mounting base 105 within the mounting groove 1401.

[0547] Based on the above-mentioned near-eye display module 2, the present application further proposes an example of a near-eye display device, which is used for an optical lens 12 and includes the near-eye display module 2 as in any of the above-mentioned examples, wherein the first connecting portion 101 of the near-eye display module 2 is connected to the optical lens 12. In this example, the first connecting portion 101 can be fixedly connected to the optical lens 12 or detachably connected to the optical lens 12.

[0548] It can be understood that the examples of the near-eye display device of the present application include the near-eye display device in any of the above examples, and also include the technical effects in any of the above examples, so they will not be repeated.

[0549] Please refer to Figures 49 and 59. In some examples, the first connecting portion 101 of the near-eye display module 2 is connected to the first side of the optical lens 12; the near-eye display device also includes a second connecting portion 500, which is arranged opposite to the first connecting portion 101 and is used to connect to the second side of the optical lens 12. The first side and the second side of the optical lens 12 are two oppositely arranged sides; the first connecting portion 101 and the second connecting portion 500 are used to clamp the lenses to each other and allow the mounting seat 105 to move on the lens to adjust the position of the optical machine 400 relative to the lens.

[0550] In some examples, the second connection portion 500 may be a component connected and fixed to the first connection portion. For example, the first connection portion 101 may be fixed to the second connection portion 500 by bonding, clamping, threading, etc., or the first connection portion 101 may be connected to the second connection portion 500 via an intermediate connection member. In some examples, the first connection portion 101 and the second connection portion 500 may be independent components, and the first connection portion 101 may cooperate with the second connection portion 500 to serve as a clamping or adsorption element.

[0551] Please refer to Figure 59. In some examples, the second connecting part 500 is at least partially made of magnetic material. The second connecting part 500 in this example can be made of magnetic material as a whole or partially. As shown in Figures 49 to 59, the second connecting part 500 includes a sleeve 510 and a magnet 53 embedded in the sleeve 510. Since structures such as the battery 8 can be adsorbed by the magnet 53, when the first connecting part 101 and the second connecting part 500 are respectively arranged on both sides of the optical lens 12, the second connecting part 500 can adsorb the first connecting part 101 at a preset position on the optical lens 12. In some examples, the first connecting part 101 includes the first cover body and the second cover body in any of the above examples, and a second sink groove is provided on the second cover body. The second sink groove can be used to install a magnet to improve the adsorption performance of the first connecting part and the second connecting part.

[0552] In some examples, a protective member 520 is provided on the second connecting portion 500. The protective member 520 may be a protective film or a protective cover. The protective member 520 is used to block between the magnet 53 and the optical lens 12 to reduce wear on the optical lens 12. Optionally, an opening is opened at one end of the sleeve 510 for the magnet 53 to pass through and be embedded in the sleeve 510. The protective member 520 includes a protective layer 523 and a fixing layer 525 connected to the protective layer 523. The protective layer 523 covers the opening of the sleeve 510 to block between the magnet 53 and the optical lens 12. The fixing layer 525 is disposed inside and outside the sleeve 510 to improve the sealing performance of the second connecting portion 500.

[0553] Referring to FIG. 49 , in some examples, the first connecting portion 101 has a fixing surface 1203, which is disposed opposite the second connecting portion 500. The fixing surface 1203 is disposed on the same side as the light-emitting side of the optical engine 400. In this example, the fixing surface 1203 can be a surface on the first connecting portion 101. The fixing surface 1203 is disposed on the same side as the light-emitting side of the optical engine 400. When the near-eye display device is installed, the near-eye display module 2 is located outside the optical lens 12, and the second connecting portion 500 can be located inside the optical lens 12 to reduce the visual intrusion of the near-eye display device on the user and improve product comfort.

[0554] In some examples, the difference from the previous example is that the fixing surface 1203 is located away from the light-emitting side of the optical engine 400. In this example, the fixing surface 1203 can be a surface on the first connecting portion 101. The fixing surface 1203 is located on the opposite side of the light-emitting side of the optical engine 400. When the near-eye display device is installed, the near-eye display module 2 is located on the inner side of the optical lens 12, and the second connecting portion 500 can be located on the outer side of the optical lens 12.

[0555] Based on the above-mentioned examples of near-eye display devices, the present application also proposes an example of a wearable device, which can be glasses for near and far vision, sports, eye protection, etc., or a helmet or smart glasses, etc., including a near-eye display module or device as in any of the above examples.

[0556] Since head-mounted devices are often worn for long periods of time, smaller and lighter head-mounted devices are constantly pursued by major manufacturers. Existing modules such as prism technology are often relatively heavy and bulky, while optical waveguide technology has low optical efficiency. These existing technologies will greatly change the appearance and structural form of traditional head-mounted devices such as ordinary glasses or helmets for myopia, hyperopia, goggles, and sunglasses, making it extremely difficult to integrate existing technology solutions with existing traditional glasses, helmets, and other head-mounted devices. In addition, as devices that need to transmit information to the human retina, for example, head-mounted devices, it is very important that the content within the visual field of the human retina can be presented clearly and completely. In the case of combining virtual and real scenarios, obtaining virtual information content with a relatively larger field of view is becoming an increasingly important functional requirement. Better image quality and higher light efficiency are also very important. Lighter, smaller size, and compatibility with various head-mounted devices have become urgent issues to be solved. The present application embodiment provides an optical module 100', which can be applied to various related embodiments, which are described in detail below.

[0557] The optical module 100' can be applied to a near-eye display device 200', for example, in augmented reality (AR), virtual reality (VR), mixed reality (MR), and extended reality (XR), goggles, smart glasses, myopia glasses, hyperopia glasses, sports glasses, contact lenses, helmets, or other related near-eye display devices. Referring to Figures 60-74, the optical module 100' includes a base 10', including a first end 12' and a second end 14' opposite to each other. The base 10' can be solid, for example, made of a transparent or light-transmitting hard, machinable material, such as PMMA (polymethyl methacrylate), PC (polycarbonate) plastic, resin, glass, etc.; and can be in a regular shape, such as a cylinder, prism, or truncated cone, or can be in an irregular shape. In other embodiments, the base 10' may also have a hollow structure. For example, it may be formed by at least two groups of thin walls bonded together with optical glue. The center may be hollow, and the first reflective surface 20', the second reflective surface 30, the incident surface 40, the exit surface 50, etc. may be formed on the thin walls.

[0558] A first reflective surface 20 ′, disposed at the first end 12 ′ of the base 10 ′, and configured to allow reflection of light;

[0559] The second reflective surface 30, disposed at the second end 14' of the base 10', is configured to receive and re-reflect light reflected from the first reflective surface 20'. It is understood that the first end 12' and the second end 14' may be opposite ends. The first reflective surface 20' and the second reflective surface 30 may be provided with a reflective material, such as a metal or metal alloy, such as aluminum, silver, or a mixture of aluminum and silver.

[0560] An incident surface 40 is disposed at the second end 14' of the base 10' and is surrounded by the second reflective surface 30;

[0561] An exit surface 50 is disposed at the first end 12' of the base 10' and surrounds the first reflective surface 20'. The size of the exit surface 50 can be the same as the size of the second reflective window 1312. In other embodiments, the size of the exit surface 50 and the size of the second reflective window 1312 can also be different.

[0562] The annular side surface 60 has one end connected to the second reflective surface 30 and the other end connected to the emitting surface 50 .

[0563] Among them, the incident surface 40 and the exit surface 50 are one or a combination of aspherical, spherical, free-form surfaces, and the incident surface 40 is configured to receive light L from the image of the microdisplay 80. The light enters the substrate 10' through the non-planar (but one or a combination of aspherical, spherical, free-form surfaces) incident surface 40, is reflected by the first reflective surface 20', then reflected by the second reflective surface 3, and leaves the substrate 10' through the non-planar exit surface 50. The microdisplay 80 can be, for example, the technology or combination described in the above-mentioned related embodiments, which will not be repeated here. In some embodiments, the optical module can be combined with existing ordinary glasses such as myopia, hyperopia, eye protection, sports glasses, etc. to achieve the function of enhanced display, so that ordinary glasses have the augmented reality function of smart glasses. It can be understood that the black or shaded areas of each reflective surface (such as the first reflective surface 20', the second reflective surface 30) in the relevant figures of this application (such as 1-2, 8-11, etc.) only illustrate that they have a reflective layer and do not represent the actual thickness design.

[0564] It can be understood that in the prior art, in order to better enable the microdisplay 80 to fit with the incident surface 40 (for example, optical glue bonding, etc.), the incident surface 40 is generally a plane, and the integrity of the entire module is ensured during subsequent packaging (for example, a regular cylinder as a whole, etc.), and the exit surface 50 is also often designed to be a plane. However, the research of this application found that based on the size requirements in product design, such as miniaturization, lightweight and combination with existing glasses, the sizes of the incident surface, the first and second reflecting surfaces, and the exit surface cannot be arbitrarily increased. At this time, the optical module is limited to a small size within a fixed range, such as less than 5mm*5mm*5mm or even smaller. This application changes the original incident surface and exit surface from a plane to an aspherical surface, a spherical surface, a free-form surface or a combination thereof, and fully redesigns the shape structure of each surface so that the image light L of the microdisplay 80 enters from the non-planar incident surface 40, where the incident surface 40 is an aspherical surface, a spherical surface, a free-form surface or a combination thereof, and then enters the substrate. 10' to the first reflection surface 20', then reflected to the second reflection surface 30, and finally leaves the base 10' through the non-planar exit surface 50. The exit surface 50 can be one or a combination of an aspherical surface, a spherical surface, and a free-form surface. The light L (Figure 67) from the edge of the micro display 80 or near the edge position is more likely to move toward the optical axis, while the light L from the edge of the micro display 80 or near the edge position of the existing planar incident surface and exit surface cannot move toward the direction close to the optical axis, thereby effectively improving the utilization rate of the light from the edge of the micro display 80 or near the edge position, effectively reducing light loss, and effectively improving the light efficiency. In addition, the light in the prior art is not easy to move toward the optical axis, resulting in a small field of view angle, while the present application makes full use of the light L at the center and edge, so that the field of view angle is effectively improved. On the other hand, the folded light path effectively reduces the size of the entire optical system, making the entire module more portable, and the shorter reflection path reduces light loss and effectively improves the light efficiency, resulting in better overall imaging quality.

[0565] In some embodiments, the lateral dimension of the annular side surface 60 tends to decrease along the direction of the line connecting the second reflective surface 30 to the exit surface 50, that is, the maximum outer contour dimension of the exit surface 50 can be smaller than the maximum outer contour dimension of the second reflective surface 30, thereby ensuring that the light L entering from the edge of the incident surface 40 of the micro display 80 is effectively contracted to the position of the central optical axis Z, further effectively improving the field of view angle and improving the image imaging quality.

[0566] In some embodiments, referring to FIG. 62 , the first reflective surface 20 ′ and the second reflective surface 30 are one or a combination of aspherical, spherical, and free-form total internal reflection surfaces. It is understood that this type of reflection can effectively reduce optical loss and improve light efficiency and imaging quality. The incident surface 40 includes a first section and a second section from the center to the periphery. The first section is curved toward a first direction of the optical axis Z, which may be the positive direction of the optical axis Z (the light-emitting direction). The second section is curved toward a second direction of the optical axis Z opposite to the first direction, which may be the negative direction of the optical axis Z (away from the light-emitting direction). The first reflective surface 20 ′, the second reflective surface 30, and the exit surface 50 are curved toward the first direction of the optical axis Z, i.e., toward the positive direction of the optical axis Z. It can be understood that the first section of the incident surface 40 corresponds to the area of ​​the microdisplay 80 which is the center or close to the center of the microdisplay 80, and the second section corresponds to the area of ​​the microdisplay 80 which is the edge or close to the edge (relatively far from the center) of the microdisplay 80. Therefore, the light at the edge or close to the edge of the microdisplay 80 can be reflected as much as possible to the edge or close to the edge of the first reflecting surface 20', and then further reflected by the first reflecting surface 20' to the edge or close to the edge of the second reflecting surface 30. Finally, the non-planar exit surface 50 makes the light move closer to the center of the optical axis Z, thereby effectively improving the utilization rate of the light at the edge or close to the edge of the microdisplay 80, and improving the lighting effect and imaging quality. The first reflecting surface 20', the second reflecting surface 30, the exit surface 50 and the incident surface 40 can all adopt a non-planar design, for example, they can be an aspherical surface, a spherical surface, a free-form surface or a combination thereof, but their bending directions can be different. The first reflecting surface 20', the second reflecting surface 30 and the exit surface 50 can be the same. As described in Table 1 below, the sagittal values ​​of the first reflecting surface 20', the second reflecting surface 30 and the exit surface 50 are positive values, and the sagittal value of the incident surface 40 is positive in the range of 0-0.6mm and negative in the range of 0.65-0.85mm. It can be seen that the incident surface 40 is first bent toward the positive direction of the optical axis and then toward the negative direction of the optical axis. Combined with the design of other surfaces, it can effectively increase the field of view angle of the exiting light, improve the light efficiency, and achieve better image quality.

[0567] In some embodiments, the second reflecting surface 30, the exit surface 50, the incident surface 40 and the first reflecting surface 20' have a projected contour shape on the plane where the vertical optical axis Z is located. The contour shape can be a circle, an ellipse, a polygon, a rounded rectangle, a trapezoid, or other geometric shapes. The plane where the vertical optical axis Z is located can be, for example, a cross section, or a plane viewed from the first end 12' or the second end 14' or a corresponding top view or bottom view. The contour shapes of the incident surface 40 and the first reflecting surface 20' can be similar to each other, and the contour shapes of the second reflecting surface 30 and the exit surface 50 can be similar to each other. In other embodiments, as shown in Figure 68, the contour shape of the incident surface 40 can also be similar to the contour shape of the second reflecting surface 30; the contour shape of the exit surface 50 can also be similar to the contour shape of the first reflecting surface 20', for example, both are regular polygons, etc. It can be understood that the geometric shape of the outer contour of the relevant surface can be flexibly designed according to the outer contour of the microdisplay 80 or the entirety to meet the assembly requirements of different sizes and shapes and to fully obtain the light from the microdisplay 80. On the other hand, the second reflection surface 30, the exit surface 50, the incident surface 40 and the first reflection surface 20' can all be the same, for example, they can all be one of the circular, elliptical or regular polygonal contours, so that the light from the microdisplay 80 can be fully reflected and utilized to achieve better imaging quality and light extraction efficiency.

[0568] In some embodiments, referring to Figures 60, 62-64, the first reflecting surface 20' includes a first vertex O2, the second reflecting surface 30 includes a second vertex O3, the incident surface 40 includes a third vertex O4, and the exit surface 50 includes a fourth vertex O5; the first vertex O2, the second vertex O3, the third vertex O4 and the fourth vertex O5 are located on the optical axis Z, and the incident surface 40, the first reflecting surface 20', the second reflecting surface 30 and the exit surface 50 are symmetrically designed relative to the cross-section of the optical axis to ensure that the optical module 100' is not eccentric, that is, the optical path area on one side will not be too large or too small than the optical path area on the other side. It can be understood that the second vertex Q3 can be the point formed by the final intersection of the curved surface of the second reflecting surface 30 after being extended relative to the center of the incident surface 40. The dotted line in Figure 62(b) indicates that the extension toward the center intersects to form the second vertex Q3. Similarly, the fourth vertex Q5 can be the point formed by the final intersection of the curved surface of the exit surface 50 after being extended relative to the center of the first reflecting surface 20'. The dotted line in Figure 62(d) indicates that the extension toward the center intersects to form the fourth vertex Q5. It can be understood that the vertices of the second reflecting surface 30, the exit surface 50, the incident surface 40 and the first reflecting surface 20' are all located on the same optical axis Z, which can ensure the symmetry of the overall optical path. The second reflecting surface 30, the exit surface 50, the incident surface 40 and the first reflecting surface 20' can be designed symmetrically relative to the optical axis Z, or the above-mentioned surfaces can be designed symmetrically relative to the plane passing through the optical axis Z. The second reflecting surface 30, the exit surface 50, the incident surface 40 and the first reflecting surface 20' are coaxially designed, which can ensure that the entire optical path is not eccentric (deviating from the optical axis Z, etc.), ensuring clearer imaging and higher imaging quality.

[0569] In some embodiments, referring to Figures 60, 63, and 64, the incident surface 40 and the second reflective surface 30 intersect at a first intersection line 122', and the exit surface 50 and the first reflective surface 20' intersect at a second intersection line 124'. The first intersection line 122' and the second intersection line 124' here can be understood as the intersection of different surfaces, and are represented by dashed lines in the figures for ease of understanding. The shape of the intersection line can be determined by the outer contours of the incident surface 40 and the first reflective surface 20', or the inner contours of the second reflective surface 30 or the inner contours of the exit surface 50. For example, the intersection lines 122' and 124' can be circles, ellipses, polygons, etc. The shapes of the incident surface 40 and the first reflective surface 20' can also be circles, ellipses, polygons, etc. In some embodiments, the distance between the first vertex O2 and the third vertex O4 is not greater than 2.8 mm, that is, the center thickness of the optical module 100 ', for example, the center thickness along the optical axis Z is not greater than 2.8 mm, for example, it can be 2.8 mm, 2.5 mm, 2 mm, 1.8 mm, 1.6 mm, etc. In other embodiments, this thickness can also be understood as the average thickness between the exit surface 50 and the incident surface 40, or the average thickness of the entire substrate 10 ', etc.; the first intersection line 122 'relative to the second vertex The distance between the line connecting O3 and the third vertex O4 is no greater than 1.35 mm, that is, the radius of the incident surface 40 is no greater than 1.35 mm, and can be, for example, 1.35 mm, 1.2 mm, 1 mm, 0.8 mm, 0.6 mm, etc. The distance between the second intersection line 124' and the line connecting the first vertex O2 and the fourth vertex O5 is no greater than 1.5 mm, that is, the radius of the first reflecting surface 20' is no greater than 1.5 mm, and can be, for example, 1.5 mm, 1.3 mm, 1 mm, 0.85 mm, 0.75 mm, etc. In some embodiments, the corresponding radii (vertical distance from the outer contour to the vertex) of the annular side surface 60, the light-emitting surface 50 and the second reflective surface 30 may be no greater than 3 mm, that is, the radius of the annular side surface 60 is no greater than 3 mm, the radius of the light-emitting surface 50 is no greater than 3 mm, and the radius of the second reflective surface 30 is no greater than 3 mm, for example, they can be 3 mm, 2.8 mm, 2.5 mm, 2 mm, etc.; the distance from the second intersection line 124' to the edge of the exit surface 50 can have the same value in the circumferential direction, for example, the width value of the exit surface 50 remains consistent along the circumference of the first reflective surface 20'; wherein, the distance from the second intersection line 124' to the edge of the exit surface 50 is greater than 0 and less than or equal to 1.6 mm, for example, it can be 1 mm, 1.5 mm, 0.8, 0.7 mm, etc.It can be understood that the above parameters should not contradict each other when combined with each other. The above radius can be the radius parameter of the projection shape of each surface on a certain plane that is a circle, etc. In other embodiments, if the projection shape of the above-mentioned relevant surfaces on a certain plane is not a circle, such as a regular polygon, an ellipse or other regular figures, etc., the above radius can also be described as its maximum radius. For example, taking an ellipse as an example, its long side can be understood as the radius described above. The size design of the embodiment of the present application can make the entire optical module have a smaller volume and weight, and does not affect the light path transmission efficiency, which is conducive to mutual adaptation with the frame or lens of the existing near-eye display device (such as nearsightedness and farsightedness, eye protection, sports, smart glasses, helmets), and there is no need to significantly change the structural design of the existing display device, etc., and can achieve the compatibility of enhanced display and traditional display devices, improve the portability of the optical module and enrich the application scenarios.

[0570] In some embodiments, as shown in FIG73 , light from the microdisplay passes through the optical module and forms an image 310 from the pupil of the eyeball 300 to the retina. The positional structural relationship of the relevant components in FIG73 (such as the eyeball 300, the image 310, etc.) is only an exemplary descriptive diagram for convenience of calculation and understanding. The following calculation process can be performed in one dimension, and certain approximations such as small angles are performed to illustrate various principles, wherein the small angle approximation is: θ≈sinθ≈tanθ. The above calculation can be directly extended to two dimensions, and more accurate calculations can be performed. The field of view FOV (Field Of View) can be finally imaged by the optical module, from the retinal end, according to the optical expansion E eye Calculation formula:

[0571] In some embodiments, the lower limit of the field of view FOV can be obtained according to the derivation of the above formula {1}: in,

[0572] Among them, from the optical module end, according to the optical etendue E eye Calculation formula:

[0573] In some embodiments, the upper limit of the field of view FOV can be obtained according to the derivation of the above formula {3}:

[0574] In the above formula, FOV is the field of view, n eye is the refractive index of the eyeball, D p is the pupil diameter, θ eye I is the angle at which the retina receives light. eye The size of the retinal imaging image 310, D eye is the diameter of the eyeball, feye is the focal length of the eyeball, θ m is the effective emission angle of the microdisplay, Dm is the maximum outer diameter of the optical module (i.e., the maximum outer diameter of one of the annular side surface 60, the light emitting surface 50, and the second reflective surface 30), S1 is the diameter of the incident surface 40 (i.e., twice the distance between the first intersection line 122' and the line connecting the second vertex O3 and the third vertex O4), S2 is the diameter of the first reflective surface 20' (i.e., twice the distance between the second intersection line 124' and the line connecting the first vertex O2 and the fourth vertex O5), L m It is the thickness of the substrate 10', and may also be the center thickness of the optical axis or the average thickness of the substrate 10', or the average thickness from the micro display to the first reflective surface 20', etc.

[0575] It can be understood that the upper limit of the field of view angle is often more determined by the optical module parameters, and in actual design, the size of the optical module is generally restricted more strictly (or fixed), such as having a small size and being compatible with traditional head-mounted devices. Therefore, the lower limit of the field of view angle that can be met is often more important and can be designed according to actual needs. In the formula for the lower limit of the field of view angle FOV, the first term is the double integral of the angle over the size of the imaged image. In the design of the optical module, it exists as an implicit expression as a whole, and the incident surface 40 and the exit surface 50 are designed to be non-planar, where the non-planar can be one or a combination of an aspherical surface, a spherical surface, and a free-form surface. The non-planar can increase the double integral value, thereby increasing the lower limit of the field of view angle of the optical module (i.e., the minimum value). It can be seen that when the existing size and related parameters such as the eyeball are limited, the field of view angle is difficult to change within the limited size. Therefore, the present application changes the original planar design to a non-planar design by changing the shapes of the incident surface 40 and the exit surface 50, so that the light from the relative edge of the micro display can enter the first reflective surface 20' and be projected to the outside of the substrate 10' through the exit surface 50. In effect, the light from the edge of the micro display is more fully utilized, and a projected light with a larger angle relative to the optical axis Z can be formed, thereby forming a larger field of view angle, better lighting efficiency, and better imaging quality.

[0576] In some embodiments, the aspherical, spherical, or free-form surfaces of the incident surface 40, the first reflective surface 20', the second reflective surface 30, and the exit surface 50 can be described by polynomial sag equations, for example, calculated using Zernike polynomials. The polynomial sag equations can be:

[0577] in,

[0578] Z is the surface sag, that is, the distance from the vertex (such as s2' in Figure 62c), h is the radial distance (the distance from the curved surface to the optical axis, such as h2' in 3c), c is the curvature of the curved surface, k is the coefficient, and A, B, C, and D are the corresponding multi-order coefficients respectively; among them, when k, A, B, C, and D are zero, it can be the calculation formula of the sag of the sphere; as a free-form surface, multiple reference points can be taken as analytical expressions to obtain it; Figure 62 shows the outline schematic diagrams of each related surface, among which Figure 62(a) is the outline schematic diagram of the incident surface 40, Figure 62(b) is the outline schematic diagram of the second reflecting surface 30, Figure 62(c) is the outline schematic diagram of the first reflecting surface 20', and Figure 62(d) is the outline schematic diagram of the exit surface 50. Contour schematic diagram; taking the contour schematic diagram of the first reflecting surface 20' in Figure 62 (c) as an example, the first reflecting surface 20' has a vertex O2 and is bent about two orthogonal axes (for example, the hZ axis in the figure), the first reflecting surface 20' has at least one first position 212' having a radial distance h1 from the Z axis (optical axis) passing through the vertex O2, and having a displacement s2' relative to the h axis at the vertex O2. Table 1 below exemplarily describes the relevant parameters of some surfaces (part of which is exemplarily selected), where h4-Z4 correspond to the parameters of the incident surface 40, h2-Z2 correspond to the parameters of the first reflecting surface 20', h3-Z3 correspond to the parameters of the second reflecting surface 30, and h5-Z5 correspond to the parameters of the exit surface 50.

[0579] Table 1

[0580] In some embodiments, referring to Figures 65-66, the optical module also includes an outer edge 70, which is provided on the annular side 60. The height of the outer edge 70 may be higher than the annular side 60, wherein the outer edge 70 may be a full circle or spaced circumferentially, etc. The extension of the outer edge 70 in the optical axis Z direction may not exceed the annular side 60, that is, the thickness of the outer edge 70 may not exceed the height of the annular side 69, so the outer edge 70 may be a relatively thin protrusion, or the outer edge 70 may also be a thread or other clip-on structure, etc. In some embodiments, the outer edge 70 may be located at one end close to the exit surface 50, and the outer edge 70 is configured to be assembled with an external mechanism. The external mechanism may be, for example, a clamp, a jig, etc., so that the optical module can be conveniently clamped or transported to avoid damage to the substrate 10' or other surfaces, or the external mechanism may also be a related shell to which the optical module needs to be assembled, for example, the corresponding assembly shell is provided with a fixing groove, etc., and the entire optical module can be positioned or fixed by the outer edge 70.

[0581] In some embodiments, referring to Figures 65-66, the outer edge 70 is further provided with at least one straight edge 72. For example, if the outer edge 70 is circular, the straight edge 72 may be tangent to the outer edge 70. In other embodiments, the outer edge 70 may also be provided with two mutually parallel straight edges 72, or more straight edges, etc. Of course, if the outer edge itself can be a polygon, the straight edges of the polygon can be straight edges 72. The straight edges 72 are configured to cooperate with an external mechanism to position the base 10' for rotational adjustment. It is understood that the external mechanism can be, for example, a clamp or a jig, and the mutually parallel straight edges can better position or clamp the base 10'. In other embodiments, the external mechanism can be, for example, an assembly housing. Sometimes, it is necessary to rotate the optical module as a whole within the assembly housing, for example, to adjust the light output angle of the optical module, etc. In this case, the straight edges 72 can play a role in preventing mistakes and positioning.

[0582] In some embodiments, as shown in FIG61 , the optical module may further include a shielding layer 66 . Shielding layer 66 covers annular side surface 60 and is configured to block light from microdisplay 80 from being transmitted from annular side surface 60 to the exterior of substrate 10 ′. Shielding layer 66 may be a coating or material such as black epoxy, black silicone rubber, carbon black, nickel black, black chrome, or Vanta Black. Alternatively, it may be an opaque sealing sleeve. Shielding layer 66 ensures that light exits substrate 10 ′ via exit surface 50 rather than annular side surface 60, effectively improving optical efficiency.

[0583] In some embodiments, referring to Figures 68-71 , the annular side surface 60 further includes a first annular surface 62 and a second annular surface 64. The first annular surface 62 has a smaller circumferential dimension than the second annular surface 64. The first end of the first annular surface 62 is connected to the first reflective surface 20', the second end of the first annular surface 62 is connected to the first end of the exit surface 50, the second end of the exit surface 50 is connected to the first end of the second annular surface 64, and the second end of the second annular surface 64 is connected to the second reflective surface 30. The first and second ends of the first annular surface 62 are opposite ends, and the first and second ends of the second annular surface 64 are opposite ends. It will be appreciated that the exit surface 50 is located between the first and second annular surfaces 62, 64, which have different dimensions. In some embodiments, the first and second annular surfaces 62, 64 can have a gradually decreasing trend along the positive direction of the optical axis Z, thereby effectively collecting light. It will be appreciated that the first and second annular surfaces 62, 64 have significantly different lateral dimensions, forming a stepped structure, thereby further reducing the overall size and weight.

[0584] In some embodiments, in combination with Figure 70, the shielding layer 66 located on the second annular surface 64 extends from the edge of the exit surface 50 along the direction of the principle exit surface 50, and the end surface of the shielding layer 66 located on the second annular surface 64 is not higher than the end surface of the first reflection surface 20'. The shielding layer 66 located on the second annular surface 64 is long enough to block the light from entering the outside from the edge of the exit surface 50 too early, and can also reduce the formation of stray light.

[0585] In some embodiments, as shown in FIG72 , the optical module further includes a matte wall 90 , which may be made of a light-impermeable material (eg, the same material as the shielding layer 66 described above) or a material capable of blocking specific wavelengths, etc. The substrate 10', the first reflection surface 20', the second reflection surface 30 and the exit surface 50 respectively include at least two groups, and the extinction wall 90 is connected between two adjacent substrates 10', for example, located between the annular side surfaces 60 of two adjacent optical modules. The extinction wall 90 is configured to block the light from one of the substrates 10' from entering the other adjacent substrate 10'. It can be understood that in the two groups of optical modules, the substrates 10' and the substrates 10' are connected as a whole, wherein each optical module is correspondingly provided with a microdisplay 80, that is, a microdisplay is provided corresponding to a single incident surface. In other embodiments, a microdisplay can also correspond to multiple incident surfaces 40, wherein the height of the extinction wall 90 can be greater than or equal to the distance from the second reflection surface 30 to the exit surface 50, that is, ensuring that the light from the two adjacent substrates 10' does not crosstalk with each other, effectively reducing the generation of stray light.

[0586] The present application further provides a near-eye display device 200 ′, which includes:

[0587] microdisplay 80, and

[0588] In the optical module described in the above embodiment, the micro display 80 is mounted on the incident surface 40 .

[0589] In specific implementations, each of the above units or structures can be implemented as an independent entity, or can be arbitrarily combined to implement as the same entity or multiple entities. The specific implementation of each of the above units or structures can be referred to in the previous embodiments and will not be described in detail here. It is understood that the near-eye display device 200' may also include, for example, a frame, lenses, a circuit board, a power supply, an infrared sensor, a gyroscope, a temperature sensor, etc. The above components for installing or driving its operation are not described in detail here.

[0590] Referring to FIG. 74 , the present application further provides a method for processing an optical module, wherein the optical module is the optical module described in the above embodiment, and the processing method comprises the following steps:

[0591] S111, forming a base 10'; the base 10' can be formed by cutting, injection molding, or compression molding.

[0592] S112. Form an emission surface 50 and a first reflection surface 20' located at the center of the emission surface 50 on the first end 12' of the substrate 10'; wherein the emission surface 50 and the first reflection surface 20' are spherical surfaces, aspherical surfaces, free-form surfaces, or a combination thereof;

[0593] S113. An incident surface 40 and a second reflective surface 30 surrounding the incident surface 40 are formed on the second end 14' of the substrate; the incident surface 40 and the second reflective film 30 are one or a combination of spherical surfaces, aspherical free-form surfaces; the first end and the second end can be opposite ends; it can be understood that the corresponding spherical surfaces, aspherical surfaces, and free-form surfaces can also be formed by, for example, cutting, injection molding, or compression molding, etc.

[0594] S114. A reflective film is applied to the first reflective surface 20' and the second reflective surface 30. The coating can be formed using processes such as evaporation and sputtering. The incident surface 40 is configured to receive light from the image of the microdisplay 80. The light enters the substrate 10' through the aspherical incident surface 40, is reflected by the first reflective surface 20', then is reflected by the second reflective surface 30, and exits the substrate 10' through the aspherical exit surface 50. For other descriptions of the optical module, please refer to the description of the above embodiment and will not be repeated here.

[0595] Near-eye display devices generally adopt optical solutions such as optical waveguides or prisms. The light source (or image source) or part of the optics of such solutions are mostly set on the wearer's temples. In addition, optical solutions such as optical waveguides have special requirements for lenses. The size and weight of such devices are relatively large, and the user experience is not good for a long time. On the other hand, the display area of ​​the display module of such devices is fixed in position. If the display device needs to move freely or to a specific position in the display state, there will often be problems with power supply, because the wired electrical connection will often interfere with the movement of the display module due to the physical existence of the wires.

[0596] Please refer to Figure 75, which is a schematic diagram of the overall structure of an embodiment of the near-eye display device of the present application. It should be noted that the electronic device (near-eye display device) in the present application can be a smart glasses structure and form including AR, VR, XR, MR, etc. Among them, the near-eye display device 100 includes a frame 110, temples 120 and lenses 130, the temples 120 are connected to the frame 110, and the frame 110 is used to fix the lenses 130. The lenses can be used for myopia glasses, hyperopia glasses, goggles, sunglasses, smart glasses and helmets, etc. The features of this part are within the scope of understanding of those skilled in the art and will not be repeated here.

[0597] Optionally, please refer to Figures 76 to 79. Figure 76 is a schematic diagram of the overall structure of an embodiment of the near-eye display device of the present application without the temples, Figure 77 is a schematic diagram of another perspective of the embodiment of Figure 75, Figure 78 is a schematic diagram of the overall structure of the display module and the first coil, and Figure 79 is a schematic diagram of the structure of an embodiment of the display module provided with a coil bracket. The near-eye display device 100 includes a lens 130 and a display module 1400; the lens 130 includes an eye side 1320 and an environment side 1310; the display module 1400 is configured to generate light and project it onto the eye side 1320. 0, the first battery 123 and the display module 1400 are spaced apart; a first coil 1500 is arranged around the lens 130, the first coil 1500 surrounds the lens 130 and is electrically connected to the first battery 123, and the first coil 1500 forms at least one loop, which is used for electromagnetic induction with the second coil 1401' in the following embodiment; the display module 1400 can be detachably mounted at any position on the surface of the lens 130, and the display module 1400 is configured to be movable at any position on the surface of the lens 130, and the user can move the display module 1400 to the lens 130 as needed. 0 surface, the display module 1400 is used to display information, and a second coil 1401' is provided on the display module 1400; the second coil 1401' can be mutually inductive with the first coil 1500, for example, the first coil 1500 acts as a transmitter to convert an electric field into a magnetic field, and the second coil 1401' acts as a receiver to convert a magnetic field into an electric field, wherein the loop size formed by the second coil 1401' is smaller than the loop size formed by the first coil 1500. It can be understood that the above-mentioned induction is configured as wireless induction between the first coil 1500 and the second coil 1401' to realize the display module The first battery 123 powers the display module 1400 during movement of the lens 130 or when the display module 1400 is at any fixed position within a predetermined region of the lens 130. It will be appreciated that, because the first coil 1500 surrounds the lens 130, the display module can freely move on the surface of the lens 130, remaining at a fixed position when the user moves the display module to a desired viewing position. Whether moving or at a fixed position, wireless induction between the first coil 1500 and the second coil 1401' can provide power to the display module 1400. In some embodiments, the predetermined region may be the inner region of the lens 130 surrounded by the first coil 1500. In other embodiments, the predetermined region may be the outer region of the lens 130 surrounded by the first coil 1500. The user can freely select the location of the predetermined region as needed. The arbitrary fixed position may be any fixed position where the user stops after moving the display module. This position may depend on the user's operational needs or viewing requirements.For example, aligning the lens with the center of the eye's field of view is often the best position. Of course, if the user wants to see the real environment side 1310 physical world at this time, the display module 1400 can be moved to a position deviated from the center of the field of view. The user can even move the display module 1400 to the position of the lens 130 corresponding to the blind spot of the eye's field of view. At this time, the display module 1400 can be located on the first coil 1500 or on the outer ring of the first coil 1500, etc.

[0598] Optionally, in some embodiments, the display module 1400 can be placed on the lens 130 by clamping, adsorption, or the like, in which case the display module 1400 can move relative to the lens 130. In other embodiments, the display module 1400 can be fixed to the lens 130 by other means. As long as the display module 1400 can be installed, fixed, detached, and movable at any position on the lens 130, the present application encompasses such embodiments and is not specifically limited herein.

[0599] Optionally, please continue to refer to Figures 75 to 77, the first coil 1500 surrounds the lens 130; in some embodiments, the first coil 1500 can be embedded in the outer edge of the lens 130, optionally, the first coil 1500 can be wrapped around the outer edge of the lens 130, optionally, the first coil 1500 can be provided in the frame 110 and surround the lens 130, in other embodiments, the first coil 1500 can surround the lens 130 in other ways; optionally, the first coil 1500 can be located on the side facing the environment side 1310, for example, in a groove or in a groove on the side of the frame 110 facing the environment. Surface, etc. Optionally, the first coil 1500 can be located on the side facing the eye side 1320, such as in a groove or surface of the frame 110 facing the eye side 1320; the accompanying drawings only give some examples. In other embodiments, those skilled in the art can adjust the position of the first coil 1500 as needed. As long as the induced current of the first coil 1500 is made to surround the lens 130 to form a loop, and then to induce the second coil 1401' to each other, and to ensure that the display module 1400 can be electrically operated at any position on the surface of the lens 130, these are all embodiments included in this application and are not specifically limited here.

[0600] Please continue to refer to Figure 75. The near-eye display device 100 is further provided with a first electrical input interface 122. At least one of the first coil 1500 and the first battery 123 is electrically connected to the first electrical input interface 122. The first electrical input interface 122 can directly supply power to the first coil 1500 and the first battery 123. Optionally, the first coil 1500 is electrically connected to the first electrical input interface 122. Optionally, the first battery 123 is electrically connected to the first electrical input interface 122. Optionally, both the first coil 1500 and the first battery 123 are electrically connected to the first electrical input interface 122. Optionally, the first electrical input interface 122 can be a micro-USB interface. Optionally, the first electrical input interface 122 can be a lightning interface. Optionally, the first electrical input interface 122 can be a type-c interface.

[0601] Optionally, please refer to Figures 79 to 81 together, Figure 80 is a schematic diagram of the display module in the embodiment of Figure 79 being provided with a second battery, and Figure 81 is a schematic diagram of the structural disassembly of the display module in the embodiment of Figure 79; Optionally, the display module 1400 also includes a shell 1403, an optical component 1406 and a display unit 1407, the optical component 1406 is located at the light-emitting end of the display unit 1407, and the second coil 1401' is electrically connected to the display unit 1407; the shell 1403 is formed with a accommodating cavity 1405, and the optical component 1406, the display unit 1407 and the second coil 1401' are arranged in the accommodating cavity 1405.

[0602] Optionally, in some embodiments, the shape of the display module 1400 can be cylindrical, such as a cylinder or a prism. In other embodiments, the shape of the display module 1400 can be other irregular shapes, which is not specifically limited here. The accompanying drawings only provide an example...

Claims

1. A method for controlling a display module, wherein: The display module is configured to be placed on an optical lens, and the display module is configured to output image content, and the method includes: Monitoring the motion state of the display module on the lens currently connected; When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

2. The method according to claim 1, wherein: The target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logic function includes: a first logic function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logic function; when the target motion state is detected, controlling the display module to image a graphical interface of the target logic function on the lens includes: When it is detected that the movement of the display module on the lens satisfies a first preset condition, the display module is controlled to image a first graphic interface of the first logical function on the lens.

3. The method according to claim 2, wherein: The first preset condition includes one or a combination of the following: The displacement distance of the movement is not less than a preset first threshold length; The displacement distance of the movement is not less than a preset first threshold length, and the displacement direction of the movement is a preset first direction; The displacement distance of the movement is not less than a preset first threshold length, and the starting point of the movement is a preset first position, which is a fixed position selected on the lens; The displacement distance of the movement is not less than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position; The end point of the movement is a preset second position, and the second position is a fixed position selected on the lens; The shape similarity between the moving trajectory and the preset trajectory is not less than a preset first threshold.

4. The method according to claim 1, wherein: The target motion state includes: the display module is stationary at a third position on the lens, and the third position is a fixed position selected on the lens; the target logic function includes: a second logic function; the display module is stationary at the third position on the lens and is preset as a trigger condition for triggering the second logic function; when the target motion state is detected, controlling the display module to image a graphical interface of the target logic function on the lens includes: In a case where it is detected that the display module is stationary at a third position on the lens, the display module is controlled to image a second graphic interface of the second logical function on the lens.

5. The method according to claim 1, wherein: The target motion state includes: the display module performs axial rotation; the target logic function includes: a third logic function, the third logic function is the logic function currently running in the foreground; when the target motion state is detected, controlling the display module to image a graphical interface of the target logic function on the lens includes: When the axial rotation of the display module is detected, the display module is controlled to update the target area in the third graphic interface currently imaged on the lens; the third graphic interface is the graphic interface of the third logical function, and the target area is the graphic area corresponding to the sub-function in the third logical function; the axial rotation of the display module is preset as a trigger condition for triggering the sub-function in the third logical function.

6. The method according to claim 5, wherein: When the display module is detected to be rotating about its axis, controlling the display module to update a target area in a third graphic interface currently imaged on the lens comprises: When it is detected that the rotation angle of the display module during the axial rotation is not less than a preset first threshold angle, the display module is controlled to update the target area in the third graphic interface currently imaged on the lens.

7. The method according to claim 1, wherein: The method further comprises: detecting contact of a touch portion of the display module; The graphical interface of controlling the display module to image the target logic function on the lens when the target motion state is detected includes: When it is detected that the duration of the touch portion being touched is not less than a preset first threshold duration and the target motion state is monitored, the display module is controlled to image a graphic interface of the target logical function on the lens.

8. The method according to claim 7, wherein: The method further comprises: When it is detected that the touch portion is touched for a duration not less than a preset second threshold duration and it is monitored that the display module is always stationary on the lens, or when it is not detected that the touch portion is touched for a duration not less than a third threshold duration, the anti-false touch mode is started; the anti-false touch mode refers to a mode in which the display module is controlled to keep imaging a graphical interface of a logic function currently running in the foreground on the lens; The first threshold duration is shorter than the second threshold duration.

9. The method according to claim 8, wherein: The method further comprises: When it is detected again in the false touch prevention mode that the touch portion is touched for a duration not less than a fourth threshold duration, the false touch prevention mode is released; and the fourth threshold duration is less than or equal to the first threshold duration.

10. The method according to claim 9, wherein: The method further comprises: When the accidental touch prevention mode is activated, a prompt is outputted to prompt the user that the accidental touch prevention mode has been activated; When the accidental touch prevention mode is canceled, a prompt is outputted to prompt the user that the accidental touch prevention mode has been canceled.

11. The method according to claim 7, wherein: The method further comprises: When it is detected that the display module is stationary on the lens and the touch portion is touched, the display module is controlled to form an image of moving prompt content around the display module on the lens.

12. The method according to claim 7, wherein: The method further comprises: When it is monitored that the display module is stationary on the lens and the touch portion is detected to be touched according to the target touch mode, the display module is controlled to image the graphic interface of the target logical function on the lens, or the display module is controlled to update the target area in the third graphic interface currently imaged on the lens; the third graphic interface is the graphic interface of the third logical function, the third logical function is the logical function currently running in the foreground, and the target area is the graphic area corresponding to the sub-function in the third logical function; the target touch mode is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

13. The method according to claim 1, wherein: The method further comprises: Acquiring multimedia data; When it is monitored that the display module is stationary on the lens and a target instruction is identified from the multimedia data, the display module is controlled to image a graphical interface of the target logical function on the lens, or the display module is controlled to update a target area in a third graphical interface currently imaged on the lens; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target instruction is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

14. The method according to claim 1, wherein: The method further comprises: Obtain eye tracking data; When it is monitored that the display module is stationary on the lens and a target eye movement pattern is identified from the eye tracking data, the display module is controlled to image a graphical interface of the target logical function on the lens, or the display module is controlled to update a target area in a third graphical interface currently imaged on the lens; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target eye movement pattern is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

15. According to claim 1, when the target motion state is detected, controlling the display module to image the graphical interface of the target logic function on the lens comprises: When a target motion state is detected in a preset imaging area on the lens, controlling the display module to image a graphical interface of the target logic function on the lens; The method further comprises: When it is detected that the display module moves out of the preset imaging area, a low power consumption mode is started.

16. A display module control device, wherein: The display module is used to be connected to the lens of the glasses and to form an image on the connected lens. The control device includes: A first monitoring module, used for monitoring the motion state of the display module on the lens currently connected; The first control module is used to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected; the target motion state is preset as a trigger condition for triggering the target logic function.

17. The control device according to claim 16, wherein: The target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logic function includes: a first logic function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logic function; the first control module includes: The first control submodule is configured to control the display module to image a first graphic interface of the first logical function on the lens when it is detected that the movement of the display module on the lens satisfies a first preset condition.

18. The control device according to claim 17, wherein: The first preset condition is one of the following: The displacement distance of the movement is not less than a preset first threshold length; The displacement distance of the movement is not less than a preset first threshold length, and the displacement direction of the movement is a preset first direction; The displacement distance of the movement is not less than a preset first threshold length, and the starting point of the movement is a preset first position, which is a fixed position selected on the lens; The displacement distance of the movement is not less than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position; The end point of the movement is a preset second position, and the second position is a fixed position selected on the lens; The shape similarity between the moving trajectory and the preset trajectory is not less than a preset first threshold.

19. The control device according to claim 16, wherein: The display module is stationary at a third position on the lens, and the third position is a fixed position selected on the lens; the target logic function includes: a second logic function; the display module is stationary at the third position on the lens and is preset as a trigger condition for triggering the second logic function; the first control module 52 includes: The second control submodule is used for controlling the display module to image a second graphic interface of the second logic function on the lens when it is detected that the display module is stationary at a third position on the lens.

20. A near-eye display device, wherein: The near-eye display device includes: a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, a method for controlling a display module is implemented, and the method includes: Monitoring the motion state of the display module on the lens currently connected; When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

Images