Smart glasses, interactive display method and interactive display system

Abstract

Embodiments of the present application relate to the technical field of intelligent device, and particularly relate to an intelligent glasses, an interactive display method and an interactive display system. Embodiments of the present application abandon binocular holographic display and high computing power, set a visual acquisition module in a first temple, set a single display interaction module in a second temple, collect visual data by using the visual acquisition module, send the visual data to a terminal device, make the terminal device generate an interaction instruction, transmit the interaction instruction to the intelligent glasses, and make the intelligent glasses display target information by using the display interaction module. In this way, the number of display interaction modules in the intelligent glasses is reduced, and the audio output module of the intelligent glasses is removed, thereby reducing energy consumption and weight, increasing battery life, making the temples light and small, and reducing the occupation of the internal space of the second temple, which is conducive to heat dissipation.

Description

Technical Field

[0001] This application relates to the field of smart device technology, and in particular to smart glasses, an interactive display method, and an interactive display system. Background Technology

[0002] With the development of science and technology, more and more smart devices are becoming popular with users. Taking Augmented Reality (AR) devices as an example, as AR devices become more widespread in consumer electronics and industrial fields, users' demands for the user experience and interaction methods of AR devices are becoming increasingly prominent. Taking AR glasses as an example, the pursuit of binocular holographic display and onboard high computing power in AR glasses has led to problems such as excessively thick and heavy temples, extremely short battery life, and difficulty in heat dissipation. Summary of the Invention

[0003] One objective of this application is to provide a smart glasses, an interactive display method, and an interactive display system, aiming to improve the situation in related technologies where binocular holographic displays and high computing power lead to excessively heavy temples, short battery life, and difficulty in heat dissipation of AR glasses.

[0004] In a first aspect, embodiments of this application provide smart glasses, including a first temple with a visual acquisition module, the visual acquisition module including an image sensing unit and a communication unit, the image sensing unit being connected to the communication unit; a second temple with a display interaction module, the display interaction module including a microcontroller and a display unit, the microcontroller being connected to the display unit; the image sensing unit is configured to acquire visual data and transmit the visual data to a terminal device through the communication unit, so that the terminal device processes the visual data to generate an interaction command and transmits the interaction command to the smart glasses; the microcontroller is configured to parse the interaction command to extract target information from the interaction command and project and display the target information through the display unit.

[0005] In some embodiments, the terminal device processes visual data to generate interactive audio and transmits the interactive audio to an audio device so that the audio device plays the interactive audio in conjunction with the smart glasses projecting target information.

[0006] In some embodiments, the visual acquisition module further includes an image processor, which is connected to the image sensing unit and the communication unit respectively. The image processor is configured to preprocess the visual data to obtain preprocessed visual data and transmit the preprocessed visual data to the terminal device through the communication unit.

[0007] In some embodiments, the display unit includes a projection optical engine and an optical display module. The projection optical engine is connected to a microcontroller and is configured to project target information transmitted by the microcontroller onto the optical display module for display.

[0008] In some embodiments, the optical display module includes an optical waveguide configured to reflect and diffract light emitted by the projection optical engine regarding target information in order to display the target information.

[0009] In some embodiments, the display interaction module further includes a touch unit connected to a microcontroller. The touch unit is configured to acquire touch signals and transmit touch signals to the microcontroller, so that the microcontroller switches the display interface of the display unit according to the touch signals.

[0010] In some embodiments, the smart glasses further include a first battery module and a second battery module. The first battery module is disposed on a first temple and electrically connected to a vision acquisition module, and is configured to provide power to the vision acquisition module. The second battery module is disposed on a second temple and electrically connected to a display interaction module, and is configured to provide power to the display interaction module.

[0011] Secondly, embodiments of this application provide an interactive display method applied to the smart glasses provided in the first aspect. The interactive display method includes: acquiring visual data using an image sensing unit; transmitting the visual data to a terminal device via a communication unit, causing the terminal device to process the visual data to generate an interactive instruction, and transmitting the interactive instruction to the smart glasses; receiving the interactive instruction and using a microcontroller to parse the interactive instruction to extract target information from the interactive instruction; and projecting and displaying the target information via a display unit.

[0012] In some embodiments, the terminal device processes visual data to generate interactive audio and transmits the interactive audio to an audio device so that the audio device plays the interactive audio in conjunction with the smart glasses projecting target information; wherein, the terminal device transmits interactive instructions to the smart glasses through a first communication link and transmits interactive audio to the audio device through a second communication link.

[0013] In some embodiments, the method further includes: acquiring visual data in a sleep state; switching from a sleep state to a working state in response to detecting that a user's action matches preset visual features or acquiring a user's touch signal; and transmitting visual data to a terminal device via a communication unit in the working state.

[0014] Thirdly, embodiments of this application provide an interactive display system, including a terminal device and the smart glasses provided in the first aspect. The terminal device and the smart glasses are communicatively connected. The smart glasses are configured to collect visual data and transmit the visual data to the terminal device. The terminal device is configured to process the visual data to generate interactive instructions and transmit the interactive instructions to the smart glasses. The smart glasses are further configured to parse the interactive instructions to extract target information from the interactive instructions and project and display the target information.

[0015] In some embodiments, the interactive display system further includes an audio device, which is communicatively connected to a terminal device; the terminal device is further configured to process visual data to generate interactive audio and transmit the interactive audio to the audio device; the audio device is configured to cooperate with smart glasses to project target information and play interactive audio.

[0016] The embodiments of this application have the following beneficial effects: Unlike related technologies, the embodiments of this application abandon binocular holographic display and onboard high computing power. A visual acquisition module is set in the first temple and a single display interaction module is set in the second temple. The visual acquisition module collects visual data and sends the visual data to the terminal device, so that the terminal device generates interaction commands and transmits the interaction commands to the smart glasses. The smart glasses then use the display interaction module to display target information. In this way, the number of display interaction modules in the smart glasses is reduced, and the audio output module in the smart glasses is removed, reducing energy consumption and weight, increasing battery life. The temples are lightweight, and the internal space occupied by the second temple is small, which is conducive to heat dissipation. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments or related technologies of this application, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the drawings described below only show some embodiments of this application and should not be considered as limiting the scope of protection. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 1 ; Figure 2 This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 2 ; Figure 3 This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 3 ; Figure 4 This is a schematic diagram of the structure of the optical display module in smart glasses provided in some embodiments of this application; Figure 5 This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 4 ; Figure 6 This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 5 ; Figure 7 This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 6 ; Figure 8This is a schematic diagram of the structure of smart glasses provided in some embodiments of this application. Figure 7 ; Figure 9A This is a schematic diagram of the structure of an interactive display system provided in some embodiments of this application. Figure 1 ; Figure 9B These are schematic diagrams illustrating the interaction between a terminal device and smart glasses in an interactive display system provided in some embodiments of this application; Figure 10A This is a schematic diagram of the structure of an interactive display system provided in some embodiments of this application. Figure 2 ; Figure 10B This is a schematic diagram illustrating the interaction between a terminal device, smart glasses, and an audio device in an interactive display system provided in some embodiments of this application; Figure 11 This is a flowchart illustrating the interactive display method provided in some embodiments of this application.

[0019] Explanation of reference numerals in the attached figures: 1000. Interactive display system; 100. Smart glasses; 10. First temple; 11. Visual acquisition module; 111. Image sensing unit; 112. Communication unit; 113. Image processor; 20. Second temple; 21. Display interaction module; 211. Microcontroller; 212. Display unit; 2121. Projection optical engine; 2122. Optical display module; 212a. Optical waveguide; 213. Touch unit; 30. Eyeglass frame; 40. First battery module; 50. Second battery module; 60. First charging module; 70. Second charging module; 80. First heat dissipation module; 90. Second heat dissipation module; 200. Terminal equipment; 300. Audio equipment. Detailed Implementation

[0020] To provide a clearer understanding of the technical features, objectives, and effects of this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, not all of them. The detailed description of the embodiments of this application in the accompanying drawings is not intended to limit the scope of protection claimed by this application, but only represents selected embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of this application.

[0021] It should be noted that when an element is referred to as being "fixed to" another element, it means that it can be directly attached to the other element or that an intervening element may be present. When an element is considered to be "connected to" another element, it can be directly connected to the other element or that an intervening element may be present simultaneously. The terms "vertical," "horizontal," "left," "right," "up," and "down," etc., used in this specification indicate orientation or position based on the orientation or position shown in the accompanying drawings.

[0022] It should be noted that the terms "first," "second," and other similar expressions used in this specification are for illustrative purposes and to distinguish between identical or similar items with substantially the same function and effect, and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features. "A plurality of" means two or more items, unless otherwise explicitly defined. It is worth noting that although functional modules are divided in the device or structural diagram, in some cases, a different module division may be used than that shown in the device or structure.

[0023] Unless otherwise defined, the technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art. The terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the scope of this application. The term "and / or" as used in this specification includes any and all combinations of one or more of the associated listed items. It should be understood that the technical features involved in the various embodiments of this application described below can be combined with each other, provided that no conflict is established.

[0024] Please refer to the following: Figure 1 , Figure 2 , Figure 9A as well as Figure 9B , Figure 1 as well as Figure 2 The present application shows a schematic diagram of the structure of smart glasses provided in some embodiments. Figure 9A The present application provides schematic diagrams of the structure of interactive display systems according to some embodiments. Figure 9B The diagram illustrates the interaction of an interactive display system provided in some embodiments of this application.

[0025] like Figure 1 As shown, the smart glasses 100 include a first temple 10 and a second temple 20. (See reference...) Figure 9A and Figure 9B As shown, the interactive display system 1000 includes smart glasses 100 and a terminal device 200, which communicates with the smart glasses 100 via a network. It is understood that examples of networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0026] like Figure 2 As shown, the first temple 10 is equipped with a visual acquisition module 11, which includes an image sensing unit 111 and a communication unit 112. The image sensing unit 111 is connected to the communication unit 112. The image sensing unit 111 includes any suitable type of image sensor, such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor. The communication unit 112 includes any suitable type of communication module or device, such as a Wi-Fi module or a Bluetooth module.

[0027] The second temple 20 is equipped with a display interaction module 21, which includes a microcontroller 211 and a display unit 212. The microcontroller 211 is connected to the display unit 212 and can be any suitable type of controller, such as an ARM Cortex-M series controller, a RISC-V architecture controller, or a dedicated architecture controller like PIC or AVR. The display unit 212 includes optical modules (e.g., prism modules, waveguide modules) and microdisplay chips. The prism module uses prism coupling imaging to display information. The waveguide module includes diffractive waveguides, geometric waveguides (i.e., arrayed reflection waveguides), and holographic waveguides. The microdisplay chip includes Micro OLEDs and Micro LEDs. The microdisplay chip generates the image to be displayed and projects it onto the optical module for display.

[0028] The image sensing unit 111 is configured to acquire visual data and transmit the visual data to the terminal device 200 via the communication unit 112. The terminal device 200 then processes the visual data to generate interactive commands and transmits these commands to the smart glasses 100. Upon receiving the visual data, the terminal device 200 processes it to generate interactive commands. These commands include control instructions such as play, pause, and switch playback, as well as media content such as text, characters, and images to be projected and displayed.

[0029] It is understood that visual data includes image data and / or video data, such as image data or video data containing user gestures, faces, or other objects. In this embodiment, the smart glasses 100 includes virtual reality (VR) glasses, mixed reality (MR) glasses, and augmented reality (AR) glasses, etc. The terminal device 200 includes any suitable device or apparatus such as a smartphone, tablet computer, laptop computer, or all-in-one computer.

[0030] The microcontroller 211 is configured to parse interactive instructions to extract target information from the interactive instructions, and display the target information through the display unit 212. The target information includes media content such as text, characters, and images to be projected and displayed.

[0031] Please see Figure 10A and Figure 10B In some embodiments, the interactive display system 1000 further includes an audio device 300, which is communicatively connected to the terminal device 200 via a network. The audio device 300 includes any suitable device or apparatus such as a Bluetooth headset or Bluetooth speaker. It is understood that examples of networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0032] In some embodiments, after receiving visual data, the terminal device 200 processes the visual data to generate interactive instructions and interactive audio. The terminal device 200 transmits the interactive instructions to the smart glasses 100 and the interactive audio to the audio device 300, so that the audio device 300 plays the interactive audio in conjunction with the smart glasses 100 projecting target information. The interactive audio includes audio information such as prompts, voice broadcasts, navigation instructions, translation results, and alarm information.

[0033] After receiving the interactive audio, the audio device 300 plays the interactive audio after the playback conditions are met or triggered (such as reaching a specified playback time or receiving a playback command sent by the terminal device 200).

[0034] In some embodiments, the terminal device 200 adds a unified presentation timestamp to the interactive instructions and interactive audio, and performs synchronization calibration based on the system clock to ensure that the target information and interactive audio are presented at the same time. That is, the target information and interactive audio are presented according to the presentation timestamp, so that the time difference between the projection display of the target information and the playback of the interactive audio is less than or equal to a preset time difference threshold (such as a time difference threshold of 50ms), thereby realizing the synchronization of audio playback and screen display.

[0035] For interactive commands, the presentation timestamp refers to the time carried by the interactive command to instruct the smart glasses 100 to present the target information. For interactive audio, the presentation timestamp refers to the time to instruct the audio device 300 to play the interactive audio.

[0036] This application's embodiment abandons binocular holographic display and onboard high computing power. Instead, a visual acquisition module is set in the first temple, and a single display interaction module is set in the second temple. The visual acquisition module collects visual data and sends it to the terminal device, enabling the terminal device to generate interaction commands and transmit the commands to the smart glasses. The smart glasses then use the display interaction module to display the target information. This reduces the number of display interaction modules in the smart glasses and removes the audio output module, thus reducing energy consumption and weight, increasing battery life. The temples are lightweight, and the second temple occupies less internal space, which is beneficial for heat dissipation.

[0037] Please refer to it again. Figure 2 In some embodiments, the display unit 212 includes a projection optical engine 2121 and an optical display module 2122. The projection optical engine 2121 is connected to a microcontroller 211, and the microcontroller 211 transmits target information in the interaction command to the projection optical engine 2121. The projection optical engine 2121 is configured to project the target information transmitted by the microcontroller 211 onto the optical display module 2122 for display. The projection optical engine 2121 can be any suitable device or component, such as a micro projector, and this application embodiment does not impose any specific limitations on it. In some embodiments, the projection optical engine 2121 includes a microdisplay chip (such as Micro OLED, Micro LED, etc.), and the projection optical engine 2121 uses the microdisplay chip to generate a display image and projects the display image onto the optical display module 2122 for display.

[0038] In this embodiment, a microcontroller is configured to drive a monocular display module (i.e., a display unit 212) for projection display, which realizes lightweight projection display of target information, reduces the number of display interaction modules in smart glasses to a single one, reduces energy consumption and weight, increases battery life, and makes the temples lightweight, making the smart glasses more stable to wear.

[0039] Please refer to the following: Figure 3 and Figure 4 In some embodiments, the optical display module 2122 includes an optical waveguide 212a.

[0040] In this system, after receiving target information, the projection optical engine 2121 emits light rays containing the target information to the optical waveguide 212a. The optical waveguide 212a is configured to reflect and diffract the light rays containing the target information emitted by the projection optical engine 2121. Specifically, the light rays entering the coupling region of the optical waveguide 212a are reflected by the waveguide and transmitted to the coupling region of the optical waveguide 212a. From the coupling region, the light rays are diffracted and output to the human eye, thereby displaying the target information. It is easy to understand that the optical waveguide 212a can include diffractive waveguides, geometric waveguides (i.e., arrayed reflection waveguides), and holographic waveguides, etc.

[0041] In this embodiment, optical waveguides are configured to reflect and diffract light rays to display target information, thereby achieving efficient and accurate projection display of target information.

[0042] Please see Figure 3 In some embodiments of this application, the visual acquisition module 11 further includes an image processor 113, which is connected to both the image sensing unit 111 and the communication unit 112. The image sensing unit 111 is configured to transmit the acquired visual data to the image processor 113, and the image processor 113 is configured to preprocess the visual data to obtain preprocessed visual data, i.e., to preprocess the visual data to obtain preprocessed visual data, and then transmit the preprocessed visual data to the terminal device 200 through the communication unit 112. It should be understood that the preprocessing operations include, but are not limited to, format unification, noise reduction, frame rate adjustment, cropping, alignment, compression, and hard encoding. The image processor 113 can be any suitable device or component, such as a System on Chip (SOC) chip or an FPGA (Field Programmable Gate Array) chip. This application does not impose any specific limitations on this.

[0043] In this embodiment, the image processor 113 is configured to preprocess the visual data before transmitting the preprocessed visual data. This improves data quality, reduces data transmission volume, lowers data transmission bandwidth and power consumption, and increases data transmission rate.

[0044] Please refer to it again. Figure 3 In some embodiments, the smart glasses 100 further includes a frame 30, the first end and the second end of which are respectively connected and fixed to the first temple 10 and the second temple 20, that is, the first end of the frame 30 (i.e., Figure 3 The left end of the frame 30 is connected and fixed to the first temple 10, and the second end of the frame 30 (i.e., the left end of the frame 30) is connected and fixed to the first temple 10. Figure 3 The right end of the mirror is connected and fixed to the second temple 20.

[0045] The optical display module 2122 is disposed at one end of the lens frame 30 near the second temple 20. This end of the lens frame 30 near the second temple 20 is the second end of the lens frame 30, meaning the optical display module 2122 is disposed near the second end of the lens frame 30. The projection optical engine 2121 is disposed at one end of the second temple 20 near the optical display module 2122, meaning the projection optical engine 2121 is disposed at the end of the second temple 20 near the second end of the lens frame 30.

[0046] In this embodiment, the optical display module is fixed in the frame, and the projection optical engine is set at the end of the second temple close to the optical display module, so that the optical display module can stably display the projected information, make reasonable use of the internal space of the second temple, and improve the space utilization rate.

[0047] Please see Figure 5 In some embodiments of this application, the display interaction module 21 further includes a touch unit 213, which is connected to the microcontroller 211.

[0048] The touch unit 213 is configured to acquire touch signals (e.g., acquire touch operations performed by the user on the touch unit 213, process the touch operations to obtain touch signals), and transmit the touch signals to the microcontroller 211, so that the microcontroller 211 switches the display interface of the display unit 212 according to the touch signals, such as switching from the current display interface to another display interface, or turning off the current display interface of the display unit 212. Touch operations include, but are not limited to, single-click, double-click, swipe, and pinch operations. In some embodiments, the touch unit 213 includes any suitable type of device or component such as a capacitive touchpad or a touch screen.

[0049] In this embodiment, a touch unit is configured to collect touch signals and switch the display interface of the display unit according to the touch signals, so that the user can flexibly switch the display interface and improve the user experience.

[0050] Please see Figure 6 In some embodiments, the smart glasses 100 further includes a first battery module 40 and a second battery module 50. The first battery module 40 is disposed inside the first temple 10 and electrically connected to the vision acquisition module 11. The first battery module 40 is configured to provide power to the vision acquisition module 11, that is, the first battery module 40 is used to provide power to the vision acquisition module 11 (including the image sensing unit 111, the communication unit 112, and the image processor 113, etc.).

[0051] The second battery module 50 is disposed within the second temple 20 and electrically connected to the display interaction module 21. The second battery module 50 is configured to provide power to the display interaction module 21, that is, the second battery module 50 is used to provide power to the display interaction module 21 (including microcontroller 211, display unit 212, and touch unit 213, etc.). Both the first battery module 40 and the second battery module 50 can be modules composed of any suitable rechargeable batteries, etc., and this application embodiment does not make any specific limitation in this regard.

[0052] In this embodiment, the first battery module 40 and the second battery module 50 are configured to independently provide power to the visual acquisition module 11 and the display interaction module 21. The visual acquisition module 11 and the display interaction module 21 do not affect each other, efficiently complete their assigned tasks, and facilitate battery module maintenance.

[0053] Please see Figure 7 In some embodiments, the smart glasses 100 further includes a first charging module 60 and a second charging module 70. The first charging module 60 is disposed within the first temple 10 and electrically connected to the first battery module 40, and the second charging module 70 is disposed within the second temple 20 and electrically connected to the second battery module 50. Both the first charging module 60 and the second charging module 70 are used to connect to an external charging device.

[0054] In this embodiment, the first charging module 60 is configured to store electrical energy input from an external charging device into the first battery module 40, that is, to convert and store electrical energy input from the external charging device into the first battery module 40. The second charging module 70 is configured to store electrical energy input from an external charging device into the second battery module 50, that is, to convert and store electrical energy input from the external charging device into the second battery module 50. The external charging device includes any suitable device or apparatus such as a charger. Both the first charging module 60 and the second charging module 70 can be any suitable charging circuit or charging component, etc., and this embodiment does not impose any specific limitations on them.

[0055] In some embodiments, the ends of the first temple 10 and the second temple 210 of the smart glasses 100 are provided with power receiving contacts. The power receiving contacts at the end of the first temple 10 are connected to the first charging module 60, and the power receiving contacts at the end of the second temple 20 are connected to the second charging module 70. The power receiving contacts at the ends of the first temple 10 and the second temple 20 are connected by Y-shaped double-headed magnetic cables. By using the principle of magnetic attraction between opposite poles, the independent first battery module 40 and the second battery module 50 can be synchronously charged, improving the convenience of charging the smart glasses 100 in an asymmetric architecture.

[0056] In this embodiment, the first charging module 60 and the second charging module 70 are configured to charge the first battery module 40 and the second battery module 50 independently, so as to realize the independent synchronous power replenishment of the first battery module 40 and the second battery module 50, improve the charging convenience, and facilitate the maintenance of the charging modules.

[0057] Please see Figure 8In some embodiments, the smart glasses 100 further includes a first heat dissipation module 80 and a second heat dissipation module 90. The first heat dissipation module 80 is disposed within the first temple 10 and is electrically connected to the first battery module 40. The second heat dissipation module 90 is disposed within the second temple 20 and is electrically connected to the second battery module 50. The first battery module 40 is also used to provide power to the first heat dissipation module 80, and the second battery module 50 is also used to provide power to the second heat dissipation module 90.

[0058] In this embodiment, the first heat dissipation module 80 is configured to dissipate heat from the visual acquisition module 11, thereby dissipating the heat generated by the visual acquisition module 11. The second heat dissipation module 90 is configured to dissipate heat from the display interaction module 21, thereby dissipating the heat generated by the display interaction module 21.

[0059] In some embodiments, the first heat dissipation module 80 is further configured to dissipate heat from the first battery module 40 and the first charging module 60, thereby dissipating the heat generated by the first battery module 40 and the first charging module 60. The second heat dissipation module 90 is further configured to dissipate heat from the second battery module 50 and the second charging module 70, thereby dissipating the heat generated by the second battery module 50 and the second charging module 70. Both the first heat dissipation module 80 and the second heat dissipation module 90 can be any suitable type of device or component, such as a miniature fan; this application embodiment does not impose any specific limitations on this.

[0060] In this embodiment, the first heat dissipation module 80 and the second heat dissipation module 90 are configured to independently dissipate heat from the components in the first temple 10 and the components in the second temple 20. The heat dissipation structure of the first heat dissipation module 80 and the second heat dissipation module 90 can be optimized as needed, and heat dissipation can be carried out independently and synchronously, improving the convenience of heat dissipation and facilitating the maintenance of the heat dissipation modules.

[0061] In summary, this embodiment of the application abandons binocular holographic display and onboard high computing power. A visual acquisition module is set in the first temple and a single display interaction module is set in the second temple. The visual acquisition module collects visual data and sends the visual data to the terminal device, so that the terminal device generates interaction commands and transmits the interaction commands to the smart glasses. The smart glasses then use the display interaction module to display the target information. In this way, the number of display interaction modules in the smart glasses is reduced, and the audio output module in the smart glasses is removed to avoid sound leakage and unclear sound. Energy consumption and weight are reduced, battery life is increased, the temples are lightweight, and the internal space occupied by the second temple is small, which is conducive to heat dissipation.

[0062] Please refer to the following: Figure 9A as well as Figure 9BThe interactive display system 1000 provided in this application embodiment includes smart glasses 100 and a terminal device 200. The terminal device 200 communicates with the smart glasses 100 via a network. The smart glasses 100 has the same structure and function as the smart glasses 100 provided in the previous embodiment, and will not be described again here.

[0063] In this embodiment, the smart glasses 100 are configured to collect visual data and transmit the visual data to the terminal device 200. The visual data includes image data and / or video data, such as image data or video data containing user gestures, faces, or other objects.

[0064] The terminal device 200 is configured to process visual data to generate interactive instructions and transmit these instructions to the smart glasses 100. These interactive instructions include control commands such as play, pause, and switch playback, as well as media content such as text, characters, and images to be projected and displayed.

[0065] In this embodiment, the smart glasses 100 are further configured to parse interactive commands to extract target information from the interactive commands and project and display the target information. The target information includes media content such as text, characters, and images to be projected and displayed.

[0066] Please refer to the following: Figure 10A and Figure 10B In some embodiments, the interactive display system 1000 also includes an audio device 300, which is communicatively connected to the terminal device 200 via a network.

[0067] Terminal device 200 is configured to process visual data to generate interactive commands and interactive audio, transmit the interactive commands to smart glasses 100, and transmit the interactive audio to audio device 300. The interactive audio includes audio information such as prompts, voice broadcasts, navigation commands, translation results, and alarm messages.

[0068] Audio device 300 is configured to project target information and play interactive audio in conjunction with smart glasses 100. After receiving interactive audio, audio device 300 plays the interactive audio after the playback conditions are met or triggered (e.g., reaching a specified playback time, receiving a playback command sent by terminal device 200). In some embodiments, terminal device 200 adds a unified presentation timestamp to the interactive command and interactive audio, and performs synchronization calibration based on the system clock to ensure that the target information and interactive audio are presented at the same time. That is, the target information and interactive audio are presented according to the presentation timestamp, so that the time difference between the projection display of the target information and the playback of the interactive audio is less than or equal to a time difference threshold (e.g., a time difference threshold of 50ms), thereby achieving synchronization between audio playback and screen display.

[0069] This application adopts a three-in-one link of "smart glasses collecting visual data → terminal device processing → audio device playing audio / smart glasses displaying information". Through a synchronization mechanism, visual feedback and audio broadcasting are synchronized, avoiding issues such as sound leakage and unclear sound that are common in smart glasses. It also reduces energy consumption and weight, increases battery life, and features lightweight temples with minimal internal space occupation, which is beneficial for heat dissipation.

[0070] This application provides an interactive display method, which is applied to smart glasses. The smart glasses have the same structure and function as the smart glasses 100 provided in the previous embodiment, and will not be described in detail here.

[0071] See Figure 11 As shown, the interactive display method includes steps S11 to S14 to achieve projected display of information.

[0072] Step S11: Acquire visual data using the image sensing unit.

[0073] Step S12: Transmit visual data to the terminal device through the communication unit, so that the terminal device processes the visual data to generate interactive instructions and transmits the interactive instructions to the smart glasses.

[0074] Step S13: Receive the interactive command and use the microcontroller to parse the interactive command to extract the target information in the interactive command.

[0075] Step S14: Project the target information through the display unit.

[0076] In this embodiment, after receiving an interaction command, the smart glasses use a microcontroller to parse the command and extract the target information. The target information is then projected and displayed through a display unit.

[0077] In some embodiments, after receiving visual data, the terminal device processes the visual data to generate interactive audio and transmits the interactive audio to an audio device so that the audio device plays the interactive audio in conjunction with the smart glasses projecting and displaying target information.

[0078] Specifically, the terminal device transmits interactive commands to the smart glasses via a first communication link and transmits interactive audio to the audio device via a second communication link. In some embodiments, the first communication link is a Bluetooth A2DP (Advanced Audio Distribution Profile) link, and the second communication link is a Bluetooth BLE (Bluetooth Low Energy) link.

[0079] In some embodiments, the interactive display method further includes steps S21 to S23.

[0080] Step S21: Acquire visual data in sleep mode.

[0081] Step S22: In response to detecting that the user's action matches the preset visual features or collecting the user's touch signal, switch from sleep state to working state.

[0082] Step S23: In the working state, transmit visual data to the terminal device through the communication unit.

[0083] In step S21, while in sleep mode, the smart glasses continuously acquire visual data using an image sensing unit (e.g., an image sensor IMX681) with a low-power preview mode. Sleep mode refers to a state of the smart glasses where the output power is reduced to the minimum required for the components to operate, thus lowering power consumption and improving battery life.

[0084] In step S22, the collected visual data is processed to extract the user's action features. These features are then compared with preset visual features. If the matching degree between the user's action features and the preset visual features is greater than or equal to a preset matching degree threshold, it indicates that the user's action conforms to the preset visual features. Once it is determined that the user's action conforms to the preset visual features, the smart glasses switch from sleep mode to working mode. Alternatively, the touch unit continuously collects input touch operations. When a touch operation is collected, it is processed to obtain a touch signal, indicating that the user's touch signal has been collected. The smart glasses then switch from sleep mode to working mode.

[0085] In step S23, after switching to the working state, visual data is transmitted to the terminal device through the communication unit in the working state to realize on-demand power consumption management of "perception-trigger-computation" and make reasonable use of electrical energy.

[0086] Those skilled in the art will understand that the above-mentioned technical features can be used in any combination without limitation. The above embodiments are only for illustrating the technical concept and features of this application, and are intended to enable those skilled in the art to more clearly understand the technical features, purpose and effects of this application and implement them accordingly. They should not be used to limit the scope of protection of this application. All equivalent transformations made using the content of this application specification and drawings, or direct or indirect applications in other related technical fields, should be included in the scope of protection of the claims of this application.

Claims

1. A type of smart glasses, characterized in that, include: The first temple is equipped with a visual acquisition module, which includes an image sensing unit and a communication unit, and the image sensing unit is connected to the communication unit. The second temple is provided with a display interaction module, which includes a microcontroller and a display unit, and the microcontroller is connected to the display unit; The image sensing unit is configured to acquire visual data and transmit the visual data to a terminal device through the communication unit, so that the terminal device processes the visual data to generate an interaction command and transmits the interaction command to the smart glasses. The microcontroller is configured to parse the interactive instructions to extract target information from the interactive instructions, and to project and display the target information through the display unit.

2. The smart glasses according to claim 1, characterized in that, The terminal device processes the visual data to generate interactive audio, and transmits the interactive audio to an audio device so that the audio device plays the interactive audio in conjunction with the smart glasses projecting and displaying the target information.

3. The smart glasses according to claim 1 or 2, characterized in that, The visual acquisition module further includes an image processor, which is connected to the image sensing unit and the communication unit respectively. The image processor is configured to preprocess the visual data to obtain preprocessed visual data, and transmit the preprocessed visual data to the terminal device through the communication unit.

4. The smart glasses according to claim 1 or 2, characterized in that, The display unit includes a projection optical engine and an optical display module. The projection optical engine is connected to the microcontroller and is configured to project the target information transmitted by the microcontroller onto the optical display module for display.

5. The smart glasses according to claim 4, characterized in that, The optical display module includes an optical waveguide configured to reflect and diffract light emitted by the projection optical engine regarding the target information in order to display the target information.

6. The smart glasses according to claim 1 or 2, characterized in that, The display interaction module also includes a touch unit, which is connected to the microcontroller. The touch unit is configured to collect touch signals and transmit the touch signals to the microcontroller, so that the microcontroller switches the display interface of the display unit according to the touch signals.

7. The smart glasses according to any one of claims 1-2, characterized in that, The smart glasses also include a first battery module and a second battery module. The first battery module is disposed on the first temple and electrically connected to the vision acquisition module, and is configured to provide power to the vision acquisition module. The second battery module is disposed on the second temple and electrically connected to the display interaction module, and is configured to provide power to the display interaction module.

8. An interactive display method, characterized in that, Applied to the smart glasses as described in any one of claims 1-7, the interactive display method includes: Visual data is acquired using an image sensing unit; The visual data is transmitted to the terminal device through the communication unit, so that the terminal device processes the visual data to generate interactive instructions; The system receives interactive instructions sent by the terminal device and uses a microcontroller to parse the interactive instructions to extract target information from them. The target information is projected and displayed through the display unit.

9. The interactive display method according to claim 8, characterized in that, The terminal device processes the visual data to generate interactive audio, and transmits the interactive audio to an audio device, so that the audio device plays the interactive audio in conjunction with the smart glasses projecting and displaying the target information. The terminal device transmits the interactive instructions to the smart glasses via a first communication link and transmits the interactive audio to the audio device via a second communication link.

10. The interactive display method according to claim 8 or 9, characterized in that, Also includes: Collect visual data while in sleep mode; When a user's action is detected to match a preset visual feature or when the user's touch signal is collected, the sleep state is switched to the working state. In the operating state, the visual data is transmitted to the terminal device through the communication unit.

11. An interactive display system, characterized in that, Includes a terminal device and smart glasses as described in any one of claims 1-7, wherein the terminal device is communicatively connected to the smart glasses; The smart glasses are configured to collect visual data and transmit the visual data to the terminal device; The terminal device is configured to process the visual data to generate interactive instructions and transmit the interactive instructions to the smart glasses; The smart glasses are also configured to parse the interaction instructions to extract target information from the interaction instructions and project and display the target information.

12. The interactive display system according to claim 11, characterized in that, The interactive display system also includes an audio device, which is communicatively connected to the terminal device. The terminal device is also configured to process the visual data to generate interactive audio and transmit the interactive audio to the audio device; The audio device is configured to project and display the target information in conjunction with the smart glasses and play the interactive audio.

Images