Smart glasses and smart glasses system

Abstract

The embodiment of the present application provides a smart glasses and a smart glasses system. The smart glasses system is composed of a separate host and a glasses body, and the host responsible for the main tasks such as display content processing is separated from the glasses body, reducing the weight of the glasses body, thereby reducing the wearing weight of the glasses system when in use.

Description

[0001] Cross-references

[0002] This application claims priority to the Chinese patent application filed on May 26, 2023, with application number "2023213152609" and invention name "Smart glasses and smart glasses system", the entire contents of which are incorporated by reference in this application. Technical Field

[0003] The present application relates to the technical field of smart glasses, and in particular to smart glasses and a smart glasses system. Background Art

[0004] With the development of intelligent technology, more and more smart glasses products are appearing on the market, such as AR (augmented reality) glasses, MR (Mixed Reality) glasses, etc. The above smart glasses can overlay virtual applications and real scenes to provide users with a real, immersive, and three-dimensional viewing experience. However, existing smart glasses cannot meet the diverse needs of users. Utility Model Content

[0005] Multiple aspects of the present application provide a kind of smart glasses and a smart glasses system, so as to provide a new type of mixed reality glasses with binocular vision.

[0006] The embodiment of the present application provides a smart glasses system, comprising: a glasses body and a glasses circuit located in the glasses body; the glasses body is detachably connected to an external host; the glasses circuit comprises: a binocular camera module electrically connected to the external host, a relay chipset electrically connected to the host, and a dual-screen display module electrically connected to the relay chipset; wherein the binocular camera module collects the environment to obtain a dual-channel environment video stream, and outputs the dual-channel environment video stream to the host; wherein the host comprises: a memory, a processor and a power supply component; wherein the memory is used to store computer instructions / programs; the processor is used to The computer instructions / program are read to: receive the dual-channel environmental video stream sent by the binocular camera group; merge the dual-channel environmental video stream with the display data of the virtual application to obtain a dual-channel mixed video stream, and output the dual-channel mixed video stream to the relay chipset; the relay chipset outputs the dual-channel mixed video stream to the dual-screen display module for display; wherein, when the smart glasses system is in use, the host and the glasses body are communicated and connected via a wireless connection or a wired connection, and the power supply component of the host supplies power to the glasses circuit via the wireless connection or the wired connection.

[0007] Optionally, the binocular camera module includes: a first camera module and a second camera module; any camera module includes: a camera and a digital signal processing chip; the dual-screen display module includes: a first display module corresponding to the first camera module and a second display module corresponding to the second camera module; wherein, the first display module is used to display a mixed video stream of the display data of the virtual application and an environmental video stream captured by the first camera module, and the second display module is used to display a mixed video stream of the display data of the virtual application and an environmental video stream captured by the second camera module.

[0008] Optionally, it also includes: a microcontroller chip electrically connected to the host, and at least one input component electrically connected to the microcontroller chip; wherein the at least one input component collects external data and outputs the external data to the microcontroller chip; the microcontroller chip processes the external data and outputs the processing result to the host; the host outputs control instructions corresponding to the display content and / or display style to the dual-screen display module according to the processing result.

[0009] Optionally, the at least one input component includes: a photoelectric sensor; the photoelectric sensor senses light signals in the environment, converts the light signals into electrical signals, and outputs the electrical signals to the microcontroller chip; the microcontroller chip outputs a control signal to the dual-screen display via the relay chipset based on the electrical signals; the dual-screen display module adjusts display parameters and / or display styles based on the control signals.

[0010] Optionally, the at least one input component includes: a posture sensor; the posture sensor includes: at least one of a gyroscope, a geomagnetic sensor, an acceleration sensor, a Beidou positioning module and a GPS module; the posture sensor acquires posture information, and outputs the posture information to the microcontroller chip; the microcontroller chip outputs the user position according to the posture information; the user position is output to the host; the host adjusts the position and angle of the virtual camera in the virtual application according to the user position.

[0011] Optionally, the at least one input component includes: a TOF sensor component; the TOF sensor component collects distance information of the observed object in the environment, and outputs the distance information to the microcontroller chip; the microcontroller chip determines the depth information of the observed object based on the distance information, and outputs the depth information to the host via the relay chipset; the host uses the depth information and the dual-channel environmental video stream collected by the binocular camera to perform depth positioning of the observed object.

[0012] Optionally, the at least one input component includes: an external input button; the external input button senses user input and outputs the user's input data to the microcontroller chip; the microcontroller chip generates a control signal based on the input data, and outputs the control signal to the corresponding controlled component via the relay chipset.

[0013] Optionally, the at least one input component also includes: a fingerprint chip and / or a security chip; wherein the fingerprint chip collects a fingerprint image, performs feature analysis on the fingerprint image, and outputs a fingerprint recognition result based on the feature analysis result; the fingerprint recognition result is used to authenticate the user; wherein the security chip stores user identity information of the smart glasses; the user identity information is used for identity authentication when the user uses the smart glasses.

[0014] Optionally, it also includes: an audio component; the audio component includes: an audio analog-to-digital converter, an audio amplifier connected to the audio analog-to-digital converter, and a player connected to the audio amplifier; wherein the audio analog-to-digital converter is electrically connected to the relay chipset; the audio analog-to-digital converter receives the audio signal output by the relay chipset and performs analog-to-digital conversion on the audio signal; the audio signal after analog-to-digital conversion is amplified by the audio amplifier, and the amplified audio signal is played by the player.

[0015] Optionally, the audio component also includes: a microphone electrically connected to the audio analog-to-digital converter; the microphone collects audio signals; the audio analog-to-digital converter converts the audio signals into electrical signals, and the electrical signals are output to the host via the relay chipset; the host interactively controls the virtual application according to the electrical signal output.

[0016] Optionally, it further includes: a communication module connected to the relay chipset; the communication module includes: at least one of an E-SIM module, a Bluetooth module and a UWB module.

[0017] In this embodiment, the smart glasses system consists of a detachable host and a glasses body, and the host responsible for major tasks such as display content processing is separated from the glasses body, reducing the weight of the glasses body and thus reducing the wearing weight of the glasses system when in use. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0019] Figure 1A schematic diagram of the structure of a smart glasses system provided by an exemplary embodiment of the present application;

[0020] Figure 2 A schematic diagram of the structure of a smart glasses system provided by another exemplary embodiment of the present application;

[0021] Figure 3 A schematic diagram of the structure of a host provided for another exemplary embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0023] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms of "a", "said", and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two, but does not exclude the inclusion of at least one.

[0024] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0025] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a product or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such a product or system. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the product or system including the elements.

[0026] In view of the technical problem that the integrated MR glasses in the prior art have relatively complex circuits, which is not conducive to lightweight and miniaturization of the glasses, a solution is provided in some embodiments of the present application. The technical solutions provided in each embodiment of the present application are described in detail below in conjunction with the accompanying drawings.

[0027] Figure 1is a schematic diagram of the structure of a smart glasses system provided by an exemplary embodiment of the present application. Figure 1 As shown, the smart glasses system 100 includes: smart glasses D1 and a host D2 that is detachably connected to the smart glasses. Among them, the smart glasses D1 is a glasses body that can be worn directly, and the host is separated from the glasses body and does not belong to the wearable part, so the user's wearing weight does not include the weight of the host. The smart glasses D1 and the host D2 exchange data through a wired or wireless connection to achieve the display of a virtual and real mixed screen. Among them, the wired connection may include: a connection based on USB (Universal SerialBus, Universal Serial Bus), such as micro USB or USB-Type-C, etc., and this embodiment includes but is not limited to this. Among them, when the smart glasses system is in use, the glasses body is worn on the user's head, and the host D2 communicates with the glasses body through a wireless connection or a wired connection. For example, when the smart glasses system is used by a user, the host can be placed on a table, in the user's backpack, or in other places where the head does not need to bear weight, thereby reducing the user's discomfort when using the smart glasses system.

[0028] Among them, Figure 1 As shown, the smart glasses D1 include a glasses body 10 and a glasses circuit 20 located in the glasses body 10. The glasses circuit 20 includes: a binocular camera module 30 electrically connected to a host D2, a relay chipset 40 electrically connected to the host D2, and a dual-screen display module 50 electrically connected to the relay chipset 40.

[0029] It should be noted that, in this embodiment, electrical connection refers to the connection between different components of the circuit structure through physical lines that can transmit electrical signals such as PCB (Printed Circuit Board) copper foil, wires, data cables (such as USB2.0 data cables) or data interfaces.

[0030] Among them, the binocular camera module 30 is used to collect the environment and obtain a two-way environment video stream. In the binocular camera module 30, the environment video stream collected by a single camera module is called a one-way environment video stream. The binocular camera module 30 can transmit the two-way environment video stream to the host D2, so that the host D2 merges the two-way environment video stream with the display data of the virtual application to obtain a two-way mixed video stream. Among them, the virtual application is an application that does not need to be installed, is ready to use, and has a user experience similar to that of the local application. The virtual application does not need to be installed locally in the smart glasses. The virtual application can be installed and run in the host D2 or a server that can communicate with the host D2.

[0031] The relay chipset 40 is mainly used to extend the network transmission distance by retransmitting or forwarding the data signal. In this embodiment, the relay chipset 40 can be used to obtain a dual-channel mixed video stream from the host D2 and send the dual-channel mixed video stream to the dual-screen display module 50 for display.

[0032] That is, the signal flow in the smart glasses is as follows: the binocular camera module 30 collects the environment to obtain a dual-channel environment video stream, and outputs the dual-channel environment video stream to the host D2; the dual-channel video stream and the display data of the virtual application are merged at the host D2 to obtain a dual-channel mixed video stream, and the dual-channel mixed video stream is output to the relay chipset 40, and distributed to the dual-screen display module 50 through the relay chipset. In this embodiment, the smart glasses system is composed of a detachable host D2 and smart glasses, and the host D2 responsible for the main tasks such as display content processing is separated from the glasses body, reducing the weight of the glasses body, which is conducive to the lightweight and miniaturization of the smart glasses. At the same time, in this embodiment, the glasses body includes a binocular camera module and a dual-screen display module, so that richer display scene data (such as depth data) can be obtained based on binocular vision, and the mixed reality picture displayed based on the dual-screen display module is more stereoscopic and immersive.

[0033] In some embodiments, Figure 1 As shown, the host D2 can be implemented as an electronic device including a memory 201, a processor 202 and a power supply component 203. Among them, the memory 201 can store programs or instructions, and the processor 202 can execute the program or instructions to realize mixed reality content processing and display. Among them, the memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The processor may include a CPU (Central Processing Unit).

[0034] In other embodiments, the processor 202 of the host D2 may be implemented using an application-specific integrated circuit (ASIC) chip. The integrated circuit chip may include, but is not limited to, a field-programmable gate array (FPGA), a programmable array logic device (PAL), a general array logic device (GAL), a complex programmable logic device (CPLD), etc.

[0035] In addition, the power supply component 203 on the host D2 can supply power to the smart glasses D1, so that there is no need to install an additional power supply component on the smart glasses D1, which can further contribute to the lightweight of the smart glasses. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing and distributing power for the device where the power supply component is located. When the smart glasses system is in use, the power supply component 203 of the host D2 supplies power to the glasses circuit in the smart glasses via a wireless connection or a wired connection.

[0036] In some optional embodiments, the binocular camera module 30 may include two integrated camera modules, or may include two separate camera modules, such as Figure 1 The first camera module 301 and the second camera module 302 are shown. The first camera module 301 and the second camera module 302 are independent of each other, so they are easy to install and calibrate.

[0037] Wherein, any camera module may include: a camera and a digital signal processing chip. Wherein, the camera is used to shoot the real environment and obtain the environment image. The digital signal processing chip is used to digitally process the environment image and obtain the environment video stream. Wherein, the digital signal processing chip can be implemented based on a DSP (Digital Signal Processing) chip. Wherein, the digital signal processing chip is electrically connected to the host D2, and the digital signal processing chips included in the first camera module 301 and the second camera module 302 can respectively output one video stream and transmit the respective output video streams to the host D2. Wherein, the video streams obtained by the first camera module 301 and the second camera module 302 can respectively carry their respective camera identifiers to facilitate the subsequent split-screen display of the two video streams.

[0038] Among them, when the host D2 fuses the dual-channel environmental video stream with the display data of the virtual application, a two-channel mixed video stream carrying a camera identifier can be obtained. For example, the display data of the virtual application includes two channels of data, namely, left-eye virtual application data and right-eye virtual application data. The host D2 can fuse the left-eye virtual application data with the environmental video stream carrying the left-eye camera identifier to obtain a left-eye mixed video stream; and fuse the right-eye virtual application data with the environmental video stream carrying the right-eye camera identifier to obtain a right-eye mixed video stream, which will not be repeated.

[0039] In some optional embodiments, the dual-screen display module 50 may be composed of a display module with a single display screen, and the display screen of the display module may be split to divide the display area into a display area corresponding to the left eye and a display area corresponding to the right eye. In other optional embodiments, the dual-screen display module 50 may include two display modules with a single display screen, and the two display modules are independent of each other. Figure 2 As shown, the dual-screen display module 50 may include: a first display module 501 corresponding to the first camera module 301 and a second display module 502 corresponding to the second camera module 302 .

[0040] After the relay chipset 40 receives the two mixed video streams sent by the host D2, the two mixed video streams can be sent to the corresponding display modules for display according to the camera identifiers carried by the two mixed video streams. Furthermore. The first display module can be used to display a mixed scene of a virtual application and a real scene captured by the first camera module; the second display module can be used to display a mixed scene of a virtual application and a real scene captured by the second camera module. For example, the relay chipset 40 can send the left-eye mixed video stream to the left-eye display module corresponding to the left-eye camera, and send the right-eye mixed video stream to the right-eye display module corresponding to the right-eye camera. The user can watch the picture displayed by the left-eye display module through the left eye, and watch the picture displayed by the right-eye display module through the right eye. Furthermore, through binocular cameras and dual-screen displays, the visual effect of the human eye can be restored as much as possible, and the sense of reality and immersion of mixed reality can be enhanced.

[0041] It should be noted that, taking into account the different parameters of different camera modules, before using the first camera module and the second camera module to shoot the real scene, the camera in the first camera module and the camera in the second camera module can be synchronously exposed and calibrated so that the camera in the first camera module and the camera in the second camera module have the same exposure time, thereby reducing the risk of the images displayed by the first display module and the second reality module being out of sync.

[0042] In some optional embodiments, such as Figure 2As shown, the smart glasses further include: a microcontroller chip 60 electrically connected to the host D2 , and at least one input component 70 connected to the microcontroller chip 60 .

[0043] Among them, the at least one input component 70 is used to collect external data; the external data includes external environment data and / or user input data. Correspondingly, the microcontroller chip 60 is used to process the external data and send the processing results to the host D2, and then the host D2 can control the display content and / or display style of the dual-screen display module according to the processing results. That is, the signal flow direction is: the at least one input component 70 collects external data, and the external data is output to the microcontroller chip; the microcontroller chip processes the external data, obtains the processing results, and outputs the processing results to the host D2. The host D2 outputs the control instructions corresponding to the display content and / or display style to the dual-screen display module according to the processing results.

[0044] For example, with the cooperation of the at least one input component 70 and the microcontroller chip 60, at least one interactive operation of smart glasses wearing detection, eye tracking, gesture recognition, human body location tracking, binocular depth assisted measurement, and screen management can be implemented. The following will be exemplified in combination with different implementation forms of the at least one input component 70.

[0045] Optionally, the at least one input component 70 may include: a photoelectric sensor 701. The photoelectric sensor 701 is used to sense light signals in the environment and convert the sensed light signals into electrical signals. Correspondingly, the microcontroller chip 60 may send a control signal to the dual-screen display module through the relay chipset according to the electrical signal, and the dual-screen display module may adjust the display parameters and / or display style according to the control signal. That is, the signal flow direction is: the photoelectric sensor senses the light signal in the environment, converts the light signal into an electrical signal, and outputs the electrical signal to the microcontroller chip; the microcontroller chip outputs a control signal to the dual-screen display through the relay chipset according to the electrical signal; the dual-screen display module adjusts the display parameters and / or display style according to the control signal.

[0046] For example, when the light in the physical environment where the smart glasses are located becomes weak, the photoelectric sensor can convert the perceived light intensity into an electrical signal and send the electrical signal to the microcontroller chip. Based on the electrical signal, the microcontroller chip can send a control signal to reduce the screen brightness to the dual-screen display module through the relay chipset, and then the dual-screen display module can adjust the screen brightness so that the display tone of the display screen can be naturally integrated with the light changes in the physical environment, thereby enhancing the integrated experience of the virtual and real environments.

[0047] Alternatively, if Figure 2As shown, the at least one input component 70 may include: a posture sensor 702. The posture sensor 702 may include: at least one of a gyroscope, a geomagnetic sensor, an acceleration sensor, a Beidou positioning module and a GPS (Global Positioning System) module.

[0048] The posture sensor 702 is used to obtain posture information and send the posture information to the microcontroller chip 60. The posture information includes the position, orientation, and tilt angle of the smart glasses in any orientation in the physical space.

[0049] Accordingly, the microcontroller chip 60 is used to determine the user position, i.e., the user's observation point in the three-dimensional physical space, according to the posture information, and transmit the user position to the host D2. That is, the signal flow direction is: the posture sensor obtains the posture information, and the posture information is output to the microcontroller chip; the microcontroller chip outputs the user position according to the posture information, and outputs the user position to the host D2. Furthermore, the host D2 can adjust the position and angle of the virtual camera in the virtual application according to the user position. Furthermore, when the user's position in the physical world (such as the viewpoint position) changes, the virtual desktop displayed by the dual-screen display module also changes accordingly.

[0050] Alternatively, if Figure 2 As shown, the at least one input component 70 includes: an external input button 703. The external input button may include at least one of a volume button and a screen parameter adjustment button.

[0051] The peripheral input button is used to sense user input and send the user input data to the microcontroller chip. Correspondingly, the microcontroller chip is used to generate a control signal according to the input data and send the control signal to the corresponding controlled component through the relay chipset.

[0052] That is, the signal flow direction is: the peripheral input button senses the user input and outputs the sensed input data to the microcontroller chip; the microcontroller chip outputs a control signal according to the input data, and outputs the control signal to the corresponding controlled component via the relay chipset.

[0053] For example, a control signal generated according to an input operation on a volume button can be sent to an audio component to adjust the volume of the audio component. For example, a control signal generated according to an input operation on a screen parameter adjustment button can be sent to a dual-screen display module so that the dual-screen display module adjusts the display parameters according to the control signal. The display parameters may include: screen brightness parameters, resolution parameters, color saturation parameters, etc., which are not limited in this embodiment.

[0054] Alternatively, if Figure 2 As shown, the at least one input component 70 includes: a fingerprint chip 704 and / or a security chip 705 .

[0055] The fingerprint chip 704 is used to collect fingerprint images, perform feature analysis on the fingerprint images, and output fingerprint recognition results according to the feature analysis results; the fingerprint recognition results are used to authenticate the user.

[0056] In some embodiments, the microcontroller chip 60 can obtain the fingerprint recognition result output by the fingerprint chip 704 and the fingerprint of the authorized user stored in advance, and determine whether the fingerprint recognition result matches the fingerprint of the authorized user. If they match, it is determined that the user's fingerprint has passed the identity authentication. The microcontroller chip 60 can send a notification message that the user has passed the identity authentication to the host D2 through the relay chipset 40, and then the host D2 can display the corresponding interactive function after determining that the user has passed the identity authentication. For example, the host can enter the user's exclusive smart glasses operating system after the user passes the identity authentication, or the host can start running the user's exclusive virtual application after the user passes the identity authentication, which will not be repeated.

[0057] In some optional embodiments, the fingerprint of the authorized user may be obtained from the security chip 705 .

[0058] The security chip 705 is used to store the user identity information of the smart glasses, and the user identity information is used for identity authentication when the user uses the smart glasses. The user identity information includes at least one of password information, unlocking pattern information, and biometric information (fingerprint, voiceprint, iris), which is not limited in this embodiment.

[0059] For example, in some embodiments, the microcontroller chip 60 can obtain the account and password entered by the user through the virtual desktop displayed by the smart glasses, or obtain the account and password entered by the user through the peripheral input buttons on the smart glasses. The microcontroller chip 60 can obtain the pre-stored user account and password from the security chip 705, and determine whether the account and password entered by the user match the account and password stored in the security chip 705. If they match, it is determined that the account and password entered by the user have passed the identity authentication. The microcontroller chip 60 can send the identity authentication pass message to the host through the relay chipset 40, and then the host can display the corresponding interactive function after determining that the user has passed the identity authentication. For example, the host can enter the user's exclusive smart glasses operating system after the user passes the identity authentication, or the host can start running the user's exclusive virtual application after the user passes the identity authentication, which will not be repeated.

[0060] Optionally, the at least one input component 70 also includes: a TOF (Time of Flight) sensor component 706 electrically connected to the microcontroller chip 60. The TOF sensor component 706 is used to collect distance information of the observed object in the environment. The microcontroller chip 60 is used to determine the depth information of the observed object based on the distance information, and send the depth information to the host through the relay chipset 40, so that the host uses the depth information and the two-way environment video stream collected by the binocular camera module 30 to perform depth positioning on the observed object. Furthermore, when the shooting environment is better (for example, the ambient light is weak, strong or the texture is more complex), the depth information collected by the TOF sensor component can supplement the depth information collected by the binocular camera module 30, thereby assisting in obtaining more accurate depth information.

[0061] Alternatively, if Figure 2 As shown, the smart glasses further include: an audio component 80. The audio component 80 includes: an audio analog-to-digital converter 801, an audio amplifier 802 connected to the audio analog-to-digital converter 801, and a player 803 connected to the audio amplifier 802. The audio analog-to-digital converter is electrically connected to the relay chipset to receive an audio signal sent by the relay chipset and play the audio signal through the audio amplifier and the player.

[0062] That is, the signal flow direction is: the audio analog-to-digital converter receives the audio signal output by the relay chipset and performs analog-to-digital conversion on the audio signal; the audio signal after analog-to-digital conversion is amplified by the audio amplifier, and the amplified audio signal is output by the player.

[0063] Alternatively, if Figure 2 As shown, the audio component also includes: a microphone 804 electrically connected to the audio analog-to-digital converter 801. The microphone 804 is used to collect audio signals. Correspondingly, the audio analog-to-digital converter is used to convert the audio signals into electrical signals, and send the electrical signals to the host through the relay chipset, so that the host can interactively control the virtual application according to the electrical signals.

[0064] That is, the signal flow direction is: the audio analog-to-digital converter converts the audio signal into an electrical signal, and the electrical signal is output to the host D2 through the relay chipset; the host D2 outputs instructions for interactive control of the virtual application based on the electrical signal.

[0065] Alternatively, if Figure 2As shown, the smart glasses further include: a communication module 90 connected to the relay chipset 40. The communication module 90 may include: at least one of an E-SIM (Embedded-Subscriber Identity Module) module, a Bluetooth module, and a UWB (Ultra Wide Band) module.

[0066] Among them, the communication module 90 is configured to facilitate wired or wireless communication between smart glasses and other devices (such as mobile phones, smart watches or other smart glasses). The device where the communication component is located can access a wireless network based on a communication standard, such as Wi-Fi (wireless network communication technology), 2G (such as Global System for Mobile Communications (GSM)), 3G (such as Wideband Code Division Multiple Access (WCDMA), 4G (such as Long Term Evolution (LTE)), 4G+ (such as upgraded version of Long Term Evolution (LTE-Advanced, LTE-A)) or 5G (Fifth Generation Mobile Communication Technology), or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component can be implemented based on near field communication (NFC) technology, radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0067] The following will be combined with the attached Figure 3 , an optional structure of the host D2 is exemplified.

[0068] like Figure 3 As shown, the host D2 may include at least a memory 201, a processor 202, and a power supply component 203. The memory 201 may include Figure 3 The internal memory and external memory shown. Figure 3As shown, the power supply component 203 may include: a battery, a battery charging and discharging and management module, a fast charging circuit, and a Type-C charging port connected in sequence. Among them, the fast charging circuit and the battery charging and discharging and management module are connected to the DC / DC power converter to connect the external power supply through the DC / DC power converter. Based on this structure, when the external power supply is connected, the external power supply can charge the battery through the DC / DC power converter, the fast charging circuit, and the battery charging and discharging and management module. Alternatively, the external power supply can be connected to the smart glasses through the DC / DC power converter, the fast charging circuit, and the Type-C charging port to power the smart glasses. In some embodiments, when the external power supply is not connected, the battery can be connected to the smart glasses through the fast charging circuit and the Type-C charging port to power the smart glasses.

[0069] In some optional embodiments, such as Figure 3 As shown, the host D2 may also include: an audio processing circuit 204 electrically connected to the processor 202, and the audio processing circuit 204 includes a headphone interface and a microphone. The headphone interface may be a Type interface or a 3.5mm interface, which is not limited in this embodiment. The headphone interface is used to connect to an external headphone to play the audio of the virtual application through the headphone. The microphone is used to collect the user's audio to achieve voice interaction with the user.

[0070] like Figure 3 As shown, the host D2 may also include: a clock chip 205 electrically connected to the processor 202, and the clock chip is used to provide a unified clock signal to the smart glasses system to reduce the risk of data transmission errors when different components in the smart glasses system communicate.

[0071] like Figure 3 As shown, the host D2 may further include: a TF card holder 206 electrically connected to the processor 202, the TF card holder being used to insert a TF memory card to expand the storage space of the host D2. Figure 3 As shown, the host D2 may further include: a network card chip 207 electrically connected to the processor 202, and the network card chip is mainly used to receive and send data packets to achieve data transmission between the host D2 and the network.

[0072] like Figure 3 As shown, the host D2 may also include: a wireless communication module 208 electrically connected to the processor 202, and the wireless communication module is used to wirelessly communicate with the glasses body or other external devices. Among them, the wireless communication module can be implemented as a Wi-Fi module or a Bluetooth module, or can be implemented as a combination of a Wi-Fi module and a Bluetooth module, which is not limited in this embodiment. In some scenarios, when the glasses circuit includes a wireless communication module, the host D2 can achieve wireless communication with the glasses circuit through its own wireless communication module and the communication module of the glasses circuit.

[0073] like Figure 3 As shown, the host D2 may further include: a satellite positioning module 209 electrically connected to the processor 202, the satellite positioning module may include at least one of a Beidou positioning module and a GPS module. The satellite positioning module is used to provide positioning and navigation services to the host D2 according to satellite signals.

[0074] like Figure 3 As shown, the host D2 may also include: multiple physical interfaces 210 electrically connected to the processor 202, such as multiple USB-Type-C interfaces, HDMI interfaces, USB3.0 interfaces, etc. Based on the above interfaces, the host D2 can be wired to the glasses circuit or other external devices.

[0075] In addition to the above components, the host D2 may also include Figure 3 The button module 211, the cooling fan 212 and the BEEP (Blocks Extensible Exchange Protocol) module 213 are electrically connected to the processor 202. The button module may include at least one of a power button, a volume adjustment button, a reset button and a setting button, which is not limited in this embodiment.

[0076] based on Figure 3 In the structure shown, the host D2 can provide the glasses circuit with video stream data processing functions, network functions, storage functions, peripheral connection functions, and key interaction functions, etc., which can make the glasses circuit in the glasses body more concise, and reduce the head weight of the user when wearing smart glasses while ensuring that the overall smart glasses system has rich functions and user experience.

[0077] It should be noted that the descriptions such as “first” and “second” in this article are used to distinguish different messages, devices, modules, etc., and do not represent the order of precedence, nor do they limit “first” and “second” to different types.

[0078] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0079] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A smart glasses system, characterized in that: include: A glasses body and a glasses circuit located in the glasses body; The glasses body is detachably connected to an external host; The glasses circuit includes: a binocular camera module electrically connected to an external host, a relay chipset electrically connected to the host, and a dual-screen display module electrically connected to the relay chipset; The binocular camera module collects the environment to obtain a dual-channel environment video stream, and outputs the dual-channel environment video stream to the host; The host comprises: a memory, a processor and a power supply component; wherein the memory is used to store computer instructions / programs; the processor is used to read the computer instructions / programs to: receive the two-way environment video stream sent by the binocular camera module; fuse the two-way environment video stream with the display data of the virtual application to obtain a two-way mixed video stream, and output the two-way mixed video stream to the relay chipset; The relay chipset outputs the dual-channel mixed video streams to the dual-screen display module for display; When the smart glasses system is in use, the glasses body is worn on the user's head, the host and the glasses body are communicated and connected via a wireless connection or a wired connection, and the power supply component of the host supplies power to the glasses circuit via the wireless connection or the wired connection.

2. The smart glasses system according to claim 1, characterized in that: The binocular camera module includes: a first camera module and a second camera module; any camera module includes: a camera and a digital signal processing chip; the dual-screen display module includes: a first display module corresponding to the first camera module and a second display module corresponding to the second camera module; Among them, the first display module is used to display a mixed video stream of the display data of the virtual application and an environmental video stream captured by the first camera module, and the second display module is used to display a mixed video stream of the display data of the virtual application and an environmental video stream captured by the second camera module.

3. The smart glasses system according to claim 1, characterized in that: Also includes: a microcontroller chip electrically connected to the host, and at least one input component electrically connected to the microcontroller chip; Wherein, the at least one input component collects external data and outputs the external data to the microcontroller chip; The microcontroller chip processes the external data and outputs the processing result to the host; the host outputs control instructions corresponding to the display content and / or display style to the dual-screen display module according to the processing result.

4. The smart glasses system according to claim 3, characterized in that: The at least one input component includes: a photoelectric sensor; the photoelectric sensor senses light signals in the environment, converts the light signals into electrical signals, and outputs the electrical signals to the microcontroller chip; The microcontroller chip outputs a control signal to the dual-screen display module via the relay chipset according to the electrical signal; the dual-screen display module adjusts display parameters and / or display styles according to the control signal.

5. The smart glasses system according to claim 3, characterized in that: The at least one input component includes: a posture sensor; the posture sensor includes: at least one of a gyroscope, a geomagnetic sensor, an acceleration sensor, a Beidou positioning module and a GPS module; The posture sensor acquires posture information and outputs the posture information to the microcontroller chip; The microcontroller chip outputs the user position according to the posture information; the user position is output to the host; the host adjusts the position and angle of the virtual camera in the virtual application according to the user position.

6. The smart glasses system according to claim 3, characterized in that: The at least one input component includes: an external input button; The peripheral input button senses user input and outputs the sensed input data to the microcontroller chip; The microcontroller chip outputs a control signal according to the input data, and outputs the control signal to the corresponding controlled component via the relay chipset.

7. The smart glasses system according to claim 3, characterized in that: The at least one input component further includes: a fingerprint chip and / or a security chip; wherein the fingerprint chip collects a fingerprint image, performs feature analysis on the fingerprint image, and outputs a fingerprint recognition result according to the feature analysis result; the fingerprint recognition result is used to authenticate the user; The security chip stores user identity information of the smart glasses; the user identity information is used for identity authentication when the user uses the smart glasses.

8. The smart glasses system according to any one of claims 1 to 7, characterized in that: Also includes: Audio components; The audio component includes: an audio analog-to-digital converter, an audio amplifier connected to the audio analog-to-digital converter, and a player connected to the audio amplifier; Among them, the audio analog-to-digital converter is electrically connected to the relay chipset; the audio analog-to-digital converter receives the audio signal output by the relay chipset and performs analog-to-digital conversion on the audio signal; the audio signal after analog-to-digital conversion is amplified by the audio amplifier, and the amplified audio signal is output by the player.

9. The smart glasses system according to claim 8, characterized in that: The audio component further comprises: a microphone electrically connected to the audio analog-to-digital converter; the microphone is used to collect audio signals; The audio analog-to-digital converter converts the audio signal into an electrical signal, and the electrical signal is output to the host via the relay chipset; the host outputs an instruction for interactively controlling the virtual application according to the electrical signal.

10. The smart glasses system according to any one of claims 1 to 7, characterized in that: Also includes: A communication module connected to the relay chipset; The communication module includes: at least one of an E-SIM module, a Bluetooth module and a UWB module.

Images