Intelligent glasses and control system and method thereof

Abstract

The invention discloses intelligent glasses and a control system and method thereof, and the intelligent glasses comprise a glasses frame and a lens assembly disposed in the glasses frame. The control system comprises a microcontroller and a driving module, and the microcontroller is arranged on the glasses frame and used for obtaining preset adjustment data according to the trigger signal and outputting a first driving signal according to the preset adjustment data; the driving module is arranged on the spectacle frame, is in contact connection with the lens assemblies and is used for controlling the lens assemblies to deform according to the first driving signal, so that the distance information between the lens assemblies is matched with preset adjustment data. The problem that the operation convenience is low when the optical center distance of the lens is adjusted to adapt to different interpupillary distances at present can be relieved.

Description

Technical Field

[0001] The present application relates to the field of electronic technology, and in particular to smart glasses and their control systems and methods. Background Art

[0002] Augmented reality (AR) glasses, intelligent devices that merge virtual information with the real world, have broad applications in education, healthcare, entertainment, industry, and other fields. For example, in education, AR glasses can present three-dimensional teaching models to students, enhancing the learning experience. In healthcare, AR glasses can be used for surgical navigation and remote consultations. However, differences in interpupillary distance (IPD) between users pose challenges to the display quality and wearing comfort of AR glasses.

[0003] Currently, some AR glasses on the market use a fixed optical center distance design and cannot be adjusted according to the user's pupil distance. Some AR glasses with adjustable optical center distance usually use mechanical slides or gear transmissions, and manually rotate knobs or push sliders to adjust the position of the lenses to achieve optical center distance adjustment.

[0004] However, the manual adjustment process is cumbersome, and it is difficult for users to quickly and accurately find the pupil distance position that suits them. It takes a lot of time and effort to adjust, and the operation is inconvenient, which is not conducive to user experience.

[0005] Therefore, the current technology still needs to be improved and enhanced. Summary of the Invention

[0006] The present application provides a pair of smart glasses and a control system and method thereof, which can alleviate the problem of low operational convenience in adjusting the optical center distance of lenses to adapt to different pupil distances.

[0007] The present application provides a control system for smart glasses, which include a frame and a lens assembly disposed in the frame; the control system includes:

[0008] A microcontroller is provided on the frame; the microcontroller is used to obtain preset adjustment data according to the trigger signal and output a first driving signal according to the preset adjustment data;

[0009] The driving module is arranged on the frame and is in contact with the lens assembly. The driving module is also electrically connected to the microcontroller; the driving module is used to control the deformation of the lens assembly according to the first driving signal so that the distance information between the lens assemblies is adapted to the preset adjustment data.

[0010] In some embodiments of the control system of the smart glasses, the control system of the smart glasses also includes a command input module, which is arranged in the frame and electrically connected to the microcontroller; the command input module is used to obtain external control instructions and output a trigger signal according to the external control instructions.

[0011] In some embodiments, the control system of the smart glasses further includes a feedback module, which is disposed in the frame and electrically connected to the microcontroller;

[0012] The feedback module is used to detect the actual deformation amount of the lens assembly after the driving module drives the lens assembly to deform, and output the actual deformation amount to the microcontroller;

[0013] The microcontroller is also used to compare the actual deformation variable with the preset deformation variable corresponding to the preset adjustment data. When the deviation value between the actual deformation variable and the preset deformation variable is greater than a preset threshold, the microcontroller is also used to output a second drive signal to the drive module, so that the drive module continues to control the lens assembly to increase the target deformation variable or decrease the target deformation variable.

[0014] In some embodiments, the control system of the smart glasses further includes a communication module, which is disposed in the frame and electrically connected to the microcontroller;

[0015] The communication module is used to establish a communication connection with an external terminal device and to obtain target adjustment data sent by the external terminal device;

[0016] The microcontroller is further configured to store the target adjustment data as at least part of the preset adjustment data.

[0017] In some embodiments of the control system of the smart glasses, the feedback module includes at least two sensors, which are electrically connected to a microcontroller; the microcontroller is used to simultaneously obtain multiple actual deformation variables output by multiple sensors, and output a second drive signal based on the multiple actual deformation variables and the preset deformation variables.

[0018] In the control system of the smart glasses in some embodiments, the microcontroller is specifically used to obtain an average value based on the multiple actual deformation quantities when obtaining multiple actual deformation quantities, and compare the average value with the preset deformation quantity to output a second driving signal.

[0019] The present application also provides a method for controlling smart glasses, wherein the smart glasses include a frame and a lens assembly disposed in the frame. The control method includes:

[0020] Obtaining external control instructions, and obtaining preset adjustment data according to the external control instructions;

[0021] The lens components are controlled to deform according to the preset adjustment data so that the distance information between the lens components is adapted to the preset adjustment data.

[0022] In some embodiments, the method for controlling smart glasses further includes:

[0023] Detecting the actual deformation of the lens component;

[0024] The actual deformation amount is compared with the preset deformation amount corresponding to the preset adjustment data, and when the deviation value between the actual deformation amount and the preset deformation amount is greater than the preset threshold, the lens assembly is continued to be controlled to increase the target deformation amount or decrease the target deformation amount.

[0025] In some embodiments, the method for controlling smart glasses further includes:

[0026] Obtain target adjustment data sent by external terminal equipment;

[0027] The target adjustment data is stored as at least part of the preset adjustment data.

[0028] A pair of smart glasses in an embodiment of the present application includes the control system of the smart glasses described above.

[0029] The present application provides a kind of smart glasses and its control method and system, wherein, by integrating a microcontroller, a driving module and a flexible lens in the smart glasses, when the user wears the smart glasses, if there is a mismatch between the distance information of the lens assembly in the smart glasses and the pupil distance, then the microcontroller outputs a first driving signal to the driving module based on the preset adjustment data, so that the driving module controls the deformation of the lens assembly according to the first driving chip to adjust the distance information between the lens assemblies, so as to adapt to the preset adjustment data and meet the application requirements. During the adjustment process, there is no need to manually adjust the distance information of the lens assembly multiple times. Only by providing a trigger signal to the microcontroller, the microcontroller automatically controls the driving module to complete the adjustment of the lens assembly, thereby improving the convenience of operation and optimizing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The following detailed description of the specific embodiments of the present application in conjunction with the accompanying drawings will make the technical solutions and other beneficial effects of the present application apparent.

[0031] Figure 1 A schematic diagram of the structure of the smart glasses provided in an embodiment of the present application.

[0032] Figure 2 This is a first structural block diagram of the control system of the smart glasses provided in an embodiment of the present application.

[0033] Figure 3This is a second structural block diagram of the control system of the smart glasses provided in an embodiment of the present application.

[0034] Figure 4 This is a third structural block diagram of the control system of the smart glasses provided in an embodiment of the present application.

[0035] Figure 5 This is a fourth structural block diagram of the control system of the smart glasses provided in an embodiment of the present application.

[0036] Figure 6 This is a schematic diagram of the structure of the feedback module in the control system of the smart glasses provided in an embodiment of the present application.

[0037] Figure 7 This is a first flow chart of a method for controlling smart glasses according to an embodiment of the present application.

[0038] Figure 8 This is a second flow chart of the control method of the smart glasses provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the embodiments described are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0040] In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance or implicitly indicating the number of technical features indicated. The features specified as "first" and "second" may explicitly or implicitly include one or more features. In the description of this application, "multiple" means two or more, unless otherwise clearly and specifically defined.

[0041] See also Figure 1 and Figure 2The embodiment of the present application provides a control system for smart glasses, wherein the smart glasses include a frame 1 and a lens assembly 2 arranged in the frame 1. For example, two lens assemblies 2 are arranged in the frame 1, and the lens assembly 2 is arranged in the frame 1. Since the frame 1 plays the role of fixing and supporting the lenses, the optical center distance between the two lens assemblies 2 is also certain as the frame 1 is fixed. The two lens assemblies 2 in this embodiment can be made of flexible materials. Correspondingly, the control system of the smart glasses includes a microcontroller 11 and a driving module 12, and the microcontroller 11 and the driving module 12 are both integrated in the frame 1. Among them, the driving module 12 can be provided with at least one driving module 12 for each lens assembly 2 according to the number of lens assemblies 2. The microcontroller 11 is electrically connected to the driving module 12, and the driving module 12 is also in contact with the lens assembly 2.

[0042] The microcontroller 11 is configured to obtain preset adjustment data based on the trigger signal. This preset adjustment data may be pre-stored distance information of the lens assembly 2, which is the distance between the optical centers of the lens assembly 2. The microcontroller 11 obtains the preset adjustment data and outputs it to the first driver chip. The driver module 12 is configured to control the deformation of the lens assembly 2 based on the first drive signal so that the distance information between the lens assembly 2 matches the preset adjustment data.

[0043] In this embodiment, a microcontroller 11, a driver module 12, and a flexible lens are integrated into the smart glasses. When a user wears the smart glasses, if there is a mismatch between the distance information of the lens assembly 2 in the smart glasses and the pupil distance, the microcontroller 11 can obtain pre-stored preset adjustment data according to the external control instruction, and output a first drive signal to the driver module 12 based on the preset adjustment data, so that the driver module 12 controls the deformation of the lens assembly 2 according to the first driver chip to adjust the distance information between the lens assemblies 2 so as to adapt to the preset adjustment data and meet the application requirements. During the adjustment process, there is no need to manually adjust the distance information of the lens assembly 2 multiple times. Only a trigger signal is provided to the microcontroller 11 by inputting a control instruction, so that the microcontroller 11 automatically controls the driver module 12 to complete the adjustment of the lens assembly 2, thereby improving the convenience of operation and optimizing the user experience.

[0044] See also Figure 3In some embodiments, the control system of the smart glasses further includes a command input module 13, which is electrically connected to the microcontroller 11; wherein the command input module 13 is used to obtain external control commands, which may be control commands input by a user, and the command input module 13 outputs a trigger signal to the microcontroller 11 according to the external control commands. The command input module 13 includes a push button and / or a touch screen switch, and the user inputs different control commands based on the number of times the push button is pressed, or inputs different control commands based on the number of times the touch screen switch is touched. For example, pressing once selects one preset adjustment data, pressing twice selects another preset adjustment data, etc. This can be set according to actual structural requirements, and this application does not limit this.

[0045] See also Figure 4 In some embodiments, the control system of the smart glasses further includes a feedback module 14, which is disposed in the frame 1 and electrically connected to the microcontroller 11. The feedback module 14 is configured to detect the actual deformation of the lens assembly 2 after the drive module 12 drives the lens assembly 2 to deform, and output the actual deformation to the microcontroller 11. The microcontroller 11 is further configured to compare the actual deformation with a preset deformation corresponding to preset adjustment data. When the deviation between the actual deformation and the preset deformation is greater than a preset threshold, the microcontroller 11 is further configured to output a second drive signal to the drive module 12, causing the drive module 12 to continue controlling the lens assembly 2 to increase or decrease the target deformation.

[0046] After obtaining the preset adjustment data, the microcontroller 11 calculates the preset deformation amount that the lens assembly 2 needs to deform based on the corresponding preset adjustment data. Subsequently, the microcontroller 11 outputs a corresponding first drive signal to the drive module 12 based on the calculated deformation amount, and the drive module 12 controls the deformation of the lens assembly 2. Simultaneously, the feedback module 14 detects the actual deformation amount of the lens assembly 2 and outputs the actual deformation amount to the microcontroller 11. The microcontroller 11 compares the actual deformation amount with the preset deformation amount. When the deviation between the actual deformation amount and the preset deformation amount is greater than a preset threshold, the microcontroller 11 outputs a second drive signal to continue controlling the lens assembly 2 to increase or decrease the target deformation amount. The second drive signal in this embodiment can be understood as the drive signal output by the microcontroller 11 when performing secondary adjustment based on the actual deformation amount of the feedback module 14. The first drive signal is the drive signal output by the microcontroller 11 based on the external control instruction obtained by the instruction input module 13.

[0047] For example, if it is necessary to control the lens assembly 2 to deform in a direction away from the user so that the lens assembly 2 bulges outward, if the deviation between the actual deformation amount of the lens assembly 2 and the preset deformation amount is greater than a preset threshold value, it indicates that the lens assembly 2 bulges outward too much or the lens assembly 2 bulges outward too little. If the lens assembly 2 bulges outward too much, the microcontroller 11 controls the driving module 12 to drive the lens assembly 2 to deform in a direction close to the user by a target deformation amount. If the lens assembly 2 bulges outward too little, the microcontroller 11 controls the driving module 12 to drive the lens assembly 2 to continue deforming in a direction away from the user by a target deformation amount. The target deformation amount is the deformation amount required to achieve the preset deformation amount calculated based on the deviation value. In this embodiment, by providing the feedback module 14, the smart glasses can automatically correct the deformation amount of the lens assembly 2, thereby effectively improving the adjustment accuracy of the distance information in the lens assembly 2.

[0048] See also Figure 5 In some embodiments, the control system of the smart glasses further includes a communication module 15, which is integrated into the frame 1 and electrically connected to the microcontroller 11. The communication module 15 is configured to establish a communication connection with an external terminal device and to obtain target adjustment data sent by the external terminal device; the microcontroller 11 is further configured to store the target adjustment data as at least part of the preset adjustment data.

[0049] The microcontroller 11 in each smart glasses can pre-store a variety of different preset adjustment data. In subsequent applications, the user can adjust and select the required preset adjustment data according to actual needs. Of course, in order to expand the application scenarios of smart glasses, a communication module 15 can also be provided, and a communication connection is established with an external terminal device based on the communication module 15 to obtain the preset adjustment data. Specifically, the user can set relevant target adjustment data through the external terminal device. The target adjustment data can be the distance information of the lens assembly 2 formulated by the user according to his or her actual needs, and the external terminal device establishes a communication connection with the smart glasses. The microcontroller 11 can obtain the target adjustment data through the communication module 15 and store the target adjustment data as part of the preset adjustment data. Then, the microcontroller 11 can directly adjust the distance information of the lens assembly 2 according to the target adjustment data, thereby improving the adjustment flexibility of the smart glasses to optimize the user experience. It should be noted that the communication module 15 can be wired communication or wireless communication, and can be set according to actual conditions. This application does not limit this.

[0050] See also Figure 6In some embodiments, the feedback module 14 includes at least two sensors 141, which are electrically connected to the microcontroller 11; the microcontroller 11 is used to simultaneously obtain multiple actual deformation variables output by multiple sensors 141, and output a second driving signal based on the multiple actual deformation variables and the preset deformation variables.

[0051] Specifically, if two sensors 141 are set, then a sensor 141 is set for each lens in the lens assembly 2. The microcontroller 11 obtains the actual deformation quantities of the two lens assemblies 2 based on the two sensors 141 respectively, and compares the actual deformation quantities of the two lenses with the preset deformation quantities. When the deviation value between the actual deformation quantity and the preset deformation quantity is greater than the preset threshold value, the second drive is output for secondary adjustment.

[0052] When multiple sensors 141 are provided, two or more sensors 141 are provided for at least one lens of the lens assembly 2. In a specific configuration, the multiple sensors 141 can be arranged around the lens, with sensors 141 positioned at different locations on the lens. For each lens, the microcontroller 11 will obtain multiple actual deformation values. The microcontroller 11 will then compare these actual deformation values ​​with the preset deformation value for that lens to facilitate secondary adjustment.

[0053] As an embodiment, for one of the lenses, when the microcontroller 11 obtains multiple actual deformation variables, the microcontroller 11 obtains an average value based on the multiple actual deformation variables, and compares the average value with the preset deformation variable to output a second drive signal. Of course, the microcontroller 11 can also select one of the multiple actual deformation variables to compare with the preset deformation variable. In this embodiment, multiple sensors 141 are set for a single lens, and the average value is taken based on the actual deformation variables obtained by the multiple sensors 141 to improve the detection accuracy, so as to facilitate more accurate adjustment of the deformation variable of the lens, thereby further improving the adjustment accuracy. It should be noted that the sensor 141 can be a sensor 141 that can realize deformation variable detection, such as a strain gauge sensor 141, a Hall sensor 141 or an optical sensor 141, etc., and can be specifically set according to actual needs, which is not limited by this application.

[0054] In one embodiment, the drive module 12 includes a MEMS (micro-electromechanical system) drive device. This drive system includes a microactuator and corresponding control circuitry. The microactuator is connected to the lens assembly 2 to drive the lens to deform. The number of microactuators is adapted to the number of lens assemblies 2, and the corresponding number can be the same as the number of lens assemblies 2. The microactuator is also connected to the control circuitry, and the microcontroller 11 controls the operation of the microactuator through the control circuitry. This drive device is currently known, and its specific structure and operation are not described in detail.

[0055] The smart glasses of this application are equipped with a control system that controls the deformation of the lens assembly 2 according to external control instructions to adjust the distance information of the lens assembly 2. This adjusts the distance information of the lens assembly 2 to the user's pupil distance, thereby improving wearing comfort. During the adjustment process, there is no need to manually adjust the distance information of the lens assembly 2. Only a trigger signal is provided to the microcontroller 11 by inputting a control instruction, which automatically controls the drive module 12 to complete the adjustment of the lens assembly 2. This improves operational convenience and optimizes the user experience.

[0056] At the same time, the control system of the smart glasses in this application eliminates the traditional mechanical slide rails and gear transmission structure, which can reduce the weight and volume of the smart glasses and further improve wearing comfort.

[0057] See also Figure 7 The present application also provides a method for controlling smart glasses, which is applied to the above-mentioned control system. The method includes:

[0058] 100. Obtain an external control instruction, and obtain preset adjustment data according to the external control instruction;

[0059] 200. Control the lens assembly to deform according to the preset adjustment data, so that the distance information between the lens assemblies is adapted to the preset adjustment data.

[0060] In this embodiment, when a user wears the smart glasses, if there is a mismatch between the distance information of the lens assemblies and the pupil distance, the smart glasses can receive an external control command, retrieve pre-stored preset adjustment data based on the control command, and output a first drive signal based on the preset adjustment data to control the deformation of the lens assemblies to adjust the distance information between the lens assemblies to match the preset adjustment data and meet the application requirements. During the adjustment process, there is no need to manually adjust the distance information of the lens assemblies. Simply inputting a control command provides a trigger signal to the smart glasses, causing them to automatically control the deformation of the lens assemblies to adjust the distance information. This improves the reliability of the smart glasses, facilitates operation, and optimizes the user experience.

[0061] See also Figure 8 In some embodiments, the method for controlling smart glasses further includes:

[0062] 300. Detecting the actual deformation amount of the lens assembly;

[0063] 400. Compare the actual deformation amount with the preset deformation amount corresponding to the preset adjustment data, and when the deviation between the actual deformation amount and the preset deformation amount is greater than a preset threshold, continue to control the lens assembly to increase the target deformation amount or decrease the target deformation amount.

[0064] After obtaining the preset adjustment data, the smart glasses calculate the preset deformation amount of the lens assembly based on the corresponding preset adjustment data. They then control the lens assembly to deform according to the calculated deformation amount. Simultaneously, the control system in the smart glasses also detects the actual deformation amount of the lens assembly and compares it with the preset deformation amount. If the deviation between the actual deformation amount and the preset deformation amount exceeds a preset threshold, the control system continues to control the lens assembly to deform, thereby improving the adjustment accuracy of the smart glasses.

[0065] In some embodiments, the control method of the smart glasses further includes: when obtaining multiple actual deformation variables, obtaining an average value based on the multiple actual deformation variables, and using the average value as the actual deformation variable for comparison with the preset deformation variable. At least one lens of the lens assembly is provided with two or more sensors. For one of the lenses, the smart glasses will obtain multiple actual deformation variables. At this time, the smart glasses will refer to the multiple actual deformation variables and compare them with the preset deformation variable of the lens to facilitate secondary adjustment. Specifically, an average value can be obtained based on the multiple actual deformation variables, and the average value can be compared with the preset deformation variable to output a second drive signal, thereby improving detection accuracy, so as to facilitate more precise adjustment of the deformation variable of the lens, thereby further improving the adjustment accuracy.

[0066] An embodiment of the present application further provides a pair of smart glasses, which include the above-mentioned control system. Since the control system has been described in detail above, it will not be repeated here.

[0067] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0068] The above is a detailed introduction to the control system of the smart glasses provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the technical solutions and core ideas of the present application. Ordinary technicians in this field should understand that they can still modify the technical solutions recorded in the aforementioned embodiments, or replace some of the technical features therein with equivalents; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A control system for smart glasses, characterized in that: The smart glasses include a frame and a lens assembly arranged in the frame; the control system includes: A microcontroller, the microcontroller being disposed on the frame; the microcontroller being configured to obtain preset adjustment data according to a trigger signal, and output a first driving signal according to the preset adjustment data; A driving module is provided on the frame and is in contact with the lens assembly, and is also electrically connected to the microcontroller; the driving module is used to control the deformation of the lens assembly according to the first driving signal so that the distance information between the lens assemblies is adapted to the preset adjustment data.

2. The control system of smart glasses according to claim 1, characterized in that: The control system of the smart glasses further includes a command input module, which is disposed in the frame and configured to obtain external control commands and output the trigger signal according to the external control commands.

3. The control system of smart glasses according to claim 2, characterized in that: The control system of the smart glasses further includes a feedback module, which is disposed in the frame and electrically connected to the microcontroller; The feedback module is used to detect the actual deformation amount of the lens assembly after the driving module drives the lens assembly to deform, and output the actual deformation amount to the microcontroller; The microcontroller is also used to compare the actual deformation amount with the preset deformation amount corresponding to the preset adjustment data. When the deviation value between the actual deformation amount and the preset deformation amount is greater than a preset threshold, the microcontroller is also used to output a second drive signal to the drive module, so that the drive module continues to control the lens assembly to increase the target deformation amount or decrease the target deformation amount.

4. The control system of smart glasses according to claim 3, characterized in that: The control system of the smart glasses further comprises a communication module, which is disposed in the frame and electrically connected to the microcontroller; The communication module is used to establish a communication connection with an external terminal device and to obtain target adjustment data sent by the external terminal device; The microcontroller is further configured to store the target adjustment data as at least part of the preset adjustment data.

5. The control system of smart glasses according to claim 3, characterized in that: The feedback module includes at least two sensors, which are electrically connected to the microcontroller; the microcontroller is used to simultaneously obtain multiple actual deformation variables output by multiple sensors, and output the second drive signal based on the multiple actual deformation variables and the preset deformation variable.

6. The control system of smart glasses according to claim 5, characterized in that: The microcontroller is specifically configured to obtain an average value according to the multiple actual deformation values ​​when obtaining the multiple actual deformation values, and compare the average value with the preset deformation value to output the second driving signal.

7. A method for controlling smart glasses, characterized in that: The smart glasses include a frame and a lens assembly arranged in the frame, and the control method includes: Obtaining an external control instruction, and obtaining preset adjustment data according to the external control instruction; The lens assembly is controlled to deform according to the preset adjustment data, so that the distance information between the lens assemblies is adapted to the preset adjustment data.

8. The control method of smart glasses according to claim 7, characterized in that: The control method of the smart glasses further includes: detecting an actual deformation amount of the lens assembly; The actual deformation amount is compared with the preset deformation amount corresponding to the preset adjustment data, and when the deviation value between the actual deformation amount and the preset deformation amount is greater than a preset threshold, the lens assembly is continued to be controlled to increase the target deformation amount or decrease the target deformation amount.

9. The control method of smart glasses according to claim 7, characterized in that: The control method of the smart glasses further includes: Obtain target adjustment data sent by external terminal equipment; The target adjustment data is stored as at least part of the preset adjustment data.

10. A pair of smart glasses, characterized in that: A control system comprising the smart glasses according to any one of claims 1 to 6.

Images