Intelligent glasses control method, intelligent glasses and vehicle-mounted intelligent glasses system

Abstract

The embodiment of the invention relates to an intelligent glasses control method, intelligent glasses and a vehicle-mounted intelligent glasses system. The method comprises the steps that user eye data collected by a first sensor on the intelligent glasses and vehicle driving data collected by a second sensor on a vehicle are obtained; determining a watching intention of the user based on the user eye data; and rendering the vehicle driving data according to a data rendering mode corresponding to the watching intention, and displaying the rendered vehicle driving data on lenses of the intelligent glasses. According to the embodiment of the invention, the user intention can be identified through the user eye data collected by the sensor, and the vehicle driving related information is displayed according to the user intention, so that the vehicle information can be displayed on the lenses according to the user intention without manually setting the intelligent glasses by the user; and the interaction flexibility and the use convenience of the intelligent glasses and the vehicle are improved.

Description

Technical Field

[0001] The present application relates to the technical field of smart wearable devices, and in particular to a smart glasses control method, smart glasses, and a vehicle-mounted smart glasses system. Background Art

[0002] AR (Augmented Reality) smart glasses are a technology that combines virtual reality with the real world, providing users with an enhanced visual experience by overlaying digital information on the real environment. Through AR glasses, users can see the real world around them, and digital content related to the real environment, such as images, videos, text, and 3D models, is displayed in their field of view.

[0003] AR glasses interact with vehicles, enabling navigation information and other content to be displayed on the glasses, providing users with a completely new navigation experience. Existing methods for using AR glasses for navigation typically require users to manually configure the glasses. AR glasses cannot automatically recognize user intent or automatically interact with the vehicle based on user intent, making them inconvenient to use in driving environments and limiting flexibility in vehicle interaction. Summary of the Invention

[0004] In view of this, in order to solve some or all of the above technical problems, the embodiments of the present application provide a smart glasses control method, smart glasses, and a vehicle-mounted smart glasses system.

[0005] In a first aspect, an embodiment of the present application provides a method for controlling smart glasses, the method comprising: obtaining user eye data collected by a first sensor on the smart glasses, and vehicle driving data collected by a second sensor on the vehicle; determining the user's viewing intention based on the user's eye data; rendering the vehicle driving data according to a data rendering method corresponding to the viewing intention, and displaying the rendered vehicle driving data on the lenses of the smart glasses.

[0006] In one possible embodiment, obtaining user eye data collected by a first sensor on the smart glasses includes: obtaining eye movement data collected by an eye tracking camera on the smart glasses, and using the eye movement data as user eye data; determining the user's viewing intention based on the user's eye data, including: identifying the user's field of view and gaze duration based on the eye movement data; if the gaze duration is greater than a preset first gaze duration threshold and the field of view is in the center area of ​​the smart glasses, determining the user's viewing intention is a gaze intention; if the gaze duration is less than a preset second gaze duration threshold and the field of view reaches the edge area of ​​the smart glasses, determining the user's viewing intention is a scan intention; rendering vehicle driving data according to a data rendering method corresponding to the viewing intention, including: if the viewing intention is a gaze intention, switching the viewing angle mode of the smart glasses to a narrow viewing angle mode, and determining key objects within the field of view based on the vehicle driving data, and rendering the key objects; if the viewing intention is a scan intention, switching the viewing angle mode of the smart glasses to a wide-angle mode, and determining the vehicle's driving environment data based on the vehicle driving data, and rendering the driving environment data.

[0007] In one possible implementation, based on vehicle driving data, key objects within the field of view are determined and rendered, including: determining a local lens area on the smart glasses corresponding to the field of view; adjusting the focal length of the local lens area to a target focal length so that the imaging magnification corresponding to the field of view is magnified to the target magnification; and enhancing the display of the key objects within the field of view.

[0008] In one possible embodiment, based on the vehicle driving data, the vehicle's driving environment data is determined, and the driving environment data is rendered, including: in response to the vehicle's status meeting the conditions for triggering dynamic blind spot monitoring, extracting distance data between the vehicle and other vehicles from the vehicle's driving data; based on the distance data, displaying a blind spot monitoring screen on the lenses of the smart glasses; in response to the vehicle's status meeting the conditions for triggering a risk warning, determining a risk avoidance path from the vehicle's driving data, and rendering the risk avoidance path on the lenses of the smart glasses.

[0009] In one possible embodiment, the vehicle driving data is rendered in a data rendering method corresponding to the viewing intention, and also includes: if the viewing intention is a gaze intention, determining the target device that the user is gazing at; in response to the time the user gazes at the target device exceeding a preset third gaze time threshold, and the target device belongs to a preset type of device, displaying a virtual control interface corresponding to the target device on the lenses of the smart glasses; based on the virtual control interface and the eye movement data, controlling the target device to execute a preset function.

[0010] In one possible embodiment, after obtaining the user's eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: obtaining lighting data of the vehicle's environment from the vehicle driving data; if the lighting data indicates that the lighting intensity of the vehicle's environment is greater than a preset intensity threshold, switching the viewing angle mode of the smart glasses to a narrow viewing angle mode, and controlling the smart glasses to perform a strong light suppression operation.

[0011] In one possible embodiment, after obtaining the user's eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: determining the user's vision compensation data based on the user's eye data; and adjusting the focal length of the lenses of the smart glasses based on the vision compensation data so that the lenses adapt to the user's vision.

[0012] In one possible embodiment, after obtaining the user's eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: using a pre-trained emotion recognition model to identify the user's eye data to obtain the user's emotion category; based on the emotion category, controlling the smart glasses to perform corresponding emotion response operations.

[0013] In one possible embodiment, after obtaining the user's eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method also includes: using a pre-trained fatigue prediction model to predict fatigue on the user's eye data to obtain the user's fatigue index; based on the fatigue index, controlling the smart glasses and the vehicle to perform corresponding fatigue response operations.

[0014] In one possible embodiment, based on the fatigue index, the smart glasses and the vehicle are controlled to perform corresponding fatigue response operations, including: if the fatigue index meets the preset light therapy plan execution conditions, based on the user's eye data, the execution time of the light therapy plan is determined, wherein the execution time includes a first execution time and a second execution time; the blue light source on the smart glasses is controlled to start, and after running for the first execution time, the blue light source is turned off, and the red light source on the smart glasses is controlled to start, and after running for the second execution time, the red light source is turned off.

[0015] In a second aspect, an embodiment of the present application provides a pair of smart glasses, comprising: an imaging lens, a first sensor, and a controller; the first sensor and the controller are communicatively connected, and the controller is used to execute the above-mentioned smart glasses control method.

[0016] In a possible implementation, the imaging lens is a variable focus lens, and a control signal input end of the variable focus lens is connected to the controller.

[0017] In one possible implementation, the smart glasses further include a fatigue relief device, and a control signal input end of the fatigue relief device is connected to the controller.

[0018] In a third aspect, an embodiment of the present application provides a vehicle-mounted smart glasses system, which includes: a vehicle and the above-mentioned smart glasses, and a controller of the smart glasses is communicatively connected to the vehicle's on-board system.

[0019] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: a memory for storing a computer program; a processor for executing the computer program stored in the memory, and when the computer program is executed, implementing the method of any embodiment of the smart glasses control method of the first aspect of the present application.

[0020] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method of any embodiment of the smart glasses control method of the first aspect described above is implemented.

[0021] In a sixth aspect, an embodiment of the present application provides a computer program, which includes a computer-readable code. When the computer-readable code runs on a device, the processor in the device implements a method as in any embodiment of the smart glasses control method of the first aspect mentioned above.

[0022] The smart glasses control method, smart glasses, and vehicle-mounted smart glasses system provided in the embodiments of the present application obtain user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle, determine the user's viewing intention based on the user's eye data, render the vehicle driving data according to a data rendering method corresponding to the viewing intention, and display the rendered vehicle driving data on the lenses of the smart glasses. The embodiments of the present application realize the interaction between smart glasses and vehicles. The smart glasses can identify the user's intention through the user's eye data collected by the sensors and display vehicle driving related information according to the user's intention. Therefore, the vehicle information can be displayed on the lenses according to the user's intention without the user having to manually set the smart glasses, thereby improving the flexibility and convenience of the interaction between smart glasses and vehicles. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0024] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0025] One or more embodiments are exemplarily illustrated by pictures in the corresponding drawings. These exemplifications do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings are represented as similar elements. Unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0026] Figure 1 A flowchart of a smart glasses control method provided in an embodiment of the present application;

[0027] Figure 2 A schematic flow chart of a second smart glasses control method provided in an embodiment of the present application;

[0028] Figure 3 A schematic flow chart of a third smart glasses control method provided in an embodiment of the present application;

[0029] Figure 4 A schematic flow chart of a fourth smart glasses control method provided in an embodiment of the present application;

[0030] Figure 5 A schematic flow chart of a fifth smart glasses control method provided in an embodiment of the present application;

[0031] Figure 6 A schematic flow chart of a sixth smart glasses control method provided in an embodiment of the present application;

[0032] Figure 7 A schematic flow chart of a seventh smart glasses control method provided in an embodiment of the present application;

[0033] Figure 8 A flowchart of an eighth smart glasses control method provided in an embodiment of the present application;

[0034] Figure 9 A schematic structural diagram of smart glasses provided in an embodiment of the present application;

[0035] Figure 10 A system architecture diagram of a vehicle-mounted smart glasses system provided in an embodiment of the present application;

[0036] Figure 11 A schematic diagram of the structure of a smart glasses control device provided in an embodiment of the present application;

[0037] Figure 12A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It is apparent that the described embodiments are only a portion of the embodiments of the present application, rather than all of the embodiments. It should be noted that, unless otherwise specifically stated, the relative arrangement of components and steps, numerical expressions, and numerical values ​​described in these embodiments do not limit the scope of the present application.

[0039] Those skilled in the art will understand that the terms "first" and "second" in the embodiments of the present application are only used to distinguish between different steps, devices, modules and other objects, and neither represent any specific technical meaning nor indicate the logical order between them.

[0040] It should also be understood that in this embodiment, “a plurality of” may refer to two or more than two, and “at least one” may refer to one, two or more than two.

[0041] It should also be understood that any component, data or structure mentioned in the embodiments of the present application can generally be understood as one or more, unless explicitly limited or otherwise indicated in the context.

[0042] In addition, the term "and / or" in this application is simply a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this application generally indicates that the related objects are in an "or" relationship.

[0043] It should also be understood that the description of each embodiment in this application focuses on the differences between the embodiments, and the same or similar aspects can be referenced with each other. For the sake of brevity, they will not be described one by one.

[0044] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0045] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the above-mentioned technologies, methods, and equipment should be considered part of the specification.

[0046] It should be noted that like reference numerals and letters refer to like items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0047] It should be noted that, unless there is a conflict, the embodiments and features in the embodiments of this application can be combined with each other. To facilitate understanding of the embodiments of this application, the application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0048] In order to solve the technical problem of low flexibility and convenience in the use of smart glasses in driving scenarios in the existing technology, the present application provides a smart glasses control method that can automatically identify user intentions based on user eye data and display vehicle-related information in driving scenarios according to the intentions, thereby greatly improving the convenience and flexibility of use.

[0049] Figure 1 This is a flow chart of a method for controlling smart glasses provided in an embodiment of the present application. This method can be applied to smart glasses, such as AR smart glasses. This method is typically performed by a controller on the smart glasses. Optionally, this method can also be performed by other electronic devices (such as mobile phones, servers, etc.) that are communicatively connected to the smart glasses.

[0050] In addition, the execution subject of this method can be hardware or software. When the execution subject is hardware, the execution subject can be one or more of the above-mentioned electronic devices. For example, a single electronic device can execute this method, or multiple electronic devices can cooperate with each other to execute this method. When the execution subject is software, the method can be implemented as multiple software or software modules, or as a single software or software module. No specific limitations are given here.

[0051] like Figure 1 As shown, the method specifically includes:

[0052] Step 101: Obtain user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle.

[0053] In some embodiments, the smart glasses are typically AR glasses that can display information on the lenses in real time. The smart glasses can be provided with various types of sensors, which are referred to as first sensors in this embodiment. For example, the smart glasses are provided with a camera, a temperature sensor, a humidity sensor, an intraocular pressure sensor, etc. Accordingly, the first sensor can collect various data such as eye images, eye temperature, humidity, and intraocular pressure, which are collectively referred to as user eye data.

[0054] The vehicle is equipped with various types of sensors, which are referred to as second sensors in this embodiment. For example, the vehicle is equipped with a speed sensor, a lidar, a camera, etc. Accordingly, the second sensor can collect data such as the vehicle's speed, position, temperature, radar point cloud, and obstacle location. This data is collectively referred to as vehicle driving data.

[0055] Step 102: Determine the user's viewing intention based on the user's eye data.

[0056] In some embodiments, a user's viewing intent can be determined by identifying the user's eye data. For example, the user's eye data may include an image of the user's eyes. Based on the position of the pupil in the image, the user's gaze direction can be determined. If the user's gaze remains on a certain object for a prolonged period based on the gaze direction, it can be determined that the user is looking at the object. For another example, if the user's eye data determines that the user's gaze is located at the edge of the lenses of the smart glasses, it can be determined that the user is looking in the rearview mirror.

[0057] Step 103 : Render the vehicle driving data according to a data rendering method corresponding to the viewing intention, and display the rendered vehicle driving data on the lenses of the smart glasses.

[0058] In some embodiments, the correspondence between viewing intent and data rendering method can be preset, that is, different viewing intents can render the vehicle driving data in different ways.

[0059] For example, vehicle driving data may include road images captured by a camera on the vehicle. If the user's viewing intent is to look at a target in front of the vehicle (such as a road sign or traffic light), the road image can be identified to determine the type of target the user is looking at. The target can then be rendered (by displaying a virtual icon, distance information, type information, etc.) to provide a prompt to the user.

[0060] For example, vehicle driving data can include distance information obtained by the vehicle's lidar scanning its surroundings. This distance information can indicate the distance between the vehicle and other vehicles and obstacles. If the user's viewing intent is to look in the rearview mirror or scan the surrounding environment, a distance heat map can be rendered on the lenses of the smart glasses.

[0061] The smart glasses control method provided in the embodiment of the present application obtains user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle, determines the user's viewing intention based on the user's eye data, renders the vehicle driving data according to a data rendering method corresponding to the viewing intention, and displays the rendered vehicle driving data on the lenses of the smart glasses. The embodiment of the present application realizes the interaction between smart glasses and vehicles. The smart glasses can identify the user's intention through the user's eye data collected by the sensors and display vehicle driving related information according to the user's intention. Therefore, the vehicle information can be displayed on the lenses according to the user's intention without the user having to manually set the smart glasses, thereby improving the flexibility and convenience of the interaction between smart glasses and vehicles.

[0062] In some optional implementations of this embodiment, such as Figure 2 As shown, step 101 includes:

[0063] Step 1011: Acquire eye movement data collected by the eye tracking camera on the smart glasses, and use the eye movement data as user eye data.

[0064] Among them, eye movement data may include but is not limited to at least one of the following: the direction of the user's eye movement, the frequency of movement, the size of the pupil, the frequency of blinking, the degree of eyelid opening, etc.

[0065] Step 102 includes:

[0066] Step 1021: Identify the user's visual range and gaze duration based on the eye movement data.

[0067] Specifically, eye movement data can be identified based on relevant technologies in the field to determine the changes in the user's gaze direction and determine the range of the gaze. The above-mentioned gaze duration can be the length of time the user's gaze stays in each direction.

[0068] Step 1022: If the gaze duration is greater than a preset first gaze duration threshold, and the visual range is in the central area of ​​the smart glasses, it is determined that the user's viewing intention is a gaze intention.

[0069] The first gaze duration threshold can be set according to actual needs, for example, 0.3 seconds. Gaze intent means that the user's gaze stays on a target object for a long time, that is, the user is currently gazing at a target object.

[0070] Step 1023: If the gaze duration is less than a preset second gaze duration threshold, and the visual range reaches the edge area of ​​the smart glasses, it is determined that the user's viewing intention is a scanning intention.

[0071] The second gaze duration threshold can be set according to actual needs, for example, 0.1 seconds. Glancing intention means that the user's line of sight changes rapidly, that is, the user is currently scanning a large area around the vehicle.

[0072] Step 103 includes:

[0073] Step 1031: If the viewing intention is a gaze intention, the viewing angle mode of the smart glasses is switched to a narrow viewing angle mode, and based on the vehicle driving data, key objects within the visual range are determined and rendered.

[0074] Among them, the narrow viewing angle mode can be a mode for displaying the scene within the central area of ​​the smart glasses. For example, in the narrow viewing angle mode, the center of each lens can be used as the origin, and objects within the range of ±10% of the total field of view can be used as objects for rendering operations. Furthermore, vehicle driving data can be identified (for example, target detection can be performed on road images) to determine key objects within the above-mentioned field of view. Key objects can be specific types of objects, such as road signs, lane lines, traffic lights, etc.

[0075] The electronic device executing this method can render the key object in the display area of ​​the lens, for example, displaying prompt text, prompt icons, distance marking and other information at the display position of the target object.

[0076] Step 1032: If the viewing intention is a scanning intention, the viewing angle mode of the smart glasses is switched to a wide-angle mode, and based on the vehicle driving data, the vehicle driving environment data is determined and the driving environment data is rendered.

[0077] Among them, the wide-angle mode can be a mode for displaying the surrounding environment of the vehicle. For example, in wide-angle mode, the scene within a range of 180°, 270° or 360° around the vehicle can be displayed on the lenses of the smart glasses. Furthermore, the vehicle driving data can be identified to determine the driving environment data. For example, the point cloud data collected by the lidar is identified to determine the distance to surrounding vehicles, obstacles and other objects, and the distance is used as driving environment information to render distance heat maps and other information on the lenses. For another example, the lane can be identified, and the lane information can be used as driving environment data to render the lane information on the lenses.

[0078] This embodiment collects eye movement data to determine the user's gaze intention and switches between narrow-angle and wide-angle modes, thereby autonomously determining the user's intention based on the user's eye movements and efficiently displaying the corresponding information. This improves the convenience of smart glasses in displaying information, helps users to view the road conditions around the vehicle more specifically, and improves driving safety.

[0079] In some optional implementations of this embodiment, such as Figure 3 As shown, step 1031 includes:

[0080] Step 10311: Determine the local lens area on the smart glasses corresponding to the field of view.

[0081] As an example, the local lens area may be an area within ±10% of the center of the lens.

[0082] Step 10312: Adjust the focal length of the local lens area to the target focal length so that the imaging magnification corresponding to the visual range is magnified to the target magnification.

[0083] Specifically, the lenses of the smart glasses in this embodiment can be focal-adjustable lenses. For example, a liquid lens module can be used to achieve controllable zoom through the electrowetting effect. When executing this step, the electronic device can send a control signal to the medium within the aforementioned local lens area, adjusting the focal length of the local lens area to the target focal length, thereby magnifying objects within the corresponding field of view to the target magnification (e.g., 3x).

[0084] Step 10313: Enhance the display of key objects within the field of view.

[0085] Ways to enhance display may include, but are not limited to: displaying prompt boxes, prompt texts, and other information at the locations of key objects.

[0086] By using a lens with adjustable focal length, this embodiment can more specifically magnify the area the user is looking at in an optical magnification manner, allowing the user to view key objects more clearly, thereby helping to improve the targeting and accuracy of viewing the surrounding environment in driving scenarios and improving driving safety.

[0087] In some optional implementations of this embodiment, step 1032 may include the following two implementations:

[0088] Implementation method 1: In response to the vehicle's status meeting the conditions for triggering dynamic blind spot monitoring, the distance data between the vehicle and other vehicles is extracted from the vehicle's driving data; based on the distance data, the blind spot monitoring screen is displayed on the lenses of the smart glasses.

[0089] Specifically, the triggering conditions for the above-mentioned dynamic blind spot monitoring can be set according to actual needs. Generally, dynamic blind spot monitoring is triggered when it is detected that the vehicle is traveling on a specific road section or performing a specific action. For example, when a vehicle drives to an intersection and needs to turn, or the vehicle is about to change lanes, or the vehicle behind is approaching quickly, dynamic blind spot monitoring is triggered. The electronic device can then extract the distance data from other vehicles and render a blind spot monitoring screen on the lens based on the distance data. The blind spot monitoring screen can be displayed in the form of a distance heat map, an animation simulating the position of other vehicles, etc.

[0090] In an exemplary scenario, if the user changes lanes to the left, the user's eyes scan the left rearview mirror area, which triggers dynamic blind spot monitoring. The position of the vehicle behind the left and the collision countdown can be displayed panoramically on the smart glasses.

[0091] Implementation method 2: In response to the vehicle's status meeting the conditions for triggering a risk warning, a risk avoidance path is determined from the vehicle's driving data, and the risk avoidance path is rendered on the lenses of the smart glasses.

[0092] The triggering conditions for risk warnings can be customized based on actual needs. Typically, a risk warning is triggered when the vehicle is detected to be in a potentially risky situation. For example, a risk warning is triggered when an obstacle or pedestrian is detected in front of the vehicle. The electronic device can determine an avoidance path based on navigation information to guide the user to avoid collision risks. The avoidance path can be displayed using colored arrows, guide lines, and other forms.

[0093] In an exemplary scenario, if a vehicle is driving in an urban area and approaches an intersection, and suddenly encounters a pedestrian crossing the road, the smart glasses in wide-angle mode will highlight the avoidance path with a green guide line and mark the danger with red.

[0094] This embodiment realizes real-time interaction between smart glasses and vehicle status monitoring by setting trigger conditions for dynamic blind spot monitoring and risk warning, which helps to efficiently remind users of possible driving risks and improve driving safety.

[0095] In some optional implementations of this embodiment, such as Figure 4 As shown, step 103 also includes:

[0096] Step 1033: If the viewing intention is a gaze intention, determine the target device that the user is gazing at.

[0097] Specifically, the user's gaze direction can be determined by real-time tracking of the user's eyeballs, and then compared with the preset location information of the target device to determine whether the user's gaze falls on the target device.

[0098] Step 1034 : In response to the user gazing at the target device for a period exceeding a preset third gaze duration threshold, and the target device is a device of a preset type, a virtual control interface corresponding to the target device is displayed on the lenses of the smart glasses.

[0099] For example, the third gaze duration threshold may be 0.5 seconds, and the target device may be a window lift button. If it is detected that the user's gaze is on the window lift button for more than 0.5 seconds, the position information of the window lift button may be obtained, and based on the position information, a virtual button may be displayed at the corresponding position on the smart glasses.

[0100] Step 1035 : Based on the virtual control interface and the eye movement data, control the target device to execute a preset function.

[0101] Continuing with the above example, the user can further control the virtual buttons through eye movements to control the lifting and lowering status of the car windows.

[0102] In this embodiment, in order to improve the accuracy of determining the position of the target device, UWB positioning devices can be installed on the vehicle and smart glasses to achieve a positioning accuracy of ±3 cm through nanosecond pulse signals (non-carrier).

[0103] Optionally, after displaying the virtual control interface, the electronic device executing this method may further recognize the user's gestures through images captured by a camera, thereby enabling the virtual control interface to be controlled by gestures.

[0104] This embodiment sets the correspondence between the user's sight direction and the position of the target device in the narrow viewing angle mode, so that certain devices on the vehicle can be controlled by the user's eye movements, further improving the convenience of vehicle control.

[0105] In some optional implementations of this embodiment, such as Figure 5 As shown, after step 101, the method further includes:

[0106] Step 104: Obtain illumination data of the vehicle's environment from the vehicle's driving data.

[0107] Specifically, a light sensor can be set on smart glasses or vehicles to collect light data in real time.

[0108] Step 105 : If the illumination data indicates that the illumination intensity of the vehicle's environment is greater than a preset intensity threshold, the viewing angle mode of the smart glasses is switched to a narrow viewing angle mode, and the smart glasses are controlled to perform a strong light suppression operation.

[0109] Specifically, if the vehicle's ambient light intensity is too high, the viewing angle mode is switched to a narrow viewing angle mode to allow the user to focus on the road ahead. This glare suppression can be achieved by adjusting the contrast of the displayed information, for example. Optionally, the lenses of the smart glasses can include a polarization filter function, which adjusts the polarization direction of the lenses by applying an electric field to reduce the intensity of light entering the human eye. Alternatively, the lenses can be provided with an EC film, which adjusts the color of the lenses by applying an external electric field.

[0110] This embodiment automatically suppresses the intensity of light entering the human eye by detecting the light intensity of the vehicle's environment in real time and setting a strong light suppression function on the lens, thereby avoiding the impact of excessive light intensity on driving the vehicle and improving safety.

[0111] In some optional implementations of this embodiment, such as Figure 6 As shown, after step 101, the method further includes:

[0112] Step 106: Determine the user's vision compensation data based on the user's eye data.

[0113] Typically, when a user wears the headset for the first time, the user's eye movement data can be collected to calibrate the user's vision and generate a vision compensation curve. The data representing the curve is the vision compensation data.

[0114] Step 107: Based on the vision compensation data, adjust the focal length of the lenses of the smart glasses to adapt the lenses to the user's vision.

[0115] The lenses of these smart glasses can include liquid lens modules. By outputting corresponding control signals to each module, the liquid changes state, achieving the effect of adjusting the focal length. Based on the aforementioned vision compensation curve and the user's eye movement data, the user's vision impairment can be determined in real time, and the corresponding focal length can be determined.

[0116] In this embodiment, by setting vision compensation data, the focal length of the lens can be automatically matched to the user's vision, thereby improving the clarity of the user's viewing environment.

[0117] In some optional implementations of this embodiment, such as Figure 7 As shown, after step 101, the method further includes:

[0118] Step 108: Use the pre-trained emotion recognition model to identify the user's eye data and obtain the user's emotion category.

[0119] The user's eye data can include heart rate data, blood oxygen and brain wave data, and facial muscle movement data. Heart rate, blood oxygen, and brain wave data can be detected by micro EEG and PPG sensors integrated into the smart glasses. Facial muscle movement data can be obtained by continuously recognizing eye images captured by the camera on the glasses.

[0120] Emotion recognition models can be built based on neural network models, which are pre-trained using machine learning methods. During training, user eye data for different emotion categories can be collected. The collected EEG spectrum (alpha / beta waves), heart rate variability (HRV), and micro-expressions (frowning frequency) are mapped to emotion labels (such as anxiety, fatigue, anger, etc.). After training, the emotion recognition model can identify the user's eye data input and determine the user's emotion category.

[0121] Step 109: Based on the emotion category, control the smart glasses to perform corresponding emotion response operations.

[0122] The correspondence between emotional response actions and emotion categories can be pre-configured based on actual needs. For example, the type of information displayed by smart glasses can be dynamically adjusted based on the emotion category (e.g., blocking entertainment notifications during anxiety and only retaining navigation / hazard avoidance alerts, or blocking non-urgent messages during low concentration).

[0123] For example, when you are anxious or angry, you can use the light source on the smart glasses to project dynamic blue light ripples (LED array, wavelength 480nm) onto the lenses; the negative ion generator set on the temples can release negative ion airflow (micro ion generator, concentration 106 / cm 3 ); natural white noise is played through the bone conduction headphones attached to the temples. In the event of fatigue: the smart glasses' intelligent soothing module activates a cold compress (15°C) on the frame; the bone conduction headphones trigger an intermittent warning tone (1kHz pulse, once every 10 seconds).

[0124] This embodiment sets an emotion recognition model to judge the user's emotions in real time and perform corresponding response operations, so that the smart glasses automatically adapt to the user's emotions to perform corresponding functions, thereby improving the scene adaptability and usage flexibility of the smart glasses.

[0125] In some optional implementations of this embodiment, the method further includes: Figure 8 As shown, after step 101, the method further includes:

[0126] Step 110 , using a pre-trained fatigue prediction model, performs fatigue prediction on the user's eye data to obtain the user's fatigue index.

[0127] The fatigue prediction model can be built based on a neural network model (such as an LSTM network), pre-trained using machine learning methods by collecting training sample data. During training, user eye data such as intraocular pressure, blink frequency, and eyelid opening can be collected, combined with data such as driving time, and fatigue levels can be annotated to complete the training.

[0128] When the fatigue prediction model is actually used, an intraocular pressure sensor (based on piezoelectric film technology) can be integrated into the nose pad of the frame to collect intraocular pressure data, and the blinking frequency, pupil diameter, and driving time data can be collected through the camera. These data are converted into vector form and input into the fatigue prediction model to obtain a fatigue index representing the user's fatigue level in the future.

[0129] Step 111: Based on the fatigue index, control the smart glasses and the vehicle to perform corresponding fatigue coping operations.

[0130] The correspondence between fatigue index and fatigue response actions can be pre-set. For example, when the fatigue index is greater than 0.8, actions such as playing a voice prompt, displaying a prompt screen, and lowering the temperature of the temples (achieved by a micro-thermoelectric plate installed on the temples) can be performed.

[0131] This embodiment uses a fatigue prediction model to predict the user's fatigue level and performs fatigue response operations, which can accurately predict the fatigue index based on the user's eye data, effectively alleviate fatigue, and improve driving safety.

[0132] In some optional implementations of this embodiment, step 111 may be performed as follows:

[0133] First, if the fatigue index meets the preset conditions for executing the light therapy plan, the execution time of the light therapy plan is determined based on the user's eye data.

[0134] The execution duration includes a first execution duration and a second execution duration.

[0135] The execution conditions for a phototherapy plan can be pre-set. For example, if the fatigue index is greater than or equal to 0.8, the execution conditions for the phototherapy plan are determined to be met. At this time, the corresponding execution time can be determined based on the user's eye data, including intraocular pressure data. For example, the higher the intraocular pressure data, the longer the execution time.

[0136] Then, the blue light source on the smart glasses is controlled to start, and after running for a first execution time, the blue light source is turned off, and the red light source on the smart glasses is controlled to start, and after running for a second execution time, the red light source is turned off.

[0137] Specifically, the smart glasses are provided with a blue light source and a red light source. The first execution duration corresponds to the blue light source, and the second execution duration corresponds to the red light source. The execution process of the light therapy program can generally be divided into two stages. In the first stage, blue light is emitted, and the duration is the above-mentioned first duration (for example, 5 minutes), and the luminous intensity can be set according to actual needs, for example, 50 lumens. This stage is the awakening stage, and the purpose is to stimulate the photoreceptor cells of the user's retina. In the second stage, red light is emitted, and the duration is the above-mentioned second duration (for example, 10 minutes), and the luminous intensity is 30 lumens. This stage is the relaxation stage, and the purpose is to promote blood circulation around the eyes.

[0138] Optionally, during the implementation of the light therapy program, the temperature adjustment device on the temples of the smart glasses can be used to adjust the eye temperature and relieve eye fatigue more effectively.

[0139] This embodiment implements a light therapy program in stages according to the predicted fatigue index, which can more effectively relieve the user's eye fatigue in driving scenarios and improve driving safety.

[0140] Figure 9 This is a schematic diagram of the structure of smart glasses 900 provided in an embodiment of the present application. Specifically, it includes: imaging lens 901, first sensor 902, and controller 903. The first sensor 902 and controller 903 are in communication with each other, and the controller is used to execute the smart glasses control method provided in the above embodiment.

[0141] The first sensor may include at least one type, such as a camera, an intraocular pressure sensor, a heart rate monitoring sensor, or an electroencephalogram monitoring sensor. The controller obtains the user's eye data collected by the first sensor, communicates with the vehicle's onboard system, obtains vehicle driving data collected by the second sensor, executes the above method, and displays the rendered image on the imaging lens 901.

[0142] The smart glasses provided in this embodiment achieve interaction with a vehicle by executing the method provided in the above embodiment. The smart glasses can identify the user's intention through the user's eye data collected by the sensor, and display vehicle driving related information according to the user's intention. Therefore, the user does not need to manually set the smart glasses, and the vehicle information can be displayed on the lenses according to the user's intention, thereby improving the flexibility and convenience of interaction between the smart glasses and the vehicle.

[0143] In some optional implementations of this embodiment, the imaging lens is a variable focus lens, and a control signal input end of the variable focus lens is connected to the controller.

[0144] Typically, the above-mentioned variable focus lens includes a liquid lens module, which is based on the electrowetting effect (Electro wetting) and fluid dynamics to achieve precise control of the focal length of the lens. The structure of the variable focus lens adopts a dual liquid system, that is, the lens is composed of two immiscible liquids (usually conductive aqueous solution + insulating oil). The inner wall of the transparent microcavity (3-5mm in diameter) on the lens is plated with a hydrophobic insulating layer (such as PTFE) and an annular electrode. By driving the annular electrode, the shape of the microcavity is changed, thereby achieving the effect of automatic focusing. The variable focus lens provided in this embodiment can adjust the focal length of the entire area or local area of ​​the lens, so as to achieve the overall adaptation to the user's vision, as well as the effect of local magnification imaging.

[0145] This embodiment provides a variable focus lens on the smart glasses, thereby achieving flexible adjustment of the focal length of the lens, making the smart glasses adaptable to more application scenarios and improving their compatibility with the user's vision.

[0146] In some optional implementations of this embodiment, the smart glasses further include a fatigue relief device, and a control signal input end of the fatigue relief device is connected to the controller.

[0147] As an example, fatigue relief devices include, but are not limited to, at least one of the following: a temperature adjustment device, a phototherapy device, etc. The temperature adjustment device can be installed on the temples and / or frames and include a micro-thermoelectric chip. The controller uses a PID temperature control method to precisely adjust the temple temperature to relieve eye fatigue. The phototherapy device can include a blue light source, a red light source, etc., and execute a phototherapy program when the fatigue index is detected to exceed a certain level (refer to the above method embodiments for details, which will not be repeated here).

[0148] This embodiment provides a fatigue relief device on the smart glasses, which can automatically perform fatigue relief operations on the user's eyes under the control of the controller, thereby improving the safety of driving scenarios.

[0149] Figure 10 A schematic diagram of the system architecture of a vehicle-mounted smart glasses system 1000 provided in an embodiment of the present application. Specifically comprising: a vehicle 1001 and the above-mentioned smart glasses 900, wherein the controller of the smart glasses 900 is communicatively connected to the vehicle system of the vehicle 1001. The smart glasses 900 can obtain user eye data through a first sensor, and obtain vehicle driving data from a second sensor on the vehicle, and execute the above-mentioned smart glasses control method based on the user eye data and the vehicle driving data. The system realizes the interaction between smart glasses and vehicles. The smart glasses can identify the user's intention through the user's eye data collected by the sensor, and display vehicle driving related information according to the user's intention. Therefore, the user does not need to manually set the smart glasses, and the vehicle information can be displayed on the lenses according to the user's intention, thereby improving the flexibility and convenience of the interaction between the smart glasses and the vehicle.

[0150] Figure 11 This is a schematic diagram of the structure of a smart glasses control device provided in an embodiment of the present application. Specifically, it includes: a first acquisition module 1101 for acquiring user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle; a first determination module 1102 for determining the user's viewing intent based on the user's eye data; and a rendering module 1103 for rendering the vehicle driving data in a data rendering method corresponding to the viewing intent, and displaying the rendered vehicle driving data on the lenses of the smart glasses.

[0151] In one possible embodiment, the first acquisition module is further used to: acquire eye movement data collected by an eye tracking camera on the smart glasses, and use the eye movement data as user eye data; the first determination module includes: an identification unit, used to identify the user's visual range and gaze duration based on the eye movement data; the first determination unit is used to determine that the user's viewing intention is a gaze intention if the gaze duration is greater than a preset first gaze duration threshold and the visual range is in the central area of ​​the smart glasses; the second determination unit is used to determine that the user's viewing intention is a glance intention if the gaze duration is less than a preset second gaze duration threshold and the visual range reaches the edge area of ​​the smart glasses; the rendering module includes: a first rendering unit, used to switch the viewing angle mode of the smart glasses to a narrow viewing angle mode if the viewing intention is a gaze intention, and determine the key objects in the visual range based on the vehicle driving data, and render the key objects; the second rendering unit, used to switch the viewing angle mode of the smart glasses to a wide-angle mode if the viewing intention is a glance intention, and determine the vehicle's driving environment data based on the vehicle driving data, and render the driving environment data.

[0152] In one possible embodiment, the first rendering unit includes: a determination subunit, used to determine a local lens area on the smart glasses corresponding to the field of view; an adjustment subunit, used to adjust the focal length of the local lens area to a target focal length so that the imaging magnification corresponding to the field of view is magnified to the target magnification; and a display subunit, used to enhance the display of key objects within the field of view.

[0153] In one possible embodiment, the second rendering unit includes: a first rendering sub-unit, for extracting distance data between the vehicle and other vehicles from the vehicle driving data in response to the vehicle's status meeting the conditions for triggering blind spot dynamic monitoring; based on the distance data, displaying a blind spot monitoring screen on the lenses of the smart glasses; a second rendering sub-unit, for determining a risk avoidance path from the vehicle driving data in response to the vehicle's status meeting the conditions for triggering a risk warning, and rendering the risk avoidance path on the lenses of the smart glasses.

[0154] In one possible embodiment, the rendering module also includes: a third determination unit, for determining the target device that the user is gazing at if the viewing intention is a gaze intention; a display unit, for displaying a virtual control interface corresponding to the target device on the lenses of the smart glasses in response to the time the user gazes at the target device exceeding a preset third gaze duration threshold and the target device being a preset type of device; and a first control unit, for controlling the target device to perform a preset function based on the virtual control interface and eye movement data.

[0155] In one possible embodiment, the device also includes: a second acquisition module, used to obtain lighting data of the vehicle's environment from the vehicle driving data; a first control module, used to switch the viewing angle mode of the smart glasses to a narrow viewing angle mode if the lighting data indicates that the lighting intensity of the vehicle's environment is greater than a preset intensity threshold, and control the smart glasses to perform a strong light suppression operation.

[0156] In one possible embodiment, the device further includes: a second determination module for determining the user's vision compensation data based on the user's eye data; and an adjustment module for adjusting the focal length of the lenses of the smart glasses based on the vision compensation data so that the lenses adapt to the user's vision.

[0157] In one possible embodiment, the device also includes: a recognition module for using a pre-trained emotion recognition model to identify the user's eye data and obtain the user's emotion category; and a second control module for controlling the smart glasses to perform corresponding emotion response operations based on the emotion category.

[0158] In one possible embodiment, the device also includes: a prediction module, which uses a pre-trained fatigue prediction model to predict fatigue of the user's eye data to obtain the user's fatigue index; and a third control module, which is used to control the smart glasses and the vehicle to perform corresponding fatigue response operations based on the fatigue index.

[0159] In one possible embodiment, the third control module includes: a fourth determination unit, which is used to determine the execution time of the phototherapy plan based on the user's eye data if the fatigue index meets the preset phototherapy plan execution conditions, wherein the execution time includes a first execution time and a second execution time; a second control unit, which is used to control the blue light source on the smart glasses to start, and turn off the blue light source after running for the first execution time, and to control the red light source on the smart glasses to start, and turn off the red light source after running for the second execution time.

[0160] The smart glasses control device provided in this embodiment can be as follows Figure 11 The smart glasses control device shown in can execute all the steps of the above smart glasses control methods, thereby achieving the technical effects of the above smart glasses control methods. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0161] Figure 12 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Figure 12The electronic device 1200 shown includes: at least one processor 1201, a memory 1202, at least one network interface 1204 and another user interface 1203. The various components in the electronic device 1200 are coupled together via a bus system 1205. It is understood that the bus system 1205 is used to achieve connection and communication between these components. In addition to including a data bus, the bus system 1205 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, the bus system 1205 is not described in detail. Figure 12 Various buses are labeled as bus system 1205.

[0162] The user interface 1203 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touchpad, or a touch screen).

[0163] It is understood that the memory 1202 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDRSDRAM), enhanced synchronous DRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus random access memory (DRRAM). The memory 1202 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0164] In some embodiments, the memory 1202 stores the following elements, executable units, or data structures, or a subset thereof, or an extended set thereof: an operating system 12021 and application programs 12022 .

[0165] Among them, the operating system 12021 includes various system programs, such as the framework layer, core library layer, and driver layer, which are used to implement various basic services and handle hardware-based tasks. Application 12022 includes various application programs, such as media players and browsers, which are used to implement various application services. The program that implements the method of the embodiment of the present application can be included in application 12022.

[0166] In this embodiment, by calling a program or instruction stored in the memory 1202, specifically, a program or instruction stored in the application 12022, the processor 1201 is configured to execute the method steps provided in each method embodiment, for example, including:

[0167] Obtain user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle; determine the user's viewing intention based on the user's eye data; render the vehicle driving data according to a data rendering method corresponding to the viewing intention, and display the rendered vehicle driving data on the lenses of the smart glasses.

[0168] The methods disclosed in the above embodiments of the present application can be applied to or implemented by processor 1201. Processor 1201 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in processor 1201 or by software instructions. The above processor 1201 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The various methods, steps, and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present application can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software units in the decoding processor. The software units can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory 1202 , and the processor 1201 reads the information in the memory 1202 and completes the steps of the above method in combination with its hardware.

[0169] It is understood that the embodiments described herein may be implemented using hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, or other electronic units or combinations thereof for performing the above-mentioned functions of the present application.

[0170] For software implementation, the techniques described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

[0171] The electronic device provided in this embodiment may be Figure 12 The electronic device shown in can execute all the steps of the smart glasses control method described above, thereby achieving the technical effects of the smart glasses control method described above. Please refer to the above related description for details. For the sake of brevity, it will not be repeated here.

[0172] The present application also provides a storage medium (computer-readable storage medium). The storage medium stores one or more programs. The storage medium may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid-state drive; and the memory may also include a combination of the aforementioned types of memory.

[0173] When one or more programs in the storage medium can be executed by one or more processors, the smart glasses control method executed on the electronic device side can be implemented.

[0174] The processor is used to execute the program stored in the memory to implement the following steps of the smart glasses control method executed on the electronic device side:

[0175] Obtain user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle; determine the user's viewing intention based on the user's eye data; render the vehicle driving data according to a data rendering method corresponding to the viewing intention, and display the rendered vehicle driving data on the lenses of the smart glasses.

[0176] Professionals should also be further aware that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0177] The steps of the methods or algorithms described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0178] It should be understood that the terms used herein are for the purpose of describing specific example embodiments only and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "comprise", "include", "contain" and "have" are inclusive and therefore specify the presence of stated features, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring them to be performed in the specific order described or illustrated, unless the order of execution is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0179] The foregoing is merely a list of specific embodiments of the present application, intended to enable those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments shown herein, but is intended to conform to the broadest scope consistent with the principles and novel features of the present application.

Claims

1. A method for controlling smart glasses, characterized in that: The method comprises: Obtaining user eye data collected by a first sensor on the smart glasses and vehicle driving data collected by a second sensor on the vehicle; determining the user's viewing intention based on the user's eye data; The vehicle driving data is rendered according to a data rendering method corresponding to the viewing intention, and the rendered vehicle driving data is displayed on the lenses of the smart glasses.

2. The method according to claim 1, characterized in that The obtaining of user eye data collected by a first sensor on the smart glasses includes: Obtaining eye movement data collected by an eye tracking camera on the smart glasses, and using the eye movement data as the user's eye data; The determining the user's viewing intention based on the user's eye data includes: Based on the eye movement data, identifying the user's sight range and gaze duration; If the gaze duration is greater than a preset first gaze duration threshold, and the visual range is in the central area of ​​the smart glasses, determining that the user's viewing intention is a gaze intention; If the gaze duration is less than a preset second gaze duration threshold, and the visual range reaches the edge area of ​​the smart glasses, it is determined that the user's viewing intention is a scanning intention; Rendering the vehicle driving data according to the data rendering method corresponding to the viewing intention includes: If the viewing intention is a gaze intention, switching the viewing angle mode of the smart glasses to a narrow viewing angle mode, and determining key objects within the visual range based on the vehicle driving data, and rendering the key objects; If the viewing intention is a scanning intention, the viewing angle mode of the smart glasses is switched to a wide-angle mode, and based on the vehicle driving data, the driving environment data of the vehicle is determined and the driving environment data is rendered.

3. The method according to claim 2, characterized in that The determining, based on the vehicle driving data, key objects within the visual range and rendering the key objects includes: Determining a local lens area on the smart glasses corresponding to the visual range; Adjusting the focal length of the local lens area to the target focal length so that the imaging magnification corresponding to the visual range is magnified to the target magnification; Key objects within the visual range are enhanced and displayed.

4. The method according to claim 2, characterized in that The determining, based on the vehicle driving data, driving environment data of the vehicle and rendering the driving environment data, includes: In response to the state of the vehicle meeting the conditions for triggering dynamic blind spot monitoring, extracting distance data between the vehicle and other vehicles from the vehicle driving data; and displaying a blind spot monitoring screen on the lenses of the smart glasses based on the distance data; In response to the state of the vehicle meeting the conditions for triggering a risk warning, a risk avoidance path is determined from the vehicle driving data, and the risk avoidance path is rendered on the lenses of the smart glasses.

5. The method according to claim 2, characterized in that The rendering of the vehicle driving data according to the data rendering method corresponding to the viewing intention further includes: If the viewing intention is a gaze intention, determining a target device that the user is gazing at; In response to the user gazing at the target device for a period exceeding a preset third gaze duration threshold, and the target device being a device of a preset type, displaying a virtual control interface corresponding to the target device on the lenses of the smart glasses; Based on the virtual control interface and the eye movement data, the target device is controlled to execute a preset function.

6. The method according to claim 1, characterized in that After acquiring the user eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: Acquiring illumination data of an environment in which the vehicle is located from the vehicle driving data; If the illumination data indicates that the illumination intensity of the vehicle's environment is greater than a preset intensity threshold, the viewing angle mode of the smart glasses is switched to a narrow viewing angle mode, and the smart glasses are controlled to perform a strong light suppression operation.

7. The method according to claim 1, characterized in that After acquiring the user eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: Determining vision compensation data of the user based on the user eye data; Based on the vision compensation data, the focal length of the lenses of the smart glasses is adjusted to adapt the lenses to the vision of the user.

8. The method according to claim 1, characterized in that After acquiring the user eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: Using a pre-trained emotion recognition model, the user's eye data is recognized to obtain the user's emotion category; Based on the emotion category, the smart glasses are controlled to perform corresponding emotion response operations.

9. The method according to claim 1, characterized in that After acquiring the user eye data collected by the first sensor on the smart glasses and the vehicle driving data collected by the second sensor on the vehicle, the method further includes: Using a pre-trained fatigue prediction model, fatigue prediction is performed on the user's eye data to obtain the user's fatigue index; Based on the fatigue index, the smart glasses and the vehicle are controlled to perform corresponding fatigue coping operations.

10. The method according to claim 9, characterized in that The controlling the smart glasses and the vehicle to perform corresponding fatigue coping operations based on the fatigue index includes: If the fatigue index meets the preset light therapy program execution conditions, determining the execution time of the light therapy program based on the user's eye data, wherein the execution time includes a first execution time and a second execution time; Control the blue light source on the smart glasses to start, and after running the first execution time, turn off the blue light source; and control the red light source on the smart glasses to start, and after running the second execution time, turn off the red light source.

11. A pair of smart glasses, characterized in that: The smart glasses include: imaging lenses, a first sensor and a controller; the first sensor and the controller are communicatively connected, and the controller is used to execute the smart glasses control method according to any one of claims 1 to 10.

12. The smart glasses according to claim 11, wherein: The imaging lens is a variable focus lens, and a control signal input end of the variable focus lens is connected to the controller.

13. The smart glasses according to claim 11, wherein: The smart glasses further include a fatigue relief device, wherein a control signal input end of the fatigue relief device is connected to the controller.

14. A vehicle-mounted smart glasses system, characterized in that: The system includes: a vehicle and the smart glasses according to any one of claims 11 to 13, wherein a controller of the smart glasses is communicatively connected to a vehicle computer system of the vehicle.

Images