Intelligent glasses control method and device, intelligent glasses and storage medium

Abstract

The invention provides an intelligent glasses control method and device, intelligent glasses and a computer readable storage medium. The intelligent glasses control method comprises the following steps: acquiring a first brain wave signal of a wearing object of the intelligent glasses in a first time period through a brain wave sensor of the intelligent glasses; determining a first emotional state of the wearing object in the first time period based on the first brain wave signal; and when the first emotional state is the same as a preset emotional state, controlling the intelligent glasses to enter a meditation working mode. According to the method, the situation that the meditation working mode needs to be started can be automatically recognized, the meditation working mode of the intelligent glasses can be automatically started, and the complexity of starting operation of the meditation working mode is reduced.

Description

Technical Field

[0001] The present application relates to the technical field of smart glasses, and in particular to a smart glasses control method, device, smart glasses and a computer-readable storage medium. Background Art

[0002] With the continuous development of network technology, the functions of electronic devices are becoming more and more diversified, bringing convenience to users. Among them, meditation is a perceptual state that combines physical relaxation and sharp alertness, which is helpful for attention training. Turning on the meditation mode through an electronic device (such as a mobile phone) can help users enter meditation. In the related art, the meditation mode of the electronic device is manually turned on by the user, and the operation of turning on the meditation mode is cumbersome. Summary of the invention

[0003] The present application provides a smart glasses control method, device, smart glasses and computer-readable storage medium, which can automatically identify situations where a meditation working mode needs to be activated and automatically activate the meditation working mode of the smart glasses, thereby reducing the complexity of the meditation working mode activation operation.

[0004] In a first aspect, the present application provides a smart glasses control method, the method comprising:

[0005] collecting, by means of a brain wave sensor of the smart glasses, a first brain wave signal of a person wearing the smart glasses within a first time period;

[0006] determining a first emotional state of the wearing object within the first time period based on the first brain wave signal;

[0007] When the first emotional state is the same as a preset emotional state, the smart glasses are controlled to enter a meditation working mode.

[0008] In some embodiments, the meditation working mode is to turn off the screen and play audio, and when the first emotional state is the same as the preset emotional state, controlling the smart glasses to enter the meditation working mode includes:

[0009] When the first emotional state is the same as a preset emotional state, obtaining meditation setting parameters of the preset emotional state;

[0010] Based on the meditation setting parameters, determining a target meditation duration matching the first emotional state and a target meditation audio matching the first emotional state;

[0011] Based on the target meditation duration, the smart glasses are controlled to turn off the screen and play the target meditation audio.

[0012] In some embodiments, when the first emotional state is the same as a preset emotional state, controlling the smart glasses to enter a meditation working mode includes:

[0013] When the first emotional state is the same as the preset emotional state, outputting meditation inquiry information;

[0014] In response to a meditation instruction for the meditation inquiry information feedback, the smart glasses are controlled to enter a meditation working mode based on the meditation audio information and meditation duration information carried by the meditation instruction.

[0015] In some embodiments, determining the first emotional state of the wearing object in the first time period based on the first brain wave signal includes:

[0016] Performing time domain feature extraction on the first brain wave signal to obtain a time domain signal curve of the first brain wave signal;

[0017] Converting the time domain signal curve of the first brain wave signal to obtain a frequency distribution curve of the first brain wave signal;

[0018] Calling a trained emotion detection network, and performing prediction based on the frequency distribution curve of the first brain wave signal to obtain the emotional state of the wearer in the first time period, wherein the emotion detection network is learned based on the frequency distribution curve of the sample brain wave signal and the labeled emotional state corresponding to the frequency distribution curve of the sample brain wave signal.

[0019] In some embodiments, the method further comprises:

[0020] Acquiring, by means of the brain wave sensor, a second brain wave signal of the wearer during a second time period in which the smart glasses are in a meditation working mode;

[0021] determining the emotion value of the wearing object at each time point in the second time period based on the second brain wave signal;

[0022] determining, based on the first brain wave signal, an emotion value of the wearing object at each time point in the first time period;

[0023] Based on the emotion value at each time point in the second time period and the emotion value at each time point in the first time period, the smart glasses are controlled to display an emotion data chart of the wearer, wherein the emotion data chart is used to indicate the emotion value of the wearer at each historical time point.

[0024] In some embodiments, the method further comprises:

[0025] When the smart glasses are in a meditation working mode, if a running operation of a target application with a higher priority than the meditation working mode is detected, the smart glasses are controlled to suspend the meditation working mode;

[0026] When the running operation of the target application is completed, the smart glasses are controlled to resume the meditation working mode.

[0027] In some embodiments, the method further comprises:

[0028] When the smart glasses are in a meditation working mode, detecting the eye state of the wearer;

[0029] If the eye state is open, the smart glasses are controlled to output eye-closing prompt information; or, if the eye state is abnormal eye-closing and eye movement, the smart glasses are controlled to output eye-movement prompt information.

[0030] In a second aspect, the present application provides a smart glasses control device, the smart glasses control device comprising:

[0031] A collection unit, configured to collect a first brain wave signal of a person wearing the smart glasses within a first time period through a brain wave sensor of the smart glasses;

[0032] a determining unit, configured to determine a first emotional state of the wearing object within the first time period based on the first brain wave signal;

[0033] A control unit is used to control the smart glasses to enter a meditation working mode when the first emotional state is the same as a preset emotional state.

[0034] In some embodiments, the meditation working mode is to turn off the screen and play audio, and the control unit is specifically used to:

[0035] When the first emotional state is the same as a preset emotional state, obtaining meditation setting parameters of the preset emotional state;

[0036] Based on the meditation setting parameters, determining a target meditation duration matching the first emotional state and a target meditation audio matching the first emotional state;

[0037] Based on the target meditation duration, the smart glasses are controlled to turn off the screen and play the target meditation audio.

[0038] In some embodiments, the control unit is specifically configured to:

[0039] When the first emotional state is the same as the preset emotional state, outputting meditation inquiry information;

[0040] In response to a meditation instruction for the meditation inquiry information feedback, the smart glasses are controlled to enter a meditation working mode based on the meditation audio information and meditation duration information carried by the meditation instruction.

[0041] In some embodiments, the determining unit is specifically configured to:

[0042] Performing time domain feature extraction on the first brain wave signal to obtain a time domain signal curve of the first brain wave signal;

[0043] Converting the time domain signal curve of the first brain wave signal to obtain a frequency distribution curve of the first brain wave signal;

[0044] Calling a trained emotion detection network, and performing prediction based on the frequency distribution curve of the first brain wave signal to obtain the emotional state of the wearer in the first time period, wherein the emotion detection network is learned based on the frequency distribution curve of the sample brain wave signal and the labeled emotional state corresponding to the frequency distribution curve of the sample brain wave signal.

[0045] In some embodiments, the smart glasses control device further includes a display unit, and the display unit is specifically used for:

[0046] Acquiring, by means of the brain wave sensor, a second brain wave signal of the wearer during a second time period in which the smart glasses are in a meditation working mode;

[0047] determining the emotion value of the wearing object at each time point in the second time period based on the second brain wave signal;

[0048] determining, based on the first brain wave signal, an emotion value of the wearing object at each time point in the first time period;

[0049] Based on the emotion value at each time point in the second time period and the emotion value at each time point in the first time period, the smart glasses are controlled to display an emotion data chart of the wearer, wherein the emotion data chart is used to indicate the emotion value of the wearer at each historical time point.

[0050] In some embodiments, the control unit is specifically configured to:

[0051] When the smart glasses are in a meditation working mode, if a running operation of a target application with a higher priority than the meditation working mode is detected, the smart glasses are controlled to suspend the meditation working mode;

[0052] When the running operation of the target application is completed, the smart glasses are controlled to resume the meditation working mode.

[0053] In some embodiments, the smart glasses control device further includes a prompt unit, and the prompt unit is specifically used to:

[0054] When the smart glasses are in a meditation working mode, detecting the eye state of the wearer;

[0055] If the eye state is open, the smart glasses are controlled to output eye-closing prompt information; or, if the eye state is abnormal eye-closing and eye movement, the smart glasses are controlled to output eye-movement prompt information.

[0056] In a third aspect, the present application further provides a pair of smart glasses, comprising a processor and a memory, wherein the memory stores a computer program, and when the processor calls the computer program in the memory, it executes any one of the smart glasses control methods provided in the present application.

[0057] In a fourth aspect, the present application also provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the smart glasses control method.

[0058] In the present application, a first brain wave signal of a wearer of the smart glasses within a first time period is collected by a brain wave sensor installed on the smart glasses, and a first emotional state of the wearer within the first time period is determined based on the first brain wave signal; when the first emotional state is the same as a preset emotional state, the smart glasses are controlled to enter a meditation working mode. On the one hand, since the emotional state of the wearer can be judged based on the brain wave signal and the meditation working mode is automatically entered, the meditation working mode can be initiated quickly and actively, so that the user does not need to manually turn on the meditation working mode, thereby reducing the complexity of turning on the meditation working mode; on the other hand, since the meditation working mode is turned on after determining that the emotional state of the wearer is the same as a preset emotional state (such as an anxiety state) through brain wave signals, it is more in line with the actual need to turn on the meditation working mode, and can automatically identify the situation where the meditation working mode needs to be turned on and automatically turn on the meditation working mode of the smart glasses, thereby improving the convenience of turning on the meditation working mode. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0060] Figure 1 is a schematic block diagram of the structure of a pair of smart glasses provided in an embodiment of the present application;

[0061] Figure 2 is a flow chart of a smart glasses control method provided by an embodiment of the present application;

[0062] Figure 3 is a schematic diagram for explaining a time domain signal curve and a frequency distribution curve in an embodiment of the present application;

[0063] Figure 4 is a schematic diagram for explaining the emotion data chart in the embodiment of the present application;

[0064] Figure 5 is another schematic diagram for explaining the emotion data chart in the embodiment of the present application;

[0065] Figure 6 is a schematic diagram illustrating the workflow of initiating a meditation working mode by smart glasses in an embodiment of the present application;

[0066] Figure 7 It is a schematic diagram of the structure of an embodiment of the smart glasses control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0067] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0068] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.

[0069] In the description of the embodiments of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0070] In order to enable any person skilled in the art to implement and use the present application, the following description is provided. In the following description, details are listed for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that the present application can also be implemented without using these specific details. In other examples, the known process will not be elaborated in detail to avoid unnecessary details that make the description of the present application embodiment obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in accordance with the embodiments of the present application.

[0071] The embodiments of the present application provide a smart glasses control method, device, smart glasses, and computer-readable storage medium, wherein the smart glasses control device can be integrated into the smart glasses.

[0072] The executor of the smart glasses control method of the embodiment of the present application may be the smart glasses control device provided in the embodiment of the present application, or the smart glasses integrated with the smart glasses control device, wherein the smart glasses control device may be implemented in hardware or software.

[0073] Some embodiments of the present application are described in detail below in conjunction with the accompanying drawings. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.

[0074] Figure 1 It is a schematic block diagram of the structure of a pair of smart glasses provided in an embodiment of the present application.

[0075] like Figure 1 As shown, the smart glasses 100 include a processor 101, a memory 102 and a brain wave sensor 103, and the processor 101, the memory 102 and the brain wave sensor 103 are connected via a bus 104, which is, for example, an I2C (Inter-integrated Circuit) bus.

[0076] Specifically, the processor 101 is used to provide computing and control capabilities to support the operation of the entire smart glasses 100. The processor 101 can be a central processing unit (CPU), and the processor 101 can also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0077] Specifically, the memory 102 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.

[0078] Specifically, the brain wave sensor can be set on the temples of the smart glasses or at the center point of the frame.

[0079] Those skilled in the art will understand that Figure 1 The structure shown in the figure is merely a block diagram of a partial structure related to the embodiment scheme of the present application, and does not constitute a limitation on the smart glasses to which the embodiment scheme of the present application is applied. The specific smart glasses may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0080] The processor 101 is used to run the computer program stored in the memory 102, and implement any one of the smart glasses control methods provided in the embodiments of the present application when executing the computer program. For example, the processor 101 is used to run the computer program stored in the memory 102, and can implement the following steps when executing the computer program:

[0081] A first brain wave signal of a person wearing the smart glasses within a first time period is collected through a brain wave sensor of the smart glasses; a first emotional state of the person wearing the smart glasses within the first time period is determined based on the first brain wave signal; and when the first emotional state is the same as a preset emotional state, the smart glasses are controlled to enter a meditation working mode.

[0082] It should be noted that technicians in the relevant field can clearly understand that for the convenience and brevity of description, the specific working process of the smart glasses described above can refer to the corresponding process in the following smart glasses control method embodiment, and will not be repeated here.

[0083] In the following, Figure 1 The smart glasses shown in the figure are taken as the execution subject of the smart glasses control method as an example to introduce the smart glasses control method provided by the embodiment of the present application in detail. For the sake of simplicity and convenience of description, the execution subject will be omitted in the subsequent method embodiments. Figure 1 The scenarios are only used to explain the smart glasses control method provided in the embodiments of the present application, but do not constitute a limitation on the application scenarios of the smart glasses control method provided in the embodiments of the present application.

[0084] See also Figure 2 , Figure 2 201 to 203, wherein:

[0085] 201. Collect, by means of a brain wave sensor of the smart glasses, a first brain wave signal of a person wearing the smart glasses within a first time period.

[0086] The brain wave sensor is a sensor for collecting brain wave signals of a person wearing the smart glasses. The brain wave sensor can be set on the smart glasses, for example, on the temples of the smart glasses, or at the center of the frame.

[0087] Among them, smart glasses can be AR (augmented reality) glasses, VR (Virtual Reality) glasses, etc.

[0088] The wearing object refers to the wearer of the smart glasses.

[0089] The first brain wave signal is a brain wave signal of a person wearing the smart glasses detected by a brain wave sensor of the smart glasses during a first time period.

[0090] The first time period is a time period to be detected for the emotional state of the wearer of the smart glasses, for example, a fixed time period every day (such as 22:00 to 23:00 every night), a fixed time period every week (such as weekday nights every week), or a fixed time period every month (such as the 1st of every month).

[0091] For example, taking the detection of the emotional state of the wearer of the smart glasses before going to sleep every night as an example, the wearer can set one hour before going to sleep every day (such as 22:00 to 23:00 every night) as the first time period, and the brain wave sensor of the smart glasses can be used to collect the brain wave signal of the wearer of the smart glasses in the first time period (such as 22:00 to 23:00 every night) as the first brain wave signal. In this way, when it is detected in step 202 that the first emotional state of the wearer in the first time period is not good (such as anxiety, irritability), the smart glasses can be controlled to enter the meditation working mode, so that the wearer can relieve the emotional state with the help of the smart glasses and fall asleep.

[0092] For another example, taking the detection of the emotional state of the wearer of the smart glasses on Monday morning as an example, every Monday morning (such as every Monday morning from 9:00 to 12:00) can be used as the first time period, and the brain wave sensor of the smart glasses can be used to collect the brain wave signal of the wearer of the smart glasses in the first time period (such as every Monday morning from 9:00 to 12:00) as the first brain wave signal. In this way, when it is detected in step 202 that the first emotional state of the wearer in the first time period is not good (such as anxiety, irritability), the smart glasses can be controlled to enter the meditation working mode, so that the wearer can relieve the emotional state with the help of the smart glasses.

[0093] For another example, taking the real-time detection of the emotional state of the wearer of the smart glasses as an example, according to the preset time period, starting from the preset starting time, each interval of a preset time period can be taken as a first time period (for example, taking the starting time as 9:00 and the preset time period as 1h as an example, 9:00-10:00 can be taken as the first first time period, 10:00-11:00 can be taken as the second first time period, and so on), and the brain wave sensor of the smart glasses can be used to collect the brain wave signal of the wearer of the smart glasses in the first first time period (such as 9:00-10:00) as the first brain wave signal, and execute steps 202 to 203. In this way, when it is detected in step 202 that the first emotional state of the wearer in the first first time period is not good (such as anxiety, irritability), the smart glasses can be controlled to enter the meditation working mode, so that the wearer can relieve the emotional state with the help of the smart glasses. When it is detected in step 202 that the first emotional state of the wearer in the first first time period is good (such as calm), the brain wave signal of the wearer of the smart glasses in the second first time period (such as 10:00-11:00) can continue to be collected as the first brain wave signal, and steps 202 to 203 are executed, and so on.

[0094] 202. Determine a first emotional state of the wearing object within the first time period based on the first brain wave signal.

[0095] The first emotional state refers to the emotional state of the wearer in a first time period.

[0096] There are many ways to perform step 202 of "determining the first emotional state of the wearer in the first time period based on the first brain wave signal", which include, for example:

[0097] (1) Detecting a first emotional state based on the trained emotion detection network. At this time, step 202 may specifically include the following steps 2021A to 2023A, wherein:

[0098] 2021A. Perform time domain feature extraction on the first brain wave signal to obtain a time domain signal curve of the first brain wave signal.

[0099] The first brain wave signal is a potential generated by the brain of the wearer in the first time period, recorded in chronological order. For example, taking the recording frequency as 1 minute (i.e., recording the potential generated by the brain of the wearer once per minute), if the first time period is from 9:00 to 9:10, the potential generated by the brain of the wearer of the smart glasses will be collected at 9:00, 9:01, ..., 9:10, respectively, assuming that they are: d0, d1, d2, d3, d4, d5, d6, d7, d8, d9, d10, and the first brain wave signal is a potential sequence {d0, d1, d2, d3, d4, d5, d6, d7, d8, d9, d10}.

[0100] For example, in step 2021A, the first brain wave signal can be used to construct a brain wave signal curve that is continuous in the time domain, thereby forming a time domain signal curve of the first brain wave signal, and the time domain signal curve of the first brain wave signal is used to reflect the potential generated by the brain of the wearer at each time point in the first time period. Figure 3 As shown, assuming that the first brain wave signal is {d0, d1, d2, d3, d4, d5, d6, d7, d8, d9, d10}, a smooth brain wave signal curve is constructed based on the first brain wave signal {d0, d1, d2, d3, d4, d5, d6, d7, d8, d9, d10} (such as Figure 3 The curve shown in (a) of FIG. 1 ), the brain wave signal curve is the time domain signal curve of the first brain wave signal.

[0101] 2022A. Convert the time domain signal curve of the first brain wave signal to obtain a frequency distribution curve of the first brain wave signal.

[0102] Exemplarily, the time domain signal curve of the first brain wave signal is converted from the time domain to the frequency domain, thereby obtaining a frequency distribution curve of the first brain wave signal, and the frequency distribution curve of the first brain wave signal is used to reflect the brain wave frequency of the wearing object at each time point in the first time period. For ease of understanding, the above example of step 2021A is continued. Figure 3 As shown, based on the time domain signal curve of the first brain wave signal (such as Figure 3 The curve shown in (a) of FIG. 1 is transformed from the time domain to the frequency domain to obtain Figure 3 The curve shown in (b) is used as the frequency distribution curve of the first brain wave signal. It can be understood that Figure 3 The time domain signal curve in (a) and Figure 3 The frequency distribution curve in (b) is only used as an example for understanding and does not represent the actual conversion relationship.

[0103] 2023A. Calling a trained emotion detection network, and performing prediction based on the frequency distribution curve of the first brain wave signal to obtain the emotional state of the wearer in the first time period.

[0104] The emotion detection network is learned based on the frequency distribution curve of the sample brain wave signal and the labeled emotional state corresponding to the frequency distribution curve of the sample brain wave signal. Exemplarily, an open source network model that can be used for classification tasks, such as a YOLOv model and a MobileNet model for classification tasks, can be used to learn the relationship between the frequency distribution curve of an EEG signal and an emotional state. For example, taking the training of a YOLOv model to obtain a trained emotion detection network as an example, the training process of the trained emotion detection network can be as follows: obtaining training sample data, where a training sample data includes a frequency distribution curve of a sample EEG signal and a labeled emotional state corresponding to the frequency distribution curve of the sample EEG signal; inputting the frequency distribution curve of the sample EEG signal into a Yolov model for processing to obtain a predicted emotional state; calculating a model loss value based on a preset loss function (such as a cross entropy loss function) according to the labeled emotional state and the predicted emotional state; when the model loss value is greater than the preset loss value, updating the model parameters of the Yolov model, and returning to execute the step of obtaining the training sample data until the model loss value is less than or equal to the preset loss value to obtain an initial Yolov model; performing accuracy verification on the initial Yolov model, and when the initial Yolov model passes the accuracy verification, determining the initial Yolov model as a pre-trained Yolov5 model. At this time, the trained Yolov5 model can be used as a trained emotion detection model to detect the frequency distribution curve of the first brain wave signal in step 202 to obtain the first emotional state of the wearing object in the first time period.

[0105] (2) The brain wave frequency intervals of each emotional state are preset (for example, the brain wave frequency interval of the irritable state is (f1, f2], and the brain wave frequency interval of the excited state is (f2, f3]), and the first emotional state of the wearer in the first time period is determined by comparing the brain wave frequency interval into which the frequency of the first brain wave signal in the first time period falls. At this time, step 202 may specifically include the following steps 2021B to 2023B, wherein:

[0106] 2021B. Perform time domain feature extraction on the first brain wave signal to obtain a time domain signal curve of the first brain wave signal.

[0107] 2022B. Convert the time domain signal curve of the first brain wave signal to obtain a frequency distribution curve of the first brain wave signal.

[0108] The implementation of steps 2021B to 2022B is similar to that of steps 2021A to 2022A. For details, please refer to the relevant instructions in the previous text, which will not be repeated here.

[0109] 2023B. Determine the first emotional state of the wearer in the first time period based on the preset brain wave frequency ranges of each emotional state and the frequency distribution curve of the first brain wave signal.

[0110] There are many ways to implement step 2023B, illustratively including:

[0111] ① In some embodiments, the brain wave frequencies at each time point in the first time period all fall within the brain wave frequency interval of the same emotional state. In this case, the emotional state corresponding to the brain wave frequency interval into which the brain wave frequencies at each time point in the first time period fall can be directly used as the first emotional state of the wearer in the first time period. For example, the emotional state includes an irritable state and an excited state, wherein the brain wave frequency interval of the irritable state is (f1, f2], and the brain wave frequency interval of the excited state is (f2, f3]); if the frequency distribution curve of the first brain wave signal indicates that the brain wave frequencies at each time point in the first time period are all within the brain wave frequency interval (f1, f2], then the emotional state corresponding to the frequency interval (f1, f2] (i.e., the irritable state) can be determined as the first emotional state of the wearer in the first time period.

[0112] 203. When the first emotional state is the same as a preset emotional state, control the smart glasses to enter a meditation working mode.

[0113] The preset emotional state is an emotional state that requires the smart glasses to enter a meditation working mode, such as an irritable state, an anxious state, or other unfavorable states. The specific types and quantities of the preset emotional states can be set according to actual business scenario requirements. For example, the preset emotional state can be an anxious state; for another example, the preset emotional state can include an anxious state and an irritable state.

[0114] For example, the preset emotional states are anxiety and irritability. When the first emotional state determined in step 202 is anxiety, that is, the first emotional state is the same as the preset emotional state, the smart glasses can be controlled to enter a meditation working mode so that the wearer of the smart glasses can relieve anxiety. Similarly, when the first emotional state determined in step 202 is irritability, that is, the first emotional state is the same as the preset emotional state, the smart glasses can be controlled to enter a meditation working mode so that the wearer of the smart glasses can relieve irritability.

[0115] Exemplarily, the meditation working mode is that the smart glasses turn off the screen and play audio. In one embodiment, there is a function setting of the meditation working mode in the smart glasses. When the switch corresponding to the function setting is turned on, the smart glasses can start the brain wave sensor to detect the brain wave signal of the wearer when the smart glasses are in the wearing state.

[0116] There are many ways to control the smart glasses to enter the meditation working mode in step 203, which include, for example:

[0117] (1) When the first emotional state is the same as the preset emotional state, directly controlling the smart glasses to enter a meditation working mode.

[0118] For example, when the first emotional state is the same as the preset emotional state, the smart glasses are controlled to turn off the screen and play default audio according to the default meditation duration.

[0119] For another example, the user can customize the duration and audio of each meditation. When the first emotional state is the same as the preset emotional state, the smart glasses are controlled to turn off the screen and play the user-defined audio according to the user-defined meditation duration.

[0120] Exemplarily, the user can set the duration and audio of each meditation through the meditation control APP (Application) of the smart glasses. For example, the meditation duration when the emotional state is irritable is set to 10 minutes, and the meditation audio is music a, and the meditation duration when the emotional state is anxious is set to 20 minutes, and the meditation audio is music b. At this time, before step 203, it can also include: obtaining the meditation duration of the preset emotional state and the meditation audio of the preset emotional state through the meditation control application of the smart glasses; using the meditation duration of the preset emotional state and the meditation audio of the preset emotional state as the meditation setting parameters of the preset emotional state. Step 203 may specifically include: when the first emotional state is the same as the preset emotional state, obtaining the meditation setting parameters of the preset emotional state; based on the meditation setting parameters, determining the target meditation duration matching the first emotional state, and the target meditation audio matching the first emotional state; based on the target meditation duration, controlling the smart glasses to turn off the screen and play the target meditation audio.

[0121] (2) When the first emotional state is the same as the preset emotional state, the user is first asked whether to enter the meditation working mode. If the user chooses to enter, the smart glasses are controlled to enter the meditation working mode; otherwise, if the user chooses not to enter, the smart glasses are controlled to maintain the original working mode.

[0122] Specifically, when it is detected that the wearer is in a bad mood (i.e., the first emotional state is the same as the preset emotional state), meditation inquiry information can be output first, and when the user chooses to meditate, the smart glasses can be controlled to enter the meditation working mode, that is, step 203 "when the first emotional state is the same as the preset emotional state, control the smart glasses to enter the meditation working mode", which can specifically include: when the first emotional state is the same as the preset emotional state, output meditation inquiry information; in response to the meditation instruction fed back to the meditation inquiry information, based on the meditation audio information and meditation duration information carried by the meditation instruction, control the smart glasses to enter the meditation working mode. Among them, the meditation inquiry information can be output in the form of voice, text, etc. For example, when it is detected that the first emotional state is the same as the preset emotional state (such as when a bad emotional state such as irritability, anxiety, etc. is detected), first, the text "You are currently in an irritable state, it is recommended to turn on the meditation working mode, click the 'Start' button to start using the default music meditation a duration, click 'Music' to switch meditation music, click 'Duration' to switch meditation duration" is displayed through the smart glasses; after the user clicks the 'Start' button, the meditation instruction is triggered, and the smart glasses enter the meditation working mode at this time. If the user chooses to switch meditation music or meditation duration, the smart glasses will be controlled to enter meditation working mode according to the meditation music and meditation duration selected by the user.

[0123] Furthermore, in order to avoid missing important information due to the smart glasses being in meditation working mode, when the smart glasses are in meditation working mode, if the operation of the target application with a higher priority than the meditation working mode is detected, the smart glasses are controlled to suspend the meditation working mode; when the operation of the target application is completed, the smart glasses are controlled to resume the meditation working mode. For example, when the smart glasses are in meditation working mode, if there is an incoming call, the smart glasses will be controlled to suspend the meditation working mode, and resume the meditation working mode after the call ends.

[0124] Furthermore, in order to improve the meditation state of the wearer by using the meditation working mode of the smart glasses and improve the meditation effect of the wearer, the eye state of the wearer (such as whether the eyes are closed, whether the eyes are moving, etc.) can be detected when the smart glasses are in the meditation working mode, and the wearer can be guided to enter a good meditation state based on the eye state. At this time, the method can further include: when the smart glasses are in the meditation working mode, the eye state of the wearer is detected; if the eye state is open, the smart glasses are controlled to output eye closing prompt information; or, if the eye state is abnormal eye closing and eye movement, the smart glasses are controlled to output eye movement prompt information.

[0125] The eye-closing prompt information may be output in the form of audio, text, etc. For example, when the smart glasses are in meditation working mode, if it is detected that the eye state of the wearer is open, the smart glasses are controlled to play an audio message of "Please close your eyes and meditate", and / or the smart glasses are controlled to display a text message of "Please close your eyes and meditate".

[0126] Among them, the eye movement prompt information can be output in the form of audio, text, etc. For example, when the smart glasses are in the meditation working mode, if it is detected that the eye state of the wearer is abnormal eye closing, the smart glasses are controlled to play the audio of "The current eye movement is fast, please slow down the eye movement speed and meditate", and / or the smart glasses are controlled to display the text of "The current eye movement is fast, please slow down the eye movement speed and meditate".

[0127] Furthermore, in order to reduce the power consumption of the smart glasses, the brain wave sensor of the smart glasses can be turned off when meditation ends, that is, the smart glasses control method also includes: when the time when the smart glasses are in the meditation working mode reaches the target meditation time, controlling the smart glasses to exit the meditation working mode and turn off the brain wave sensor.

[0128] Furthermore, in order to let users understand their own emotional state and guide users to learn emotional management, the historical emotional data of the wearer can also be counted and displayed through a visual chart (such as counting the emotional value of the user each time they meditate, and drawing a visual chart with the date on the X axis and the emotional value on the Y axis to display it in the smart glasses). There are many ways to visualize the historical emotional data of the wearer, illustratively, including the following methods ① and ②:

[0129] Method ①: In some embodiments, the emotional value of the wearer at each historical time point can be visualized by a chart. In this case, the historical emotional data of the wearer can be counted by the following steps A1 to A4 and displayed using a visualized chart:

[0130] A1. Acquire, by means of the brain wave sensor, a second brain wave signal of the wearer during a second time period when the smart glasses are in a meditation working mode.

[0131] The second time period is the time period when the smart glasses are in the meditation working mode.

[0132] The second brain wave signal is a brain wave signal of the wearer of the smart glasses detected by the brain wave sensor of the smart glasses during a second time period.

[0133] A2. Determine the emotion value of the wearing object at each time point in the second time period based on the second brain wave signal.

[0134] Exemplarily, time domain features may be extracted from the second brain wave signal to obtain a time domain signal curve of the second brain wave signal; the time domain signal curve of the second brain wave signal may be converted to obtain a frequency distribution curve of the second brain wave signal; and then, based on the frequency distribution curve of the second brain wave signal, the brain wave frequency of the wearing object at each time point in the second time period may be determined as the emotional value of the wearing object at each time point in the second time period.

[0135] A3. Determine the emotion value of the wearer at each time point in the first time period based on the first brain wave signal.

[0136] Exemplarily, the time domain feature extraction can be performed on the first brain wave signal to obtain the time domain signal curve of the first brain wave signal; the time domain signal curve of the first brain wave signal can be converted to obtain the frequency distribution curve of the first brain wave signal; then, according to the frequency distribution curve of the first brain wave signal, the brain wave frequency of the wearing object at each time point in the first time period is determined as the emotional value of the wearing object at each time point in the first time period. The first time period and the second time period are two different time periods.

[0137] A4. Based on the emotion value at each time point in the second time period and the emotion value at each time point in the first time period, control the smart glasses to display an emotion data chart of the wearer.

[0138] The emotion data chart is used to indicate the emotion value of the wearing object at each historical time point.

[0139] For example, Figure 4 As shown, taking the emotional data chart as an example, the X-axis represents each historical time point and the Y-axis represents the emotional value of each historical time point, all the historical meditation data of the wearer (such as the emotional value of each time point in each meditation time period, and the emotional value of each time point in the period before each meditation) can be counted to construct the following Figure 4 The sentiment data chart shown ( Figure 4 In the example, t1, t2, ..., tn represent various historical time points), and the emotional data chart of the wearer is displayed on the meditation control APP page of the smart glasses, so that the user can understand his or her own emotional changes. It is understandable that when constructing the emotional data chart, it can be constructed according to the emotional values ​​at multiple different time points.

[0140] Method ②: In some other embodiments, the emotional state of the wearer on each date can be visualized by a chart. In this case, the historical emotional data of the wearer can be counted and displayed using a visualized chart by the following steps B1 to B3:

[0141] B1. Acquire, through the brain wave sensor, a second brain wave signal of the wearer during a second time period when the smart glasses are in a meditation working mode.

[0142] B2. Determine a second emotional state of the wearing object within the second time period based on the second brain wave signal.

[0143] The second emotional state refers to the emotional state of the wearer in the second time period.

[0144] B3. Based on the second emotional state, control the smart glasses to display an emotional data chart of the wearer.

[0145] For example, Figure 5 As shown in FIG. 1 , taking the emotional data chart in which the X-axis represents the date and the Y-axis represents the emotional state during meditation on each date as an example, all the historical meditation data of the wearer (i.e., the date of each meditation and the emotional state during meditation on that date) can be counted to construct the following: Figure 5 The sentiment data chart shown ( Figure 5 Take the emotional states including emotion a, emotion b, emotion c, emotion d as an example. Figure 5In which Date 1, Date 2, ..., Date n represent the date of each meditation), a chart of the wearer's emotional data is displayed on the meditation control APP page of the smart glasses to enable the user to understand his or her own emotional changes.

[0146] Furthermore, in order to enable users to understand their own emotional states and guide users to learn emotional management, emotional relief suggestion information for the second emotional state can also be displayed through emotional data charts.

[0147] To better understand the smart glasses control method provided by this embodiment, refer to Figure 6 ,The following example introduces the workflow of smart glasses initiating meditation working mode:

[0148] 1. The wearer of smart glasses sets the meditation duration and meditation audio in the meditation control APP of smart glasses. (Refer to Figure 6 "Quick Meditation Setup" section)

[0149] 2. During the use of the smart glasses, the brain wave sensor detects the first brain wave signal of the wearer in the first time period; and determines the first emotional state of the wearer in the first time period based on the first brain wave signal. (Refer to Figure 6 (See "Emotional Sensing and Meditation Inquiry" section)

[0150] 3. When the first emotional state is the same as the preset emotional state, the smart glasses output meditation inquiry information. (Refer to Figure 6 (See "Emotional Sensing and Meditation Inquiry" section)

[0151] 4. The wearer chooses to start meditation based on the meditation inquiry information, and the smart glasses trigger the meditation command. According to the meditation duration and meditation audio set by the wearer, the smart glasses enter the meditation working mode. (Refer to Figure 6 (see “Meditation Initiation” section)

[0152] 5. After the smart glasses enter the meditation working mode, the smart glasses detect the eye status of the wearer through eye tracking technology; if the eye status is open, the smart glasses are controlled to output eye closing prompt information; or, if the eye status is abnormal eye closing and eye movement, the smart glasses are controlled to output eye movement prompt information. (Reference Figure 6 "Eye Movement Detection" section)

[0153] 6. When the smart glasses are in meditation mode for a certain period of time, the smart glasses will exit the meditation mode. (Refer to Figure 6 “End of Meditation” section)

[0154] 7. Record the emotional data of the wearer during this meditation, and create an emotional data chart based on the emotional data of this meditation. Display the emotional data chart of the wearer on the meditation control APP page of the smart glasses to enable users to understand their own emotional changes. (Reference Figure 6 "Meditation Data Recording" and "Emotional Chart Visualization" sections)

[0155] From the above content, it can be seen that in this embodiment, the first brain wave signal of the wearer of the smart glasses within the first time period is collected by the brain wave sensor installed on the smart glasses, and the first emotional state of the wearer within the first time period is determined based on the first brain wave signal; when the first emotional state is the same as the preset emotional state, the smart glasses are controlled to enter the meditation working mode. On the one hand, since the emotional state of the wearer can be judged based on the brain wave signal and the meditation working mode is automatically entered, the meditation working mode can be initiated quickly and actively, so that the user does not need to manually turn on the meditation working mode, thereby reducing the complexity of the meditation working mode startup operation; on the other hand, since the meditation working mode is turned on after determining that the emotional state of the wearer is the same as the preset emotional state (such as anxiety state) through the brain wave signal, it is more in line with the actual need to turn on the meditation working mode, and it can automatically identify the situation where the meditation working mode needs to be turned on and automatically turn on the meditation working mode of the smart glasses, thereby improving the convenience of turning on the meditation working mode.

[0156] In addition, in order to better implement the smart glasses control method in the embodiment of the present application, based on the smart glasses control method, a smart glasses control device is also provided in the embodiment of the present application, such as Figure 6 FIG. 1 is a schematic diagram of a structure of a smart glasses control device according to an embodiment of the present application. The smart glasses control device 700 includes:

[0157] The collecting unit 701 is used to collect a first brain wave signal of a wearer of the smart glasses within a first time period through a brain wave sensor of the smart glasses.

[0158] The determination unit 702 is used to determine a first emotional state of the wearer within the first time period based on the first brain wave signal.

[0159] The control unit 703 is used to control the smart glasses to enter a meditation working mode when the first emotional state is the same as a preset emotional state.

[0160] In some embodiments, the meditation working mode is to turn off the screen and play audio, and the control unit 703 is specifically used to:

[0161] When the first emotional state is the same as a preset emotional state, obtaining meditation setting parameters of the preset emotional state; based on the meditation setting parameters, determining a target meditation duration that matches the first emotional state, and a target meditation audio that matches the first emotional state; based on the target meditation duration, controlling the smart glasses to turn off the screen and play the target meditation audio.

[0162] In some embodiments, the control unit 703 is specifically used to:

[0163] When the first emotional state is the same as the preset emotional state, meditation inquiry information is output; in response to a meditation instruction fed back to the meditation inquiry information, the smart glasses are controlled to enter a meditation working mode based on meditation audio information and meditation duration information carried by the meditation instruction.

[0164] In some embodiments, the determining unit 702 is specifically configured to:

[0165] Perform time domain feature extraction on the first brain wave signal to obtain a time domain signal curve of the first brain wave signal; convert the time domain signal curve of the first brain wave signal to obtain a frequency distribution curve of the first brain wave signal; call a trained emotion detection network, perform prediction based on the frequency distribution curve of the first brain wave signal, and obtain the emotional state of the wearer in the first time period, wherein the emotion detection network is learned based on the frequency distribution curve of the sample brain wave signal and the labeled emotional state corresponding to the frequency distribution curve of the sample brain wave signal.

[0166] In some embodiments, the smart glasses control device 700 further includes a display unit (not shown in the figure), and the display unit is specifically used for:

[0167] Acquire, by means of the brain wave sensor, a second brain wave signal of the wearing object in a second time period when the smart glasses are in a meditation working mode; determine, based on the second brain wave signal, the emotional value of the wearing object at each time point in the second time period; determine, based on the first brain wave signal, the emotional value of the wearing object at each time point in the first time period; and control the smart glasses to display an emotional data chart of the wearing object based on the emotional value at each time point in the second time period and the emotional value at each time point in the first time period, wherein the emotional data chart is used to indicate the emotional value of the wearing object at each historical time point.

[0168] In some embodiments, the control unit 703 is specifically used to:

[0169] When the smart glasses are in a meditation working mode, if a running operation of a target application with a higher priority than the meditation working mode is detected, the smart glasses are controlled to pause the meditation working mode; when the running operation of the target application is completed, the smart glasses are controlled to resume the meditation working mode.

[0170] In some embodiments, the smart glasses control device 700 further includes a prompt unit (not shown in the figure), and the prompt unit is specifically used to:

[0171] When the smart glasses are in a meditation working mode, the eye state of the wearer is detected; if the eye state is open, the smart glasses are controlled to output eye closing prompt information; or, if the eye state is abnormal eye closing and eye movement, the smart glasses are controlled to output eye movement prompt information.

[0172] Therefore, the smart glasses control device 700 provided in the embodiment of the present application can bring the following effects: on the one hand, since the emotional state of the wearer can be judged based on the brain wave signal and the meditation working mode can be automatically entered, the meditation working mode can be initiated quickly and actively, so that the user does not need to manually operate to turn on the meditation working mode, thereby reducing the complexity of the operation of turning on the meditation working mode; on the other hand, since the meditation working mode is turned on after determining through the brain wave signal that the emotional state of the wearer is the same as the preset emotional state (such as anxiety state), it is more in line with the actual need to turn on the meditation working mode, and it can automatically identify the situation where the meditation working mode needs to be turned on and automatically turn on the meditation working mode of the smart glasses, thereby improving the convenience of turning on the meditation working mode.

[0173] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above units can refer to the previous smart glasses control method embodiment, which will not be repeated here.

[0174] Those skilled in the art will appreciate that all or part of the steps in the above-mentioned smart glasses control method can be completed by instructions, or by controlling related hardware through instructions. The instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0175] To this end, an embodiment of the present application provides a computer-readable storage medium, in which multiple computer programs are stored. The computer programs can be loaded by a processor to execute any smart glasses control method provided by the embodiment of the present application.

[0176] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0177] In the above-mentioned smart glasses control device, computer-readable storage medium, and smart glasses embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the smart glasses control device, computer-readable storage medium, smart glasses and their corresponding units described above can refer to the description of the smart glasses control method in the above embodiment, and will not be repeated here.

[0178] The above is a detailed introduction to a smart glasses control method, device, smart glasses and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A smart glasses control method, characterized in that: The method comprises: collecting, by means of a brain wave sensor of the smart glasses, a first brain wave signal of a person wearing the smart glasses within a first time period; determining a first emotional state of the wearing object within the first time period based on the first brain wave signal; When the first emotional state is the same as a preset emotional state, the smart glasses are controlled to enter a meditation working mode.

2. The smart glasses control method according to claim 1, characterized in that: The meditation working mode is to turn off the screen and play audio, and when the first emotional state is the same as the preset emotional state, controlling the smart glasses to enter the meditation working mode includes: When the first emotional state is the same as a preset emotional state, obtaining meditation setting parameters of the preset emotional state; Based on the meditation setting parameters, determining a target meditation duration that matches the first emotional state and a target meditation audio that matches the first emotional state; Based on the target meditation duration, the smart glasses are controlled to turn off the screen and play the target meditation audio.

3. The smart glasses control method according to claim 1, characterized in that: When the first emotional state is the same as the preset emotional state, controlling the smart glasses to enter a meditation working mode includes: When the first emotional state is the same as the preset emotional state, outputting meditation inquiry information; In response to a meditation instruction for the meditation inquiry information feedback, the smart glasses are controlled to enter a meditation working mode based on the meditation audio information and meditation duration information carried by the meditation instruction.

4. The smart glasses control method according to claim 1, characterized in that: The determining, based on the first brain wave signal, a first emotional state of the wearing object in the first time period includes: Performing time domain feature extraction on the first brain wave signal to obtain a time domain signal curve of the first brain wave signal; Converting the time domain signal curve of the first brain wave signal to obtain a frequency distribution curve of the first brain wave signal; Calling a trained emotion detection network, and performing prediction based on the frequency distribution curve of the first brain wave signal to obtain the emotional state of the wearer in the first time period, wherein the emotion detection network is learned based on the frequency distribution curve of the sample brain wave signal and the labeled emotional state corresponding to the frequency distribution curve of the sample brain wave signal.

5. The smart glasses control method according to claim 1, characterized in that: The method further comprises: Acquiring, by means of the brain wave sensor, a second brain wave signal of the wearer during a second time period in which the smart glasses are in a meditation working mode; determining the emotion value of the wearing object at each time point in the second time period based on the second brain wave signal; determining, based on the first brain wave signal, an emotion value of the wearing object at each time point in the first time period; Based on the emotion value at each time point in the second time period and the emotion value at each time point in the first time period, the smart glasses are controlled to display an emotion data chart of the wearer, wherein the emotion data chart is used to indicate the emotion value of the wearer at each historical time point.

6. The smart glasses control method according to claim 1, characterized in that: The method further comprises: When the smart glasses are in a meditation working mode, if a running operation of a target application with a higher priority than the meditation working mode is detected, the smart glasses are controlled to suspend the meditation working mode; When the running operation of the target application is completed, the smart glasses are controlled to resume the meditation working mode.

7. The smart glasses control method according to claim 1, characterized in that: The method further comprises: When the smart glasses are in a meditation working mode, detecting the eye state of the wearer; If the eye state is open, the smart glasses are controlled to output eye-closing prompt information; or, if the eye state is abnormal eye-closing and eye movement, the smart glasses are controlled to output eye-movement prompt information.

8. A smart glasses control device, characterized in that: The smart glasses control device comprises: A collection unit, configured to collect a first brain wave signal of a person wearing the smart glasses within a first time period through a brain wave sensor of the smart glasses; a determining unit, configured to determine a first emotional state of the wearing object within the first time period based on the first brain wave signal; A control unit is used to control the smart glasses to enter a meditation working mode when the first emotional state is the same as a preset emotional state.

9. A smart glasses, characterized in that: The method comprises a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, the method for controlling the smart glasses according to any one of claims 1 to 7 is executed.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the smart glasses control method according to any one of claims 1 to 7.

Images