Smart glasses, smart glasses system, and stress relief prompt method

Abstract

Smart glasses, a smart glasses system, and a stress relief prompting method are disclosed. The smart glasses include a processor, a sensor, an input device, and a playback device disposed in the temples. The processor is configured to continuously acquire sensor data from the sensor and determine the user's eye status based on the sensor data. The processor is further configured to control the playback device to issue a rest prompt if the user's eye status meets a preset prompting condition. Furthermore, if the user performs a preset input operation on the input device within a preset waiting time, the playback device is controlled to play a preset music file. These smart glasses, smart glasses system, and stress relief prompting method can improve the intelligence of rest prompting by smart glasses.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of smart wearable devices, and in particular to smart glasses, a smart glasses system, and a stress relief prompt method. Background Art

[0002] When reading, people overstrain their eyes by staring intently at screens or physical pages for extended periods, leading to health problems such as eye fatigue, headaches, and shoulder and neck pain. Consequently, various eye protection methods have become popular in recent years to alleviate vision problems and mental stress. For example, the 20-20-20 rule effectively protects vision, meaning that every 20 minutes, look at something 20 feet away for 20 seconds to relax the eye muscles.

[0003] Existing technology uses smart glasses to detect the distance and duration of eye use, issuing alerts and tracking statistics. However, this technology is typically used to correct children's eye habits, prevent visual fatigue, and reduce the risk of myopia. There are no methods to help users relax their eyes and mind while working. Summary of the Invention

[0004] The embodiments of the present application provide a pair of smart glasses, a smart glasses system, and a stress relief prompt method, which can solve the problem of lack of reminders for users who are working to relax their eyes and mind.

[0005] An embodiment of the present application provides smart glasses, including:

[0006] A processor, a sensor, an input device, and a playback device disposed in the temples;

[0007] The processor is connected to the sensor, the input device and the playback device;

[0008] The processor is used to continuously acquire sensing data from the sensor and determine the user's eye status based on the sensing data;

[0009] The processor is also used to control the playback device to issue a rest prompt if the user's eye status reaches a preset prompt condition, and to control the playback device to play a preset music file if the user is detected to perform a preset input operation on the input device within a preset waiting time.

[0010] On the one hand, an embodiment of the present application further provides a smart glasses system, including: a smart terminal, a cloud server, and the smart glasses as described above.

[0011] On the one hand, an embodiment of the present application also provides a stress relief prompt method, including: issuing a rest prompt through the smart glasses as described above and playing a preset music file through the smart glasses when the smart glasses obtain a user's preset input operation.

[0012] It can be seen from the above-mentioned embodiments of the present application that the smart glasses include a processor, a sensor, an input device and a playback device arranged in the temples. The processor is used to continuously obtain the sensing data of the sensor and judge the user's eye status based on the sensing data. If the user's eye status reaches a preset prompt condition, the playback device is controlled to issue a rest prompt. If the user is detected to perform a preset input operation on the input device within a preset waiting time, the playback device is controlled to play a preset music file. By monitoring the user's eye status, a rest prompt can be automatically triggered, and a music file can be played when the user's input operation is detected, thereby improving the intelligence of the smart glasses and facilitating user operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention.

[0014] Figure 1 A schematic diagram of the hardware structure of the smart glasses provided in one embodiment of the present application;

[0015] Figure 2 A schematic diagram of an eye status judgment angle for the smart glasses provided in an embodiment of the present application;

[0016] Figure 3 A schematic diagram of another eye status judgment angle for the smart glasses provided in an embodiment of the present application;

[0017] Figure 4 A schematic diagram of the structure of a smart glasses system provided in one embodiment of the present application;

[0018] Figure 5 A schematic diagram of the implementation flow of the stress relief prompt method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0019] To make the purpose, technical solutions, and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0020] See also Figure 1 , a schematic diagram of the structure of smart glasses provided by an embodiment of the present application. For ease of explanation, only the parts related to the embodiment of the present application are shown. The smart glasses may include:

[0021] A processor 11, a sensor 12, an input device 13, and a playback device 14 are provided in the temple 10;

[0022] The processor 11 is connected to the sensor 12, the input device 13 and the playback device 14;

[0023] The processor 11 is used to obtain sensing data from the sensor 12 and determine the user's eye status based on the sensing data;

[0024] Eye use states include: focused eye use state, static state and dynamic state;

[0025] Among them, the focused eye state refers to the state in which the user continuously uses the eyes, such as reading a book or viewing the interface of an electronic product, and the user's head has a preset range of up and down pitch and left and right swings;

[0026] The static state refers to a state where the user's head movement is relatively small. The absolute changes in acceleration and angular velocity are used to determine the amplitude of head movement. When the amplitude of head movement is less than the threshold for the amplitude of head movement during normal walking, the user is determined to be in a static state. The static state includes the state of focused eye use. Examples include riding in a car, chatting, in a meeting, eating, reading, and using a mobile phone.

[0027] A dynamic state refers to a situation where the user's head moves significantly. The magnitude of head movement is determined by the absolute changes in acceleration and angular velocity. When the magnitude of head movement exceeds the threshold for normal walking, the user is considered to be in a dynamic state, such as running, walking, or climbing stairs.

[0028] The processor 11 is further configured to control the playback device 14 to issue a rest reminder if the user's eye usage status reaches a preset reminder condition.

[0029] The preset prompt condition can be the prompt score corresponding to the continuous length of time that the user is in a focused eye state, or the prompt score corresponding to the continuous length of time that the user is in a static state without focusing eye state, or the sum of the prompt scores corresponding to the continuous length of time in the focused eye state and the continuous length of time in the static state without focusing eye state is greater than the prompt score threshold.

[0030] Specifically, the processor is further configured to calculate a rest reminder score threshold Sremind according to the weighted score w corresponding to the eye use state and a preset rest reminder interval T;

[0031] Furthermore, a rest reminder score S is calculated according to the weighted score w corresponding to the eye use state and the eye use time T, and when the reminder score S is greater than the reminder score threshold Sremind, the playback device is controlled to issue a rest reminder.

[0032] Specifically, the weighted score corresponding to the focused eye state is w1, the weighted score corresponding to the static state is w2, and the weighted score corresponding to the dynamic state is w3;

[0033] w1>w2>w3, for example, w1=2; w2=1, w3=0;

[0034] The user's activity time is t, and the rest reminder score is S, then:

[0035] S = w*t;

[0036] Among them, if the user is in a state of focused eye use, then w=w1; if the user is in a static state of non-focused eye use, then w=w2; if the user is in an active state, then w=w3.

[0037] Sremind is the rest reminder score threshold, Sremind=w1*T, T is the rest reminder interval, the unit is second.

[0038] Generally, if the preset rest reminder interval T is 20 minutes, T = 1200 seconds, then the rest reminder score threshold Sremind = 2400;

[0039] For example, if a user is concentrating on using their eyes for 20 minutes, S = 2400; the smart glasses will issue a break reminder after 20 minutes.

[0040] In another example, if the user is in a static state with no focused eyesight, such as in a meeting, and the meeting lasts for 20 minutes (S=1200), no break reminder will be issued. If the user then focuses on their eyes for 10 minutes, or continues the meeting for another 20 minutes (S=2400), the smart glasses will issue a break reminder.

[0041] In another example, if the user is in a state of focused eye use for 10 minutes and then continues to be active, such as walking for 2 minutes, S will return to zero and the smart eyes will not issue a rest reminder.

[0042] In this embodiment, the determination of whether the user needs a rest reminder does not focus on the user's eye concentration state, but rather comprehensively considers the user's eye state and eye use duration.

[0043] The processor 11 is further configured to play a preset music file through the playing device 14 if it is detected that the user performs a preset input operation on the input device 13 within a preset waiting time.

[0044] The input device 13 includes a touch control device, and the preset input operation is correspondingly a touch operation; the input device 13 also includes a button, and the preset input operation is correspondingly an operation of pressing the button.

[0045] When the user performs the input operation on the input device 13 , the input device 13 sends a notification signal, so that the processor 11 can obtain the notification signal, thereby confirming that the input operation is performed on the input device 13 .

[0046] The playback device 14 may specifically be a speaker.

[0047] The temples 10 of the smart glasses are also provided with a first wireless data transmission module 15 for wirelessly connecting the smart glasses to a smart terminal having a second wireless data transmission module. The smart terminal can be an electronic device such as a mobile phone, smart watch, tablet computer, desktop computer, etc.

[0048] The processor 11 is also used to obtain the length of time the user uses the screen of the smart terminal, or obtain the user's heartbeat rate through the first wireless data transmission module 15. If the length of time exceeds the preset usage time, or the average heartbeat rate of the user exceeds the preset heartbeat rate, it is confirmed that the user needs to rest, and the playback device 14 is controlled to issue a rest prompt.

[0049] Users can use the application running on the smart terminal to set the sound file corresponding to the rest reminder issued by the smart glasses. The sound file can be a soft voice prompt, and the prompt content can be "Please take a break", "You have been using your eyes for 20 minutes, please take a break", etc., or it can be a musical sound, such as piano music, singing bowl audio, etc.; the user can also set the rest reminder interval when the user is in a state of focused eye use. The rest reminder interval is usually set to 20 minutes, but it can also be 30 minutes or 40 minutes, etc.; the volume of the rest reminder can also be set.

[0050] The user can also use this app to set a music file for the smart glasses to play after detecting a preset input operation on the input device 13. Specifically, the smart glasses will play the music file according to the user's selected playback date, playback time period, and playback volume. For example, playback dates are Monday through Friday; playback time period is, for example, 9:00 AM to 10:00 PM every day of the aforementioned playback date. During non-playing dates and non-playing time periods, the music file cannot be played by the user using the preset input operation on the input device 13.

[0051] The app also lets users set the type of music files to play. The app includes a built-in music library, where each music file is categorized by music category and sound effects. Users can choose a specific type of music based on their preferences, such as soothing music, or a specific sound effect, such as water droplets or rain.

[0052] Correspondingly, the processor 11 is further configured to obtain and save, through the first wireless data transmission module 15 , the preset duration, the sound file of the rest prompt, and the volume of the rest prompt set by the user on the smart terminal.

[0053] The processor 11 is further configured to obtain and save, through the first wireless data transmission module 15 , the play date, play time period, and play volume of the plurality of preset music files set by the user on the smart terminal.

[0054] The processor 11 is further configured to obtain and save the type of the preset music file set by the user on the smart terminal through the first wireless data transmission module 15 .

[0055] After the processor 11 obtains the above parameters set on the smart terminal, it can store the above parameters. When the smart glasses are not connected to the smart terminal, it can also execute according to the above parameters: if the user's eye status reaches the preset prompt condition, control the playback device to issue a rest prompt, and if it is detected that the user performs a preset input operation on the input device 13 within the preset waiting time, control the playback device 14 to play the preset music file.

[0056] Specifically, the processor 11 is further configured to, upon detecting a preset number of user input operations on the input device 13 within the preset waiting time, search for a music file in a plurality of preset music files whose play date and play time period correspond to the current date and time, respectively, and control the playback device 13 to play the found music file. The preset waiting time is a short wait time, such as one minute. If a preset input operation is detected on the input device 13 within the preset waiting time, it is determined that the user has performed an operation to trigger playback of the music file.

[0057] The preset number of times, for example, 1 time, 2 times or multiple times, can be set arbitrarily by the user.

[0058] Users can preset multiple music files and play different music files at different time periods. For example, forest background sound effects can be played from 9:00 a.m. to 12:00 a.m.; stretching audio instructions can be played from 2:00 p.m. to 8:00 p.m.; and hypnotic music can be played from 9:00 p.m. to 10:00 p.m.

[0059] Furthermore, the sensor 12 includes an inertial sensor, specifically including: a three-dimensional acceleration sensor and a three-dimensional gyroscope; the sensing data includes acceleration and angular velocity.

[0060] The processor 11 is further configured to calculate a change in the acceleration and a change in the angular velocity, calculate a head angle of the user based on the acceleration, and determine whether the change in the acceleration and the change in the angular velocity meet a preset focused eye condition, a static state condition, or a dynamic state condition;

[0061] If the focused eye condition is met, the user is further determined to be in a focused eye state based on the user's head angle;

[0062] If the static state condition is met, it is determined that the user is in a static state;

[0063] If the dynamic state condition is met, it is determined that the user is in a dynamic state.

[0064] Furthermore, if the user is in a dedicated eye-use state and statistics are continuously kept, the processor 11 is further configured to reset the timing of the user's eye-use state to zero if the user is in a dynamic state for a third statistical duration.

[0065] Specifically, the calculation method is to calculate the absolute change of the acceleration |Δ a |or the absolute change in angular velocity|Δ ω |:

[0066]

[0067]

[0068] Among them, a i is the acceleration of the user's head, ω i is the angular velocity of the user’s head;

[0069] i is the dimension of the three-axis accelerometer and three-axis gyroscope, and the numbers 0, 1, and 2 in the formula correspond to x, y, and z respectively; t is the number of data samples collected in each sampling period; N is the total amount of sensor data in each sampling period, and the sampling period can be 1 second, 2 seconds, or 5 seconds, etc.

[0070] If |Δ a |<|Δ aw |, then it is determined that the static state condition is met and the user is in a static state; otherwise, it is determined that the dynamic state condition is met and the user is in a dynamic state, where |Δ aw | is the acceleration change threshold of the user's normal walking, which is a known value;

[0071] Or, if |Δ ω |<|Δ ωw |, then it is determined that the static state condition is met and the user is in a static state; otherwise, it is determined that the dynamic state condition is met and the user is in a dynamic state, where |Δ ωw | is the angular velocity change threshold of the user's normal walking, which is a known value;

[0072] If the calculated |Δ a | and |Δ ωIf the static state condition is met, the user's head angle is calculated based on the sensor data of the acceleration sensor to determine whether the user meets the preset focused eye conditions. Figure 2 , Figure 2 This is a schematic diagram of the user's line of sight in the sagittal plane. Figure 3 This is a coronal diagram of the user's line of sight. The natural line of sight refers to the direction in which the user looks straight ahead:

[0073]

[0074] Among them, θ1, θ and θ2 can represent the pitch angle of the user's head, θ represents the pitch angle of the user's head, θ1 and θ2 respectively represent the maximum allowable pitch angles in the state of focused eye use; the range of θ is usually between 10° and 50°.

[0075] φ1, φ and φ2 can represent the user's head tilt angle, φ represents the user's head tilt angle, φ1 and φ2 represent the maximum allowable tilt angles in the state of focused eye use; the range of φ is usually between 30° and -30°.

[0076] a x 、a y and a z Represents the components of the user's head acceleration on the x, y, and z axes respectively.

[0077] If the calculation results are θ1≤θ≤θ2, and φ1≤φ≤φ2, it is determined that the user is in a state of focused eye use.

[0078] Furthermore, the smart glasses also include a proximity sensor 16 , a microphone 17 and a battery 18 .

[0079] In an embodiment of the present application, the smart glasses include a processor, a sensor, an input device, and a playback device arranged in the temples. The processor is used to continuously obtain sensing data from the sensor and judge the user's eye status based on the sensing data. If the user's eye status reaches a preset prompt condition, the playback device is controlled to issue a rest prompt. If the user is detected to perform a preset input operation on the input device within a preset waiting time, the playback device is controlled to play a preset music file. By monitoring the user's eye status, a rest prompt can be automatically triggered, and a music file can be played when the user's input operation is detected, thereby improving the intelligence of the smart glasses and facilitating user operation.

[0080] In addition, by obtaining the play date, play time period and type of the music files set by the user in the smart terminal, the user can play favorite music according to his or her own working hours and daily routine, so as to relax the eyes and mind, protect eyesight and relieve stress.

[0081] See also Figure 4, the embodiment of the present application also provides a smart glasses system, including smart glasses 100, a smart terminal 200 and a cloud server 300;

[0082] The smart glasses 100 are the smart glasses in the above embodiment, the smart terminal 200 is the smart terminal in the above embodiment, an application is running on the smart terminal 200, and the cloud server 300 can store data and applications.

[0083] The smart glasses 100 are connected to the smart terminal 200 via a wireless network, and the smart terminal 200 is connected to the cloud server 300 via a wireless network or a mobile network.

[0084] Wireless networks include Bluetooth, WIFI, etc.; mobile networks include 4G or 5G, etc.

[0085] The smart glasses 100 obtain data of the application program set by the user on the smart terminal 200 through the wireless network.

[0086] The smart terminal 200 exchanges data with the cloud server 300 via a wireless network, such as downloading applications, uploading setting data of the smart glasses 100 to the cloud server 300, etc.

[0087] See also Figure 5 The present application also provides a stress relief prompt method, which can be applied to the smart glasses in the above embodiment. The smart glasses issue a rest prompt and, when the smart glasses receive a preset input operation from the user, play a preset music file through the smart glasses. The method includes the following steps:

[0088] S501, continuously acquiring sensor data from sensors of the smart glasses, and determining the user's eye status based on the sensor data;

[0089] S502: If the user's eye condition reaches a preset prompt condition, a rest prompt is issued;

[0090] S503: If it is detected that the user performs a preset input operation on the input device within the preset waiting time, control the playback device to play a preset music file.

[0091] For the specific contents of the embodiments of this application, please refer to the description of the aforementioned embodiments.

[0092] In an embodiment of the present application, by continuously acquiring sensor data from the sensor and judging the user's eye status based on the sensor data, if the user's eye status reaches a preset prompt condition, the playback device is controlled to issue a rest prompt; if the user is detected to perform a preset input operation on the input device within a preset waiting time, the playback device is controlled to play a preset music file. By monitoring the user's eye status, a rest prompt can be automatically triggered, and a music file can be played when a user's preset input operation is detected, thereby improving the intelligence of the smart glasses and facilitating user operation.

[0093] It should be noted that for the aforementioned method embodiments, for ease of description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that the present invention is not limited by the order of the actions described, because according to the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0094] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0095] The above is a description of the smart glasses, smart glasses system, and stress relief prompt method provided by the present invention. For those skilled in the art, based on the concepts of the embodiments of this application, there may be changes in the specific implementation methods and application scopes. In summary, the contents of this specification should not be understood as limiting the present invention.

Claims

1. A pair of smart glasses, characterized in that: The smart glasses include: A processor, a sensor, an input device, and a playback device disposed in the temples; The processor is connected to the sensor, the input device and the playback device; The processor is used to continuously acquire sensing data from the sensor and determine the user's eye status based on the sensing data; The processor is further configured to control the playback device to issue a rest prompt if the user's eye state reaches a preset prompt condition, and to control the playback device to play a preset music file if the user is detected to perform a preset input operation on the input device within a preset waiting time. The eye state includes a static state and a dynamic state, wherein the static state includes a focused eye state. The preset prompt condition is that the sum of the prompt scores corresponding to the continuous time in the focused eye state and the continuous time in the static state of the non-focused eye state is greater than the prompt score threshold, wherein the prompt score of each eye state is the product of the weighted score corresponding to the state and the continuous time in the state, and the weighted score of the focused eye state is greater than the weighted score of the static state of the non-focused eye state.

2. The smart glasses according to claim 1, wherein: The processor is further configured to, when it is detected that the user has performed a preset input operation on the input device for a preset number of times within the preset waiting time, search for a music file whose playing date and playing time period correspond to the current date and time respectively in a plurality of preset music files, and control the playing device to play the found music file.

3. The smart glasses according to claim 1 or 2, characterized in that: The sensor includes an inertial sensor, and the sensing data includes acceleration and angular velocity.

4. The smart glasses according to claim 3, wherein: The processor is further configured to calculate a change in the acceleration and a change in the angular velocity, calculate a change in the amplitude of the user's head movement, and determine whether the user is in a stationary state or a dynamic state based on the amplitude of the movement change; Furthermore, the user's head angle is calculated based on the acceleration, and the static state of the user in the stationary state, i.e., a focused eye state or a non-focused eye state, is determined based on the user's head angle.

5. The smart glasses according to claim 4, characterized in that: The processor is further configured to calculate a rest reminder score threshold Sremind based on the weighted score w1 corresponding to the focused eye state and a preset rest reminder interval T; Furthermore, a rest reminder score S is calculated according to the weighted score w1 corresponding to the focused eye state and the user activity time t, and when the reminder score S is greater than the reminder score threshold Sremind, the playback device is controlled to issue a rest reminder.

6. The smart glasses according to claim 5, characterized in that: The processor is further configured to reset the prompt score to zero after a preset dynamic statistical time period if the user is in the dynamic state.

7. The smart glasses according to claim 6, wherein: The smart glasses further include: a first wireless data transmission module; The first wireless data transmission module is used to wirelessly connect the smart glasses to a smart terminal having a second wireless data transmission module.

8. The smart glasses according to claim 7, wherein: The processor is also used to obtain the length of time the user uses the screen of the smart terminal, or obtain the user's heartbeat rate through the first wireless data transmission module. If the length of time exceeds the preset usage time, or the average heartbeat rate of the user exceeds the preset heartbeat rate, the playback device is controlled to issue a rest prompt.

9. The smart glasses according to claim 8, characterized in that The processor is further configured to obtain and save the dynamic statistical duration, the sound file of the rest prompt, and the reminder volume of the rest prompt set by the user on the smart terminal through the first wireless data transmission module.

10. The smart glasses according to claim 9, wherein: The processor is further configured to obtain and save, through the first wireless data transmission module, the play dates and play time periods of the plurality of preset music files set by the user on the smart terminal.

11. The smart glasses according to claim 10, wherein: The processor is further configured to obtain and save, through the first wireless data transmission module, the type of the preset music file set by the user on the smart terminal.

12. A smart glasses system, characterized in that: include: A smart terminal, a cloud server, and the smart glasses according to any one of claims 1 to 11.

13. A stress relief prompt method, applied to smart glasses, characterized in that: include: A rest reminder is issued by the smart glasses according to any one of claims 1 to 11, and a preset music file is played by the smart glasses when the smart glasses obtain a user's preset input operation.

Images