Smart glasses, wearing detection method, storage medium and computer program product

Abstract

The embodiment of the invention discloses intelligent glasses, a wearing detection method, a storage medium and a computer program product. A first loudspeaker and a first microphone are arranged on a glasses leg, a second microphone is arranged on a glasses frame, the first loudspeaker emits detection ultrasonic waves, and when a user wears the intelligent glasses, the detection ultrasonic waves are transmitted to the first loudspeaker; the head of the user is located on the propagation path of the detection ultrasonic waves, so that a first time difference is determined according to the time when the first microphone receives the first feedback ultrasonic waves and the time when the first loudspeaker emits the detection ultrasonic waves, and the detection ultrasonic waves are detected according to the first time difference and the amplitude of the second feedback ultrasonic waves received by the second microphone. The wearing state of the intelligent glasses can be determined, and then the working state of the intelligent glasses is controlled according to the wearing state of the intelligent glasses. The intelligent glasses provided by the embodiment of the invention can adapt to a scene more intelligently and automatically to control the working mode of the intelligent glasses more accurately, and the power consumption of the intelligent glasses is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of smart wearable devices, and more particularly, to a smart glasses, a wearing detection method, a storage medium, and a computer program product. Background Art

[0002] With the development of technology and the improvement of people's living standards, the application scale of wearable smart devices is becoming increasingly large. Smart glasses are a common type of wearable smart device. By integrating electronic components into the glasses, smart glasses can have functions such as image display, audio playback, and signal collection. When traditional wearable smart devices are in use, even if they are taken off by the user, the wearable smart devices still maintain their original working state, which increases the energy consumption of the devices. Currently, some wearable smart devices use touch sensors or acceleration sensors on the devices for wearing detection, but these detection methods are easily affected by user activities and other factors, resulting in misjudgment and thus affecting the normal use of users. Summary of the Invention

[0003] In view of this, embodiments of the present invention provide a smart glasses, a wearing detection method, a storage medium, and a computer program product to solve at least some of the above problems existing in the prior art.

[0004] In a first aspect, an embodiment of the present invention provides a smart glasses, including a glasses body, a first speaker, a first microphone, a second microphone, and a control circuit; the glasses body includes a frame and two temple arms; the first speaker is disposed on the temple arm, and the first speaker is configured to emit detection ultrasonic waves; the first microphone is disposed on the temple arm and on one side of the first speaker, and the first microphone is configured to receive a first feedback ultrasonic wave, where the first feedback ultrasonic wave includes at least part of the detection ultrasonic wave; the second microphone is disposed on the frame, and the second microphone is configured to receive a second feedback ultrasonic wave, where the second feedback ultrasonic wave includes at least part of the detection ultrasonic wave; the control circuit is electrically connected to the first speaker, the first microphone, and the second microphone, and the control circuit is configured to: determine a first time difference, where the first time difference is the time difference between the time when the first microphone receives the first feedback ultrasonic wave and the time when the first speaker emits the detection ultrasonic wave; determine the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave, where the wearing state of the smart glasses includes a worn state and an unworn state; and control the working state of the smart glasses according to the wearing state of the smart glasses.

[0005] Further, there are two first speakers and two first microphones. One first speaker and one first microphone are respectively arranged on each temple; the first speakers on the two temples are configured to simultaneously emit ultrasonic waves; or, the first speakers on the two temples are configured to alternately emit ultrasonic waves at a predetermined time interval.

[0006] Further, each temple is connected to the frame through a first connection structure. The first microphone is arranged between the first speaker and the first connection structure, and the second microphone is arranged between the two first connection structures.

[0007] Further, the working states of the smart glasses include a first state and a second state, and the power consumption of the smart glasses in the second state is lower than that in the first state; controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: when it is determined that the wearing state of the smart glasses is the worn state, controlling the smart glasses to be in the first state; when it is determined that the wearing state of the smart glasses is the non-worn state, controlling the smart glasses to be in the second state.

[0008] Further, determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: when the first time difference exceeds the first duration range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the non-worn state; and when the first time difference is within the first duration range and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, determining the wearing state of the smart glasses as the worn state.

[0009] Further, determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: when the first time difference exceeds the first duration range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the non-worn state; and when the first time difference is within the first duration range and the continuous duration exceeds the preset duration, determining the wearing state of the smart glasses as the worn state.

[0010] Further, the control circuit is further configured to: when the first time difference exceeds the first duration range, determine the fluctuation state of the first time difference, where the fluctuation state includes a fluctuation amplitude and a fluctuation duration; determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave further includes: when the fluctuation amplitude of the first time difference is greater than or equal to a first amplitude threshold and the fluctuation duration is greater than a preset fluctuation duration threshold, determining the wearing state of the smart glasses as the not-worn state, where the first amplitude threshold is greater than the difference between the maximum value and the minimum value of the first duration range.

[0011] Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave further includes: when the fluctuation amplitude of the first time difference is less than the first amplitude threshold and the amplitude of the second feedback ultrasonic wave is within a first amplitude range, determining the wearing state of the smart glasses as the worn state.

[0012] Controlling the working state of the smart glasses according to the wearing state of the smart glasses further includes: when it is determined that the wearing state of the smart glasses is the not-worn state, inputting the first time difference and / or the amplitude of the second feedback ultrasonic wave within a preset duration into a wearing detection neural network model to obtain a not-worn probability, where the wearing detection neural network model is trained by a plurality of sample data marked with true wearing states and including the first time difference and the amplitude of the second feedback ultrasonic wave; and when the not-worn probability is greater than a preset probability threshold, controlling the smart glasses to shut down.

[0013] In a second aspect, an embodiment of the present invention further provides a wearing detection method for a smart glasses. The smart glasses include a glasses body, and the glasses body includes a frame and two temple arms. The method includes the following steps: emitting a detection ultrasonic wave through a first speaker, where the first speaker is disposed on the temple arm; receiving a first feedback ultrasonic wave through a first microphone, where the first feedback ultrasonic wave includes at least a part of the detection ultrasonic wave, and the first microphone is disposed on the temple arm; receiving a second feedback ultrasonic wave through a second microphone, where the second feedback ultrasonic wave includes at least a part of the detection ultrasonic wave, and the second microphone is disposed on the frame; determining a first time difference, where the first time difference is the time difference between the time when the first microphone receives the first feedback ultrasonic wave and the time when the first speaker emits the detection ultrasonic wave; determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave, where the wearing state of the smart glasses includes a worn state and a not-worn state; and controlling the working state of the smart glasses according to the wearing state of the smart glasses.

[0014] Further, the working states of the smart glasses include a first state and a second state, and the power consumption of the smart glasses in the second state is lower than that in the first state; controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: when it is determined that the wearing state of the smart glasses is the worn state, controlling the smart glasses to be in the first state; and when it is determined that the wearing state of the smart glasses is the non-worn state, controlling the smart glasses to be in the second state.

[0015] Further, determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: when the first time difference exceeds the first duration range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the non-worn state; and when the first time difference is within the first duration range and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, determining the wearing state of the smart glasses as the worn state.

[0016] Further, determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: when the first time difference exceeds the first duration range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the non-worn state; and when the first time difference is within the first duration range and the continuous duration exceeds the preset duration, determining the wearing state of the smart glasses as the worn state.

[0017] Further, the method further includes: when the first time difference exceeds the first duration range, determining the fluctuation state of the first time difference, where the fluctuation state includes the fluctuation amplitude and the fluctuation continuous duration; determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave further includes: when the fluctuation amplitude of the first time difference is greater than or equal to the first amplitude threshold and the fluctuation continuous duration is greater than the preset fluctuation duration threshold, determining the wearing state of the smart glasses as the non-worn state, where the first amplitude threshold is greater than the difference between the maximum value and the minimum value of the first duration range; and when the fluctuation amplitude of the first time difference is less than the first amplitude threshold and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, determining the wearing state of the smart glasses as the worn state.

[0018] Further, controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: when it is determined that the wearing state of the smart glasses is the non-wearing state, inputting the first time difference and / or the amplitude of the second feedback ultrasonic wave within a predetermined time duration into a wearing detection neural network model to obtain a non-wearing probability, where the wearing detection neural network model is trained by a plurality of sample data marked with the true wearing state and including the first time difference and the amplitude of the second feedback ultrasonic wave; and when the non-wearing probability is greater than a preset probability threshold, controlling the smart glasses to shut down.

[0019] In a third aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which computer program instructions are stored, and when the computer program is executed by a processor, the method described in the second aspect is implemented.

[0020] In a fourth aspect, an embodiment of the present invention further provides a computer program product, including instructions, and when the instructions run on the smart glasses, the smart glasses are enabled to execute the method described in the second aspect.

[0021] An embodiment of the present invention provides a smart glasses, a wearing detection method, a storage medium, and a computer program product. By providing a first speaker and a first microphone on the temple, and a second microphone on the frame, the first speaker emits detection ultrasonic waves. When the user wears the smart glasses, the user's head is located on the propagation path of the detection ultrasonic waves. Thus, a first time difference is determined according to the time when the first microphone receives the first feedback ultrasonic wave and the time when the first speaker emits the detection ultrasonic wave. According to the first time difference and the amplitude of the second feedback ultrasonic wave received by the second microphone, the wearing state of the smart glasses can be determined, and further, the working state of the smart glasses can be controlled according to the wearing state of the smart glasses. The smart glasses provided by the embodiment of the present invention can more intelligently and automatically adapt to the scenario to more accurately control the working mode of the smart glasses and reduce the power consumption of the smart glasses. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Through the following description of the embodiments of the present invention with reference to the drawings, the above and other objects, features, and advantages of the present invention will become clearer. In the drawings:

[0023] Figure 1 is a three-dimensional structural schematic diagram of a smart glasses according to an embodiment of the present invention;

[0024] Figure 2 is a three-dimensional schematic diagram of a smart glasses according to an embodiment of the present invention in a worn state;

[0025] Figure 3 is a top view schematic diagram of a smart glasses according to an embodiment of the present invention in a worn state;

[0026] Figure 4 is a schematic block diagram of the smart glasses according to an embodiment of the present invention;

[0027] Figure 5 is a schematic block diagram of the smart glasses according to another embodiment of the present invention;

[0028] Figure 6 is a flowchart of a wearing detection method according to an embodiment of the present invention;

[0029] Figure 7 is a schematic flowchart of determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave according to an embodiment of the present invention;

[0030] Figure 8 is a schematic flowchart of determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave according to another embodiment of the present invention;

[0031] Figure 9 is a schematic flowchart of determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave according to another embodiment of the present invention;

[0032] Figure 10 is a schematic flowchart of determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave according to another embodiment of the present invention.

[0033] Description of reference numerals:

[0034] 10 - glasses main body; 11 - spectacle frame; 111 - nose bridge; 12 - temple; 13 - first connection structure; 20 - first speaker; 30 - first microphone; 40 - second microphone; 50 - control circuit; 60 - third microphone; A - head. Detailed implementation manners

[0035] The following is a description of the present application based on embodiments, but the present application is not limited to these embodiments. In the following detailed description of the present application, some specific details are described in detail. Those skilled in the art can fully understand the present application without the description of these details. In order to avoid obscuring the essence of the present application, well-known methods, processes, procedures, elements and circuits are not described in detail.

[0036] In addition, those of ordinary skill in the art should understand that the drawings provided herein are for illustrative purposes only, and the drawings are not necessarily drawn to scale.

[0037] Unless the context clearly requires otherwise, words such as "including" and "comprising" in the entire application document shall be construed in an inclusive sense rather than an exclusive or exhaustive sense; that is, it means "including but not limited to".

[0038] In the description of this application, it should be understood that terms such as "first" and "second" are only used for descriptive purposes and should not be construed as indicating or implying relative importance. In addition, in the description of this application, unless otherwise specified, the meaning of "a plurality of" is two or more.

[0039] An embodiment of the present invention provides a smart glasses. Smart glasses are wearable devices that integrate computing, display, sensing, and other advanced technologies, aiming to provide users with augmented reality (AR), virtual reality (VR), or mixed reality (MR) experiences while maintaining convenience and comfort in daily use. Smart glasses not only have the functions of traditional glasses, namely vision correction, adjusting visible light, or decoration, but also can realize functions such as information interaction, environmental perception, and user interface operation through various built-in sensors, cameras, microphones, speakers, and displays. Smart glasses can establish wired or wireless communication connections with other electronic devices (for example, smartphones, computers, etc.) to achieve information interaction. The wireless communication connection can be, for example, a short-range transmission technology such as wireless fidelity (Wi-Fi) connection, Bluetooth connection, etc. The wired communication connection can be, for example, a universal serial bus (USB) connection, a high-definition multimedia interface (HDMI) connection, etc. This embodiment does not limit the type of communication connection.

[0040] Refer to Figure 1 and Figure 2 , in this embodiment, the smart glasses include a glasses body 10 and a speaker and a microphone provided on the glasses body 10. The glasses body 10 includes a frame 11 and two temple arms 12. The two temple arms 12 are respectively a left temple arm 12 and a right temple arm 12, and the two temple arms 12 are respectively connected to the left end and the right end of the frame 11. Refer to Figure 3 , when the user wears the smart glasses, the two temple arms 12 are respectively located on the left side and the right side of the user's head A. Each temple arm 12 is connected to the frame 11 through a first connection structure 13. In some embodiments, the first connection structure 13 can be a pivot structure so that the temple arm 12 can rotate relative to the frame 11 to realize the folding or unfolding of the smart glasses. The glasses body 10 may further include a display device, and the display device can be embedded in the frame 11.

[0041] The speaker of the smart glasses includes at least one first speaker 20, and the first speaker 20 is provided on the temple 12 and can emit detection ultrasonic waves. The microphone of the smart glasses includes at least one first microphone 30, and the first microphone 30 is provided on the temple 12 and is located on one side of the first speaker 20. In some embodiments, the first speaker 20 and the first microphone 30 provided on the same temple 12 form a set of ultrasonic wave transmitting and receiving groups. The direction of the detection ultrasonic wave emitted by the first speaker 20 forms a certain angle with the line connecting the first speaker 20 and the first microphone 30. After being reflected by an object on the propagation path, the detection ultrasonic wave can reach the first microphone 30 to form the first feedback ultrasonic wave. The first microphone 30 can be used to receive the first feedback ultrasonic wave, and the first feedback ultrasonic wave includes at least a part of the detection ultrasonic wave. The specific frequency of the detection ultrasonic wave can be determined as needed to ensure the required detection accuracy. In some embodiments, the frequency of the detection signal can be 22000 Hz. In some embodiments, the first microphone 30 can be an ultrasonic microphone, and the pickup frequency band of the first microphone 30 matches the frequency of the detection ultrasonic wave to reduce the interference of ambient sound.

[0042] In the embodiment of the present invention, the time difference between the time when the first microphone 30 receives the first feedback ultrasonic wave and the time when the first speaker 20 emits the detection ultrasonic wave is defined as the first time difference. Since the propagation speed of ultrasonic waves in the air is relatively constant, the distance between the object and the temple 12 can be determined according to the first time difference. Figure 3 The dashed arrow in is a part of the detection ultrasonic wave that is reflected by the user's head A and propagates to the first microphone 30. Refer to Figure 3 , when the user wears the smart glasses, at least a part of the detection ultrasonic wave emitted by the first speaker 20 is reflected by the user's head A, and the part of the detection ultrasonic wave is reflected by the user's head A and then propagates to the first microphone 30. Therefore, when the user wears the smart glasses correctly, there is a relatively definite distance range between the user's head A and the first microphone 30 and the first speaker 20 on the temple 12. This distance range corresponds to the first time difference that at least a part of the detection ultrasonic wave emitted by the first speaker 20 is reflected by the user's head A and then propagates to the first microphone 30 within the first time range. Thus, by comparing the first time difference with the first time range, it is possible to detect whether the smart glasses are worn.

[0043] In some embodiments, refer to Figure 1 and Figure 3 , the first speaker 20 includes two, and the first microphone 30 includes two. One first speaker 20 and one first microphone 30 are respectively provided on each temple 12. Refer to Figure 3When the smart glasses are in a worn state, the distances between the two temple arms 12 and the user's head A are both within a certain range. Due to the obstruction of the user's head A, the first speaker 20 on each temple arm 12 can receive the first feedback ultrasonic wave formed by the reflection of the detection ultrasonic wave emitted by the first microphone 30 on the same temple arm 12 via the user's head A. Thus, according to the time difference (the first time difference) between the time when the first microphone 30 on the two temple arms 12 receives the first feedback ultrasonic wave and the time when the first speaker 20 emits the detection ultrasonic wave, the distance between each temple arm 12 and an object can be determined, so as to more accurately determine the wearing state of the smart glasses. The first speakers 20 on the two temple arms 12 can emit ultrasonic waves simultaneously; or, the first speakers 20 on the two temple arms 12 are configured to alternately emit ultrasonic waves at a predetermined time interval. The frequencies of the ultrasonic waves emitted by the first speakers 20 on the two temple arms 12 can be the same, or different frequency bands of ultrasonic waves can be respectively used.

[0044] Referring to Figure 4 and Figure 5 The smart glasses include a control circuit 50. The control circuit 50 is electrically connected to the first speaker 20 and the first microphone 30 respectively to achieve signal transmission. The control circuit 50 may include a processor for controlling the overall operation of the smart glasses, and may include one or more processing units. For example, the processor may include at least one of a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a video processing unit (VPU), a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated in one or more processors. The controller can generate operation control signals according to the instruction operation code and the timing signal to complete the control of obtaining instructions and executing instructions. A memory may also be provided in the processor for storing instructions and data. The processor executes various functional applications and data processing of the smart glasses by running the instructions stored in the memory. In some embodiments, the memory is a cache memory.

[0045] The control circuit 50 determines a first time difference based on the time when the first microphone 30 receives the first feedback ultrasonic wave and the time when the first speaker 20 emits the detection ultrasonic wave, and determines the wearing state of the smart glasses based on at least the first time difference. The wearing state of the smart glasses includes a worn state and an unworn state. In some embodiments, when the first time difference is within a first time range and the continuous time exceeds a preset time, the control circuit 50 may determine the wearing state of the smart glasses as the worn state. The control circuit 50 may control the working state of the smart glasses according to the determined wearing state of the smart glasses.

[0046] In this embodiment, the working state of the smart glasses may include a first state and a second state. After the smart glasses are powered on, they can enter the first state to work, and determine the wearing state of the smart glasses by means of the first speaker 20 emitting the detection ultrasonic wave and the microphone receiving the ultrasonic wave. The first speaker 20 may be configured to emit the detection ultrasonic wave at a predetermined period when the smart glasses are in the first state, and the predetermined period may be appropriately selected according to the needs of the time application scenario, for example, it may be 1 second, 2 seconds, etc. When it is determined that the wearing state of the smart glasses is the worn state, the control circuit 50 controls the smart glasses to remain in the first state; when it is determined that the wearing state of the smart glasses is the unworn state, the control circuit 50 controls the smart glasses to be in the second state. Among them, the power consumption of the smart glasses in the second state is lower than that in the first state. For example, in the second state, at least a part of the functional modules of the smart glasses may be in a power-off state or a sleep state. That is, when the smart glasses are not worn, the control circuit 50 reduces the overall power consumption of the smart glasses by controlling at least a part of the functional modules to enter the power-off state or the sleep state, or by controlling the smart glasses to shut down.

[0047] In the embodiment of the present invention, such as Figures 1-5As shown, the microphone of the smart glasses further includes at least one second microphone 40. The second microphone 40 is disposed on the frame 11 and is used to receive the second feedback ultrasonic wave, and the second feedback ultrasonic wave includes at least part of the detected ultrasonic wave. The first speaker 20 is arranged such that when the temple 12 is unfolded, the propagation direction of the detected ultrasonic wave at least partially points to the position where the second microphone 40 is located. When the user does not wear the smart glasses, there is no obstacle or a small obstacle between the first speaker 20 and the second microphone 40, and the amplitude of the second feedback ultrasonic wave detected by the second microphone 40 is relatively large; when the user wears the smart glasses, the user's head A will block part of the detected ultrasonic wave, so that only part of the detected ultrasonic wave propagates to the second microphone 40, resulting in a relatively small amplitude of the detected second feedback ultrasonic wave. The unit of this amplitude value can be decibel (dB). That is, when the smart glasses are in the worn state, the amplitude of the second feedback ultrasonic wave detected by the second microphone 40 is attenuated relative to the amplitude of the detected ultrasonic wave in the non-worn state. Thus, the amplitude of the second feedback ultrasonic wave can reflect the wearing state of the smart glasses to a certain extent, and the control circuit 50 can determine the wearing state of the smart glasses according to the amplitude of the second feedback ultrasonic wave.

[0048] Furthermore, the control circuit 50 can combine the first time difference and the amplitude of the second feedback ultrasonic wave to determine the wearing state of the smart glasses. When the temple 12 is folded, etc., the distance between the temple 12 and an object such as the frame may be close to the distance from the user's head A in the worn state, resulting in the determined first time difference may be within the first time range. Therefore, relying solely on the first time difference to judge the wearing state may result in misjudgment. However, since when the temple 12 is folded, the distance between the first speaker 20 and the second microphone 40 is shortened, resulting in the amplitude of the second feedback ultrasonic wave at this time being greater than the amplitude of the second feedback ultrasonic wave when the temple 12 is unfolded. Therefore, the amplitude of the second feedback ultrasonic wave can be combined to determine the wearing state of the smart glasses, which can improve the accuracy of the judgment result of the wearing state of the smart glasses. In some embodiments, when the first time difference exceeds the first time range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, it indicates that there is a high probability that the user has removed the smart glasses. At this time, the wearing state of the smart glasses can be determined as the non-worn state; when the first time difference is within the first time range and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, the wearing state of the smart glasses is determined as the worn state. Among them, the maximum value of the first amplitude range is less than the amplitude of the detected ultrasonic wave emitted by the first speaker 20. The specific values of the first time range and the first amplitude range can be determined according to the results of wearing tests or simulation tests. For example, the first amplitude range can be 10 dB - 40 dB, etc.

[0049] In some embodiments, the first microphone 30 is disposed between the first speaker 20 and the first connection structure 13, and the second microphone 40 is disposed between the two first connection structures 13. On the propagation path of the detection ultrasonic wave emitted by the first speaker 20, the distance between the second microphone 40 and the first speaker 20 is farther than the distance between the first microphone 30 and the first speaker 20. And the position where the second microphone 40 is disposed ensures that when the user wears the smart glasses, the detection ultrasonic wave will be blocked by the user's head A when propagating between the first speaker 20 and the second microphone 40. In one embodiment, the frame 11 includes a nose bridge 111, and the second microphone 40 can be disposed at the nose bridge 111.

[0050] The control circuit 50 also determines the wearing state of the smart glasses according to the fluctuation state of the first time difference within a certain period of time. Since the smart glasses may shake when the user wears them for daily activities or sports, the first time difference may exceed the first duration range in certain periods of detection. In order to eliminate the interference of the shaking of the smart glasses when they are worn to the accuracy of the determination result of the wearing state of the smart glasses as much as possible, in some embodiments, when the first time difference exceeds the first duration range, the control circuit 50 can also determine the wearing state of the smart glasses in combination with the fluctuation state of the first time difference. When the first time difference exceeds the first duration range, the control circuit 50 determines the fluctuation state of the first time difference based on multiple first time differences before the current time, and the fluctuation state includes the fluctuation amplitude and the duration of the fluctuation. When the fluctuation amplitude of the first time difference is greater than or equal to the first amplitude threshold and the duration of the fluctuation is greater than the preset fluctuation duration threshold, it indicates that the smart glasses are more likely to be taken off from the head A by the user, and the control circuit 50 can determine the wearing state of the smart glasses as the unworn state. Among them, the first amplitude threshold is greater than the difference between the maximum value and the minimum value of the first duration range. When the fluctuation amplitude of the first time difference is less than the first amplitude threshold, and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, the fluctuation of the first time difference may be caused by the shaking of the smart glasses caused by the normal activities of the user when wearing the smart glasses. In this case, the control circuit 50 can determine the wearing state of the smart glasses as the worn state. The first amplitude threshold and the fluctuation duration threshold can be determined in advance by experiments or simulations. For example, the specific values ​​of the first amplitude threshold and the fluctuation duration threshold can be determined by recording the changes in the first time difference during the process of the user taking off the glasses.

[0051] In some embodiments, a wearing detection neural network model may also be preset in the control circuit 50. The wearing detection neural network model is trained by a plurality of sample data marked with the true wearing state, including the first time difference and the amplitude of the second feedback ultrasonic wave. The sample data can be obtained by collecting the first time difference and the amplitude of the second feedback ultrasonic wave in the states where the smart glasses are not worn and worn during the test. When it is determined that the wearing state of the smart glasses is the non-wearing state, the first time difference and / or the amplitude of the second feedback ultrasonic wave within a preset time period before the current time are input into the wearing detection neural network model to obtain the non-wearing probability. When the non-wearing probability is greater than a preset probability threshold (for example, 90%, 95%, 98%, etc.), the control circuit 50 controls the smart glasses to shut down.

[0052] In some embodiments, referring to Figure 2 and Figure 5 , the microphone of the smart glasses may further include at least one third microphone 60. The pickup frequency band of the third microphone 60 may be the audible frequency band of the human ear to meet the needs of functions such as recording and voice interaction of the smart glasses.

[0053] In some embodiments, the speaker of the smart glasses may further include at least one second speaker. The second speaker is used to play sound waves in the audible frequency band of the human ear. Thus, the smart glasses can meet the user's needs to listen to music, make calls, etc. while detecting the wearing state of the smart glasses without the user's awareness.

[0054] The embodiment of the present invention also provides a wearing detection method for smart glasses. The wearing detection method can be applied to the smart glasses described in at least some of the above embodiments. Figure 6 is a schematic flowchart of the wearing detection method according to an embodiment of the present invention. In one embodiment, referring to Figure 6 , the wearing detection method includes the following steps S100 to step S160:

[0055] Step S100, the smart glasses are powered on.

[0056] In some embodiments, when the smart glasses receive a preset power-on input (for example, pressing the power-on button) operated by the user, in response to this input, the smart glasses are powered on. After the smart glasses are started, the subsequent step S110 can be executed to start the detection of the wearing state.

[0057] The working states of the smart glasses may include a first state and a second state, where the power consumption of the smart glasses in the second state is lower than that in the first state. For example, in the second state, at least some of the functional modules of the smart glasses may be in a powered-off state or a sleep state, or the second state is a shutdown state. In some embodiments, after the smart glasses are powered on, they may enter the first state. It should be understood that in this embodiment, powering on the smart glasses may be starting from the shutdown state, or may refer to entering the first state from the sleep state or a relatively low power consumption state.

[0058] Step S110: Transmit detection ultrasonic waves through the first speaker.

[0059] The first speaker 20 of the smart glasses can transmit detection ultrasonic waves. Among them, referring to the above-mentioned smart glasses embodiment, the smart glasses include a glasses body 10, the glasses body 10 includes a frame 11 and two temple arms 12, and the first speaker 20 is provided on at least one temple arm 12. The detection ultrasonic waves have a predetermined frequency. In this embodiment, the frequency of the detection ultrasonic waves can be 22000 Hz. Optionally, the first speaker 20 can be configured to transmit detection ultrasonic waves at a predetermined period when the smart glasses are in the first state, and the predetermined period can be appropriately selected according to the needs of the time application scenario, such as 1 second, 2 seconds, etc.

[0060] Step S120: Receive the first feedback ultrasonic waves through the first microphone.

[0061] When the first speaker 20 transmits detection ultrasonic waves, the sound waves in the surrounding environment can be received through the microphone, and the surrounding sound waves include the detection ultrasonic waves transmitted by the first speaker 20. The first microphone 30 is provided on the temple arm 12 and is located on one side of the first speaker 20, so that when the user wears the smart glasses, at least a part of the detection ultrasonic waves can be reflected by the user's head A to form the first feedback ultrasonic waves near the first speaker 20. The first microphone 30 is used to pick up the first feedback ultrasonic waves. In some embodiments, the first microphone 30 may be an ultrasonic microphone, and the pickup frequency band of the first microphone 30 matches the frequency of the detection ultrasonic waves to reduce the interference of ambient sounds.

[0062] Step S130: Receive the second feedback ultrasonic waves through the second microphone.

[0063] The second feedback ultrasonic wave includes at least a part of the detected ultrasonic wave. The second microphone 40 is disposed on the spectacle frame 11, and the position of the second microphone 40 is set such that when the user wears the smart glasses, at least a part of the detected ultrasonic wave can be blocked by the user's head A, so that the amplitude of the second feedback ultrasonic wave detected by the second microphone 40 is attenuated relative to the amplitude of the detected ultrasonic wave when the smart glasses are not worn by the user. In some embodiments, the second microphone 40 may be an ultrasonic microphone, and the audio pickup frequency band of the second microphone 40 matches the frequency of the detected ultrasonic wave to reduce the interference of ambient sound.

[0064] Step S140, determine the first time difference.

[0065] After step S120, according to the time when the first microphone 30 receives the first feedback ultrasonic wave and the time when the first speaker 20 emits the detected ultrasonic wave, determine the first time difference. The first time difference may be the difference between the time when the first microphone 30 receives the first feedback ultrasonic wave and the time when the first speaker 20 emits the detected ultrasonic wave, that is, the duration for the part of the detected ultrasonic wave that propagates to the first speaker 20 to reach the first microphone 30 from the first speaker 20.

[0066] Step S150, determine the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave.

[0067] The wearing state of the smart glasses includes the worn state and the unworn state. The control circuit 50 determines the wearing state of the smart glasses separately according to the first time difference or the amplitude of the second feedback ultrasonic wave, or may combine the first time difference and the amplitude of the second feedback ultrasonic wave to determine the wearing state of the smart glasses.

[0068] When the user wears the smart glasses, at least a part of the detected ultrasonic wave emitted by the first speaker 20 is reflected by the user's head A, and the part of the detected ultrasonic wave is reflected by the user's head A and then propagates to the first microphone 30. Therefore, when the user wears the smart glasses correctly, there is a relatively definite distance range between the user's head A and the first microphone 30 and the first speaker 20 on the temple 12. This distance range corresponds to the first time difference for at least a part of the detected ultrasonic wave emitted by the first speaker 20 to be reflected by the user's head A and then propagate to the first microphone 30 within the first time range. Thus, by comparing the first time difference with the first time range, the wearing state of the smart glasses can be determined. And in the worn state, the amplitude of the second feedback ultrasonic wave detected by the second microphone 40 is attenuated relative to the amplitude of the detected ultrasonic wave in the unworn state. Thus, the amplitude of the second feedback ultrasonic wave can reflect the wearing state of the smart glasses to a certain extent, so the wearing state of the smart glasses can be determined according to the amplitude of the second feedback ultrasonic wave.

[0069] In one embodiment, with reference to Figure 7 , determining the wearing state of the smart glasses may include steps S210 to S260 as follows. Among them, in step S200 in the figure, the acquisition of the first time difference and the amplitude of the second feedback ultrasonic wave may be obtained through the above steps S110 to S140, that is, step S200 may include the above steps S110 - S140.

[0070] Step S210, determine whether the first time difference is within the first time range.

[0071] In step S210, when the judgment result is "yes", execute step S220. When the judgment result is "no", execute step S230.

[0072] It should be understood that in the case where the first speaker 20 and the first microphone 30 are respectively provided on each temple 12 in the above smart glasses embodiment, when the first speaker 20 and the first microphone 30 are respectively provided on both temples 12, the first time difference determined by comprehensively considering the time when the corresponding first microphones 30 on the two temples 12 receive the first feedback ultrasonic wave and the time when the first speaker 20 emits the detection ultrasonic wave can be used to determine the working state of the smart glasses. According to actual needs, during the process of the control circuit 50 judging whether the first time difference meets a certain condition, when the first time difference corresponding to the first microphone 30 on any one temple 12 meets the predetermined condition, the above judgment result can be determined as "yes"; or when the first time differences corresponding to the first microphones 30 on the two temples 12 both meet the predetermined condition accordingly, the above judgment result can be determined as "yes". For example, when the positions of the first speaker 20 and the first microphone 30 on one temple 12 are symmetrical to those of the first speaker 20 and the first microphone 30 on the other temple 12, and the frequencies of the detection ultrasonic waves emitted by the first speakers 20 on the two temples 12 are the same, in step S210, when the first time differences corresponding to the first microphones 30 on the two temples 12 are both within the first time range, the judgment result of step S210 can be output as "yes"; and when the first time difference corresponding to the first microphone 30 on any one temple 12 exceeds the first time range, the judgment result of step S210 can be output as "no".

[0073] Step S220, determine whether the duration for which the first time difference is within the first time range is greater than the preset duration.

[0074] In step S220, when the judgment result is "yes", step S240 is executed to determine the wearing state of the smart glasses as the worn state. That is, when the first time difference is within the first time range and the continuous duration exceeds the preset duration, it indicates that there is a high possibility that the smart glasses are worn by the user, and the control circuit 50 can determine the wearing state of the smart glasses as the worn state.

[0075] In step S220, when the judgment result is "no", return to step S200 to continue obtaining the first time difference and the amplitude data of the second feedback ultrasonic wave.

[0076] Step S230: Judge whether the amplitude of the second feedback ultrasonic wave is within the first amplitude range.

[0077] In step S230, when the judgment result is "no", execute step S250 to determine the wearing state of the smart glasses as the not-worn state. That is, when the first time difference exceeds the first time range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, it indicates that there is a high possibility that the smart glasses are taken off from the user's head A, and the wearing state of the smart glasses can be determined as the not-worn state.

[0078] In step S230, when the judgment result is "no", it indicates that there is a certain possibility that the smart glasses are still in the worn state. At this time, return to step S200 to continue obtaining the first time difference and the amplitude data of the second feedback ultrasonic wave for further judgment.

[0079] In another embodiment, refer to Figure 8 , when the judgment result of step S210 is "yes", step S220' can be used to replace step S220 in the embodiment described in Figure 8 . In step S220', judge whether the amplitude of the second feedback ultrasonic wave is within the first amplitude range, and when the judgment result is "yes", determine the wearing state of the smart glasses as the worn state. That is, when the first time difference is within the first time range and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, determine the wearing state of the smart glasses as the worn state. When the judgment result of step S220' is "no", return to step S200 to continue obtaining the first time difference and the amplitude data of the second feedback ultrasonic wave for further judgment. Among them, Figure 8 steps S100, S200, S210, S230, S240 and S250 in Figure 7 can be the same as those in the embodiment described above in

[0080] It is easy to understand that when it is necessary to determine the wearing state of the smart glasses based on two data, namely the first time difference and the amplitude of the second feedback ultrasonic wave, the order of judgment on whether the first time difference meets the predetermined condition and whether the amplitude of the second feedback ultrasonic wave meets the predetermined condition can be swapped. For example, referring to Figure 9 , in one embodiment, step S210' is performed first to determine whether the amplitude of the second feedback ultrasonic wave is within the first amplitude range; then step S220" or step S230' is executed to determine whether the first time difference is within the first time range. When the results of both judgments are "yes" (i.e., the first time difference is within the first time range and the amplitude of the second feedback ultrasonic wave is within the first amplitude range), the wearing state of the smart glasses is determined to be the worn state; when the results of both judgments are "no" (i.e., the first time difference exceeds the first time range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range), the wearing state of the smart glasses is determined to be the non-worn state. That is, compared with the embodiment described above with reference to Figure 8 , the order of the two steps of judging "whether the amplitude of the second feedback ultrasonic wave is within the first amplitude range" and judging "whether the first time difference is within the first time range" is swapped.

[0081] Figure 10 is a schematic flowchart of a wearing detection method according to another embodiment of the present invention. Steps S100, S200, S210, S210, S230, S240, and S250 in the figure can be the same as those in the embodiment described above with reference to Figure 7 .

[0082] Referring to Figure 10 , in one embodiment, when the judgment result of step S210 is "no", step S211 is executed. In step S211, the fluctuation state of the first time difference is determined, where the fluctuation state includes the fluctuation amplitude and the fluctuation duration. That is, when the first time difference exceeds the first time range, the fluctuation state of the first time difference is determined based on multiple first time differences before the current time.

[0083] After step S211, step S212 is executed to determine whether the fluctuation amplitude of the first time difference is greater than or equal to a preset first amplitude threshold. The first amplitude threshold is greater than the difference between the maximum value and the minimum value of the first duration range. For example, if the first duration range is [t1, t2], then the first amplitude threshold t3 > (t2 - t1). When the judgment result of step S212 is "yes", step S213 is executed. When the judgment result of step S213 is "no", step S230 is executed. That is, when the fluctuation amplitude of the first time difference is small, the fluctuation may be caused by the shaking of the smart glasses due to the user's movement, and the wearing state of the smart glasses can be determined by combining the amplitude of the second feedback ultrasonic wave. When the fluctuation amplitude of the first time difference is less than the first amplitude threshold and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, the wearing state of the smart glasses can be determined as the worn state.

[0084] In step S213, it is determined whether the fluctuation duration of the first time difference greater than the first amplitude threshold is greater than a preset fluctuation duration threshold. When the fluctuation duration is greater than the preset fluctuation duration threshold, step S250 is executed, and the wearing state of the smart glasses can be determined as the not worn state. That is, when the first time difference fluctuates with a large amplitude (greater than or equal to the first amplitude threshold) for a certain period of time (greater than the preset fluctuation duration threshold), it indicates that the smart glasses may have been removed from the user's head A, and at this time, the wearing state of the smart glasses can be determined as the not worn state.

[0085] Step S160: Control the working state of the smart glasses according to the wearing state of the smart glasses.

[0086] In some embodiments, when it is determined that the wearing state of the smart glasses is the worn state, the smart glasses are controlled to be in the first state; when it is determined that the wearing state of the smart glasses is the not worn state, the smart glasses are controlled to be in the second state. Thus, when the user does not wear the smart glasses, the power consumption of the smart glasses can be reduced to save electric energy.

[0087] In some embodiments, a wearing detection neural network model can also be pre - set in the smart glasses. The wearing detection neural network model is trained by multiple sample data marked with the true wearing state and including the first time difference and the amplitude of the second feedback ultrasonic wave. The sample data can be obtained by collecting the first time difference and the amplitude of the second feedback ultrasonic wave in the non - worn and worn states of the smart glasses during the test. When it is determined that the wearing state of the smart glasses is the not worn state, the first time difference and / or the amplitude of the second feedback ultrasonic wave within a preset duration before the current time are input into the wearing detection neural network model to obtain the non - wearing probability. When the non - wearing probability is greater than a preset probability threshold (such as 90%, 95%, 98%, etc.), the control circuit 50 controls the smart glasses to shut down.

[0088] In an embodiment of the present invention, by providing a first speaker 20 and a first microphone 30 on the temple 12, and a second microphone 40 on the spectacle frame 11, the first speaker 20 emits detection ultrasonic waves. When the user wears the smart glasses, the user's head A is located on the propagation path of the detection ultrasonic waves. Thus, according to the time difference between the time when the first microphone 30 receives the first feedback ultrasonic wave and the time when the first speaker 20 emits the detection ultrasonic wave, and according to the amplitude of the second feedback ultrasonic wave received by the second microphone 40, the wearing state of the smart glasses can be determined, and further, the working state of the smart glasses can be controlled according to the wearing state of the smart glasses. The smart glasses provided by the embodiment of the present invention can more intelligently and automatically adapt to the scene to more precisely control the working mode of the smart glasses, and reduce the power consumption of the smart glasses.

[0089] Those skilled in the art should understand that the embodiments of the present application can be provided as a method, a device (equipment), or a computer program product. Therefore, the present application can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can be implemented as a computer program product on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0090] The present application is described with reference to the flowcharts of methods, devices (equipment), and computer program products according to the embodiments of the present application. It should be understood that each process in the flowchart can be implemented by computer program instructions.

[0091] These computer program instructions can be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, and the instruction device implements the process Figure 1 specified functions in one or more of these processes. These computer program instructions can also be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing devices produce a device for implementing the Figure 1 specified functions in one or more of these processes.

[0092] Another embodiment of the present invention relates to a non-volatile storage medium for storing a computer-readable program, and the computer-readable program is used for a computer to execute the above-mentioned partial or all method embodiments.

[0093] That is, those skilled in the art can understand that all or part of the steps in the methods of the above embodiments can be completed by instructing relevant hardware through a program. The program is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application. The foregoing storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical discs.

[0094] The foregoing are only the preferred embodiments of the present application and are not intended to limit the present application. For those skilled in the art, various modifications and changes can be made to the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the protection scope of the present application.

Claims

1. A smart glasses, characterized in that: include: The main body of the glasses includes a frame and two temples; A first speaker, disposed on the temple, the first speaker being configured to emit a detection ultrasonic wave; a first microphone, disposed on the temple and located on one side of the first speaker, the first microphone being configured to receive a first feedback ultrasonic wave, the first feedback ultrasonic wave including at least a portion of the detection ultrasonic wave; a second microphone, disposed on the mirror frame, the second microphone being configured to receive a second feedback ultrasonic wave, the second feedback ultrasonic wave including at least a portion of the detection ultrasonic wave; as well as a control circuit, electrically connected to the first speaker, the first microphone and the second microphone, wherein the control circuit is configured as follows: Determine a first time difference, where the first time difference is a time difference between a time when the first microphone receives the first feedback ultrasonic wave and a time when the first speaker emits the detection ultrasonic wave; determining a wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave, where the wearing state of the smart glasses includes a worn state and a not worn state; and The working state of the smart glasses is controlled according to the wearing state of the smart glasses.

2. The smart glasses according to claim 1, characterized in that: The first speakers include two, the first microphones include two, and each temple is provided with one of the first speakers and one of the first microphones; The first speakers on the two temples are configured to emit ultrasonic waves simultaneously; Alternatively, the first speakers on the two temples are configured to emit ultrasonic waves alternately at predetermined time intervals.

3. The smart glasses according to claim 2, characterized in that: Each of the temples is connected to the frame via a first connecting structure, the first microphone is arranged between the first speaker and the first connecting structure, and the second microphone is arranged between two of the first connecting structures.

4. The smart glasses according to claim 1, characterized in that: The working state of the smart glasses includes a first state and a second state, and the power consumption of the smart glasses in the second state is lower than that in the first state; Controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: When it is determined that the wearing state of the smart glasses is the worn state, controlling the smart glasses to be in a first state; When it is determined that the wearing state of the smart glasses is the unworn state, the smart glasses are controlled to be in a second state.

5. The smart glasses according to claim 1, characterized in that: Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: When the first time difference exceeds the first time length range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the not-wearing state; and When the first time difference is within a first time length range and the amplitude of the second feedback ultrasonic wave is within a first amplitude range, the wearing state of the smart glasses is determined as the worn state.

6. The smart glasses according to claim 1, characterized in that: Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: When the first time difference exceeds the first time length range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the not-wearing state; and When the first time difference is within a first time range and lasts for longer than a preset time, the wearing state of the smart glasses is determined as the worn state.

7. The smart glasses according to claim 5 or 6, characterized in that: The control circuit is further configured to: When the first time difference exceeds the first duration range, determining a fluctuation state of the first time difference, wherein the fluctuation state includes a fluctuation amplitude and a fluctuation duration; Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave further includes: When the fluctuation amplitude of the first time difference is greater than or equal to a first amplitude threshold and the fluctuation duration is greater than a preset fluctuation duration threshold, the wearing state of the smart glasses is determined as the not-wearing state, wherein the first amplitude threshold is greater than the difference between the maximum value and the minimum value of the first duration range.

8. The smart glasses according to claim 7, characterized in that: Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave further includes: When the fluctuation amplitude of the first time difference is smaller than the first amplitude threshold and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, the wearing state of the smart glasses is determined as the worn state.

9. The smart glasses according to claim 1, characterized in that: Controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: When it is determined that the wearing state of the smart glasses is not worn, the first time difference and / or the amplitude of the second feedback ultrasonic wave within a predetermined time length are input into a wearing detection neural network model to obtain a not worn probability, wherein the wearing detection neural network model is trained by a plurality of sample data including the first time difference and the amplitude of the second feedback ultrasonic wave marked with a real wearing state; and When the non-wearing probability is greater than a preset probability threshold, the smart glasses are controlled to shut down.

10. A wearing detection method for smart glasses, wherein the smart glasses include a glasses body, wherein the glasses body includes a frame and two temples, wherein: The method comprises: The first speaker emits a detection ultrasonic wave, and the first speaker is arranged on the temple; receiving a first feedback ultrasonic wave through a first microphone, wherein the first feedback ultrasonic wave includes at least a portion of the detection ultrasonic wave, and the first microphone is disposed on the temple; receiving a second feedback ultrasonic wave through a second microphone, wherein the second feedback ultrasonic wave includes at least a portion of the detection ultrasonic wave, and the second microphone is disposed on the mirror frame; Determine a first time difference, where the first time difference is a time difference between a time when the first microphone receives the first feedback ultrasonic wave and a time when the first speaker emits the detection ultrasonic wave; determining a wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave, where the wearing state of the smart glasses includes a worn state and a not worn state; and The working state of the smart glasses is controlled according to the wearing state of the smart glasses.

11. The method according to claim 10, characterized in that The working state of the smart glasses includes a first state and a second state, and the power consumption of the smart glasses in the second state is lower than that in the first state; Controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: When it is determined that the wearing state of the smart glasses is the worn state, controlling the smart glasses to be in a first state; as well as When it is determined that the wearing state of the smart glasses is the unworn state, the smart glasses are controlled to be in a second state.

12. The method according to claim 10, characterized in that Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: When the first time difference exceeds the first time length range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the not-wearing state; and When the first time difference is within a first time length range and the amplitude of the second feedback ultrasonic wave is within a first amplitude range, the wearing state of the smart glasses is determined as the worn state.

13. The method according to claim 10, characterized in that Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave includes: When the first time difference exceeds the first time length range and the amplitude of the second feedback ultrasonic wave exceeds the first amplitude range, determining the wearing state of the smart glasses as the not-wearing state; and When the first time difference is within a first time range and lasts for longer than a preset time, the wearing state of the smart glasses is determined as the worn state.

14. The method according to claim 12 or 13, characterized in that The method further comprises: When the first time difference exceeds the first duration range, determining a fluctuation state of the first time difference, wherein the fluctuation state includes a fluctuation amplitude and a fluctuation duration; Determining the wearing state of the smart glasses according to the first time difference and / or the amplitude of the second feedback ultrasonic wave further includes: When the fluctuation amplitude of the first time difference is greater than or equal to a first amplitude threshold and the fluctuation duration is greater than a preset fluctuation duration threshold, determining the wearing state of the smart glasses as the not-wearing state, wherein the first amplitude threshold is greater than the difference between the maximum value and the minimum value of the first duration range; and When the fluctuation amplitude of the first time difference is smaller than the first amplitude threshold and the amplitude of the second feedback ultrasonic wave is within the first amplitude range, the wearing state of the smart glasses is determined as the worn state.

15. The method according to claim 10, characterized in that Controlling the working state of the smart glasses according to the wearing state of the smart glasses includes: When it is determined that the wearing state of the smart glasses is not worn, the first time difference and / or the amplitude of the second feedback ultrasonic wave within a predetermined time length are input into a wearing detection neural network model to obtain a not worn probability, wherein the wearing detection neural network model is trained by a plurality of sample data including the first time difference and the amplitude of the second feedback ultrasonic wave marked with a real wearing state; and When the non-wearing probability is greater than a preset probability threshold, the smart glasses are controlled to shut down.

16. A computer-readable storage medium storing computer program instructions, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 10 to 15 is implemented.

17. A computer program product comprising instructions, characterized in that When the instructions are executed on the smart glasses, the smart glasses are caused to execute the method as claimed in any one of claims 10 to 15.

Images