Intelligent glasses control method and device, intelligent glasses and computer storage medium

Abstract

The invention provides an intelligent glasses control method and device, intelligent glasses and a computer readable storage medium. The intelligent glasses control method comprises the following steps: acquiring a proximity measurement signal representing the proximity degree between the intelligent glasses and an obstacle; acquiring motion data of the intelligent glasses; judging whether screen-on conditions are met at the same time, and if yes, opening a screen of the intelligent glasses, the screen-on conditions comprising: determining that the intelligent glasses are in an approaching state based on the approaching measurement signal; and based on the motion data, determining that the intelligent glasses are not in a standing state or an inverted state.

Description

Technical Field

[0001] The present disclosure relates to the field of head-mounted device control technology, and in particular to a smart glasses control method, device, smart glasses and computer storage medium. Background Art

[0002] There is a risk of screen burn-in when the display screen of smart glasses is working for a long time. It is necessary to control the screen of the smart glasses to be turned on only when it is confirmed that the user is using the smart glasses.

[0003] In the related solutions, a single sensor is used to determine the usage status of the smart glasses to control the screen of the smart glasses to turn on. However, the use of a single sensor solution may misjudge the usage status of the smart glasses, causing the screen of the smart glasses to be mistakenly turned on when the user does not need to use the smart glasses, increasing the working time of the display screen and increasing the risk of screen burn-in. In addition, there are also solutions in the related solutions that combine multiple sensors to determine the usage status of the smart glasses. However, in these solutions, it is often necessary to set a camera on the smart glasses to detect the user's face or eyes. The setting of the camera leads to a high cost of the smart glasses. Summary of the invention

[0004] In view of this, the present disclosure provides a smart glasses control method, device, smart glasses and computer storage medium.

[0005] In a first aspect, the present disclosure provides a method for controlling smart glasses, the method comprising: obtaining a proximity measurement signal characterizing the degree of proximity between the smart glasses and an obstacle; obtaining motion data of the smart glasses; determining whether screen-on conditions are simultaneously met, and if so, turning on the screen of the smart glasses; the screen-on conditions comprising: determining, based on the proximity measurement signal, that the smart glasses are in a proximity state; and, based on the motion data, determining that the smart glasses are not in a static state and are not in an inverted state.

[0006] In a second aspect, the present disclosure provides a smart glasses control device, which includes a proximity signal acquisition unit, a motion data acquisition unit and a control unit; the proximity signal acquisition unit is used to acquire a proximity measurement signal representing the proximity between the smart glasses and the obstacle; the motion data acquisition unit is used to acquire the motion data of the smart glasses. The control unit is used to determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses; wherein the screen-on conditions include: determining that the smart glasses are in a proximity state based on the proximity measurement signal; and, determining that the smart glasses are not in a static state and not in an inverted state based on the motion data.

[0007] In a third aspect, the present disclosure provides a pair of smart glasses, which include a display screen, a proximity sensor, a motion detection element, a memory and a processor; the display screen is used to display image data; the proximity sensor is used to collect a proximity measurement signal characterizing the degree of proximity between the smart glasses and an obstacle; the motion detection element is used to collect motion data of the smart glasses; the memory is used to store a computer program; and the processor is used to implement the smart glasses control method provided in the first aspect when executing the computer program.

[0008] In a fourth aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon; when the program is executed by a processor, the smart glasses control method provided in the first aspect is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the present disclosure or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the embodiments of the present disclosure. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0010] Figure 1 A schematic diagram of the structure of smart glasses provided by some embodiments of the present disclosure is shown;

[0011] Figure 2 A schematic diagram of the hardware structure of smart glasses provided by some embodiments of the present disclosure is shown;

[0012] Figure 3 A schematic diagram showing a flow chart of a smart glasses control method provided by some embodiments of the present disclosure;

[0013] Figure 4 a and Figure 4 b respectively shows a comparison schematic diagram of the smart glasses in a horizontally stationary state before and after rotation provided by some embodiments of the present disclosure;

[0014] Figure 5 a and Figure 5 b is a schematic diagram showing a comparison of vectors output by a motion detection element before and after being affected by random disturbances provided by some embodiments of the present disclosure;

[0015] Figure 6 A schematic diagram of the structure of smart glasses provided by some embodiments of the present disclosure is shown;

[0016] Figure 7 A schematic diagram of the hardware structure of smart glasses provided by some embodiments of the present disclosure is shown;

[0017] Figure 8 A schematic diagram showing a flow chart of a smart glasses control method provided by some embodiments of the present disclosure;

[0018] Fig. 9 The arrangement of the Hall sensor assembly in some implementations of the present disclosure is shown;

[0019] Fig.10 A schematic diagram showing the spatial positions of the Hall element and the permanent magnet when the temples of the smart glasses are in an unfolded state in some implementations of the present disclosure is shown;

[0020] Fig.11 A schematic diagram showing the spatial positions of the Hall element and the permanent magnet when the temples of the smart glasses are in a buckled state in some implementations of the present disclosure is shown;

[0021] Fig.12 Another arrangement of the Hall sensor assembly in some implementations of the present disclosure is shown;

[0022] Fig.13 A schematic diagram of the structure of a smart glasses control device provided in some embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in the field based on the embodiments in the present disclosure should fall within the scope of protection of the embodiments of the present disclosure.

[0024] The specific implementation of the embodiment of the present disclosure is further explained below in conjunction with the accompanying drawings of the embodiment of the present disclosure.

[0025] Figure 1 FIG. 1 is a schematic diagram showing the structure of smart glasses provided by some embodiments of the present disclosure. Figure 1 As shown, the smart glasses 10 include a display screen 100 , a proximity sensor 102 and a glasses body 101 .

[0026] Smart glasses may be, for example, smart glasses based on AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), and XR (Extended Reality). The glasses body 101 may, for example, include a frame 1010 and temples 1012, and the frame 1010 is connected to the temples 1012. When the user wears the smart glasses, the frame 1010 is usually located in front of the user's face, and the temples 1012 are usually located on both sides of the user's head. For example, the temples 1012 may be mounted above the ears on both sides of the user. Optionally, the temples 1012 have a shape that matches the contour of the ear so that the smart glasses can be stably worn on the user's head.

[0027] The display screen 100 of the smart glasses 10 can be set on the frame 1010 for displaying image data. When the user wears the smart glasses, the display screen 100 needs to be turned on to present the corresponding display screen to the human eye. When the user takes off the smart glasses (i.e., after use), the display screen 100 needs to be turned off in time to prevent screen burn-in. The proximity sensor 102 of the smart glasses 10 can be set on the side of the glasses body facing the user's face, and is used to collect a proximity measurement signal that characterizes the proximity between the proximity sensor 102 and the obstacle. The proximity measurement signal changes with the change in the proximity between the proximity sensor 102 and the obstacle. Optionally, it can be determined whether the smart glasses are in a state of being worn or taken off based on the change in the proximity measurement signal collected by the proximity sensor 102, thereby triggering the screen to light up or turn off.

[0028] Optionally, the smart glasses 10 may further include a motion detection element 104 for collecting motion data of the smart glasses. Based on the motion data collected by the motion detection element 104, the posture, position, or both of the smart glasses can be represented. The smart glasses with the motion detection element 104 may support 3DoF (Degree of Free) or 6DoF image rendering.

[0029] In an optional implementation, the screen-on condition of the smart glasses 10 can be set accordingly based on the proximity measurement signal to control the smart glasses 10. The control method of the smart glasses 10 includes: obtaining a proximity measurement signal that characterizes the degree of proximity between the smart glasses and the obstacle; determining whether the screen-on condition is met, and if so, turning on the screen of the smart glasses, and the screen-on condition includes: determining that the smart glasses are in a proximity state based on the proximity measurement signal. Optionally, the control method of the smart glasses 10 also includes: turning off the screen of the smart glasses if the screen-off condition is met, and the screen-off condition includes: determining that the smart glasses are in a distance state based on the proximity measurement signal.

[0030] When wearing or using the smart glasses 10, the proximity sensor 102 may be contaminated with oil, causing the proximity measurement signal to no longer change with the actual proximity between the proximity sensor 102 and the obstacle, causing the smart glasses to mistakenly judge that they are being worn, thereby causing the display screen to light up or remain lit, increasing the risk of screen burn-in.

[0031] Figure 2 FIG. 1 is a schematic diagram of the hardware structure of smart glasses provided in some embodiments of the present disclosure. The smart glasses 10 include a display screen 100, a proximity sensor 102, a memory 106, and a processor 108. Optionally, the smart glasses 10 also include a motion detection element 104.

[0032] Among them, the configuration of the display screen 100 is the same as Figure 1 The embodiments shown will not be described in detail here.

[0033] The proximity sensor 102 is used to collect a proximity measurement signal that characterizes the proximity between the smart glasses 10 and the obstacle. The higher the intensity of the proximity measurement signal collected by the proximity sensor 102, the closer the obstacle is to the smart glasses; conversely, it means that the obstacle is farther away from the smart glasses. The proximity threshold can be set according to the distance between the smart glasses 10 and the user's face when they are normally worn. If the signal strength of the collected proximity measurement signal is greater than the proximity threshold, it can usually be determined that the user is wearing the smart glasses. An appropriate distance threshold can also be set to determine that the user has taken off the smart glasses when the signal strength of the collected proximity measurement signal is less than the distance threshold.

[0034] The motion detection element 104 is used to collect motion data of the smart glasses. For example, the motion detection element 104 may include an inertial measurement unit (IMU), a gyroscope, an accelerometer, a gravity sensor, or other sensors for obtaining motion data of the smart glasses. The motion data collected by the motion detection element 104 can characterize the posture, position, or both of the smart glasses. Smart glasses equipped with the motion detection element 104 can support 3DoF (Degree of Free) or 6DoF image rendering methods.

[0035] The memory 106 is used to store computer programs, modules and various data. For example, the memory 106 processor 108 executes various functional applications and data processing of the smart glasses by running the computer programs and modules stored in the memory 106. The processor 108 includes but is not limited to SOC (System on Chip), MCU (Micro Controller Unit), CPU (Central Processing Unit), DSP (Digital Signal Processing), or Application Specific Integrated Circuit (ASIC), or is configured to implement one or more integrated circuits of the embodiments of the present application. The one or more processors included in the smart device can be processors of the same type, such as one or more CPUs; or they can be processors of different types, such as one or more CPUs and one or more ASICs.

[0036] In an optional implementation, the memory 106 and the processor 108 may be disposed on the glasses body so that the smart glasses constitute an integrated device. Alternatively, the memory 106 and the processor 108 are disposed on an intelligent terminal that communicates with the smart glasses body. The intelligent terminal includes but is not limited to: a mobile phone, a tablet computer, an algorithm box, a laptop computer, etc. The smart glasses body and the intelligent terminal constitute a split device. For example, the intelligent terminal can be connected to the temples of the smart glasses via a cable.

[0037] For the smart glasses 20 including the proximity sensor 102 and the motion detection element 104 , the screen-lit condition of the smart glasses 20 may be set accordingly based on the proximity measurement signal and the motion data. Figure 3 The flowchart of the smart glasses control method provided by some embodiments of the present disclosure is shown. Figure 1 and Figure 2 The smart glasses shown are executed. Figure 3 As shown, the smart glasses control method includes:

[0038] S302, obtaining a proximity measurement signal representing the proximity between the smart glasses and the obstacle;

[0039] S304, obtaining motion data of the smart glasses;

[0040] S306: Determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses.

[0041] These steps are described in detail below.

[0042] In S302, a proximity measurement signal between the smart glasses and the obstacle is obtained.

[0043] Specifically, a proximity measurement signal between the smart glasses and the obstacle can be obtained through the proximity sensor 102. The higher the intensity of the proximity measurement signal collected by the proximity sensor 102, the closer the obstacle is to the smart glasses; conversely, the farther the obstacle is from the smart glasses. Based on the proximity measurement signal, it can be determined whether the user is wearing or taking off the smart glasses, that is, whether the smart glasses are in a close state or a far state.

[0044] In S304, motion data of the smart glasses is obtained.

[0045] Specifically, the motion data of the smart glasses is obtained through the motion detection element 104. The motion data can be used to characterize the posture, position, or both of the smart glasses. For example, the motion data may include at least one of the information such as the moving speed, acceleration, angular velocity, moving direction, gravity magnitude, gravity direction, and three-axis posture of the smart glasses. Based on the motion data, it can be determined whether the smart glasses are in a static state or a moving state.

[0046] In 306, it is determined whether the screen-on conditions are met at the same time. If so, the screen of the smart glasses is turned on.

[0047] Among them, the screen lighting conditions include: based on the proximity measurement signal, determining that the smart glasses are in a proximity state; based on the motion data, determining that the smart glasses are not in a static state and are not in an inverted state.

[0048] Each of the above two conditions is a screen-on condition, and for ease of description, they are referred to as the first screen-on condition and the second screen-on condition, respectively. When the processor 108 determines that the first screen-on condition and the second screen-on condition are satisfied at the same time, the screen of the smart glasses is turned on.

[0049] When the processor 108 determines that the smart glasses are in a proximity state based on the proximity measurement signal, it can be considered that the smart glasses are likely to be worn and used by the user. However, in some scenarios, for example, when the temples of the smart glasses are buckled, placed upside down on a table, hung in front of the chest, on the top of the head, or the surface is dirty, although the first screen-on condition is met, the smart glasses are not actually worn and used by the user. In these scenarios, if the screen of the smart glasses is controlled to be turned on only based on the satisfaction of the first screen-on condition, the screen of the smart glasses may be turned on by mistake.

[0050] When the smart glasses are worn by the user, the smart glasses are considered to be upright and usually move with the movement of the user's head, and the movement data of the smart glasses can be collected by the motion detection element 104 in the smart glasses. When the user stops using the smart glasses, for example, takes them off and places them on a table, the smart glasses are usually placed upside down due to the shape of the temples or the connection cables on the temples.

[0051] Therefore, when it is determined based on the motion data of the smart glasses that the smart glasses are not in a static state and not in an inverted state, the smart glasses can be considered to be in a worn state. Therefore, based on the proximity sensing signal to determine that the smart glasses are in a proximity state, combined with the screen-on condition, the screen-on condition of the smart glasses can be more accurately controlled.

[0052] If the first screen-on condition is met, and it is determined based on the motion data that the smart glasses are not in a static state and are not in an inverted state, the screen of the smart glasses is turned on, otherwise the screen of the smart glasses is not turned on, thereby avoiding the screen of the smart glasses from being turned on by mistake in the above scenarios, thereby avoiding an increase in the working time of the display screen, and further reducing the risk of screen burn-in. In addition, in the embodiments of the present disclosure, since the use status of the smart glasses can be determined more accurately by combining the proximity measurement signal and the motion data, there is no need to add additional devices to the smart glasses, and no additional cost is added.

[0053] In a possible implementation of the present disclosure, determining that the smart glasses are not in a static state and are not in an inverted state based on the motion data includes:

[0054] Step A: determining that the smart glasses are not in a static state based on the motion data acquired within a first preset time period;

[0055] Step B: determining that the smart glasses are not in an inverted state based on the motion data acquired within the second preset time period;

[0056] The second preset time length is shorter than the first preset time length.

[0057] The first preset duration and the second preset duration can be determined based on empirical data or the user's usage habits. When the smart glasses are worn by the user, the user may be stationary or have only slight movements for a relatively long period of time, that is, in a stationary state for a long time. However, the user is less likely to be in an inverted state for a relatively long period of time. Therefore, the second preset duration is smaller than the first preset duration. The timing is restarted every time the first preset duration is reached; the timing is also restarted every time the second preset duration is reached. Thus, the motion data within the first preset duration and the second preset duration are continuously detected.

[0058] In addition, the execution of step A and step B are independent of each other and are both based on the results of analyzing the motion data. The processor 108 can execute step A and step B simultaneously. Due to human physiological characteristics and behavioral habits, in most cases, users usually do not stay still all the time. If the smart glasses are worn by the user, within the first preset time, the motion detection element can detect motion data that characterizes the smart glasses in motion, thereby determining that the smart glasses are not in a static state and satisfying the second screen-on condition. If the smart glasses are worn normally by the user, they are usually not in an inverted state for a long time. If it is determined that the smart glasses are not in an inverted state based on the motion data obtained within the second preset time, it is determined that the second screen-on condition is satisfied.

[0059] In a possible implementation, step A includes: if the motion data acquired within a first preset time period is greater than a motion detection threshold, determining that the smart glasses are not in a stationary state.

[0060] Specifically, the processor 108 determines whether the smart glasses are in a stationary state based on a comparison result between the motion data obtained within the first preset time and the motion detection threshold. If the motion data obtained within the first preset time is greater than the motion detection threshold, it can be considered that the smart glasses are not in a stationary state within the first preset time, and the smart glasses are more likely to be used within the first preset time. On the contrary, if the motion data obtained within the first preset time is less than or equal to the motion detection threshold, it can be considered that the smart glasses are in a stationary state within the first preset time, and the smart glasses are less likely to be used within the first preset time. The motion detection threshold can be determined based on empirical data or the user's usage habits, etc., and this embodiment does not limit this.

[0061] In a possible implementation, step B includes:

[0062] Step B11: determining a rotation angle of the smart glasses relative to the horizontal inverted state based on the motion data acquired within a second preset time period;

[0063] Step B12: If the rotation angle is greater than the angle threshold, it is determined that the smart glasses are not in an inverted state.

[0064] The horizontal inverted state is the state when the smart glasses are placed horizontally and inverted. Specifically, the processor 108 determines whether the smart glasses are in an inverted state based on the comparison result of the rotation angle of the smart glasses relative to the horizontal inverted state and the angle threshold. If it is determined based on the motion data obtained within the second preset time period that the rotation angle of the smart glasses relative to the horizontal inverted state is greater than the angle threshold, it can be considered that the smart glasses are not in an inverted state within the second preset time period, and the smart glasses are likely to be used within the second preset time period. On the contrary, if it is determined based on the motion data obtained within the second preset time period that the rotation angle of the smart glasses relative to the horizontal inverted state is less than or equal to the angle threshold, it is considered that the smart glasses are in an inverted state within the second preset time period, and the smart glasses are less likely to be used within the second preset time period.

[0065] For ease of explanation, Figure 4 a and Figure 4 As shown in FIG. 2 , a coordinate system of the smart glasses is established. In the coordinate system, the center of gravity of the smart glasses is taken as the origin, the X-axis is parallel to the length direction of the frame 2010, and the Y-axis is perpendicular to the length direction of the frame 2010. The motion data of the smart glasses when they are in a horizontal inverted state is obtained, and the motion data is used as reference motion data. The motion data of the smart glasses is obtained within a second preset time length, and the rotation angle of the smart glasses relative to the horizontal inverted state can be determined based on the motion data of the smart glasses obtained within the second preset time length and the reference motion data. The processor 108 determines whether the smart glasses are in an inverted state based on the comparison result of the rotation angle and the angle threshold.

[0066] The angle threshold is related to the up-and-down swing angle of the temple relative to the frame. The up-and-down swing angle is the tilt angle of the temple of the smart glasses relative to the horizontal position. Usually, the temple of the smart glasses is substantially vertically arranged with respect to the frame. When the smart glasses are in a horizontal inverted state, the temple of the smart glasses is on the plane defined by the X and Y axes, that is, located in the horizontal plane. However, in order to adapt to the relative height of the ears and eyes of different users, the temple 1012 of the smart glasses has a variety of angles relative to the frame 1010, so that when the smart glasses are in a horizontal inverted state, the temple 1012 of the smart glasses has a certain angle with the horizontal plane.

[0067] For example, in one possible implementation, the temples of the smart glasses have three angle settings relative to the frame, where the second position is the middle position, corresponding to the horizontal state of the temples of the smart glasses, and the first and third positions are two small angle tilt states symmetrical about the horizontal position. The angles of the first and third positions relative to the second position (horizontal position) are +θ and -θ, respectively. Due to the existence of this angle, an erroneous judgment of the inverted state of the smart glasses may be made. For this reason, the up-and-down swing angle is taken into account when setting the angle threshold. For example, setting the angle threshold to be greater than the up-and-down swing angle can improve the accuracy of the judgment of the inverted state of the smart glasses.

[0068] In a possible implementation of the present disclosure, step B11 includes: obtaining a current gravity vector of the smart glasses; calculating a spatial angle between the current gravity vector and a reference gravity vector as a rotation angle. The reference gravity vector is a gravity vector obtained when the smart glasses are in a horizontal inverted state.

[0069] Also refer to Figure 4 a and Figure 4 b. When the smart glasses are horizontally inverted, the gravity vector is detected by the motion detection element 104, etc., and the gravity vector is saved as a reference gravity vector. When the angle of the smart glasses changes (such as turning clockwise), the gravity of the smart glasses generates the current gravity vector The current gravity vector can be detected by the motion detection element 104 With reference gravity vector The spatial angle between them is used as the rotation angle of the smart glasses relative to the horizontal inverted state.

[0070] It should be understood that the method of obtaining the rotation angle of the smart glasses relative to the horizontal inverted state here is only an example, and other implementation methods may also be used, which is not limited in the present disclosure.

[0071] In addition, since the motion data obtained by the motion detection element 104 is susceptible to random disturbances, taking the use of the motion detection element to obtain the gravity vector of the smart glasses as an example, Figure 5 As shown in a, when the smart glasses are not subjected to random disturbances and rotate clockwise, the motion detection element outputs the gravity vector like Figure 5 As shown in b, when the smart glasses are disturbed by vibration, they generate new acceleration. The acceleration The size and direction of are random. The motion detection element 104 obtains the gravity vector of the smart glasses. and acceleration The resultant vector Therefore, the random perturbation to the gravity vector Detection causes interference, resulting in the current gravity vector With reference gravity vector The detection of the spatial angle (i.e., the rotation angle) between them is inaccurate, which can easily lead to misjudgment of the inverted state.

[0072] In a possible implementation, in order to avoid the influence of random disturbance on the calculation of the spatial angle, after the motion data of the smart glasses are acquired, the motion data of the smart glasses are filtered, and whether the smart glasses are in an inverted state is determined based on the motion data after the filtering process. Since random disturbance and the motion of the wearer are difficult to distinguish, when determining whether the smart glasses are in a static state, it is necessary to base it on the motion data before the filtering process.

[0073] In one possible implementation, a filter can be used to smooth the motion data of the smart glasses. Before smoothing the motion data of the smart glasses, the filter parameters of the filter need to be determined. Specifically, the random disturbances can be simply classified and the signal values ​​of typical disturbances can be collected. Figure 4 Taking the coordinate system shown in 4a and 4b as an example, typical disturbances include: linear motion along the X-axis, limited motion along the Y-axis, linear motion along the Z-axis, rotational motion along the X-axis, rotational motion along the Y-axis, rotational motion along the Z-axis, etc. For each typical disturbance, a filter is used for smoothing filtering. According to the result of the filtering, specifically, according to whether the noise interference caused by the disturbance gradually converges, the filtering parameters of the filter are adjusted. When the noise caused by the disturbance converges to an allowable range for all typical disturbances, the filtering parameters of the filter are used as target parameters. The motion data of the smart glasses are filtered according to the filter with target parameters. In this implementation, the working mechanism and operation process of determining that the smart glasses are not in a static state and not in an inverted state based on the filtered motion data are the same as Figure 3 The working mechanism and operation process of step 306 in the illustrated embodiment are similar and will not be described in detail here.

[0074] In an optional implementation, after turning on the screen of the smart glasses, the control method of the smart glasses further includes:

[0075] If any screen-off condition is met, the screen of the smart glasses is turned off, and the screen-off condition includes:

[0076] determining that the smart glasses are in a away state based on the proximity measurement signal;

[0077] Determining that the smart glasses are in a stationary state based on the motion data;

[0078] Based on the motion data, it is determined that the smart glasses are in an inverted state.

[0079] Any of the above three conditions is a screen-off condition.

[0080] Some embodiments of the present disclosure further provide a method for turning off the screen of smart glasses, comprising: after turning on the screen of the smart glasses, if any screen turning off condition is met, turning off the screen of the smart glasses, the screen turning off condition comprising:

[0081] determining that the smart glasses are in a away state based on the proximity measurement signal;

[0082] Determining that the smart glasses are in a stationary state based on the motion data;

[0083] The smart glasses are determined to be in an inverted state based on the motion data.

[0084] Any of the above three conditions is a screen-off condition.

[0085] It should be understood that the screen-off method of the smart glasses provided in the present disclosure can be combined with the control method of the smart glasses provided in the embodiments of the present disclosure to control the turning on and off of the screen, but is not limited to the embodiments of the control method of the smart glasses provided in the present disclosure, and the turning off of the smart glasses can be controlled separately.

[0086] In an optional implementation, determining that the smart glasses are in a away state based on the proximity measurement signal includes comparing the signal strength of the proximity measurement signal with a preset away threshold, and if the signal strength of the proximity measurement signal is less than the away threshold, the smart glasses are determined to be in a away state, thereby determining that the smart glasses are taken off or not worn. At this time, turning off the screen of the smart glasses can prevent the screen of the smart glasses from working for a long time.

[0087] In an optional implementation, determining that the smart glasses are in a stationary state based on the motion data includes: determining that the smart glasses are in a stationary state based on the motion data acquired within a first preset time period. If the motion data acquired within the first preset time period is less than or equal to the motion detection threshold, it is determined that the smart glasses are in a stationary state. At this time, turning off the screen of the smart glasses can prevent the screen of the smart glasses from working for a long time.

[0088] In an optional implementation, determining that the smart glasses are in an inverted state based on motion data includes: determining that the smart glasses are in an inverted state based on motion data acquired within a second preset time length. Optionally, the rotation angle of the smart glasses relative to the horizontal inverted state is determined based on the motion data acquired within the second preset time length; if the rotation angle is less than the angle threshold, it is determined that the smart glasses are in an inverted state. The process of determining the rotation angle is the same as the process of determining the rotation angle in step B1, and will not be repeated here. When the smart glasses are in an inverted state, it can be considered that the smart glasses are not worn. At this time, turning off the screen of the smart glasses can avoid the screen of the smart glasses from working for a long time.

[0089] By turning off the screen of the smart glasses when any of the three screen-off conditions is met, the screen of the smart glasses can be turned off in time, avoiding the screen of the smart glasses from working for a long time and reducing the risk of screen burn-in of the smart glasses.

[0090] It should be understood that in order to avoid the influence of random interference, which causes inaccurate motion data to be acquired, resulting in incorrect judgment of the static state and the inverted state, after acquiring the motion data of the smart glasses, the motion data of the smart glasses can be filtered, and determining that the smart glasses are in a static state based on the motion data may include determining that the smart glasses are in a static state based on the filtered motion data, and determining that the smart glasses are in an inverted state based on the motion data may include determining that the smart glasses are in an inverted state based on the filtered motion data.

[0091] Figure 6 FIG. 1 is a schematic diagram showing the structure of smart glasses provided by some embodiments of the present disclosure. Figure 6 As shown, the smart glasses 20 include a display screen 200 , a proximity sensor 202 , an opening and closing measurement sensor (not shown) and a glasses body 201 .

[0092] The eyeglass body 201 may include, for example, a frame 2010 and temples 2012, wherein the frame 2010 is connected to the temples 2012. The frame 2010 may include a frame stud, and the temples 2012 may be foldably coupled to the frame stud via a hinge (not shown).

[0093] The configuration of the display screen 200 and the proximity sensor 202 of the smart glasses 20 is Figure 1 The configurations of the display screen 100 and the proximity sensor 102 of the smart glasses 10 shown are the same and will not be described again here.

[0094] The opening and closing measurement sensor of the smart glasses 20 is used to collect the opening and closing measurement signal representing the left and right opening and closing state of the temples of the smart glasses relative to the frame. The left and right opening and closing state may include an unfolded state and a closed state. The left and right opening and closing state may be determined by the left and right opening and closing angles of the temples of the smart glasses relative to the frame. The left and right opening and closing angles refer to the angles between the temples 2012 and the frame studs when the temples 2012 of the smart glasses rotate relative to the frame studs through the hinges. It should be understood that Figure 6 This is just an example. Depending on the type and configuration of the opening and closing measurement sensor, the opening and closing measurement sensor can be set on the temples and frames of the smart glasses 20 near the hinged part, or directly on the temples and frames of the smart glasses 20, or at other positions on the glasses body of the smart glasses 20. This embodiment is not limited to this.

[0095] Optionally, the smart glasses 20 may further include a motion detection element 204 for collecting motion data of the smart glasses. Based on the motion data collected by the motion detection element 104, the posture, position, or both of the smart glasses can be represented. The smart glasses with the motion detection element 104 may support 3DoF (Degree of Free) or 6DoF image rendering.

[0096] Figure 7 FIG. 1 shows a schematic diagram of the hardware structure of smart glasses provided by some embodiments of the present disclosure. Figure 7 As shown, the smart glasses include a display screen 200, a proximity sensor 202, an opening and closing measurement sensor 210, a memory 206, and a processor 208. Optionally, the smart glasses may further include a motion detection element 204.

[0097] The configuration of the display screen 200, the proximity sensor 202 and the motion detection element 204 (if any) is similar to Figure 2 The configurations of the display screen 100, the proximity sensor 102, and the motion detection element 104 (if any) in the illustrated embodiment are similar and will not be described in detail herein.

[0098] The opening and closing measurement sensor 210 is used to collect an opening and closing measurement signal representing the left and right opening and closing state of the temple 2012 of the smart glasses relative to the frame 2010. The opening and closing measurement signal may change as the left and right opening and closing state of the temple relative to the frame changes. The processor 208 may determine whether the smart glasses are in an unfolded state or in a closed state based on the opening and closing measurement signal.

[0099] In an optional embodiment, the opening and closing measurement sensor may include a Hall sensor component, which may be disposed at a position near the hinge between the temple and the frame of the smart glasses 20, or may be disposed at other suitable positions on the glasses body of the smart glasses 20. Optionally, the opening and closing measurement sensor may also include an angle encoder, which is disposed at the hinge between the temple and the frame, and determines the opening and closing state of the temple by measuring the left and right opening and closing angles of the temple relative to the frame. It should be understood that the opening and closing measurement sensor may also use other suitable sensors, which is not limited in this embodiment.

[0100] In some embodiments of the present disclosure, the screen-on condition of the smart glasses 20 can be set accordingly based on the proximity measurement signal and the opening and closing measurement signal to control the smart glasses. The control method of the smart glasses 20 includes:

[0101] Acquire a proximity measurement signal representing the proximity between the smart glasses and the obstacle;

[0102] Obtain motion data from smart glasses;

[0103] Acquire an opening and closing measurement signal representing the left and right opening and closing state of the temple relative to the frame;

[0104] Determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses.

[0105] The screen lighting conditions include: determining that the smart glasses are in a proximity state based on a proximity measurement signal; and determining that the temples are in an unfolded state based on an opening and closing measurement signal.

[0106] Each of the above two conditions is a screen-on condition. When the two screen-on conditions are met at the same time, the screen of the smart glasses is turned on.

[0107] The control method of the smart glasses 20 can be Figure 6 and Figure 7 The smart glasses shown are used to perform.

[0108] When it is determined based on the proximity measurement signal that the smart glasses are in a proximity state, it can be considered that the smart glasses are likely to be worn and used by the user. However, in some scenarios (for example, when the temples of the smart glasses are buckled), although the first screen-on condition is met, the smart glasses are not actually worn and used by the user. In these scenarios, if the screen of the smart glasses is turned on and off only based on the satisfaction of the first screen-on condition, the screen of the smart glasses may be turned on by mistake.

[0109] When the smart glasses are worn by the user, they are usually in an unfolded state. When the user buckles the temples of the smart glasses, the user usually stops using the smart glasses.

[0110] Therefore, when it is determined that the smart glasses are in a proximity state based on the proximity sensing signal, and at the same time, when it is judged that the smart glasses are in an unfolded state according to the opening and closing measurement signal of the smart glasses, the smart glasses can be considered to be in a worn state, thereby more accurately controlling the screen lighting of the smart glasses.

[0111] Optionally, the control method of the smart glasses 20 further includes: after turning on the screen of the smart glasses, if any screen turning off condition is met, turning off the screen of the smart glasses, the screen turning off condition including:

[0112] Based on the proximity measurement signal, it is determined that the smart glasses are in a distance state; based on the opening and closing measurement signal, it is determined that the temples are in a closed state.

[0113] Either of the above two conditions is a screen-off condition. For the convenience of description, they are respectively referred to as the first screen-on condition and the third screen-on condition in the following.

[0114] By turning off the screen of the smart glasses when either of the two screen turning-off conditions is met, the screen of the smart glasses can be turned off in time, thereby preventing the screen of the smart glasses from working for a long time and reducing the risk of screen burn-in of the smart glasses.

[0115] Some embodiments of the present disclosure further provide a method for turning off the screen of smart glasses, comprising: after turning on the screen of the smart glasses, if any screen turning off condition is met, turning off the screen of the smart glasses, the screen turning off condition comprising:

[0116] determining that the smart glasses are in a away state based on the proximity measurement signal;

[0117] It is determined that the temple is in a closed state based on the opening and closing measurement signal.

[0118] Either of the above two conditions is a screen-off condition.

[0119] It should be understood that the screen-off method of the smart glasses provided in the present disclosure can be combined with the control method of the smart glasses provided in the embodiments of the present disclosure to control the turning on and off of the screen, but is not limited to the embodiments of the control method of the smart glasses provided in the present disclosure, and the turning off of the smart glasses can be controlled separately.

[0120] In some embodiments of the present disclosure, the screen lighting conditions of the smart glasses 20 can be set accordingly based on the proximity measurement signal, the motion data, and the opening and closing measurement signal to control the smart glasses. Figure 8 A schematic diagram of a process flow of a smart glasses control method provided according to some embodiments of the present disclosure is shown. The smart glasses control method can be Figure 6 and Figure 7The smart glasses 20 shown are used to perform the above operations. Figure 8 As shown, the method includes:

[0121] S802, obtaining a proximity measurement signal representing the proximity between the smart glasses and the obstacle;

[0122] S804, obtaining motion data of the smart glasses;

[0123] S806, obtaining an opening and closing measurement signal representing the left and right opening and closing states of the temples relative to the frame;

[0124] S808: Determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses.

[0125] Among them, the screen lighting conditions include: determining that the smart glasses are in a proximity state based on a proximity measurement signal; determining that the smart glasses are not in a static state and not in an inverted state based on motion data; and determining that the temples are in an unfolded state based on an opening and closing measurement signal.

[0126] Each of the above three conditions is a screen-on condition, and for ease of description, they are referred to as the first screen-on condition, the second screen-on condition, and the third screen-on condition in the following. When the three screen-on conditions are met at the same time, the processor 2308 controls the screen of the smart glasses to be turned on.

[0127] In this embodiment, the specific process of steps S802 and S804 is the same as Figure 3 The specific processes of steps S302 and S304 in the illustrated embodiment are the same and will not be described in detail here.

[0128] Step S806 can be performed by Figure 6 and Figure 7 The opening and closing measurement sensor 210 in the provided embodiment is implemented.

[0129] In step S808, the working mechanism and operation process of the first screen-on condition and the second screen-on condition are the same as Figure 3 The working mechanism and operation process of the first screen-on condition and the second screen-on condition in the illustrated embodiment are similar and will not be described in detail here.

[0130] For the third screen-on condition, in one possible implementation, the processor 208 can calibrate the correspondence between the opening and closing measurement signal and the left and right opening and closing angles of the temples relative to the frame, and then can determine the left and right opening and closing angles of the temples relative to the frame in real time based on the change curve of the opening and closing measurement signal and the opening and closing measurement signal and the corresponding relationship, and then determine whether the temples are in the extended state or the closed state.

[0131] In another possible implementation, an intensity threshold can be set according to the intensity of the opening and closing measurement signal when the smart glasses are normally worn, and the processor 208 can determine whether the temple is in the extended state or the closed state according to the relationship between the intensity of the opening and closing measurement signal and the intensity threshold.

[0132] It can be understood that the above description about the third screen-on condition is not limited to this embodiment, and the above description is applicable to any embodiment including the third screen-on condition.

[0133] Determining that the smart glasses are in a proximity state based on the proximity sensor, and determining that the smart glasses are not in a static state and not in an inverted state based on the motion data are necessary conditions for judging that the smart glasses are in use. However, in some scenarios, these conditions cannot guarantee that the smart glasses are in use. For example, the proximity sensor of the smart glasses is stained with oil and is buckled and placed on a moving object. At this time, it can be determined that the smart glasses are in a proximity state based on the proximity measurement signal, and it can be determined that the smart glasses are not in a static state and not in an inverted state based on the motion data, but in fact the user is not using the smart glasses. In this scenario, based on the opening and closing measurement signal obtained by the opening and closing measurement sensor, it can be determined that the temples are not in an unfolded state, thereby judging that the smart glasses are not worn by the user, judging that the third screen-on condition is not met, and the screen of the smart glasses is not turned on. It can avoid the screen of the smart glasses from being turned on by mistake in the above scenario, and improve the accuracy of the control of the screen-on of the smart glasses.

[0134] After turning on the screen of the smart glasses, the smart glasses control method further includes: if any screen off condition is met, turning off the screen of the smart glasses, the screen off condition includes:

[0135] determining that the smart glasses are in a away state based on the proximity measurement signal;

[0136] Determining that the smart glasses are in a stationary state based on the motion data;

[0137] determining, based on the motion data, that the smart glasses are in an inverted state;

[0138] It is determined that the temple is in a closed state based on the opening and closing measurement signal.

[0139] Each of the above four conditions is a screen-off condition. When any of the screen-off conditions is met, it can be considered that the smart glasses are not worn and used by the user. When any of the four screen-off conditions is met, the screen of the smart glasses is turned off, so that the screen of the smart glasses can be turned off in time, avoiding the screen of the smart glasses from working for a long time, and reducing the risk of screen burn-in of the smart glasses.

[0140] Some embodiments of the present disclosure further provide a method for turning off the screen of smart glasses, comprising: after turning on the screen of the smart glasses, if any screen turning off condition is met, turning off the screen of the smart glasses, the screen turning off condition comprising:

[0141] determining that the smart glasses are in a away state based on the proximity measurement signal;

[0142] Determining that the smart glasses are in a stationary state based on the motion data;

[0143] determining, based on the motion data, that the smart glasses are in an inverted state;

[0144] It is determined that the temple is in a closed state based on the opening and closing measurement signal.

[0145] Any of the above four conditions is a screen-off condition.

[0146] It should be understood that the screen-off method of the smart glasses provided in the present disclosure can be combined with the control method of the smart glasses provided in the embodiments of the present disclosure to control the turning on and off of the screen, but is not limited to the embodiments of the control method of the smart glasses provided in the present disclosure, and the turning off of the smart glasses can be controlled separately.

[0147] In an optional implementation, the opening and closing measurement sensor of the smart glasses may be a Hall sensor component. Fig. 9 FIG. 2 shows the arrangement of the Hall sensor assembly in some implementations of the present disclosure. Fig. 9 As shown, the opening and closing measurement sensor of the smart glasses 30 includes a Hall sensor assembly 310. The Hall sensor assembly 310 is used to obtain an electromagnetic induction signal that characterizes the left and right opening and closing state of the temple of the smart glasses relative to the frame. The intensity of the electromagnetic induction signal characterizes the intensity of the magnetic field generated by the temple. The Hall sensor assembly 310 includes a Hall element 3102 and a permanent magnet 3104. The permanent magnet 3104 is arranged on the temple 3012 near the hinge part, and is used to make the temple 3012 generate a magnetic field. The Hall element 3102 is arranged on the frame 3010 near the hinge part, and is used to obtain an electromagnetic induction signal that characterizes the left and right opening and closing state of the temple relative to the frame. The intensity of the electromagnetic induction signal is the intensity of the magnetic field generated by the temple. When the left and right opening and closing state of the temple relative to the frame changes, the intensity of the electromagnetic induction signal obtained by the Hall element 3102 will change accordingly. Therefore, the left and right opening and closing state of the temple relative to the frame can be determined based on the intensity of the electromagnetic induction signal obtained by the Hall element 3102.

[0148] It should be understood that in this embodiment, two Hall sensor assemblies 310 are usually provided. In the case of two Hall sensor assemblies 310, there are two Hall elements 3102 and two permanent magnets 3104, respectively. The two Hall elements 3102 can be respectively provided at two frame studs 3011 of the smart glasses, and the two permanent magnets 3104 can be respectively provided at the ends of the temples 3012 near the two frame studs 3103.

[0149] For ease of understanding, refer to Fig.10 and Fig.11 right Fig. 9 The working mechanism of the Hall sensor assembly 310 is described in detail.

[0150] For ease of explanation, a coordinate system is established based on the Hall element 3102 body. In this coordinate system, the Y axis of the Hall element 3102 is parallel to the length direction of the frame 3010, the X axis of the Hall element 3102 is parallel to the length direction of the temple 3012 when the temple 3012 is in the unfolded state, and the Z axis of the Hall element 3102 is parallel to the axis of rotation of the temple 3012 relative to the frame 3010. In this coordinate system, when the temple 3012 of the smart glasses is opened or closed, the permanent magnet 3104 rotates around the Z axis of the Hall element 3102.

[0151] Fig.10 and Fig.11 Schematic diagrams of the spatial positions of the Hall element and the permanent magnet when the temples of the smart glasses are in the unfolded state and the closed state in some implementations of the present disclosure are respectively shown. Fig.10 As shown, when the temple 3012 is in the unfolded state, the central axis of the magnetic flux line of the permanent magnet 3104 is parallel to and coincides with the Y axis of the Hall element 3102. At this time, the magnetic induction intensity data of the Y axis of the Hall element 3102 is the largest, and the magnetic induction intensity data of the X axis of the Hall element 3102 is the smallest, that is, the first magnetic induction intensity data of the electromagnetic induction signal in the first direction is the largest, and the second magnetic induction intensity data in the second direction is the smallest. As the temple 3012 is gradually buckled, the position of the permanent magnet 3104 changes. When the temple 3012 is fully buckled, the spatial position is as shown in FIG. Fig.11 As shown, at this time, the magnetic induction intensity data of the X-axis of the Hall element 3102 is the largest, and the magnetic induction intensity data of the Y-axis is the smallest, that is, the second magnetic induction intensity data of the electromagnetic induction signal in the second direction is the largest, and the first magnetic induction intensity data in the first direction is the smallest. Therefore, according to the relationship between the first magnetic induction intensity data and / or the second magnetic induction intensity data acquired by the Hall element and the left and right opening and closing states of the smart glasses, it can be determined whether the smart glasses are in the closed state or in the unfolded state.

[0152] In an optional implementation, the opening and closing measurement signal collected by the opening and closing measurement sensor includes an electromagnetic induction signal, and the intensity of the electromagnetic induction signal represents the intensity of the magnetic field generated by the temple. Figure 8 The step S806 shown, obtaining the opening and closing measurement signal characterizing the left and right opening and closing state of the temple relative to the frame, may include: obtaining the first magnetic induction intensity data of the electromagnetic induction signal in the first direction and / or the second magnetic induction intensity data in the second direction, the first direction is the direction along the length of the temple when the temple is in the unfolded state, and the second direction is orthogonal to the first direction; the left and right opening and closing state of the temple relative to the frame is determined according to the first magnetic induction intensity data and / or the second magnetic induction intensity data. This step may be performed by Figure 9-11 The Hall sensor assembly 310 is shown implemented.

[0153] Optionally, the left and right opening and closing states are determined by the left and right opening and closing angles. The corresponding relationship between the change curve of the first magnetic induction intensity data and the second magnetic induction intensity data and the left and right opening and closing angles of the temple relative to the frame can be calibrated, and then the left and right opening and closing angles of the temple relative to the frame can be determined in real time according to the first magnetic induction intensity data, the second magnetic induction intensity data and the corresponding relationship, and then it can be determined whether the temple is in the extended state or the closed state.

[0154] Optionally, a first magnetic induction intensity threshold can be set according to the magnetic induction intensity data of the magnetic induction signal in the first direction obtained by the Hall element when the smart glasses are worn normally, and / or a second magnetic induction intensity threshold can be set according to the magnetic induction intensity data of the magnetic induction signal in the second direction obtained by the Hall element when the smart glasses are worn normally. If the first magnetic induction intensity data is greater than the first magnetic induction intensity threshold and / or the second magnetic induction intensity data is less than the second magnetic induction intensity threshold, when it is determined that the temples are in the unfolded state, the user is more likely to be wearing smart glasses.

[0155] It should be understood that the above description of the Hall sensor assembly and the electromagnetic induction signal can be applied to the use of Figure 9-11 Various implementations of the control method of smart glasses with the Hall sensor assembly arrangement shown in . For example, the screen-on condition and screen-off condition of the smart glasses can be set accordingly based on the proximity measurement signal and the electromagnetic induction signal to control the smart glasses; the screen-on condition and screen-off condition of the smart glasses can also be set accordingly based on the proximity measurement signal, motion data and the electromagnetic induction signal to control the smart glasses. In this way, the screen of the smart glasses can be prevented from being accidentally turned on in some scenarios, and the screen of the smart glasses can be turned off in time, thereby reducing the possibility of screen burn-in of the smart glasses.

[0156] In another optional implementation, the opening and closing measurement sensors of the smart glasses are arranged in another manner. Fig.12Another arrangement of the Hall sensor assembly in some implementations of the present disclosure is shown. Fig.12 As shown, the glasses body 401 may include, for example, a frame 4010 and temples 4012, wherein the frame 4010 is connected to the temples 4012. The frame 4010 may include a frame stud, and the temples 4012 may be combined at the frame stud in a foldable manner through a hinge 4013. When the user wears the smart glasses, the frame 4010 is usually located in front of the user's face, and the temples 4012 are usually located on both sides of the user's head. For example, the temples 4012 may be set above the ears on both sides of the user. Optionally, the temples 4012 have a shape that matches the ear contour so that the smart glasses can be stably worn on the user's head.

[0157] The Hall sensor assembly 410 includes a Hall element 4102 and permanent magnets 4104a and 4104b. The Hall element 4102 is arranged at the middle position of the mirror frame 4010, and the permanent magnets 4104a and 4104b are arranged on two temples 4012, and the distance between the permanent magnets 4104a and 4104b and the hinge 4013 is equal to the distance between the Hall element and the hinge 4013. The permanent magnets 4104a and 4104b are used to generate a magnetic field on the temples 4012, and the Hall element 4102 is used to obtain an electromagnetic induction signal that characterizes the left and right opening and closing state of the temples relative to the mirror frame. The intensity of the electromagnetic induction signal is the intensity of the magnetic field generated by the temples. When the left and right opening and closing state of the temples relative to the mirror frame changes, the intensity of the electromagnetic induction signal obtained by the Hall element 4102 will change accordingly. Therefore, the left and right opening and closing state of the temples relative to the mirror frame can be determined based on the intensity of the electromagnetic induction signal obtained by the Hall element 4102.

[0158] In an optional implementation, the Hall element 4102 is used to obtain the magnetic induction intensity data of the electromagnetic induction signal in the third direction. The intensity of the electromagnetic induction signal is the intensity of the magnetic field generated by the temple. The third direction is a direction perpendicular to the plane where the frame 4010 is located, that is, the normal direction of the plane where the frame 4010 is located. Fig.12 When the two frames 4012 are in a buckled state, the Hall element 4102 is close to the permanent magnets 4104a and 1204, and the magnetic induction intensity data of the electromagnetic induction signal sensed by the Hall element 4102 in the normal direction of the plane where the frame 4010 is located is the largest. When the two frames 4012 are in an unfolded state, the Hall element 4102 is far away from the permanent magnets 4104a and 4104b, and the magnetic induction intensity data of the electromagnetic induction signal sensed by the Hall element 4102 in the normal direction of the plane where the frame 4010 is located is the smallest (basically 0). Therefore, it can be determined whether the smart glasses are in a buckled state or an unfolded state based on the magnetic induction intensity data in the third direction obtained by the Hall element.

[0159] In an optional implementation, Figure 8 Step S806 in the method of obtaining the opening and closing measurement signal representing the left and right opening and closing state of the temple relative to the frame may include: obtaining the magnetic induction intensity of the electromagnetic induction signal in a third direction. The third direction is a direction perpendicular to the plane where the frame is located. This step may be performed by Fig.12 The Hall sensor assembly 410 in the provided embodiment performs the above operation. Accordingly, the left and right opening and closing states of the temples relative to the frame are determined according to the magnetic induction intensity data in the third direction.

[0160] Optionally, the left and right opening and closing states can be judged by the left and right opening and closing angles. The correspondence between the change curve of the magnetic induction intensity data sensed by the Hall element 4102 and the left and right opening and closing angles of the temples relative to the frame can be calibrated. Then, based on the magnetic induction intensity data in the third direction sensed by the Hall element and the correspondence, the left and right opening and closing angles of the temples relative to the frame can be determined in real time, thereby determining whether the temples are in the extended state or the closed state.

[0161] Optionally, the magnetic induction intensity in the third direction of the magnetic induction signal acquired by the Hall element when the smart glasses are normally worn can be used as the distance away from the air gap. When the magnetic induction intensity data in the third direction is less than the distance away from the air gap, it is determined that the temple is in the unfolded state. A distance close to the air gap can also be set, and when the magnetic induction intensity data in the third direction is greater than the distance close to the air gap, it is determined that the temple is in the buckled state.

[0162] It should be understood that the above description of the Hall sensor assembly and the electromagnetic induction signal can be applied to the use of Fig.12 Various implementations of the control method of smart glasses with the Hall sensor assembly arrangement shown in . For example, the screen-on condition and screen-off condition of the smart glasses can be set accordingly based on the proximity measurement signal and the electromagnetic induction signal to control the smart glasses; the screen-on condition and screen-off condition of the smart glasses can also be set accordingly based on the proximity measurement signal, motion data and the electromagnetic induction signal to control the smart glasses. In this way, the screen of the smart glasses can be prevented from being accidentally turned on in some scenarios, and the screen of the smart glasses can be turned off in time, thereby reducing the possibility of screen burn-in of the smart glasses.

[0163] Some embodiments of the present disclosure also provide a method for controlling smart glasses. The method includes: obtaining a proximity measurement signal that characterizes the degree of proximity between the smart glasses and the obstacle; obtaining the motion data of the smart glasses; determining whether the screen-on conditions are met at the same time, and if so, turning on the screen of the smart glasses, and the screen-on conditions include: determining that the smart glasses are in a proximity state based on the proximity measurement signal; and, based on the motion data, determining that the smart glasses are not in a static state and are not in an inverted state. Among them, the proximity measurement signal and the motion data can also be obtained using additional sensors (for example, sensors and cameras disposed outside the smart glasses). The method can be implemented by any electronic device that can control smart glasses, and is not limited to the smart glasses shown in the above-mentioned embodiments of the present disclosure.

[0164] In a possible implementation method, determining that the smart glasses are not in a static state and not in an inverted state based on motion data includes: determining that the smart glasses are not in a static state based on motion data acquired within a first preset time length; determining that the smart glasses are not in an inverted state based on motion data acquired within a second preset time length, and the second preset time length is less than the first preset time length.

[0165] In one possible implementation, based on the motion data obtained within a first preset time period, determining that the smart glasses are not in a static state includes: if the motion data obtained within the first preset time period is greater than a motion detection threshold, determining that the smart glasses are not in a static state.

[0166] In one possible implementation, based on the motion data obtained within the second preset time length, it is determined that the smart glasses are not in an inverted state, including: determining the rotation angle of the smart glasses relative to the horizontal inverted state based on the motion data obtained within the second preset time length; if the rotation angle is greater than the angle threshold, it is determined that the smart glasses are not in an inverted state.

[0167] In one possible implementation, the rotation angle of the smart glasses relative to the horizontal inverted state is determined based on motion data obtained within a second preset time period, including: obtaining the current gravity vector of the smart glasses; calculating the spatial angle between the current gravity vector and the reference gravity vector as the rotation angle, wherein the reference gravity vector is the gravity vector obtained when the smart glasses are in a horizontal inverted state.

[0168] In a possible implementation, the smart glasses include a frame and temples hinged to the frame, and the angle threshold is related to an up-and-down swing angle of the temples relative to the frame.

[0169] In a possible implementation, after turning on the screen of the smart glasses, it also includes: if any screen-off condition is met, turning off the screen of the smart glasses, the screen-off conditions include: determining that the smart glasses are in a away state based on a proximity measurement signal; determining that the smart glasses are in a static state based on motion data; determining that the smart glasses are in an inverted state based on motion data.

[0170] In a possible implementation, after acquiring the motion data of the smart glasses, it also includes: filtering the motion data; based on the motion data, determining that the smart glasses are not in a static state and not in an inverted state, including: determining that the smart glasses are not in a static state based on the motion data before filtering; determining that the smart glasses are not in an inverted state based on the motion data after filtering.

[0171] In a possible implementation, the smart glasses include a frame and temples hinged to the frame. Before determining that the screen-lighting conditions are simultaneously met, the smart glasses also include: obtaining an opening and closing measurement signal characterizing the left and right opening and closing states of the temples relative to the frame. The screen-lighting conditions also include: determining that the temples are in an unfolded state based on the opening and closing measurement signal.

[0172] In a possible implementation, the screen-off condition further includes: determining that the temple is in a closed state based on an opening and closing measurement signal.

[0173] In a possible implementation, the opening and closing measurement signal includes an electromagnetic induction signal, the intensity of the electromagnetic induction signal characterizes the intensity of the magnetic field generated by the temple; obtaining the opening and closing measurement signal characterizing the left and right opening and closing state of the temple relative to the frame includes: obtaining first magnetic induction intensity data of the electromagnetic induction signal in a first direction and second magnetic induction intensity data in a second direction, the first direction being the direction along the length of the temple when the temple is in an unfolded state, and the second direction being orthogonal to the first direction; the left and right opening and closing state of the temple relative to the frame is determined based on the first magnetic induction intensity data and the second magnetic induction intensity data.

[0174] In a possible implementation, the opening and closing measurement signal includes an electromagnetic induction signal, the intensity of the electromagnetic induction signal represents the intensity of the magnetic field generated by the temple; obtaining the opening and closing measurement signal representing the left and right opening and closing state of the temple of the smart glasses relative to the frame includes: obtaining magnetic induction intensity data of the electromagnetic induction signal in a third direction; the third direction is a direction perpendicular to the plane where the frame is located; the left and right opening and closing state of the temple relative to the frame is determined based on the magnetic induction intensity data.

[0175] Fig.13 Schematic diagram of a smart glasses control device according to some embodiments of the present disclosure. Fig.13As shown, the smart glasses control device 1300 includes: a proximity signal acquisition unit 1302, a motion data acquisition unit 1304 and a control unit 1306. The proximity signal acquisition unit 1302 is used to acquire a proximity measurement signal representing the proximity between the smart glasses and the obstacle. The motion data acquisition unit 1304 is used to acquire the motion data of the smart glasses. The control unit 1306 is used to determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses. The screen-on conditions include: based on the proximity measurement signal, the smart glasses are in a proximity state; and, based on the motion data, it is determined that the smart glasses are not in a static state and are not in an inverted state.

[0176] In one possible implementation, determining that the smart glasses are not in a static state and not in an inverted state based on motion data includes: determining that the smart glasses are not in a static state based on motion data acquired within a first preset time length; determining that the smart glasses are not in an inverted state based on motion data acquired within a second preset time length, and the second preset time length is less than the first preset time length.

[0177] In one possible implementation, based on the motion data obtained within a first preset time period, determining that the smart glasses are not in a static state includes: if the motion data obtained within the first preset time period is greater than a motion detection threshold, determining that the smart glasses are not in a static state.

[0178] In one possible implementation, based on the motion data obtained within the second preset time length, it is determined that the smart glasses are not in an inverted state, including: determining the rotation angle of the smart glasses relative to the horizontal inverted state based on the motion data obtained within the second preset time length; if the rotation angle is greater than the angle threshold, it is determined that the smart glasses are not in an inverted state.

[0179] In one possible implementation, the rotation angle of the smart glasses relative to the horizontal inverted state is determined based on motion data obtained within a second preset time period, including: obtaining the current gravity vector of the smart glasses; calculating the spatial angle between the current gravity vector and the reference gravity vector as the rotation angle, wherein the reference gravity vector is the gravity vector obtained when the smart glasses are in a horizontal inverted state.

[0180] In a possible implementation, the smart glasses include a frame and temples hinged to the frame, and the angle threshold is related to an up-and-down swing angle of the temples relative to the frame.

[0181] In a possible implementation, after turning on the screen of the smart glasses, the control unit 1306 is further configured to: if any screen off condition is satisfied, turn off the screen of the smart glasses. The screen off condition includes: determining that the smart glasses are in a distance state based on the proximity measurement signal; determining that the smart glasses are in a static state based on the motion data; and determining that the smart glasses are in an inverted state based on the motion data.

[0182] In a possible implementation, the smart glasses control device further includes a filtering unit, which is used to filter the motion data of the smart glasses after acquiring the motion data of the smart glasses. Accordingly, the control unit 1306 is used to determine that the smart glasses are not in a static state based on the motion data before filtering; and determine that the smart glasses are not in an inverted state based on the motion data after filtering.

[0183] In a possible implementation, the smart glasses include a frame and temples hinged to the frame, and the control unit 1306 further includes an opening and closing signal acquisition unit, which is used to acquire an opening and closing measurement signal representing a left and right opening and closing state of the temple relative to the frame. Accordingly, the screen-on condition further includes: determining that the temple is in an unfolded state based on the opening and closing measurement signal.

[0184] In a possible implementation, the screen-off condition further includes: determining that the temple is in a closed state based on an opening and closing measurement signal.

[0185] In a possible implementation, the opening and closing measurement signal includes an electromagnetic induction signal, the intensity of the electromagnetic induction signal represents the intensity of the magnetic field generated by the temple, and the opening and closing signal acquisition unit is specifically used to: obtain first magnetic induction intensity data of the magnetic field generated by the temple in a first direction and second magnetic induction intensity data in a second direction, the first direction being the direction along the length of the temple when the temple is in an unfolded state, and the second direction is orthogonal to the first direction; the left and right opening and closing state of the temple relative to the frame is determined based on the first magnetic induction intensity data and the second magnetic induction intensity data.

[0186] In a possible implementation, the opening and closing measurement signal includes an electromagnetic induction signal, the intensity of the electromagnetic induction signal represents the intensity of the magnetic field generated by the temple, and accordingly, the opening and closing signal acquisition unit is specifically used to: obtain magnetic induction intensity data of the electromagnetic induction signal in a third direction; the third direction is a direction perpendicular to the plane where the frame is located; the left and right opening and closing state of the temple relative to the frame is determined based on the magnetic induction intensity data.

[0187] The smart glasses control device provided in this embodiment is used to execute the smart glasses control method provided in the above-mentioned embodiment, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.

[0188] The embodiment of the present disclosure also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the smart glasses control method provided in the aforementioned method embodiment are implemented.

[0189] It should be pointed out that, according to the needs of implementation, the various components / steps described in the embodiments of the present disclosure can be split into more components / steps, or two or more components / steps or partial operations of components / steps can be combined into new components / steps to achieve the purpose of the embodiments of the present disclosure.

[0190] The above-described method according to the embodiment of the present disclosure may be implemented in hardware, firmware, or as software or computer code that can be stored in a recording medium (such as a CD ROM, RAM, floppy disk, hard disk, or magneto-optical disk), or as computer code that is originally stored in a remote recording medium or a non-temporary machine-readable medium downloaded via a network and will be stored in a local recording medium, so that the method described herein can be stored in such software processing on a recording medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware (such as an ASIC or FPGA). It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component (e.g., RAM, ROM, flash memory, etc.) that can store or receive software or computer code, and when the software or computer code is accessed and executed by a computer, a processor, or hardware, the smart glasses control method described herein is implemented. In addition, when a general-purpose computer accesses the code for implementing the smart glasses control method shown herein, the execution of the code converts the general-purpose computer into a dedicated computer for executing the smart glasses control method shown herein.

[0191] Those of ordinary skill in the art will appreciate that the units and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present disclosure.

[0192] The above implementation methods are only used to illustrate the embodiments of the present disclosure, and are not limitations of the embodiments of the present disclosure. Ordinary technicians in the relevant technical field may make various changes and modifications without departing from the spirit and scope of the embodiments of the present disclosure. Therefore, all equivalent technical solutions also belong to the scope of the embodiments of the present disclosure. The scope of patent protection of the embodiments of the present disclosure should be defined by the claims.

Claims

1. A smart glasses control method, comprising: Acquire a proximity measurement signal representing the proximity between the smart glasses and the obstacle; Acquiring motion data of the smart glasses; Determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses, wherein the screen-on conditions include: Based on the proximity measurement signal, determining that the smart glasses are in a proximity state; Based on the motion data, it is determined that the smart glasses are not in a static state and are not in an inverted state.

2. The method according to claim 1, wherein determining that the smart glasses are not in a static state and are not in an inverted state based on the motion data comprises: Based on the motion data acquired within a first preset time period, determining that the smart glasses are not in a static state; Based on the motion data acquired within a second preset time length, it is determined that the smart glasses are not in an inverted state, and the second preset time length is shorter than the first preset time length.

3. The method according to claim 2, wherein determining that the smart glasses are not in a static state based on the motion data acquired within a first preset time period comprises: If the motion data acquired within the first preset time period is greater than the motion detection threshold, it is determined that the smart glasses are not in a static state.

4. The method according to claim 2, wherein determining that the smart glasses are not in an inverted state based on the motion data acquired within a second preset time period comprises: Determining a rotation angle of the smart glasses relative to a horizontal inverted state based on the motion data acquired within the second preset time period; If the rotation angle is greater than the angle threshold, it is determined that the smart glasses are not in an inverted state.

5. The method according to claim 4, wherein determining the rotation angle of the smart glasses relative to the horizontal inverted state based on the motion data acquired within the second preset time period comprises: Obtaining the current gravity vector of the smart glasses; A spatial angle between the current gravity vector and a reference gravity vector is calculated as the rotation angle, wherein the reference gravity vector is a gravity vector obtained when the smart glasses are in a horizontal inverted state.

6. The method according to claim 4, wherein: The smart glasses include a frame and temples hinged to the frame, and the angle threshold is related to an up-and-down swing angle of the temples relative to the frame.

7. The method according to claim 1, after turning on the screen of the smart glasses, further comprises: If any screen-off condition is met, the screen of the smart glasses is turned off, and the screen-off condition includes: determining that the smart glasses are in a away state based on the proximity measurement signal; Determining that the smart glasses are in a stationary state based on the motion data; Based on the motion data, it is determined that the smart glasses are in an inverted state.

8. The method according to claim 1, wherein: After acquiring the motion data of the smart glasses, the method further includes: Performing filtering on the motion data; The step of determining, based on the motion data, that the smart glasses are not in a static state and are not in an inverted state comprises: Determining that the smart glasses are not in a static state based on the motion data before filtering; The smart glasses are determined to be not in an inverted state based on the filtered motion data.

9. The method according to claim 1, wherein: The smart glasses include a frame and temples hinged to the frame, and before determining that the screen lighting conditions are simultaneously met, further include: Acquire an opening and closing measurement signal representing the left and right opening and closing states of the temple relative to the frame; The screen-on condition also includes: determining that the temple is in an unfolded state based on the opening and closing measurement signal.

10. The method according to claim 9, wherein the screen off condition further comprises: Based on the opening and closing measurement signal, it is determined that the temple is in a closed state.

11. The method according to claim 9 or 10, wherein the opening and closing measurement signal comprises an electromagnetic induction signal, and the intensity of the electromagnetic induction signal represents the intensity of the magnetic field generated by the temple; The step of obtaining an opening and closing measurement signal representing a left-right opening and closing state of the temple relative to the frame includes: Acquire first magnetic induction intensity data of the electromagnetic induction signal in a first direction and second magnetic induction intensity data in a second direction, wherein the first direction is a direction along the length of the temple when the temple is in an unfolded state, and the second direction is orthogonal to the first direction; The left and right opening and closing states of the temples relative to the frame are determined according to the first magnetic induction intensity data and the second magnetic induction intensity data.

12. The method according to claim 9 or 10, wherein the opening and closing measurement signal comprises an electromagnetic induction signal, and the intensity of the electromagnetic induction signal represents the intensity of the magnetic field generated by the temple; The obtaining of the opening and closing measurement signal representing the left and right opening and closing states of the temples of the smart glasses relative to the frame includes: Acquire magnetic induction intensity data of the electromagnetic induction signal in a third direction; the third direction is a direction perpendicular to the plane where the lens frame is located; The left and right opening and closing states of the temples relative to the frame are determined according to the magnetic induction intensity data.

13. A smart glasses control device, comprising: A proximity signal acquisition unit, used to acquire a proximity measurement signal representing the proximity between the smart glasses and the obstacle; A motion data acquisition unit, used to acquire motion data of the smart glasses; A control unit, used to determine whether the screen-on conditions are met at the same time, and if so, turn on the screen of the smart glasses; The screen-on conditions include: Based on the proximity measurement signal, determining that the smart glasses are in a proximity state; Based on the motion data, it is determined that the smart glasses are not in a static state and are not in an inverted state.

14. A pair of smart glasses, comprising: A display screen for displaying image data; A proximity sensor, used to collect a proximity measurement signal representing the proximity between the smart glasses and an obstacle; A motion detection element, used to collect motion data of the smart glasses; Memory, used to store computer programs; A processor, configured to implement the smart glasses control method according to any one of claims 1 to 8 when executing the computer program.

15. The smart glasses according to claim 14, further comprising: An opening and closing measurement sensor, used to collect an opening and closing measurement signal representing the left and right opening and closing states of the temples of the smart glasses relative to the frame, wherein the temples are connected to the frame via a hinge; The processor is used to implement the smart glasses control method according to claim 9 or 10 when executing the computer program.

16. The smart glasses according to claim 15, wherein the opening and closing measurement sensor comprises a Hall sensor component, and the Hall sensor component comprises: A Hall element is provided on the mirror frame near the hinge portion and is used to collect first magnetic induction intensity data of the electromagnetic induction signal in the first direction and second magnetic induction intensity data in the second direction; A permanent magnet is disposed on the temple near the hinge portion and is used to generate a magnetic field on the temple; The processor is configured to implement the smart glasses control method according to claim 11 when executing the computer program.

17. The smart glasses according to claim 15, wherein the opening and closing measurement sensor comprises a Hall sensor component, and the Hall sensor component comprises: A Hall element is provided on the mirror frame and is used to collect magnetic induction intensity data of the electromagnetic induction signal in the third direction; A permanent magnet is disposed on the temple and is used to generate a magnetic field on the temple; Wherein, the distance between the permanent magnet and the hinged portion is equal to the distance between the Hall element and the hinged portion; The processor is configured to implement the smart glasses control method as claimed in claim 12 when executing the computer program.

18. A computer-readable storage medium having a computer program stored thereon, wherein when the program is executed by a processor, the smart glasses control method according to any one of claims 1 to 12 is implemented.

Images