Earphone control method, earphone and computer readable storage medium
By using the headphone sensor module to identify the user's head position and provide alerts, the problem of difficulty in recognizing head fatigue during prolonged sitting and cycling is solved, reducing the risk of neck fatigue injury.
Patent Information
- Application Number
- CN202411216867.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2025-01-14
- Estimated Expiration
- 2044-08-30
AI Technical Summary
In scenarios such as prolonged sitting and cycling, the user's head and neck remain fixed for extended periods, making it difficult to recognize fatigue in a timely manner and increasing the risk of neck strain injuries.
The system collects detection data through the sensor module in the earphone, uses accelerometers and gyroscopes to determine the amplitude and angular velocity of the user's head movement, and combines preset state thresholds and time window fusion algorithms to identify the static state of the head and issue a prompt message when the duration reaches the threshold.
It effectively prompts users to change their head position, avoids fatigue caused by maintaining the same posture for a long time, and reduces the risk of neck fatigue injury.
Smart Images

Figure CN119316765A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of earphones, and more specifically, to an earphone control method, an earphone, and a computer-readable storage medium. Background Art
[0002] At present, most modern working methods are sitting at a computer, accompanied by long periods of sitting time. In the scene of deep concentration, the user's head is basically in a stable state facing the screen, with less head movement and a fixed posture. Among them, head inactivity is highly correlated with neck discomfort. During cycling, because the human eyes need to look straight ahead, the cervical spine will be in a hyperextended state, and long-term cycling will cause the cervical spine to remain in this high-pressure posture for a long time, increasing the risk of neck strain injury. In the case of long-term sitting and cycling, the long-term fixation of the head and neck will cause the human body to be in a state of fatigue. However, the human body often cannot know in time that it is in a state of fatigue. Summary of the invention
[0003] Embodiments of the present application provide a method for controlling an earphone, an earphone, and a computer-readable storage medium.
[0004] The earphones of the embodiment of the present application include a sensor module, and the control method of the earphones includes: acquiring detection data collected by the sensor module; determining the current state of the head of a user wearing the earphones according to the detection data and a preset state threshold, the current state including a first state and a second state, the movement amplitude of the user's head in the first state is greater than the movement amplitude of the user's head in the second state; when the current state is the second state, accumulating the time length of time that the user's head is continuously in the second state; when the accumulated time length reaches the preset time length threshold, issuing a prompt message.
[0005] In some embodiments, the sensor module includes an accelerometer, the detection data includes three-axis acceleration detected by the accelerometer, and the preset state threshold includes a preset acceleration difference threshold. Determining the current state of the head of the user wearing the headset according to the detection data and the preset state threshold includes: determining the current state of the head of the user wearing the headset according to the three-axis acceleration and the acceleration difference threshold within a preset time window.
[0006] In some embodiments, determining the current state of the head of the user wearing the headset based on the three-axis acceleration and the acceleration difference threshold within a preset time window includes: fusing the three-axis acceleration at multiple predetermined moments within the preset time window to obtain multiple fused acceleration values corresponding to the multiple predetermined moments; screening out a maximum fused acceleration value and a minimum fused acceleration value from the multiple fused acceleration values; obtaining an acceleration difference value based on the maximum fused acceleration value and the minimum fused acceleration value; and determining the current state of the head of the user wearing the headset based on the acceleration difference value and the acceleration difference threshold.
[0007] In some embodiments, determining the current state of the head of the user wearing the headset based on the acceleration difference and the acceleration difference threshold includes: when the acceleration difference is greater than the acceleration difference threshold, determining that the current state of the head of the user wearing the headset is the first state; when the acceleration difference is less than the acceleration difference threshold, determining that the current state of the head of the user wearing the headset is the second state.
[0008] In some embodiments, the sensor module includes a gyroscope, the detection data includes a three-axis angular velocity detected by the gyroscope, and the preset state threshold includes a preset angular velocity difference threshold. Determining the current state of the head of the user wearing the headset according to the detection data and the preset state threshold includes: determining the current state of the head of the user wearing the headset according to the three-axis angular velocity and the angular velocity difference threshold within a preset time window.
[0009] In some embodiments, determining the current state of the head of the user wearing the headset based on the three-axis angular velocity and the angular velocity difference threshold within a preset time window includes: fusing the three-axis angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values corresponding to the multiple predetermined moments; screening out a maximum fused angular velocity value and a minimum fused angular velocity value from the multiple fused angular velocity values; obtaining an angular velocity difference value based on the maximum fused angular velocity value and the minimum fused angular velocity value; and determining the current state of the head of the user wearing the headset based on the angular velocity difference value and the angular velocity difference threshold.
[0010] In some embodiments, determining the current state of the head of the user wearing the headphones based on the angular velocity difference and the angular velocity difference threshold includes: when the angular velocity difference is greater than the angular velocity difference threshold, determining that the current state of the head of the user wearing the headphones is the first state; and when the angular velocity difference is less than the angular velocity difference threshold, determining that the current state of the head of the user wearing the headphones is the second state.
[0011] In some embodiments, the sensor module includes an accelerometer and a gyroscope, the detection data includes three-axis acceleration detected by the accelerometer and three-axis angular velocity detected by the gyroscope, and the preset state threshold includes a preset acceleration difference threshold and a preset angular velocity difference threshold. Determining the current state of the head of the user wearing the headset according to the detection data and the preset state threshold includes: determining the current state of the head of the user wearing the headset according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold, and the angular velocity difference threshold within a preset time window.
[0012] In some embodiments, the determining the current state of the head of the user wearing the headset according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold and the angular velocity difference threshold within a preset time window includes: fusing the three-axis acceleration at multiple predetermined moments within the preset time window to obtain multiple fused acceleration values corresponding to the multiple predetermined moments, and fusing the three-axis angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values corresponding to the multiple predetermined moments; selecting a maximum fused acceleration value and a minimum fused acceleration value from the multiple fused acceleration values, and selecting a maximum fused angular velocity value and a minimum fused angular velocity value from the multiple fused angular velocity values; obtaining an acceleration difference value according to the maximum fused acceleration value and the minimum fused acceleration value, and obtaining an angular velocity difference value according to the maximum fused angular velocity value and the minimum fused angular velocity value; and determining the current state of the head of the user wearing the headset according to the acceleration difference value, the acceleration difference threshold, the angular velocity difference value, and the angular velocity difference threshold.
[0013] In some embodiments, determining the current state of the head of the user wearing the headset based on the acceleration difference, the acceleration difference threshold, the angular velocity difference, and the angular velocity difference threshold includes: when the acceleration difference is greater than the acceleration difference threshold, and / or the angular velocity difference is greater than the angular velocity difference threshold, determining that the current state of the head of the user wearing the headset is the first state; when the acceleration difference is less than the acceleration difference threshold, and the angular velocity difference is less than the angular velocity difference threshold, determining that the current state of the head of the user wearing the headset is the second state.
[0014] In some embodiments, the control method also includes: identifying a current scene in which the headset is located, the current scene including a first scene and a second scene; and determining a preset state threshold based on the current scene, the preset state threshold in the first scene being smaller than the preset state threshold in the second scene.
[0015] In some embodiments, the sensor module includes an accelerometer, the detection data includes three-axis acceleration detected by the accelerometer, and the headset further includes an instruction receiving module. The identifying the current scene of the headset includes: determining the current scene based on the three-axis acceleration and the instruction received by the instruction receiving module.
[0016] In some embodiments, determining the current scene based on the three-axis acceleration and the instruction received by the instruction receiving module includes: determining whether the current scene is in the first scene based on the change of the Z-axis acceleration in the three-axis acceleration; and determining whether the current scene is in the second scene based on whether the instruction receiving module receives a scene entry instruction.
[0017] In some embodiments, the headset further includes a control box assembly and a battery box assembly, wherein the control box assembly includes a control box, and the battery box assembly includes a battery box. The instruction receiving module includes an input module disposed on the control box or on the battery box, wherein the input module is used to input user instructions, and the input module includes at least one of a button and a touch screen.
[0018] In some embodiments, the headset further includes a control box assembly and a battery box assembly, wherein the control box assembly includes a control box, and the battery box assembly includes a battery box. The headset further includes a communication module, wherein the communication module includes the instruction receiving module disposed in the control box or the battery box, wherein the instruction receiving module is used to receive instructions sent by an external device, wherein the external device includes at least one of a mobile phone, a watch, a server, a computer, and a tablet computer.
[0019] In some embodiments, the control method further includes: setting a preset time threshold for the headset in different scenarios based on user input; determining the preset time threshold based on the current scenario, the preset time threshold in the first scenario is less than the preset time threshold in the second scenario.
[0020] In some embodiments, the control method further includes: when the accumulated time does not reach the preset time threshold, the accumulated time is reset to zero, and the process returns to execute acquisition of the detection data collected by the sensor module.
[0021] In some embodiments, the control method further includes: after the prompt message is issued, the accumulated duration is reset to zero, and the process returns to execute acquisition of the detection data collected by the sensor module.
[0022] The present application also provides an earphone, which includes a sensor module and a control module; the sensor module is used to collect detection data; the control module is communicatively connected to the sensor module, and is used to execute the control method described in any one of the above embodiments.
[0023] In some embodiments, the earphones in the above embodiments are bone conduction earphones or air conduction earphones.
[0024] The present application also provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the control method described in any one of the above-mentioned embodiments is implemented.
[0025] In the control method of the headset, the headset and the computer-readable storage medium provided by the present application, the control module of the headset can determine the current state of the head of the user wearing the headset by detecting data and a preset state threshold, judge whether the head is in the second state, and accumulate the length of time the head is continuously in the second state. When the accumulated length of time reaches the preset length of time threshold, a prompt message is issued to prompt the user that the user has been in the second state for a certain length of time, prompting the user that the user is in a fatigued state and needs to change the current state of the head to avoid the user's head being in the same state for a long time, thereby avoiding fatigue caused by the head being in the same state for a long time.
[0026] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0028] Figure 1 It is a flowchart of the control method of the headset of the present application;
[0029] Figure 2 is a three-dimensional schematic diagram of headphones according to certain embodiments of the present application;
[0030] Figure 3 yes Figure 2 A three-dimensional schematic diagram of the structure of part of the middle earphone;
[0031] Figure 4 is a flowchart of a method for controlling headphones in some implementation modes of the present application;
[0032] Figure 5 is a flowchart of a method for controlling headphones in some implementation modes of the present application;
[0033] Figure 6is a flowchart of a method for controlling headphones in some implementations of the present application;
[0034] Figure 7 is a flowchart of a method for controlling headphones in other embodiments of the present application;
[0035] Figure 8 is a flowchart of a method for controlling headphones in other embodiments of the present application;
[0036] Fig. 9 Schematic diagram of the flow of the headset control method of other embodiments of the present application
[0037] Fig.10 is a flowchart of a method for controlling headphones in some embodiments of the present application;
[0038] Fig.11 is a flowchart of a method for controlling headphones in some embodiments of the present application;
[0039] Fig.12 is a flowchart of a method for controlling headphones in some embodiments of the present application;
[0040] Fig.13 is a flowchart of a method for controlling headphones in some implementation modes of the present application;
[0041] Fig.14 is a schematic diagram of the structure of the interaction between the headset and the external device in some embodiments of the present application;
[0042] Fig.15 is a flowchart of a method for controlling headphones in certain embodiments of the present application;
[0043] Fig.16 is a flowchart of a method for controlling headphones in certain embodiments of the present application;
[0044] Fig.17 is a flowchart of a method for controlling headphones in certain embodiments of the present application;
[0045] Fig.18 It is a schematic diagram of the connection status of a computer-readable storage medium and a processor in certain embodiments of the present application.
[0046] Description of main component symbols:
[0047] Headphones 10;
[0048] Control module 11; sensor module 12; gyroscope 121; accelerometer 122; prompt module 14; instruction receiving module 15;
[0049] Battery box 117; control box 119.
[0050] Processor 20;
[0051] Computer readable storage medium 200 ; program 202 . DETAILED DESCRIPTION
[0052] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.
[0053] As a wearable device, earphones support users to wear them in sports and daily life scenarios. Therefore, earphones can collect data from users wearing earphones. Most modern working methods are sitting and sitting for long periods of time. In the scene of deep concentration, the user's head is basically in a stable state facing the screen, with less head movement and a fixed posture. A large number of studies have found that long-term exposure to sedentary environments at work is significantly correlated with discomfort and pain in the neck, shoulders, and back. Among them, head inactivity is more highly correlated with neck discomfort. During cycling, because the eyes need to look straight ahead, the cervical spine will be in a hyperextended state, and the muscles at the back of the neck will continue to work to maintain balance. Long-term cycling will keep the cervical spine in this high-pressure posture for a long time, increasing the risk of neck strain injury. However, the human body often cannot know in time that it is in a fatigued state. The present application aims to determine whether the user's head has been in a relatively static state (that is, a fatigued state) for a long time through earphones 10, and to remind the user when the user is in a fatigued state. In order to solve the above problems, the present application provides an earphone 10 (such as Figure 2 , Figure 3 and Fig.14 as shown), earphone control method (as shown Figure 1 , Figures 4 to 12 , Figures 15 to 17 As shown), and a computer readable storage medium (such as Fig.18 shown).
[0054] See also Figures 1 to 3 , the headset control method of the embodiment of the present application includes:
[0055] 02: Acquire the detection data collected by the sensor module 12;
[0056] 05: Determine the current state of the head of the user wearing the headset 10 according to the detection data and the preset state threshold, the current state includes a first state and a second state, and the movement amplitude of the user's head in the first state is greater than the movement amplitude of the user's head in the second state;
[0057] 07: when the current state is the second state, the accumulated time duration that the user's head is continuously in the second state; and
[0058] 091: When the accumulated duration reaches the preset duration threshold, a prompt message is issued.
[0059] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11, a sensor module 12, a prompt module 14 and an instruction receiving module 15.
[0060] Specifically, the earphone 10 is an audio device, which is mainly used for sound-to-electric conversion, such as converting audio signals into sound, so that users can listen to music, movies, games or other audio content, or converting sound into electrical signals. The design of the earphone 10 is intended to provide a private listening environment, so that users can enjoy the audio content alone without affecting the people around them. The earphone 10 can be worn on the user's ear and can be used in conjunction with mobile phones, computers, smart wearable devices (such as smart watches, smart bracelets, smart glasses and smart helmets, etc.), head-mounted display devices and virtual reality devices. The earphone 10 includes air conduction earphones and bone conduction earphones. Air conduction earphones, that is, air conduction earphones, are earphones that transmit sound through air vibrations. Bone conduction earphones, that is, bone conduction earphones, are earphones that convert sound into different mechanical vibrations and transmit sound waves through the human skull, bony labyrinth, inner ear lymph, spiral organ, auditory center, etc. Air conduction earphones and bone conduction earphones can be applied to scenes, increasing the applicability of the earphone 10.
[0061] The earphone 10 includes a battery box assembly for placing batteries and / or a control box assembly with a control function. The control box assembly includes a control box 119, and the battery box assembly includes a battery box 117. The control box 119 can be used to control the power on and off of the earphone 10 and adjust the volume of the earphone 10, and the battery box 117 is used to load batteries, and the batteries are used to power the earphone 10 so that the earphone 10 can work normally.
[0062] The earphone 10 also includes a to-be-connected part 13, which includes an ear hook 137 and / or a back hook 139. When the user wears the earphone 10, the back hook 139 of the earphone 10 is worn on the head, and the ear hook 137 of the earphone 10 is worn on the back of the ear, thereby improving the wearing stability of the earphone 10, and the earphone 10 is not easy to fall off when the user is outdoors or exercising. The back hook 139 is used to connect the battery box 117 and the control box 119. The earphone 10 also includes a transducer component 30, and the ear hook 137 is used to connect the battery box 117 and the transducer component 30, and to connect the control box 119 and the transducer component 30. The transducer component 30 is used to fit with the skin of the human body. When the earphone 10 is in use, the transducer component 30 can vibrate mechanically to enable the user to hear the sound.
[0063] More specifically, the headset 10 further includes a control module 11 , a sensor module 12 , a prompt module 14 and an instruction receiving module 15 .
[0064] The control module 11 is a module inside the earphone 10 that is responsible for processing various data and coordinating various functions (including but not limited to audio processing, connecting devices, power management, user interaction, etc.). The control module 11 is in communication connection with the sensor module 12. Among them, the control module 11 and the sensor module 12 can form a wired communication connection through a data line, or a wireless communication connection through a wireless signal. The control module 11 obtains the detection data collected by the sensor module 12 in a manner that the control module 11 directly reads the detection data collected by the sensor module 12; the control module 11 periodically sends a request to poll the sensor module 12 to obtain the latest detection data; or the sensor module 12 and the control module 11 are wirelessly connected, and the control module 11 obtains the detection data collected by the sensor module 12 through a wireless communication protocol.
[0065] The sensor module 12 is a module for collecting detection data. The sensor module 12 can monitor and collect signals of the user in the process of wearing the headset 10 in real time, and transmit the detection data formed by the signal to the control module 11. The sensor module 12 includes but is not limited to one or more of an inertial measurement unit (IMU), a pressure sensor, an electrocardiogram sensor, an electrocardiogram sensor, and a temperature sensor. The detection data includes but is not limited to one or more of three-axis acceleration, three-axis angular acceleration, pressure, heart rate, and temperature. The detection data collected by the sensor module 12 can be relevant data of the human body (such as heart rate) or relevant data of the external environment (such as ambient temperature). The headset 10 of the present application includes at least one sensor module 12. In an embodiment in which the headset 10 includes multiple sensor modules 12, the types of detection data collected by different sensor modules 12 can be the same or different. The detection data formed by the signal can represent the current state of the user. The way in which the sensor module 12 collects detection data includes but is not limited to sampling at a constant sampling rate, sampling at a variable sampling rate, and sampling at a time window. In the present application, the sensor samples at a constant sampling rate. More specifically, the present application obtains a set of sampled data at intervals of one second. The constant sampling rate is simple and convenient, and can continuously collect detection data to achieve continuous monitoring, and it is not easy to miss state changes in the detection data.
[0066] The prompt module 14 is used to issue prompt information, including but not limited to voice prompt, action prompt (eg, vibration), text prompt, graphical interface prompt, etc. or any combination thereof.
[0067] The instruction receiving module 15 is used to receive instructions sent by external devices (such as Fig.14 As shown), the external device includes at least one of a mobile phone, a watch, a server, a computer and a tablet computer.
[0068] In some embodiments, the instruction receiving module 15 includes an input module (not shown) disposed on the control box 117 or the battery box 119, the input module is used to input user instructions, and the input module includes at least one of a key and a touch screen. The input module is used to input user instructions, and the user instructions at least include a scene entry instruction, so that the control module 11 can determine whether the current scene is in the second scene based on whether the instruction receiving module 15 receives the scene entry instruction.
[0069] In some embodiments, the instruction receiving module 15 also includes a communication module (not shown), and the communication module includes the instruction receiving module 15 disposed in the control box 117 or the battery box 119. Specifically, the instruction receiving module 15 can receive instructions sent by an external device, and the communication module transmits the instructions to the control module 11.
[0070] In the method of 02, the sensor module 12 is used to collect detection data. The control module 11 is used to obtain the detection data collected by the sensor module 12; determine the current state of the head of the user wearing the headset 10 according to the detection data and the preset state threshold, the current state includes a first state and a second state, the movement amplitude of the user's head in the first state is greater than the movement amplitude of the user's head in the second state; when the current state is the second state, the duration of the user's head being in the second state is accumulated. The prompt module 14 is used to issue a prompt message when the accumulated duration reaches the preset duration threshold.
[0071] In the method of 05, the preset state threshold is a predefined parameter used to distinguish different current states of the user's head. It is understandable that the earphone 10 is worn on the human head, and the sensor module 12 is at least capable of collecting detection data of the user's head, and determining the current state of the head of the user wearing the earphone 10 based on the detection data and the preset state threshold. More specifically, the preset state threshold may include an acceleration threshold, which is used to characterize the intensity of the movement of the head; the preset state threshold may include an angular velocity threshold, which is also used to characterize the intensity of the movement of the head; the preset state threshold may include a temperature threshold, which is used to characterize whether the user wearing the earphone 10 is in a healthy state.
[0072] In the embodiment of the present application, the current state includes a first state and a second state, and the movement amplitude of the user's head in the first state is greater than the movement amplitude of the user's head in the second state. More specifically, in the first state, the user's head has a more significant movement, and the movement amplitude is large, such as rapid rotation of the head, large tilt of the head, or frequent movement of the head. For example, the user may be in the first state when swimming, playing basketball, etc. In the second state, the user's head has no significant movement, the movement amplitude is small, or even stationary. For example, the user may be in the second state when reading or riding a long distance. For example, the first state usually refers to the motion state, and the second state usually refers to the static state. Among them, the movement amplitude in the motion state is greater than the preset first motion amplitude threshold, and the movement amplitude in the static state is less than the preset second motion amplitude threshold, the first motion amplitude threshold> the second motion amplitude threshold, and the second motion amplitude threshold can be zero or a smaller value greater than zero. In addition, the motion amplitude can refer to the displacement on the three axes (X, Y and Z), or the rotation angle around the three axes (X, Y and Z).
[0073] In the method of 07, when the control module 11 recognizes that the current state is the second state, the control module 11 accumulates the time the user's head is continuously in the second state. Thus, the control module 11 can obtain the time the user is in the second state, that is, the control module 11 can obtain the time the user is in the current state with a small motion amplitude, so as to provide data for subsequent methods.
[0074] In the method of 091, the preset duration threshold is a parameter predefined by the control module 11, which is used by the control module 11 to determine the size of the accumulated duration and serves as a basis for the prompt module 14 to issue a prompt message. The way of issuing the prompt message includes but is not limited to sending an audio prompt and sending a vibration prompt.
[0075] In the control method of the earphones of the present application, the control module 11 of the earphones 10 can determine the current state of the head of the user wearing the earphones 10 by detecting data and a preset state threshold, judge whether the head is in the second state, and accumulate the duration for which the head is continuously in the second state. When the accumulated duration reaches the preset duration threshold, a prompt message is issued to prompt the user that the user has been in the second state for a certain period of time, prompting the user to change the current state of the head to avoid the user's head being in the same state for a long time, thereby avoiding fatigue caused by the head being in the same state for a long time.
[0076] See also Figures 2 to 4 In some embodiments, the sensor module 12 includes an accelerometer 122, the detection data includes the three-axis acceleration detected by the accelerometer 122, and the preset state threshold includes a preset acceleration difference threshold ka. The method of 05 includes:
[0077] 051: Determine the current state of the head of the user wearing the headset 10 according to the three-axis acceleration and the acceleration difference threshold ka within a preset time window.
[0078] The above-mentioned earphone control method can be applied to the earphone 10, and the control module 11 is further used to determine the current state of the head of the user wearing the earphone 10 according to the three-axis acceleration and the acceleration difference threshold ka within a preset time window.
[0079] Specifically, the accelerometer 122 can collect and measure the acceleration of the head in three spatial dimensions (X, Y, and Z axes). That is, when the user wears the headset 10 on his head, the accelerometer 122 can measure the three-axis acceleration of the head, which includes X-axis acceleration, Y-axis acceleration, and Z-axis acceleration. The X-axis acceleration characterizes the change in the movement speed of the head along the X-axis direction, the Y-axis acceleration characterizes the change in the movement speed of the head along the Y-axis direction, and the Z-axis acceleration characterizes the change in the movement speed of the head along the Z-axis direction. Therefore, the three-axis acceleration includes accelerations in three spatial dimensions. Compared with the single-axis acceleration, the three-axis acceleration can fully express the overall acceleration of the head.
[0080] In the method of 051, the preset time window is the time range of the acquired three-axis acceleration. For example, the preset time window can be a time window with a fixed length but rolling with time, and the control module 11 acquires the detection data collected by the sensor module 12 at a constant time interval. For example, the preset time window has a fixed length of 5 minutes, then the control module 11 takes the current moment as the center, and acquires the three-axis acceleration data collected by the sensor module 12 at the current moment, the three-axis acceleration data collected by the sensor module 12 2 minutes before the current moment, and the three-axis acceleration data collected by the sensor module 12 2 minutes after the current moment. At the next moment, the control module 11 takes the next moment as the center, and acquires the three-axis acceleration data collected by the sensor module 12 at the next moment, the three-axis acceleration data collected by the sensor module 12 2 minutes before the next moment, and the three-axis acceleration data collected by the sensor module 12 2 minutes after the next moment. Using the time window to collect detection data can reduce the interference of related data, improve the accuracy of the control module 11 in determining the current state of the head of the user wearing the headset 10, and can also reduce the calculation burden of the control module 11, and avoid excessive detection data, resulting in a heavy burden on the control module 11. The rolling time window can provide continuous and time-sequential three-axis acceleration data, which can more accurately reflect the current state of the head of the user wearing the headset 10.
[0081] The acceleration difference threshold ka is a preset parameter. The user's state is determined by comparing the three-axis acceleration data within a preset time window with the acceleration difference threshold ka. The specific determination method is further described below.
[0082] See also Figure 3 and Figure 5 In certain embodiments, the method of 051 comprises:
[0083] 0511: Fusing the three-axis accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values An (n is a natural number greater than 1) corresponding to the multiple predetermined moments respectively;
[0084] 0513: Filter out the maximum fusion acceleration value Amax and the minimum fusion acceleration value Amin from multiple fusion acceleration values An;
[0085] 0515: Obtaining the acceleration difference ΔA according to the maximum value Amax of the fused acceleration and the minimum value Amin of the fused acceleration; and
[0086] 0517: Determine the current state of the head of the user wearing the headset 10 according to the acceleration difference ΔA and the acceleration difference threshold ka.
[0087] The above-mentioned earphone control method can be applied to the earphone 10, and the control module 11 is also used to: fuse the three-axis accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values An corresponding to the multiple predetermined moments; screen out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from the multiple fused acceleration values An; obtain the acceleration difference ΔA according to the maximum fused acceleration value Amax and the minimum fused acceleration value Amin; and determine the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA and the acceleration difference threshold ka.
[0088] Specifically, in the method of 0511, a plurality of groups of three-axis accelerations are included in the preset time window, and each group of three-axis accelerations includes at least X-axis acceleration, Y-axis acceleration and Z-axis acceleration. The three-axis accelerations at the multiple predetermined moments are fused respectively to obtain the fused acceleration values at the multiple predetermined moments. It is understandable that the fusion process includes filtering and denoising, and the filtering includes but is not limited to Kalman filtering, Gaussian filtering and median filtering. Filtering can remove part of the noise in the three-axis acceleration and improve the accuracy of the fused acceleration value.
[0089] For example, within the preset time window T corresponding to the current time t0, the three-axis acceleration a1 at the predetermined time t1 (which is the set of X, Y, Z three-axis accelerations ax1, ay1 and az1), the three-axis acceleration a2 at the predetermined time t2 (which is the set of X, Y, Z three-axis accelerations ax2, ay2 and az2), the three-axis acceleration a3 at the predetermined time t3 (which is the set of X, Y, Z three-axis accelerations ax3, ay3 and az3)... the three-axis acceleration an at the predetermined time tn (which is the set of X, Y, Z three-axis accelerations axn, ayn and azn), after the three-axis accelerations are fused respectively, the three-axis acceleration a1 is fused to obtain the fused acceleration value A1 at the predetermined time t1, the three-axis acceleration a2 is fused to obtain the fused acceleration value A2 at the predetermined time t2, the three-axis acceleration a3 is fused to obtain the fused acceleration value A3 at the predetermined time t3... the three-axis acceleration an is fused to obtain the fused acceleration value An at the predetermined time tn. The fused acceleration value carries more information and can more accurately represent the current state of the head of the user wearing the headset 10 than the non-fused acceleration value. The fusion process also helps to eliminate occasional abnormal values or instantaneous large fluctuations, making the 0511 method more resistant to interference and robust.
[0090] In the method of 0513, the control module 11 selects the maximum fusion acceleration value Amax and the minimum fusion acceleration value Amin from multiple fusion acceleration values, that is, within the preset time window T, the maximum value among the fusion acceleration values A1, A2, A3...An is selected as the maximum fusion acceleration value Amax, and the minimum value among the fusion acceleration values A1, A2, A3...An is selected as the minimum fusion acceleration value Amin. The maximum fusion acceleration value Amax and the minimum fusion acceleration value Amin are selected, the amount of data is small, and the screening method does not involve complex calculations. The control module 11 can directly obtain the activity range of the head of the user wearing the headset 10, and quickly respond to the activity range of the user's head, which is conducive to quickly responding to the current state of the head under multiple preset time windows.
[0091] In the method of 0515, the control module 11 makes a difference between the maximum fusion acceleration Amax and the minimum fusion acceleration Amin to obtain the acceleration difference ΔA, that is, ΔA=Amax-Amin. A large value of the acceleration difference ΔA indicates that the user's head has a large movement amplitude within the time window T, and the head may be moving quickly; a small value of the acceleration difference ΔA indicates that the user's head has a small movement amplitude within the time window T, and the head may be stationary relative to the user's body.
[0092] In the method of 0517, the control module 11 compares the acceleration difference ΔA with the acceleration difference threshold ka to determine the current state of the head of the user wearing the headset 10. The comparison method includes but is not limited to directly comparing the acceleration difference ΔA with the acceleration difference threshold ka (for example, directly calculating the difference between the acceleration difference ΔA and the acceleration difference threshold ka). The acceleration difference threshold ka can provide a direct standard for the control module 11, and the control module 11 can directly distinguish the size of the acceleration difference ΔA, which is convenient for the subsequent calculation of the control module 11.
[0093] See also Figure 2 and Figure 6 In certain embodiments, the method of 0517 comprises:
[0094] 05171: in the case of ΔA>ka, determining that the current state of the head of the user wearing the headset 10 is the first state;
[0095] 05173: When ΔA<ka, it is determined that the current state of the head of the user wearing the headset 10 is the second state.
[0096] The above-mentioned earphone control method can be applied to the earphone 10, and the control module 11 is also used to: when ΔA>ka, determine that the current state of the head of the user wearing the earphone 10 is the first state; when ΔA<acceleration difference threshold ka, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0097] In addition, when ΔA=ka, the control module 11 can determine whether the current state of the head of the user wearing the headset 10 is the first state or the second state, which can be set according to the needs. The control module 11 simplifies the logic of current state judgment by setting a clear acceleration difference threshold ka. By judging the magnitude relationship between the acceleration difference ΔA and the acceleration difference threshold ka, the current state of the user's head can be directly divided into the first state and the second state, which is conducive to real-time and rapid judgment of the current state of the user's head when the sensor module 12 collects detection data in real time.
[0098] See also Figure 3 and Figure 7 In some embodiments, the sensor module 12 includes a gyroscope 121, the detection data includes the three-axis angular velocity detected by the gyroscope 121, the preset state threshold includes a preset angular velocity difference threshold kω, and the method of 05 further includes:
[0099] 053: Determine the current state of the head of the user wearing the headset 10 according to the three-axis angular velocity and the angular velocity difference threshold kω within a preset time window.
[0100] The above-mentioned earphone control method can be applied to the earphone 10 , and the control module 11 is further used to determine the current state of the head of the user wearing the earphone 10 according to the three-axis angular velocity and the angular velocity difference threshold kω within a preset time window.
[0101] Specifically, the gyroscope 121 can measure the angular velocity of the head in three spatial dimensions (X, Y, and Z axes), and the three-axis angular velocity includes the X-axis angular velocity, the Y-axis angular velocity, and the Z-axis angular velocity. The X-axis angular velocity represents the angular change of the head rotating around the X-axis, the Y-axis angular velocity represents the angular change of the head rotating around the Y-axis, and the Z-axis angular velocity represents the angular change of the head rotating around the Z-axis. Therefore, the three-axis angular velocity includes the angular velocity of three spatial dimensions. Compared with the single-axis angular velocity, the three-axis angular velocity can fully express the overall angular velocity of the head.
[0102] In the method of 053, the preset time window is also the time range of the acquired three-axis angular velocity. For example, the preset time window can be a time window with a fixed length but rolling with time, and the control module 11 acquires the detection data collected by the sensor module 12 at a constant time interval. For example, the preset time window has a fixed length of 5 minutes, then the control module 11 takes the current moment as the center, and acquires the three-axis angular velocity data collected by the sensor module 12 at the current moment, the three-axis angular velocity data collected by the sensor module 12 2 minutes before the current moment, and the three-axis angular velocity data collected by the sensor module 12 2 minutes after the current moment. At the next moment, the control module 11 takes the next moment as the center, and acquires the three-axis angular velocity data collected by the sensor module 12 at the next moment, the three-axis angular velocity data collected by the sensor module 12 2 minutes before the next moment, and the three-axis angular velocity data collected by the sensor module 12 2 minutes after the next moment. The effect of using the time window to collect detection data is the same as before, and will not be repeated here.
[0103] The angular velocity difference threshold kω is a preset parameter. The user's state is determined by comparing the three-axis angular velocity data within a preset time window with the angular velocity difference threshold kω. The specific determination method is further described below.
[0104] See also Figure 3 and Figure 8 In certain embodiments, the method of 053 comprises:
[0105] 0531: Fusing the three-axis angular velocities at multiple predetermined moments within a preset time window to obtain multiple fused angular velocity values Ωm (m is a natural number greater than 1) corresponding to the multiple predetermined moments respectively;
[0106] 0533: Filter out the maximum fusion angular velocity Ωmax and the minimum fusion angular velocity Ωmin from multiple fusion angular velocity values Ωm;
[0107] 0535: Obtaining an angular velocity difference ΔΩ according to a maximum fused angular velocity Ωmax and a minimum fused angular velocity Ωmin; and
[0108] 0537: Determine the current state of the head of the user wearing the headset 10 according to the angular velocity difference ΔΩ and the angular velocity difference threshold kω.
[0109] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11, and the control module 11 is also used to: fuse the three-axis angular velocities at multiple predetermined moments in a preset time window to obtain multiple fused angular velocity values Ωm corresponding to the multiple predetermined moments; screen out the maximum fused angular velocity Ωmax and the minimum fused angular velocity Ωmin from the multiple fused angular velocity values Ωm; obtain the angular velocity difference ΔΩ based on the maximum fused angular velocity Ωmax and the minimum fused angular velocity Ωmin; and determine the current state of the head of the user wearing the earphone 10 according to the angular velocity difference ΔΩ and the angular velocity difference threshold kω.
[0110] Specifically, in the method of 0531, a plurality of groups of three-axis angular velocities are included in the preset time window, and each group of three-axis angular velocities includes at least the X-axis angular velocity, the Y-axis angular velocity and the Z-axis angular velocity. The three-axis angular velocities at the multiple predetermined moments are fused respectively to obtain the fused angular velocity values at the multiple predetermined moments. It is understandable that the fusion process includes filtering and denoising, and the filtering includes but is not limited to Kalman filtering, Gaussian filtering and median filtering. Filtering can remove part of the noise in the three-axis angular velocity and improve the accuracy of the fused angular velocity value.
[0111] For example, the preset time window T corresponding to the current time t0 includes the three-axis angular velocity ω1 at the predetermined time t1 (which is the set of X, Y, Z three-axis accelerations ωx1, ωy1 and ωz1), the three-axis angular velocity ω2 at the predetermined time t2 (which is the set of X, Y, Z three-axis accelerations ωx2, ωy2 and ωz2), the three-axis angular velocity ω3 at the predetermined time t3 (which is the set of X, Y, Z three-axis accelerations ωx3, ωy3 and ωz3)... The three-axis angular velocity ω3 at the predetermined time t3 (which is the set of X, Y, Z three-axis accelerations ωx3, ωy3 and ωz3) at the predetermined time tm Angular velocity ωm (which is a collection of X, Y, Z three-axis acceleration ωxm, ωym and ωzm), after the three-axis angular velocities are fused separately, the three-axis angular velocity ω1 is fused to obtain the fused angular velocity value Ω1 at the predetermined time t1, the three-axis angular velocity ω2 is fused to obtain the fused angular velocity value Ω2 at the predetermined time t2, the three-axis angular velocity ω3 is fused to obtain the fused angular velocity value Ω3 at the predetermined time t3... The three-axis angular velocity ωm is fused to obtain the fused angular velocity value Ωm at the predetermined time tm. The fused angular velocity value Ωm carries more information, and compared with the non-fused acceleration value, it can more accurately characterize the current state of the head of the user wearing the headset 10, and can better characterize the change in the rotation angle of the user's head. The fusion process also helps to eliminate occasional abnormal values or large instantaneous fluctuations, making the 0531 method more resistant to interference and robust.
[0112] In the method of 0533, the control module 11 selects the maximum fusion angular velocity Ωmax and the minimum fusion angular velocity Ωmin from multiple fusion angular velocity values, that is, within the preset time window T, the maximum value among the fusion angular velocity values Ω1, fusion angular velocity values Ω2, fusion angular velocity values Ω3...fusion angular velocity values Ωm is selected as the maximum fusion angular velocity Ωmax, and the minimum value among the fusion angular velocity values Ω1, fusion angular velocity values Ω2, fusion angular velocity values Ω3...fusion angular velocity values Ωm is selected as the minimum fusion angular velocity Ωmim. The maximum fusion angular velocity Ωmax and the minimum fusion angular velocity Ωmim are selected, the amount of data is small, and the screening method does not involve complex calculations. The control module 11 can directly obtain the activity range of the head of the user wearing the headset 10, and quickly respond to the activity range of the user's head, which is conducive to quickly responding to the current state of the head under multiple preset time windows.
[0113] In the method of 0535, the control module 11 makes a difference between the maximum value of the fused angular velocity Ωmax and the minimum value of the fused angular velocity Ωmim to obtain the angular velocity difference ΔΩ, that is, ΔΩ=Ωmax-Ωmim. A large value of the angular velocity difference ΔΩ indicates that the user's head has a large movement amplitude within the time window T, and the head may be rotating greatly; a small value of the angular velocity difference ΔΩ indicates that the user's head has a small movement amplitude within the time window T, and the head may be stationary relative to the user's body.
[0114] In the method of 0537, the control module 11 compares the angular velocity difference ΔΩ with the angular velocity difference threshold kω to determine the current state of the head of the user wearing the headset 10. The comparison method includes but is not limited to directly comparing the angular velocity difference ΔΩ with the angular velocity difference threshold kω (for example, directly calculating the difference between the angular velocity difference ΔΩ and the angular velocity difference threshold kω). The angular velocity difference threshold kω can provide a direct standard for the control module 11, and the control module 11 can directly distinguish the size of the angular velocity difference ΔΩ, which is convenient for the subsequent calculation of the control module 11.
[0115] See also Figure 3 and Fig. 9 In certain embodiments, the method of 0537 comprises:
[0116] 05371: when ΔΩ>kω, determine that the current state of the head of the user wearing the headset 10 is the first state;
[0117] 05373: When ΔΩ<kω, it is determined that the current state of the head of the user wearing the headset 10 is the second state.
[0118] The above-mentioned earphone control method can be applied to the earphone 10, and the control module 11 is also used to: when ΔΩ>kω, determine that the current state of the head of the user wearing the earphone 10 is the first state; when ΔΩ<kω, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0119] In addition, when ΔΩ=kω, the control module 11 can determine whether the current state of the head of the user wearing the headset 10 is the first state or the second state, which can be set according to the requirements. The control module 11 simplifies the logic of the current state judgment by setting a clear angular velocity difference threshold kω. By judging the size of the angular velocity difference ΔΩ and the angular velocity difference threshold kω, the current state of the user's head can be directly divided into the first state and the second state, which is conducive to real-time and rapid judgment of the current state of the user's head when the sensor module 12 collects detection data in real time.
[0120] See also Figure 3 and Fig.10 In some embodiments, the sensor module 12 includes an accelerometer 122 and a gyroscope 121, the detection data includes three-axis acceleration detected by the accelerometer 122 and three-axis angular velocity detected by the gyroscope 121, and the preset state threshold includes a preset acceleration difference threshold ka and a preset angular velocity difference threshold kω; the method of 05 also includes:
[0121] 055: Determine the current state of the head of the user wearing the headset 10 according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold ka and the angular velocity difference threshold kω within a preset time window.
[0122] The above-mentioned earphone control method can be applied to the earphone 10, and the control module 11 is also used to determine the current state of the head of the user wearing the earphone 10 according to the three-axis acceleration, three-axis angular velocity, acceleration difference threshold ka and angular velocity difference threshold kω within a preset time window.
[0123] Specifically, the accelerometer 122 can collect three-axis acceleration as detection data, and the gyroscope 121 can collect three-axis angular velocity as detection data. The preset time window, three-axis acceleration, three-axis angular velocity, acceleration difference threshold ka, and angular velocity difference threshold kω are explained the same as the preset time window, three-axis acceleration, three-axis angular velocity, acceleration difference threshold ka, and angular velocity difference threshold kω in the previous text, and are not repeated here.
[0124] The sensor module 12 uses two different types of sensors (i.e., the accelerometer 122 and the gyroscope 121), which can provide two types of detection data (i.e., three-axis acceleration and three-axis angular velocity), providing more comprehensive and accurate detection data, thereby more comprehensively reflecting the current state of the head of the user wearing the headset 10. When one sensor is interfered with or the detection data noise is too large, the detection data collected by another sensor can be used as a supplement to improve the robustness of the control module 11.
[0125] See also Figure 3 and Fig.11 In certain embodiments, the method of 055 comprises:
[0126] 0551: Fusing the three-axis accelerations at multiple predetermined moments in a preset time window to obtain multiple fused acceleration values An corresponding to the multiple predetermined moments, and fusing the three-axis angular velocities at multiple predetermined moments in the preset time window to obtain multiple fused angular velocity values Ωm corresponding to the multiple predetermined moments;
[0127] 0553: selecting a maximum fusion acceleration value Amax and a minimum fusion acceleration value Amin from multiple fusion acceleration values An, and selecting a maximum fusion angular velocity value Ωmax and a minimum fusion angular velocity value Ωmin from multiple fusion angular velocity values Ωm;
[0128] 0555: Obtain the acceleration difference ΔA according to the maximum value Amax of the fused acceleration and the minimum value Amin of the fused acceleration, and obtain the angular velocity difference ΔΩ according to the maximum value Ωmax of the fused angular velocity and the minimum value Ωmin of the fused angular velocity; and
[0129] 0557: Determine the current state of the head of the user wearing the headset 10 based on the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω.
[0130] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11, and the control module 11 is also used to: fuse the three-axis accelerations at multiple predetermined moments in a preset time window to obtain multiple fused acceleration values An corresponding to the multiple predetermined moments, and fuse the three-axis angular velocities at multiple predetermined moments in the preset time window to obtain multiple fused angular velocity values Ωm corresponding to the multiple predetermined moments; select the fused acceleration maximum value Amax and the fused acceleration minimum value Amin from the multiple fused acceleration values An, and select the fused angular velocity maximum value Ωmax and the fused angular velocity minimum value Ωmin from the multiple fused angular velocity values Ωm; obtain the acceleration difference ΔA according to the fused acceleration maximum value Amax and the fused acceleration minimum value Amin, and obtain the angular velocity difference ΔΩ according to the fused angular velocity maximum value Ωmax and the fused angular velocity minimum value Ωmin; and determine the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω.
[0131] Specifically, in the method of 0551, the acquisition of multiple fused acceleration values An is consistent with that in the method of 0511, and the acquisition of multiple fused angular velocity values Ωm is consistent with that in the method of 0531, which will not be repeated here.
[0132] In the method of 0553, the acquisition of the maximum fusion acceleration Amax and the minimum fusion acceleration Amin is consistent with that in the method of 0513, and the acquisition of the maximum fusion angular velocity Ωmax and the minimum fusion angular velocity Ωmin is consistent with that in the method of 0533, which will not be repeated here.
[0133] In the method of 0555, the acquisition of the acceleration difference ΔA is consistent with that in the method of 0515, and the acquisition of the angular velocity difference ΔΩ is consistent with that in the method of 0535, which will not be described in detail here.
[0134] Among them, in methods 0551, 0553, and 0555, the data related to the three-axis acceleration and the three-axis angular velocity correspond to the same preset time window.
[0135] In the method of 0557, the control module 11 determines the current state of the head of the user wearing the headset 10 according to the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω. There are many ways to determine. For example, in the implementation of the threshold comparison method, the control module 11 can directly compare the acceleration difference ΔA and the angular velocity difference ΔΩ with the magnitude of the respective thresholds. The specific implementation is described in the methods of 05571 and 05573.
[0136] For another example, the control module 11 can determine the current state according to the ratio of the acceleration difference ΔA and the angular velocity difference ΔΩ to their respective thresholds. More specifically, the control module 11 sets the probability of acceleration to P1, and the control module 11 sets the probability of angular velocity to P2, the probability of acceleration P1 = acceleration difference ΔA / acceleration difference threshold ka, the probability of angular velocity P2 = angular velocity difference ΔΩ / angular velocity difference threshold kω, the probability of the current state is P, and the probability of the current state P = f(P1, P2) is obtained through a predetermined function f. When P is in the first interval, the current state is determined to be the first state, and when P is in the second interval, the current state is determined to be the second state.
[0137] For another example, the control module 11 may comprehensively evaluate the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω according to a pre-trained machine learning model to determine the current state.
[0138] In the method of 055, the fused acceleration value An carries more information, and can more accurately represent the acceleration information of the current state of the head of the user wearing the headset 10, and can more accurately represent the moving speed of the user's head, compared with the non-fused acceleration value; the fused angular velocity value Ωm carries more information, and can more accurately represent the angle information of the current state of the head of the user wearing the headset 10, and can more accurately represent the rotation angle change of the user's head, compared with the non-fused angular velocity value. The current state is determined by the acceleration difference ΔA obtained by the fused acceleration value, the angular velocity difference ΔΩ obtained by the fused angular velocity value, the acceleration difference threshold ka, and the angular velocity difference threshold kω, and the data is rich, so as to more comprehensively reflect the current state of the head of the user wearing the headset 10. In the case where the noise of one data (acceleration difference ΔA or angular velocity difference ΔΩ) is too large, another data (angular velocity difference ΔΩ or acceleration difference ΔA) can be used to obtain the current state of the head of the user wearing the headset 10 or correct the one data (acceleration difference ΔA or angular velocity difference ΔΩ), thereby improving the robustness of the control module 11.
[0139] Please refer to 3 and Fig.12 In certain embodiments, the method of 0557 comprises:
[0140] 05571: when ΔA>ka, and / or the angular velocity difference ΔΩ>kω, determining that the current state of the head of the user wearing the headset 10 is the first state;
[0141] 05573: When the acceleration difference ΔA<ka and the angular velocity difference ΔΩ<kω, it is determined that the current state of the head of the user wearing the headset 10 is the second state.
[0142] The above-mentioned earphone control method can be applied to the earphone 10, and the control module 11 is also used to: when ΔA>ka, and / or the angular velocity difference ΔΩ>kω, determine that the current state of the head of the user wearing the earphone 10 is the first state; when the acceleration difference ΔA<ka, and ΔΩ<kω, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0143] In addition, when ΔA=ka and ΔΩ=kω, the control module 11 can determine that the current state of the head of the user wearing the headset 10 is the first state or the second state, which can be set as required. The control module 11 determines the current state by comparing the acceleration difference ΔA with the acceleration difference threshold ka, and the angular velocity difference ΔΩ with the angular velocity difference threshold kω, with higher accuracy.
[0144] See also Figure 2 , Figure 3 and Fig.13 In some embodiments, the control method further comprises:
[0145] 03: Identify the current scene in which the headset 10 is located, where the current scene includes a first scene and a second scene; and
[0146] 04: Determine the preset state threshold according to the current scenario, the preset state threshold in the first scenario is less than the preset state threshold in the second scenario.
[0147] The above-mentioned earphone control method can be applied to earphone 10, and the control module 11 is also used to: identify the current scene in which the earphone 10 is located, the current scene includes a first scene and a second scene; and determine a preset state threshold according to the current scene, the preset state threshold under the first scene is less than the preset state threshold under the second scene.
[0148] Specifically, in the methods 03 and 04, the first scene is a sitting scene, and the second scene is a riding scene. It is understandable that in the riding scene, the road surface is relatively bumpy, the stability of the user's head may be low, and the user's head is prone to vibration or bumps. The preset state threshold in the first scene is smaller than the preset state threshold in the second scene, which can filter the normal signal agitation generated by the road surface during riding and reduce the noise of the detection data.
[0149] See also Figure 2 , Figure 3 , Fig.14 and Fig.15 In some embodiments, the headset 10 further includes an instruction receiving module 15, and the method 03 includes:
[0150] 031: Determine the current scene based on the three-axis acceleration and the instruction received by the instruction receiving module 15.
[0151] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the embodiment of the present application also includes an instruction receiving module 15, which is used to receive instructions; the control module 11 is also used to: determine the current scene based on the three-axis acceleration and the instructions received by the instruction receiving module 15.
[0152] Specifically, in the method of 031, the control module 11 can determine the current scene based on independent judgment of the three-axis acceleration, or based on independent judgment of the command received by the command receiving module 15, or based on the fusion judgment of the three-axis acceleration and the command received by the command receiving module 15. More specifically, the command received by the command receiving module 15 is sent by an external device, and the external device includes at least one of a mobile phone, a watch, a server, a computer and a tablet computer. This application only Fig.14 Only the process of the watch sending instructions to the headset 10 is shown. The user can turn on the riding mode through the buttons or touch screen of the watch, and the watch sends the instructions to the instruction receiving module 15, so that the headset 10 can recognize the current scene.
[0153] For example, when the current scene determined based on the three-axis acceleration is different from the current scene determined based on the instruction received by the receiving module, the prompt module 14 can issue an abnormal reminder to allow the user to determine whether the current scene is correct. The control module 11 determines the current scene in more than one way, which can improve the accuracy of the current scene recognition and reduce misjudgment.
[0154] See also Figure 2 , Figure 3 , Fig.14 , Fig.15 and Fig.16 In certain embodiments, the method of 031 comprises:
[0155] 0311: Determine whether the current scene is in the first scene based on the change of the Z-axis acceleration in the three-axis acceleration;
[0156] 0313: Determine whether the current scene is in the second scene based on whether the instruction receiving module 15 receives the scene entry instruction.
[0157] The above-mentioned earphone control method can be applied to earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11, and the control module 11 is also used to: determine whether the current scene is in the first scene based on the change of the Z-axis acceleration in the three-axis acceleration; determine whether the current scene is in the second scene based on whether the instruction receiving module 15 receives the scene entry instruction.
[0158] Specifically, in the method of 0311, the control module 11 can determine whether the current scene is in the first scene according to the change of Z-axis acceleration. Z-axis acceleration represents the acceleration of the user's head in the Z-axis direction (i.e., the vertical direction). When the user's head moves in the vertical direction, the Z-axis acceleration will also change. It can be understood that the direction of the Z-axis acceleration is opposite when the user is sitting and standing. That is, for the Z-axis acceleration when the user is sitting (regarded as the first Z-axis acceleration), the direction of the first Z-axis acceleration is the first direction, and for the Z-axis acceleration when the user is standing (regarded as the second Z-axis acceleration), the direction of the second Z-axis acceleration is the second direction, and the first direction and the second direction are opposite. Therefore, it can be determined whether the current scene is in the first scene by the change of Z-axis acceleration, and the first scene is the sitting scene.
[0159] In the method of 0313, the control module 11 determines whether the current scene is in the second scene, that is, whether the current scene is in the riding scene, based on whether the scene entry instruction is received by the instruction receiving module 15. The method of obtaining the scene entry instruction is direct, which improves the accuracy of the current scene recognition, and does not require the control module 11 to make a judgment, which can save the memory of the control module 11.
[0160] See also Figure 2 , Figure 3 and Fig.17 In some embodiments, the method for controlling the headset further includes:
[0161] 01: Setting a preset time threshold for the earphone 10 to be in different scenarios according to user input;
[0162] 043: Determine a preset duration threshold according to the current scenario, the preset duration threshold in the first scenario being smaller than the preset duration threshold in the second scenario.
[0163] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the implementation mode of the present application includes a control module 11, and the control module 11 is also used to: set a preset time threshold of the earphone 10 in different scenarios according to user input; identify the current scene in which the earphone 10 is located, and the current scene includes a first scene and a second scene; determine the preset time threshold according to the current scene, and the preset time threshold in the first scene is less than the preset time threshold in the second scene.
[0164] Specifically, different current scenes correspond to different preset duration thresholds, that is, the first scene corresponds to the preset duration threshold under the first scene, and the second scene corresponds to the preset duration threshold under the second scene. Therefore, according to the different current scenes, a preset duration threshold that is more suitable for the current scene can be set to make the subsequent current state judgment more accurate. The preset duration threshold under the first scene is smaller than the preset duration threshold under the second scene, which can reduce the time difference under the second scene.
[0165] See also Figure 2 , Figure 3 and Fig.17 In some embodiments, the control method further comprises:
[0166] If the accumulated time does not reach the preset time threshold, the accumulated time is reset to zero, and the process returns to execute the acquisition of the detection data collected by the sensor module 12 .
[0167] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11, and the control module 11 is also used to: when the accumulated time does not reach the preset time threshold, the accumulated time is cleared, and the detection data collected by the sensor module 12 is returned to be executed.
[0168] Specifically. The control method of the headset also includes 09: whether the accumulated duration reaches the preset duration threshold. That is, the control module 11 is used to determine whether the accumulated duration reaches the preset duration threshold. The method of 09 includes the method of 091. If the accumulated duration does not meet the method of 091, then when the accumulated duration does not reach the preset duration threshold, the accumulated duration is cleared, and the method returns to execute the acquisition of the detection data collected by the sensor module 12. During the time accumulated by the control module 11, the user's head may suddenly turn or move. If the current state of the head exceeds a certain threshold, for example, at a certain moment in any time window, the acceleration difference ΔA is greater than the acceleration difference threshold ka, and the angular velocity difference ΔΩ is greater than the angular velocity difference threshold kω, then the accumulated duration is cleared, and the control module 11 returns and re-executes the methods of 02, 05, 07, and 09.
[0169] See also Figure 2 , Figure 3 and Fig.17 In some embodiments, the control method further comprises:
[0170] After the prompt message is sent, the accumulated time is reset to zero, and the process returns to execute the acquisition of the detection data collected by the sensor module 12 .
[0171] The above-mentioned earphone control method can be applied to the earphone 10. The earphone 10 of the implementation mode of the present application includes a control module 11 and a prompt module 14. The control module 11 is also used for: after the prompt module 14 sends a prompt message, the accumulated time is reset to zero, and returns to execute the detection data collected by the sensor module 12.
[0172] Specifically, after the prompt module 14 issues the prompt information, the accumulated duration in the control module 11 is cleared, and the control module 11 returns to execute the method 02 and subsequent steps. Thus, the headset 10 can continuously determine the current state of the head of the user wearing the headset 10 according to the detection data and the preset state threshold, and issue the prompt information again when the accumulated duration reaches the preset duration threshold. The headset 10 is able to continuously detect the current state of the user's head.
[0173] See also Figure 2 , Figure 3 and Fig.18 The present application also provides a computer-readable storage medium 200 on which a program 202 is stored. When the program 202 is executed by the processor 20, the control method of any of the above-mentioned embodiments is implemented.
[0174] For example, when the program 202 is executed by the processor 20, the following control method is implemented:
[0175] 02: Acquire the detection data collected by the sensor module 12;
[0176] 05: Determine the current state of the head of the user wearing the headset 10 according to the detection data and the preset state threshold, the current state includes a first state and a second state, and the movement amplitude of the user's head in the first state is greater than the movement amplitude of the user's head in the second state;
[0177] 07: when the current state is the second state, the accumulated time duration that the user's head is continuously in the second state;
[0178] 091: When the accumulated duration reaches the preset duration threshold, a prompt message is issued.
[0179] For another example, when the program 202 is executed by the processor 20, the following control method is implemented:
[0180] 0551: Fusing the three-axis accelerations at multiple predetermined moments in a preset time window to obtain multiple fused acceleration values corresponding to the multiple predetermined moments, and fusing the three-axis angular velocities at multiple predetermined moments in the preset time window to obtain multiple fused angular velocity values corresponding to the multiple predetermined moments;
[0181] 0553: selecting a maximum fusion acceleration value Amax and a minimum fusion acceleration value Amin from multiple fusion acceleration values, and selecting a maximum fusion angular velocity value Ωmax and a minimum fusion angular velocity value Ωmin from multiple fusion angular velocity values;
[0182] 0555: Obtain the acceleration difference ΔA according to the maximum value Amax of the fused acceleration and the minimum value Amin of the fused acceleration, and obtain the angular velocity difference ΔΩ according to the maximum value and the minimum value of the fused angular velocity; and
[0183] 0557: Determine the current state of the head of the user wearing the headset 10 based on the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω.
[0184] For another example, when program 202 is executed by processor 20, it can also implement the control methods in 01, 02, 03, 031, 0311, 0313, 04, 043, 05, 051, 0511, 0513, 0515, 0517, 05171, 05173, 053, 0531, 0533, 0535, 0537, 05371, 05373, 055, 0551, 0553, 0555, 0557, 05571, 05573, 07, 09, 091, and 093.
[0185] In the computer-readable storage medium 200 in the present application, the control module 11 of the headset 10 can determine the current state of the head of the user wearing the headset 10 through detection data and a preset state threshold, judge whether the head is in the second state, and accumulate the length of time the head is continuously in the second state. When the accumulated length of time reaches the preset length of time threshold, a prompt message is issued to prompt the user that the user has been in the second state for a certain length of time, prompting the user to change the current state of the head to avoid the user's head being in the same state for a long time, thereby avoiding fatigue caused by the head being in the same state for a long time.
[0186] In the description of this specification, the descriptions with reference to the terms "certain embodiments", "in an example", "exemplarily", etc., mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.
[0187] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.
[0188] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A method for controlling headphones, characterized in that: The earphone includes a sensor module, and the control method includes: Acquiring detection data collected by the sensor module; Determine a current state of a head of a user wearing the headset according to the detection data and a preset state threshold, wherein the current state includes a first state and a second state, and a movement amplitude of the head of the user in the first state is greater than a movement amplitude of the head of the user in the second state; When the current state is the second state, accumulating the time duration that the user's head is continuously in the second state; and When the accumulated duration reaches the preset duration threshold, a prompt message is issued.
2. The control method according to claim 1, characterized in that: The sensor module includes an accelerometer, the detection data includes three-axis acceleration detected by the accelerometer, and the preset state threshold includes a preset acceleration difference threshold; The determining the current state of the head of the user wearing the headset according to the detection data and a preset state threshold comprises: The current state of the head of the user wearing the headset is determined according to the three-axis acceleration and the acceleration difference threshold within a preset time window.
3. The control method according to claim 2, characterized in that: The determining the current state of the head of the user wearing the headset according to the three-axis acceleration and the acceleration difference threshold within a preset time window includes: fusing the three-axis accelerations at a plurality of predetermined moments within the preset time window to obtain a plurality of fused acceleration values respectively corresponding to the plurality of predetermined moments; Screening out a maximum fusion acceleration value and a minimum fusion acceleration value from the plurality of fusion acceleration values; Obtaining an acceleration difference according to the maximum value of the fused acceleration and the minimum value of the fused acceleration; and The current state of the head of the user wearing the headset is determined according to the acceleration difference value and the acceleration difference threshold.
4. The control method according to claim 3, characterized in that: The determining, according to the acceleration difference value and the acceleration difference threshold, a current state of the head of the user wearing the headset comprises: When the acceleration difference is greater than the acceleration difference threshold, determining that the current state of the head of the user wearing the headset is the first state; When the acceleration difference value is less than the acceleration difference threshold, it is determined that the current state of the head of the user wearing the headset is the second state.
5. The control method according to claim 1, characterized in that: The sensor module includes a gyroscope, the detection data includes a three-axis angular velocity detected by the gyroscope, and the preset state threshold includes a preset angular velocity difference threshold; and determining the current state of the head of the user wearing the headset according to the detection data and the preset state threshold includes: The current state of the head of the user wearing the headset is determined according to the three-axis angular velocity and the angular velocity difference threshold within a preset time window.
6. The control method according to claim 5, characterized in that: The determining the current state of the head of the user wearing the headset according to the three-axis angular velocity and the angular velocity difference threshold within a preset time window includes: fusing the three-axis angular velocities at a plurality of predetermined moments within the preset time window to obtain a plurality of fused angular velocity values respectively corresponding to the plurality of predetermined moments; Screening out a maximum fusion angular velocity value and a minimum fusion angular velocity value from the plurality of fusion angular velocity values; Acquire an angular velocity difference according to the maximum fused angular velocity and the minimum fused angular velocity; and The current state of the head of the user wearing the headset is determined according to the angular velocity difference value and the angular velocity difference threshold.
7. The control method according to claim 6, characterized in that: The determining, according to the angular velocity difference and the angular velocity difference threshold, a current state of the head of the user wearing the headset comprises: When the angular velocity difference is greater than the angular velocity difference threshold, determining that the current state of the head of the user wearing the headset is the first state; and When the angular velocity difference is less than the angular velocity difference threshold, it is determined that the current state of the head of the user wearing the headset is the second state.
8. The control method according to claim 1, characterized in that: The sensor module includes an accelerometer and a gyroscope, the detection data includes three-axis acceleration detected by the accelerometer and three-axis angular velocity detected by the gyroscope, and the preset state threshold includes a preset acceleration difference threshold and a preset angular velocity difference threshold; The determining the current state of the head of the user wearing the headset according to the detection data and a preset state threshold comprises: The current state of the head of the user wearing the headset is determined according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold and the angular velocity difference threshold within a preset time window.
9. The control method according to claim 8, characterized in that: The determining the current state of the head of the user wearing the headset according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold and the angular velocity difference threshold within a preset time window includes: The three-axis accelerations at multiple predetermined moments in the preset time window are fused to obtain multiple fused acceleration values corresponding to the multiple predetermined moments, and the three-axis angular velocities at multiple predetermined moments in the preset time window are fused to obtain multiple fused angular velocity values corresponding to the multiple predetermined moments; Screening out a maximum fused acceleration value and a minimum fused acceleration value from the plurality of fused acceleration values, and screening out a maximum fused angular velocity value and a minimum fused angular velocity value from the plurality of fused angular velocity values; Acquire an acceleration difference value according to the maximum value of the fused acceleration and the minimum value of the fused acceleration, and acquire an angular velocity difference value according to the maximum value of the fused angular velocity and the minimum value of the fused angular velocity; and A current state of a head of a user wearing the headset is determined according to the acceleration difference value, the acceleration difference threshold value, the angular velocity difference value, and the angular velocity difference threshold value.
10. The control method according to claim 9, characterized in that: The determining, according to the acceleration difference value, the acceleration difference threshold value, the angular velocity difference value, and the angular velocity difference threshold value, a current state of the head of the user wearing the headset comprises: When the acceleration difference is greater than the acceleration difference threshold, and / or the angular velocity difference is greater than the angular velocity difference threshold, determining that the current state of the head of the user wearing the headset is the first state; When the acceleration difference is smaller than the acceleration difference threshold and the angular velocity difference is smaller than the angular velocity difference threshold, it is determined that the current state of the head of the user wearing the headset is the second state.
11. The control method according to claim 1, characterized in that: Also includes: Identifying a current scene in which the headset is located, where the current scene includes a first scene and a second scene; and A preset state threshold is determined according to the current scene, and the preset state threshold in the first scene is smaller than the preset state threshold in the second scene.
12. The control method according to claim 11, characterized in that: The sensor module includes an accelerometer, the detection data includes three-axis acceleration detected by the accelerometer, and the headset also includes an instruction receiving module; the identifying the current scene where the headset is located includes: The current scene is determined based on the three-axis acceleration and the instruction received by the instruction receiving module.
13. The control method according to claim 12, characterized in that: The determining the current scene based on the three-axis acceleration and the instruction received by the instruction receiving module includes: Determining whether the current scene is in the first scene based on a change in the Z-axis acceleration among the three-axis accelerations; Based on whether the instruction receiving module receives a scene entry instruction, it is determined whether the current scene is in the second scene.
14. The control method according to claim 13, characterized in that: The headset further comprises a control box assembly and a battery box assembly, wherein the control box assembly comprises a control box, and the battery box assembly comprises a battery box; The instruction receiving module includes an input module arranged on the control box or the battery box, the input module is used to input user instructions, and the input module includes at least one of a button and a touch screen; or, The headset also includes a communication module, which includes the instruction receiving module arranged in the control box or the battery box, and the instruction receiving module is used to receive instructions sent by an external device, and the external device includes at least one of a mobile phone, a watch, a server, a computer and a tablet computer.
15. The control method according to claim 1, characterized in that: Also includes: Setting a preset time threshold for the headset to be in different scenarios according to user input; The preset duration threshold is determined according to the current scenario, and the preset duration threshold in the first scenario is smaller than the preset duration threshold in the second scenario.
16. The control method according to claim 1, characterized in that: Also includes: If the accumulated time does not reach the preset time threshold, the accumulated time is reset to zero, and the process returns to execute acquisition of the detection data collected by the sensor module.
17. The control method according to claim 1, characterized in that: Also includes: After the prompt message is sent, the accumulated duration is reset to zero, and the process returns to execute acquisition of the detection data collected by the sensor module.
18. An earphone, characterized in that: The earphone comprises: A sensor module, used to collect detection data; and A control module is communicatively connected to the sensor module and is used to execute the control method described in any one of claims 1-17.
19. The earphone according to claim 18, characterized in that The earphones include air conduction earphones and bone conduction earphones.
20. A computer-readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, the control method described in any one of claims 1 to 17 is implemented.
Citation Information
Patent Citations
Head posture detection method and apparatus, and earphone
CN107493531A
Reminding method and device based on use of earphone
CN109451385A
Earphone state detection method and device, equipment and storage medium
CN113596656A
Riding safety control method, mobile terminal, wearable device and storage medium
CN115373509A
Exercise reminding method and electronic equipment
CN116416769A