Control Method of Headphone, Headphone and Computer-Readable Storage Medium
The earpiece uses sensors to detect static head positions and alert users, addressing the issue of prolonged static head and neck positions during computer work and cycling, thereby reducing fatigue.
Patent Information
- Application Number
- CN202411216867.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2025-07-15
- Estimated Expiration
- 2044-08-30
AI Technical Summary
In scenarios such as sitting and cycling, the user's head and neck are fixed for a long time, making it difficult to identify fatigue in a timely manner, increasing the risk of neck overwork and injury.
The detection data is collected through the sensor module in the headset, and the accelerometer and gyroscope are used to judge the motion amplitude and angular velocity of the user's head, and the head state is identified based on the preset state threshold, and a prompt is issued when the continuous rest time reaches the threshold.
Timely remind users to change their head status to avoid fatigue caused by long-term static periods and reduce the risk of neck fatigue damage.
Smart Images

Figure CN119316765B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of earphones, and more particularly, to a control method for an earphone, an earphone, and a computer-readable storage medium. Background Art
[0002] Currently, most modern working methods involve sitting in front of a computer. Along with long sedentary hours, and in a scenario of deep concentration, the user's head is basically in a stable state facing the screen, with less head movement and a tendency to maintain a fixed posture. The lack of head movement is highly correlated with neck discomfort. During cycling, since the human eyes need to look straight ahead, the cervical vertebrae will be in a hyperextended state, and long-term cycling will keep the cervical vertebrae in this high-pressure posture for a long time, increasing the risk of overwork injury to the neck. In the cases of sedentary and cycling, the long-term fixation of the head and neck will make the human body in a fatigued state. However, the human body often cannot timely know that it is already in a fatigued state. Summary of the Invention
[0003] Embodiments of this application provide a control method for an earphone, an earphone, and a computer-readable storage medium.
[0004] The earphone according to the embodiments of this application includes a sensor module. The control method of the earphone includes: obtaining detection data collected by the sensor module; determining the current state of the head of the user wearing the earphone according to the detection data and a preset state threshold, where the current state includes a first state and a second state, and the movement amplitude of the head of the user in the first state is greater than that in the second state; when the current state is the second state, accumulating the duration that the head of the user continuously stays in the second state; and when the accumulated duration reaches a preset duration threshold, sending a prompt message.
[0005] In some embodiments, the sensor module includes an accelerometer, the detection data includes the three-axis acceleration detected by the accelerometer, and the preset state threshold includes a preset acceleration difference threshold. The determining the current state of the head of the user wearing the earphone according to the detection data and the preset state threshold includes: determining the current state of the head of the user wearing the earphone according to the three-axis acceleration within a preset time window and the acceleration difference threshold.
[0006] In some embodiments, determining the current state of the head of the user wearing the earphone according to the triaxial acceleration and the acceleration difference threshold within a preset time window includes: fusing the triaxial accelerations at multiple predetermined moments within the preset time window to obtain multiple fused acceleration values respectively corresponding to the multiple predetermined moments; screening out the maximum fused acceleration value and the minimum fused acceleration value among the multiple fused acceleration values; obtaining an acceleration difference according to the maximum fused acceleration value and the minimum fused acceleration value; and determining the current state of the head of the user wearing the earphone according to the acceleration difference and the acceleration difference threshold.
[0007] In some embodiments, determining the current state of the head of the user wearing the earphone according to the acceleration difference and the acceleration difference threshold includes: when the acceleration difference is greater than the acceleration difference threshold, determining that the current state of the head of the user wearing the earphone is the first state; and when the acceleration difference is less than the acceleration difference threshold, determining that the current state of the head of the user wearing the earphone is the second state.
[0008] In some embodiments, the sensor module includes a gyroscope, the detection data includes triaxial angular velocities detected by the gyroscope, and the preset state threshold includes a preset angular velocity difference threshold. Determining the current state of the head of the user wearing the earphone according to the detection data and the preset state threshold includes: determining the current state of the head of the user wearing the earphone according to the triaxial angular velocities and the angular velocity difference threshold within a preset time window.
[0009] In some embodiments, determining the current state of the head of the user wearing the earphone according to the triaxial angular velocities and the angular velocity difference threshold within a preset time window includes: fusing the triaxial angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values respectively corresponding to the multiple predetermined moments; screening out the maximum fused angular velocity value and the minimum fused angular velocity value among the multiple fused angular velocity values; obtaining an angular velocity difference according to the maximum fused angular velocity value and the minimum fused angular velocity value; and determining the current state of the head of the user wearing the earphone according to the angular velocity difference and the angular velocity difference threshold.
[0010] In some embodiments, determining the current state of the head of the user wearing the earphone according to the angular velocity difference and the angular velocity difference threshold includes: when the angular velocity difference is greater than the angular velocity difference threshold, determining that the current state of the head of the user wearing the earphone is the first state; and when the angular velocity difference is less than the angular velocity difference threshold, determining that the current state of the head of the user wearing the earphone is the second state.
[0011] In some embodiments, the sensor module includes an accelerometer and a gyroscope, the detection data includes the three-axis acceleration detected by the accelerometer and the three-axis angular velocity detected by the gyroscope, and the preset state thresholds include a preset acceleration difference threshold and a preset angular velocity difference threshold. Determining the current state of the head of the user wearing the earphone according to the detection data and the preset state thresholds includes: determining the current state of the head of the user wearing the earphone according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold, and the angular velocity difference threshold within a preset time window.
[0012] In some embodiments, determining the current state of the head of the user wearing the earphone according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold, and the angular velocity difference threshold within a preset time window includes: fusing the three-axis accelerations at multiple predetermined moments within the preset time window to obtain multiple fused acceleration values respectively corresponding to the multiple predetermined moments, and fusing the three-axis angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values respectively corresponding to the multiple predetermined moments; screening out the maximum fused acceleration value and the minimum fused acceleration value from the multiple fused acceleration values, and screening out the maximum fused angular velocity value and the minimum fused angular velocity value from the multiple fused angular velocity values; obtaining an acceleration difference according to the maximum fused acceleration value and the minimum fused acceleration value, and obtaining an angular velocity difference according to the maximum fused angular velocity value and the minimum fused angular velocity value; and determining the current state of the head of the user wearing the earphone according to the acceleration difference, the acceleration difference threshold, the angular velocity difference, and the angular velocity difference threshold.
[0013] In some embodiments, determining the current state of the head of the user wearing the earphone according to the acceleration difference, the acceleration difference threshold, the angular velocity difference, and the angular velocity difference threshold includes: determining that the current state of the head of the user wearing the earphone is the first state when the acceleration difference is greater than the acceleration difference threshold and / or the angular velocity difference is greater than the angular velocity difference threshold; and determining that the current state of the head of the user wearing the earphone is the second state when the acceleration difference is less than the acceleration difference threshold and the angular velocity difference is less than the angular velocity difference threshold.
[0014] In some embodiments, the control method further includes: identifying the current scene where the earphone is located, the current scene including a first scene and a second scene; and determining a preset state threshold according to the current scene, the preset state threshold in the first scene being less than the preset state threshold in the second scene.
[0015] In some embodiments, the sensor module includes an accelerometer, the detection data includes the three-axis acceleration detected by the accelerometer, and the earphone further includes an instruction receiving module. Identifying the current scenario in which the earphone is located includes: determining the current scenario based on the three-axis acceleration and the instruction received by the instruction receiving module.
[0016] In some embodiments, determining the current scenario based on the three-axis acceleration and the instruction received by the instruction receiving module includes: determining whether the current scenario is in the first scenario based on the change in the Z-axis acceleration among the three-axis accelerations; determining whether the current scenario is in the second scenario based on whether the instruction receiving module receives a scenario entry instruction.
[0017] In some embodiments, the earphone further includes a control box assembly and a battery box assembly. The control box assembly includes a control box, and the battery box assembly includes a battery box. The instruction receiving module includes an input module disposed on the control box or the battery box. The input module is used for inputting user instructions, and the input module includes at least one of a button and a touch screen.
[0018] In some embodiments, the earphone further includes a control box assembly and a battery box assembly. The control box assembly includes a control box, and the battery box assembly includes a battery box. The earphone further includes a communication module. The communication module includes the instruction receiving module disposed on the control box or the battery box. The instruction receiving module is used for receiving instructions sent by an external device, and the external device includes at least one of a mobile phone, a watch, a server, a computer, and a tablet computer.
[0019] In some embodiments, the control method further includes: setting a preset duration threshold for the earphone in different scenarios according to user input; determining a preset duration threshold according to the current scenario, and the preset duration threshold in the first scenario is less than the preset duration threshold in the second scenario.
[0020] In some embodiments, the control method further includes: when the accumulated duration does not reach the preset duration threshold, clearing the accumulated duration and returning to execute acquiring the detection data collected by the sensor module.
[0021] In some embodiments, the control method further includes: after sending a prompt message, clearing the accumulated duration and returning to execute acquiring the detection data collected by the sensor module.
[0022] The present application also provides a headset, which includes a sensor module and a control module; the sensor module is used to collect detection data; the control module is communicatively connected to the sensor module and is used to execute the control method described in any one of the above embodiments.
[0023] In some embodiments, the headset in the above embodiments is a bone conduction headset or an air conduction headset.
[0024] The present application also provides a computer-readable storage medium, on which a program is stored. When the program is executed by a processor, the control method described in any one of the above embodiments is implemented.
[0025] In the control method of the headset, the headset, and the computer-readable storage medium provided by the present application, the control module of the headset can determine the current state of the head of the user wearing the headset through the detection data and a preset state threshold, judge whether the head is in a second state, and accumulate the duration of the head continuously being in the second state. When the accumulated duration reaches a preset duration threshold, a prompt message is sent to prompt the user that they have been in the second state for a certain duration, indicating that the user is in a fatigued state and needs to change the current state of the head, thus avoiding the head being in the same state for a long time and preventing fatigue caused by being in the same state for a long time.
[0026] Additional aspects and advantages of the embodiments of the present application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The above and / or additional aspects and advantages of the present application will become apparent and be readily understood from the following description of the embodiments in conjunction with the accompanying drawings, where:
[0028] Figure 1 is a schematic flowchart of the control method of the headset of the present application;
[0029] Figure 2 is a three-dimensional schematic diagram of the headset in some embodiments of the present application;
[0030] Figure 3 is Figure 2 a three-dimensional schematic diagram of a partial structure of the headset in
[0031] Figure 4 is a schematic flowchart of the control method of the headset in some embodiments of the present application;
[0032] Figure 5 is a schematic flowchart of the control method of the headset in some embodiments of the present application;
[0033] Figure 6Schematic diagram of the control method of the earphone according to some embodiments of the present application;
[0034] Figure 7 Schematic diagram of the control method of the earphone according to some other embodiments of the present application;
[0035] Figure 8 Schematic diagram of the control method of the earphone according to some other embodiments of the present application;
[0036] Figure 9 Schematic diagram of the control method of the earphone according to some other embodiments of the present application
[0037] Figure 10 Schematic diagram of the control method of the earphone according to some other embodiments of the present application;
[0038] Figure 11 Schematic diagram of the control method of the earphone according to some other embodiments of the present application;
[0039] Figure 12 Schematic diagram of the control method of the earphone according to some other embodiments of the present application;
[0040] Figure 13 Schematic diagram of the control method of the earphone according to some embodiments of the present application;
[0041] Figure 14 Schematic diagram of the interaction structure between the earphone and an external device according to some embodiments of the present application;
[0042] Figure 15 Schematic diagram of the control method of the earphone according to some embodiments of the present application;
[0043] Figure 16 Schematic diagram of the control method of the earphone according to some embodiments of the present application;
[0044] Figure 17 Schematic diagram of the control method of the earphone according to some embodiments of the present application;
[0045] Figure 18 Schematic diagram of the connection state between the computer-readable storage medium and the processor according to some embodiments of the present application.
[0046] Description of main component symbols:
[0047] Earphone 10;
[0048] Control module 11; Sensor module 12; Gyroscope 121; Accelerometer 122; Reminder module 14; Instruction receiving module 15;
[0049] Battery case 117; Control case 119.
[0050] Processor 20;
[0051] Computer-readable storage medium 200; Program 202. Detailed implementation manners
[0052] The following details the implementation manners of the present application. Examples of the implementation manners are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The implementation manners described below with reference to the accompanying drawings are exemplary only for explaining the implementation manners of the present application and should not be construed as a limitation on the implementation manners of the present application.
[0053] As a wearable device, the earphone supports users to wear and use it in sports and daily life scenarios. Therefore, the earphone can collect data of the user wearing the earphone. Most modern working methods are sedentary office work, accompanied by long sedentary hours. And in a scenario of deep concentration, the user's head is basically in a stable state facing the screen, with less head movement and a tendency to be fixed. A large number of studies have found that long-term exposure to a sedentary environment at work is significantly correlated with discomfort and pain in the neck, shoulders, and back. Among them, the inactivity of the head has a relatively high correlation with neck discomfort. During cycling, because the eyes need to look straight ahead, the cervical spine will be in a hyperextended state, and the muscles on the back of the neck continuously work to maintain balance. And long-term cycling will keep the cervical spine in this high-pressure posture for a long time, increasing the risk of overwork injury to the neck. However, the human body often cannot know in time that it is already in a fatigued state. The present application aims to determine whether the user's head is in a relatively stationary state (i.e., a fatigued state) for a long time through the earphone 10, and issue a reminder to the user when the user is in a fatigued state. To solve the above problems, the present application provides an earphone 10 (as shown in Figure 2 , Figure 3 and Figure 14 ), a control method of the earphone (as shown in Figure 1 , Figures 4 to 12 , Figures 15 to 17 ), and a computer-readable storage medium (as shown in Figure 18 ).
[0054] Please refer to Figures 1 to 3 . The control method of the earphone in the implementation manner of the present application includes:
[0055] 02: Obtain the detection data collected by the sensor module 12;
[0056] 05: Determine the current state of the head of the user wearing the earphone 10 according to the detection data and a preset state threshold. The current state includes a first state and a second state, and the movement amplitude of the user's head in the first state is greater than that in the second state;
[0057] 07: When the current state is the second state, accumulate the duration during which the user's head continuously remains in the second state; and
[0058] 091: When the accumulated duration reaches a preset duration threshold, send a prompt message.
[0059] The above control method of the earphone can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11, a sensor module 12, a prompt module 14, and an instruction receiving module 15.
[0060] Specifically, the earphone 10 is an audio device mainly used for electroacoustic conversion. For example, it converts an audio signal into sound so that the user can hear music, movies, games, or other audio content, or converts sound into an electrical signal. The earphone 10 is designed to provide a private listening environment so that the user can enjoy the audio content alone without disturbing the people around. The earphone 10 can be worn on the user's ear and can be used in cooperation with devices such as mobile phones, computers, smart wearable devices (such as smart watches, smart bracelets, smart glasses, and smart helmets), head-mounted display devices, and virtual reality devices. The earphone 10 includes an air-conduction earphone and a bone-conduction earphone. The air-conduction earphone, that is, an air-conduction headphone, is a headphone that transmits sound through air vibration. The bone-conduction earphone, that is, a bone-conduction headphone, is a headphone that converts sound into different mechanical vibrations and transmits sound waves through the human skull, bony labyrinth, inner ear lymph, spiral organ, auditory center, etc. The air-conduction earphone and the bone-conduction earphone can be applicable to different scenarios, increasing the applicability of the earphone 10.
[0061] The earphone 10 includes a battery box assembly for placing a battery and / or a control box assembly with control functions. The control box assembly includes a control box 119, and the battery box assembly includes a battery box 117. The control box 119 can be used to control the power on, power off of the earphone 10, and adjust the volume of the earphone 10. The battery box 117 is used to load the battery, and the battery is used to supply power to the earphone 10 so that the earphone 10 can work normally.
[0062] The earphone 10 further includes a to-be-connected member 13. The to-be-connected member 13 includes an earhook 137 and / or a rear hook 139. When the user wears the earphone 10, the rear hook 139 of the earphone 10 is worn on the head, and the earhook 137 of the earphone 10 is worn behind the ear, thereby improving the wearing stability of the earphone 10. In the case where the user is outdoors or exercising, the earphone 10 is not easily detached. The rear hook 139 is used to connect the battery box 117 and the control box 119. The earphone 10 further includes a transducer assembly 30. The earhook 137 is used to connect the battery box 117 and the transducer assembly 30, and is also used to connect the control box 119 and the transducer assembly 30. The transducer assembly 30 is used to fit with the human skin. When the earphone 10 is in use, the transducer assembly 30 can make the user hear sound through mechanical vibration.
[0063] More specifically, the earphone 10 further includes a control module 11, a sensor module 12, a prompt module 14, and an instruction receiving module 15.
[0064] The control module 11 is a module inside the earphone 10 responsible for processing various data and coordinating various functions (including but not limited to functions such as audio processing, connecting devices, power management, and user interaction). The control module 11 is communicatively connected to the sensor module 12. Among them, a wired communication connection can be formed between the control module 11 and the sensor module 12 through a data line, or a wireless communication connection can be formed through a wireless signal. The way for the control module 11 to obtain the detection data collected by the sensor module 12 can be that the control module 11 directly reads the detection data collected by the sensor module 12; it can be that the control module 11 periodically sends requests to poll the sensor module 12 to obtain the latest detection data; it can also be that a wireless connection is adopted between the sensor module 12 and the control module 11, and the control module 11 obtains the detection data collected by the sensor module 12 through a wireless communication protocol.
[0065] The sensor module 12 is a module for collecting detection data. The sensor module 12 can continuously monitor and collect signals of the user during the process of wearing the earphone 10, and transmit the detection data formed by the signals to the control module 11. The sensor module 12 includes one or more of, but is not limited to, an Inertial Measurement Unit (IMU), a pressure sensor, an electrocardiogram sensor, an electrocardiogram sensor, and a temperature sensor, etc. The detection data includes one or more of, but is not limited to, three-axis acceleration, three-axis angular acceleration, pressure, heart rate, and temperature, etc. The detection data collected by the sensor module 12 can be related data of the human body (such as heart rate), or can be related data of the external environment (such as ambient temperature). The earphone 10 of the present application includes at least one sensor module 12. In an embodiment where the earphone 10 includes multiple sensor modules 12, the types of detection data collected by different sensor modules 12 can be the same or different. The detection data formed by the signals can characterize the current state of the user. The ways for the sensor module 12 to collect detection data include, but are not limited to, sampling at a constant sampling rate, sampling at a variable sampling rate, and sampling with a time window. In the present application, the sensor samples at a constant sampling rate. More specifically, in the present application, a set of sampling data is obtained at one-second intervals. The constant sampling rate is simple and convenient, and can continuously collect detection data to achieve continuous monitoring, and it is not easy to miss the state changes in the detection data.
[0066] The prompt module 14 is used to issue prompt information. The prompt information includes, but is not limited to, voice prompts, action prompts (such as vibration), text prompts, graphical interface prompts, etc., or any combination thereof.
[0067] The instruction receiving module 15 is used to receive instructions sent by an external device (such asFigure 14 As shown in the figure, the external device includes at least one of a mobile phone, a watch, a server, a computer, and a tablet computer.
[0068] In some embodiments, the instruction receiving module 15 includes an input module (not shown) disposed on the control box 117 or the battery box 119. The input module is used to input user instructions, and the input module includes at least one of a button and a touch screen. The input module is used to input user instructions, and the user instructions at least include a scene entry instruction. Thus, the control module 11 can determine whether the current scene is in the second scene based on whether the instruction receiving module 15 receives the scene entry instruction.
[0069] In some embodiments, the instruction receiving module 15 further includes a communication module (not shown). The communication module includes the instruction receiving module 15 disposed on the control box 117 or the battery box 119. Specifically, the instruction receiving module 15 can receive instructions sent by an external device, and the communication module transmits the instructions to the control module 11.
[0070] In the method of 02, the sensor module 12 is used to collect detection data. The control module 11 is used to obtain the detection data collected by the sensor module 12; determine the current state of the head of the user wearing the earphone 10 according to the detection data and a preset state threshold. The current state includes a first state and a second state. In the first state, the movement amplitude of the user's head is greater than that in the second state; when the current state is the second state, the duration of the user's head continuously in the second state is accumulated. The prompting module 14 is used to send a prompting message when the accumulated duration reaches a preset duration threshold.
[0071] In the method of 05, the preset state threshold is a predefined parameter used to distinguish different current states of the user's head. It can be understood that the earphone 10 is worn on the human head. The sensor module 12 can at least collect the detection data of the user's head and determine the current state of the head of the user wearing the earphone 10 according to the detection data and the preset state threshold. More specifically, the preset state threshold may include an acceleration threshold, which is used to characterize the intensity of the head movement; the preset state threshold may include an angular velocity threshold, which is also used to characterize the intensity of the head movement; the preset state threshold may include a temperature threshold, which is used to characterize whether the user wearing the earphone 10 is in a healthy state.
[0072] In an embodiment of the present application, the current state includes a first state and a second state. The movement amplitude of the user's head in the first state is greater than that in the second state. More specifically, in the first state, the user's head has relatively significant activities and a large movement amplitude. For example, the head rotates rapidly, tilts significantly, or moves frequently. For example, when the user is swimming, playing basketball, etc., the user may be in the first state. In the second state, the user's head has no significant activities, the movement amplitude is small, or even stationary. For example, when the user is reading or riding a long distance, the user may be in the second state. For example, the first state generally refers to a moving state, and the second state generally refers to a stationary state. Among them, the movement amplitude in the moving state is greater than a preset first movement amplitude threshold, and the movement amplitude in the stationary state is less than a preset second movement amplitude threshold. The first movement amplitude threshold > the second movement amplitude threshold, and the second movement amplitude threshold can be zero or a relatively small value greater than zero. In addition, the movement amplitude can refer to the displacement amount on the three axes (X, Y, and Z), or the rotation angle around the three axes (X, Y, and Z).
[0073] In the method of 07, when the control module 11 identifies that the current state is the second state, the control module 11 accumulates the duration during which the user's head continuously remains in the second state. Thus, the control module 11 can obtain the duration during which the user is in the second state, that is, the control module 11 can obtain the duration during which the user continuously remains in the current state with a small movement amplitude, so as to provide data for subsequent methods.
[0074] In the method of 091, the preset duration threshold is a parameter predefined by the control module 11, used for the control module 11 to judge the size of the accumulated duration and as a basis for the prompt module 14 to issue a prompt message. The ways of issuing a prompt message include but are not limited to sending an audio prompt and sending a vibration prompt.
[0075] In the control method of the earphone of the present application, the control module 11 of the earphone 10 can determine the current state of the user's head wearing the earphone 10 through detection data and a preset state threshold, judge whether the head is in the second state, and accumulate the duration during which the head continuously remains in the second state. When the accumulated duration reaches the preset duration threshold, a prompt message is issued to prompt the user that the user has continuously been in the second state for a certain duration, and prompt the user to change the current state of the head, so as to prevent the user's head from being in the same state for a long time, thereby avoiding fatigue caused by being in the same state for a long time.
[0076] Please refer to Figures 2 to 4 , in some embodiments, the sensor module 12 includes an accelerometer 122, the detection data includes the three-axis acceleration detected by the accelerometer 122, the preset state threshold includes a preset acceleration difference threshold ka, and the method of 05 includes:
[0077] 051: Determine the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration and the acceleration difference threshold ka within a preset time window.
[0078] The above earphone control method can be applied to the earphone 10. The control module 11 is further configured to: determine the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration and the acceleration difference threshold ka within a preset time window.
[0079] Specifically, the accelerometer 122 can collect and measure the acceleration of the head in three spatial dimensions (X, Y, and Z axes). That is, when the user's head wears the earphone 10, the accelerometer 122 can measure the triaxial acceleration of the head. The triaxial acceleration includes the X-axis acceleration, the Y-axis acceleration, and the Z-axis acceleration. The X-axis acceleration represents the change in the moving speed of the head along the X-axis direction, the Y-axis acceleration represents the change in the moving speed of the head along the Y-axis direction, and the Z-axis acceleration represents the change in the moving speed of the head along the Z-axis direction. Therefore, the triaxial acceleration includes the accelerations in three spatial dimensions. Compared with the single-axis acceleration, the triaxial acceleration can completely express the resultant acceleration of the whole head.
[0080] In the method of 051, the preset time window is the time range of the acquired triaxial acceleration. For example, the preset time window can be a time window with a fixed length but rolling with time. The control module 11 acquires the detection data collected by the sensor module 12 at a constant time interval. For example, if the fixed length of the preset time window is 5 minutes, the control module 11 takes the current moment as the center and acquires the triaxial acceleration data collected by the sensor module 12 at the current moment, the triaxial acceleration data collected by the sensor module 12 2 minutes before the current moment, and the triaxial acceleration data collected by the sensor module 12 2 minutes after the current moment. At the next moment, the control module 11 takes the next moment as the center and acquires the triaxial acceleration data collected by the sensor module 12 at the next moment, the triaxial acceleration data collected by the sensor module 12 2 minutes before the next moment, and the triaxial acceleration data collected by the sensor module 12 2 minutes after the next moment. Collecting the detection data using a time window can reduce the interference of relevant data, improve the accuracy of the control module 11 to determine the current state of the head of the user wearing the earphone 10, and can also reduce the calculation burden of the control module 11 and avoid excessive detection data resulting in a heavy burden on the control module 11. The rolling time window can provide continuous and time-ordered triaxial acceleration data, which can more accurately reflect the current state of the head of the user wearing the earphone 10.
[0081] The acceleration difference threshold ka is a preset parameter. The state of the user is judged by the comparison result between the triaxial acceleration data within the preset time window and the acceleration difference threshold ka. The specific judgment method will be further described below.
[0082] Please refer to Figure 3 and Figure 5 , in some embodiments, the method of 051 includes:
[0083] 0511: Fuse the three-axis accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values An (n is a natural number greater than 1) respectively corresponding to the multiple predetermined moments;
[0084] 0513: Screen out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from the multiple fused acceleration values An;
[0085] 0515: Obtain the acceleration difference ΔA according to the maximum fused acceleration value Amax and the minimum fused acceleration value Amin; and
[0086] 0517: Determine the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA and the acceleration difference threshold ka.
[0087] The above control method of the earphone can be applied to the earphone 10, and the control module 11 is further configured to: fuse the three-axis accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values An; screen out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from the multiple fused acceleration values An; obtain the acceleration difference ΔA according to the maximum fused acceleration value Amax and the minimum fused acceleration value Amin; and determine the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA and the acceleration difference threshold ka.
[0088] Specifically, in the method of 0511, the preset time window includes multiple groups of three-axis accelerations, and each group of three-axis accelerations includes at least an X-axis acceleration, a Y-axis acceleration, and a Z-axis acceleration. The three-axis accelerations at multiple groups of predetermined moments are fused respectively to obtain the fused acceleration values at multiple predetermined moments. It can be understood that the fusion process includes filtering and denoising, and the filtering includes but is not limited to Kalman filtering, Gaussian filtering, median filtering, etc. Filtering can remove some noises in the three-axis accelerations and improve the accuracy of the fused acceleration values.
[0089] For example, within a preset time window T corresponding to the current moment t0, it includes the three-axis acceleration a1 at a predetermined moment t1 (which is a set of X, Y, and Z axis accelerations ax1, ay1, and az1), the three-axis acceleration a2 at a predetermined moment t2 (which is a set of X, Y, and Z axis accelerations ax2, ay2, and az2), the three-axis acceleration a3 at a predetermined moment t3 (which is a set of X, Y, and Z axis accelerations ax3, ay3, and az3)... the three-axis acceleration an at a predetermined moment tn (which is a set of X, Y, and Z axis accelerations axn, ayn, and azn). After the three-axis accelerations are respectively fused, the fused acceleration value A1 at the predetermined moment t1 is obtained after the fusion of the three-axis acceleration a1, the fused acceleration value A2 at the predetermined moment t2 is obtained after the fusion of the three-axis acceleration a2, the fused acceleration value A3 at the predetermined moment t3 is obtained after the fusion of the three-axis acceleration a3... the fused acceleration value An at the predetermined moment tn is obtained after the fusion of the three-axis acceleration an. The fused acceleration value carries more information and can more accurately characterize the current state of the head of the user wearing the earphone 10 compared to the non-fused acceleration value. The fusion process also helps to eliminate occasional outliers or momentary large fluctuations, making the method of 0511 more resistant to interference and robust.
[0090] In the method of 0513, the control module 11 screens out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from multiple fused acceleration values. That is, within the preset time window T, the maximum value among the fused acceleration values A1, A2, A3... An is selected as the maximum fused acceleration value Amax, and the minimum value among the fused acceleration values A1, A2, A3... An is selected as the minimum fused acceleration value Amin. By screening the maximum fused acceleration value Amax and the minimum fused acceleration value Amin, the amount of data is small, and the screening method does not involve complex operations. The control module 11 can directly obtain the activity range of the head of the user wearing the earphone 10 and quickly respond to the activity range of the head of the user, which is beneficial for quickly responding to the current state of the head under multiple preset time windows.
[0091] In the method of 0515, the control module 11 subtracts the minimum fused acceleration value Amin from the maximum fused acceleration value Amax to obtain the acceleration difference ΔA, that is, ΔA = Amax - Amin. A large numerical value of the acceleration difference ΔA indicates that the movement amplitude of the user's head within the time window T is large, and the head may be moving rapidly; a small numerical value of the acceleration difference ΔA indicates that the movement amplitude of the user's head within the time window T is small, and the head may be relatively stationary with respect to the user's body.
[0092] In the method of 0517, the control module 11 compares the acceleration difference ΔA with the acceleration difference threshold ka to determine the current state of the head of the user wearing the earphone 10. The comparison methods include but are not limited to directly comparing the acceleration difference ΔA with the acceleration difference threshold ka (for example, directly calculating the difference between the acceleration difference ΔA and the acceleration difference threshold ka). The acceleration difference threshold ka can provide a direct standard for the control module 11, and the control module 11 can directly distinguish the magnitude of the acceleration difference ΔA, facilitating the subsequent operations of the control module 11.
[0093] Please refer to Figure 2 and Figure 6 , in some embodiments, the method of 0517 includes:
[0094] 05171: When ΔA > ka, determine that the current state of the head of the user wearing the earphone 10 is the first state;
[0095] 05173: When ΔA < ka, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0096] The above control method of the earphone can be applied to the earphone 10, and the control module 11 is further configured to: when ΔA > ka, determine that the current state of the head of the user wearing the earphone 10 is the first state; when ΔA < the acceleration difference threshold ka, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0097] In addition, when ΔA = ka, the control module 11 can determine that the current state of the head of the user wearing the earphone 10 is the first state or the second state, which can be set according to requirements. By setting a clear acceleration difference threshold ka, the control module 11 simplifies the logic of current state judgment. By judging the magnitude relationship between the acceleration difference ΔA and the acceleration difference threshold ka, the current state of the user's head can be directly divided into the first state and the second state, which is beneficial to quickly and real-time judge the current state of the user's head when the sensor module 12 collects detection data in real time.
[0098] Please refer to Figure 3 and Figure 7 , in some embodiments, the sensor module 12 includes a gyroscope 121, the detection data includes the three-axis angular velocity detected by the gyroscope 121, the preset state threshold includes a preset angular velocity difference threshold kω, and the method of 05 further includes:
[0099] 053: Determine the current state of the head of the user wearing the earphone 10 according to the three-axis angular velocity within a preset time window and the angular velocity difference threshold kω.
[0100] The control method of the above-mentioned earphone can be applied to earphone 10, and the control module 11 is further configured to: determine the current state of the head of the user wearing the earphone 10 according to the triaxial angular velocity within a preset time window and the angular velocity difference threshold kω.
[0101] Specifically, the gyroscope 121 can measure the angular velocity of the head in three spatial dimensions (X, Y, and Z axes). The triaxial angular velocity includes the X-axis angular velocity, the Y-axis angular velocity, and the Z-axis angular velocity. The X-axis angular velocity represents the angular change of the head rotating around the X-axis, the Y-axis angular velocity represents the angular change of the head rotating around the Y-axis, and the Z-axis angular velocity represents the angular change of the head rotating around the Z-axis. Therefore, the triaxial angular velocity includes the angular velocities in three spatial dimensions. Compared with the single-axis angular velocity, the triaxial angular velocity can completely express the resultant angular velocity of the whole head.
[0102] In the method of 053, the preset time window is also the time range of the acquired triaxial angular velocity. For example, the preset time window can be a time window with a fixed length but rolling with time. The control module 11 acquires the detection data collected by the sensor module 12 at a constant time interval. For example, if the fixed length of the preset time window is 5 minutes, the control module 11 takes the current moment as the center and acquires the triaxial angular velocity data collected by the sensor module 12 at the current moment, the triaxial angular velocity data collected by the sensor module 12 2 minutes before the current moment, and the triaxial angular velocity data collected by the sensor module 12 2 minutes after the current moment. At the next moment, the control module 11 takes the next moment as the center and acquires the triaxial angular velocity data collected by the sensor module 12 at the next moment, the triaxial angular velocity data collected by the sensor module 12 2 minutes before the next moment, and the triaxial angular velocity data collected by the sensor module 12 2 minutes after the next moment. The effect of collecting detection data using the time window is the same as before and will not be elaborated here.
[0103] The angular velocity difference threshold kω is a preset parameter. The state of the user is judged based on the comparison result between the triaxial angular velocity data within the preset time window and the angular velocity difference threshold kω. The specific judgment method will be further described below.
[0104] Please refer to Figure 3 and Figure 8 , in some embodiments, the method of 053 includes:
[0105] 0531: Fuse the triaxial angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values Ωm (m is a natural number greater than 1) respectively corresponding to the multiple predetermined moments;
[0106] 0533: Screen out the maximum fused angular velocity Ωmax and the minimum fused angular velocity Ωmin from the multiple fused angular velocity values Ωm;
[0107] 0535: Obtain the angular velocity difference ΔΩ based on the maximum fused angular velocity Ωmax and the minimum fused angular velocity Ωmin; and
[0108] 0537: Determine the current state of the head of the user wearing the earphone 10 according to the angular velocity difference ΔΩ and the angular velocity difference threshold kω.
[0109] The above earphone control method can be applied to the earphone 10. The earphone 10 in the embodiment of the present application includes a control module 11, and the control module 11 is further configured to: fuse the three-axis angular velocities at multiple predetermined moments within a preset time window to obtain multiple fused angular velocity values Ωm corresponding to the multiple predetermined moments respectively; screen out the maximum fused angular velocity Ωmax and the minimum fused angular velocity Ωmin from the multiple fused angular velocity values Ωm; obtain the angular velocity difference ΔΩ based on the maximum fused angular velocity Ωmax and the minimum fused angular velocity Ωmin; and determine the current state of the head of the user wearing the earphone 10 according to the angular velocity difference ΔΩ and the angular velocity difference threshold kω.
[0110] Specifically, in the method of 0531, the preset time window includes multiple groups of three-axis angular velocities, and each group of three-axis angular velocities includes at least the X-axis angular velocity, the Y-axis angular velocity, and the Z-axis angular velocity. The three-axis angular velocities at multiple groups of predetermined moments are fused respectively to obtain the fused angular velocity values at the multiple predetermined moments. It can be understood that the fusion process includes filtering and denoising, and the filtering includes but is not limited to Kalman filtering, Gaussian filtering, median filtering, etc. Filtering can remove some noise in the three-axis angular velocity and improve the accuracy of the fused angular velocity value.
[0111] For example, within a preset time window T corresponding to the current moment t0, it includes the three-axis angular velocity ω1 at a predetermined moment t1 (which is a set of the X, Y, and Z axis accelerations ωx1, ωy1, and ωz1), the three-axis angular velocity ω2 at a predetermined moment t2 (which is a set of the X, Y, and Z axis accelerations ωx2, ωy2, and ωz2), the three-axis angular velocity ω3 at a predetermined moment t3 (which is a set of the X, Y, and Z axis accelerations ωx3, ωy3, and ωz3),..., the three-axis angular velocity ωm at a predetermined moment tm (which is a set of the X, Y, and Z axis accelerations ωxm, ωym, and ωzm). After the three-axis angular velocities are respectively fused, the fused angular velocity value Ω1 at the predetermined moment t1 is obtained after fusing the three-axis angular velocity ω1, the fused angular velocity value Ω2 at the predetermined moment t2 is obtained after fusing the three-axis angular velocity ω2, the fused angular velocity value Ω3 at the predetermined moment t3 is obtained after fusing the three-axis angular velocity ω3,..., and the fused angular velocity value Ωm at the predetermined moment tm is obtained after fusing the three-axis angular velocity ωm. The fused angular velocity value Ωm carries more information and can more accurately characterize the current state of the head of the user wearing the earphone 10 compared to the non-fused acceleration values, and can better characterize the change in the rotation angle of the user's head. The fusion process also helps to eliminate occasional outliers or momentary large fluctuations, making the method of 0531 more resistant to interference and robust.
[0112] In the method of 0533, the control module 11 screens out the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin from multiple fused angular velocity values. That is, within the preset time window T, the maximum value among the fused angular velocity values Ω1, Ω2, Ω3,..., Ωm is selected as the maximum fused angular velocity value Ωmax, and the minimum value among the fused angular velocity values Ω1, Ω2, Ω3,..., Ωm is selected as the minimum fused angular velocity value Ωmim. Screening the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmim involves a small amount of data, and the screening method does not involve complex operations. The control module 11 can directly obtain the activity range of the head of the user wearing the earphone 10 and quickly respond to the activity range of the user's head, which is beneficial for quickly responding to the current state of the head under multiple preset time windows.
[0113] In the method of 0535, the control module 11 subtracts the minimum fused angular velocity value Ωmim from the maximum fused angular velocity value Ωmax to obtain the angular velocity difference ΔΩ, that is, ΔΩ = Ωmax - Ωmim. A large value of the angular velocity difference ΔΩ indicates that the head of the user has a large movement amplitude within the time window T, and the head may be rotating significantly; a small value of the angular velocity difference ΔΩ indicates that the head of the user has a small movement amplitude within the time window T, and the head may be relatively stationary with respect to the user's body.
[0114] In the method of 0537, the control module 11 compares the angular velocity difference ΔΩ with the angular velocity difference threshold kω to determine the current state of the head of the user wearing the earphone 10. The comparison methods include, but are not limited to, directly comparing the angular velocity difference ΔΩ with the angular velocity difference threshold kω (for example, directly calculating the difference between the angular velocity difference ΔΩ and the angular velocity difference threshold kω). The angular velocity difference threshold kω can provide a direct standard for the control module 11, and the control module 11 can directly distinguish the magnitude of the angular velocity difference ΔΩ, which is convenient for the subsequent operations of the control module 11.
[0115] Please refer to Figure 3 and Figure 9 , in some embodiments, the method of 0537 includes:
[0116] 05371: When ΔΩ > kω, determine that the current state of the head of the user wearing the earphone 10 is the first state;
[0117] 05373: When ΔΩ < kω, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0118] The above control method of the earphone can be applied to the earphone 10, and the control module 11 is further configured to: when ΔΩ > kω, determine that the current state of the head of the user wearing the earphone 10 is the first state; when ΔΩ < kω, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0119] In addition, when ΔΩ = kω, the control module 11 can determine that the current state of the head of the user wearing the earphone 10 is the first state or the second state, which can be set according to requirements. By setting a clear angular velocity difference threshold kω, the control module 11 simplifies the logic of current state judgment. By judging the magnitudes of the angular velocity difference ΔΩ and the angular velocity difference threshold kω, the current state of the user's head can be directly divided into the first state and the second state, which is beneficial to quickly and real-time judge the current state of the user's head when the sensor module 12 collects detection data in real time.
[0120] Please refer to Figure 3 and Figure 10 , in some embodiments, the sensor module 12 includes an accelerometer 122 and a gyroscope 121, the detection data includes the three-axis acceleration detected by the accelerometer 122 and the three-axis angular velocity detected by the gyroscope 121, and the preset state thresholds include a preset acceleration difference threshold ka and a preset angular velocity difference threshold kω; the method of 05 also includes:
[0121] 055: Determine the current state of the head of the user wearing the earphone 10 according to the three-axis acceleration, three-axis angular velocity, acceleration difference threshold ka, and angular velocity difference threshold kω within a preset time window.
[0122] The control method of the above-mentioned earphone can be applied to the earphone 10, and the control module 11 is further configured to: determine the current state of the head of the user wearing the earphone 10 according to the triaxial acceleration, triaxial angular velocity, acceleration difference threshold ka, and angular velocity difference threshold kω within a preset time window.
[0123] Specifically, the accelerometer 122 can collect triaxial acceleration as detection data, and the gyroscope 121 can collect triaxial angular velocity as detection data. The preset time window, triaxial acceleration, triaxial angular velocity, acceleration difference threshold ka, and angular velocity difference threshold kω are the same as the explanations of the preset time window, triaxial acceleration, triaxial angular velocity, acceleration difference threshold ka, and angular velocity difference threshold kω in the previous text, and will not be elaborated here.
[0124] The sensor module 12 uses two different types of sensors (i.e., the accelerometer 122 and the gyroscope 121), which can provide two types of detection data (i.e., triaxial acceleration and triaxial angular velocity), providing more comprehensive and accurate detection data, so as to more comprehensively reflect the current state of the head of the user wearing the earphone 10. Also, in the case where one sensor is interfered or the detection data has excessive noise, the detection data collected by the other sensor can be used as a supplement to improve the robustness of the control module 11.
[0125] Please refer to Figure 3 and Figure 11 , in some embodiments, the method of 055 includes:
[0126] 0551: Fuse the triaxial accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values An corresponding to the multiple predetermined moments respectively, and fuse the triaxial angular velocities at multiple predetermined moments within a preset time window to obtain multiple fused angular velocity values Ωm corresponding to the multiple predetermined moments respectively;
[0127] 0553: Screen out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from the multiple fused acceleration values An, and screen out the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin from the multiple fused angular velocity values Ωm;
[0128] 0555: Obtain the acceleration difference ΔA according to the maximum fused acceleration value Amax and the minimum fused acceleration value Amin, and obtain the angular velocity difference ΔΩ according to the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin; and
[0129] 0557: Determine the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω.
[0130] The control method of the above-mentioned earphone can be applied to the earphone 10. The earphone 10 in the embodiment of the present application includes a control module 11. The control module 11 is further configured to: fuse the three-axis accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values An corresponding to the multiple predetermined moments respectively, and fuse the three-axis angular velocities at multiple predetermined moments within a preset time window to obtain multiple fused angular velocity values Ωm corresponding to the multiple predetermined moments respectively; screen out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from the multiple fused acceleration values An, and screen out the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin from the multiple fused angular velocity values Ωm; obtain an acceleration difference ΔA according to the maximum fused acceleration value Amax and the minimum fused acceleration value Amin, and obtain an angular velocity difference ΔΩ according to the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin; and determine the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω.
[0131] Specifically, in the method of 0551, the obtaining of the multiple fused acceleration values An is the same as that in the method of 0511, and the obtaining of the multiple fused angular velocity values Ωm is the same as that in the method of 0531, which will not be elaborated here.
[0132] In the method of 0553, the obtaining of the maximum fused acceleration value Amax and the minimum fused acceleration value Amin is the same as that in the method of 0513, and the obtaining of the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin is the same as that in the method of 0533, which will not be elaborated here.
[0133] In the method of 0555, the obtaining of the acceleration difference ΔA is the same as that in the method of 0515, and the obtaining of the angular velocity difference ΔΩ is the same as that in the method of 0535, which will not be elaborated here.
[0134] Among them, in the methods of 0551, 0553, and 0555, the preset time windows corresponding to the data of the three-axis acceleration and the three-axis angular velocity are the same.
[0135] In the method of 0557, the control module 11 jointly determines the current state of the head of the user wearing the earphone 10 according to the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω. There are various ways of determination. For example, in the embodiment of the threshold comparison method, the control module 11 can directly compare the magnitudes of the acceleration difference ΔA and the angular velocity difference ΔΩ with their respective thresholds. The specific implementation methods are described in the methods of 05571 and 05573.
[0136] For another example, the control module 11 may determine the current state according to the ratios of the acceleration difference ΔA and the angular velocity difference ΔΩ to their respective thresholds. More specifically, the control module 11 sets the probability of the acceleration as P1, and the control module 11 sets the probability of the angular velocity as P2. The probability of the acceleration P1 = acceleration difference ΔA / acceleration difference threshold ka, the probability of the angular velocity P2 = angular velocity difference ΔΩ / angular velocity difference threshold kω. The probability of the current state is P. Through a predetermined function f, the probability of the current state P = f(P1, P2) is obtained. When P is in the first interval, the current state is determined to be the first state, and when P is in the second interval, the current state is determined to be the second state.
[0137] For still another example, the control module 11 may comprehensively evaluate the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω according to a pre-trained machine learning model to determine the current state. Details are not described herein.
[0138] In the method of 055, the fused acceleration value An carries more information. Compared with the non-fused acceleration value, it can more accurately represent the acceleration information of the current state of the head of the user wearing the earphone 10 and can better represent the moving speed of the user's head. The fused angular velocity value Ωm carries more information. Compared with the non-fused angular velocity value, it can more accurately represent the angular information of the current state of the head of the user wearing the earphone 10 and can better represent the change in the rotation angle of the user's head. The current state is determined based on the acceleration difference ΔA obtained by fusing the acceleration value, the angular velocity difference ΔΩ obtained by fusing the angular velocity value, the acceleration difference threshold ka, and the angular velocity difference threshold kω. The data is rich, so as to more comprehensively reflect the current state of the head of the user wearing the earphone 10. Also, in the case where one type of data (acceleration difference ΔA or angular velocity difference ΔΩ) has excessive noise, the current state of the head of the user wearing the earphone 10 can be obtained or the one type of data (acceleration difference ΔA or angular velocity difference ΔΩ) can be corrected using the other type of data (angular velocity difference ΔΩ or acceleration difference ΔA), improving the robustness of the control module 11.
[0139] Please refer to 3 and Figure 12 , in some embodiments, the method of 0557 includes:
[0140] 05571: When the acceleration difference ΔA > ka and / or the angular velocity difference ΔΩ > kω, determine that the current state of the head of the user wearing the earphone 10 is the first state;
[0141] 05573: When the acceleration difference ΔA < ka and the angular velocity difference ΔΩ < kω, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0142] The above control method of the earphone can be applied to the earphone 10, and the control module 11 is further configured to: when ΔA > ka and / or the angular velocity difference ΔΩ > kω, determine that the current state of the head of the user wearing the earphone 10 is the first state; when the acceleration difference ΔA < ka and ΔΩ < kω, determine that the current state of the head of the user wearing the earphone 10 is the second state.
[0143] In addition, when ΔA = ka and ΔΩ = kω, the control module 11 can determine that the current state of the head of the user wearing the earphone 10 is the first state or the second state, which can be set according to requirements. The control module 11 jointly determines the current state through the comparison result between the acceleration difference ΔA and the acceleration difference threshold ka, and the comparison result between the angular velocity difference ΔΩ and the angular velocity difference threshold kω, with higher accuracy.
[0144] Please refer to Figure 2 、 Figure 3 and Figure 13 In some embodiments, the control method further includes:
[0145] 03: Identify the current scene where the earphone 10 is located, and the current scene includes a first scene and a second scene; and
[0146] 04: Determine a preset state threshold according to the current scene, and the preset state threshold in the first scene is less than the preset state threshold in the second scene.
[0147] The above control method of the earphone can be applied to the earphone 10, and the control module 11 is further configured to: identify the current scene where the earphone 10 is located, and the current scene includes a first scene and a second scene; and determine a preset state threshold according to the current scene, and the preset state threshold in the first scene is less than the preset state threshold in the second scene.
[0148] Specifically, in the methods of 03 and 04, the first scene is a sitting posture scene, and the second scene is a cycling scene. It can be understood that in the cycling scene, the road surface is relatively bumpy, the stability of the user's head may be low, and the user's head is prone to vibration or bump. The preset state threshold in the first scene is less than the preset state threshold in the second scene, which can filter out the normal signal restlessness generated by the road surface during cycling and reduce the noise of the detection data.
[0149] Please refer to Figure 2 、 Figure 3 、 Figure 14 and Figure 15 In some embodiments, the earphone 10 further includes an instruction receiving module 15, and the method of 03 includes:
[0150] 031: Determine the current scene based on the three-axis acceleration and the instruction received by the instruction receiving module 15.
[0151] The control method of the above-mentioned earphone can be applied to the earphone 10. The earphone 10 in the embodiment of the present application further includes an instruction receiving module 15 for receiving instructions. The control module 11 is further configured to: determine the current scenario based on the three-axis acceleration and the instructions received by the instruction receiving module 15.
[0152] Specifically, in the method of 031, the control module 11 can determine the current scenario based on the three-axis acceleration independently, or based on the instructions received by the instruction receiving module 15 independently, or based on the fusion of the three-axis acceleration and the instructions received by the instruction receiving module 15. More specifically, the instruction receiving module 15 receives instructions sent by external devices, and the external devices include at least one of a mobile phone, a watch, a server, a computer, and a tablet computer. The present application only Figure 14 shows only the process of the watch sending instructions to the earphone 10. The user can turn on the cycling mode through the buttons or touch screen of the watch, and the watch sends the instructions to the instruction receiving module 15. Thus, the earphone 10 can identify the current scenario.
[0153] For example, when the current scenario determined based on the three-axis acceleration is different from the current scenario determined based on the instructions received by the receiving module, the prompt module 14 can issue an abnormal reminder to allow the user to determine whether the current scenario is correct. The manner in which the control module 11 determines the current scenario is not limited to one, which can improve the accuracy of current scenario recognition and reduce misjudgment.
[0154] Please refer to Figure 2 、 Figure 3 、 Figure 14 、 Figure 15 and Figure 16 , in some embodiments, the method of 031 includes:
[0155] 0311: Determine whether the current scenario is in the first scenario based on the change of the Z-axis acceleration in the three-axis acceleration;
[0156] 0313: Determine whether the current scenario is in the second scenario based on whether the instruction receiving module 15 receives a scenario entry instruction.
[0157] The control method of the above-mentioned earphone can be applied to the earphone 10. The earphone 10 in the embodiment of the present application includes a control module 11, and the control module 11 is further configured to: determine whether the current scenario is in the first scenario based on the change of the Z-axis acceleration in the three-axis acceleration; determine whether the current scenario is in the second scenario based on whether the instruction receiving module 15 receives a scenario entry instruction.
[0158] Specifically, in the method of 0311, the control module 11 can determine whether the current scene is in the first scene according to the change of the Z-axis acceleration. The Z-axis acceleration characterizes the acceleration of the user's head in the Z-axis direction (i.e., the vertical direction). When the user's head moves in the vertical direction, the Z-axis acceleration also changes. It can be understood that when the user sits down and stands up, the directions of the Z-axis acceleration are opposite. That is, for the Z-axis acceleration when the user sits down (regarded as the first Z-axis acceleration), the direction of the first Z-axis acceleration is the first direction, and for the Z-axis acceleration when the user stands up (regarded as the second Z-axis acceleration), the direction of the second Z-axis acceleration is the second direction, and the first direction and the second direction are opposite. Thus, it can be determined whether the current scene is in the first scene, i.e., the sitting posture scene, according to the change of the Z-axis acceleration.
[0159] In the method of 0313, the control module 11 determines whether the current scene is in the second scene based on whether the instruction receiving module 15 receives a scene entry instruction, that is, determines whether the current scene is in the riding scene. The way to obtain the scene entry instruction is direct, which improves the accuracy of the current scene recognition and does not require the control module 11 to make a judgment, saving the memory of the control module 11.
[0160] Please refer to Figure 2 、 Figure 3 and Figure 17 , in some embodiments, the control method of the earphone further includes:
[0161] 01: Set the preset duration threshold of the earphone 10 in different scenes according to the user input;
[0162] 043: Determine the preset duration threshold according to the current scene, and the preset duration threshold in the first scene is less than the preset duration threshold in the second scene.
[0163] The above control method of the earphone can be applied to the earphone 10. The earphone 10 in the embodiment of the present application includes a control module 11, and the control module 11 is further configured to: set the preset duration threshold of the earphone 10 in different scenes according to the user input; identify the current scene where the earphone 10 is located, and the current scene includes the first scene and the second scene; determine the preset duration threshold according to the current scene, and the preset duration threshold in the first scene is less than the preset duration threshold in the second scene.
[0164] Specifically, the preset duration thresholds corresponding to different current scenes are different, that is, the first scene corresponds to the preset duration threshold in the first scene, and the second scene corresponds to the preset duration threshold in the second scene. Thus, the preset duration threshold more in line with the current scene can be set according to the difference of the current scene, making the subsequent judgment of the current state more accurate. The preset duration threshold in the first scene is less than the preset duration threshold in the second scene, which can reduce
[0165] Please refer to Figure 2 、 Figure 3 and Figure 17 , in some embodiments, the control method further includes:
[0166] When the accumulated duration does not reach the preset duration threshold, the accumulated duration is cleared, and the process returns to execute obtaining the detection data collected by the sensor module 12.
[0167] The control method of the above-mentioned earphone can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11. The control module 11 is further configured to: when the accumulated duration does not reach the preset duration threshold, the accumulated duration is cleared, and the process returns to execute obtaining the detection data collected by the sensor module 12.
[0168] Specifically, the control method of the earphone further includes 09: whether the accumulated duration reaches the preset duration threshold. That is, the control module 11 is used to judge whether the accumulated duration reaches the preset duration threshold. The method of 09 includes the method of 091. If the accumulated duration does not meet the method of 091, then when the accumulated duration does not reach the preset duration threshold, the accumulated duration is cleared, and the process returns to execute obtaining the detection data collected by the sensor module 12. During the process of the control module 11 accumulating the duration, the user's head may suddenly turn or move. If the current state of the head exceeds a certain threshold, for example, at a certain moment in any time window, the acceleration difference ΔA is greater than the acceleration difference threshold ka, and the angular velocity difference ΔΩ is greater than the angular velocity difference threshold kω, then the accumulated duration is cleared, and the control module 11 returns and re-executes the methods of 02, 05, 07, and 09.
[0169] Please refer to Figure 2 、 Figure 3 and Figure 17 , in some embodiments, the control method further includes:
[0170] After sending out the prompt message, the accumulated duration is cleared, and the process returns to execute obtaining the detection data collected by the sensor module 12.
[0171] The control method of the above-mentioned earphone can be applied to the earphone 10. The earphone 10 of the embodiment of the present application includes a control module 11 and a prompt module 14. The control module 11 is further configured to: after the prompt module 14 sends out the prompt message, the accumulated duration is cleared, and the process returns to execute obtaining the detection data collected by the sensor module 12.
[0172] Specifically, after the prompt module 14 issues a prompt message, the accumulated duration in the control module 11 is cleared, and the control module 11 returns to execute the method after 02 and 02. Thus, the headset 10 can continuously determine the current state of the head of the user wearing the headset 10 based on the detection data and the preset state threshold, and issue a prompt message again when the accumulated duration reaches the preset duration threshold. The continuous detection of the current state of the head of the user by the headset 10 is realized.
[0173] Please refer to Figure 2 、 Figure 3 and Figure 18 , this application also provides a computer-readable storage medium 200, on which a program 202 is stored. When the program 202 is executed by a processor 20, the control method of any of the above embodiments is implemented.
[0174] For example, when the program 202 is executed by the processor 20, the following control method is implemented:
[0175] 02: Obtain the detection data collected by the sensor module 12;
[0176] 05: Determine the current state of the head of the user wearing the headset 10 according to the detection data and the preset state threshold. The current state includes a first state and a second state. The movement amplitude of the head of the user in the first state is greater than the movement amplitude of the head of the user in the second state;
[0177] 07: When the current state is the second state, accumulate the duration of the head of the user continuously in the second state;
[0178] 091: Issue a prompt message when the accumulated duration reaches the preset duration threshold.
[0179] For another example, when the program 202 is executed by the processor 20, the following control method is implemented:
[0180] 0551: Fuse the three-axis accelerations at multiple predetermined times within a preset time window to obtain multiple fused acceleration values corresponding to the multiple predetermined times respectively, and fuse the three-axis angular velocities at multiple predetermined times within a preset time window to obtain multiple fused angular velocity values corresponding to the multiple predetermined times respectively;
[0181] 0553: Screen out the maximum fused acceleration value Amax and the minimum fused acceleration value Amin from the multiple fused acceleration values, and screen out the maximum fused angular velocity value Ωmax and the minimum fused angular velocity value Ωmin from the multiple fused angular velocity values;
[0182] 0555: Obtain the acceleration difference ΔA based on the maximum value Amax of the fused acceleration and the minimum value Amin of the fused acceleration, and obtain the angular velocity difference ΔΩ based on the maximum value of the fused angular velocity and the minimum value of the fused angular velocity; and
[0183] 0557: Determine the current state of the head of the user wearing the earphone 10 based on the acceleration difference ΔA, the acceleration difference threshold ka, the angular velocity difference ΔΩ, and the angular velocity difference threshold kω.
[0184] For another example, when the program 202 is executed by the processor 20, the control methods in 01, 02, 03, 031, 0311, 0313, 04, 043, 05, 051, 0511, 0513, 0515, 0517, 05171, 05173, 053, 0531, 0533, 0535, 0537, 05371, 05373, 055, 0551, 0553, 0555, 0557, 05571, 05573, 07, 09, 091, and 093 can also be implemented.
[0185] In the computer-readable storage medium 200 of the present application, the control module 11 of the earphone 10 can determine the current state of the head of the user wearing the earphone 10 through the detection data and the preset state threshold, judge whether the head is in the second state, and accumulate the duration of the head continuously in the second state. When the accumulated duration reaches the preset duration threshold, a prompt message is sent to prompt the user that the head has been continuously in the second state for a certain duration, and prompt the user to change the current state of the head to avoid the head being in the same state for a long time, thereby avoiding fatigue caused by the head being in the same state for a long time.
[0186] In the description of this specification, the descriptions referring to the terms "certain embodiments", "in an example", "exemplarily", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiments or examples. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples.
[0187] Any process or method description, whether in a flowchart or otherwise described herein, can be understood to represent a module, segment, or portion of code including one or more executable instructions for implementing a specific logical function or process. The scope of the preferred embodiments of the present application includes additional implementations, where functions may be performed in a substantially simultaneous manner or in a reverse order according to the functions involved, rather than in the order shown or discussed. This should be understood by those skilled in the art to which the embodiments of the present application pertain.
[0188] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.
Claims
1. A control method for an earphone, characterized in that, The earphone includes a sensor module, and the control method includes: Obtaining detection data collected by the sensor module, the sensor module includes an accelerometer, and the detection data includes triaxial acceleration detected by the accelerometer; Fusing the triaxial accelerations at multiple predetermined moments within a preset time window to obtain multiple fused acceleration values respectively corresponding to the multiple predetermined moments; Selecting the maximum fused acceleration value and the minimum fused acceleration value from the multiple fused acceleration values; Obtaining an acceleration difference according to the maximum fused acceleration value and the minimum fused acceleration value; Determining the current state of the head of the user wearing the earphone according to the acceleration difference and a preset state threshold, the preset state threshold includes a preset acceleration difference threshold, the current state includes a first state and a second state, and the movement amplitude of the head of the user in the first state is greater than the movement amplitude of the head of the user in the second state; When the current state is the second state, accumulating the duration for which the head of the user continuously remains in the second state; and When the accumulated duration reaches a preset duration threshold, sending a prompt message.
2. The control method according to claim 1, wherein The determining the current state of the head of the user wearing the earphone according to the acceleration difference and the acceleration difference threshold includes: When the acceleration difference is greater than the acceleration difference threshold, determining that the current state of the head of the user wearing the earphone is the first state; When the acceleration difference is less than the acceleration difference threshold, determining that the current state of the head of the user wearing the earphone is the second state.
3. The control method according to claim 1, wherein The sensor module includes a gyroscope, the detection data includes triaxial angular velocity detected by the gyroscope, and the preset state threshold includes a preset angular velocity difference threshold; the determining the current state of the head of the user wearing the earphone according to the detection data and the preset state threshold includes: Determining the current state of the head of the user wearing the earphone according to the triaxial angular velocity within a preset time window and the angular velocity difference threshold.
4. The control method according to claim 3, characterized in that The determining the current state of the head of the user wearing the earphone according to the triaxial angular velocity within a preset time window and the angular velocity difference threshold includes: Fusing the triaxial angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values respectively corresponding to the multiple predetermined moments; Selecting the maximum fused angular velocity value and the minimum fused angular velocity value from the multiple fused angular velocity values; Obtaining an angular velocity difference according to the maximum fused angular velocity value and the minimum fused angular velocity value; and Determining the current state of the head of the user wearing the earphone according to the angular velocity difference and the angular velocity difference threshold.
5. The control method according to claim 4, wherein The determining the current state of the head of the user wearing the earphone according to the angular velocity difference and the angular velocity difference threshold includes: When the angular velocity difference is greater than the angular velocity difference threshold, determining that the current state of the head of the user wearing the earphone is the first state; and When the angular velocity difference is less than the angular velocity difference threshold, determine that the current state of the head of the user wearing the earphone is the second state.
6. The control method according to claim 1, wherein The sensor module includes an accelerometer and a gyroscope, the detection data includes the three-axis acceleration detected by the accelerometer and the three-axis angular velocity detected by the gyroscope, and the preset state threshold includes a preset acceleration difference threshold and a preset angular velocity difference threshold; Determining the current state of the head of the user wearing the earphone according to the detection data and the preset state threshold includes: Determining the current state of the head of the user wearing the earphone according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold, and the angular velocity difference threshold within a preset time window.
7. The control method according to claim 6, wherein Determining the current state of the head of the user wearing the earphone according to the three-axis acceleration, the three-axis angular velocity, the acceleration difference threshold, and the angular velocity difference threshold within a preset time window includes: Fusing the three-axis accelerations at multiple predetermined moments within the preset time window to obtain multiple fused acceleration values corresponding to the multiple predetermined moments respectively, and fusing the three-axis angular velocities at multiple predetermined moments within the preset time window to obtain multiple fused angular velocity values corresponding to the multiple predetermined moments respectively; Selecting the maximum fused acceleration value and the minimum fused acceleration value from the multiple fused acceleration values, and selecting the maximum fused angular velocity value and the minimum fused angular velocity value from the multiple fused angular velocity values; Obtaining an acceleration difference according to the maximum fused acceleration value and the minimum fused acceleration value, and obtaining an angular velocity difference according to the maximum fused angular velocity value and the minimum fused angular velocity value; and Determining the current state of the head of the user wearing the earphone according to the acceleration difference, the acceleration difference threshold, the angular velocity difference, and the angular velocity difference threshold.
8. The control method according to claim 7, wherein Determining the current state of the head of the user wearing the earphone according to the acceleration difference, the acceleration difference threshold, the angular velocity difference, and the angular velocity difference threshold includes: When the acceleration difference is greater than the acceleration difference threshold, and / or the angular velocity difference is greater than the angular velocity difference threshold, determine that the current state of the head of the user wearing the earphone is the first state; When the acceleration difference is less than the acceleration difference threshold and the angular velocity difference is less than the angular velocity difference threshold, determine that the current state of the head of the user wearing the earphone is the second state.
9. The control method according to claim 1, characterized in that It further includes: Identifying the current scene where the earphone is located, the current scene including a first scene and a second scene; and Determining a preset state threshold according to the current scene, the preset state threshold in the first scene being less than the preset state threshold in the second scene.
10. The control method according to claim 9, wherein, The sensor module includes an accelerometer, the detection data includes the three-axis acceleration detected by the accelerometer, and the earphone further includes an instruction receiving module; identifying the current scene where the earphone is located includes: Determining the current scene based on the three-axis acceleration and the instruction received by the instruction receiving module.
11. The control method according to claim 10, wherein Determining the current scenario based on the three-axis acceleration and the instruction received by the instruction receiving module includes: Determining whether the current scenario is in the first scenario based on the change in the Z-axis acceleration among the three-axis accelerations; Determining whether the current scenario is in the second scenario based on whether the instruction receiving module receives a scenario entry instruction.
12. The control method according to claim 11, characterized in that, The earphone further includes a control box assembly and a battery box assembly. The control box assembly includes a control box, and the battery box assembly includes a battery box; The instruction receiving module includes an input module disposed on the control box or the battery box. The input module is used to input user instructions, and the input module includes at least one of a button and a touch screen; or, The earphone further includes a communication module. The communication module includes the instruction receiving module disposed on the control box or the battery box. The instruction receiving module is used to receive instructions sent by an external device, and the external device includes at least one of a mobile phone, a watch, a server, a computer, and a tablet computer.
13. The control method according to claim 1, characterized in that, It further includes: Setting a preset duration threshold for the earphone in different scenarios according to user input; Determining a preset duration threshold according to the current scenario, and the preset duration threshold in the first scenario is less than the preset duration threshold in the second scenario.
14. The control method according to claim 1, wherein It further includes: When the accumulated duration does not reach the preset duration threshold, clearing the accumulated duration and returning to execute obtaining the detection data collected by the sensor module.
15. The control method according to claim 1, wherein It further includes: After sending a prompt message, clearing the accumulated duration and returning to execute obtaining the detection data collected by the sensor module.
16. An earphone, characterized in that, The earphone includes: A sensor module for collecting detection data; and A control module communicatively connected to the sensor module and configured to execute the control method according to any one of claims 1-15.
17. The earphone according to claim 16, wherein, The earphone includes an air-conduction earphone and a bone-conduction earphone.
18. A computer-readable storage medium, on which a program is stored, characterized in that, When the program is executed by a processor, the control method according to any one of claims 1-15 is implemented.
Citation Information
Patent Citations
Reminding method and device based on use of earphone
CN109451385A
Exercise reminding method and electronic equipment
CN116416769A