Posture detection method and device, wireless earphone and storage medium
By collecting and comparing head movement data through wireless earphones, the problem of the lack of posture detection in wireless earphones is solved, enabling timely reminders of user fatigue posture and improving safety and comfort.
Patent Information
- Application Number
- CN202110584065.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-27
- Publication Date
- 2025-11-25
- Estimated Expiration
- 2041-05-27
AI Technical Summary
Existing wireless headphones lack user head fatigue posture detection functions, which means they cannot promptly remind users to adjust poor posture, especially when driving or using mobile phones for extended periods, posing a safety hazard.
The system collects user head movement data through wireless earphones, generates motion curves, compares them with standard motion curves, uses accelerometers and angular velocity sensors to determine the user's head posture, and sends alarm prompts to remind the user to rest or adjust their posture.
It achieves accurate detection of the user's head posture, promptly reminds the user to adjust their posture when fatigued, and improves safety and comfort when driving or using a mobile phone.
Smart Images

Figure CN115412793B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] Embodiments of the present application relate to, but are not limited to, the technical field of wireless earphone, in particular, relate to, but are not limited to, a posture detection method and device, a wireless earphone and a storage medium. BACKGROUND
[0002] Mobile phone is the first tool for interaction in work and life, and car is the tool for providing convenience in work and life. Rational use can improve work efficiency and enhance life happiness, but irrational use can bring great risk and even threaten life. Fatigue driving ranks first in traffic accidents on the highway, and the trend is rising with the popularization of cars. During driving, hand-held calls can easily cause instability in control due to the hand leaving the steering wheel, thereby causing traffic accidents. Therefore, making a call with hands leaving the steering wheel is prohibited by traffic rules. How to make the driver aware of fatigue and keep both hands on the steering wheel has become an important direction of automotive electronics research.
[0003] At present, fatigue driving monitoring technologies mainly include the following types:
[0004] Vehicle running track monitoring mode: This mode installs a monitoring running track device on the vehicle to determine whether the vehicle deviates from the lane so as to judge whether the driver is in a fatigue driving state. When the vehicle is running, if it deviates from the track, an accident will occur. In the high-speed section, the time left for the driver to react and take control measures is very short, and the result is that even if there is a fatigue driving warning system, the effect is not good. In addition, the vehicle does not always move in a straight line during driving, so the misjudgment rate is high.
[0005] Fatigue driving monitoring system based on human eyes: This mode uses a camera to monitor the state of human eyes and judges the degree of fatigue according to the opening degree of human eyes. This mode has requirements for the environment, and when the light is dark or the driver wears dark glasses, the shooting effect is poor so that the state of human eyes cannot be accurately identified. When the road is smooth and has no curvature, the vehicle approaches a kind of uniform straight motion, and the driver is prone to visual fatigue and driving posture fatigue. This monitoring system cannot ideally identify these two degrees of fatigue.
[0006] From the above technical description, it can be known that these technical directions have not involved solving the problem of safe communication during driving. Some vehicles are equipped with a vehicle-mounted Bluetooth communication system, but because the driver is far away from the microphone, the sound of speaking cannot be effectively distinguished from the noise inside the vehicle, so that the counterpart of the communication cannot clearly hear the content that the driver needs to deliver, resulting in the abandonment of the vehicle-mounted Bluetooth communication system; and a large part of vehicles do not have a vehicle-mounted Bluetooth communication system. Therefore, it is necessary to accurately monitor the fatigue of the driver and at the same time provide a friendly and safe communication system. Summary of the Invention
[0007] The posture detection method, device, wireless earphone, and storage medium provided in the embodiments of the present invention at least solve the technical problem that existing wireless earphones do not have the function of detecting abnormal postures such as user head fatigue posture.
[0008] This invention provides an attitude detection method for use in wireless headphones, comprising:
[0009] Collect the user's first head movement data;
[0010] The motion curve of the user's head is generated based on the first motion data collected;
[0011] Obtain the comparison result between the motion curve and the standard motion curve, and send an alarm prompt to the user based on the comparison result.
[0012] This invention also provides an attitude detection device for use in wireless headphones, comprising:
[0013] The posture acquisition unit is used to collect the first motion data of the user's head;
[0014] The posture determination unit is used to generate the motion curve of the user's head based on the collected first motion data; and to obtain the comparison result between the motion curve and the standard motion curve.
[0015] The posture reminder unit is used to send an alarm prompt to the user based on the comparison result.
[0016] This invention also provides a wireless headset, comprising: a processor, a memory, and a communication bus;
[0017] The communication bus is used to enable communication between the processor and the memory;
[0018] The processor is used to execute one or more computer programs stored in the memory to implement the steps of the attitude detection method as described above.
[0019] This invention also provides a computer-readable storage medium storing one or more computer programs that can be executed by one or more processors to implement the steps of the attitude detection method described above.
[0020] According to the posture detection method, device, wireless earphone, and storage medium provided in the embodiments of the present invention, the user's head first motion data is collected; a motion curve of the user's head is generated based on the collected first motion data; the comparison result of the motion curve and a standard motion curve is obtained; and an alarm prompt is sent to the user based on the comparison result. This enables the acquisition of the user's head posture data through a wireless earphone, and the sending of an alarm prompt to the user's head when the user's head is in an abnormal posture (e.g., fatigue state), thereby timely reminding the user to rest or adjust poor posture.
[0021] Other features and corresponding beneficial effects of the present invention will be described in the latter part of the specification, and it should be understood that at least some of the beneficial effects will become obvious from the description in the specification. Attached Figure Description
[0022] Figure 1 This is a flowchart illustrating the attitude detection method in Embodiment 1 of the present invention;
[0023] Figure 2 This is a schematic diagram of the structure of the wireless earphone connecting to the cloud in Embodiment 1 of the present invention;
[0024] Figure 3 This is a schematic diagram of the motion curve model in Embodiment 1 of the present invention;
[0025] Figure 4 This is a schematic diagram of the attitude detection device in Embodiment 2 of the present invention;
[0026] Figure 5 This is a schematic diagram of the structure of an attitude detection device according to Embodiment 3 of the present invention;
[0027] Figure 6 This is a schematic diagram of another attitude detection device in Embodiment 3 of the present invention;
[0028] Figure 7 This is a detailed flowchart of an attitude detection method according to Embodiment 3 of the present invention.
[0029] Figure 8 This is a schematic diagram of the structure of another attitude detection device in Embodiment 3 of the present invention.
[0030] Figure 9 This is a detailed flowchart illustrating another attitude detection method in Embodiment 3 of the present invention;
[0031] Figure 10 This is a schematic diagram of the structure of the wireless earphone in Embodiment 4 of the present invention. Detailed Implementation
[0032] To make the objectives, technical solutions, and advantages of this invention clearer, the embodiments of this invention will be further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
[0033] Example 1:
[0034] This invention provides an attitude detection method for wireless headphones. Please refer to [link / reference]. Figure 1 As shown, the attitude detection method includes the following steps:
[0035] S101: Collects the first motion data of the user's head.
[0036] In some embodiments, before collecting the first motion data of the user's head, the method further includes: detecting the wearing status of the wireless headphones;
[0037] In practical applications, when the wireless earbuds are not worn (i.e., in a non-wearing state), they enter a sleep state to reduce power consumption. The user's head posture detection function is activated only when the earbuds are worn. To achieve this wear detection function, the wireless earbuds incorporate an accelerometer and / or a distance sensor. The distance detector can be an infrared proximity sensor or a capacitive sensor. An infrared proximity sensor determines the distance between itself and the user based on the intensity of the infrared light reflected back after the emitted infrared light passes through the user's obstruction. A capacitive sensor determines the distance based on the change in capacitance caused by the user's skin approaching the contact point. The methods for detecting whether the wireless earbuds are being worn include, but are limited to, the following:
[0038] Method 1: Collect the acceleration value of the wireless earphone; if the acceleration value changes within a preset time, determine that the wireless earphone is in a wearing state.
[0039] Method 2: Collect the distance value between the wireless earphone and the user's head. If the distance value is less than or equal to a preset distance threshold within a preset time, it is determined that the wireless earphone is being worn.
[0040] Method 3: Collect the acceleration value of the wireless earphone and the distance value between the wireless earphone and the user's head respectively. If the acceleration value changes within a preset time and the distance value is less than or equal to a preset distance threshold, it is determined that the wireless earphone is in the wearing state.
[0041] Of the three methods mentioned above, method three helps to eliminate the possibility of users accidentally touching the wireless earphones, thereby improving the accuracy of wear detection.
[0042] In practical applications, the wireless earphones are in sleep mode. Accelerometer values are periodically acquired, and if the acceleration value changes within a preset time, it's determined that the earphones have been moved. A distance detector (e.g., a proximity infrared sensor or a capacitive sensor) is then activated for further detection, periodically acquiring distance values. If these distance values remain less than or equal to a preset distance threshold within a preset time, it's determined that the earphones are being worn. The preset distance threshold can be appropriately selected based on the specific type of distance detector and the required sensitivity. For example, the preset distance threshold could be 1mm, 1.5mm, 2.0mm, or 2.5mm. Furthermore, after determining that the earphones are being worn, the distance detector remains active, continuing to periodically acquire distance values. If these distance values remain greater than the preset threshold within a preset time, it's determined that the earphones have been removed. Once the earphones are removed, they enter sleep mode until they are worn again.
[0043] S102: Generate the motion curve of the user's head based on the collected first motion data.
[0044] The wireless earphones have a built-in angular velocity sensor (also known as a gyroscope), which can be used to collect the angle and direction of the user's head. In S102, the first motion data includes the angle, direction, and frequency of the wireless earphones. Subsequently, a motion curve of the user's head can be constructed based on the first motion data. By comparing the motion curve with a standard motion curve, it can be determined whether the user's head posture is normal or abnormal.
[0045] In practical applications, to accurately construct the motion curve of a user's head, a sufficient amount of motion data needs to be collected, making the processing of this motion data quite complex. In real-world application scenarios, such as... Figure 2 As shown, a system can be composed of wireless earphones, a mobile terminal, and a cloud. The wireless earphones are paired with the mobile terminal and communicate with the cloud through the mobile terminal. Furthermore, when the wireless earphones integrate a specific chip, they can also communicate directly with the cloud. In this embodiment, a suitable execution entity can be selected to process the user's head motion data to generate a user's head motion curve based on actual application needs; a suitable execution entity can also be selected to compare the motion curve with a standard motion curve to obtain a comparison result. The aforementioned execution entity can be a wireless earphone or a third device, where the third device can be a mobile terminal paired with the wireless earphones or a cloud device communicating with the wireless earphones.
[0046] To better understand, here are some specific examples:
[0047] In one example, the wireless earphone generates a motion curve of the user's head based on the collected first motion data; a pre-stored standard motion curve is retrieved from the wireless earphone, and the motion curve is compared with the standard motion curve to obtain the comparison result. In this method, the wireless earphone has a built-in standard motion curve, facilitating rapid acquisition of the standard motion curve for subsequent processing. Even if the wireless earphone cannot communicate with the mobile terminal and therefore cannot access the cloud, or if the wireless earphone lacks cloud service functionality and cannot access the cloud, the standard motion curve can still be obtained directly from within the wireless earphone.
[0048] In addition, the wireless earphones can generate a standard motion curve based on the collected motion data using a local algorithm. The specific process is as follows: S1, after detecting the user's head movement for the first time within a certain period and returning to the initial state, the timer is reset to zero to calibrate the accelerometer and gyroscope. S2, head motion posture parameter acquisition is initiated. S3, when the user's head movement is detected, the acceleration of this head movement is compared with the acceleration of the previous valid head movement to obtain the acceleration change rate. S4, when the acceleration change rate is less than or equal to a preset threshold, it indicates that this head movement monitoring is valid; the angle and direction of the head movement are recorded, and the movement frequency is calculated according to frequency = 1 / time; then proceed to S6. S5, when the acceleration change rate exceeds the preset threshold, it indicates that the user's sudden head movement is caused by other circumstances and is not a natural movement due to neck muscle relaxation; then proceed to S6. S6, after the head movement angle returns to the initial state, the timer is reset to zero, and the next head motion posture parameter acquisition begins, returning to S3. A standard motion curve is constructed based on the collected valid head motion posture parameters. Figure 3 As shown, based on the angles and frequencies within the effective head movement posture parameters, the user's head movement curves are constructed using flexion, extension, left side, and right side as anchor points.
[0049] In another example, the wireless earpiece generates a motion curve of the user's head based on the collected first motion data; it receives a standard motion curve sent by a third-party device, and compares the motion curve with the standard motion curve through the wireless earpiece to obtain the comparison result. In this approach, the standard motion curve can be generated by a third-party device to obtain a more accurate standard motion curve, thereby improving the accuracy of posture detection.
[0050] To reduce the false positive rate by constructing corresponding standard motion curves for different users, the method further includes, before receiving the standard motion curve sent by a third-party device: collecting second motion data of the user's head, the second motion data including the acceleration value of the wireless earphone; and when the acceleration value is less than or equal to a preset acceleration threshold within a preset time, sending the second motion data to the third-party device so that the third-party device can generate the standard motion curve based on the second motion data. For example, in a practical application scenario, the wireless earphone is paired with a mobile terminal via Bluetooth. When the wireless earphone is in the wearing state, the second motion data of the user's head is acquired through the wireless earphone, the second motion data including the acceleration value of the wireless earphone and the angle and frequency of the wireless earphone; when the acceleration value is less than or equal to the preset acceleration threshold within a preset time, it is determined that the user's head posture is in a normal posture; at this time, the second motion data of the user's head collected within the preset time can be sent to the mobile terminal, and then the mobile terminal constructs the standard motion curve of the user's head based on the second motion data and feeds it back to the wireless earphone; after receiving the standard motion curve, the wireless earphone compares the user's head motion curve with the standard motion curve to determine whether the user's head posture is normal. In another practical application scenario, wireless earbuds pair with a mobile terminal via Bluetooth, and the earbuds communicate with the cloud via the mobile terminal. When the wireless earbuds are being worn, they acquire second motion data of the user's head, including the earbuds' acceleration value, angle, and frequency. If the acceleration value is less than or equal to a preset acceleration threshold within a preset time, the user's head posture is determined to be normal. At this point, the mobile terminal can send the second motion data of the user's head collected within the preset time to the cloud. Then, an artificial intelligence algorithm in the cloud constructs a standard motion curve of the user's head based on the second motion data and feeds it back to the wireless earbuds via the mobile terminal. After receiving the standard motion curve, the wireless earbuds compare the user's head motion curve with the standard motion curve to determine whether the user's head posture is normal.
[0051] It should be noted that the specific process of generating a standard motion curve in the cloud based on artificial intelligence algorithms is as follows: After receiving n valid head movement posture data, the head movement curve is identified by classifying the head movement based on its angle, frequency, and rate of change of acceleration using a classification algorithm (such as the K-nearest neighbor algorithm). Simultaneously, the next head movement posture data is predicted based on this head movement curve. If k out of m predictions are accurate, then this head movement curve is determined to be the standard motion curve for the current wearer's head movement posture. The values of m and k are set according to the accuracy requirements.
[0052] In another example, the first motion data is sent to a third-party device; and the comparison result is received from the third-party device. Using this method, a third-party device is selected to process the user's head motion data to obtain the user's head motion curve, and the user's head motion curve is compared with a standard motion curve to determine the user's head posture, which helps improve the accuracy of posture detection.
[0053] S103: Obtain the comparison result between the motion curve and the standard motion curve, and send an alarm prompt to the user based on the comparison result.
[0054] When wireless headphones are worn, they move with the user's head, and their motion data can be considered as the user's head motion data. In some real-world scenarios, when the user's head is in a normal posture, the tension torque of the neck muscles keeps the head's posture stable, resulting in minimal head acceleration. When the user experiences postural fatigue (i.e., an abnormal posture), the tension torque of the neck muscles cannot balance the gravitational torque of the head and neck, leading to changes in acceleration, resulting in a larger head acceleration. In other real-world scenarios, when the user experiences postural fatigue (i.e., an abnormal posture), the head acceleration is small, and the head posture remains unchanged for a long time. The frequency and angle of head movement are both small, resulting in a flatter head motion curve. Therefore, the current posture of the user's head can be determined based on any one or more parameters such as acceleration value, frequency, and angle during head movement. To better understand this, the following further explains how to determine the user's head posture:
[0055] In one example, the first motion data includes the angle and frequency of the wireless earphone. A motion curve of the user's head is generated based on the angle and frequency; a standard motion curve is also obtained. Then, obtaining the comparison result between the motion curve and the standard motion curve includes: obtaining a first frequency and a first angle of the motion curve and a second frequency and a second angle of the standard motion curve; when the first frequency is less than the second frequency and the first angle is less than the second angle, a comparison result indicating that the user's head is in an abnormal posture is generated; and / or, when the first frequency is greater than the second frequency and the first angle is greater than the second angle, a comparison result indicating that the user's head is in an abnormal posture is generated.
[0056] In another example, the first motion data includes: the acceleration value of the wireless earphone and the angle and frequency of the wireless earphone. A motion curve of the user's head is generated based on the angle and frequency; a standard motion curve is also obtained. If the acceleration value is greater than a preset acceleration threshold within a preset time and the acceleration value shows an increasing trend, an abnormal result indicating that the user's head is in an abnormal posture is generated, and an alarm prompt is sent to the user based on the abnormal result; if the acceleration value is less than the preset acceleration threshold within a preset time, the motion curve is compared with the standard motion curve to obtain the comparison result. The specific process of comparing the motion curve with the standard motion curve to obtain the comparison result is as described above and will not be repeated here.
[0057] It is understandable that when comparing a motion curve with a standard motion curve, frequency and angle can be expressed in the form of interval values. Frequency can indicate how fast the angle of the motion curve or the standard motion curve changes, and angle can indicate the range of angle change of the motion curve or the standard motion curve.
[0058] The wireless earphone has a built-in speaker and motor; sending alarm prompts to the user through the wireless earphone includes: sending voice prompts to the user's head through the speaker in the wireless earphone, and / or sending vibration prompts to the user's head through the motor in the wireless earphone.
[0059] According to the posture detection method provided in the embodiments of the present invention, the posture data of the user's head can be obtained by means of wireless headphones, and when the user's head is in an abnormal posture (such as fatigue), an alarm prompt can be sent to the user's head to achieve the purpose of timely reminding the user to pay attention to rest or adjust poor posture.
[0060] Example 2
[0061] This invention provides an attitude detection device for wireless headphones. Please refer to [link / reference]. Figure 4 As shown, the posture detection device includes at least the following units: a posture acquisition unit 201, a posture judgment unit 202, and a posture reminder unit 203. The posture acquisition unit 201 is used to collect first motion data of the user's head; the posture judgment unit 202 is used to generate a motion curve of the user's head based on the collected first motion data; and the posture reminder unit 203 is used to obtain the comparison result between the motion curve and a standard motion curve, and send an alarm prompt to the user based on the comparison result.
[0062] In some embodiments, the posture acquisition unit 201 is further configured to acquire the acceleration value of the wireless earphone and / or acquire the distance value between the wireless earphone and the user's head. The posture detection device further includes a wearing detection unit. The wearing detection unit is configured to determine that the wireless earphone is in a wearing state when the acceleration value changes within a preset time; or, the wearing detection unit is configured to determine that the wireless earphone is in a wearing state when the distance value is less than or equal to a preset distance threshold within a preset time; or, the wearing detection unit is configured to determine that the wireless earphone is in a wearing state when the acceleration value changes within a preset time and the distance value is less than or equal to the preset distance threshold.
[0063] In some embodiments, the posture determination unit 202 is specifically used to generate a motion curve of the user's head based on the collected first motion data via the wireless earphone; obtain a pre-stored standard motion curve from the wireless earphone; and compare the motion curve with the standard motion curve via the wireless earphone to obtain the comparison result. Alternatively, the posture determination unit 202 is specifically used to generate a motion curve of the user's head based on the collected first motion data via the wireless earphone; receive the standard motion curve sent by a third-party device; and compare the motion curve with the standard motion curve via the wireless earphone to obtain the comparison result. Alternatively, the posture determination unit 202 is specifically used to send the first motion data to a third-party device; and receive the comparison result sent by the third-party device. The third-party device may be a mobile terminal paired with and connected to the wireless earphone, or a cloud application communicatively connected to the wireless earphone.
[0064] In some embodiments, the posture acquisition unit 201 is further configured to collect second motion data of the user's head, the second motion data including the acceleration value of the wireless earphone. The posture determination unit 202 is further configured to send the second motion data to the third-party device when the acceleration value is less than or equal to a preset acceleration threshold within a preset time, so that the third-party device can generate the standard motion curve based on the second motion data.
[0065] In some embodiments, the posture determination unit 202 is further specifically used to obtain the first frequency and first angle of the motion curve and the second frequency and second angle of the standard motion curve; when the first frequency is less than the second frequency and the first angle is less than the second angle, a comparison result of the user's head being in an abnormal posture is generated; and / or, the posture determination unit 202 is further specifically used to generate a comparison result of the user's head being in an abnormal posture when the first frequency is greater than the second frequency and the first angle is greater than the second angle.
[0066] In some embodiments, when the first motion data includes the acceleration value of the wireless earphone, the posture determination unit 202 is further configured to generate an abnormal result indicating that the user's head is in an abnormal posture when the acceleration value is greater than a preset acceleration threshold and the acceleration value shows an increasing trend within a preset time; and to compare the motion curve with the standard motion curve to obtain the comparison result when the acceleration value is less than the preset acceleration threshold within a preset time. The posture reminder unit 203 is further configured to send an alarm prompt to the user based on the abnormal result.
[0067] The posture detection device provided in the embodiments of the present invention realizes the acquisition of user head posture data by means of wireless headphones, and sends an alarm prompt to the user's head when the user's head is in an abnormal posture (such as a fatigued state), so as to timely remind the user to pay attention to rest or adjust poor posture.
[0068] Example 3:
[0069] This invention provides a preferred posture detection method and apparatus. The wireless earphone can be an in-ear wireless Bluetooth earphone or a bone conduction wireless Bluetooth earphone. Please refer to... Figure 5 As shown, the posture detection device in the wireless earphone includes the following units: posture tracking unit 301 (corresponding to posture acquisition unit 201), audio vibration unit 302 (corresponding to posture reminder unit 203), wearing detection unit 300, wireless connection unit 303, power management unit 304, storage unit 305, and management and control unit 306 (corresponding to posture judgment unit 202). The functions of each unit in the posture detection device are described in detail below:
[0070] The wear detection unit 300 is used to determine whether the user has properly worn the wireless earphones. The posture tracking unit 301 is only enabled and its data is valid when the wireless earphones are being worn. Simultaneously, when the wireless earphones are not being worn, they are in a deep sleep state to reduce the overall system power consumption. The wear detection unit 300 includes a distance detector and an accelerometer, wherein the distance detector can be either a proximity infrared sensor or a capacitive sensor. The distance detector can be positioned around each speaker. In practical applications, the wear detection unit 300 specifically reads the acceleration values from the accelerometer at regular intervals. When the acceleration value changes within a preset time, it determines that the wireless earphones are in motion. It then activates the distance detector for periodic detection; when the distance value detected by the distance detector is less than or equal to a preset distance threshold, it determines that the wireless earphones are being worn.
[0071] An attitude tracking unit 301 is used to monitor the user's head movement data. This attitude tracking unit 301 may include an accelerometer and / or an angular velocity sensor (also known as a gyroscope). The accelerometer obtains the acceleration value of the wireless headphones, while the gyroscope obtains the angle of the wireless headphones.
[0072] The audio vibration unit 302 provides functions such as electroacoustic conversion, audio acquisition, and vibration alerts. This audio vibration unit 302 includes, but is not limited to, a microphone (MIC), a bone conduction speaker, and a motor. The microphone is used to acquire audio data; the bone conduction speaker is used to convert electrical signals into audio data; and the motor is used to generate vibrations. In practical applications, when a user makes a call using a bone conduction wireless headset, the audio vibration unit 302 transmits audio data to the user via bone conduction and also sends the acquired audio data to the management control unit 306, which then sends the audio data to the mobile terminal. Furthermore, the audio vibration unit 302 also receives alert messages sent by the management control unit 306 and provides timely auditory and tactile reminders to the user to take breaks or adjust poor posture.
[0073] The wireless connection unit 303 provides a mobile network for connecting the wireless headset to external devices such as mobile terminals, for example, via Bluetooth or Wi-Fi. The management control unit 306 transmits audio data to the mobile terminal and other external devices through the wireless connection unit 303 to enable voice calls. When the wireless headset can access the cloud, it can also transmit the user's head motion data to the mobile terminal via the wireless connection unit 303, and then from the mobile terminal to the cloud. In this mode, an artificial intelligence algorithm (such as the K-nearest neighbor algorithm) in the cloud can construct a motion curve of the user's head based on the head motion data; then, the mobile terminal feeds back the user's head motion curve to the wireless headset. It should be understood that the user's head motion curve estimated by the cloud is the motion curve when the user's head is in a normal posture, and it can be used as a reference motion curve for determining the current posture of the user's head; this reference motion curve will be referred to as the standard motion curve below.
[0074] The power management unit 304 is used to power other units in the attitude detection device and charge the battery in this unit. Since wireless headphones do not require audio cables to improve portability, the individual units inside the wireless headphones rely on batteries for power. In addition, the power management unit 304 may also include a power switch, which can be used to control the power supply circuits of other units in the attitude detection device to further reduce power consumption.
[0075] Storage unit 305 is used to store the user's head motion data and the motion curve of the user's head in a normal posture (i.e., the standard motion curve). In practical applications, when the wireless connection unit 303 in the wireless headset is offline, or the wireless headset cannot successfully connect to the cloud due to network instability, or the wireless headset does not have cloud service functionality, the management control unit 306 can obtain the standard motion curve from storage unit 305. In this mode, the standard motion curve is estimated by a local algorithm. Meanwhile, storage unit 305 includes, but is not limited to, TF card (Trans-flash Card) and flash memory (Flash EEPROM) storage chips.
[0076] The management control unit 306 is used to determine the current posture of the user's head. In practical applications, when the wireless headphones are worn, it is necessary to determine the current posture of the user's head. At this time, the management control unit 306 obtains a standard motion curve from the storage unit 305, or obtains a standard motion curve from the cloud through the wireless connection unit 303 and the mobile terminal; and obtains the user's head motion data from the posture tracking unit 301, and constructs the user's head motion curve based on the user's head motion data; then, it determines the current posture of the user's head based on the motion curve and the standard motion curve, and finally generates a prompt message based on the comparison result and sends it to the audio vibration unit 302.
[0077] To better understand the present invention, the embodiments of the present invention are described in detail with reference to specific application scenarios:
[0078] Application Scenario 1:
[0079] The posture detection device and method provided in this invention can be applied to monitor driver fatigue, allowing drivers to enjoy the convenience of driving while also having an extra layer of safety monitoring. In this case, the wireless earphone is a bone conduction wireless earphone. Because the wireless earphone uses bone conduction, there is no need to insert earplugs into the ear canal, thus not reducing the driver's perception of external sounds.
[0080] Please see Figure 6As shown, the posture detection device applied to wireless headphones includes the following units: posture tracking unit 301, audio vibration unit 302, wear detection unit 300, wireless connection unit 303, power management unit 304, storage unit 305, and management and control unit 306. The wear detection unit 300 includes an accelerometer and an infrared proximity sensor; the posture tracking unit 301 includes a gyroscope and an accelerometer; the audio vibration unit 302 includes an audio codec unit, a microphone, a bone conduction speaker, and a motor; the wireless connection unit 303 connects to a mobile terminal via Bluetooth; the power management unit 304 includes a charging and power conversion unit and a battery; the storage unit 305 includes a Flash memory chip; and the management and control unit 306 includes a microcontroller unit (MCU).
[0081] Please see Figure 7 As shown, the attitude detection method applied to wireless headphones includes the following steps:
[0082] S501: The wireless earphone is in sleep mode. It periodically acquires the acceleration value detected by the accelerometer and determines whether the acceleration value changes within a preset time. If it does, it is determined that the wireless earphone is in motion, and then S502 is executed; otherwise, no action is taken.
[0083] S502: Activate the infrared proximity sensor for detection.
[0084] S503: Periodically acquire the distance value detected by the infrared proximity sensor, and determine whether the distance value is less than or equal to the preset distance value within a preset time; if so, determine that the wireless earphone is in the wearing state; otherwise, determine that the wireless earphone is only in the moving state.
[0085] S504: Confirm that the wireless earphones are being worn, then proceed to S506;
[0086] S505: Determine that the wireless earphones are only in motion and do not take any action.
[0087] S506: Calibrates the accelerometer and gyroscope, and establishes a Bluetooth connection with the mobile terminal.
[0088] S507: Determine if the wireless earphone can connect to the cloud; if not, proceed to S508; otherwise, proceed to S509.
[0089] S508: Retrieves pre-stored standard motion curves from local storage.
[0090] S509: Periodically acquire acceleration values from the accelerometer.
[0091] S510: Determine whether the acceleration value within the preset time is less than the preset acceleration threshold; if yes, execute S511; otherwise, return to execute S509.
[0092] S511: The user's head motion data is uploaded to the cloud via the mobile terminal, and the cloud's artificial intelligence algorithm estimates the motion curve (i.e., the standard motion curve) of the user's head when it is in a normal posture.
[0093] S512: Receives standard motion curves sent from the cloud via a mobile terminal.
[0094] S513: Periodically acquires acceleration values from the accelerometer and parameters from the gyroscope.
[0095] S514: Determine the motion curve of the user's head based on the parameters of the gyroscope.
[0096] S515: Determine whether the acceleration value is greater than the preset acceleration threshold within a preset time; if yes, execute S516; otherwise, execute S517.
[0097] S516: When the acceleration value shows an increasing trend within this preset time, it is determined that the driver's fatigue level is high, and the driver is promptly reminded to take a rest.
[0098] S517: Based on the motion curve and the standard motion curve, further determine whether the user's current head posture is in an abnormal posture; if so, execute S518; otherwise, return to execute S513.
[0099] S518: When the frequency of the motion curve is less than that of the standard motion curve, and the angle of the motion curve is less than that of the standard motion curve, the driver's fatigue level is determined to be high, and the driver is promptly reminded to take a rest. If the vehicle's control unit has a driver status data access function, this fatigue level is also transmitted to the vehicle's control unit, which limits or reduces the driving speed based on the fatigue level.
[0100] The posture detection method and apparatus provided in this invention enable driver fatigue monitoring when the driver wears a wireless headset, as the headset has posture detection capabilities. Simultaneously, during the monitoring process, the wireless headset can issue auditory and / or tactile warnings to the driver based on the degree of fatigue, providing an additional layer of safety monitoring while the driver enjoys the convenience of car travel.
[0101] Application Scenario 2:
[0102] The posture detection device and method provided in this invention can be applied to monitor the fatigue state of primary school students, thereby helping them maintain focus. In this case, the wireless headphones can be either in-ear wireless headphones or bone conduction wireless headphones.
[0103] Please see Figure 8 As shown, the posture detection device applied to wireless headphones includes the following units: posture tracking unit 301, audio vibration unit 302, wear detection unit 300, wireless connection unit 303, power management unit 304, storage unit 305, and management and control unit 306. The wear detection unit 300 includes an accelerometer and a capacitive sensor (i.e., the capacitive touch button in the figure); the posture tracking unit 301 includes a gyroscope and an accelerometer; the audio vibration unit 302 includes an audio codec unit, a microphone, a bone conduction speaker, and a motor; the wireless connection unit 303 connects to a mobile terminal via Bluetooth; the power management unit 304 includes a charging and power conversion unit and a battery; the storage unit 305 includes a Flash memory chip; and the management and control unit 306 includes a microcontroller unit (MCU).
[0104] Please see Figure 9 As shown, the attitude detection method applied to wireless headphones includes the following steps:
[0105] S701: The wireless earphone is in sleep mode. It periodically acquires the acceleration value detected by the accelerometer and determines whether the acceleration value changes within a preset time. If it does, it is determined that the wireless earphone is in motion, and then S702 is executed; otherwise, no action is taken.
[0106] S702: Start the capacitive sensor for detection.
[0107] S703: Periodically acquire the distance value detected by the capacitive sensor, and determine whether the distance value is less than or equal to the preset distance value within a preset time; if so, determine that the wireless earphone is in the wearing state; otherwise, determine that the wireless earphone is only in the moving state.
[0108] S704: Confirm that the wireless earphones are being worn, then proceed to S706;
[0109] S705: Confirm that the wireless earphones are only in motion and do not take any action.
[0110] S706: Calibrates the accelerometer and gyroscope, and establishes a Bluetooth connection with the mobile terminal.
[0111] S707: Determine if the wireless earphone can connect to the cloud; if not, proceed to S708; otherwise, proceed to S709.
[0112] S708: Retrieves pre-stored standard motion curves from local storage.
[0113] S709: Periodically acquires acceleration values from the accelerometer.
[0114] S710: Determine whether the acceleration value within the preset time is less than the preset acceleration threshold; if yes, execute S711; otherwise, return to execute S709.
[0115] S711: Uploads the user's head motion data to the cloud via the mobile terminal, and the cloud's artificial intelligence algorithm estimates the motion curve (i.e., the standard motion curve) of the user's head when it is in a normal posture.
[0116] S712: Receives standard motion curves sent from the cloud via a mobile terminal.
[0117] S713: Timely acquire gyroscope parameters.
[0118] S714: Determines the motion curve of the user's head based on the parameters of the gyroscope.
[0119] S715: Determine whether the motion curve and the standard motion curve meet the first preset condition, which is that the frequency of the motion curve is less than the frequency of the standard motion curve and the angle of the motion curve is less than the angle of the standard motion curve; if not, execute S716; otherwise, return to execute S717.
[0120] S716: If it is determined that the primary school student is highly fatigued, the primary school student should be reminded in a timely manner to take a rest or move their head slightly.
[0121] S717: Continue to determine whether the motion curve and the standard motion curve meet the second preset condition. The second preset condition is that the frequency of the motion curve is greater than the frequency of the standard motion curve, and the angle of the motion curve is greater than the angle of the standard motion curve. If yes, execute S718; otherwise, return to execute S713.
[0122] S718: If a primary school student is found to be inattentive, promptly remind the student to concentrate or adjust their posture while writing.
[0123] The posture detection method and apparatus provided in this invention enable primary school students to monitor their fatigue state after wearing wireless headphones, as these headphones possess posture detection capabilities. Simultaneously, during the monitoring process, the wireless headphones can issue auditory and / or tactile warnings based on the degree of fatigue, helping students concentrate and maintain correct posture while doing homework or listening to lessons.
[0124] Example 4:
[0125] This embodiment provides a wireless earphone, see [link / reference] Figure 10 As shown, it includes a processor 801, a memory 802, and a communication bus 803, wherein:
[0126] Communication bus 803 is used to realize the connection and communication between processor 801 and memory 802;
[0127] The processor 801 is used to execute one or more computer programs stored in the memory 802 to implement at least one step of the attitude detection method in the above embodiments.
[0128] This embodiment also provides a computer-readable storage medium, which includes volatile or non-volatile, removable or non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules or other data). Computer-readable storage media include, but are not limited to, RAM (Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory or other memory technologies, CD-ROM (Compact Disc Read-Only Memory), DVD or other optical disc storage, magnetic cartridges, magnetic tapes, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible by a computer.
[0129] The computer-readable storage medium in this embodiment can be used to store one or more computer programs, which can be executed by a processor to implement at least one step of the attitude detection method in the above embodiments.
[0130] This embodiment also provides a computer program (or computer software) that can be distributed on a computer-readable medium and executed by a computing device to implement at least one step in the attitude detection method in the above embodiments; and in some cases, at least one step shown or described can be executed in a different order than that described in the above embodiments.
[0131] This embodiment also provides a computer program product, including a computer-readable device on which the computer program as shown above is stored. In this embodiment, the computer-readable device may include the computer-readable storage medium as shown above.
[0132] Therefore, those skilled in the art should understand that all or some of the steps, systems, and devices disclosed above, as well as the functional modules / units, can be implemented as software (which can be implemented using computer program code executable by a computing device), firmware, hardware, and suitable combinations thereof. In hardware implementations, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as integrated circuits, such as application-specific integrated circuits (ASICs).
[0133] Furthermore, as is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, computer program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium. Therefore, this invention is not limited to any particular combination of hardware and software.
[0134] The above description, in conjunction with specific implementation methods, provides a further detailed explanation of the embodiments of the present invention. It should not be construed that the specific implementation of the present invention is limited to these descriptions. For those skilled in the art, various simple deductions or substitutions can be made without departing from the concept of the present invention, and all such modifications and substitutions should be considered within the scope of protection of the present invention.
Claims
1. An attitude detection method, applied to wireless headphones, comprising: Collect the user's first head movement data; The motion curve of the user's head is generated based on the first motion data collected; The comparison result between the motion curve and the standard motion curve is obtained, and an alarm prompt is sent to the user based on the comparison result. The standard motion curve is generated based on the second motion data when the user's head posture is determined to be in a normal posture based on the second motion data of the current user's head. The comparison results between the motion curve and the standard motion curve include: Obtain the first frequency and first angle of the motion curve and the second frequency and second angle of the standard motion curve; When the first frequency is less than the second frequency and the first angle is less than the second angle, a comparison result is generated in which the user's head is in an abnormal posture; And / or, When the first frequency is greater than the second frequency and the first angle is greater than the second angle, a comparison result is generated showing the user's head in an abnormal posture.
2. The attitude detection method as described in claim 1, characterized in that, Before collecting the first motion data of the user's head, the wearing status of the wireless headphones is also detected; The detection of the wearing status of the wireless earphones includes: The acceleration value of the wireless earphone is collected, and if the acceleration value changes within a preset time, it is determined that the wireless earphone is in a wearing state. or, The distance between the wireless earphone and the user's head is collected. If the distance value is less than or equal to a preset distance threshold within a preset time, it is determined that the wireless earphone is in a wearing state. The acceleration value of the wireless earphone and the distance value between the wireless earphone and the user's head are collected respectively. If the acceleration value changes within a preset time and the distance value is less than or equal to a preset distance threshold, it is determined that the wireless earphone is in a wearing state.
3. The attitude detection method as described in claim 1, characterized in that, The method further includes: The wireless earphone generates a motion curve of the user's head based on the first motion data collected; the wireless earphone retrieves the pre-stored standard motion curve, and the wireless earphone compares the motion curve with the standard motion curve to obtain the comparison result. The wireless earphones generate the motion curve of the user's head based on the collected first motion data; The system receives the standard motion curve sent by a third-party device and compares the motion curve with the standard motion curve through the wireless earphone to obtain the comparison result. Send the first motion data to a third-party device; and receive the comparison result sent by the third-party device.
4. The attitude detection method as described in claim 3, characterized in that, Before receiving the standard motion curve sent by the third-party device, the method further includes: Collect second motion data of the user's head, the second motion data including the acceleration value of the wireless earphone; When the acceleration value is less than or equal to a preset acceleration threshold within a preset time period, the second motion data is sent to the third-party device so that the third-party device can generate the standard motion curve based on the second motion data.
5. The attitude detection method as described in claim 1, characterized in that, When the first motion data includes the acceleration value of the wireless earphone; the method further includes: When the acceleration value is greater than the preset acceleration threshold within a preset time and the acceleration value shows an increasing trend, an abnormal result is generated indicating that the user's head is in an abnormal posture, and an alarm prompt is sent to the user based on the abnormal result. If the acceleration value is less than a preset acceleration threshold within a preset time period, the motion curve is compared with the standard motion curve to obtain the comparison result.
6. An attitude detection device, applied to wireless headphones, characterized in that, include: The posture acquisition unit is used to collect the first motion data of the user's head; The posture determination unit is used to generate the motion curve of the user's head based on the collected first motion data, and to obtain the comparison result between the motion curve and the standard motion curve. The posture reminder unit is used to send an alarm prompt to the user based on the comparison result, wherein the standard motion curve is generated based on the second motion data when it is determined that the current user's head posture is in a normal posture. The posture determination unit is also used to obtain the first frequency and first angle of the motion curve and the second frequency and second angle of the standard motion curve; when the first frequency is less than the second frequency and the first angle is less than the second angle, a comparison result of the user's head being in an abnormal posture is generated; And / or, the posture determination unit is further configured to generate a comparison result of the user's head being in an abnormal posture when the first frequency is greater than the second frequency and the first angle is greater than the second angle.
7. The attitude detection device as described in claim 6, characterized in that, Also includes: Wearing a detection unit; The attitude acquisition unit is also used to collect the acceleration value of the wireless earphone and / or collect the distance value between the wireless earphone and the user's head; The wearing detection unit is used to determine that the wireless earphone is in a wearing state when the acceleration value changes within a preset time. The wearing detection unit is used to determine that the wireless earphone is being worn when the distance value is less than or equal to a preset distance threshold within a preset time. The wear detection unit is used to determine that the wireless earphone is in a wearing state when the acceleration value changes within a preset time and the distance value is less than or equal to a preset distance threshold.
8. A wireless earphone, characterized in that, include: Processor, memory, and communication bus; The communication bus is used to enable communication between the processor and the memory; The processor is used to execute one or more computer programs stored in the memory to implement the steps of the attitude detection method as described in any one of claims 1 to 5.
9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores one or more computer programs, which can be executed by one or more processors to implement the steps of the attitude detection method as described in any one of claims 1 to 5.
Citation Information
Patent Citations
Wireless earphone, wearing detection method thereof and storage medium
CN111372157A
Earpiece with an inertial sensor
US20030002705A1