Device drop detection method, electronic device, and storage medium

Abstract

The application discloses a device falling detection method, an electronic device and a storage medium, wherein in the device falling detection method, first audio data is collected after an audio playing device is switched from a wearing state to a non-wearing state, and whether the audio playing device is in a falling state is determined according to an audio feature parameter of the first audio data and a preset judgment condition, wherein when the audio feature parameter of the first audio data meets the preset judgment condition, it is determined that the audio playing device is in the falling state. Compared with the prior art, the application determines whether the audio playing device falls by using the audio data collected after the audio playing device is changed to the non-wearing state, without the need of additionally increasing the hardware of the audio playing device, thereby reducing the falling detection cost.

Description

Technical Field

[0001] This application relates to drop detection technology, including but not limited to a device drop detection method, electronic equipment, and storage medium. Background Technology

[0002] Wireless audio playback devices have gained increasing attention and popularity due to their portability, as they can connect to electronic devices without additional cables. They also offer significantly improved stereo sound compared to traditional audio players. However, wireless audio playback devices are easily dropped and lost, causing considerable inconvenience for users. Therefore, anti-loss technology for wireless audio playback devices is particularly important.

[0003] Existing anti-loss technology for wireless audio playback devices works by detecting whether the device is being touched when it detaches from the user's body, such as the ear. If the device is not being touched, it is determined that it has been dropped. This method accurately determines whether the device has been dropped. However, this method requires the addition of a touch sensor to detect the touch state, which occupies the stacking space of the wireless audio playback devices, making the design difficult and costly. Summary of the Invention

[0004] In view of this, the device drop detection method, electronic device and storage medium provided in the embodiments of this application can accurately determine whether the wireless audio playback device has fallen to the ground after it is detached from the user's body, and provide a prompt on the electronic device side to prevent the loss of the wireless audio playback device.

[0005] In a first aspect, embodiments of this application provide a device drop detection method applied to an electronic device, wherein the electronic device and an audio playback device have a wireless communication connection. The method includes: acquiring first audio data collected by the audio playback device, wherein the first audio data is collected after the audio playback device switches from a wearing state to an unwearing state; determining whether the audio playback device is in a drop state based on audio feature parameters of the first audio data and a preset judgment condition, wherein the preset judgment condition is determined based on the audio feature parameters of second audio data collected by the audio playback device in the drop state, wherein the audio feature parameters include one or more of the following: root mean square amplitude, average frequency amplitude, and duration of audio data with amplitude greater than or equal to a second threshold; wherein, when the audio feature parameters of the first audio data satisfy the preset judgment condition, the audio playback device is determined to be in the drop state.

[0006] In the aforementioned device drop detection method, first audio data is collected after the audio playback device is switched from a worn state to a non-worn state. Based on the audio characteristic parameters of the first audio data and preset judgment conditions, it is determined whether the audio playback device is in a drop state. Specifically, the audio playback device is determined to be in a drop state when the audio characteristic parameters of the first audio data meet the preset judgment conditions. Compared to existing technologies, this application uses audio data collected after the audio playback device is switched to a non-worn state to determine whether the audio playback device has been dropped, eliminating the need for additional hardware for the audio playback device and reducing drop detection costs.

[0007] In some embodiments, the audio feature parameters include the average frequency amplitude, and the preset judgment condition is that the value of the audio feature parameters is greater than or equal to a first threshold. Determining whether the audio playback device is in a drop state based on the audio feature parameters of the first audio data and the preset judgment condition includes: obtaining the frequency curve corresponding to the first audio data; calculating the average frequency amplitude of the frequency curve; determining that the audio playback device is in a drop state when the average frequency amplitude is greater than or equal to the first threshold; and determining that the audio playback device is in a non-drop state when the average frequency amplitude is less than the first threshold.

[0008] In some embodiments, calculating the average frequency point amplitude of the frequency curve includes: obtaining multiple target frequency points in the frequency curve within a preset frequency range, and the frequency point amplitude corresponding to each target frequency point; calculating the average of the multiple frequency point amplitudes according to the same frequency point amplitude coefficient to obtain the average frequency point amplitude.

[0009] In some embodiments, after determining whether the audio playback device is in a drop state based on the audio feature parameters of the first audio data and preset judgment conditions, the method further includes: when it is determined that the audio playback device is in the drop state, outputting a first prompt message, the first prompt message being used to prompt the user about the drop state.

[0010] In some embodiments, after determining whether the audio playback device is in a dropped state based on the audio feature parameters of the first audio data and a preset judgment condition, the method further includes: when the audio feature parameters of the first audio data do not meet the preset judgment condition, determining whether the audio playback device is placed in a storage device; when the audio playback device is not placed in the storage device, outputting a second prompt message, the second prompt message being used to prompt the user that the audio playback device is not in a dropped state, but needs to be placed in the storage device.

[0011] In some embodiments, after determining whether the audio playback device is placed inside the storage device, the method further includes: when the audio playback device is not placed inside the storage device, determining the location of the audio playback device, the location being used to indicate the distance between the audio playback device and the electronic device; correspondingly, the second prompt information also includes the location.

[0012] In some embodiments, determining whether the audio playback device is placed inside the storage device includes: receiving a storage status detection signal sent by the storage device; and determining whether the audio playback device is placed inside the storage device based on the storage status detection signal.

[0013] Secondly, the electronic device provided in this application embodiment has a wireless communication connection with an audio playback device. The electronic device includes: an audio data acquisition module, used to acquire first audio data collected by the audio playback device, the first audio data being collected after the audio playback device switches from a wearing state to a non-wearing state; and a drop state determination module, used to determine whether the audio playback device is in a drop state based on the audio feature parameters of the first audio data and a preset judgment condition. The preset judgment condition is determined based on the audio feature parameters of second audio data collected by the audio playback device in the drop state. The audio feature parameters include one or more of the following: root mean square amplitude, average frequency amplitude, and duration of audio data with amplitude greater than or equal to a second threshold. The audio playback device is determined to be in the drop state when the audio feature parameters of the first audio data satisfy the preset judgment condition.

[0014] Thirdly, the computer device provided in the embodiments of this application includes a memory and a processor. The memory stores a computer program that can run on the processor, and the processor executes the program to implement the method described in the embodiments of this application.

[0015] Fourthly, the computer-readable storage medium provided in the embodiments of this application stores a computer program thereon, which, when executed by a processor, implements the method described in the embodiments of this application.

[0016] It should be understood that the second to fourth aspects of the embodiments of this application are consistent with the technical solutions of the first aspect of the embodiments of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be described again. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with this application and, together with the specification, serve to explain the technical solutions of this application.

[0018] Figure 1 This is a schematic diagram of the structure of the equipment drop detection system provided in the embodiments of this application;

[0019] Figure 2 This is a schematic diagram of the structure of an audio playback device provided in an embodiment of this application;

[0020] Figure 3 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0021] Figure 4 A schematic flowchart illustrating the equipment drop detection method provided in this application embodiment;

[0022] Figure 5 A schematic diagram of the sound signal of the first audio data provided in the embodiments of this application;

[0023] Figure 6 A schematic diagram of the frequency curve of the first audio data provided in the embodiments of this application;

[0024] Figure 7 A schematic flowchart illustrating the equipment drop detection method provided in this application embodiment;

[0025] Figure 8 A schematic flowchart illustrating the equipment drop detection method provided in this application embodiment;

[0026] Figure 9 A schematic flowchart illustrating the equipment drop detection method provided in this application embodiment;

[0027] Figure 10 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application;

[0028] Figure 11 A schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of this application will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.

[0030] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0031] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0032] It should be noted that the terms "first, second, third" used in the embodiments of this application are used to distinguish similar or different objects and do not represent a specific order of objects. It can be understood that "first, second, third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0033] Figure 1 This is a schematic diagram of a device drop detection system provided in an embodiment of this application. Figure 1 As shown, the device drop detection system includes an electronic device 20 and an audio playback device 10, and a wireless communication connection is established between the electronic device 20 and the audio playback device 10.

[0034] Optionally, the electronic device 20 and the audio playback device 10 can use various Near Field Communication (NFC) technologies capable of receiving and transmitting data at close range. Communication methods such as Infrared Array (IrDA), Infrared, and Zigbee can be used, as well as other wireless communication methods that form a communication channel at close range and are capable of receiving and transmitting signals. Furthermore, the electronic device 20 and the audio playback device 10 can also be connected via Wi-Fi.

[0035] It should be understood that the audio playback device 10 described above is a device that wirelessly receives sound signals, including speech, and transmits them to a person's ear. The audio playback device 10 has various usage forms, such as being inserted into one ear, into both ears, or surrounding a protruding ear portion. In some embodiments, the audio playback device 10 can be a Bluetooth headset.

[0036] For example, such as Figure 2As shown, taking the audio playback device 10 as an example of wireless headphones, the wireless headphones are equipped with a headphone case as a storage device. The headphone case includes an in-case detection component, which includes a left in-case detection component 1.1 and a right in-case detection component 1.2. The left in-case detection component 1.1 corresponds to the left headphone 2, and the right in-case detection component 1.2 corresponds to the right headphone 3. The wireless headphones include an in-ear detection component, a noise-canceling microphone, and a main microphone. To distinguish between the left and right wireless headphones, the in-ear detection component includes a left in-ear detection component 2.1 corresponding to the left headphone 2 and a right in-ear detection component 3.1 corresponding to the right headphone 3. The noise-canceling microphone includes a left noise-canceling microphone 2.2 corresponding to the left headphone 2 and a right noise-canceling microphone 3.2 corresponding to the right headphone 3. The main microphone includes a left main microphone 2.3 corresponding to the left headphone 2 and a right main microphone 3.3 corresponding to the right headphone 3.

[0037] Optionally, the aforementioned electronic device 20 can be any type of device with information processing capabilities during implementation. For example, the electronic device 20 may include a personal computer, laptop computer, handheld computer, or server; the electronic device 20 may also be a mobile terminal, such as a mobile phone, in-vehicle computer, tablet computer, or projector. The functions implemented by this method can be achieved by the processor in the electronic device calling program code. Of course, the program code can be stored in a computer storage medium. Therefore, the electronic device 20 includes at least a processor and a storage medium.

[0038] For example, such as Figure 3 As shown, the electronic device 20 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, a display screen 270, and buttons 280.

[0039] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 20. In other embodiments of this application, the electronic device 20 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0040] Processor 210 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. For example, processor 210 may be a smart terminal CPU, such as a Snapdragon series processor. In some embodiments, processor 210 may include one or more interfaces. Interfaces may include inter-integrated circuit (I2C) interfaces, inter-integrated circuit sound (I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, mobile industry processor interfaces (MIPI) interfaces, general-purpose input / output (GPIO) interfaces, subscriber identity module (SIM) interfaces, and / or universal serial bus (USB) interfaces, etc.

[0041] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 20. In other embodiments of this application, the electronic device 20 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0042] The wireless communication function of electronic device 20 can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 20 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0043] The mobile communication module 250 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 20. The mobile communication module 250 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation.

[0044] The wireless communication module 260 can provide solutions for wireless communication applications on the electronic device 20, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 210. The wireless communication module 260 can also receive signals to be transmitted from processor 210, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0045] In some embodiments, antenna 1 of electronic device 20 is coupled to mobile communication module 250, and antenna 2 is coupled to wireless communication module 260, enabling electronic device 20 to communicate with networks and other devices via wireless communication technology.

[0046] Electronic device 20 implements display functions through a GPU, display screen 270, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 270 and the application processor. The GPU performs mathematical and geometric calculations and is used for graphics rendering. Processor 210 may include one or more GPUs, which execute program instructions to generate or modify display information. Display screen 270 is used to display images, videos, etc.

[0047] Electronic device 20 can achieve shooting functions through an ISP, camera, video codec, GPU, display 270, and application processor. The ISP processes data fed back from the camera. The camera captures still images or videos. An object is projected onto a photosensitive element by an optical image generated through a lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, and other formats. The digital signal processor processes digital signals, including digital image signals and other digital signals.

[0048] The external storage interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 20. The external memory card communicates with the processor 210 through the external storage interface 220 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0049] Internal memory 221 can be used to store computer executable program code, which includes instructions. Internal memory 221 may include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc. The data storage area may store data created during the use of electronic device 20 (such as audio data, phone book, etc.).

[0050] Buttons 280 include a power button, volume buttons, etc. Buttons 280 can be mechanical buttons or touch-sensitive buttons. Electronic device 20 can receive button input and generate key signal inputs related to user settings and function control of electronic device 20.

[0051] In addition, the electronic devices involved in the embodiments of this application may also be equipped with an operating system, on which applications can be installed and run. The embodiments of this application do not limit this.

[0052] Figure 4 This is a schematic flowchart illustrating the device drop detection method provided in an embodiment of this application. Figure 4 As shown, the method may include the following steps:

[0053] Step S101: Obtain the first audio data collected by the audio playback device. The first audio data is collected after the audio playback device switches from the wearing state to the non-wearing state.

[0054] Optionally, the aforementioned first audio data can be collected from the main microphone of the audio playback device, such as... Figure 2 The left main microphone is 2.3 or the right main microphone is 3.3, as shown.

[0055] Optionally, the wearing or non-wearing state of the aforementioned audio playback device can be collected through the feedback microphone of the audio playback device. The feedback microphone is used to collect the sound signal in the user's ear canal. When the difference between the value of the output signal of the feedback microphone at the current moment and the value of the output signal at the previous moment exceeds the error threshold, it can be determined that the audio playback device has switched from the wearing state to the non-wearing state or from the non-wearing state to the wearing state. The specific determination is based on the magnitude of the difference. For example, if the value of the output signal at the current moment is greater than the value of the output signal at the previous moment, it is determined that the audio playback device has switched from the non-wearing state to the wearing state.

[0056] Optionally, the aforementioned wearing or not wearing state can also be detected by an in-ear detection sensor in the audio playback device, such as an in-ear detection sensor... Figure 2 The left in-ear detection component 2.1 or the right in-ear detection component 3.1 shown can determine that the device is not wearing the headphones when the signal output by the in-ear detection sensor indicates that no ear has been detected, and that it is wearing the headphones when the signal output by the in-ear detection sensor indicates that a ear has been detected. In some embodiments, the in-ear detection sensor can be an optical in-ear detection sensor. The optical in-ear detection sensor detects the distance between the headphones and the ears by the time difference between the emission and reception of the infrared signals. It automatically senses whether the headphones are being worn. When the audio playback device is being worn, it can detect the ear and, after emitting an infrared signal, can receive the reflected infrared signal, thus determining that the audio playback device is being worn. When the audio playback device is not being worn, it cannot detect the ear and, after emitting an infrared signal, cannot receive the reflected infrared signal, thus determining that the audio playback device is not being worn.

[0057] Step S102: determining whether the audio playback device is in a falling state according to audio characteristic parameters of first audio data and a preset judgment condition, wherein the preset judgment condition is determined according to audio characteristic parameters of second audio data collected by the audio playback device when the audio playback device is in the falling state; and determining that the audio playback device is in the falling state when the audio characteristic parameters of the first audio data satisfy the preset judgment condition.

[0058] It should be understood that the audio characteristic parameters of the first audio data of the audio playback device in the falling state are different from those when the audio playback device is not in the falling state. For example, when the audio playback device is in the falling state, the audio playback device has more non-zero audio characteristic parameters in the first audio data than when it is not in the falling state. When judging whether the audio playback device is in the falling state, the judgment can be made according to the audio characteristic parameters of the audio playback device in the falling state, and can also be made according to the audio characteristic parameters of the audio playback device in the non-falling state.

[0059] Optionally, the audio characteristic parameter may be a characteristic quantity of an acoustic signal of the first audio data, such as duration and root-mean-square amplitude of partial audio data whose amplitude is greater than or equal to a second threshold.

[0060] In some embodiments, the calculation method of the duration may be: recording a start time and an end time when an amplitude of the first audio data is greater than an amplitude threshold, and calculating the duration according to the start time and the end time. For example, an amplitude threshold yg is set, when the amplitude y > yg, the time point is recorded as t1; after t1, the amplitude y is continuously monitored, when y < yg, the time point is recorded as t2; after t2, the amplitude is continuously monitored. A time threshold tg is set, if y > yg is detected again within a time period tg after t2, the time point is recorded as t3... until y < yg is detected, the time point is recorded as tn, and no y > yg is detected within the time period tg after tn, the detection ends, and the duration of the waveform is: t = tn-t1. In this way, the duration of the waveform can be accurately calculated through the amplitude threshold yg and the time threshold tg.

[0061] In some embodiments, the above-mentioned average RMS calculation method can be as follows: set multiple time windows for the first audio data, obtain the RMS amplitude within each time window, and calculate the average RMS amplitude based on the RMS amplitude within each time window. For example, set a time interval td (e.g., 50ms), and within the waveform duration t, there are n time intervals (t = n * td): t(1), t(2), ..., t(n), with corresponding RMS amplitudes of yd(1), yd(2), ..., yd(n) and amplitude coefficients of a(1), a(2), ..., a(n). The average RMS amplitude is denoted as yrms = [a(1) * yd(1) + a(2) * yd(2) + ... + a(n) * yd(n)] / n. This can accurately calculate the waveform amplitude within time t.

[0062] For example, taking Bluetooth headphones as the audio playback device, Figure 5 This is a schematic image of an acoustic signal of first audio data provided in an embodiment of this application. Figure 5 As shown, waveforms 1 and 2 in the first audio data represent the headphones placed on a table, while waveforms 3 and 4 represent the headphones falling to the ground. In terms of waveform duration, waveform 1 lasts 0.1s, waveform 2 lasts 0.35s, waveform 3 lasts 1.65s, and waveform 4 lasts 1.81s. This means that the duration of the high-amplitude sound signal is shorter when the headphones are placed on a table compared to when they fall to the ground. Calculating the root mean square (RMS) amplitude based on the amplitude of the high-amplitude sound signal reveals that the average RMS for waveform 1 is -39.91, for waveform 2 it is -24.87, for waveform 3 it is -20.12, and for waveform 4 it is -20.65. This indicates that within the duration of the high-amplitude signal, the average RMS is smaller when the headphones are placed on a table and larger when they fall to the ground.

[0063] Optionally, the aforementioned audio feature parameters can be feature quantities of the frequency signal corresponding to the first audio data, such as the average value of the amplitude at each frequency point.

[0064] In some embodiments, the calculation of the average frequency point amplitude can be as follows: obtaining the frequency curve corresponding to the first audio data; calculating the average frequency point amplitude of the frequency curve; determining that the audio playback device is in a drop state when the average frequency point amplitude is greater than or equal to a first threshold; and determining that the audio playback device is in a non-drop state when the average frequency point amplitude is less than the first threshold. The method for calculating the average frequency point amplitude of the frequency curve can be as follows: obtaining multiple target frequency points within a preset frequency range in the frequency curve, and the frequency point amplitude corresponding to each target frequency point; calculating the average of the multiple frequency point amplitudes using the same frequency point amplitude coefficient to obtain the average frequency point amplitude. For example, within a certain frequency domain, consider n frequency points: f(1), f(2), ..., f(n), with amplitudes corresponding to these frequency points of y(1), y(2), ..., y(n) and amplitude coefficients of b(1), b(2), ..., b(n). Then the average amplitude is: Y = [b(1)*y(1) + b(2)*y(2) + ... + b(n)*y(n)] / n. In this application, b(1) = b(2) = ... = b(n) = 1. This calculation of the average amplitude takes into account the amplitude of each frequency point, better reflecting the characteristics of sound throughout the entire frequency domain.

[0065] For example, taking Bluetooth headphones as the audio playback device, Figure 6 This is a schematic diagram of the frequency curve of a first audio data provided in an embodiment of this application. Figure 6 As shown, curves 1 and 2 in the first audio data represent the waveforms of the headphones placed on a table, while curves 3 and 4 represent the waveforms of the headphones falling to the ground. It is evident that the values ​​of curves 3 and 4 are larger than those of curves 1 and 2 at most frequency points. Based on the frequency curves, the average amplitude of each curve within the 100Hz-15000Hz range can be calculated: the average amplitude of curve 1 is L1 = -92.8dB, the average amplitude of curve 2 is L2 = -68.2dB, the average amplitude of curve 3 is L3 = -63.02dB, and the average amplitude of curve 4 is L4 = -63.04dB. It is clear that L1 and L2 are smaller than L3 and L4, meaning that the average amplitude of the frequency curves is smaller when the headphones are placed on a table and larger when they are dropped to the ground.

[0066] Optionally, the preset judgment condition is that the value of the audio feature parameter is greater than or equal to the first threshold. Accordingly, the way to determine that the audio playback device is in a drop state can be: obtaining the target value of the audio feature parameter of the first audio data; if the target value is greater than or equal to the first threshold, then the audio playback device is determined to be in a drop state.

[0067] In the aforementioned device drop detection method, first audio data is collected after the audio playback device is switched from a worn state to a non-worn state. Based on the audio characteristic parameters of the first audio data and preset judgment conditions, it is determined whether the audio playback device is in a drop state. Specifically, the audio playback device is determined to be in a drop state when the audio characteristic parameters of the first audio data meet the preset judgment conditions. Compared to existing technologies, this application uses audio data collected after the audio playback device is switched to a non-worn state to determine whether the audio playback device has been dropped, eliminating the need for additional hardware for the audio playback device and reducing drop detection costs.

[0068] Figure 7 This is a schematic flowchart illustrating the device drop detection method provided in an embodiment of this application. Figure 7 As shown, the method may include the following steps:

[0069] Step S201: Obtain the first audio data collected by the audio playback device. The first audio data is collected after the audio playback device switches from the wearing state to the non-wearing state.

[0070] Step S202: Based on the audio feature parameters of the first audio data and preset judgment conditions, determine whether the audio playback device is in a drop state. The preset judgment conditions are determined based on the audio feature parameters of the second audio data collected when the audio playback device is in a drop state. Specifically, if the audio feature parameters of the first audio data meet the preset judgment conditions, it is determined that the audio playback device is in a drop state.

[0071] It should be noted that the execution methods of steps S201 to S202 can be the same as those of steps S101 to S102, and will not be repeated here.

[0072] Step S203: When it is determined that the audio playback device is in a drop state, a first prompt message is output. The first prompt message is used to notify the user of the drop state.

[0073] Optionally, the aforementioned first prompt information can be at least one of text prompts, vibration signals, sound signals, or light signals. When the first prompt information is a text prompt, the electronic device will pop up a prompt window to display the text prompt; when the first prompt information is a vibration signal, the electronic device will generate a vibration command to control the motor to vibrate; when the first prompt information is a sound signal, the electronic device will generate a sound signal to transmit to an audio playback device for playback, or to the speaker of the electronic device for playback; when the first prompt information is a light signal, the electronic device will generate a light signal to control the light of the electronic device to emit light according to the light signal. In some embodiments, the first prompt information can also be a prompt signal composed of vibration, sound, and light.

[0074] In the above-mentioned device drop detection method, when it is determined that the audio playback device is in a drop state, a first prompt message is output to remind the user that the audio playback device is in a drop state, so as to effectively prevent the audio playback device from being lost after a drop.

[0075] Figure 8 This is a schematic flowchart illustrating the device drop detection method provided in an embodiment of this application. Figure 8 As shown, the method may include the following steps:

[0076] Step S301: Obtain the first audio data collected by the audio playback device. The first audio data is collected after the audio playback device switches from the wearing state to the non-wearing state.

[0077] Step S302: Based on the audio feature parameters of the first audio data and a preset judgment condition, determine whether the audio playback device is in a drop state. The preset judgment condition is determined based on the audio feature parameters of the second audio data collected when the audio playback device is in a drop state. Specifically, if the audio feature parameters of the first audio data meet the preset judgment condition, it is determined that the audio playback device is in a drop state.

[0078] It should be noted that the execution methods of steps S301 to S302 can be the same as those of steps S101 to S102, and will not be repeated here.

[0079] Step S303: When the audio feature parameters of the first audio data do not meet the preset judgment conditions, determine whether the audio playback device is placed inside the storage device.

[0080] Optionally, there can be a unique correspondence between the storage device and the audio playback device. After the audio playback device is placed in the storage device, the storage device can verify the audio playback device to determine that the audio playback device placed in the storage device is the target audio playback device corresponding to the storage device. The specific verification method can adopt existing verification methods, as long as it can determine whether the audio playback device placed in the storage device is the target audio playback device. This application does not impose any restrictions.

[0081] For example, taking wireless earphones as the audio playback device and an earphone case as the storage device, after the wireless earphones are placed in the earphone case, the wireless earphones can send verification information to the earphone case. The verification information includes the identifier of the wireless earphones. After receiving the verification information, the earphone case determines whether the wireless earphones are earphones that are compatible with the earphone case. If so, the earphone case sends a first confirmation signal to the electronic device so that the electronic device can determine that the audio playback device has been placed in the storage device. If not, the earphone case sends a second confirmation signal to the electronic device so that the electronic device can determine that the audio playback device has not been placed in the storage device.

[0082] Optionally, the method for determining whether the audio playback device is placed inside the storage device can be: receiving a storage status detection signal sent by the storage device; and determining whether the audio playback device is placed inside the storage device based on the storage status detection signal.

[0083] For example, the aforementioned storage status detection signal may include a first signal or a second signal. When the audio playback device is placed inside the storage device, the storage device sends the first signal to the electronic device; when the audio playback device is not placed inside the storage device, the storage device sends the second signal to the electronic device. Thus, the audio playback device can determine whether it is placed inside the storage device based on the storage status detection signal.

[0084] Optionally, the aforementioned storage device may include a contact component to trigger the generation of a storage status detection signal when in contact with an audio playback device. The contact component may be, for example... Figure 2 The left in-box detection component 1.1 or the right in-box detection component 1.2 shown.

[0085] Step S304: When the audio playback device is not placed in the storage device, output a second prompt message. The second prompt message is used to remind the user that the audio playback device has not fallen, but needs to be placed in the storage device.

[0086] Optionally, the display method of the second prompt message can be the same as that of the first prompt message, which will not be elaborated here.

[0087] Optionally, performing step S304 may further include:

[0088] When the audio playback device is not placed inside the storage device, the location of the audio playback device is determined, and the location is used to indicate the distance between the audio playback device and the electronic device; accordingly, the second prompt information also includes the location.

[0089] Optionally, when the audio playback device and the electronic device are connected via Bluetooth, the distance between them can be determined using the Received Signal Strength Indication (RSSI). Generally, the RSSI at the electronic device displays the strength of the Bluetooth signal received from the audio playback device. It can have a strength range of -10 to 30, but if a maximum value of 30 is reached, the power control function of the electronic device's Bluetooth communication module is executed, automatically adjusting the value to 0. Therefore, the ideal value is 0.

[0090] Optionally, the location indication method in the second prompt message can be such that the farther the location, the stronger the prompt level. For example, the farther the distance between the audio playback device and the electronic device, the stronger the vibration of the electronic device.

[0091] Optionally, the distance between the audio playback device and the electronic device can be determined by the wireless communication signal between the audio playback device and the electronic device.

[0092] For example, in a normal communication environment, when the distance between the audio playback device and the electronic device is 1 meter (m), assuming the average RSSI signal value is 5, the corresponding safe distance is 1m. The highest prompt level is when the safe distance is exceeded. Therefore, when the electronic device receives an RSSI signal value corresponding to the audio playback device through the Bluetooth communication module that exceeds 5, it can determine that the audio playback device has left the safe distance and raise the prompt level to the maximum value.

[0093] In the above-mentioned device drop detection method, a second prompt message is output when the audio playback device is not placed in the storage device, so as to remind the user to place the audio playback device in the storage device. This helps users form good headphone usage habits and further reduces the probability of losing the audio playback device.

[0094] Figure 9 This is a schematic flowchart illustrating the device drop detection method provided in an embodiment of this application. Figure 9 As shown, the method may include the following steps:

[0095] 1. When the Bluetooth earphone is removed from the ear, the in-ear detection module outputs a detection signal indicating that the earphone has been removed from the ear;

[0096] 2. The Bluetooth headset controls the microphone to start collecting audio data based on the detection signal, and transmits the collected audio data to the mobile terminal via Bluetooth;

[0097] 3. The mobile terminal analyzes the characteristic quantities of the audio data, including duration, average RMS amplitude, and average amplitude of each frequency point of the frequency curve;

[0098] 4. The mobile terminal compares the feature value of the analyzed audio data with the set threshold. If the feature value is greater than the set threshold, it is determined that the Bluetooth headset has been dropped, and the terminal issues a prompt / alarm.

[0099] 5. If the feature value is less than the set threshold, check whether the Bluetooth earphone is placed in the earphone case. If the earphone is not detected to be in the case, it is assumed that the earphone is placed on the table or other location, and the terminal issues a prompt to remind the user to put the earphone in the earphone case. When the earphone is detected to be in the case, the process ends.

[0100] Based on the audio signal after the earphone is removed from the ear, it can accurately determine whether the earphone has fallen to the ground and provide a prompt / alarm on the terminal, effectively preventing the earphone from being lost.

[0101] It should be understood that, although Figure 1-9 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 1-9 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0102] Based on the foregoing embodiments, this application provides an electronic device, which includes various modules and units included in each module, which can be implemented by a processor; of course, it can also be implemented by specific logic circuits; in the implementation process, the processor can be a central processing unit (CPU), microprocessor (MPU), digital signal processor (DSP) or field programmable gate array (FPGA), etc.

[0103] Figure 10 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application, such as... Figure 10 As shown, the electronic device may include:

[0104] The audio data acquisition module 1001 is used to acquire first audio data collected by the audio playback device. The first audio data is collected after the audio playback device switches from a wearing state to a non-wearing state.

[0105] The drop state determination module 1002 is used to determine whether the audio playback device is in a drop state based on the audio feature parameters of the first audio data and the preset judgment conditions. The preset judgment conditions are determined based on the audio feature parameters of the second audio data collected by the audio playback device in a drop state.

[0106] Specifically, when the audio feature parameters of the first audio data meet the preset judgment conditions, it is determined that the audio playback device is in a drop state.

[0107] In some embodiments, the audio feature parameters include the average amplitude of frequency points, and the preset judgment condition is that the value of the audio feature parameters is greater than or equal to a first threshold. The aforementioned drop state determination module 1002 may include:

[0108] The frequency curve acquisition submodule is used to obtain the frequency curve corresponding to the first audio data.

[0109] The average value calculation submodule is used to calculate the average value of the frequency point amplitude of the frequency curve;

[0110] The first judgment submodule is used to determine that the audio playback device is in a drop state when the average amplitude of the frequency point is greater than or equal to the first threshold.

[0111] The second judgment submodule is used to determine that the audio playback device is in a non-drop state when the average amplitude of the frequency point is less than the first threshold.

[0112] In some embodiments, the above-described average value calculation submodule may include:

[0113] The frequency point amplitude acquisition unit includes acquiring multiple target frequency points in the frequency curve within a preset frequency range, and the frequency point amplitude corresponding to each target frequency point;

[0114] The amplitude average calculation unit includes calculating the average of multiple frequency point amplitudes according to the same frequency point amplitude coefficient to obtain the frequency point amplitude average.

[0115] In some embodiments, the above-mentioned electronic device may further include:

[0116] The first prompt module is used to output a first prompt message when it is determined that the audio playback device is in a drop state. The first prompt message is used to notify the user of the drop state.

[0117] In some embodiments, the above-mentioned electronic device may further include:

[0118] The storage status determination module is used to determine whether the audio playback device is placed inside the storage device when the audio feature parameters of the first audio data do not meet the preset judgment conditions.

[0119] The second prompt module is used to output a second prompt message when the audio playback device is not placed in the storage device. The second prompt message is used to remind the user that the audio playback device has not fallen, but needs to be placed in the storage device.

[0120] In some embodiments, the above-mentioned electronic device may further include:

[0121] The location determination module is used to determine the location of the audio playback device when it is not placed inside the storage device. The location is used to indicate the distance between the audio playback device and the electronic device.

[0122] Accordingly, the second notification also includes the location.

[0123] In some embodiments, the above-mentioned storage status determination module may include:

[0124] The storage status receiving submodule is used to receive the storage status detection signal sent by the storage device;

[0125] The storage status determination submodule is used to determine whether the audio playback device is placed inside the storage device based on the storage status detection signal.

[0126] In some embodiments, the preset judgment condition is that the value of the audio feature parameter is greater than or equal to a first threshold, and the aforementioned fall state determination module 1002 may include:

[0127] The parameter value acquisition submodule is used to obtain the target values ​​of the audio feature parameters of the first audio data.

[0128] The parameter value judgment submodule is used to determine that the audio playback device is in a drop state if the target value is greater than or equal to the first threshold.

[0129] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0130] It should be noted that, in the embodiments of this application... Figure 10 The module division of the illustrated electronic device is illustrative and represents only one logical functional division; in actual implementation, other division methods may be used. Furthermore, the functional units in the various embodiments of this application can be integrated into a single processing unit, exist as separate physical units, or be integrated into a single unit. The integrated units described above can be implemented in hardware, as software functional units, or in a combination of both.

[0131] It should be noted that, in the embodiments of this application, if the above-described methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0132] This application provides a computer device, which may be a server, and its internal structure diagram may be as follows: Figure 11 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs stored in the non-volatile storage medium. The database stores data. The network interface communicates with external terminals via a network connection. When executed by the processor, the computer program implements a device drop detection method.

[0133] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the method provided in the above embodiments.

[0134] This application provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps in the method provided in the above-described method embodiments.

[0135] Those skilled in the art will understand that Figure 11 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0136] In one embodiment, the electronic device provided in this application can be implemented as a computer program, and the computer program can be implemented as follows: Figure 11 The sampling device runs on the computer device shown. The computer device's memory can store the various program modules that make up the sampling device. The computer program, composed of the various program modules, causes the processor to execute the steps in the device drop detection methods of the various embodiments of this application described in this specification.

[0137] In one embodiment, a computer device is provided, including a memory and a processor, the memory storing a computer program, the processor executing the computer program to implement the steps of the device drop detection method disclosed in any embodiment of this application.

[0138] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps of the device drop detection method disclosed in any embodiment of this application.

[0139] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium, storage medium, and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0140] It should be understood that the phrases "one embodiment," "an embodiment," or "some embodiments" mentioned throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment," "in one embodiment," or "in some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The descriptions of the various embodiments above tend to emphasize the differences between the various embodiments; their similarities or commonalities can be referred to mutually, and for the sake of brevity, they will not be repeated here.

[0141] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three kinds of relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist simultaneously, and object B exists alone.

[0142] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0143] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple modules or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or modules can be electrical, mechanical, or other forms.

[0144] The modules described above as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules. They may be located in one place or distributed across multiple network units. Some or all of the modules may be selected to achieve the purpose of this embodiment according to actual needs.

[0145] In addition, each functional module in the various embodiments of this application can be integrated into one processing unit, or each module can be a separate unit, or two or more modules can be integrated into one unit; the integrated modules can be implemented in hardware or in the form of hardware plus software functional units.

[0146] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.

[0147] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0148] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0149] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0150] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0151] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for detecting equipment drop, characterized in that, Applied to an electronic device, wherein a wireless communication connection is established between the electronic device and an audio playback device, the method includes: The first audio data collected by the audio playback device is acquired after the in-ear detection sensor of the audio playback device detects a switch from a wearing state to an unwearing state. Based on the audio feature parameters of the first audio data and a preset judgment condition, it is determined whether the audio playback device is in a drop state. The preset judgment condition is determined based on the audio feature parameters of the second audio data collected by the audio playback device in the drop state. Specifically, when the audio feature parameters of the first audio data meet the preset judgment conditions, the audio playback device is determined to be in the drop state. The audio feature parameter is the average amplitude of a frequency point. The preset judgment condition is that the value of the audio feature parameter is greater than or equal to a first threshold. Determining whether the audio playback device is in a drop state based on the audio feature parameter of the first audio data and the preset judgment condition includes: Obtain the frequency curve corresponding to the first audio data; Calculate the average amplitude of the frequency points of the frequency curve; When the average amplitude of the frequency point is greater than or equal to the first threshold, it is determined that the audio playback device is in a drop state; When the average amplitude of the frequency point is less than the first threshold, the audio playback device is determined to be in a non-drop state.

2. The method as described in claim 1, characterized in that, The calculation of the average amplitude of the frequency points of the frequency curve includes: Obtain multiple target frequency points within a preset frequency range in the frequency curve, and the frequency point amplitude corresponding to each target frequency point; The average value of the amplitude at multiple frequency points is obtained by calculating the average value of the amplitude at multiple frequency points using the same frequency point amplitude coefficient.

3. The method as described in claim 1, characterized in that, After determining whether the audio playback device is in a dropped state based on the audio feature parameters of the first audio data and preset judgment conditions, the method further includes: When it is determined that the audio playback device is in the fall state, a first prompt message is output, which is used to notify the user of the fall state.

4. The method as described in claim 1, characterized in that, After determining whether the audio playback device is in a dropped state based on the audio feature parameters of the first audio data and preset judgment conditions, the method further includes: If the audio feature parameters of the first audio data do not meet the preset judgment conditions, determine whether the audio playback device is placed inside the storage device; When the audio playback device is not placed in the storage device, a second prompt message is output. The second prompt message is used to remind the user that the audio playback device has not fallen, but needs to be placed in the storage device.

5. The method as described in claim 4, characterized in that, After determining whether the audio playback device is placed inside the storage device, the method further includes: When the audio playback device is not placed inside the storage device, the location of the audio playback device is determined, and the location is used to indicate the distance between the audio playback device and the electronic device. Accordingly, the second prompt message also includes the location.

6. The method as described in claim 4, characterized in that, Determining whether the audio playback device is placed inside the storage device includes: Receive the storage status detection signal sent by the storage device; Based on the storage status detection signal, it is determined whether the audio playback device is placed inside the storage device.

7. An electronic device, characterized in that, The electronic device establishes a wireless communication connection with the audio playback device, and the electronic device includes: The audio data acquisition module is used to acquire first audio data collected by the audio playback device. The first audio data is collected after the in-ear detection sensor of the audio playback device detects a switch from a wearing state to an unwearing state. The drop state determination module is used to determine whether the audio playback device is in a drop state based on the audio feature parameters of the first audio data and a preset judgment condition. The preset judgment condition is determined based on the audio feature parameters of the second audio data collected by the audio playback device in the drop state. Specifically, when the audio feature parameters of the first audio data meet the preset judgment conditions, the audio playback device is determined to be in the drop state. The audio feature parameter is the average amplitude of a frequency point. The preset judgment condition is that the value of the audio feature parameter is greater than or equal to a first threshold. Determining whether the audio playback device is in a drop state based on the audio feature parameter of the first audio data and the preset judgment condition includes: Obtain the frequency curve corresponding to the first audio data; Calculate the average amplitude of the frequency points of the frequency curve; When the average amplitude of the frequency point is greater than or equal to the first threshold, it is determined that the audio playback device is in a drop state; When the average amplitude of the frequency point is less than the first threshold, the audio playback device is determined to be in a non-drop state.

8. A computer device comprising a memory and a processor, the memory storing a computer program executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 6.

Images