[0025] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
[0026] It should be understood that when used in this specification and the appended claims, the terms "including" and "including" indicate the existence of the described features, wholes, steps, operations, elements and/or components, but do not exclude one or The existence or addition of multiple other features, wholes, steps, operations, elements, components, and/or collections thereof.
[0027] It should also be understood that the terms used in this specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. As used in the specification of the present invention and the appended claims, unless the context clearly indicates other circumstances, the singular forms "a", "an" and "the" are intended to include plural forms.
[0028] As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determination" or "in response to detection" depending on the context . Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".
[0029] In specific implementation, the terminals described in the embodiments of the present invention include but are not limited to other portable devices such as mobile phones with touch-sensitive surfaces (for example, touch screen displays and/or touch pads), laptop computers, or tablet computers. It should also be understood that, in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., a touch screen display and/or a touch pad).
[0030] In the following discussion, a terminal including a display and a touch-sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and/or joystick.
[0031] The terminal supports various applications, such as one or more of the following: drawing application, presentation application, word processing application, website creation application, disk burning application, spreadsheet application, game application, telephone application Applications, video conferencing applications, email applications, instant messaging applications, exercise support applications, photo management applications, digital camera applications, digital camera applications, web browsing applications, digital music player applications, and / Or digital video player application.
[0032] Various application programs that can be executed on the terminal can use at least one common physical user interface device such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the terminal can be adjusted and/or changed between applications and/or within corresponding applications. In this way, the common physical architecture of the terminal (for example, a touch-sensitive surface) can support various applications with a user interface that is intuitive and transparent to the user.
[0033] In addition, the functional units in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be realized in the form of hardware or software functional unit.
[0034] It should be understood that, in the embodiments of the present invention, the so-called processor may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), and dedicated integrated Circuit (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field-Programmable GateArray, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
[0035] It should be understood that the terminal is only one example of a portable multifunction device, and the terminal may have more or fewer components than those shown, may combine two or more components, or may have different component configurations or arrangements. Various components may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.
[0036] It should also be understood that although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish these elements from each other. For example, without departing from the scope of the present invention, the first terminal may be referred to as the second terminal, and similarly, the second terminal may be referred to as the first terminal. The first terminal and the second terminal are both terminals, but they are not the same terminal.
[0037] See figure 1 , Is a schematic flowchart of a method for detecting wearing earphones according to Embodiment 1 of the present invention. As shown in the figure, the method includes the following steps S11 to S15:
[0038] Step S11: Obtain the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal.
[0039] Specifically, the sound source audio signal emitted by the earphone can be acquired by arranging a sensor inside the earphone, and setting the sensor to sense the sound actually produced in the ear canal, and converting the actually produced sound into an audio signal, that is, a feedback audio signal.
[0040] Step S12: Extract the audio signal of the target frequency band in the audio source audio signal and the feedback audio signal.
[0041] Specifically, an audio signal of a preset target frequency band is selected from the audio source audio signal and the feedback audio signal to perform subsequent operations.
[0042] Among them, step S12 includes step S12a.
[0043] Step S12a: Extract low-frequency signals in the audio source audio signal and the feedback audio signal.
[0044] Specifically, because the amplitude-frequency characteristic curve has a higher amplitude in the low frequency range, the audio signal in the low frequency range is selected from the audio source audio signal and the feedback audio signal for subsequent operations, for example, the audio signal in the 20-100Hz frequency band is selected Perform subsequent manipulations,
[0045] Step S13: Obtain the characteristic value of the audio signal of the target frequency band according to the first preset condition.
[0046] Specifically, the characteristic value of the audio signal of the target frequency band is obtained according to the first preset condition, and the characteristic value is a value that can reflect the characteristic of the audio signal of the frequency band.
[0047] Among them, step S13 includes step S13a.
[0048] Step S13a: Obtain a number of frequency points that equally divide the frequency of the low-frequency signal frequency band, and obtain a low-frequency weighted value of the amplitude of the frequency point of the low-frequency signal according to the number of frequency points.
[0049] Specifically, taking the 20-100Hz low-frequency frequency band selected above as an example, 20-100Hz is divided into 80 frequency bands with a step of 1Hz, and the 81 frequency points of 20-100Hz with a step of 1Hz are calculated. The average value of the amplitude of the frequency points, to obtain a weighted value F (20-100Hz).
[0050] Step S14: Calculate the difference between the characteristic value of the audio source audio signal and the characteristic value of the feedback audio signal, and compare the difference with a preset difference threshold.
[0051] Specifically, taking the weighting value F (20-100 Hz) of the above frequency amplitude as an example, the low-frequency weighting value F1 (20-100 Hz) of the sound source audio signal can be obtained through the sound source audio signal within 20-100 Hz, and the low-frequency weighting value F1 (20-100 Hz) of the sound source audio signal can be obtained through 20-100 Hz. The feedback audio signal can get the low frequency weight F2 (20-100Hz) of the feedback audio signal. There must be a difference between the low-frequency weighting value F2 (20-100Hz) of the feedback audio signal and the low-frequency weighting value F1 (20-100Hz) of the audio source audio signal. This difference also exists when the headset is worn correctly. A difference threshold M can be preset here, that is, when the difference between F1 (20-100Hz) and F2 (20-100Hz) does not exceed the difference threshold M, it is judged that the wearing is correct, if F1 (20-100Hz) If the difference between) and F2 (20-100 Hz) exceeds the difference threshold M, it is considered that the wearing is incorrect.
[0052] Step S15: A corresponding prompt is issued according to the comparison result between the difference and the preset difference threshold.
[0053] Specifically, the difference between the characteristic value of the audio source audio signal and the feedback audio signal is compared with a preset difference threshold, and a corresponding prompt is issued according to the comparison result to inform the user whether the earphone is worn correctly, as in the above example, the audio source audio signal The difference between F1 (20-100Hz) and the low-frequency weighting value F2 (20-100Hz) of the feedback audio signal is compared with the preset difference threshold M. If the difference does not exceed the difference threshold M, a prompt to wear the headset is issued, or There is no need to give a prompt to the user, and the user is directly worn correctly by default, and when the difference exceeds the difference threshold M, a prompt is issued that the headset is not worn correctly to remind the user that the current wear is incorrect.
[0054] Extract the audio signal of the audio source and the audio signal of the target frequency band in the feedback audio signal through the audio signal of the audio source of the earphone itself and the feedback audio signal received by the earphone in the ear canal, and obtain the characteristic value of the audio signal of the target frequency band according to preset conditions. The difference between the characteristic value of the sound source audio signal and the characteristic value of the feedback audio signal is compared with a preset difference threshold to achieve the purpose of judging whether the earphone is worn correctly, with high accuracy, real-time detection, simple and convenient.
[0055] See figure 2 , Is a schematic flowchart of a method for detecting wearing earphones according to the second embodiment of the present invention. As shown in the figure, the method includes the following steps S21 to S26:
[0056] Step S21: Determine whether the earphone is currently in the ear canal according to the second preset condition.
[0057] Specifically, before performing the detection method of the present invention, it is determined in advance whether the earphone is in the ear canal according to the set conditions, so as to avoid unnecessary detection actions of the earphone without being worn.
[0058] Among them, step S21 includes step S21a and step S21b.
[0059] Step S21a: Determine whether the light intensity of the environment where the earphone is currently located is lower than a preset light intensity threshold.
[0060] Specifically, when the earphone is worn in the ear canal, the front speaker part of the earphone is in the ear canal, and the light intensity is very weak. A threshold of light intensity is preset. If the front end of the earphone extends into the ear canal, the light intensity of the environment is low At the preset light intensity threshold, it is considered that a condition that the earphone is in the ear canal is satisfied, and the judgment here is the judgment of the light intensity of the environment where the earphone is currently located.
[0061] Step S21b: If the light intensity of the environment is lower than the preset light intensity threshold, it is determined whether the earphone is currently subjected to circumferential pressure.
[0062] Specifically, if the light intensity of the environment where the earphone is located satisfies the condition of light intensity, that is, the light intensity of the current environment is lower than the preset light intensity threshold, it is determined whether the earphone is currently under circumferential pressure. Because when the earphone is inside the ear canal, it is in a state of circumferential squeezing of the inner wall of the ear canal, combined with the judgment of whether it is subjected to circumferential pressure and whether the light intensity is lower than the preset light intensity threshold, to achieve the purpose of judging whether the earphone is in the ear canal .
[0063] Step S22: If the earphone is in the ear canal, obtain the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal.
[0064] Specifically, the purpose of judging whether the earphone is in the ear canal is based on whether it is subjected to circumferential pressure and whether the light intensity is lower than the preset light intensity threshold. The sound source audio signal emitted by the earphone can be obtained by setting a sensor inside the earphone, and setting the sensor To sense the sound actually produced in the ear canal, and convert the actually produced sound into an audio signal, that is, the feedback audio signal.
[0065] Step S23: Extract the audio signal of the target frequency band in the audio source audio signal and the feedback audio signal.
[0066] Specifically, an audio signal of a preset target frequency band is selected from the audio source audio signal and the feedback audio signal to perform subsequent operations.
[0067] Among them, step S23 includes step S23a.
[0068] Step S23a: Extract low-frequency signals in the audio source audio signal and the feedback audio signal.
[0069] Specifically, because the amplitude-frequency characteristic curve has a higher amplitude in the low frequency range, the audio signal in the low frequency range is selected from the audio source audio signal and the feedback audio signal for subsequent operations, for example, the audio signal in the 20-100Hz frequency band is selected Perform subsequent manipulations,
[0070] Step S24: Obtain the characteristic value of the audio signal of the target frequency band according to the first preset condition.
[0071] Specifically, the characteristic value of the audio signal of the target frequency band is obtained according to the first preset condition, and the characteristic value is a value that can reflect the characteristic of the audio signal of the frequency band.
[0072] Among them, step S24 includes step S24a.
[0073] Step S24a: Obtain a number of frequency points that equally divide the frequency of the low-frequency signal frequency band, and obtain the low-frequency weighted value of the frequency point amplitude of the low-frequency signal according to the number of frequency points.
[0074] Specifically, taking the 20-100Hz low-frequency frequency band selected above as an example, 20-100Hz is divided into 80 frequency bands with a step of 1Hz, and the 81 frequency points of 20-100Hz with a step of 1Hz are calculated. The average value of the amplitude of the frequency points, to obtain a weighted value F (20-100Hz).
[0075] Step S25: Calculate the difference between the characteristic value of the audio source audio signal and the characteristic value of the feedback audio signal, and compare the difference with a preset difference threshold.
[0076] Specifically, taking the weighting value F (20-100 Hz) of the above frequency amplitude as an example, the low-frequency weighting value F1 (20-100 Hz) of the sound source audio signal can be obtained through the sound source audio signal within 20-100 Hz, and the low-frequency weighting value F1 (20-100 Hz) of the sound source audio signal can be obtained through 20-100 Hz. The feedback audio signal can get the low frequency weight F2 (20-100Hz) of the feedback audio signal. There must be a difference between the low-frequency weighting value F2 (20-100Hz) of the feedback audio signal and the low-frequency weighting value F1 (20-100Hz) of the audio source audio signal. This difference also exists when the headset is worn correctly. A difference threshold M can be preset here, that is, when the difference between F1 (20-100Hz) and F2 (20-100Hz) does not exceed the difference threshold M, it is judged that the wearing is correct, if F1 (20-100Hz) If the difference between) and F2 (20-100 Hz) exceeds the difference threshold M, it is considered that the wearing is incorrect.
[0077] Step S26: A corresponding prompt is issued according to the comparison result between the difference and the preset difference threshold.
[0078] Specifically, the difference between the characteristic value of the audio source audio signal and the feedback audio signal is compared with a preset difference threshold, and a corresponding prompt is issued according to the comparison result to inform the user whether the earphone is worn correctly, as in the above example, the audio source audio signal The difference between F1 (20-100Hz) and the low-frequency weighting value F2 (20-100Hz) of the feedback audio signal is compared with the preset difference threshold M. If the difference does not exceed the difference threshold M, a prompt to wear the headset is issued, or There is no need to give a prompt to the user, and the user is directly worn correctly by default, and when the difference exceeds the difference threshold M, a prompt is issued that the headset is not worn correctly to remind the user that the current wear is incorrect.
[0079] Specifically, it is configured to determine whether the earphone is in the ear canal to avoid unnecessary detection actions when the earphone is not worn.
[0080] See image 3 Is a schematic block diagram of a terminal provided in Embodiment 1 of the present invention. As shown in the figure, the terminal includes:
[0081] The acquiring unit 10 is configured to acquire the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal;
[0082] The extraction unit 20 is used to extract the audio signal of the target frequency band in the audio source audio signal and the feedback audio signal, including extracting the low frequency signal in the audio source audio signal and the feedback audio signal;
[0083] The arithmetic unit 30 is used to obtain the characteristic value of the audio signal of the target frequency band according to the first preset condition, including obtaining a number of frequency points that divide the frequency of the low frequency signal frequency band equally, and obtaining the low frequency according to the number of frequency points Low frequency weighted value of signal frequency point amplitude;
[0084] The comparing unit 40 is configured to calculate the difference between the characteristic value of the sound source audio signal and the characteristic value of the feedback audio signal, and compare the difference with a preset difference threshold;
[0085] The prompt unit 50 is configured to issue a corresponding prompt according to the comparison result between the difference and the preset difference threshold.
[0086] Specifically, the terminal 99 obtains the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal through the acquisition unit 10, and extracts the sound source audio signal and the audio signal of the target frequency band in the feedback audio signal through the extraction unit 20. This embodiment Used in the example to extract low-frequency signals. Then, the arithmetic unit 30 obtains the characteristic value of the audio signal of the target frequency band according to the first preset condition. In this embodiment, by obtaining a number of frequency points that divide the frequency of the low frequency signal frequency band equally, according to the number of frequency points Point to get the low-frequency weighted value of the amplitude of the low-frequency signal frequency point. After the characteristic value is identified, the comparison unit 40 calculates the difference between the characteristic value of the sound source audio signal and the characteristic value of the feedback audio signal, and compares the difference with a preset difference threshold. In this embodiment, the sound source audio is calculated. The difference between the low-frequency weighting value of the signal and the low-frequency weighting value of the feedback audio signal. According to the comparison result between the difference and the preset difference threshold, the prompt unit 50 issues a corresponding prompt.
[0087] Extract the audio signal of the audio source and the audio signal of the target frequency band in the feedback audio signal through the audio signal of the audio source of the earphone itself and the feedback audio signal received by the earphone in the ear canal, and obtain the characteristic value of the audio signal of the target frequency band according to preset conditions. The difference between the characteristic value of the sound source audio signal and the characteristic value of the feedback audio signal is compared with a preset difference threshold to achieve the purpose of judging whether the earphone is worn correctly, with high accuracy, real-time detection, simple and convenient.
[0088] See Figure 4 Is a schematic block diagram of a terminal provided in Embodiment 2 of the present invention. As shown in the figure, the terminal includes:
[0089] The determining unit 60 is configured to determine whether the earphone is currently in the ear canal according to the second preset condition and includes a first determining subunit 61 and a second determining subunit 62.
[0090] The first judging subunit 61 is used to judge whether the light intensity of the environment where the headset is currently located is lower than a preset light intensity threshold;
[0091] The second judging subunit 62 is used for judging whether the earphone is currently under circumferential pressure if the light intensity of the environment is lower than the preset light intensity threshold.
[0092] The execution unit 70 is configured to perform the steps of acquiring the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal if the earphone is currently under circumferential pressure.
[0093] The acquiring unit 10 is configured to acquire the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal;
[0094] The extraction unit 20 is used to extract the audio signal of the target frequency band in the audio source audio signal and the feedback audio signal, including extracting the low frequency signal in the audio source audio signal and the feedback audio signal;
[0095] The arithmetic unit 30 is used to obtain the characteristic value of the audio signal of the target frequency band according to the first preset condition, including obtaining a number of frequency points that divide the frequency of the low frequency signal frequency band equally, and obtaining the low frequency according to the number of frequency points Low frequency weighted value of signal frequency point amplitude;
[0096] The comparing unit 40 is configured to calculate the difference between the characteristic value of the sound source audio signal and the characteristic value of the feedback audio signal, and compare the difference with a preset difference threshold;
[0097] The prompt unit 50 is configured to issue a corresponding prompt according to the comparison result between the difference and the preset difference threshold.
[0098] Specifically, the terminal 99 judges whether the earphone is currently in the ear canal through the judgment unit 60, including a first judgment subunit 61 and a second judgment subunit 62. The first judgment subunit 61 judges whether the light intensity of the environment where the earphone is currently located is lower than The preset light intensity threshold. If the light intensity of the environment is lower than the preset light intensity threshold, the second determining subunit 62 determines whether the earphone is currently subjected to circumferential pressure. If the earphone is currently subjected to circumferential pressure, the execution unit 70 executes In the step of acquiring the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal, the acquisition unit 10 starts to acquire the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal, and pass the extraction unit 20 The audio signal of the audio source and the audio signal of the target frequency band in the feedback audio signal are extracted. In this embodiment, it is used to extract the low-frequency signal. Then, the arithmetic unit 30 obtains the characteristic value of the audio signal of the target frequency band according to the first preset condition. In this embodiment, by obtaining a number of frequency points that divide the frequency of the low frequency signal frequency band equally, according to the number of frequency points Point to get the low-frequency weighted value of the amplitude of the low-frequency signal frequency point. After the characteristic value is identified, the comparison unit 40 calculates the difference between the characteristic value of the sound source audio signal and the characteristic value of the feedback audio signal, and compares the difference with a preset difference threshold. In this embodiment, the sound source audio is calculated. The difference between the low-frequency weighting value of the signal and the low-frequency weighting value of the feedback audio signal. According to the comparison result between the difference and the preset difference threshold, the prompt unit 50 issues a corresponding prompt.
[0099] Specifically, compared to the first embodiment, this embodiment adds a judgment on whether the earphone is in the ear canal before the wearing detection, so as to avoid unnecessary detection actions when the earphone is not worn.
[0100] Figure 5 It is a schematic diagram of the structural composition of the fourth embodiment of the terminal of the present invention. Such as Figure 5 As shown, it may include: at least one input device 101, at least one output device 102, a bus 103, a transceiver 104, a memory 105, and a processor 100. The aforementioned input device 101, output device 102, transceiver 104, memory 105, and processing The device 100 is connected via a bus 103, where:
[0101] The input device 101 is used to receive input data from an external input terminal 99. In specific implementation, the input device 101 of the embodiment of the present invention may include a keyboard, a mouse, an optoelectronic input device, a sound input device, a touch input device, a scanner, and the like.
[0102] The output device 102 is used to externally output the output data of the terminal. In specific implementation, the output device 102 of the embodiment of the present invention may include a display, a speaker, a printer, and the like.
[0103] The bus 103 is used to communicate with other devices. In specific implementation, the bus 103 in the embodiment of the present invention may be an example of a propagation medium. The propagation medium may generally embody other data in the form of computer readable instructions, data structures, program modules or other modulated data signals (such as carrier waves or other transmission mechanisms). For example, the propagation medium may include wired media, such as a priority network or For linear connection, the propagation medium can also include wireless medium, such as sound wave, radio frequency, infrared and so on. In specific implementation, the bus 103 in the embodiment of the present invention can be used to receive an access request from an access terminal.
[0104] The transceiver device 104 is configured to send data to or receive data from other devices through the bus 103. In specific implementation, the transceiver device 104 of the embodiment of the present invention may include a transceiver device such as a radio frequency antenna.
[0105] The memory 105 is used to store program data with various functions. The data stored in the memory 105 in the embodiment of the present invention includes data available to the network service provider and data unavailable to the network service provider, as well as other program data that can be called and run. In specific implementation, the memory 105 of the embodiment of the present invention may be a system memory, for example, volatile (such as RAM), non-volatile (such as ROM, flash memory, etc.), or a combination of the two. In specific implementation, the memory 105 in the embodiment of the present invention may also be an external memory outside the system, such as a magnetic disk, an optical disk, and a tape.
[0106] The processor 100, such as a CPU, is used to call program data stored in the memory 105 and perform the following operations:
[0107] Acquire the audio source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal; extract the audio signal of the target frequency band in the audio source audio signal and the feedback audio signal; obtain the characteristic value of the audio signal of the target frequency band according to the first preset condition ; Calculate the difference between the characteristic value of the audio source audio signal and the characteristic value of the feedback audio signal, and compare the difference with the preset difference threshold; issue corresponding prompts based on the comparison result between the difference and the preset difference threshold .
[0108] Determine whether the earphone is currently in the ear canal according to the second preset condition; if the earphone is in the ear canal, obtain the sound source audio signal of the earphone itself and the feedback audio signal received by the earphone in the ear canal; extract the target frequency band of the sound source audio signal and the feedback audio signal The audio signal; obtain the characteristic value of the audio signal of the target frequency band according to the first preset condition; calculate the difference between the characteristic value of the audio source audio signal and the characteristic value of the feedback audio signal, and compare the difference with the preset The difference threshold is compared; the corresponding prompt is issued according to the comparison result between the difference and the preset difference threshold.
[0109] In the several embodiments provided in this application, it should be understood that the disclosed method is only illustrative and can be implemented in other ways.
[0110] It should be noted that the steps in the method of the embodiment of the present invention may be adjusted, merged, and deleted in order according to actual needs.
[0111] In the embodiment of the present invention, the units in the terminal can be combined, divided, and deleted according to actual needs.
[0112] The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited to this. Anyone familiar with the technical field can easily think of various equivalents within the technical scope disclosed by the present invention. Modifications or replacements, these modifications or replacements shall be covered by the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.
