Headphone control method and device, headphone, and storage medium

Abstract

The present disclosure relates to a headphone control method and device, a headphone, and a storage medium. The method includes: determining whether the center of the speaker is aligned with the center of the ear on which the headphone is worn; and when it is determined that the center of the speaker is not aligned with the center of the ear on which the headphone is worn, aligning the center of the speaker with the center of the ear. In this embodiment, by aligning the center of the speaker with the center of the ear, the power of the audio signal entering the ear canal can be guaranteed, ensuring the quality of the audio listening experience, and improving the user experience.

Description

Technical Field

[0001] The present disclosure relates to the field of control technology, and in particular to an earphone control method and device, an earphone, and a storage medium. Background Art

[0002] With existing headphones, users manually adjust them to fit their ears. However, a flexible protective layer on the outside of the headphones prevents users from feeling that the headband fits completely against their ears, resulting in a tight fit on one side and a loose fit on the other. Alternatively, during use, users may move, causing the headphones to fit their ears tight on one side and loose on the other. If this happens, the center point of the sound waves emitted by the speaker may shift away from the ear canal, reducing the audio power entering the ear canal and causing a reduced sense of hearing. Summary of the Invention

[0003] The present disclosure provides an earphone control method and device, earphones, and a storage medium to address the deficiencies of related technologies.

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an earphone control method applicable to a headset, the method comprising:

[0005] determining whether a center of the speaker is aligned with a center of an ear wearing the headset;

[0006] When it is determined that the center of the speaker is not aligned with the center of the ear on which the headphone is worn, the center of the speaker is aligned with the center of the ear.

[0007] Optionally, the headset includes a plurality of sensing devices, each sensing device is used to obtain sensing data with the ear, and the sensing data is used to determine whether the center of the speaker is aligned with the center of the ear wearing the headset.

[0008] Optionally, the plurality of sensing devices are pressure sensors, and each pressure sensor is respectively arranged at a corresponding preset position on the headset;

[0009] Determining whether a center of the speaker is aligned with a center of an ear wearing the headphone comprises:

[0010] Obtaining pressure values ​​collected by each pressure sensor in the headset;

[0011] When the pressure value of at least one pressure sensor is less than the corresponding preset pressure threshold, it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset; when the pressure values ​​of all pressure sensors exceed the corresponding preset threshold, it is determined that the center of the speaker is aligned with the center of the ear wearing the headset.

[0012] Optionally, after obtaining the pressure values ​​collected by each pressure sensor in the headset, the method further includes:

[0013] Comparing pressure values ​​collected by two first pressure sensors located on the same side of the plane where the earband of the headset is located, or comparing pressure values ​​collected by two second pressure sensors located on the same side and symmetrically about the plane where the earband is located;

[0014] When the difference between the pressure values ​​of the two first pressure sensors exceeds a set pressure threshold, it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset, and is offset in the plane where the ear band is located; when the difference between the pressure values ​​of the two second pressure sensors exceeds a set pressure threshold, it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset, and is offset perpendicular to the plane where the ear band is located.

[0015] Optionally, the plurality of sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset;

[0016] Determining whether a center of the speaker is aligned with a center of an ear wearing the headphone comprises:

[0017] acquiring characteristic data of an ear wearing the headset based on the received ultrasonic audio signal;

[0018] Based on the feature data of the preset ear, obtaining a cosine value of the feature data of the ear and the feature data of the preset ear, and using the cosine value as the similarity between the ear and the preset ear;

[0019] When the similarity exceeds a preset similarity threshold, it is determined that the center of the speaker of the headset is aligned with the center of the entrance of the ear canal; when the similarity is less than the preset threshold, it is determined that the center of the speaker of the headset is not aligned with the center of the entrance of the ear canal.

[0020] Optionally, acquiring characteristic data of an ear of a person wearing the headset based on the received ultrasonic audio signal includes:

[0021] Sequentially obtaining the reflection point position of each ultrasonic audio signal in the ear canal; the ultrasonic audio signal is converted by an ultrasonic receiver in the earphone into ultrasonic waves in the ear;

[0022] Based on the position and emission angle of the ultrasonic transmitter, construct a 3D image of the ear according to the reflection point positions corresponding to the ultrasonic audio signals;

[0023] respectively obtaining characteristic parameter values ​​of a preset number of designated positions on the 3D image;

[0024] A feature matrix of the 3D image is constructed according to the feature parameter values ​​of the preset number of designated positions, and the feature matrix is ​​used as feature data of the ear.

[0025] Optionally, aligning the center of the speaker with the center of the ear includes:

[0026] The first driving component is controlled to adjust the orientation of the headset until the pressure values ​​of all pressure sensors exceed corresponding preset thresholds, so as to align the center of the speaker with the center of the ear.

[0027] Optionally, aligning the center of the speaker with the center of the ear includes:

[0028] The second driving component is controlled to adjust the orientation of the speaker in the headset to align the center of the speaker with the center of the ear.

[0029] According to a second aspect of an embodiment of the present disclosure, there is provided an earphone control device, applicable to a headset, the device comprising:

[0030] a determination module, configured to determine whether a center of the speaker is aligned with a center of an ear wearing the headset;

[0031] An alignment module is configured to align the center of the speaker with the center of the ear when it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset.

[0032] Optionally, the headset includes a plurality of sensing devices, each sensing device is used to obtain sensing data with the ear, and the sensing data is used to determine whether the center of the speaker is aligned with the center of the ear wearing the headset.

[0033] Optionally, the plurality of sensing devices are pressure sensors, and each pressure sensor is respectively arranged at a corresponding preset position on the headset; and the determining module includes:

[0034] a pressure value acquiring unit, configured to acquire pressure values ​​collected by pressure sensors in the headset;

[0035] an alignment determination unit, configured to determine that the center of the speaker is not aligned with the center of the ear wearing the headset when the pressure value of at least one pressure sensor is less than a corresponding preset threshold; and to determine that the center of the speaker is aligned with the center of the ear wearing the headset when the pressure values ​​of all pressure sensors exceed the corresponding preset threshold.

[0036] Optionally, the determining module further includes:

[0037] a pressure value comparison unit, configured to compare pressure values ​​collected by two first pressure sensors located on the same side of the plane where the earband of the headset is located, or pressure values ​​collected by two second pressure sensors located symmetrically about the plane where the earband is located and on the same side;

[0038] The alignment determination unit is further configured to determine that the center of the speaker is not aligned with the center of the ear wearing the headset and is offset in the plane where the ear band is located when the difference between the pressure values ​​of the two first pressure sensors exceeds a set pressure threshold; and to determine that the center of the speaker is not aligned with the center of the ear wearing the headset and is offset perpendicular to the plane where the ear band is located when the difference between the pressure values ​​of the two second pressure sensors exceeds a set pressure threshold.

[0039] Optionally, the plurality of sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset; and the determining module includes:

[0040] a characteristic data acquisition unit, configured to acquire characteristic data of an ear wearing the headset based on the received ultrasonic audio signal;

[0041] a similarity obtaining unit, configured to obtain, based on preset ear feature data, a cosine value of the ear feature data and the preset ear feature data, and use the cosine value as the similarity between the ear and the preset ear;

[0042] A center alignment determination unit is used to determine that the center of the speaker of the headset is aligned with the center of the entrance of the ear canal when the similarity exceeds a preset threshold; and to determine that the center of the speaker of the headset is not aligned with the center of the entrance of the ear canal when the similarity is less than the preset threshold.

[0043] Optionally, the feature data acquisition unit includes:

[0044] The reflection point acquisition subunit is used to sequentially obtain the reflection point position of each ultrasonic audio signal in the ear canal; the ultrasonic audio signal is converted from the ultrasonic wave received by the ultrasonic receiver in the earphone into the ear;

[0045] a 3D image acquisition subunit, configured to construct a 3D image of the ear according to the positions of reflection points corresponding to the ultrasonic audio signals based on the position and emission angle of the ultrasonic transmitter;

[0046] a parameter value acquisition subunit, configured to respectively acquire characteristic parameter values ​​of a preset number of designated positions on the 3D image;

[0047] The feature data acquisition subunit is used to construct a feature matrix of the 3D image according to the feature parameter values ​​of the preset number of designated positions, and use the feature matrix as the feature data of the ear.

[0048] Optionally, the alignment module includes:

[0049] The first driving unit is used to control the first driving component to adjust the orientation of the headset until the pressure values ​​of all pressure sensors exceed corresponding preset thresholds, so as to align the center of the speaker with the center of the ear.

[0050] Optionally, the alignment module further includes:

[0051] The second control unit is used to control the second driving component to adjust the direction of the speaker in the headset to align the center of the speaker with the center of the ear.

[0052] According to a third aspect of an embodiment of the present disclosure, there is provided a headset, comprising:

[0053] a plurality of sensing devices, each sensing device being used to obtain sensing data relative to the ear, wherein the sensing data is used to determine whether a center of the speaker is aligned with a center of an ear wearing the headphone;

[0054] a speaker configured to emit ultrasonic waves and sound waves;

[0055] a first driving assembly, configured to drive the head of the headset to rotate around an earband or around a fixed axis of the head;

[0056] a memory for storing a processor executable program;

[0057] A processor is used to execute the executable program to implement the steps of the above method.

[0058] Optionally, a second driving assembly is further included, and the second driving assembly is used to rotate the speaker around its central axis.

[0059] Optionally, the multiple sensing devices are pressure sensors, and each pressure sensor is respectively arranged at a corresponding preset position on the headset; or, the multiple sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset.

[0060] According to a fourth aspect of an embodiment of the present disclosure, a readable storage medium is provided, on which an executable program is stored, and the executable program implements the steps of the above method when executed.

[0061] The technical solutions provided by the embodiments of the present disclosure may have the following beneficial effects:

[0062] As can be seen from the above embodiments, in the disclosed embodiments, it is possible to determine whether the center of the speaker is aligned with the center of the ear on which the headset is worn; if it is determined that the center of the speaker is not aligned with the center of the ear on which the headset is worn, the center of the speaker is aligned with the center of the ear. Thus, by aligning the center of the speaker with the center of the ear, this embodiment ensures the power of the audio signal entering the ear canal, ensures the quality of the audio listening experience, and improves the user experience.

[0063] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0065] Figure 1 The figure is a flow chart of a method for controlling an earphone according to an exemplary embodiment.

[0066] Figure 2 The figure is a schematic diagram of an application scenario according to an exemplary embodiment.

[0067] Figure 3 The figure is a flow chart of another earphone control method according to an exemplary embodiment.

[0068] Figure 4 The flowchart of another earphone control method is shown according to an exemplary embodiment.

[0069] Figure 5 The figure is a block diagram of a headphone control device according to an exemplary embodiment.

[0070] Figure 6 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0071] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, like numbers in different figures represent like or similar elements unless otherwise indicated. The exemplary embodiments described below are not intended to represent all embodiments consistent with the present disclosure. Rather, they are merely examples of devices consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0072] With existing headphones, users manually adjust them to fit their ears. However, a flexible protective layer on the outside of the headphones prevents users from feeling that the headband fits completely against their ears, resulting in a tight fit on one side and a loose fit on the other. Alternatively, during use, users may move, causing the headphones to fit their ears tight on one side and loose on the other. If this happens, the center point of the sound waves emitted by the speaker may shift away from the ear canal, reducing the audio power entering the ear canal and causing a reduced sense of hearing.

[0073] Figure 1 is a flow chart of a headphone control method according to an exemplary embodiment, which is applicable to Figure 2 Headphones shown. See Figure 2 The headset includes a headband 1 and a head 2, as well as multiple pressure sensors 3, a first drive component for controlling the orientation of the head of the headset, and a second drive component for adjusting the orientation of the speaker (not shown in the figure), and each pressure sensor is set at a preset position.

[0074] It should be noted that the headset also includes multiple sensing devices, each of which is set to its own corresponding preset position and is used to obtain sensing data from the ear. The sensing data is used to determine whether the center of the speaker is aligned with the center of the ear wearing the headset. In one example, the multiple sensing devices are pressure sensors, each of which can collect the pressure value between the preset position of the headset head and the ear. In another example, the multiple sensing devices can be ultrasonic receivers, each of which is used to receive ultrasonic audio signals returned by the ear. The role of pressure values ​​and ultrasonic audio signals will be explained in subsequent embodiments.

[0075] It should be noted that the number of pressure sensors can be set according to the specific scenario. For example, the headset can be provided with 4 pressure sensors, 2 of which are respectively arranged on the straight lines where the plane of the headset head and the plane of the headband intersect, and the other 2 pressure sensors can be arranged at positions symmetrical with respect to the plane of the headband. In other words, the head of the headset is an elliptical component, and a pressure sensor is arranged at the vertex position of the major axis and the minor axis of the elliptical component. Similarly, the number of ultrasonic receivers can be set according to the specific scenario. The specific number and setting method can refer to the relevant technology and will not be described in detail here. It should be noted that the number of the first drive components can be set according to the specific scenario. For example, the drive component is implemented by 2 stepper motors, and 1 stepper motor is used to drive the headset head to rotate with the headband as the axis, and the rotation direction is as follows. Figure 2 The direction R1 shown in the figure can adjust the fitting pressure between the headphone head and the ear. Another stepper motor is used to drive the headphone head to rotate around a fixed axis perpendicular to the headband. The rotation direction is as shown in the figure. Figure 2 The direction R2 shown in the figure can adjust the pressure of the earphone head and the ear. The number of the second drive components can be set according to the specific scenario. For example, a stepper motor is set so that the speaker in the earphone can move around the central axis of the speaker. The rotation direction is as follows: Figure 2 Direction R3 shown in .

[0076] See also Figure 1 , a headset control method, comprising steps 11 and 12, wherein:

[0077] In step 11, it is determined whether the center of the speaker is aligned with the center of the ear wearing the headset.

[0078] In this embodiment, the processor in the headset may obtain whether the center of the speaker is aligned with the center of the ear, including:

[0079] In one example, when wearing headphones, one side may be tight while the other side may be loose. Because the plane where the head of the headphones is located or the plane where the speaker surface is located forms a certain angle with the plane where the ear is located, the audio signal emitted by the speaker is no longer parallel to the ear canal, that is, the audio signal cannot directly enter the ear canal. Therefore, see Figure 3 In step 31, the processor in the headset can obtain the pressure value collected by each pressure sensor. For example, each pressure sensor in the headset will collect pressure values ​​according to a set period, and the pressure value is used to characterize the pressure between the head of the headset and the head when the headset is worn. The processor in the headset can be connected to each pressure sensor to obtain the pressure value collected by the pressure sensor, and the acquisition method includes receiving the pressure value reported by the pressure sensor or reading the pressure value from the local memory. In step 32, the headset can pre-store the preset threshold value of each pressure sensor. In actual application, the preset threshold value can be set according to the installation position of each pressure sensor. For example, the preset threshold value of the pressure sensor at the front position of the left channel earphone in the headset (close to the user's face) can be greater than the preset threshold value of the pressure sensor at the rear position (close to the back of the user's head). This is because the headset is usually tilted forward during wearing. After obtaining the pressure value of each pressure sensor, the processor can compare the pressure value with the corresponding preset threshold; when the pressure value of at least one pressure sensor is less than the corresponding preset threshold, it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset; when the pressure values ​​of all pressure sensors exceed the corresponding preset threshold, it is determined that the center of the speaker is aligned with the center of the ear wearing the headset.

[0080] In another example, the headset can be provided with an ultrasonic receiver at a preset position, and the processor can control the speaker to emit an ultrasonic signal. The ultrasonic audio signal will be returned as an ultrasonic audio signal after hitting the auricle, ear canal and / or the inner wall of the eardrum. In this way, the ultrasonic receiver can receive the ultrasonic audio signal. Figure 4 In step 41, the processor may obtain characteristic data of the ear of the person wearing the headset based on the received ultrasonic audio signal. For example, the processor may sequentially obtain the locations of reflection points in the ear canal corresponding to the ultrasonic audio signals received by each ultrasonic receiver. The processor may then construct a 3D image of the ear based on the installation position of the ultrasonic transmitter and the locations of the reflection points corresponding to each ultrasonic audio signal. The method for constructing the 3D image can be referenced in related art and will not be further described here.

[0081] The processor can respectively obtain the characteristic parameter values ​​of a preset number of specified positions on the 3D image. The characteristic parameter values ​​may include the distance between the specified position and the ultrasonic transmitter, the curvature (or slope) of the upper, lower, left and right sides of the specified position, which can be selected according to the specific scene. In addition, the number and position of the specified positions can be set according to the specific scene. For example, more positions can be specified at the protruding position in the ear canal, and fewer positions can be specified at the straighter position, that is, the specified position should be selected as the turning position in the ear canal as much as possible. The processor can construct a characteristic matrix of the 3D image based on the characteristic parameter values ​​of the preset number of specified positions, and use the characteristic matrix as the characteristic data of the ear.

[0082] It is understandable that, when the designated positions and the characteristic parameter values ​​of each designated position are known, a multidimensional matrix of characteristic parameter values ​​can be formed according to the order of the designated positions. For example, if the designated position 1 has characteristic parameter values ​​of {x11, x12, x13}; the designated position 2 has characteristic parameter values ​​of {x21, x22, x23}, ..., and the designated position n has characteristic parameter values ​​of {xn1, xn2, xn3}, then the characteristic data obtained is:

[0083]

[0084] In another example, the processor may obtain the spatial coordinates of a predetermined number of designated locations on the 3D image. For each designated location, the processor may obtain the distance between the designated location and each other designated location, thereby obtaining a distance set corresponding to the designated location. A feature matrix of the 3D image is constructed based on each designated location and its corresponding distance set, and the feature matrix is ​​used as the feature data of the ear.

[0085] Taking 4 specified positions as an example, the distance set corresponding to specified position 1 is {x11, x12, x13, x14}; the distance set corresponding to specified position 2 is {x21, x22, x23, x24}, the distance set corresponding to specified position 3 is {x31, x32, x33, x34}, and the distance set corresponding to specified position 4 is {x41, x42, x43, x44}. The feature data of the ear is:

[0086]

[0087] When the specified position coincides with the own position, the value is 0, such as x22 is zero.

[0088] In practical applications, headphones can store preset ear feature data. For example, after the user puts on the headphones, the headphones can emit ultrasonic waves to collect ear feature data, and use this feature data as the preset ear feature data. In another example, when configuring the headphones, the user is guided through the corresponding configuration steps. When the user determines that the audio quality is satisfactory, the feature data is obtained and used as the preset ear feature data.

[0089] In step 42, the processor may obtain a cosine value between the ear feature data and the preset ear feature data based on the preset ear feature data, and use the cosine value as the similarity between the ear and the preset ear. The calculation method of the cosine value can be referred to in related art and will not be further described here.

[0090] In step 43, the processor obtains a preset similarity threshold, compares the above similarity with the preset similarity threshold, and when the similarity exceeds the preset similarity threshold, determines that the center of the speaker of the headset is aligned with the center of the entrance of the ear canal; when the similarity is less than the preset threshold, determines that the center of the speaker of the headset is not aligned with the center of the entrance of the ear canal.

[0091] That is, the similarity between the ear and the preset ear is determined by the ultrasonic audio signal to determine whether some reflection points of the ear are not detected, thereby determining whether the headset is tilted.

[0092] In step 12, when it is determined that the center of the speaker is not aligned with the center of the ear on which the headphone is worn, the center of the speaker is aligned with the center of the ear.

[0093] In this embodiment, when the processor determines that the center of the speaker and the center of the ear are not aligned, the processor may align the center of the speaker and the center of the ear, including:

[0094] In one example, the orientation of the headset is adjusted. The processor may control the first drive assembly to adjust the orientation of the headset, for example, by adjusting the front-to-back tilt angle and / or the up-and-down tilt angle of the headset, until the pressure values ​​of all pressure sensors exceed corresponding preset thresholds, thereby aligning the center of the speaker with the center of the ear.

[0095] In another example, the orientation of the speaker is adjusted. The processor can control the second driver to adjust the orientation of the speaker so that the center of the speaker points to the center of the ear canal, that is, the center of the speaker is aligned with the center of the ear canal. This allows the audio signal to be directly incident on the ear canal, reduces audio signal attenuation, and ensures the audio listening effect.

[0096] Thus, in the disclosed embodiment, it is possible to determine whether the center of the speaker is aligned with the center of the ear on which the headset is worn; if it is determined that the center of the speaker is not aligned with the center of the ear on which the headset is worn, the center of the speaker is aligned with the center of the ear. Thus, in this embodiment, by aligning the center of the speaker with the center of the ear, the power of the audio signal entering the ear canal is guaranteed, ensuring the quality of the audio listening experience, and thus improving the user experience.

[0097] Figure 5 This is a block diagram of an earphone control device according to an exemplary embodiment, which is applicable to a headset. The device includes:

[0098] a determination module 51, configured to determine whether the center of the speaker is aligned with the center of the ear wearing the headset;

[0099] The alignment module 52 is configured to align the center of the speaker with the center of the ear when it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset.

[0100] In one embodiment, the headset includes a plurality of sensing devices, each sensing device is used to obtain sensing data with the ear, and the sensing data is used to determine whether the center of the speaker is aligned with the center of the ear wearing the headset.

[0101] In one embodiment, the plurality of sensing devices are pressure sensors, each of which is disposed at a corresponding preset position on the headset; and the determining module includes:

[0102] a pressure value acquiring unit, configured to acquire pressure values ​​collected by pressure sensors in the headset;

[0103] an alignment determination unit, configured to determine that the center of the speaker is not aligned with the center of the ear wearing the headset when the pressure value of at least one pressure sensor is less than a corresponding preset threshold; and to determine that the center of the speaker is aligned with the center of the ear wearing the headset when the pressure values ​​of all pressure sensors exceed the corresponding preset threshold.

[0104] In one embodiment, the determining module further includes:

[0105] a pressure value comparison unit, configured to compare pressure values ​​collected by two first pressure sensors located on the same side of the plane where the earband of the headset is located, or pressure values ​​collected by two second pressure sensors located symmetrically about the plane where the earband is located and on the same side;

[0106] The alignment determination unit is further configured to determine that the center of the speaker is not aligned with the center of the ear wearing the headset and is offset in the plane where the ear band is located when the difference between the pressure values ​​of the two first pressure sensors exceeds a set pressure threshold; and to determine that the center of the speaker is not aligned with the center of the ear wearing the headset and is offset perpendicular to the plane where the ear band is located when the difference between the pressure values ​​of the two second pressure sensors exceeds a set pressure threshold.

[0107] In one embodiment, the plurality of sensing devices are ultrasonic receivers, each ultrasonic receiver being disposed at a corresponding preset position on the headset; and the determining module includes:

[0108] a characteristic data acquisition unit, configured to acquire characteristic data of an ear wearing the headset based on the received ultrasonic audio signal;

[0109] a similarity obtaining unit, configured to obtain, based on preset ear feature data, a cosine value of the ear feature data and the preset ear feature data, and use the cosine value as the similarity between the ear and the preset ear;

[0110] A center alignment determination unit is used to determine that the center of the speaker of the headset is aligned with the center of the entrance of the ear canal when the similarity exceeds a preset threshold; and to determine that the center of the speaker of the headset is not aligned with the center of the entrance of the ear canal when the similarity is less than the preset threshold.

[0111] In one embodiment, the feature data acquisition unit includes:

[0112] The reflection point acquisition subunit is used to sequentially obtain the reflection point position of each ultrasonic audio signal in the ear canal; the ultrasonic audio signal is converted from the ultrasonic wave received by the ultrasonic receiver in the earphone into the ear;

[0113] a 3D image acquisition subunit, configured to construct a 3D image of the ear according to the positions of reflection points corresponding to the ultrasonic audio signals based on the position and emission angle of the ultrasonic transmitter;

[0114] a parameter value acquisition subunit, configured to respectively acquire characteristic parameter values ​​of a preset number of designated positions on the 3D image;

[0115] The feature data acquisition subunit is used to construct a feature matrix of the 3D image according to the feature parameter values ​​of the preset number of designated positions, and use the feature matrix as the feature data of the ear.

[0116] In one embodiment, the alignment module includes:

[0117] The first driving unit is used to control the first driving component to adjust the orientation of the headset until the pressure values ​​of all pressure sensors exceed corresponding preset thresholds, so as to align the center of the speaker with the center of the ear.

[0118] In one embodiment, the alignment module further includes:

[0119] The second control unit is used to control the second driving component to adjust the direction of the speaker in the headset to align the center of the speaker with the center of the ear.

[0120] It is understandable that the device provided by the embodiment of the present disclosure corresponds to the above-mentioned method embodiment. For specific content, please refer to the content of each method embodiment, which will not be repeated here.

[0121] Figure 6 6 is a block diagram of an electronic device according to an exemplary embodiment. For example, electronic device 600 may be a smartphone, computer, digital broadcast terminal, tablet device, medical device, fitness device, personal digital assistant, etc., including the transmitting coil, first magnetic sensor, and second magnetic sensor of the headphone control device.

[0122] Reference Figure 6 , the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , a communication component 616 , and an image acquisition component 618 .

[0123] The processing component 602 generally controls the overall operation of the processing electronic device 600, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions. In addition, the processing component 602 may include one or more modules to facilitate interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate interaction between the multimedia component 608 and the processing component 602.

[0124] The memory 604 is configured to store various types of data to support operations on the electronic device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0125] The power supply assembly 606 provides power to the various components of the electronic device 600. The power supply assembly 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.

[0126] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the target object. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the target object. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0127] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals. In addition, the audio component 610 can also Figure 1 or Figure 3The headset shown in the example has a processor MCU in it that can implement the steps of the above method.

[0128] The I / O interface 612 provides an interface between the processing component 602 and a peripheral interface module, such as a keyboard, a click wheel, a button, etc.

[0129] The sensor assembly 614 includes one or more sensors for providing various status assessments for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of components, such as the display screen and keypad of the electronic device 600, and can also detect changes in the position of the electronic device 600 or a component, the presence or absence of contact between the electronic device 600 and a target object, the orientation or acceleration / deceleration of the electronic device 600, and changes in the temperature of the electronic device 600.

[0130] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0131] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components.

[0132] In an exemplary embodiment, a headset is further provided, characterized by comprising:

[0133] a plurality of sensing devices, each sensing device being used to obtain sensing data relative to the ear, wherein the sensing data is used to determine whether a center of the speaker is aligned with a center of an ear wearing the headphone;

[0134] a speaker configured to emit ultrasonic waves and sound waves;

[0135] a first driving assembly, configured to drive the head of the headset to rotate around an earband or around a fixed axis of the head;

[0136] a memory for storing a processor executable program;

[0137] A processor is used to execute the executable program to implement the steps of the above method.

[0138] In one embodiment, a second driving assembly is further included, and the second driving assembly is used to rotate the speaker around its central axis.

[0139] In one embodiment, the multiple sensing devices are pressure sensors, and each pressure sensor is respectively arranged at a corresponding preset position on the headset; or, the multiple sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset.

[0140] In the description Figure 2 The headphones shown have been described for Figure 1 The improvements made to the headphone control method shown will not be described in detail here.

[0141] In an exemplary embodiment, a non-transitory readable storage medium including an executable program is also provided, such as a memory 604 storing the executable program, which can be executed by a processor in the audio component. The readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, or the like.

[0142] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the embodiments disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosed embodiments that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0143] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A headphone control method, characterized in that: Applicable to a headset, the method includes: determining whether a center of a speaker of the headset is aligned with a center of an ear on which the headset is worn; When it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset, controlling the second driving component to adjust the orientation of the speaker in the headset to align the center of the speaker with the center of the ear; Determining whether a center of the speaker is aligned with a center of an ear wearing the headphone comprises: Acquiring characteristic data of the ear of the person wearing the headset based on the received ultrasonic audio signal, wherein the ultrasonic audio signal is converted by an ultrasonic receiver in the headset into ultrasonic waves in the ear; Based on the feature data of the preset ear, obtaining a cosine value of the feature data of the ear and the feature data of the preset ear, and using the cosine value as the similarity between the ear and the preset ear; When the similarity exceeds a preset similarity threshold, determining that the center of the speaker of the headset is aligned with the center of the entrance of the ear canal; when the similarity is less than the preset threshold, determining that the center of the speaker of the headset is not aligned with the center of the entrance of the ear canal; The acquiring characteristic data of the ear of the person wearing the headset based on the received ultrasonic audio signal includes: Sequentially obtain the reflection point position of each ultrasonic audio signal in the ear canal; Based on the position and emission angle of the ultrasonic receiver, construct a 3D image of the ear according to the reflection point positions corresponding to the ultrasonic audio signals; respectively obtaining characteristic parameter values ​​of a preset number of designated positions on the 3D image; constructing a feature matrix of the 3D image according to the feature parameter values ​​of the preset number of designated positions, and using the feature matrix as feature data of the ear; Among the preset number of designated positions, the number of designated positions at protruding positions in the ear canal is greater than the number of designated positions at relatively straight positions in the ear canal.

2. The headphone control method according to claim 1, wherein: The headset includes a plurality of sensing devices, each of which is used to obtain sensing data relative to the ear, and the sensing data is used to determine whether the center of the speaker is aligned with the center of the ear wearing the headset.

3. The earphone control method according to claim 2, wherein: The multiple sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset.

4. The headphone control method according to any one of claims 1 to 3, characterized in that: Aligning a center of the speaker with a center of the ear, comprising: The first driving component is controlled to adjust the orientation of the headset until the pressure values ​​of all pressure sensors exceed corresponding preset thresholds, so as to align the center of the speaker with the center of the ear.

5. An earphone control device, characterized in that: Applicable to a headset, the device comprises: a determination module, configured to determine whether a center of a speaker of the headset is aligned with a center of an ear wearing the headset; an alignment module, configured to align the center of the speaker with the center of the ear when it is determined that the center of the speaker is not aligned with the center of the ear wearing the headset; The alignment module further includes: a second control unit, configured to control the second driving assembly to adjust the orientation of the speaker in the headset so as to align the center of the speaker with the center of the ear; The determination module includes: a characteristic data acquisition unit, configured to acquire characteristic data of an ear of a person wearing the headset based on a received ultrasonic audio signal, wherein the ultrasonic audio signal is converted from ultrasonic waves received by an ultrasonic receiver in the headset into ultrasonic waves in the ear; a similarity obtaining unit, configured to obtain, based on preset ear feature data, a cosine value of the ear feature data and the preset ear feature data, and use the cosine value as the similarity between the ear and the preset ear; a center alignment determining unit, configured to determine that the center of the speaker of the headset is aligned with the center of the entrance of the ear canal when the similarity exceeds a preset threshold; and to determine that the center of the speaker of the headset is not aligned with the center of the entrance of the ear canal when the similarity is less than the preset threshold; The feature data acquisition unit includes: A reflection point acquisition subunit is used to sequentially acquire the reflection point position in the ear canal corresponding to each ultrasonic audio signal; a 3D image acquisition subunit, configured to construct a 3D image of the ear according to the positions of reflection points corresponding to the ultrasonic audio signals based on the position and emission angle of the ultrasonic receiver; a parameter value acquisition subunit, configured to respectively acquire characteristic parameter values ​​of a preset number of designated positions on the 3D image; a feature data acquisition subunit, configured to construct a feature matrix of the 3D image based on the feature parameter values ​​of the preset number of designated positions, and use the feature matrix as feature data of the ear; Among the preset number of designated positions, the number of designated positions at protruding positions in the ear canal is greater than the number of designated positions at relatively straight positions in the ear canal.

6. The headphone control device according to claim 5, characterized in that: The headset includes a plurality of sensing devices, each of which is used to obtain sensing data relative to the ear, and the sensing data is used to determine whether the center of the speaker is aligned with the center of the ear wearing the headset.

7. The earphone control device according to claim 6, characterized in that: The multiple sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset.

8. The earphone control device according to any one of claims 5 to 7, wherein: The alignment module includes: The first driving unit is used to control the first driving component to adjust the orientation of the headset until the pressure values ​​of all pressure sensors exceed corresponding preset thresholds, so as to align the center of the speaker with the center of the ear.

9. A headset, characterized in that: include: a plurality of sensing devices, each sensing device being used to obtain sensing data relative to the ear, wherein the sensing data is used to determine whether a center of the speaker is aligned with a center of an ear wearing the headphone; a speaker configured to emit ultrasonic waves and sound waves; a first driving assembly, configured to drive the head of the headset to rotate around an earband or around a fixed axis of the head; a memory for storing a processor executable program; A processor, configured to execute an executable program to implement the steps of the method according to any one of claims 1 to 4.

10. The headset according to claim 9, wherein Also included is a second drive assembly for rotating the speaker around its central axis.

11. The headset according to claim 9, wherein The multiple sensing devices are ultrasonic receivers, and each ultrasonic receiver is respectively arranged at a corresponding preset position on the headset.

12. A readable storage medium having an executable program stored thereon, characterized in that: When the executable program is executed, the steps of the method according to any one of claims 1 to 4 are implemented.

Images