A method of a sound signal and related apparatus

Abstract

The embodiment of the application discloses a sound signal method and related equipment, which can be used in the field of smart wearable devices. The first microphone and the second microphone are located at the first side and the second side of the first earphone, the third microphone and the fourth microphone are located at the first side and the second side of the second earphone, the second side is different from the first side, and the first side is provided with an audio output port of the earphone. The method comprises the following steps: obtaining a first sound signal obtained through the first microphone, a second sound signal obtained through the second microphone, a third sound signal obtained through the third microphone and a fourth sound signal obtained through the fourth microphone; performing noise reduction processing on the first sound signal according to the second sound signal to obtain a first noise reduction signal; performing noise reduction processing on the third sound signal according to the fourth sound signal to obtain a second noise reduction signal; and determining that each earphone is worn on the left ear or the right ear. The wearing position of the earphone is determined based on the actual wearing condition of the user, and the user operation is simpler.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and particularly relates to a sound signal method and related equipment. BACKGROUND

[0002] With the development of science and technology, earphones become a more and more popular product. The invention of Bluetooth earphones, wireless earphones and other types of earphones makes users have a larger activity space when using earphones, and users can more conveniently listen to audio, watch video, experience virtual reality (VR) games and the like.

[0003] At present, the mainstream way is that two earpieces of an earphone are pre-marked with left (L) and right (R), and a user needs to wear the two earpieces on the left ear and the right ear according to the marks on the two earpieces, but the two earpieces may be worn in reverse by the user, and when playing stereo sound through the earphone, the user wearing the earpieces in reverse will cause unnatural sound heard by the user. SUMMARY

[0004] Embodiments of the present application provide a sound signal method and related equipment, which determine whether an earpiece is worn on the left ear or the right ear based on the actual wearing position of a user, that is, the user can randomly wear the earphone, which makes the user operation simpler and is conducive to improving the user stickiness of the present solution; in addition, the first noise reduction signal and the second noise reduction signal each include a clear heart sound signal, which is conducive to improving the accuracy of the generated detection result.

[0005] To solve the above technical problems, embodiments of the present application provide the following technical solutions:

[0006] In a first aspect, an embodiment of the present application provides a sound signal processing method, which can be applied to the field of smart wearable devices. The earphone includes a first earpiece and a second earpiece. The first earpiece is provided with a first microphone and a second microphone. The first microphone is located at a first side of the first earpiece, and the second microphone is located at a second side of the first earpiece. The second earpiece is provided with a third microphone and a fourth microphone. The third microphone is located at a first side of the second earpiece, and the fourth microphone is located at a second side of the second earpiece. It should be noted that the first side of the first earpiece and the second side of the first earpiece respectively represent two position regions of the first earpiece, rather than two specific position points of the first earpiece. Correspondingly, the first side of the second earpiece and the second side of the second earpiece respectively represent two position regions of the second earpiece, rather than two specific position points of the second earpiece. That is, the specific position point of the first microphone in the first earpiece and the specific position point of the third microphone in the second earpiece can be consistent or inconsistent, as long as the position region of the first microphone in the first earpiece and the position region of the third microphone in the second earpiece are the same. Correspondingly, the specific position point of the second microphone in the first earpiece and the specific position point of the fourth microphone in the second earpiece can be consistent or inconsistent, as long as the position region of the second microphone in the first earpiece and the position region of the fourth microphone in the second earpiece are the same.

[0007] Further, the first side of the earpiece has an audio output port, and the second side is different from the first side. That is, the first microphone and the audio output port of the first earpiece are located on the same side of the first earpiece, and the second microphone and the audio output port of the first earpiece are located on different sides of the first earpiece. Correspondingly, the second microphone and the audio output port of the second earpiece are located on the same side of the second earpiece, and the second microphone and the audio output port of the second earpiece are located on different sides of the second earpiece.

[0008] The sound signal processing method includes: in a case where it is detected that the earphone is worn, the device acquires a first sound signal, a second sound signal, a third sound signal and a fourth sound signal. The first sound signal is obtained through the first microphone, the second sound signal is obtained through the second microphone, the third sound signal is obtained through the third microphone, and the fourth sound signal is obtained through the fourth microphone. The device performs noise reduction processing on the first sound signal according to the second sound signal to obtain a first noise reduction signal, and performs noise reduction processing on the third sound signal according to the fourth sound signal to obtain a second noise reduction signal. The device determines a detection result according to the first noise reduction signal and the second noise reduction signal. The detection result is used to indicate that the first earpiece is worn on the left ear or the right ear, and / or the detection result is used to indicate that the second earpiece is worn on the left ear or the right ear.

[0009] In the implementation, the first microphone and the third microphone are located on the first side of the earpiece, the second microphone and the fourth microphone are located on the second side of the earpiece, the second side is different from the first side, the sound generated by the user's heart beating can be transmitted to the first earpiece and the second earpiece respectively, the first sound signal and the third sound signal include the heart sound signal generated by the heart beating in addition to the sound signal generated by the external environment, and the second sound signal and the fourth sound signal include the sound signal generated by the external environment; the first noise reduction signal and the second noise reduction signal can both include the clear heart sound signal generated by the heart beating, and the detection result can be determined according to the first noise reduction signal and the second noise reduction signal. It can be known from the foregoing solution that the category of each earpiece is not preset in the application, but the earpiece is determined to be worn on the left ear or the right ear based on the actual wearing position of the user after the user wears the earpiece, that is, the user can randomly wear the earphone, so that the user operation is simpler, and the user viscosity of the solution is improved. In addition, the first noise reduction signal and the second noise reduction signal both include the clear heart sound signal, which is beneficial to improve the accuracy of the generated detection result.

[0010] In a possible implementation of the first aspect, the execution device determines the detection result according to the first noise reduction signal and the second noise reduction signal, including: the execution device acquires a first occurrence time corresponding to at least one wave crest in the first noise reduction signal, and acquires a second occurrence time corresponding to at least one wave crest in the second noise reduction signal; and the execution device determines the detection result according to the first occurrence time and the second occurrence time.

[0011] In the implementation, the occurrence time of at least one wave crest in the first noise reduction signal at least includes the time when the sound signal generated by the atrial contraction of the user is transmitted to the first earpiece, and the occurrence time of at least one wave crest in the second noise reduction signal at least includes the time when the sound signal generated by the atrial contraction of the user is transmitted to the first earpiece. Therefore, the detection result can be determined based on the occurrence time of at least one wave crest in the first noise reduction signal and the second noise reduction signal, a simple determination manner of the detection result is provided, and the operation is easy.

[0012] In a possible implementation of the first aspect, the execution device determines the detection result according to the first occurrence time and the second occurrence time, which can include: if the execution device determines, according to the first occurrence time and the second occurrence time, that the occurrence time of the first wave crest in the first noise reduction signal is earlier than the occurrence time of the first wave crest in the second noise reduction signal, it is determined that the first earpiece is worn on the left ear and the second earpiece is worn on the right ear; if the execution device determines, according to the first occurrence time and the second occurrence time, that the occurrence time of the first wave crest in the first noise reduction signal is later than the occurrence time of the first wave crest in the second noise reduction signal, it is determined that the first earpiece is worn on the right ear and the second earpiece is worn on the left ear; or,

[0013] If the execution device determines, according to the first occurrence time and the second occurrence time, that the occurrence time of the first peak in the first noise reduction signal is earlier than the occurrence time of the first peak in the second noise reduction signal, it is determined that the first earphone is worn on the left ear and the second earphone is worn on the right ear, and the height of the first peak is greater than or equal to the first height threshold; if the execution device determines, according to the first occurrence time and the second occurrence time, that the occurrence time of the first peak in the first noise reduction signal is later than the occurrence time of the first peak in the second noise reduction signal, it is determined that the first earphone is worn on the right ear and the second earphone is worn on the left ear; or,

[0014] If the execution device determines, according to the first occurrence time and the second occurrence time, that the occurrence time of the second peak in the first noise reduction signal is earlier than the occurrence time of the second peak in the first noise reduction signal, it is determined that the first earphone is worn on the left ear and the second earphone is worn on the right ear, and the height of the second peak is greater than or equal to the second height threshold and less than the first height threshold; if the execution device determines, according to the first occurrence time and the second occurrence time, that the occurrence time of the second peak in the first noise reduction signal is later than the occurrence time of the second peak in the first noise reduction signal, it is determined that the first earphone is worn on the right ear and the second earphone is worn on the left ear.

[0015] In the implementation mode, multiple implementation modes of determining the detection result according to the occurrence time corresponding to at least one peak in the noise reduction signal are provided, and the implementation flexibility of the scheme is improved.

[0016] In a possible implementation mode of the first aspect, the execution device determines the detection result according to the first occurrence time and the second occurrence time, including: in the case where the first order and the second order are consistent, the execution device determines the detection result according to the first occurrence time and the second occurrence time. Wherein, the first order represents the occurrence order of the first peak in the first noise reduction signal and the second peak in the first noise reduction signal, and the second order represents the occurrence order of the first peak in the second noise reduction signal and the second peak in the second noise reduction signal; the height of the first peak is greater than or equal to the first height threshold, and the occurrence time of the first peak corresponds to the time when the sound generated at the time of atrial contraction reaches the earphone; the height of the second peak is greater than or equal to the second height threshold and less than the first height threshold, and the occurrence time of the first peak corresponds to the time when the sound generated at the time of ventricular contraction (i.e. atrial diastole) reaches the earphone.

[0017] In the present implementation, since the at least one peak in the first noise reduction signal can include a peak corresponding to the sound generated during atrial contraction and can also include a peak corresponding to the sound generated during atrial diastole, the peak corresponding to the sound generated during atrial contraction is higher than the peak corresponding to the sound generated during atrial diastole, that is, the occurrence time of the first peak in the noise reduction signal corresponds to the time when the sound generated during atrial contraction reaches the earpiece, and the occurrence time of the second peak in the noise reduction signal corresponds to the time when the sound generated during ventricular contraction (i.e., atrial diastole) reaches the earpiece.

[0018] Since there can be a sound generated during atrial contraction in the current heartbeat cycle corresponding to the first peak in one noise reduction signal, and a sound generated during atrial diastole in the previous heartbeat cycle corresponding to the first peak in another noise reduction signal, that is, the first peaks in the first noise reduction signal and the second noise reduction signal can correspond to different heartbeat cycles, in the present solution, the time of the heartbeat sound in the same heartbeat cycle to the first earpiece and the second earpiece needs to be compared to determine the wearing position of the first earpiece and / or the second earpiece. If the first order and the second order are consistent, it can be proved that the first noise reduction signal and the second noise reduction signal correspond to the same heartbeat cycle, thereby facilitating to improve the accuracy of the generated detection result.

[0019] In a possible implementation of the first aspect, the first sound signal, the second sound signal, the third sound signal, and the fourth sound signal are collected in a target time period, and the value range of the target time period is greater than or equal to the length of one heartbeat cycle and less than or equal to the length of two heartbeat cycles. As an example, the value range of the target time period can be 1 second to 2.5 seconds, for example, the value of the target time period is 1.2 seconds, 1.5 seconds, 2 seconds, 2.4 seconds, or other values, and the like, which are not exhaustively listed here.

[0020] In the present implementation, the greater the value of the target time period, the longer the time spent in the subsequent signal processing process, and the smaller the value of the target time period, the sound signal in a complete heartbeat cycle can not be collected. The value range of the target time period is determined to be 1 second to 2.5 seconds, which can ensure that the complete sound signal is collected and avoid wasting computer resources.

[0021] In a possible implementation of the first aspect, the execution device can process the first sound signal and the second sound signal before performing noise reduction processing on the first sound signal by using the second sound signal, and the signal intensity of the processed first sound signal and the second sound signal is consistent. The execution device can process the third sound signal and the fourth sound signal before performing noise reduction processing on the third sound signal by using the fourth sound signal, and the signal intensity of the processed third sound signal and the fourth sound signal is consistent.

[0022] In the implementation, the signal strength of the sound signal collected by the microphone located on the outer side of the earpiece can be greater than the signal strength of the sound signal collected by the microphone located on the inner side of the earpiece. The two sound signals are processed so that the signal strengths of the processed sound signals are consistent, thereby avoiding the influence of the different signal strengths on the noise reduction process, and improving the performance of the noise reduction process, and further obtaining more accurate detection results.

[0023] In a possible implementation of the first aspect, the method further includes: determining, by the execution device, first wearing information corresponding to the first earpiece according to the first sound signal and the second sound signal, the first wearing information indicating a wearing tightness state of the first earpiece; and / or determining second wearing information corresponding to the second earpiece according to the third sound signal and the fourth sound signal, the second wearing information indicating a wearing tightness state of the second earpiece, wherein the wearing tightness state of the first earpiece includes that the first earpiece is in a tight state and that the first earpiece is in a loose state.

[0024] In the implementation, the noise can enter the ear canal through the gap between the earpiece and the ear. Therefore, the noise signal in the surrounding environment is included in the first sound signal and the second sound signal. If the first earpiece is in a tight state, the noise signal entering the ear canal is less, and the difference between the first sound signal and the second sound signal is greater. If the first earpiece is in a loose state, the noise signal entering the ear canal is more, and the difference between the first sound signal and the second sound signal is less. Based on the foregoing principle, the wearing tightness state of the earpiece can be determined. In the scheme, not only can it be determined whether each earpiece is worn on the left ear or the right ear, but also the wearing tightness state of the earpiece can be determined, that is, more wearing information can be obtained automatically, which is beneficial to providing more personalized services for users and improving the user stickiness of the scheme.

[0025] In the second aspect, the embodiment of the present application provides a sound signal processing method, which can be applied to the field of intelligent wearable devices. The earphone includes an earpiece, and the earpiece is configured with a first microphone and a second microphone. The first microphone and an audio output port of the earpiece are located on the same side of the earpiece, and the second microphone is located on the opposite side of the first microphone. The method includes: in the case that the earphone is worn, an execution device acquires a first sound signal and a second sound signal. The first sound signal is obtained through the first microphone, and the second sound signal is obtained through the second microphone. The execution device performs noise reduction processing on the first sound signal according to the second sound signal to obtain a target noise reduction signal. The heartbeat frequency of a user is determined according to the target noise reduction signal.

[0026] In the present implementation, since the first microphone and the audio output port of the earphone are located on the same side of the earphone, the second microphone and the first microphone are located on different sides of the earphone, and the sound generated by the user's heart beat can be transmitted to the target earphone, the first sound signal includes not only the sound signal generated by the external environment but also the heart sound signal generated by the heart beat, and the second sound signal includes the sound signal generated by the external environment; therefore, the target noise reduction signal can include the clear heart sound signal generated by the heart beat, and the heart beat frequency of the user can be determined according to the target noise reduction signal; since the target noise reduction signal includes the clear heart sound signal, the accuracy of the generated heart beat frequency can be improved.

[0027] In a possible implementation of the second aspect, the execution device determines the heart beat frequency of the user according to the target noise reduction signal, which can include: the execution device acquires the number of first wave crests in the target noise reduction signal, and determines the heart beat frequency of the user according to the length of the first time period; wherein the first wave crest refers to a wave crest in the target noise reduction signal with a height greater than or equal to a first height threshold, the occurrence time of the first wave crest corresponds to the time when the sound signal generated by the atrial contraction is transmitted to the target earphone, that is, the number of first wave crests in the first time period can represent the number of atrial contractions of the user in the first time period, that is, the number of first wave crests in the first time period can represent the number of heart beats in the first time period. Or,

[0028] The execution device determines the heart beat frequency of the user according to the target noise reduction signal, which can include: the execution device acquires the number of second wave crests in the target noise reduction signal, and determines the heart beat frequency of the user according to the length of the first time period; wherein the second wave crest refers to a wave crest in the target noise reduction signal with a height greater than or equal to a second height threshold and less than the first height threshold, the occurrence time of the second wave crest corresponds to the time when the sound signal generated by the ventricular contraction (i.e., atrial diastole) is transmitted to the target earphone, that is, the number of second wave crests in the first time period can represent the number of ventricular contractions of the user in the first time period, that is, the number of second wave crests in the first time period can represent the number of heart beats in the first time period. Or,

[0029] The execution device determines the heart beat frequency of the user according to the target noise reduction signal, which can include: the execution device acquires the total number of wave crests in the target noise reduction signal, and determines the heart beat frequency of the user according to the length of the first time period; wherein the plurality of wave crests in the target noise reduction signal can include wave crests corresponding to the atrial contraction of the user and wave crests corresponding to the ventricular contraction (i.e., atrial dilation) of the user, that is, the total number of all wave crests in the first time period can be regarded as twice the number of heart beats in the first time period.

[0030] In a possible implementation manner of the second aspect, the at least one peak in the target noise reduction signal includes a first peak and a second peak, a height of the first peak is greater than or equal to a first height threshold, and a height of the second peak is greater than or equal to a second height threshold and less than the first height threshold. The method further includes: performing the device to obtain a first height of the target noise reduction signal at the first peak and a second reference height; obtaining a second height of the target noise reduction signal at the second peak; and determining, according to the first height, the first reference height and the second height, the cardiac state information, the cardiac state information including the atrial beat strength information and the ventricular beat strength information of the user. The first height is used to reflect the current strength of the atrial contraction of the user, the first reference height represents the strength of the atrial contraction of the user in a resting state, the second height is used to reflect the current strength of the ventricular contraction (i.e., atrial diastole) of the user, and the second reference height represents the strength of the atrial contraction of the user in the resting state.

[0031] In the embodiments of the present application, the atrial beat strength information and the ventricular beat strength information of the user can also be obtained according to the target noise reduction signal, that is, the cardiac health status of the user can be more comprehensively monitored.

[0032] In a possible implementation manner of the second aspect, the heartbeat frequency of the user is used to indicate the cardiac state information of the user and / or the sleep state of the user.

[0033] In the embodiments of the present application, the cardiac state information of the user and / or the sleep state of the user can be obtained according to the heartbeat frequency of the user, so that more personalized services can be provided for the user based on the foregoing information, and the user stickiness of the present solution can be further improved.

[0034] In a third aspect, an embodiment of the present application provides a sound signal processing apparatus, which can be applied in the field of smart wearable devices. The earphone comprises a first earpiece and a second earpiece. The first earpiece is configured with a first microphone and a second microphone. The first microphone is located at a first side of the first earpiece, and the second microphone is located at a second side of the first earpiece. The second earpiece is configured with a third microphone and a fourth microphone. The third microphone is located at a first side of the second earpiece, and the fourth microphone is located at a second side of the second earpiece. The second side is different from the first side, and the first side is provided with an audio output port of the earpiece. The sound signal processing apparatus comprises: an acquisition module, configured to acquire a first sound signal, a second sound signal, a third sound signal and a fourth sound signal when it is detected that the earphone is worn, wherein the first sound signal is obtained through the first microphone, the second sound signal is obtained through the second microphone, the third sound signal is obtained through the third microphone, and the fourth sound signal is obtained through the fourth microphone; a noise reduction module, configured to perform noise reduction processing on the first sound signal according to the second sound signal to obtain a first noise reduction signal; the noise reduction module is further configured to perform noise reduction processing on the third sound signal according to the fourth sound signal to obtain a second noise reduction signal; and a determination module, configured to determine a detection result according to the first noise reduction signal and the second noise reduction signal, wherein the detection result is used to indicate that the first earpiece is worn on a left ear or a right ear, and / or the detection result is used to indicate that the second earpiece is worn on the left ear or the right ear.

[0035] The sound signal processing apparatus provided by the third aspect of the embodiments of the present application can also perform the steps performed by the apparatus in each possible implementation manner of the first aspect. For the specific implementation steps of the third aspect of the embodiments of the present application and the various possible implementation manners of the third aspect, and the beneficial effects brought by each possible implementation manner, reference can be made to the description in the various possible implementation manners of the first aspect, which will not be repeated here.

[0036] In a fourth aspect, an embodiment of the present application provides a sound signal processing apparatus, which can be applied in the field of smart wearable devices. The earphone comprises an earpiece. The earpiece is configured with a first microphone and a second microphone. The first microphone and an audio output port of the earpiece are located at the same side of the earpiece, and the second microphone is located at a side different from the first microphone. The sound signal processing apparatus comprises: an acquisition module, configured to acquire a first sound signal and a second sound signal when the earphone is worn, wherein the first sound signal is obtained through the first microphone, and the second sound signal is obtained through the second microphone; a noise reduction module, configured to perform noise reduction processing on the first sound signal according to the second sound signal to obtain a target noise reduction signal; and a determination module, configured to determine a heart rate of a user according to the target noise reduction signal.

[0037] The processing apparatus of the sound signal provided by the fourth aspect of the embodiments of the present application can also perform the steps performed by the device in each possible implementation manner of the second aspect. For the specific implementation steps of the fourth aspect of the embodiments of the present application and the various possible implementation manners of the fourth aspect, and the beneficial effects brought by each possible implementation manner, reference can be made to the description of the various possible implementation manners in the second aspect, which will not be repeated here.

[0038] In the fifth aspect, the embodiments of the present application provide an execution device, which can include a processor, the processor and a memory are coupled, and the memory stores program instructions. When the program instructions stored in the memory are executed by the processor, the sound signal processing method of the first aspect or the second aspect is implemented.

[0039] In the sixth aspect, the embodiments of the present application provide a computer readable storage medium, and the computer readable storage medium stores program codes. When the program codes are run on a computer, the computer executes the sound signal processing method of the first aspect or the second aspect.

[0040] In the seventh aspect, the embodiments of the present application provide a computer program product, which includes program codes. When the program codes are run on a computer, the computer executes the sound signal processing method of the first aspect or the second aspect.

[0041] In the tenth aspect, the embodiments of the present application provide a chip system, which includes a processor for implementing the functions involved in the above aspects, such as sending or processing the data and / or information involved in the above methods. In a possible design, the chip system further includes a memory, and the memory is used to save the necessary program instructions and data of the server or the communication device. The chip system can be composed of a chip, or can include a chip and other discrete devices. BRIEF DESCRIPTION OF DRAWINGS

[0042] Figure 1a An application scenario diagram of the sound signal processing method provided by the embodiments of the present application;

[0043] Figure 1b An application scenario diagram of the sound signal processing method provided by the embodiments of the present application;

[0044] Figure 1c A flowchart of the sound signal processing method provided by the embodiments of the present application;

[0045] Figure 2a A principle diagram of the sound signal processing method provided by the embodiments of the present application;

[0046] Figure 2bA flowchart of a processing method of a sound signal provided by an embodiment of the present application;

[0047] Figure 3 A schematic diagram of a position of a microphone in a processing method of a sound signal provided by an embodiment of the present application;

[0048] Figure 4 A schematic diagram of an anti-phase signal of a second sound signal in a processing method of a sound signal provided by an embodiment of the present application;

[0049] Figure 5 A schematic diagram of a first noise reduction signal in a processing method of a sound signal provided by an embodiment of the present application;

[0050] Figure 6 A schematic diagram of a first peak and a second peak in a processing method of a sound signal provided by an embodiment of the present application;

[0051] Figure 7 A schematic diagram of a noise reduction signal in a processing method of a sound signal provided by an embodiment of the present application;

[0052] Figure 8 A schematic diagram of a principle of determining a wearing tightness state of a first earpiece in a processing method of a sound signal provided by an embodiment of the present application;

[0053] Figure 9 A flowchart of determining a wearing tightness state of a first earpiece in a processing method of a sound signal provided by an embodiment of the present application;

[0054] Figure 10 A flowchart of a processing method of a sound signal provided by an embodiment of the present application;

[0055] Figure 11 A structural schematic diagram of a processing apparatus of a sound signal provided by an embodiment of the present application;

[0056] Figure 12 A structural schematic diagram of a processing apparatus of a sound signal provided by an embodiment of the present application;

[0057] Figure 13 A structural schematic diagram of an execution device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0058] The terms "first", "second", and the like in the description and in the claims of the present application and above-described drawings are used to distinguish similar objects and are not necessarily used to describe a specific sequential or chronological order. It should be understood that the terms so used are interchangeable under appropriate circumstances and are merely employed for the purpose of distinguishing one object from another. Moreover, the terms "comprising" and "including" and any variations thereof are intended to cover a non-exclusive inclusion, such that processes, methods, systems, articles, or apparatuses that comprise, include, or are otherwise including a list of elements are not required to only those elements but can include other elements not expressly listed or inherent to such processes, methods, systems, articles, or apparatuses.

[0059] Embodiments of the present application are described below with reference to the accompanying drawings. Those skilled in the art can know that with the development of technology and the emergence of new scenarios, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0060] The present application can be applied to various application scenarios of earphones, and an earphone includes two earpieces, which can be optionally symmetrical in shape. The aforementioned earphones include but are not limited to in-ear earphones, semi-in-ear earphones, over-ear earphones, around-ear earphones, or other types of earphones, and the like. The application scenarios of the embodiments of the present application are exemplified below.

[0061] Application scenario one: watching a movie

[0062] In some implementations of the present application, as an example, when a user wears an earphone to watch a movie, the sound played in the earphone can be a stereo sound effect, for example, a train passing from left to right in the picture played by the movie. The sound effect is played cooperatively through the two earpieces of the earphone to create the sound of the train passing from left to right. If the two earpieces of the earphone are worn in reverse by the user, a mismatch between the picture and the hearing will occur, resulting in confusion between hearing and vision.

[0063] Application scenario two: playing a game

[0064] In some implementations of the present application, as an example, please refer to Figure 1a , Figure 1a An application scenario diagram is provided for the processing method of the sound signal of the embodiments of the present application. When a user wears an earphone to play a game, the sound played in the earphone can be a stereo sound effect, for example, a shooting game in the diagram. When a non-player character (NPC) in the game appears around the user, the orientation of the NPC relative to the user can be simulated through the two earpieces of the earphone to enhance the immersion of the user. If the two earpieces of the earphone are worn in reverse by the user, confusion between hearing and vision will occur.

[0065] Application scenario three: hearing assistance

[0066] In some embodiments of the present application, as an example, please refer to Figure 1b , Figure 1b An application scenario of the processing method of the sound signal provided by the embodiments of the present application is shown in the following figure. As shown in the upper figure of the following figure, Figure 1b When the user wears the earphone and walks on the road, when the vehicle located at the left side of the user in the background sound emits the horn sound, the earphone can emit the warning sound in the corresponding direction of the user to remind the direction of the vehicle emitting the horn sound, as shown in the upper figure of the following figure, Figure 1b When the user wears the earphone and walks on the road, when the vehicle located at the right side of the user in the background sound emits the horn sound, the earphone can emit the warning sound in the corresponding direction of the user to remind the direction of the vehicle emitting the horn sound, as shown in the lower figure of the following figure; in this scenario, it is necessary to determine which ear of the user each earpiece is worn on. In other application scenarios, when the user wears the earphone and talks with others, the earphone can also remind the user of the orientation of the speaker by emitting the prompt sound, and the like, which is not exhaustively listed here.

[0067] Application scenario four: navigation

[0068] In some embodiments of the present application, as an example, in the process of the navigation application playing the navigation route to the user through the earphone, if the audio to be played is “turn right”, that is, the direction information is carried in the audio to be played, then “turn right” can be played only in the earpiece determined as the right channel to guide the user more intuitively through the form of audio, and if the two earpieces of the earphone are worn reversely by the user, it will cause the hearing to be inconsistent with the played audio content, resulting in more confusion of the user.

[0069] Application scenario five: user authentication

[0070] In some embodiments of the present application, as an example, after the ear canal features and / or auricle features of the left ear and the right ear of the user are collected, the ear canal and / or auricle features of the user can be used for user identification, and in this scenario, it is necessary to determine which ear of the user each earpiece is worn on, so as to determine whether the earpiece collects the ear canal features and / or auricle features of the left ear or the ear canal features and / or auricle features of the right ear, and the like.

[0071] It should be noted that the above enumeration of the application scenarios of the embodiments of the present application by means of various figures is only for the convenience of understanding the present solution, and the application scenarios of the embodiments of the present application are not exhaustively enumerated one by one.

[0072] In order to be able to detect whether each earpiece is worn on the left ear or the right ear of the user based on the actual wearing position of the user in the above various application scenarios, an embodiment of the present application provides a sound signal processing method for automatically detecting the specific wearing condition of each earpiece based on sound signals collected by multiple microphones. The earphone includes a first earpiece and a second earpiece. The first earpiece is provided with a first microphone and a second microphone. The first microphone is located at a first side of the first earpiece, and the second microphone is located at a second side of the first earpiece. The second earpiece is provided with a third microphone and a fourth microphone. The third microphone is located at a first side of the second earpiece, and the fourth microphone is located at a second side of the second earpiece. The audio output port of the earpiece exists at the first side, and the second side is different from the first side. It should be noted that the first side of the first earpiece and the second side of the first earpiece respectively represent two position regions of the first earpiece, rather than specifically two position points of the first earpiece. Correspondingly, the first side of the second earpiece and the second side of the second earpiece respectively represent two position regions of the second earpiece, rather than specifically two position points of the second earpiece. That is, the specific position point of the first microphone in the first earpiece and the specific position point of the third microphone in the second earpiece can be consistent or inconsistent, as long as the position region of the first microphone in the first earpiece and the position region of the third microphone in the second earpiece are the same. Correspondingly, the specific position point of the second microphone in the first earpiece and the specific position point of the fourth microphone in the second earpiece can be consistent or inconsistent, as long as the position region of the second microphone in the first earpiece and the position region of the fourth microphone in the second earpiece are the same.

[0073] Specifically, please refer to Figure 1c , Figure 1c A flowchart of the sound signal processing method provided by the embodiment of the present application is shown. A1, in the case where the earphone is worn, a first sound signal, a second sound signal, a third sound signal and a fourth sound signal are obtained. The first sound signal is obtained by the first microphone, the second sound signal is obtained by the second microphone, the third sound signal is obtained by the third microphone, and the fourth sound signal is obtained by the fourth microphone. A2, the first sound signal is processed by noise reduction according to the second sound signal to obtain a first noise reduction signal. A3, the third sound signal is processed by noise reduction according to the fourth sound signal to obtain a second noise reduction signal. A4, a detection result is determined according to the first noise reduction signal and the second noise reduction signal. The detection result is used to indicate that the first earpiece is worn on the left ear or the right ear, and / or the detection result is used to indicate that the second earpiece is worn on the left ear or the right ear.

[0074] In the embodiments of the present application, since the first microphone and the third microphone are located on the first side of the earpiece, and the second microphone and the fourth microphone are located on the second side of the earpiece, the sound generated by the user's heart beat can be transmitted to the first earpiece and the second earpiece in the form of bone conduction, respectively. Therefore, the first sound signal and the third sound signal include not only the sound signal generated by the external environment, but also the heart sound signal generated by the heart beat. The second sound signal and the fourth sound signal include the sound signal generated by the external environment. The first noise reduction signal and the second noise reduction signal can both include the clear heart sound signal generated by the heart beat, and the detection result can be determined according to the first noise reduction signal and the second noise reduction signal. The detection result indicates the actual wearing position of the first earpiece and / or the second earpiece. According to the foregoing scheme, it can be seen that the category of each earpiece is not pre-set in the present application, but the earpiece is determined to be worn on the left ear or the right ear based on the actual wearing position of the user after the user wears the earpiece. That is, the user can randomly wear the earphone, which makes the user operation simpler and is conducive to improving the user viscosity of the present scheme. In addition, the first noise reduction signal and the second noise reduction signal both include the clear heart sound signal, which is conducive to improving the accuracy of the generated detection result.

[0075] In combination with the foregoing description, the specific implementation process of the sound signal processing method provided by the embodiments of the present application will be described below. In order to further understand the principles of the embodiments of the present application, please refer to Figure 2a , Figure 2a The principle diagram of the sound signal processing method provided by the embodiments of the present application is shown in FIG. 1. The blood in the user's body flows unidirectionally under the influence of atrial contraction and / or diastole. During the blood flow, the vibration wave signal generated by the blood flowing through the ear is relatively high. The vibration wave signal generated by the blood in the ear can be conducted to the ear canal through the tympanic membrane. The foregoing vibration wave signal can be collected by the microphone (i.e., the first microphone and the third microphone) in the ear canal in the form of a sound signal.

[0076] As shown in the figure, since the heart is located at the center of the human body, the length of the arterial path from the heart to the left and right ears is different. Therefore, the heart sound in the same heart beat cycle propagates to the left ear from the heart in a shorter path than to the right ear. That is, the time when the heart sound in the same heart beat cycle reaches the earpiece worn on the left ear is earlier than the time when the heart sound reaches the earpiece worn on the right ear. The first noise reduction signal and the second noise reduction signal can both include the clear heart sound signal generated by the heart beat. The first noise reduction signal can reflect the time when the heart sound reaches the first earpiece, and the second noise reduction signal can reflect the time when the heart sound reaches the second earpiece. Therefore, the first earpiece can be determined to be worn on the left ear or the right ear according to the first noise reduction signal and the second noise reduction signal. Correspondingly, the second earpiece can also be determined to be worn on the left ear or the right ear. It should be understood that Figure 2aThe schematic diagram in the figure is only for the convenience of understanding the scheme and is not used to limit the scheme.

[0077] Specifically, please refer to Figure 2b , Figure 2b A flowchart of a processing method of a sound signal provided by an embodiment of the present application. The processing method of the sound signal provided by the embodiment of the present application can include:

[0078] 201. In a case where it is detected that the earphone is worn, the device obtains a first sound signal, a second sound signal, a third sound signal and a fourth sound signal. The first sound signal is obtained through a first microphone, the second sound signal is obtained through a second microphone, the third sound signal is obtained through a third microphone, and the fourth sound signal is obtained through a fourth microphone. The first microphone is located at a first side of a first earpiece, the second microphone is located at a second side of the first earpiece, the third microphone is located at a first side of a second earpiece, and the fourth microphone is located at a second side of the second earpiece. The first side is provided with an audio output port of the earpiece, and the second side is different from the first side.

[0079] In the embodiment of the present application, the device can start to detect the actual wearing positions of the two earpieces after it is determined that the two earpieces of the earphone are both worn, that is, to trigger the start of obtaining the first sound signal, the second sound signal, the third sound signal and the fourth sound signal. It should be noted that in the process of collecting the first sound signal, the second sound signal, the third sound signal and the fourth sound signal by the earphone,

[0080] The earphone includes a first earpiece and a second earpiece. The first earpiece is configured with a first microphone and a second microphone, and the second earpiece is configured with a third microphone and a fourth microphone. The first sound signal is obtained through the first microphone, the second sound signal is obtained through the second microphone, the third sound signal is obtained through the third microphone on the second earpiece, and the fourth sound signal is obtained through the fourth microphone on the second earpiece.

[0081] The first microphone is located at a first side of the first earpiece, the second microphone is located at a second side of the first earpiece, the third microphone is located at a first side of the second earpiece, and the fourth microphone is located at a second side of the second earpiece. The first side is provided with an audio output port of the earpiece, and the second side is different from the first side. Further, the first microphone, the second microphone, the third microphone and the fourth microphone can each include one or more microphones.

[0082] For a more intuitive understanding of the scheme, please refer to Figure 3 , Figure 3 A schematic diagram of the position of a microphone in the processing method of a sound signal provided by an embodiment of the present application. As shown in Figure 3 , the first side is provided with an audio output port of the earpiece, and the second side is different from the first side, that is, for collecting noise signals in the surrounding environment. It should be understood that,Figure 3 The examples in the specification are only for the convenience of understanding the scheme and do not limit the scheme.

[0083] It should be noted that the execution device can be a headset, or a target electronic device in communication connection with the headset. For example, the execution device can be a mobile phone, a tablet, a smart wearable device, a virtual reality (VR) device, an on-board computer in a vehicle, or other electronic devices that can be in communication connection with the headset, without being exhaustive.

[0084] The acquisition process of the first sound signal, the second sound signal, the third sound signal and the fourth sound signal. If the execution device is a headset, step 201 can include: the execution device acquires the first sound signal through the first microphone, acquires the second sound signal through the second microphone, acquires the third sound signal through the third microphone, and acquires the fourth sound signal through the fourth microphone when it is detected that the headset is worn.

[0085] The first sound signal, the second sound signal, the third sound signal and the fourth sound signal can have the same starting acquisition time, and the first sound signal, the second sound signal, the third sound signal and the fourth sound signal can have the same stopping acquisition time.

[0086] The first sound signal, the second sound signal, the third sound signal and the fourth sound signal are acquired within a target time period, and the target time period can have a value range greater than or equal to one heartbeat cycle of the heart. Alternatively, the target time period can have a value range greater than or equal to one heartbeat cycle of the heart and less than or equal to two heartbeat cycles of the heart. For example, the target time period can have a value range of 1 second to 2.5 seconds, such as 1.2 seconds, 1.5 seconds, 2 seconds, 2.4 seconds or other values, without being exhaustive.

[0087] Further, the headset performs sound signal acquisition operation through the first microphone, the second microphone, the third microphone and the fourth microphone according to a preset sampling frequency. The sampling frequency of the sound signal refers to the number of sound signal samples per second. The preset sampling frequency can be greater than or equal to 100 Hz. For example, the preset sampling frequency can be 500 Hz, 2000 Hz, 5000 Hz, 8000 Hz, 1.1025 kHz or other values, and the specific value of the preset sampling frequency can be flexibly set in combination with the actual product form, without being limited.

[0088] In the embodiments of the present application, the greater the value of the target time period, the longer the time spent in the subsequent signal processing process. The smaller the value of the target time period, the less likely it is to collect sound signals within a complete heartbeat cycle. The value range of the target time period is determined to be 1 second to 2.5 seconds, which can ensure that complete sound signals are collected and avoid wasting computer resources.

[0089] If the execution device is a target electronic device in communication connection with the earphone, step 201 can include: the execution device can send a first instruction to the earphone when detecting that the earphone is worn, the first instruction being used to instruct the earphone to collect the first sound signal, the second sound signal, the third sound signal and the fourth sound signal; the execution device receives the first sound signal, the second sound signal, the third sound signal and the fourth sound signal sent by the earphone. The collection process of the first sound signal, the second sound signal, the third sound signal and the fourth sound signal is not repeated here.

[0090] The detection process of whether both earpieces of the earphone are worn. When any one or more of the following scenarios occurs, the execution device can trigger to detect whether both earpieces are worn: when the earpiece is picked up, each time the earpiece is taken out of the box, after the earpiece is taken off the ear, or other scenarios. The execution device can also detect whether each earpiece of the earphone is worn.

[0091] Further, if each earpiece is detected by the earphone, when any one of the above scenarios occurs, the earphone will start to detect whether each earpiece is worn; if each earpiece is detected by the target electronic device in communication connection with the earphone, when any one of the above scenarios occurs, the earphone can send indication information to the aforementioned electronic device, the indication information being used to inform the electronic device to start detecting whether the earpiece is worn.

[0092] Specifically, when the execution device determines that any one or more of the following conditions exists, it is considered that the earphone is detected to be worn: detecting that the earpiece is placed on the ear, detecting that the screen of the electronic device in communication connection with the earphone is turned on or in other ways, and the like, which are not exhaustively listed here.

[0093] More specifically, the principle of detecting whether the earpiece is placed on the ear by the execution device. In one implementation, one or more sensors can be configured on each earpiece, and each earpiece can detect whether it is worn through the aforementioned sensors. The aforementioned sensors can specifically be any one of the following sensors: a voltage sensor, a resistance sensor, a light-sensitive sensor, or other types of sensors, and the like. The aforementioned sensors can specifically be used to collect any one of the following information: a pressure value, a contact area, a signal strength, and the like. What type of sensor is used to check whether each earpiece is worn can be determined in combination with the actual situation, and an exhaustive list is not provided here.

[0094] In another implementation, the detection signal can be emitted by the speaker in the earpiece, and the feedback signal corresponding to the detection signal can be collected by the microphone in the earpiece (i.e., the microphone in the same-side earpiece). When the earpiece is not worn, the space corresponding to the earpiece is open, and the microphone in the earpiece can collect less feedback signal (denoted as "signal A" for convenience of description). When the earpiece is worn by the user, the cavity of the earpiece and the ear canal (and / or the pinna) of the user form a closed cavity, the detection signal is reflected multiple times by the ear, and the microphone in the earpiece can collect a large amount of feedback signal (denoted as "signal B" for convenience of description). The first characteristic information of signal A and the first characteristic information of signal B are obviously different, and thus the first characteristic information of signal A and the first characteristic information of signal B can be compared to determine whether the earpiece is worn by the user, and the like. It should be noted that other ways can also be used to detect whether the earpiece is placed on the ear, and all implementation manners of detecting whether the earpiece is placed on the ear are not enumerated in the embodiments of the present application.

[0095] If the execution device detects that the earpiece has not been worn, the detection of whether the earpiece is worn can be continued. Alternatively, the detection of whether the earpiece is worn can be stopped when the number of the foregoing detection reaches a preset number, which can be 1, 2, 3, or another value, or the like; or the detection of whether the earpiece is worn can be stopped when the duration of the foregoing detection reaches a preset duration, which can be 2 minutes, 3 minutes, 5 minutes, or another duration, or the like; or the detection of whether the earpiece is worn can be continued until the user is detected to wear the earpiece.

[0096] It should be noted that if each earpiece is detected by the earphone, and the first earpiece and / or the second earpiece is detected by the target electronic device in communication connection with the earphone to be worn on the left ear or the right ear, the earphone can send indication information to the target electronic device after detecting that each earpiece is worn, and the foregoing indication information is used to inform the target electronic device that both earpieces are worn, so as to trigger the target electronic device to start detecting whether the first earpiece and / or the second earpiece is worn on the left ear or the right ear.

[0097] Correspondingly, if each earpiece is detected by the target electronic device in communication connection with the earphone, and the first earpiece and / or the second earpiece is detected by the earphone to be worn on the left ear or the right ear, the target electronic device can send indication information to the earphone after detecting that each earpiece is worn, and the foregoing indication information is used to inform the earphone that both earpieces are worn, so as to trigger the earphone to start detecting whether the first earpiece and / or the second earpiece is worn on the left ear or the right ear.

[0098] 202. The execution device performs noise reduction processing on the first sound signal according to the second sound signal to obtain a first noise reduction signal.

[0099] In the embodiments of the present application, the first sound signal collected by the first microphone can include not only the sound signal generated by the heart beat, but also the sound signal in the surrounding environment, while the second microphone is not located in the ear canal and cannot collect the sound signal generated by the heart beat, and the second sound signal can include the sound signal in the surrounding environment. After obtaining the second sound signal and the first sound signal, the execution device can perform noise reduction processing on the first sound signal according to the second sound signal to obtain the first noise reduction signal, that is, to weaken the sound signal in the surrounding environment included in the first sound signal to leave only the sound signal generated by the heart beat as much as possible.

[0100] Specifically, in an implementation manner, the execution device can first perform alignment operation on the first sound signal and the second sound signal in the time domain, then obtain the inverse signal of the second sound signal, superimpose the inverse signal of the second sound signal and the first sound signal at the same time domain position to obtain the first noise reduction signal.

[0101] For example, the first sound signal and the second sound signal can be arrays, and the value of each number in the array corresponding to the first sound signal represents the intensity of the first sound signal at a time point, and correspondingly, the value of each number in the array corresponding to the second sound signal represents the intensity of the second sound signal at a time point.

[0102] The phase difference between the inverse signal of the second sound signal and the second sound signal is 180 degrees, that is, after superimposing the inverse signal of the second sound signal and the second sound signal, there will be no sound.

[0103] For a more intuitive understanding of the present scheme, please refer to Figure 4 , Figure 4 A schematic diagram of the inverse signal of the second sound signal in the sound signal processing method provided by the embodiments of the present application is shown in Figure 4 , which shows the original sound signal, the inverse signal of the original sound signal, and the signal obtained by superimposing the inverse signal and the original signal. It should be understood that Figure 4 The examples in the above are only for the convenience of understanding the concept of inverse signal, and are not used to limit the present scheme.

[0104] In another implementation manner, the execution device can first perform alignment operation on the first sound signal and the second sound signal in the time domain, then subtract the first sound signal and the second sound signal at the same time domain position to obtain the first noise reduction signal.

[0105] For a more intuitive understanding of the present scheme, please refer to Figure 5 , Figure 5 A schematic diagram of the first noise reduction signal in the sound signal processing method provided by the embodiments of the present application is shown in Figure 5The first sound signal and the second sound signal, and the first noise-reduced signal obtained by performing noise reduction processing on the first sound signal using the second sound signal are shown in FIG. 1. As shown in the figure, the first noise-reduced signal can more clearly reflect the sound signal generated by the heart beating. It should be understood that, Figure 5 The examples in the foregoing merely serve to facilitate understanding of the present scheme, and are not used to limit the present scheme.

[0106] Optionally, before performing noise reduction processing on the first sound signal using the second sound signal, in an implementation manner, the execution device can input the first sound signal into an amplifier to amplify the first sound signal through the amplifier. The signal strength of the amplified first sound signal is consistent with the signal strength of the second sound signal.

[0107] In another implementation manner, the execution device can perform normalization processing on both the first sound signal and the second sound signal. The value of the array corresponding to the normalized first sound signal can be limited to 0 to 1, and the value of the array corresponding to the normalized second sound signal can be limited to 0 to 1, that is, the signal strength of the normalized first sound signal and the normalized second sound signal is consistent.

[0108] It should be noted that, in order to make the signal strength of the processed first sound signal and the processed second sound signal consistent, the execution device can also amplify / reduce the value range of the array corresponding to the first sound signal and / or the second sound signal to other area ranges, or the execution device can also process the first sound signal and the second sound signal in other manners, as long as the signal strength of the processed first sound signal and the processed second sound signal is consistent, and the specific implementation manner is not limited herein.

[0109] In addition, the execution device can first adjust the signal strength of the first sound signal and the second sound signal to be consistent, and then align the first sound signal and the second sound signal in the time domain; or the execution device can first align the first sound signal and the second sound signal in the time domain, and then adjust the signal strength of the first sound signal and the second sound signal to be consistent.

[0110] In the embodiments of the present application, since the second sound signal is collected by the microphone located outside the earpiece, the signal strength of the second sound signal can be greater than the signal strength of the first sound signal. The second sound signal is processed on the first sound signal, so that the signal strength of the processed first sound signal and the processed second sound signal is consistent, so as to avoid the influence of the difference between the signal strength of the first sound signal and the signal strength of the second sound signal on the noise reduction process, which is beneficial to improve the performance of the noise reduction process, and further beneficial to obtain more accurate detection results.

[0111] Optionally, the performing device can further perform a filtering operation on the first sound signal and the second sound signal by using a filter before performing the noise reduction processing on the first sound signal according to the second sound signal, wherein the filtered first sound signal is in a preset frequency band, and the filtered second sound signal is in the preset frequency band.

[0112] The filtering operation aims to filter out noise caused by breathing on the sound source, or filter out high-frequency noise in the surrounding environment carried by the first sound signal and the second sound signal.

[0113] For example, the preset frequency band can be 0-12 Hz, 0-15 Hz, 0-25 Hz, 0-40 Hz, 0.3-12 Hz, 0.3-15 Hz, 0.3-25 Hz, 0.3-40 Hz, 0.5-12 Hz, 0.5-15 Hz, 0.5-40 Hz, or other ranges, which are not limited herein.

[0114] It should be noted that the execution order of the filtering operation can be before or after any one of the two steps of "aligning in time domain" and "adjusting the signal intensity of the first sound signal and the second sound signal to be consistent".

[0115] In the embodiments of the present application, generally, the frequency of the sound signal generated by the heart beating is not too high, and the frequency of the sound signal generated by the heart beating is not too low. The filtering operation performed on the first sound signal and the second sound signal is beneficial to filter out noise in the useless frequency band, so as to obtain a more accurate first noise signal, and further obtain a more accurate detection result.

[0116] 203. The performing device performs noise reduction processing on the third sound signal according to the fourth sound signal to obtain a second noise reduction signal.

[0117] In the embodiments of the present application, the specific implementation manner of step 203 is similar to that of step 202, and the difference is that the "first sound signal" in step 202 is replaced by the "third sound signal" in step 203, and the "second sound signal" in step 202 is replaced by the "fourth sound signal" in step 203.

[0118] It should be noted that the execution order of steps 202 and 203 is not limited in the embodiments of the present application. Step 202 can be executed first, and then step 203 can be executed. Alternatively, step 203 can be executed first, and then step 202 can be executed. Alternatively, steps 202 and 203 can be executed simultaneously.

[0119] 204、The execution device acquires the occurrence time of the first peak in the first noise reduction signal and the occurrence time of the second peak in the first noise reduction signal, the height of the first peak being greater than or equal to the first height threshold, and the height of the second peak being greater than or equal to the second height threshold and less than the first height threshold.

[0120] In some embodiments of the present application, since the first noise reduction signal can include multiple peaks, the execution device can acquire the occurrence time of at least one first peak and the occurrence time of at least one second peak in the first noise reduction signal.

[0121] The measurement unit of the occurrence time of the first peak and the occurrence time of the second peak can be sampling points, seconds, milliseconds, or other time measurement units, etc. For example, the occurrence time of the first peak is at 0.15-0.4 seconds; as another example, the occurrence time of the second peak is at 200-240 sampling points, etc. The specific time measurement unit can be determined flexibly in combination with the actual application scenario, which is not limited here.

[0122] The first peak refers to a peak in the first noise reduction signal with a height greater than or equal to the first height threshold, and the occurrence time of the first peak corresponds to the time when the sound signal generated by atrial contraction is transmitted to the first earpiece. The second peak refers to a peak in the first noise reduction signal with a height greater than or equal to the second height threshold and less than the first height threshold, and the occurrence time of the second peak corresponds to the time when the sound signal generated by ventricular contraction (i.e., atrial diastole) is transmitted to the first earpiece.

[0123] Further, the values of the first height threshold and the second height threshold can be determined in combination with the actual product form. The factors considered by the first height threshold can include the height of the peak corresponding to atrial contraction in the first noise reduction signal obtained by testing different people, the height of the peak corresponding to atrial contraction in the first noise reduction signal obtained by testing in different environments, the height of the peak corresponding to atrial contraction in the first noise reduction signal obtained by testing in different motion states, the model of the earphone, or other factors, etc. This is not an exhaustive list.

[0124] Correspondingly, the factors considered by the first height threshold can include the height of the peak corresponding to ventricular contraction in the first noise reduction signal obtained by testing different people, the height of the peak corresponding to ventricular contraction in the first noise reduction signal obtained by testing in different environments, the height of the peak corresponding to ventricular contraction in the first noise reduction signal obtained by testing in different motion states, the model of the earphone, or other factors, etc. This is not an exhaustive list.

[0125] Still further, the values of the first height threshold can be the same or different in different models of earphones, and the values of the second height threshold can also be the same or different.

[0126] It should be noted that, since the collection time length of the first sound signal and the second sound signal can be greater than 1 heartbeat period, that is, the first noise reduction signal can reflect sound signals generated in more than 1 heartbeat period, multiple first wave crests and / or multiple second wave crests can appear in the first noise reduction signal.

[0127] For a more intuitive understanding of the scheme, please refer to Figure 6 , Figure 6 A schematic diagram of the first wave crest and the second wave crest in the sound signal processing method provided by the embodiments of the present application is shown in the figure. As shown in the figure, the height of the first wave crest is greater than the height of the second wave crest. It should be understood that, Figure 6 The examples in the figure are only for the convenience of understanding the concept of the first wave crest and the second wave crest, and are not used to limit the scheme.

[0128] 205. The execution device acquires the occurrence time of the first wave crest in the second noise reduction signal and the occurrence time of the second wave crest in the second noise reduction signal.

[0129] In some embodiments of the present application, the execution device can also acquire the occurrence time of the first wave crest and the occurrence time of the second wave crest in the second noise reduction signal. The specific implementation manner of step 205 is similar to that of step 204, and the difference lies in that the "first noise reduction signal" in step 204 is replaced by the "second noise reduction signal" in step 205, the "first wave crest" in step 204 is replaced by the "first wave crest" in step 205, and the "second wave crest" in step 204 is replaced by the "second wave crest" in step 205.

[0130] It should be noted that the embodiments of the present application do not limit the execution order of steps 204 and 205. Step 204 can be executed first, and then step 205 can be executed. Alternatively, step 205 can be executed first, and then step 204 can be executed. Alternatively, steps 204 and 205 can be executed simultaneously.

[0131] 206. The execution device judges whether the first order and the second order are consistent. If the judgment result is yes, step 207 is entered. If the judgment result is no, step 201 is re-entered.

[0132] In some embodiments of the present application, the execution device can judge whether the first order and the second order are consistent. If the judgment result is yes, step 207 is entered. If the judgment result is no, step 201 is re-entered, that is, new first sound signal, second sound signal, third sound signal and fourth sound signal are acquired.

[0133] The first order indicates the occurrence order between the first wave crest in the first noise reduction signal and the second wave crest in the first noise reduction signal, and the second order indicates the occurrence order between the first wave crest in the second noise reduction signal and the second wave crest in the second noise reduction signal.

[0134] Further, if the first order indicates that the first peak in the first noise reduction signal appears earlier than the second peak in the first noise reduction signal, and the second order indicates that the first peak in the second noise reduction signal appears earlier than the second peak in the second noise reduction signal, it means that the appearance orders indicated by the first order and the second order are consistent. Or,

[0135] If the first order indicates that the first peak in the first noise reduction signal appears later than the second peak in the first noise reduction signal, and the second order indicates that the first peak in the second noise reduction signal appears later than the second peak in the second noise reduction signal, it means that the appearance orders indicated by the first order and the second order are consistent.

[0136] 207、The execution device generates a detection result according to the first appearance time and the second appearance time, and the detection result is used to indicate that the first earpiece is worn on the left ear or the right ear, and / or the detection result is used to indicate that the second earpiece is worn on the left ear or the right ear.

[0137] In the embodiments of the present application, steps 204 to 206 are optional steps. If steps 204 to 206 are not performed, after step 203 is performed, step 207 can be directly entered. If steps 204 to 206 are performed, in the case where the first order and the second order are consistent, the execution device can generate a detection result according to the first appearance time and the second appearance time, and the detection result is used to indicate that the first earpiece is worn on the left ear or the right ear, and / or the detection result is used to indicate that the second earpiece is worn on the left ear or the right ear. The first appearance time includes a time corresponding to at least one peak in the first noise reduction signal, and the second appearance time includes a second appearance time corresponding to at least one peak in the second noise reduction signal.

[0138] In the embodiments of the present application, since the at least one peak in the first noise reduction signal can include a peak corresponding to a sound produced during atrial contraction, and can also include a peak corresponding to a sound produced during atrial diastole, the peak corresponding to the sound produced during atrial contraction is higher than the peak corresponding to the sound produced during atrial diastole, that is, the appearance time of the first peak in the noise reduction signal corresponds to the time when the sound produced during atrial contraction reaches the earpiece, and the appearance time of the second peak in the noise reduction signal corresponds to the time when the sound produced during ventricular contraction (i.e. atrial diastole) reaches the earpiece.

[0139] Since there can be a sound produced during atrial contraction in the current heartbeat cycle corresponding to the first peak in one noise reduction signal, and a sound produced during atrial diastole in the previous heartbeat cycle corresponding to the first peak in another noise reduction signal, that is, the first peak in the first noise reduction signal and the first peak in the second noise reduction signal can correspond to different heartbeat cycles, and in the above Figure 2aIt can be seen from the principle diagram shown that the wearing position of the first earpiece and / or the second earpiece needs to be determined by comparing the time of the heartbeat sound in the same heartbeat cycle to the first earpiece and the second earpiece. If the first sequence and the second sequence are consistent, it can be proved that the first noise reduction signal and the second noise reduction signal correspond to the same heartbeat cycle, thereby facilitating the improvement of the accuracy of the generated detection result.

[0140] For the determination process of the detection result. The execution device can determine the detection result according to the first occurrence time corresponding to at least one peak in the first noise reduction signal, and the second occurrence time corresponding to at least one peak in the second noise reduction signal. For the specific implementation manner of the execution device obtaining the occurrence time corresponding to each peak in the first noise reduction signal (or the second noise reduction signal), please refer to the description in the above step 204, which will not be repeated here.

[0141] For a more intuitive understanding of the present scheme, please refer to Figure 7 , Figure 7 A schematic diagram of a noise reduction signal in a sound signal processing method provided by an embodiment of the present application is shown as Figure 7 The first noise reduction signal and the second noise reduction signal obtained are placed together, and it can be seen that the occurrence time of the first peak in the first noise reduction signal is earlier. Therefore, the wearing position of the first earpiece corresponding to the first noise reduction signal is determined to be the left ear, and the wearing position of the second earpiece corresponding to the second noise reduction signal is determined to be the right ear. It should be understood that Figure 7 The examples in the above are only for the convenience of understanding the present scheme, and are not used to limit the present scheme.

[0142] In the embodiment of the present application, the occurrence time of at least one peak in the first noise reduction signal can at least include the time when the sound signal generated by the atrial contraction of the user is transmitted to the first earpiece, and the occurrence time of at least one peak in the second noise reduction signal can at least include the time when the sound signal generated by the atrial contraction of the user is transmitted to the first earpiece. Therefore, based on the occurrence time of at least one peak in the first noise reduction signal and the second noise reduction signal, the detection result can be determined. A simple determination manner of the detection result is provided, which is easy to operate.

[0143] Specifically, in one implementation, the first occurrence time includes an occurrence time of a first peak in the first noise reduction signal, and the second occurrence time includes an occurrence time of a first peak in the second noise reduction signal. Step 207 can include: if the executing device determines that the occurrence time of the first peak in the first noise reduction signal is earlier than the occurrence time of the first peak in the second noise reduction signal, the generated detection result indicates that the first earpiece is worn on the left ear and the second earpiece is worn on the right ear; if the executing device determines that the occurrence time of the first peak in the first noise reduction signal is later than the occurrence time of the first peak in the second noise reduction signal, the generated detection result indicates that the first earpiece is worn on the right ear and the second earpiece is worn on the left ear.

[0144] In another implementation, the first occurrence time includes occurrence times of one or more first peaks in the first noise reduction signal, and the second occurrence time includes occurrence times of one or more first peaks in the second noise reduction signal. Step 207 can include: if the executing device determines that the occurrence times of the first peaks in the first noise reduction signal are earlier than the occurrence times of the first peaks in the second noise reduction signal, it is determined that the first earpiece is worn on the left ear and the second earpiece is worn on the right ear; if the executing device determines that the first occurrence time and the second occurrence time, and determines that the occurrence times of the first peaks in the first noise reduction signal are later than the occurrence times of the first peaks in the second noise reduction signal, it is determined that the first earpiece is worn on the right ear and the second earpiece is worn on the left ear.

[0145] Further, since the first noise reduction signal and the second noise reduction signal can each include one or more first peaks, "the occurrence time of the first peak in the first noise reduction signal is earlier than the occurrence time of the first peak in the second noise reduction signal" can refer to the occurrence time of the Nth first peak in the first noise reduction signal is earlier than the occurrence time of the Nth first peak in the second noise reduction signal, N is an integer greater than or equal to 1.

[0146] In another implementation, the first occurrence time includes occurrence times of one or more second peaks in the first noise reduction signal, and the second occurrence time includes occurrence times of one or more second peaks in the second noise reduction signal. Step 207 can include: if the executing device determines that the occurrence times of the second peaks in the first noise reduction signal are earlier than the occurrence times of the second peaks in the first noise reduction signal, it is determined that the first earpiece is worn on the left ear and the second earpiece is worn on the right ear; if the executing device determines that the occurrence times of the second peaks in the first noise reduction signal are later than the occurrence times of the second peaks in the first noise reduction signal, it is determined that the first earpiece is worn on the right ear and the second earpiece is worn on the left ear.

[0147] Further, since one or more second peaks can be included in the first noise reduction signal and the second noise reduction signal, the "the occurrence time of the second peak in the first noise reduction signal is earlier than the occurrence time of the second peak in the second noise reduction signal" can refer to the occurrence time of an Nth second peak in the first noise reduction signal is earlier than the occurrence time of the Nth second peak in the second noise reduction signal, where N is an integer greater than or equal to 1.

[0148] In the embodiments of the present application, various implementation manners of determining the detection result according to the occurrence time of at least one peak in the noise reduction signal are provided, and the implementation flexibility of the present scheme is improved.

[0149] 208、The execution device determines first wearing information corresponding to the first earpiece according to the first sound signal and the second sound signal, and the first wearing information indicates a wearing tightness state of the first earpiece.

[0150] In some embodiments of the present application, the execution device can also determine first wearing information corresponding to the first earpiece according to the first sound signal and the second sound signal, and the first wearing information indicates a wearing tightness state of the first earpiece, where the wearing tightness state of the first earpiece can include that the first earpiece is in a tight wearing state and the first earpiece is in a loose wearing state.

[0151] For a more intuitive understanding of the present scheme, please refer to Figure 8 , Figure 8 A principle diagram for determining the wearing tightness state of the first earpiece in the processing method of the sound signal provided in the embodiments of the present application is shown in the figure. Since noise can enter the ear canal through the gap between the earpiece and the ear, the first sound signal and the second sound signal both include noise signals in the surrounding environment. If the first earpiece is in a tight wearing state, the noise signal entering the ear canal will be less, and the difference between the first sound signal and the second sound signal will be greater. If the first earpiece is in a loose wearing state, the noise signal entering the ear canal will be more, and the difference between the first sound signal and the second sound signal will be less. It should be understood that Figure 8 The examples in the above are only for facilitating the understanding of the present scheme, and are not used to limit the present scheme.

[0152] Specifically, in one case, the execution device can determine the first wearing information corresponding to the first earpiece according to the difference between the intensity of the first sound signal and the intensity of the second sound signal.

[0153] More specifically, in an implementation, the execution device can align the first sound signal and the second sound signal in time domain, and then subtract the first sound signal from the second sound signal to obtain a processed signal, the processed signal including a plurality of values, each of the plurality of values representing an intensity difference between the second sound signal and the first sound signal at each time point. The execution device generates a first value according to the plurality of values, and determines that the first earpiece is in a tight state if the first value is less than or equal to a first preset threshold, or determines that the first earpiece is in a loose state if the first value is greater than the first preset threshold.

[0154] The first value is obtained by statistical processing of the plurality of values, and can be an average value, a maximum value, a minimum value, any one of the plurality of values, or other value modes.

[0155] For a more intuitive understanding of the scheme, please refer to Figure 9 , Figure 9 A flowchart for determining the wearing state of the first earpiece in the sound signal processing method provided by the embodiments of the present application is shown in the figure. B1, when detecting that the earphone is worn, the execution device obtains a first sound signal and a second sound signal, the first sound signal being obtained by a first microphone, and the second sound signal being obtained by a second microphone. The first microphone is located at a first side of the first earpiece, and the second microphone is located at a second side of the first earpiece. The first side has an audio output port of the earpiece, and the second side is different from the first side. B2, the execution device subtracts the first sound signal from the second sound signal to obtain a processed signal, the processed signal including a plurality of values, each of the plurality of values representing an intensity difference between the second sound signal and the first sound signal at each time point. B3, the execution device determines whether a first value is less than or equal to a first preset threshold, and if the determination result is yes, it goes to step B4, or if the determination result is no, it goes to B5. B4, the execution device determines that the first earpiece is in a tight state. B5, the execution device determines that the first earpiece is in a loose state. It should be understood that Figure 9 The examples in the above description are only for the convenience of understanding the scheme, and are not used to limit the scheme.

[0156] More specifically, in an implementation, the execution device can align the first sound signal and the second sound signal in time domain, and then subtract the first sound signal from the second sound signal to obtain a processed signal, the processed signal including a plurality of values, each of the plurality of values representing an intensity difference between the second sound signal and the first sound signal at each time point. The execution device generates a first value according to the plurality of values, and determines that the first earpiece is in a tight state if the first value is less than or equal to a first preset threshold, or determines that the first earpiece is in a loose state if the first value is greater than the first preset threshold.

[0157] The second value is obtained by statistical processing of the plurality of values, and can be an average value, a maximum value, a minimum value, any one of the plurality of values, or other value modes.

[0158] In another case, the execution device can calculate the similarity between the first sound signal and the second sound signal, and if the similarity between the first sound signal and the second sound signal is less than or equal to a third preset threshold, it is determined that the first earphone is in a tight state; if the similarity between the first sound signal and the second sound signal is greater than the third preset threshold, it is determined that the first earphone is in a loose state.

[0159] The similarity between the first sound signal and the second sound signal can be obtained by calculating the cosine similarity, Euclidean distance, Mahalanobis distance, or other methods between the first sound signal and the second sound signal, and this is not an exhaustive list.

[0160] 209、The execution device determines second wearing information corresponding to the second earphone according to the third sound signal and the fourth sound signal, and the second wearing information indicates the wearing tightness state of the second earphone.

[0161] In the embodiments of the present application, the specific implementation manner of step 206 is similar to that of step 205, and can be directly understood, and thus will not be described here.

[0162] In the embodiments of the present application, not only can it be automatically detected whether each earphone is worn on the left ear or the right ear, but also the wearing tightness state of the earphone can be detected, that is, more wearing information can be automatically obtained, which is conducive to providing more personalized services to users and improving the user stickiness of the present scheme.

[0163] In the embodiment of the present application, since the first microphone and the third microphone are located on the first side of the earpiece, the second microphone and the fourth microphone are located on the second side of the earpiece, the second side is different from the first side, the sound generated by the user's heart beating can be transmitted to the first earpiece and the second earpiece respectively, then the first sound signal and the third sound signal include the heart sound signal generated by the heart beating in addition to the sound signal generated by the external environment, the second sound signal and the fourth sound signal include the sound signal generated by the external environment; then the first noise reduction signal and the second noise reduction signal can both include the clear heart sound signal generated by the heart beating, and then the detection result can be determined according to the first noise reduction signal and the second noise reduction signal, the detection result indicates the actual wearing position of the first earpiece and / or the second earpiece. As can be seen from the foregoing scheme, in the present application, the category of each earpiece is not pre-set, but after the user wears the earpiece, the actual wearing position of the user is determined to determine whether the earpiece is worn on the left ear or the right ear, that is, the user can randomly wear the earphone, so that the user operation is simpler, which is beneficial to improve the user viscosity of the present scheme; in addition, the first noise reduction signal and the second noise reduction signal both include the clear heart sound signal, which is beneficial to improve the accuracy of the generated detection result.

[0164] The embodiment of the present application also provides another sound signal processing method, please refer to Figure 10 , Figure 10 A flowchart of the sound signal processing method provided by the embodiment of the present application, the sound signal processing method provided by the embodiment of the present application can include:

[0165] 1001, when the user is in a resting state, the execution device obtains a fifth sound signal and a sixth sound signal, the fifth sound signal is obtained through a first microphone, the sixth sound signal is obtained through a second microphone, the first microphone and the audio output port of the target earpiece are located on the same side of the target earpiece, and the second microphone is located on the opposite side of the target earpiece from the first microphone.

[0166] 1002, the execution device performs noise reduction processing on the fifth sound signal according to the sixth sound signal to obtain a third noise reduction signal.

[0167] In the embodiment of the present application, in the case that the user wears the earphone for the first time, the earphone is connected to other electronic devices for the first time or other scenarios, the earphone can remind the user to be in a resting state to collect at least one type of parameter corresponding to the user's heart beating in the resting state.

[0168] In the embodiment of the present application, in the case that the user wears the earphone for the first time, the earphone is connected to other electronic devices for the first time or other scenarios, the earphone can remind the user to be in a resting state to collect at least one type of parameter corresponding to the user's heart beating in the resting state.

[0169] For details on the implementation of steps 1001 and 1002, and the positions of the first and second microphones on the earpiece, please refer to [link / reference needed]. Figure 2b The difference between steps 201 and 202 in the corresponding embodiments is that, firstly, in Figure 2b In the corresponding embodiment, the fifth and sixth sound signals were collected within the target time period. Figure 10 In the corresponding embodiment, the fifth and sixth sound signals are collected within the first time period. Optionally, the length of the first time period is greater than or equal to the length of the target time period. For example, the first time period can be 5 seconds, 10 seconds, 15 seconds or other lengths, etc., which are not exhaustive here.

[0170] Second, Figure 2b In the corresponding embodiment, "first sound signal" is replaced with Figure 10 The "fifth sound signal" in the corresponding embodiment will Figure 2b In the corresponding embodiment, "second sound signal" is replaced with Figure 10 The "sixth sound signal" in the corresponding embodiment will Figure 2b In the corresponding embodiment, "first noise reduction signal" is replaced with Figure 10 The specific implementation of steps 1001 and 1002 will not be elaborated here, as the "third noise reduction signal" in the corresponding embodiment is not described in detail.

[0171] 1003. The execution device generates target parameters based on the third noise reduction signal. The target parameters include at least one type of parameter corresponding to the user's heartbeat when the user is in a resting state.

[0172] In this embodiment of the application, the execution device can generate target parameters based on the third noise reduction signal. The target parameters include at least one type of parameter corresponding to the user's heartbeat. For example, the aforementioned at least one type of parameter may include heart rate, heart rate intensity, or other types of parameters. The specific types of parameters to be collected need to be flexibly set in combination with the actual product form, and will not be listed exhaustively here.

[0173] Regarding the process of obtaining the reference heart rate: The device acquires the number of occurrences of at least one peak in the third noise-reduced signal. Based on the occurrence time of at least one peak in the third noise-reduced signal, the user's reference heart rate in the resting state can be determined.

[0174] Specifically, in an implementation, the execution device can obtain the number of first peaks in the third noise-reduced signal, and determine the reference heartbeat frequency of the user in the resting state according to the length of the first time period; wherein the first peak refers to a peak in the third noise-reduced signal with a height greater than or equal to a first height threshold, the occurrence time of the first peak corresponds to the time when the sound signal generated by atrial contraction is transmitted to the target earphone, that is, the number of first peaks in the first time period can represent the number of atrial contractions of the user in the first time period, that is, the number of first peaks in the first time period can represent the number of heartbeats in the first time period, and thus the reference heartbeat frequency of the user in the resting state can be obtained.

[0175] In another implementation, the execution device can obtain the number of second peaks in the third noise-reduced signal, and determine the reference heartbeat frequency of the user in the resting state according to the length of the first time period; wherein the second peak refers to a peak in the third noise-reduced signal with a height greater than or equal to a second height threshold and less than the first height threshold, the occurrence time of the second peak corresponds to the time when the sound signal generated by ventricular contraction (i.e. atrial diastole) is transmitted to the target earphone, that is, the number of second peaks in the first time period can represent the number of ventricular contractions (i.e. atrial diastole) of the user in the first time period, that is, the number of second peaks in the first time period can represent the number of heartbeats in the first time period, and thus the reference heartbeat frequency of the user in the resting state can be obtained.

[0176] In another implementation, the execution device can obtain the total number of peaks in the third noise-reduced signal, and determine the reference heartbeat frequency of the user in the resting state according to the length of the first time period; wherein the plurality of peaks in the third noise-reduced signal can include peaks corresponding to atrial contraction of the user and peaks corresponding to ventricular contraction (i.e. atrial dilation) of the user, that is, the total number of all peaks in the first time period can be considered as twice the number of heartbeats in the first time period, and thus the reference heartbeat frequency of the user in the resting state can be obtained.

[0177] It should be noted that the execution device can also obtain the reference heartbeat frequency of the user in the resting state in other ways according to the third noise-reduced signal, which is not exhaustively listed here.

[0178] For the heartbeat intensity obtaining process, the execution device can determine the heartbeat intensity of the user in the resting state according to the height of at least one peak in the third noise-reduced signal.

[0179] Specifically, in an implementation, the execution device can obtain the height of each first peak in the third noise-reduced signal, and determine a first reference height of the first peak corresponding to the user in the resting state according to the heights of the plurality of first peaks in the third noise-reduced signal, the first reference height of the first peak corresponding to the user in the resting state representing the intensity of atrial contraction of the user in the resting state.

[0180] The first peak refers to a peak in the third noise-reduced signal with a height greater than or equal to a first height threshold, and the first peak is caused by the sound signal generated by the atrial contraction of the user being transmitted to the target earpiece. The greater the intensity of the atrial contraction of the user, the greater the sound signal generated by the atrial contraction of the user, and the higher the height of the first peak. Therefore, the height of the first peak can represent the intensity of the atrial contraction of the user.

[0181] Further, the first reference height of the first peak corresponding to the user in the resting state can be an average, a median, a maximum, a minimum, or other types of numerical values of the heights of the plurality of first peaks in the third noise-reduced signal. Which numerical value to use can be determined in combination with the actual application scenario.

[0182] In another implementation, the execution device can obtain the height of each second peak in the third noise-reduced signal, and determine a second reference height of the second peak corresponding to the user in the resting state according to the heights of the plurality of second peaks in the third noise-reduced signal, the second reference height of the second peak corresponding to the user in the resting state representing the intensity of ventricular contraction of the user in the resting state.

[0183] The second peak refers to a peak in the third noise-reduced signal with a height greater than or equal to a second height threshold and less than the first height threshold, and the second peak is caused by the sound signal generated by the ventricular contraction of the user being transmitted to the target earpiece. The greater the intensity of the ventricular contraction of the user, the greater the sound signal generated by the ventricular contraction of the user, and the higher the height of the second peak. Therefore, the height of the second peak can represent the intensity of the ventricular contraction of the user.

[0184] Further, the second reference height of the second peak corresponding to the user in the resting state can be an average, a median, a maximum, a minimum, or other types of numerical values of the heights of the plurality of second peaks in the third noise-reduced signal. Which numerical value to use can be determined in combination with the actual application scenario.

[0185] In another implementation, the executing device can obtain a first reference height of the first wave crest corresponding to the user in the resting state, and a second reference height of the second wave crest corresponding to the user in the resting state; wherein the first reference height of the first wave crest corresponding to the user in the resting state represents the intensity of atrial systole of the user in the resting state, and the second reference height of the second wave crest corresponding to the user in the resting state represents the intensity of ventricular systole of the user in the resting state.

[0186] It should be noted that, whether the executing device in steps 1001 to 1003 is the earphone or other electronic device in communication connection with the earphone, after the target parameters are generated, the earphone stores the aforementioned target parameters, and the target parameters include at least one type of parameter corresponding to the heartbeat of the user in the resting state.

[0187] 1004, when the earphone is worn, the executing device obtains a first sound signal and a second sound signal, the first sound signal is obtained through the first microphone, and the second sound signal is obtained through the second microphone, the first microphone and the audio output port of the target earpiece are located on the same side of the target earpiece, and the second microphone is located on the opposite side of the target earpiece from the first microphone.

[0188] 1005, the executing device performs noise reduction processing on the first sound signal according to the second sound signal to obtain a target noise reduction signal.

[0189] 1006, the executing device obtains a first height of the target noise reduction signal at the first wave crest and a second height of the target noise reduction signal at the second wave crest according to the target noise reduction signal.

[0190] 1007, the executing device determines the heartbeat frequency of the user according to the target noise reduction signal.

[0191] In the embodiments of the present application, the specific implementation manners of steps 1004 to 1007 can refer to the descriptions in steps 1001 to 1003, and the “fifth sound signal” in the corresponding embodiments of steps 1001 to 1003 is replaced by the “first sound signal” in the corresponding embodiments of steps 1004 to 1007, the “sixth sound signal” in the corresponding embodiments of steps 1001 to 1003 is replaced by the “second sound signal” in the corresponding embodiments of steps 1004 to 1007, the “third noise reduction signal” in the corresponding embodiments of steps 1004 to 1007 is replaced by the “target noise reduction signal” in the corresponding embodiments of steps 1004 to 1007, the “first reference height” in the corresponding embodiments of steps 1004 to 1007 is replaced by the “first height” in the corresponding embodiments of steps 1004 to 1007, and the “second reference height” in the corresponding embodiments of steps 1004 to 1007 is replaced by the “second height” in the corresponding embodiments of steps 1004 to 1007, which will not be repeated here.

[0192] It should be noted that the execution order between steps 1001 to 1003 and steps 1004 to 1007 is not limited in the embodiments of the present application, and steps 1004 to 1007 can be executed multiple times after steps 1001 to 1003 are executed once or multiple times.

[0193] 1008, the execution device determines the heart state information of the user and / or the sleep state of the user.

[0194] In the embodiments of the present application, step 1006 is an optional step. If step 1006 is not executed, in one implementation manner, step 1008 can include that the execution device can compare the current heart rate and the reference heart rate after obtaining the reference heart rate of the user in the resting state through step 1003 and the current heart rate of the user through step 1007, to determine the heart state information of the user, and the aforementioned heart state information of the user includes the current heart rate of the user.

[0195] Optionally, when the execution device determines that the heart rate of the user is too fast or the heart rate of the user is too slow, the execution device can output suggestion information to the user, which can be a rest instruction or a relaxation instruction when the heart rate is too fast, or a health state warning when the heart rate is too slow.

[0196] Further optionally, after outputting the aforementioned suggestion information, the execution device can also collect feedback information input by the user in response to the aforementioned suggestion information, to determine whether the determined heart rate of the user can truly reflect the real performance level of the current physical quality of the user. The aforementioned steps can be repeatedly executed multiple times to gradually enhance the learning and monitoring of the heart rate changes of the user, thereby improving the accuracy of the determination of the heart rate.

[0197] In another implementation, step 1008 can include that the execution device can determine the sleep-in state of the user according to the heart rate of the user and the reference frequency of the user in the resting state.

[0198] Specifically, when the user wears the earphone in the sleep, the execution device can take the first time period as a sliding window, and execute step 1004, step 1005 and step 1007 multiple times to constantly update the current heart rate of the user, so as to obtain the current heart rate of the user at multiple time points. The execution device can compare the multiple current heart rates with the reference heart rate to determine the sleep-in state of the user.

[0199] The sleep-in state of the user can include multiple states in the process from the wake to the sleep of the user, for example, the sleep-in state of the user can include the wake state, the sleep-in state, the sleep state or other types of sleep-in states, and the like. The execution device can control the earphone to perform any one or more of the following operations according to the sleep-in state of the user: reducing the volume, turning off or other operations.

[0200] More specifically, when the current heart rate of the user is less than or equal to the reference heart rate, it can be determined that the user is entering the sleep state, and then the volume of the earphone playing the audio stream can be reduced.

[0201] Optionally, after a period of time, if no new interaction operation input by the user is obtained, the new current heart rate is less than or equal to the reference heart rate, and the new current heart rate is less than or equal to the old current heart rate, it can be determined that the user has entered the sleep state, and then the earphone can be controlled to turn off.

[0202] In the embodiments of the present application, the heart state information of the user and / or the sleep-in state of the user can be obtained according to the heart rate of the user, so that more personalized services can be provided to the user based on the foregoing information, and the user stickiness of the present scheme can be further improved.

[0203] In another implementation, if step 1006 is executed, step 1008 can include that the execution device can determine the heart state information of the user according to the first height and / or the second height, the heart state information being used to indicate the atrial and / or ventricular beating strength information of the user.

[0204] The first height is used to reflect the current strength of the atrial contraction of the user, the first reference height represents the strength of the atrial contraction of the user in the resting state, the second height is used to reflect the current strength of the ventricular contraction (i.e. atrial diastole) of the user, and the second reference height represents the strength of the atrial contraction of the user in the resting state.

[0205] Specifically, in an implementation, the execution device can compare the first height with the first reference height. If the first height is greater than the first reference height and the difference between the first height and the first reference height is greater than a preset threshold, it can be determined that the atrial beat intensity of the user is too large. If the first height is less than the first reference height and the difference between the first height and the first reference height is greater than the preset threshold, it can be determined that the atrial beat intensity of the user is too small. If the difference between the first height and the first reference height is less than the preset threshold, it can be determined that the atrial beat intensity of the user is normal.

[0206] In another implementation, the execution device can compare the second height with the second reference height. If the second height is greater than the second reference height and the difference between the second height and the second reference height is greater than a preset threshold, it can be determined that the ventricular beat intensity of the user is too large. If the second height is less than the second reference height and the difference between the second height and the second reference height is greater than the preset threshold, it can be determined that the ventricular beat intensity of the user is too small. If the difference between the second height and the second reference height is less than the preset threshold, it can be determined that the ventricular beat intensity of the user is normal.

[0207] In another implementation, the execution device can determine whether the atrial beat intensity of the user is normal by comparing the first height with the first reference height. The execution device can also determine whether the ventricular beat intensity of the user is normal by comparing the second height with the second reference height.

[0208] Optionally, the execution device can output prompt information when it determines that the atrial beat intensity of the user is too large or too small. The prompt information is used to inform the user that the current atrial beat intensity is too large or too small. Correspondingly, the execution device can output prompt information when it determines that the ventricular beat intensity of the user is too large or too small. The prompt information is used to inform the user that the current ventricular beat intensity is too large or too small.

[0209] In the embodiments of the present application, the atrial beat intensity information and the ventricular beat intensity information of the user can also be obtained according to the target noise reduction signal, that is, the heart health status of the user can be monitored more comprehensively.

[0210] In the embodiments of the present application, the first microphone and the audio output port of the earpiece are located on the same side of the earpiece, and the second microphone is located on the second side which is different from the first side. The sound generated by the heart beat of the user can be transmitted to the target earpiece. Therefore, the first sound signal includes not only the sound signal generated by the external environment but also the heart sound signal generated by the heart beat. The second sound signal includes the sound signal generated by the external environment. The target noise reduction signal can include the clear heart sound signal generated by the heart beat, and the heart rate of the user can be determined according to the target noise reduction signal. Since the target noise reduction signal includes the clear heart sound signal, the accuracy of the generated heart rate can be improved.

[0211] In Figures 1c to 10 Based on the corresponding embodiments, in order to better implement the above-mentioned scheme of the embodiments of the present application, the related equipment for implementing the above-mentioned scheme is also provided below. For details, please refer to Figure 11 , Figure 11 A structural schematic diagram of a sound signal processing device provided for the embodiments of the present application, the earphone includes a first earpiece and a second earpiece, the first earpiece is configured with a first microphone and a second microphone, the first microphone is located at a first side of the first earpiece, and the second microphone is located at a second side of the first earpiece, the second earpiece is configured with a third microphone and a fourth microphone, the third microphone is located at a first side of the second earpiece, and the fourth microphone is located at a second side of the second earpiece, the audio output port of the earpiece exists at the first side, and the second side is different from the first side. The sound signal processing device 1100 includes: an acquisition module 1101, configured to acquire a first sound signal, a second sound signal, a third sound signal and a fourth sound signal when it is detected that the earphone is worn, wherein the first sound signal is obtained through the first microphone, the second sound signal is obtained through the second microphone, the third sound signal is obtained through the third microphone, and the fourth sound signal is obtained through the fourth microphone; a noise reduction module 1102, configured to perform noise reduction processing on the first sound signal according to the second sound signal to obtain a first noise reduction signal; the noise reduction module 1102 is also configured to perform noise reduction processing on the third sound signal according to the fourth sound signal to obtain a second noise reduction signal; a determination module 1103, configured to determine a detection result according to the first noise reduction signal and the second noise reduction signal, wherein the detection result is used to indicate that the first earpiece is worn on the left ear or the right ear, and / or the detection result is used to indicate that the second earpiece is worn on the left ear or the right ear.

[0212] In a possible design, the determination module 1103 is specifically configured to: acquire a first occurrence time corresponding to at least one peak in the first noise reduction signal, and acquire a second occurrence time corresponding to at least one peak in the second noise reduction signal; and determine the detection result according to the first occurrence time and the second occurrence time.

[0213] In a possible design, the determination module 1103 is specifically configured to: in a case where the first order and the second order are consistent, determine the detection result according to the first occurrence time and the second occurrence time; wherein the first order represents an occurrence order of a first peak in the first noise reduction signal and a second peak in the first noise reduction signal, the second order represents an occurrence order of the first peak in the second noise reduction signal and the second peak in the second noise reduction signal, the height of the first peak is greater than or equal to a first height threshold, and the height of the second peak is greater than or equal to a second height threshold and less than the first height threshold.

[0214] In a possible design, the first sound signal, the second sound signal, the third sound signal, and the fourth sound signal are acquired in a target time period, and a length of the target time period is greater than or equal to a length of one heartbeat cycle and less than or equal to a length of two heartbeat cycles.

[0215] In a possible design, the determining module 1103 is further configured to determine, according to the first sound signal and the second sound signal, first wearing information corresponding to the first earpiece, the first wearing information indicating a wearing tightness state of the first earpiece; and / or, the determining module 1103 is further configured to determine, according to the third sound signal and the fourth sound signal, second wearing information corresponding to the second earpiece, the second wearing information indicating a wearing tightness state of the second earpiece.

[0216] It should be noted that the information interaction and execution process between the modules / units in the sound signal processing apparatus 1100 are the same as those of the method provided in the present application. Figures 1c to 9 The corresponding method embodiments are based on the same concept, and specific content can be referred to the description of the method embodiments provided in the foregoing of the present application, which will not be repeated here.

[0217] The present application also provides a sound signal processing apparatus, please refer to Figure 12 , Figure 12 A structure diagram of a sound signal processing apparatus provided by the present application is shown, the earphone includes an earpiece, the earpiece is configured with a first microphone and a second microphone, the first microphone and an audio output port of the earpiece are located on the same side of the earpiece, and the second microphone and the first microphone are located on different sides of the earpiece. The sound signal processing apparatus 1200 includes: an acquisition module 1201 configured to acquire a first sound signal and a second sound signal when the earphone is worn, wherein the first sound signal is obtained through the first microphone, and the second sound signal is obtained through the second microphone; a noise reduction module 1202 configured to perform noise reduction processing on the first sound signal according to the second sound signal to obtain a target noise reduction signal; and a determination module 1203 configured to determine a heartbeat frequency of a user according to the target noise reduction signal.

[0218] In a possible design, the at least one wave crest in the target noise reduction signal includes a first wave crest and a second wave crest, a height of the first wave crest is greater than or equal to a first height threshold, and a height of the second wave crest is greater than or equal to a second height threshold and less than the first height threshold; the acquisition module 1201 is further configured to acquire a first height of the target noise reduction signal at the first wave crest; the acquisition module 1201 is further configured to acquire a second height of the target noise reduction signal at the second wave crest; and the determination module 1203 is further configured to determine, according to the first height and the second height, heart state information, the heart state information including beating intensity information of an atrium of the user and beating intensity information of a ventricle of the user.

[0219] In one possible design, the user's heart rate is used to indicate the user's cardiac status and / or the user's sleep state.

[0220] It should be noted that the information interaction and execution process between the modules / units in the sound signal processing device 1200 are different from those in this application. Figure 10 The various method embodiments are based on the same concept, and the details can be found in the descriptions of the method embodiments shown above in this application, which will not be repeated here.

[0221] The following describes an execution device provided in an embodiment of this application. Please refer to [link / reference]. Figure 13 , Figure 13 This is a schematic diagram of an execution device provided in an embodiment of this application. The execution device 1300 can specifically be an earphone, a virtual reality (VR) device, a mobile phone, a tablet, a laptop, a watch, glasses, etc., and is not limited thereto. The execution device 1300 may be equipped with... Figure 10 The sound signal processing device 1000 described in the corresponding embodiment is used to implement... Figure 9 The corresponding embodiment executes the function of the device. Specifically, the execution device 1300 includes: a receiver 1301, a transmitter 1302, a processor 1303, and a memory 1304 (wherein the execution device 1300 may have one or more processors 1303). Figure 13 (Taking a processor as an example), processor 1303 may include application processor 13031 and communication processor 13032. In some embodiments of this application, receiver 1301, transmitter 1302, processor 1303 and memory 1304 may be connected via bus or other means.

[0222] Memory 1304 may include read-only memory and random access memory, and provides instructions and data to processor 1303. A portion of memory 1304 may also include non-volatile random access memory (NVRAM). Memory 1304 stores processor and operation instructions, executable modules, or data structures, or subsets thereof, or extended sets thereof, wherein the operation instructions may include various operation instructions for implementing various operations.

[0223] Processor 1303 controls the operation of the execution device. In specific applications, the various components of the execution device are coupled together through a bus system, which may include not only the data bus, but also power buses, control buses, and status signal buses. However, for clarity, all buses are referred to as the bus system in the diagram.

[0224] The method disclosed in the embodiments of the present application can be applied to the processor 1303 or implemented by the processor 1303. The processor 1303 can be an integrated circuit chip having a signal processing capability. In the implementation process, the steps of the method can be completed by hardware integrated logic circuits in the processor 1303 or by instructions in the form of software. The processor 1303 described above can be a general processor, a digital signal processor (DSP), a microprocessor or a microcontroller, and can further include an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The processor 1303 can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general processor can be a microprocessor or the processor can also be any conventional processor or the like. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as a hardware code processor for execution, or a combination of hardware and software modules in the code processor for execution. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register or other mature storage medium in the art. The storage medium is located in the storage 1304, and the processor 1303 reads the information in the storage 1304 and combines the hardware to complete the steps of the method.

[0225] The receiver 1301 can be used to receive input digital or character information, and generate signal input related to the relevant settings and function control of the execution device. The transmitter 1302 can be used to output digital or character information through the first interface; the transmitter 1302 can also be used to send instructions to the disk group through the first interface to modify the data in the disk group; the transmitter 1302 can also include a display device such as a display screen.

[0226] In the embodiments of the present application, in one case, the application processor 13031 in the processor 1303 is used to execute Figures 1c to 9 The method for processing the sound signal executed by the execution device in the corresponding embodiment. It should be noted that the specific manner in which the application processor 13031 executes the above steps is the same as that described in the embodiments of the present application Figures 1c to 9 The corresponding method embodiments are based on the same concept, and the technical effects brought by them are the same as those in the embodiments of the present application Figures 1c to 9 The corresponding method embodiments are based on the same concept, and the technical effects brought by them are the same as those in the embodiments of the present application

[0227] In one case, the application processor 13031 in the processor 1303 is configured to execute Figure 10 the method for processing a sound signal executed by the execution device in the corresponding embodiment. It should be noted that the specific manner in which the application processor 13031 executes the foregoing steps is the same as that described in the method embodiments of the present application Figure 10 The corresponding method embodiments are based on the same concept, and the technical effects brought by them are the same as those described in the method embodiments of the present application Figure 10 The corresponding method embodiments are the same, and the specific content can be referred to the description in the method embodiments of the present application, which will not be repeated here.

[0228] The present application also provides a computer program product including a program code, when the program code is run on a computer, so that the computer executes the steps executed by the execution device in the method described in the foregoing Figures 1c to 9 embodiments, or so that the computer executes the steps executed by the execution device in the method described in the foregoing Figure 10 embodiments.

[0229] The present application also provides a computer readable storage medium, which stores a program code, when the program code is run on a computer, so that the computer executes the steps executed by the execution device in the method described in the foregoing Figures 1c to 9 embodiments, or so that the computer executes the steps executed by the execution device in the method described in the foregoing Figure 10 embodiments.

[0230] The sound signal processing device and the execution device provided by the embodiments of the present application can be a chip, which includes a processing unit and a communication unit. The processing unit can be a processor, and the communication unit can be an input / output interface, a pin, a circuit, etc. The processing unit can execute computer execution instructions stored in a storage unit, so that the chip executes the sound signal processing method described in the foregoing Figures 1c to 9 embodiments, or so that the chip executes the sound signal processing method described in the foregoing Figure 10 embodiments. Alternatively, the storage unit is a storage unit in the chip, such as a register, a cache, etc. The storage unit can also be a storage unit outside the chip in the wireless access device, such as a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM), etc.

[0231] The processor mentioned in any of the above can be a general central processing unit, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the method of the first aspect.

[0232] It should be noted that the above-described apparatus embodiments are merely illustrative, and the units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, i.e., can be located in one place or distributed on multiple network units. Part or all of the modules can be selected to achieve the purpose of the embodiment according to actual needs. In addition, the connection relationship between the modules in the apparatus embodiment provided in the present application indicates that there is a communication connection between them, which can be implemented as one or more communication buses or signal lines.

[0233] Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software and necessary general hardware, and of course can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. Generally, functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure for implementing the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better embodiment. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer's floppy disk, U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk, etc., including a plurality of instructions for making a computer device (which can be a personal computer, a training device, or a network device, etc.) execute the methods described in various embodiments of the present application.

[0234] In the above embodiments, all or part can be realized by software, hardware, firmware or any combination thereof. When realized by software, it can be realized in the form of a computer program product in whole or in part.

[0235] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from one website, computer, training device or data center to another website, computer, training device or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be stored by the computer or a data storage device such as a training device, a data center, etc. integrated with one or more available media sets. The available media can be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)), etc.

Claims

1. A method of processing a sound signal, characterized by, The earphone comprises a first earpiece and a second earpiece, the first earpiece is provided with a first microphone and a second microphone, the first microphone is located at a first side of the first earpiece, the second microphone is located at a second side of the first earpiece, the second earpiece is provided with a third microphone and a fourth microphone, the third microphone is located at a first side of the second earpiece, the fourth microphone is located at a second side of the second earpiece, the first side and the second side are different, and an audio output port of the earpiece exists at the first side; The method comprises: In a case where it is detected that the earphone is worn, a first sound signal, a second sound signal, a third sound signal and a fourth sound signal are acquired, wherein the first sound signal is obtained through the first microphone, the second sound signal is obtained through the second microphone, the third sound signal is obtained through the third microphone, and the fourth sound signal is obtained through the fourth microphone; The first sound signal is subjected to noise reduction processing according to the second sound signal to obtain a first noise reduction signal, the first noise reduction signal reflects a time when heartbeat sound reaches the first earpiece; The third sound signal is subjected to noise reduction processing according to the fourth sound signal to obtain a second noise reduction signal, the second noise reduction signal reflects a time when heartbeat sound reaches the second earpiece; A detection result is determined according to the first noise reduction signal and the second noise reduction signal, wherein the detection result is used to indicate that the first earpiece is worn on a left ear or a right ear, and / or the detection result is used to indicate that the second earpiece is worn on a left ear or a right ear.

2. The method of claim 1, wherein, The determination of the detection result according to the first noise reduction signal and the second noise reduction signal comprises: A first occurrence time corresponding to at least one wave crest in the first noise reduction signal is acquired, and a second occurrence time corresponding to at least one wave crest in the second noise reduction signal is acquired; The detection result is determined according to the first occurrence time and the second occurrence time.

3. The method of claim 2, wherein, The determination of the detection result according to the first occurrence time and the second occurrence time comprises: In a case where a first sequence and a second sequence are consistent, the detection result is determined according to the first occurrence time and the second occurrence time; The first sequence represents an occurrence sequence of a first wave crest in the first noise reduction signal and a second wave crest in the first noise reduction signal, the second sequence represents an occurrence sequence of a first wave crest in the second noise reduction signal and a second wave crest in the second noise reduction signal, the height of the first wave crest is greater than or equal to a first height threshold, and the height of the second wave crest is greater than or equal to a second height threshold and less than the first height threshold.

4. The method according to any one of claims 1 to 3, characterized in that, The first sound signal, the second sound signal, the third sound signal and the fourth sound signal are acquired within a target time period, the value range of the target time period is greater than or equal to the length of one heartbeat cycle and less than or equal to the length of two heartbeat cycles.

5. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: According to the first sound signal and the second sound signal, first wearing information corresponding to the first earpiece is determined, the first wearing information indicating a wearing tightness state of the first earpiece; and / or, According to the third sound signal and the fourth sound signal, second wearing information corresponding to the second earpiece is determined, the second wearing information indicating a wearing tightness state of the second earpiece.

6. A method of processing a sound signal, characterized by, The earphone comprises an earpiece, the earpiece being configured with a first microphone and a second microphone, the first microphone and an audio output port of the earpiece being located on the same side of the earpiece, and the second microphone being located on a different side of the earpiece from the first microphone, and the method comprises: In a case where the earphone is worn, a first sound signal and a second sound signal are acquired, wherein the first sound signal is obtained by the first microphone, and the second sound signal is obtained by the second microphone; The first sound signal is subjected to noise reduction processing according to the second sound signal to obtain a target noise reduction signal, at least one wave crest in the target noise reduction signal comprising a first wave crest and a second wave crest, a height of the first wave crest being greater than or equal to a first height threshold, and a height of the second wave crest being greater than or equal to a second height threshold and less than the first height threshold; A heartbeat frequency of a user is determined according to the target noise reduction signal; When the heartbeat frequency of the user is used to indicate heart state information of the user, the determination of the heartbeat frequency of the user according to the target noise reduction signal comprises: acquiring a first height of the target noise reduction signal at the first wave crest; acquiring a second height of the target noise reduction signal at the second wave crest; and determining heart state information according to the first height and the second height, the heart state information comprising jumping intensity information of an atrium of the user and jumping intensity information of a ventricle.

7. The method of claim 6, wherein, The heartbeat frequency of the user is also used to indicate an entering-sleep state of the user.

8. A processing apparatus of a sound signal, characterized by, The earphone comprises a first earpiece and a second earpiece, the first earpiece being configured with a first microphone and a second microphone, the first microphone being located on a first side of the first earpiece, and the second microphone being located on a second side of the first earpiece, the second earpiece being configured with a third microphone and a fourth microphone, the third microphone being located on a first side of the second earpiece, and the fourth microphone being located on a second side of the second earpiece, the first side and the second side being different, and the first side having an audio output port of the earpiece; The sound signal processing device comprises: An acquisition module is configured to, in a case where the earphone is detected to be worn, acquire a first sound signal, a second sound signal, a third sound signal and a fourth sound signal, wherein the first sound signal is obtained by the first microphone, the second sound signal is obtained by the second microphone, the third sound signal is obtained by the third microphone, and the fourth sound signal is obtained by the fourth microphone; A noise reduction module is configured to subject the first sound signal to noise reduction processing according to the second sound signal to obtain a first noise reduction signal, the first noise reduction signal reflecting a time at which a heartbeat sound reaches the first earpiece. The noise reduction module is further configured to perform noise reduction processing on the third sound signal according to the fourth sound signal to obtain a second noise reduction signal, and the second noise reduction signal reflects a time when a heartbeat sound reaches the second earpiece; The determination module is configured to determine a detection result according to the first noise reduction signal and the second noise reduction signal, wherein the detection result is used to indicate that the first earpiece is worn on a left ear or a right ear, and / or the detection result is used to indicate that the second earpiece is worn on a left ear or a right ear.

9. The apparatus of claim 8, wherein, The determination module is specifically configured to: obtain a first occurrence time corresponding to at least one peak in the first noise reduction signal, and obtain a second occurrence time corresponding to at least one peak in the second noise reduction signal; determine the detection result according to the first occurrence time and the second occurrence time.

10. The apparatus of claim 9, wherein, The determination module is specifically configured to: in a case where a first sequence and a second sequence are consistent, determine the detection result according to the first occurrence time and the second occurrence time; wherein the first sequence represents an occurrence sequence of a first peak in the first noise reduction signal and a second peak in the first noise reduction signal, the second sequence represents an occurrence sequence of a first peak in the second noise reduction signal and a second peak in the second noise reduction signal, the first peak has a height greater than or equal to a first height threshold, and the second peak has a height greater than or equal to a second height threshold and less than the first height threshold.

11. The apparatus of any one of claims 8 to 10, wherein, The first sound signal, the second sound signal, the third sound signal, and the fourth sound signal are collected within a target time period, and the target time period has a length greater than or equal to 1 heartbeat cycle and less than or equal to 2 heartbeat cycles.

12. The apparatus of any one of claims 8 to 10, wherein The determination module is further configured to determine first wearing information corresponding to the first earpiece according to the first sound signal and the second sound signal, and the first wearing information indicates a wearing tightness state of the first earpiece; and / or The determination module is further configured to determine second wearing information corresponding to the second earpiece according to the third sound signal and the fourth sound signal, and the second wearing information indicates a wearing tightness state of the second earpiece.

13. A processing apparatus of a sound signal, characterized by, An earphone includes an earpiece, the earpiece is configured with a first microphone and a second microphone, the first microphone and an audio output port of the earpiece are located on the same side of the earpiece, the second microphone and the first microphone are located on different sides of the earpiece, and a sound signal processing apparatus includes: An acquisition module is configured to acquire a first sound signal and a second sound signal when the earphone is worn, wherein the first sound signal is obtained through the first microphone, and the second sound signal is obtained through the second microphone; The noise reduction module is configured to perform noise reduction processing on the first sound signal according to the second sound signal to obtain a target noise reduction signal, at least one peak in the target noise reduction signal includes a first peak and a second peak, a height of the first peak is greater than or equal to a first height threshold, and a height of the second peak is greater than or equal to a second height threshold and less than the first height threshold; The acquisition module is further configured to acquire a first height of the target noise reduction signal at the first peak; The acquisition module is further configured to acquire a second height of the target noise reduction signal at the second peak; The determination module is configured to determine a heartbeat frequency of the user according to the target noise reduction signal. When the heartbeat frequency of the user is used to indicate heart state information of the user, the determination module is specifically configured to determine heart state information according to the first height and the second height, and the heart state information includes jumping intensity information of an atrium of the user and jumping intensity information of a ventricle of the user.

14. The apparatus of claim 13, wherein, The heartbeat frequency of the user is also used to indicate an entering-sleep state of the user.

15. A computer program product, characterised in that, The computer program product includes program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7.

17. An execution device, characterized by The computer program product includes program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7. The computer-readable storage medium stores program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7. The computer program product includes program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7. The computer-readable storage medium stores program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7. The computer program product includes program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7. The computer-readable storage medium stores program code, which, when executed on a computer, causes the computer to perform the method according to any one of claims 1 to 7.

Images