Sound signal processing method and terminal equipment

Abstract

The invention provides a sound signal processing method and terminal equipment, and relates to the field of terminals.The method is applied to the terminal equipment, the terminal equipment comprises a first loudspeaker, a second loudspeaker and a microphone, and the method comprises the steps that when a ringing triggering event is detected, a first sound signal is transmitted through the first loudspeaker, and a second sound signal is transmitted through the second loudspeaker; the first loudspeaker emits a first sound signal, the second loudspeaker emits a second sound signal, the first sound signal and the second sound signal are obtained by fusing a ringtone signal and an ultrasonic signal, and the ultrasonic signal in the first sound signal and the ultrasonic signal in the second sound signal do not coincide in a time domain. According to the technical scheme provided by the invention, the ultrasonic signal is transmitted during ringing.

Description

Technical Field

[0001] This application relates to the field of terminals, and in particular, to a method for processing sound signals and a terminal device. Background Art

[0002] When the terminal device makes an alarm or incoming call, it can emit a ringtone to remind the user. When the user perceives the ringtone, they can locate the terminal device and click on the screen or button to turn off the ringtone. However, this operation often cannot be performed blindly, resulting in a poor user experience.

[0003] In the prior art, a camera may be included in the terminal device. Through the camera, the motion characteristics of target objects such as users can be recognized, enabling the user to turn off the ringtone through gestures. However, there is also a risk of leaking user privacy. Summary of the Invention

[0004] In view of this, this application provides a method for processing sound signals and a terminal device, which realizes the emission of ultrasonic signals when ringing.

[0005] To achieve the above object, in a first aspect, an embodiment of this application provides a method for processing sound signals. The method is applied to a terminal device, and the terminal device includes a first speaker, a second speaker, and a microphone. The method includes: when a trigger ringing event is detected, a first sound signal is emitted through the first speaker, and a second sound signal is emitted through the second speaker. The first sound signal and the second sound signal are obtained by fusing a ringtone signal and an ultrasonic signal, and the ultrasonic signals in the first sound signal and the ultrasonic signals in the second sound signal do not overlap in the time domain.

[0006] In the embodiment of this application, the terminal device includes a first speaker, a second speaker, and a microphone. When a ringing event is detected, a first sound signal can be emitted through the first speaker, and a second sound signal can be emitted through the second speaker. Among them, the first sound signal and the second sound signal are obtained by fusing a ringtone signal and an ultrasonic signal, and the ultrasonic signals in the first sound signal and the ultrasonic signals in the second sound signal do not overlap in the time domain. Therefore, when the terminal device detects a ringing event, ultrasonic signals can be alternately emitted without affecting the quality of the ringtone signal, enabling the user to operate on the ringing event through body movements and other means.

[0007] In some embodiments, the ringtone signal in the first sound signal and the ringtone signal in the second sound signal do not overlap in the time domain, and the end moment of the ringtone signal in the first sound signal is the same as the start moment of the ringtone signal in the second sound signal, and the start moment of the ringtone signal in the first sound signal is the same as the end moment of the ringtone signal in the second sound signal.

[0008] That is, the ringtone signal is alternately emitted by the first speaker and the second speaker. When the first speaker emits the ringtone signal in the first sound signal, the second speaker stops emitting the ringtone signal in the second sound signal, and when the second speaker emits the ringtone signal in the second sound signal, the first speaker stops emitting the ringtone signal in the first sound signal.

[0009] The first speaker and the second speaker can achieve continuous emission of the ringtone signal, ensuring the stability of the intensity and quality of the ringtone signal and further improving the user experience.

[0010] In some embodiments, the ringtone signal in the first sound signal and the ultrasonic signal in the first sound signal do not overlap in the time domain; and / or, the ringtone signal in the second sound signal and the ultrasonic signal in the second sound signal do not overlap in the time domain.

[0011] In some embodiments, the end moment of the ringtone signal segment in the first sound signal can be the same as the start moment of the ultrasonic signal in the first sound signal, and the start moment of the ringtone signal segment in the first sound signal can be the same as the end moment of the ultrasonic signal in the first sound signal. In some embodiments, the end moment of the ringtone signal segment in the second sound signal can be the same as the start moment of the ultrasonic signal in the second sound signal, and the start moment of the ringtone signal segment in the second sound signal can be the same as the end moment of the ultrasonic signal in the second sound signal.

[0012] That is, the first speaker alternately emits the ringtone signal and the ultrasonic signal in the first sound signal; and / or, the second speaker alternately emits the ringtone signal and the ultrasonic signal in the second sound signal.

[0013] The non - overlap of the ringtone signal and the ultrasonic signal in the time domain also enables the first speaker or the second speaker to emit with a higher power when emitting the ringtone signal or the ultrasonic signal alone, thereby expanding the recognition range and accuracy of the user's gestures or the distance from other objects while ensuring the quality and intensity of the ringtone signal.

[0014] In some embodiments, before the first sound signal is emitted by the first speaker and the second sound signal is emitted by the second speaker, the method further includes: obtaining the set ringtone signal; obtaining at least one first ringtone signal segment corresponding to the first speaker and at least one second ringtone signal segment corresponding to the second speaker in the ringtone signal; replacing each of the first ringtone signal segments in the ringtone signal with the ultrasonic signal to obtain the first sound signal; and replacing each of the second ringtone signal segments in the ringtone signal with the ultrasonic signal to obtain the second sound signal.

[0015] Replacing at least one ringtone signal segment in the ringtone signal with the ultrasonic signal means inserting the ultrasonic signal into the ringtone signal. Therefore, while one speaker emits a stronger ultrasonic signal, the other speaker can emit a stronger ringtone signal.

[0016] In some embodiments, the ultrasonic signal is a frequency modulated continuous wave (FMCW).

[0017] In some embodiments, the first speaker and the second speaker alternately emit multiple segments of ultrasonic signals, which can improve the gesture recognition performance in the direction of the speaker emitting ultrasound, complete more refined and wider-range gesture recognition, thereby enabling more possibilities for extended functions of the device, such as gesture volume adjustment, gesture screen brightness adjustment, etc.

[0018] In some embodiments, before the first sound signal is emitted by the first speaker and the second sound signal is emitted by the second speaker, the method further includes: obtaining the set ringtone signal; obtaining at least one first ringtone signal segment corresponding to the first speaker and at least one second ringtone signal segment corresponding to the second speaker in the ringtone signal; superimposing the ultrasonic signal on each of the first ringtone signal segments in the ringtone signal to obtain the first sound signal; and superimposing the ultrasonic signal on each of the second ringtone signal segments in the ringtone signal to obtain the second sound signal.

[0019] In some embodiments, the ultrasonic signal is a continuous wave (CW).

[0020] In some embodiments, the method further includes: when it is detected that the first speaker or the second speaker is blocked, the unblocked speaker among the first speaker and the second speaker emits a third sound signal, and the blocked speaker among the first speaker and the second speaker emits the ringtone signal, where the third sound signal is obtained by fusing the ringtone signal and the ultrasonic signal.

[0021] When the terminal device detects that any one of the first speaker and the second speaker is blocked, the unblocked speaker among the first speaker and the second speaker plays a third sound signal, so as to identify the motion characteristics of the target object in the direction opposite to the unblocked speaker. By emitting the ringtone signal through the blocked speaker, the intensity and quality of the ringtone signal can be ensured, improving the user experience.

[0022] In some embodiments, the ringtone signal in the third sound signal and the ultrasonic signal in the third sound signal do not overlap in the time domain. In some embodiments, the intensity of the ultrasonic signal in the third sound signal can be greater than the intensity of the ultrasonic signal in the first sound signal and / or the intensity of the ultrasonic signal in the second sound signal, so as to have a higher-precision identification ability in the direction corresponding to the speaker emitting the ultrasonic signal.

[0023] In some embodiments, the method further includes: when it is detected that the first speaker or the second speaker is blocked, the unblocked speaker among the first speaker and the second speaker emits a third sound signal, and the blocked speaker among the first speaker and the second speaker emits a fourth sound signal, where the third sound signal is obtained by fusing the ringtone signal and the ultrasonic signal, the fourth sound signal is obtained based on the ringtone signal, and when the first speaker emits the ringtone signal in the third sound signal, the second speaker stops emitting the ringtone signal in the fourth sound signal, and when the second speaker emits the ringtone signal in the fourth sound signal, the first speaker stops emitting the ringtone signal in the third sound signal.

[0024] When the terminal device detects that any one of the first speaker and the second speaker is blocked, the unblocked speaker among the first speaker and the second speaker plays a third sound signal, so as to identify the motion characteristics of the target object in the direction opposite to the unblocked speaker. By emitting the ringtone signal through the blocked speaker, the intensity and quality of the ringtone signal can be ensured, improving the user experience. And since the first speaker and the second speaker alternately emit the ringtone signal, the time of the emitted ringtone signals does not overlap and there is no time interval, which can improve the problems of large variation in the intensity of the ringtone and degradation of the ringtone quality.

[0025] In some embodiments, the method further includes: obtaining, by the microphone, a reflection signal of the ultrasonic signal from the target object; determining a first motion feature of the target object based on the obtained reflection signal; and if the first motion feature of the target object is the same as a preset second motion feature, processing the ringing event based on a processing strategy corresponding to the second motion feature.

[0026] Exemplarily, the first motion feature includes a first gesture, and the second motion feature includes a second gesture. When the terminal device detects that the first gesture is the same as the second gesture, the ringing event can be turned off, such as stopping the emission of a sound signal emitted in response to the ringing event. Alternatively, the second motion feature includes a third gesture. When the terminal device detects the first gesture and the third gesture, the intensity of the sound signal emitted in response to the ringing event can be reduced. Alternatively, the second motion feature is a fourth gesture. When the terminal device detects the first gesture and the fourth gesture, the intensity of the sound signal emitted in response to the ringing event can be increased.

[0027] In a second aspect, an embodiment of the present application provides a sound signal processing device, which has a function of implementing the behaviors of the terminal device in the above aspects and the possible implementation manners of the above aspects. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a transceiver module or unit, a processing module or unit, an acquisition module or unit, etc.

[0028] In a third aspect, an embodiment of the present application provides a terminal device, including: a memory and a processor, where the memory is used to store a computer program; and the processor is used to execute the method according to any one of the first aspects when calling the computer program.

[0029] In a fourth aspect, an embodiment of the present application provides a chip system, where the chip system includes a processor, and the processor is coupled to a memory. The processor executes a computer program stored in the memory to implement the method according to any one of the first aspects.

[0030] Wherein, the chip system can be a single chip or a chip module composed of multiple chips.

[0031] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method according to any one of the first aspects is implemented.

[0032] In a sixth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on a terminal device, the terminal device is enabled to execute the method according to any one of the first aspects.

[0033] It can be understood that the beneficial effects of the second to sixth aspects above can be referred to the relevant descriptions in the first aspect above, and will not be elaborated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 A schematic structural diagram of a terminal device provided by an embodiment of the present application;

[0035] Figure 2 A schematic diagram of a gesture recognition scenario provided by an embodiment of the present application;

[0036] Figure 3 Another schematic diagram of a gesture recognition scenario provided by an embodiment of the present application;

[0037] Figure 4 A flowchart of a method for processing sound signals provided by an embodiment of the present application;

[0038] Figure 5 A schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0039] Figure 6 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0040] Figure 7 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0041] Figure 8 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0042] Figure 9 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0043] Figure 10 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0044] Figure 11 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0045] Figure 12 Another flowchart of a method for processing sound signals provided by an embodiment of the present application;

[0046] Figure 13 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0047] Figure 14 Another schematic diagram of a manner of transmitting sound signals provided by an embodiment of the present application;

[0048] Figure 15 Schematic diagram of another way to emit a sound signal provided by an embodiment of the present application;

[0049] Figure 16 Flowchart of another method for processing a sound signal provided by an embodiment of the present application;

[0050] Figure 17 Schematic diagram of another way to emit a sound signal provided by an embodiment of the present application;

[0051] Figure 18 Flowchart of a method for generating a sound signal provided by an embodiment of the present application;

[0052] Figure 19 Flowchart of another method for a sound signal provided by an embodiment of the present application. Detailed implementation manners

[0053] The sound signal processing method provided by the embodiments of the present application can be applied to terminal devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), etc. The embodiments of the present application do not impose any restrictions on the specific types of terminal devices.

[0054] Figure 1 It is a schematic structural diagram of a terminal device 100 provided by an embodiment of the present application. The terminal device 100 may include a processor 110, a memory 120, a communication module 130, a speaker 140, a microphone 150, etc.

[0055] Among them, the processor 110 may include one or more processing units, and the memory 120 is used to store program codes and data. In the embodiments of the present application, the processor 110 can execute the computer execution instructions stored in the memory 120 to control and manage the actions of the terminal device 100.

[0056] The communication module 130 can be used for communication between various internal modules of the terminal device 100, or communication between the terminal device 100 and other external terminal devices, etc. Exemplarily, if the terminal device 100 communicates with other terminal devices in a wired connection manner, the communication module 130 may include interfaces, such as a USB interface. The USB interface can be an interface that complies with the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the terminal device 100, and can also be used to transfer data between the terminal device 100 and peripheral devices. It can also be used to connect headphones to emit audio. This interface can also be used to connect other terminal devices, etc.

[0057] Alternatively, the communication module 130 may include audio devices, radio frequency circuits, Bluetooth chips, wireless fidelity (Wi-Fi) chips, near-field communication (NFC) modules, etc., and can implement the interaction between the terminal device 100 and other terminal devices in various different ways.

[0058] The speaker 140, also known as a "loudspeaker", is used to convert an audio electrical signal into a sound signal. In some embodiments, the terminal device 100 can play music through the speaker 140, and can also play various notification and message ringtones such as alarm clock ringtones, incoming call ringtones, and text message ringtones. In some embodiments, the speaker 140 of the terminal device 100 can be used to emit ultrasonic signals, and the ultrasonic signals can be used for ranging, identifying user gestures, identifying objects, etc. In some embodiments, the terminal device 100 may include at least two speakers 140.

[0059] The microphone 150, also known as a "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak close to the microphone 150 with their mouth to input the sound signal into the microphone 150. The terminal device 100 can be provided with at least one microphone 150. In some embodiments, the microphone 150 can be used to receive ultrasonic signals.

[0060] Optionally, the terminal device 100 may further include peripheral devices 160, such as a mouse, a keyboard, a stylus, etc.

[0061] It should be understood that in addition to Figure 1Beyond the various components or modules listed, the embodiments of this application do not specifically limit the structure of the terminal device 100. In some other embodiments of this application, the terminal device 100 may further include more or fewer components than shown in the figure, or combine certain components, or split certain components, or have different component arrangements. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0062] To facilitate the understanding of the technical solutions in the embodiments of this application, the application scenarios of the embodiments of this application are first introduced below.

[0063] When the user sets an alarm or the terminal device receives an incoming call, a ringtone will be emitted to remind the user. The user needs to find the terminal device and click on the screen or button of the terminal device to turn off the ringtone. This operation method is not convenient for blind operation and greatly reduces the user experience. In some embodiments, the terminal device can be a mobile phone as shown in a of Figure 2 or a smart speaker as shown in b of Figure 2 . The terminal device includes optical sensors such as cameras. Through the optical sensors, the user's gestures can be recognized, enabling the user to turn off the ringtone through gestures, but this also brings privacy issues and increases costs. In some other embodiments, the terminal device can detect the user's gestures through ultrasonic signals, avoiding privacy issues and reducing costs at the same time. However, how to design the sound signal to ensure the quality of the output ringtone while ensuring the accuracy and coverage of ultrasonic gesture detection has received increasing attention.

[0064] To solve at least some of the above technical problems, the embodiments of this application provide a method for processing sound signals. On the premise that the terminal device has a speaker and a microphone, by performing signal design on the ringtone emitted by the terminal device and superimposing ultrasonic signals, it is possible to improve the effective range and recognition accuracy of ultrasonic gesture recognition without affecting the sound quality of the ringtone, and to solve the problem of possible occlusion scenarios, thereby giving more possibilities for the development of practical functions of the terminal device.

[0065] In some embodiments, as shown in Figure 3 , the terminal device includes two speakers and one microphone. When the terminal device needs the two speakers to emit a ringtone, it can emit a sound signal with ultrasonic signals superimposed or inserted separately or alternately through the two speakers, and then the microphone can receive the ultrasonic signal. By detecting the user's gestures through the ultrasonic signal, the range of gesture recognition can be expanded and the detection success rate in occlusion scenarios can be improved while ensuring the quality and loudness of the ringtone, enabling the user to control the terminal device through gestures when the terminal device emits a ringtone.

[0066] The technical solution of the present application will be described in detail below with specific embodiments. These several specific embodiments below can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0067] Please refer to Figure 4 , which is a flowchart of a method for processing sound signals provided by an embodiment of the present application. It should be noted that this method is not limited to Figure 4 the specific order described below. It should be understood that in some embodiments, the order of some steps of this method can be interchanged according to actual needs, or some of the steps can also be omitted or deleted. The method includes the following steps:

[0068] S401, the terminal device fuses the ultrasonic signal and the ringtone signal to obtain a first sound signal and a second sound signal.

[0069] In order to be able to transmit the ultrasonic signal when transmitting the ringtone signal, the terminal device can generate a first sound signal and a second sound signal based on the ultrasonic signal and the ringtone signal.

[0070] In some embodiments, the terminal device can generate corresponding sound signals based on the speaker (i.e., sound channel) that emits the ringtone. In some embodiments, the terminal device includes a first speaker and a second speaker. Exemplarily, the first speaker can be the left sound channel, and the second speaker can be the right sound channel. The terminal device can obtain the set ringtone signal and generate a first sound signal corresponding to the first speaker (i.e., the left sound channel) and a second sound signal corresponding to the second speaker (i.e., the right sound channel) based on the ringtone signal and the ultrasonic signal, wherein the ultrasonic signals in the first sound signal and the ultrasonic signals in the second sound signal do not overlap in the time domain. That is, when the terminal device emits the first sound signal and the second sound signal, it can alternately emit the ultrasonic signals in the first sound signal and the ultrasonic signals in the second sound signal.

[0071] In some embodiments, the ringtone signals in the first sound signal and the ringtone signals in the second sound signal do not overlap in the time domain, and the end moment of the ringtone signal in the first sound signal is the same as the start moment of the ringtone signal in the second sound signal, and the start moment of the ringtone signal in the first sound signal is the same as the end moment of the ringtone signal in the second sound signal. That is, the terminal device can achieve continuous emission of the ringtone signal by alternately emitting the ringtone signals in the first sound signal and the ringtone signals in the second sound signal, ensuring the stability of the intensity and quality of the ringtone signal and further improving the user experience.

[0072] In some embodiments, the ringtone signal in the first sound signal and the ultrasonic signal in the first sound signal do not overlap in the time domain, and / or the ringtone signal in the second sound signal and the ultrasonic signal in the second sound signal do not overlap in the time domain. In some embodiments, the end moment of the ringtone signal segment in the first sound signal may be the same as the start moment of the ultrasonic signal in the first sound signal, and the start moment of the ringtone signal segment in the first sound signal may be the same as the end moment of the ultrasonic signal in the first sound signal. In some embodiments, the end moment of the ringtone signal segment in the second sound signal may be the same as the start moment of the ultrasonic signal in the second sound signal, and the start moment of the ringtone signal segment in the second sound signal may be the same as the end moment of the ultrasonic signal in the second sound signal.

[0073] Taking the first speaker as an example, the non - overlapping of the ringtone signal and the ultrasonic signal in the time domain also enables the first speaker to emit with a higher power when emitting the ringtone signal or the ultrasonic signal alone. Thus, while ensuring the quality and intensity of the ringtone signal, the recognition range and accuracy of the user's gesture or the distance from other objects are expanded.

[0074] In addition, when the first speaker emits the first sound signal, it can alternately emit ringtone signal segments and ultrasonic signals, and at the same moment, it can emit only a ringtone signal segment or an ultrasonic signal. And when the start moment of the ringtone signal segment is the same as the end moment of the ultrasonic signal, and the end moment of the ringtone signal segment is the same as the start moment of the ultrasonic signal, it is possible to continuously emit ringtone signal segments and ultrasonic signals when emitting the first sound signal. Similarly, when the second speaker emits the second sound signal, it can alternately emit ringtone signal segments and ultrasonic signals, and at the same moment, it can emit a ringtone signal segment or an ultrasonic signal. And when the start moment of the ringtone signal segment is the same as the end moment of the ultrasonic signal, and the end moment of the ringtone signal segment is the same as the start moment of the ultrasonic signal, it is possible to continuously emit ringtone signal segments and ultrasonic signals when emitting the second sound signal.

[0075] In some embodiments, the ultrasonic signal may include CW or FMCW. In some embodiments, the required emission duration of FMCW is shorter than that of CW. Exemplarily, one CW can be emitted for at least 600 ms (milliseconds), and one FMCW can be emitted for at least 50 ms.

[0076] In some embodiments, the way for the terminal device to fuse the ultrasonic signal and the ringtone signal can also refer to the detailed description in the following Figure 18 and Figure 19 described in detail.

[0077] In some embodiments, S401 can be omitted.

[0078] S402. When the terminal device detects a trigger ring event, it emits a first sound signal through the first speaker and a second sound signal through the second speaker.

[0079] When the terminal device detects a ring event triggered by an alarm clock, an incoming call, a notification, or other reasons, it can emit a first sound signal through the first speaker and a second sound signal through the second speaker, so as to also emit an ultrasonic signal when emitting the ring signal, in order to detect the motion characteristics of the target object through the ultrasonic signal.

[0080] In some embodiments, the target object may include a human body or a part of the human body, such as a hand. In other embodiments, the target object may also be other types of objects.

[0081] In some embodiments, the terminal device may also generate and emit a first sound signal and a second sound signal when detecting a trigger ring event.

[0082] In some embodiments, the terminal device may alternately emit ring signals through the first speaker and the second speaker. When the first speaker emits the ring signal in the first sound signal, the second speaker stops emitting the ring signal in the second sound signal. When the second speaker emits the ring signal in the second sound signal, the first speaker stops emitting the ring signal in the first sound signal.

[0083] In some embodiments, the terminal device may alternately emit the ring signal and the ultrasonic signal in the first sound signal through the first speaker; and / or alternately emit the ring signal and the ultrasonic signal in the second sound signal through the second speaker.

[0084] In some embodiments, the way the terminal device emits the sound signal is as Figure 5 shown.

[0085] The first speaker first emits the superposition of the ultrasonic signal and the ring signal, while the second speaker emits the ring signal.

[0086] When the ultrasonic signal is emitted for the first duration (i.e., T1), the first speaker keeps emitting the ring signal and pauses emitting the ultrasonic signal, and the pause duration is the second duration (i.e., Δt1).

[0087] After that, the second speaker emits the superposition of the ultrasonic signal and the ring signal.

[0088] When the ultrasonic signal is emitted for the first duration, the second speaker keeps emitting the ring signal and pauses emitting the ultrasonic signal, and the pause duration is the second duration.

[0089] After that, the first speaker emits the superposition of the ultrasonic signal and the ringtone signal again.

[0090] That is, the first speaker and the second speaker alternately emit a period of ultrasonic signal, and the duration of each period of ultrasonic signal is the first duration, and the time interval between two adjacent periods of ultrasonic signals is the second duration. In some embodiments, the first duration can be greater than or equal to 600 ms.

[0091] In some embodiments, the way the terminal device emits the sound signal is as Figure 6 shown.

[0092] The first speaker first emits the superposition of the ultrasonic signal and the ringtone signal, and at the same time the second speaker emits the ringtone signal.

[0093] When the ultrasonic signal is emitted for the first duration (i.e., T1), the first speaker keeps emitting the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the third duration (i.e., Δt2).

[0094] After that, the first speaker continues to emit the superposition of the ultrasonic signal and the ringtone signal.

[0095] When the ultrasonic signal is emitted to the first duration again, the first speaker keeps emitting the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the fourth duration (i.e., Δt3).

[0096] After that, the second speaker emits the superposition of the ultrasonic signal and the ringtone signal.

[0097] When the ultrasonic signal is emitted to the first duration, the second speaker keeps emitting the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the third duration.

[0098] After that, the second speaker continues to emit the superposition of the ultrasonic signal and the ringtone signal.

[0099] When the ultrasonic signal is emitted to the first duration, the second speaker keeps emitting the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the fourth duration.

[0100] After that, the first speaker emits the superposition of the ultrasonic signal and the ringtone signal again.

[0101] That is, the first speaker and the second speaker alternately emit multiple periods (such as two periods, three periods or even more) of ultrasonic signals, the duration of each period of ultrasonic signal is the first duration, the time interval between two adjacent periods of ultrasonic signals emitted by the same speaker is the third duration, and the time interval between two adjacent periods of ultrasonic signals emitted by the first speaker and the second speaker is the fourth duration. In some embodiments, the third duration can be less than or equal to the fourth duration.

[0102] In some embodiments, the terminal device emits a sound signal in the following manner as Figure 7 shown.

[0103] The first speaker first emits an ultrasonic signal, and at the same time, the second speaker emits a ringtone signal.

[0104] When the duration of the ultrasonic signal emitted by the first speaker reaches the fifth duration (T2), the first speaker pauses emitting the ultrasonic signal and starts emitting the ringtone signal.

[0105] When the duration of pausing to emit the ultrasonic signal reaches the sixth duration (i.e., Δt5), the second speaker pauses emitting the ringtone signal and starts emitting the ultrasonic signal.

[0106] When the duration of the ultrasonic signal emitted by the second speaker reaches the fifth duration, the second speaker pauses emitting the ultrasonic signal and starts emitting the ringtone signal.

[0107] When the duration of pausing to emit the ultrasonic signal reaches the sixth duration, the first speaker pauses emitting the ringtone signal and starts emitting the ultrasonic signal.

[0108] That is to say, the first speaker and the second speaker alternately emit a segment of ultrasonic signal, the duration of each segment of ultrasonic signal is the fifth duration, and the time interval between adjacent two segments of ultrasonic signals is the sixth duration. In some embodiments, the fifth duration may be greater than or equal to 50 ms.

[0109] In some embodiments, the terminal device emits a sound signal in the following manner as Figure 8 shown.

[0110] The first speaker first emits an ultrasonic signal, and at the same time, the second speaker emits a ringtone signal.

[0111] When the duration of the ultrasonic signal emitted by the first speaker reaches the fifth duration (i.e., T2), the first speaker pauses emitting the ultrasonic signal.

[0112] When the duration of pausing to emit the ultrasonic signal reaches the sixth duration (i.e., Δt5), the second speaker pauses emitting the ringtone signal and starts emitting the ultrasonic signal, and at the same time, the first speaker continues to emit the ringtone signal.

[0113] When the duration of the ultrasonic signal emitted by the second speaker reaches the fifth duration, the second speaker pauses emitting the ultrasonic signal and starts emitting the ringtone signal, and at the same time, the first speaker pauses emitting the ringtone signal.

[0114] When the duration of pausing to emit the ultrasonic signal reaches the sixth duration, the first speaker continues to emit the ultrasonic signal.

[0115] That is, the first speaker and the second speaker alternately transmit a segment of ultrasonic signal, and the duration of each segment of ultrasonic signal is the fifth duration, and the time interval between two adjacent segments of ultrasonic signals is the sixth duration.

[0116] In some embodiments, the manner in which the terminal device transmits the sound signal is as Figure 9 shown.

[0117] The first speaker first transmits the ultrasonic signal, and at the same time, the second speaker transmits the ringtone signal.

[0118] When the duration of the ultrasonic signal transmitted by the first speaker reaches the fifth duration (T2), the first speaker pauses transmitting the ultrasonic signal and starts to transmit the ringtone signal.

[0119] When the duration of the paused transmission of the ultrasonic signal reaches the sixth duration (i.e., Δt5), the first speaker pauses transmitting the ringtone signal and continues to transmit the ultrasonic signal.

[0120] When the duration of the ultrasonic signal transmitted by the first speaker reaches the fifth duration again, the first speaker pauses transmitting the ultrasonic signal and continues to transmit the ringtone signal.

[0121] When the duration of the paused transmission of the ultrasonic signal reaches the seventh duration (i.e., Δt6), the second speaker pauses transmitting the ringtone signal and starts to transmit the ultrasonic signal.

[0122] When the duration of the ultrasonic signal transmitted by the second speaker reaches the fifth duration, the second speaker pauses transmitting the ultrasonic signal and starts to transmit the ringtone signal.

[0123] When the duration of the paused transmission of the ultrasonic signal reaches the sixth duration, the second speaker pauses transmitting the ringtone signal and continues to transmit the ultrasonic signal.

[0124] That is, the first speaker and the second speaker alternately transmit multiple segments of ultrasonic signals, the duration of each segment of ultrasonic signal is the fifth duration, the time interval between two adjacent segments of ultrasonic signals transmitted by the same speaker is the sixth duration, and the time interval between two adjacent segments of ultrasonic signals transmitted by the first speaker and the second speaker is the seventh duration. In some embodiments, the sixth duration may be less than or equal to the seventh duration.

[0125] In some embodiments, the manner in which the terminal device transmits the sound signal is as Figure 10 shown.

[0126] The first speaker first transmits the ultrasonic signal, and at the same time, the second speaker transmits the ringtone signal.

[0127] When the duration of the ultrasonic signal emitted by the first speaker reaches the fifth duration (T2), the first speaker pauses emitting the ultrasonic signal and starts to emit a ringing signal, and at the same time, the second speaker pauses emitting the ringing signal.

[0128] When the duration of pausing emitting the ultrasonic signal reaches the sixth duration (i.e., Δt5), the first speaker pauses emitting the ringing signal and continues to emit the ultrasonic signal, and at the same time, the second speaker continues to emit the ringing signal.

[0129] When the duration of the ultrasonic signal emitted by the first speaker reaches the fifth duration again, the first speaker pauses emitting the ultrasonic signal and starts to emit a ringing signal, and at the same time, the second speaker pauses emitting the ringing signal.

[0130] When the duration of pausing emitting the ultrasonic signal reaches the seventh duration (i.e., Δt6), the second speaker continues to emit the ultrasonic signal.

[0131] When the duration of the ultrasonic signal emitted by the second speaker reaches the fifth duration, the second speaker pauses emitting the ultrasonic signal and starts to emit a ringing signal, and at the same time, the first speaker pauses emitting the ringing signal.

[0132] That is to say, the first speaker and the second speaker alternately emit multiple segments of ultrasonic signals, the duration of each segment of ultrasonic signal is the fifth duration, the time interval between two adjacent segments of ultrasonic signals emitted by the same speaker is the sixth duration, and the time interval between two adjacent segments of ultrasonic signals emitted by the first speaker and the second speaker is the seventh duration.

[0133] In some embodiments, the way the terminal device emits sound signals is as Figure 11 shown.

[0134] The first speaker first emits the ultrasonic signal, and at the same time, the second speaker emits the ringing signal.

[0135] When the duration of the ultrasonic signal emitted by the first speaker reaches the fifth duration (T2), the first speaker pauses emitting the ultrasonic signal.

[0136] When the duration of pausing emitting the ultrasonic signal reaches the sixth duration (i.e., Δt5), the first speaker continues to emit the ultrasonic signal.

[0137] When the duration of the ultrasonic signal emitted by the first speaker reaches the fifth duration again, the first speaker pauses emitting the ultrasonic signal and starts to emit a ringing signal, and at the same time, the second speaker pauses emitting the ringing signal.

[0138] When the duration of pausing emitting the ultrasonic signal reaches the seventh duration (i.e., Δt6), the second speaker continues to emit the ultrasonic signal.

[0139] When the duration of the ultrasonic signal emitted by the second speaker reaches the fifth duration, the second speaker pauses emitting the ultrasonic signal.

[0140] That is, the first speaker and the second speaker alternately emit multiple segments of ultrasonic signals, the duration of each segment of ultrasonic signal is the fifth duration, the time interval between two adjacent segments of ultrasonic signals emitted by the same speaker is the sixth duration, and the time interval between two adjacent segments of ultrasonic signals emitted by the first speaker and the second speaker is the seventh duration. In addition, during each round of continuous emission of multiple segments of ultrasonic signals by the same speaker, a ringtone signal is not emitted, but is emitted by the other speaker that does not emit ultrasonic signals, reducing the switching times of the speaker emitting the ringtone signal and further improving the ringtone quality and user experience.

[0141] In the embodiment described above Figure 6 、 Figures 9 - 11 By alternately emitting multiple segments of ultrasonic signals between the first speaker and the second speaker, the gesture recognition performance in the direction of the speaker emitting ultrasound can be improved, enabling more refined and wider-range gesture recognition, thus giving the device more possibilities for extended functions, such as gesture volume adjustment, gesture screen brightness adjustment, etc.

[0142] In the embodiment described above Figures 7 - 11 At least one ringtone signal segment in the ringtone signal is replaced with an ultrasonic signal, that is, the ultrasonic signal is inserted into the ringtone signal. Therefore, while one speaker emits a stronger ultrasonic signal, the other speaker can emit a stronger ringtone signal.

[0143] In the embodiments described above Figure 8 、 Figure 10 and Figure 11 By alternately emitting ringtone signals between the first speaker and the second speaker, the emitted ringtone signals do not overlap in time and there is no time interval, which can improve the problems of large variation in ringtone intensity and degradation in ringtone quality.

[0144] S403, the terminal device obtains the reflection signal of the ultrasonic signal by the target object through the microphone.

[0145] As can be seen from the foregoing, the first speaker and the second speaker can alternately emit ultrasonic signals. Therefore, the terminal device can obtain the reflection signal generated by the ultrasonic signal emitted by the first speaker or the second speaker through the microphone.

[0146] S404, the terminal device determines the first motion feature of the target object based on the obtained reflection signal.

[0147] In some embodiments, the terminal device may determine the distance to the target object based on the reflected signal of the target object, and then determine the first motion feature of the target object. In some other embodiments, the terminal device may also determine the first motion feature of the target object through the reflected signal based on other methods.

[0148] S405, the terminal device determines whether the first motion feature is the same as the preset second motion feature. If so, it executes S406; otherwise, it returns to S403.

[0149] The terminal device may compare the detected first motion feature with the pre-set second motion feature to determine whether the first motion feature is the same as the preset second motion feature.

[0150] S406, the terminal device processes the ringing event based on the processing strategy corresponding to the second motion feature.

[0151] In some embodiments, the terminal device may determine the second motion feature and the corresponding processing strategy in advance. Exemplarily, the first motion feature includes a first gesture, the second motion feature includes a second gesture. When the terminal device detects that the first gesture is the same as the second gesture, it may turn off the ringing event, such as stopping emitting the sound signal emitted in response to the ringing event. Or, the second motion feature includes a third gesture. When the terminal device detects that the first gesture is the same as the third gesture, it may reduce the intensity of the sound signal emitted in response to the ringing event. Or, the second motion feature is a fourth gesture. When the terminal device detects that the first gesture is the same as the fourth gesture, it may increase the intensity of the sound signal emitted in response to the ringing event.

[0152] In some embodiments, the second motion feature and the corresponding processing strategy may be set by the user or relevant technical personnel.

[0153] In some embodiments, at least some of the steps in S403 - S406 may be omitted.

[0154] In the embodiments of the present application, the terminal device includes a first speaker, a second speaker, and a microphone. When a ringing event is detected, a first sound signal may be emitted through the first speaker, and a second sound signal may be emitted through the second speaker. Wherein, the first sound signal and the second sound signal are obtained by fusing the ringing signal and the ultrasonic signal, and the ultrasonic signals in the first sound signal and the second sound signal do not overlap in the time domain. Therefore, the terminal device can alternately emit ultrasonic signals when detecting a ringing event without affecting the quality of the ringing signal, and then determine the first motion feature of the target object through the ultrasonic signal, so that the user can operate the ringing event by means of body movements and the like.

[0155] Please refer to Figure 12 , which is a flowchart of a method for processing sound signals provided by an embodiment of the present application. Among them, this method can be used after S402 in the method shown in the foregoing Figure 4 . It should be noted that this method is not limited by Figure 12 and the specific order described below. It should be understood that in some embodiments, the order of some steps of this method can be interchanged according to actual needs, or some of the steps can also be omitted or deleted. This method includes the following steps:

[0156] S407, the terminal device determines that any one of the first speaker and the second speaker is blocked.

[0157] In some embodiments, the terminal device can obtain the reflection signal of the ultrasonic signal through the microphone. If the first signal energy of the reflection signal is greater than the preset second signal energy, it is determined that the speaker that emits the ultrasonic signal is blocked. Or, in some other embodiments, the terminal device can identify whether the first speaker and the second speaker are blocked by other means.

[0158] S408, the terminal device emits a third sound signal through the unblocked speaker among the first speaker and the second speaker, and emits a ringtone signal through the blocked speaker among the first speaker and the second speaker. The third sound signal is obtained by fusing the ringtone signal and the ultrasonic signal.

[0159] When it is detected that any one of the first speaker and the second speaker is blocked, a third sound signal is emitted through the unblocked speaker, so as to identify the motion characteristics of the target object in the direction opposite to the unblocked speaker. Emitting a ringtone signal through the blocked speaker can ensure the intensity and quality of the ringtone signal and improve the user experience.

[0160] In some embodiments, the terminal device can generate the third sound signal based on a manner similar to or the same as that for generating the first sound signal and the second sound signal. In some embodiments, the ringtone signal in the third sound signal and the ultrasonic signal in the third sound signal do not overlap in the time domain. In some embodiments, the intensity of the ultrasonic signal in the third sound signal can be greater than the intensity of the ultrasonic signal in the first sound signal and / or the intensity of the ultrasonic signal in the second sound signal, so as to have a higher-precision identification ability in the direction corresponding to the speaker that emits the ultrasonic signal.

[0161] In some embodiments, the terminal device may determine at least one third ringtone signal segment in the ringtone signal, replace the at least one third ringtone signal segment in the ringtone signal with an ultrasonic signal, or superimpose the at least one third ringtone signal segment in the ringtone signal with the ultrasonic signal, so as to obtain a third sound signal.

[0162] In some embodiments, when it is detected that the second speaker is blocked, the way the terminal device emits a sound signal is as Figure 13 shown.

[0163] The first speaker first emits the superposition of the ultrasonic signal and the ringtone signal, and at the same time the second speaker emits the ringtone signal.

[0164] When the ultrasonic signal is emitted to the first duration (i.e., T1), the first speaker keeps emitting the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the eighth duration (i.e., Δt4).

[0165] After that, the first speaker continues to emit the superposition of the ultrasonic signal and the ringtone signal.

[0166] When the ultrasonic signal is emitted to the first duration again, the first speaker keeps emitting the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the eighth duration.

[0167] After that, the first speaker continues to emit the superposition of the ultrasonic signal and the ringtone signal.

[0168] That is to say, the second speaker only emits the ringtone signal, and the first speaker independently emits multiple segments of ultrasonic signals. The duration of each segment of ultrasonic signal is the first duration, and the time interval between adjacent two segments of ultrasonic signals is the eighth duration.

[0169] In some embodiments, when it is detected that the second speaker is blocked, the way the terminal device emits a sound signal is as Figure 14 shown.

[0170] The first speaker first emits the ultrasonic signal, and at the same time the second speaker emits the ringtone signal.

[0171] When the ultrasonic signal is emitted to the fifth duration (i.e., T2), the first speaker starts to emit the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the sixth duration (i.e., Δt5).

[0172] After that, the first speaker continues to emit the ultrasonic signal and pauses emitting the ringtone signal.

[0173] When the ultrasonic signal is emitted to the fifth duration again, the first speaker continues to emit the ringtone signal and pauses emitting the ultrasonic signal, and the pause duration is the sixth duration.

[0174] That is, the second speaker only emits a ringtone signal, and the first speaker independently emits multiple segments of ultrasonic signals. The duration of each segment of ultrasonic signal is the fifth duration, and the time interval between two adjacent segments of ultrasonic signals is the sixth duration.

[0175] In some embodiments, when it is detected that the second speaker is blocked, the terminal device emits a sound signal in the following manner Figure 15 as shown.

[0176] The first speaker first emits an ultrasonic signal, and at the same time, the second speaker emits a ringtone signal.

[0177] When the ultrasonic signal is emitted for the fifth duration (i.e., T2), the first speaker pauses emitting the ultrasonic signal, and the pause duration is the sixth duration (i.e., Δt5).

[0178] After that, the first speaker continues to emit the ultrasonic signal.

[0179] When the ultrasonic signal is emitted to the fifth duration again, the first speaker pauses emitting the ultrasonic signal, and the pause duration is the sixth duration.

[0180] That is, the second speaker only emits a ringtone signal, and the first speaker independently emits multiple segments of ultrasonic signals. The duration of each segment of ultrasonic signal is the fifth duration, and the time interval between two adjacent segments of ultrasonic signals is the sixth duration. Among them, when the first speaker does not emit ultrasonic signals, it also does not emit ringtone signals.

[0181] In some embodiments, the terminal device may, when receiving a user instruction to turn on the high-precision recognition function, after executing S402, detect whether the first speaker and the second speaker are blocked, and then execute S407 - S408. Or the terminal device may, when receiving a user instruction to turn off the high-precision recognition function, not detect whether the first speaker and the second speaker are blocked after executing S402, and thus not execute S407 - S408.

[0182] In the embodiments of the present application, when the terminal device detects that any one of the first speaker and the second speaker is blocked, the third sound signal is played through the unblocked speaker among the first speaker and the second speaker, so as to identify the motion characteristics of the target object in the direction opposite to the unblocked speaker. By emitting a ringtone signal through the blocked speaker, the intensity and quality of the ringtone signal can be ensured, and the user experience can be improved.

[0183] Please refer to Figure 16 , which is a flowchart of a method for processing a sound signal provided by an embodiment of the present application. Among them, this method can be used after S402 in the method shown above Figure 4 It should be noted that this method is not based on Figure 16Subject to the specific order described below, it should be understood that in some embodiments, the order of some of the steps of the method can be interchanged according to actual needs, or some of the steps can also be omitted or deleted. The method includes the following steps:

[0184] S407, the terminal device determines that any one of the first speaker and the second speaker is blocked.

[0185] S409, the terminal device transmits a third sound signal through the unblocked speaker among the first speaker and the second speaker, and transmits a fourth sound signal through the blocked speaker among the first speaker and the second speaker, where the third sound signal is obtained by fusing a ringtone signal and an ultrasonic signal, the fourth sound signal is obtained based on the ringtone signal, and when the first speaker transmits the ringtone signal in the third sound signal, the second speaker stops transmitting the ringtone signal in the fourth sound signal, and when the second speaker transmits the ringtone signal in the fourth sound signal, the first speaker stops transmitting the ringtone signal in the third sound signal.

[0186] When it is detected that any one of the first speaker and the second speaker is blocked, a third sound signal is transmitted through the unblocked speaker, so as to identify the motion characteristics of the target object in the direction opposite to the unblocked speaker. Transmitting a ringtone signal through the blocked speaker can ensure the intensity and quality of the ringtone signal and improve the user experience. And since the first speaker and the second speaker alternately transmit the ringtone signal, the transmission times of the ringtone signals do not overlap and there is no time interval, which can improve the problem of large variation in the intensity of the ringtone and degradation of the ringtone quality.

[0187] In some embodiments, the third sound signal includes at least one segment of ultrasonic signal, and the ringtone signal segment at the position corresponding to the at least one segment of ultrasonic signal in the ringtone signal is deleted or muted, so as to obtain the fourth sound signal.

[0188] In some embodiments, the terminal device can determine at least one third ringtone signal segment in the ringtone signal, delete or mute the at least one third ringtone signal segment in the ringtone signal to obtain the fourth sound signal, and replace the at least one third ringtone signal segment in the ringtone signal with an ultrasonic signal to obtain the third sound signal.

[0189] In some embodiments, when it is detected that the second speaker is blocked, the way the terminal device transmits the sound signal is as Figure 17 shown.

[0190] The first speaker first transmits an ultrasonic signal, and at the same time the second speaker transmits a ringtone signal.

[0191] When the ultrasonic signal is transmitted for the fifth duration (i.e., T2), the first speaker starts to transmit the ringtone signal and pauses transmitting the ultrasonic signal for the sixth duration (i.e., Δt5), while the second speaker pauses transmitting the ringtone signal.

[0192] After that, the first speaker continues to transmit the ultrasonic signal and pauses transmitting the ringtone signal, while the second speaker continues to transmit the ringtone signal.

[0193] When the ultrasonic signal is transmitted to the fifth duration again, the first speaker continues to transmit the ringtone signal and pauses transmitting the ultrasonic signal for the sixth duration, while the second speaker pauses transmitting the ringtone signal.

[0194] That is to say, the second speaker only transmits the ringtone signal, and the first speaker independently transmits multiple segments of ultrasonic signals. The duration of each segment of ultrasonic signal is the fifth duration, and the time interval between adjacent two segments of ultrasonic signals is the sixth duration. In addition, the second speaker and the first speaker alternately transmit the ringtone signal, and there is no interval when transmitting the ringtone signal.

[0195] In some embodiments, when the terminal device receives the user's instruction to turn on the high-precision recognition function, after executing S402, it can detect whether the first speaker and the second speaker are blocked, and then execute S407 - S409. Or when the terminal device receives the user's instruction to turn off the high-precision recognition function, after executing S402, it does not detect whether the first speaker and the second speaker are blocked, and thus does not execute S407 - S409.

[0196] In the embodiments of the present application, when the terminal device detects that any one of the first speaker and the second speaker is blocked, it plays the third sound signal through the unblocked speaker among the first speaker and the second speaker, so as to identify the motion characteristics of the target object in the direction opposite to the unblocked speaker. By transmitting the ringtone signal through the blocked speaker, the intensity and quality of the ringtone signal can be ensured, and the user experience can be improved. And because the first speaker and the second speaker alternately transmit the ringtone signal, the time of the transmitted ringtone signals does not coincide and there is no time interval, which can improve the problem of large variation in the intensity of the ringtone and the decline in the quality of the ringtone.

[0197] Please refer to Figure 18 , which is a flowchart of a method for generating a sound signal provided by the embodiments of the present application. Among them, this method can be a detailed description of the foregoing S401. In some embodiments, Figure 18 The method shown can generate the first sound signal and the second sound signal in the foregoing Figure 5 and Figure 6 . It should be noted that this method is not limited to Figure 18And subject to the specific order described below, it should be understood that in some embodiments, the order of some of the steps of this method can be interchanged according to actual needs, or some of the steps can also be omitted or deleted. The method includes the following steps:

[0198] S1801, the terminal device acquires the set ringtone signal.

[0199] In some embodiments, the terminal device can acquire the ringtone signal set for this terminal device from the ringtone settings option.

[0200] S1802, the terminal device acquires at least one first ringtone signal segment corresponding to the first speaker and at least one second ringtone signal segment corresponding to the second speaker in the ringtone signal.

[0201] In some embodiments, the terminal device can acquire at least one first ringtone signal segment corresponding to the first speaker and at least one second ringtone segment corresponding to the second speaker in the ringtone signal based on the duration of a segment of ultrasonic signal (such as the first duration mentioned above), the total duration of the ringtone signal, and the channel configuration. In some embodiments, the channel configuration of the ultrasonic signal can include the channel for transmitting the ultrasonic signal and the number of segments of the ultrasonic signal transmitted in each channel in each round.

[0202] S1803, the terminal device determines the intensity of the ultrasonic signal.

[0203] In some embodiments, taking the first sound signal as an example, the terminal device can determine the intensity of the ringtone signal and determine the intensity of the ultrasonic signal based on the intensity of the ringtone signal and the intensity compensation for the ultrasonic signal. Exemplarily, as Figure 5 shown, the intensity of the ringtone signal is E1 and the intensity compensation for the ultrasonic signal is ΔE, then the intensity E2 of the ultrasonic signal = E1 + ΔE.

[0204] Among them, the greater the intensity of the ultrasonic signal, the larger the coverage range of the ultrasonic signal. The intensity compensation for the ultrasonic signal can ensure that the ultrasonic signal can cover a preset coverage range (such as 1 meter - 1.5 meters) and improve the influence of the ringtone signal on the ultrasonic signal.

[0205] In some embodiments, the intensity of the first sound signal can be less than the intensity threshold corresponding to the first speaker, and the intensity of the second sound signal can be less than the intensity threshold corresponding to the second speaker.

[0206] In some embodiments, S1803 can be omitted.

[0207] S1804, the terminal device superimposes the ultrasonic signal on each first ringtone signal segment in the ringtone signal respectively to obtain a first sound signal, and superimposes the ultrasonic signal on each second ringtone signal segment in the ringtone signal respectively to obtain a second sound signal.

[0208] The terminal device can traverse the ringtone signal, so as to superimpose the ultrasonic signal on each first ringtone signal segment in the ringtone signal respectively to generate a first sound signal, or superimpose the ultrasonic signal on each second ringtone signal segment in the ringtone signal respectively to generate a second sound signal.

[0209] Please refer to Figure 19 , which is a flowchart of a method for generating a sound signal provided by an embodiment of the present application. Among them, this method can be a detailed description of the foregoing S401. In some embodiments, Figure 19 The method shown can generate the first sound signal and the second sound signal in the foregoing Figures 7 - 11 . It should be noted that this method is not limited by Figure 19 and the specific order described below. It should be understood that in some embodiments, the order of some steps of this method can be interchanged according to actual needs, or some of the steps can also be omitted or deleted. This method includes the following steps:

[0210] S1901, the terminal device obtains the set ringtone signal.

[0211] In some embodiments, the manner in which the terminal device executes S1901 can be the same as or similar to the manner in which it executes S1801.

[0212] S1902, the terminal device obtains at least one first ringtone signal segment corresponding to the first speaker and at least one second ringtone segment corresponding to the second speaker in the ringtone signal.

[0213] In some embodiments, the manner in which the terminal device executes S1702 can be the same as or similar to the manner in which it executes S1602.

[0214] S1903, the terminal device determines the intensity of the ultrasonic signal.

[0215] In some embodiments, the intensity of the ultrasonic signal can be less than the intensity threshold corresponding to the first speaker and / or the intensity threshold corresponding to the second speaker. That is, the ultrasonic signal can be emitted at the maximum intensity allowed by the speaker.

[0216] In some embodiments, S1903 can be omitted.

[0217] In S1904, the terminal device replaces each of the foregoing first ring signal segments in the ring signal with an ultrasonic signal to obtain a first sound signal, and replaces each of the second ring signal segments in the ring signal with an ultrasonic signal to obtain a second sound signal.

[0218] The terminal device can traverse the ring signal, thereby replacing each of the first ring signal segments in the ring signal with an ultrasonic signal to generate a first sound signal, or replacing each of the second ring signal segments in the ring signal with an ultrasonic signal to generate a second sound signal.

[0219] Based on the same inventive concept, as an implementation of the above method, an embodiment of the present application provides a sound signal processing device. The device embodiment corresponds to the foregoing method embodiment. For the convenience of reading, the details in the foregoing method embodiment will not be described one by one in this device embodiment. However, it should be clear that the device in this embodiment can correspondingly implement all the contents in the foregoing method embodiment.

[0220] In a possible implementation manner, the sound signal processing device can correspond to the terminal device in the foregoing method embodiment. For example, it can be a terminal device or a chip configured in the terminal device. The sound signal processing device is used to execute each step or process corresponding to the terminal device in the above method.

[0221] Based on the same inventive concept, an embodiment of the present application further provides a terminal device. The terminal device includes: a memory and a processor. The memory is used to store a computer program; the processor is used to execute the method described in the foregoing method embodiment when calling the computer program.

[0222] The terminal device provided in this embodiment can execute the foregoing method embodiment, and its implementation principle and technical effect are similar, and will not be described here.

[0223] Based on the same inventive concept, an embodiment of the present application further provides a chip system. The chip system includes a processor, and the processor is coupled to a memory. The processor executes a computer program stored in the memory to implement the method described in the foregoing method embodiment.

[0224] Among them, the chip system can be a single chip or a chip module composed of multiple chips.

[0225] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described in the foregoing method embodiment is implemented.

[0226] An embodiment of the present application further provides a computer program product. When the computer program product runs on a terminal device, the terminal device is caused to execute the method described in the foregoing method embodiment.

[0227] When the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such understanding, to implement all or part of the processes in the above embodiment methods of this application, a computer program can be used to instruct relevant hardware to complete. The computer program can be stored in a computer-readable storage medium. When the computer program is executed by a processor, the steps of the above various method embodiments can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in the form of source code, object code, executable file or some intermediate form, etc. The computer-readable storage medium can at least include: any entity or device capable of carrying the computer program code to a terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk, or an optical disc, etc.

[0228] In the above embodiments, the descriptions of the various embodiments have their own emphases. For parts not detailed or recorded in a certain embodiment, reference can be made to the relevant descriptions of some embodiments.

[0229] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed in this document can be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of this application.

[0230] In the embodiments provided in this application, it should be understood that the disclosed device / equipment and method can be implemented in other ways. For example, the device / equipment embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection to each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0231] It should be understood that, as used in the specification of this application and the appended claims, the term "comprising" indicates the presence of the described features, integers, steps, operations, elements and / or components, but does not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or their combinations.

[0232] It should also be understood that the term "and / or" as used in the specification of this application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0233] As used in the specification of this application and the appended claims, the term "if" may be construed, depending on the context, as "when" or "once" or "in response to determining" or "in response to detecting". Similarly, the phrases "if determined" or "if detected [the described condition or event]" may be construed, depending on the context, to mean "once determined" or "in response to determining" or "once detected [the described condition or event]" or "in response to detecting [the described condition or event]".

[0234] In addition, in the description of the specification of this application and the appended claims, the terms "first", "second", "third", etc. are used only for descriptive distinction and should not be construed as indicating or implying relative importance.

[0235] Reference to "an embodiment" or "some embodiments" or the like described in the specification of this application means that a particular feature, structure or characteristic described in connection with that embodiment is included in one or more embodiments of this application. Thus, statements such as "in an embodiment", "in some embodiments", "in other some embodiments", "in still other embodiments", etc. that appear in different places in this specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized. The terms "comprising", "including", "having" and their variants all mean "including but not limited to", unless otherwise specifically emphasized.

[0236] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit them; although this application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for processing voice signals, characterized in that The method is applied to a terminal device, which includes a first speaker, a second speaker, and a microphone. The method includes: When a trigger ringing event is detected, a first sound signal is transmitted through the first speaker, and a second sound signal is transmitted through the second speaker. The first sound signal and the second sound signal are obtained by fusing a ringing signal and an ultrasonic signal, and the ultrasonic signals in the first sound signal and the second sound signal do not overlap in the time domain.

2. The method according to claim 1, characterized in that The transmitting the first sound signal through the first speaker and the second sound signal through the second speaker includes: When the first speaker transmits the ringing signal in the first sound signal, the second speaker stops transmitting the ringing signal in the second sound signal; when the second speaker transmits the ringing signal in the second sound signal, the first speaker stops transmitting the ringing signal in the first sound signal.

3. The method according to claim 1 or 2, characterized in that, The transmitting the first sound signal through the first speaker and the second sound signal through the second speaker includes: alternately transmitting the ringing signal and the ultrasonic signal in the first sound signal through the first speaker; and / or alternately transmitting the ringing signal and the ultrasonic signal in the second sound signal through the second speaker.

4. The method according to any one of claims 1-3, characterized in that, Before transmitting the first sound signal through the first speaker and the second sound signal through the second speaker, the method further includes: obtaining the set ringing signal; obtaining at least one first ringing signal segment corresponding to the first speaker and at least one second ringing signal segment corresponding to the second speaker in the ringing signal; replacing each of the first ringing signal segments in the ringing signal with the ultrasonic signal to obtain the first sound signal; replacing each of the second ringing signal segments in the ringing signal with the ultrasonic signal to obtain the second sound signal.

5. The method according to claim 4, wherein The ultrasonic signal is a frequency-modulated continuous wave FMCW.

6. The method according to claim 1, wherein Before transmitting the first sound signal through the first speaker and the second sound signal through the second speaker, the method further includes: obtaining the set ringing signal; obtaining at least one first ringing signal segment corresponding to the first speaker and at least one second ringing signal segment corresponding to the second speaker in the ringing signal; superposing the ultrasonic signal with each of the first ringing signal segments in the ringing signal to obtain the first sound signal; superposing the ultrasonic signal with each of the second ringing signal segments in the ringing signal to obtain the second sound signal.

7. The method according to claim 6, wherein The ultrasonic signal is a continuous wave CW.

8. The method according to any one of claims 1-7, characterized in that The method further includes: When it is detected that the first speaker or the second speaker is blocked, a third sound signal is emitted through the unblocked speaker among the first speaker and the second speaker, and a ring signal is emitted through the blocked speaker among the first speaker and the second speaker. The third sound signal is obtained by fusing the ring signal and the ultrasonic signal.

9. The method according to any one of claims 1-7, characterized in that, The method further includes: When it is detected that the first speaker or the second speaker is blocked, a third sound signal is emitted through the unblocked speaker among the first speaker and the second speaker, and a fourth sound signal is emitted through the blocked speaker among the first speaker and the second speaker. The third sound signal is obtained by fusing the ring signal and the ultrasonic signal, the fourth sound signal is obtained based on the ring signal, and when the first speaker emits the ring signal in the third sound signal, the second speaker stops emitting the ring signal in the fourth sound signal, and when the second speaker emits the ring signal in the fourth sound signal, the first speaker stops emitting the ring signal in the third sound signal.

10. The method according to any one of claims 1-9, characterized in that, The method further includes: Obtaining a reflection signal of the ultrasonic signal by the microphone; Determining a first motion feature of the target object based on the obtained reflection signal; If the first motion feature of the target object is the same as a preset second motion feature, then processing the ringing event based on a processing strategy corresponding to the second motion feature.

11. A terminal device, characterized in that, Including: A memory and a processor, the memory is used for storing a computer program; the processor is used for executing the method according to any one of claims 1-10 when calling the computer program.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, The computer program, when executed by the processor, implements the method according to any one of claims 1-10.

13. A computer program product, characterized in that, When the computer program product runs on a terminal device, the terminal device is caused to execute the method according to any one of claims 1-10.

Images