Voice communication method and device and storage medium

Abstract

The invention provides a voice communication method and device and a storage medium. The voice communication method comprises the following steps: performing voice communication in response to a terminal, and obtaining a communication voice signal and a sound signal for generating a masking sound signal; and generating a masking sound signal based on the sound signal and the call voice signal. And playing the call voice signal and the masking sound signal. According to the method and the device, the masking sound signal is generated based on the call voice signal and the sound signal, so that the call voice signal can be better masked, and surrounding users are prevented from being interfered.

Description

Technical Field

[0001] The present disclosure relates to the field of mobile communications, and in particular to a voice call method, device and storage medium. Background Art

[0002] With the development of mobile communication technology and the Internet, users are using terminals to make voice calls in more and more scenarios, and their requirements for call privacy and security are also increasing.

[0003] By playing a masking sound when a terminal is making a voice call, the user's voice call content can be masked, thereby ensuring the privacy and security of the call. However, the currently played masking sound cannot be synchronized with the user's voice call, which still causes sound leakage and cannot effectively mask the user's voice call content. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a voice call method, device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a voice call method is provided, comprising: in response to a terminal making a voice call, obtaining a call voice signal and a sound signal for generating a concealed sound signal; generating a masking sound signal based on the sound signal and the call voice signal; and playing the call voice signal and the masking sound signal.

[0006] In one implementation, the playing of the call voice signal and the masking sound signal includes: controlling a first sound emitting device of the terminal to emit the call voice signal, and controlling a second sound emitting device of the terminal to emit the masking sound signal.

[0007] In one embodiment, the first sound-emitting device is a diaphragm of a dipole speaker in the terminal close to a user, and the second sound-emitting device is a diaphragm of a dipole speaker in the terminal away from a user; or the first sound-emitting device is a handset of the terminal, and the second sound-emitting device is a speaker of the terminal.

[0008] In one embodiment, generating a masking sound signal based on the sound signal and the call voice signal includes: frequency matching the sound signal according to the frequency of the call voice signal; and using a sound signal whose frequency and loudness match the call voice signal as the masking sound signal.

[0009] In one embodiment, the frequency matching of the sound signal according to the frequency of the call voice signal includes: obtaining the frequency spectrum of the call voice signal; performing spectrum equalization on the frequency of the sound signal in frames according to the frequency spectrum of the call voice signal to obtain a sound signal whose frequency matches that of the call voice signal; wherein the sound signal whose frequency matches that of the call voice signal includes a sound signal whose frequency spectrum distribution has a similarity with that of the call voice signal that is less than a threshold value; and spectrum equalization processing parameters used for performing spectrum equalization processing on the frequency of the sound signal change in real time based on changes in the frequency spectrum of the call voice signal.

[0010] In one embodiment, the loudness matching according to the loudness of the call voice signal includes: obtaining the loudness envelope of the call voice signal; adjusting the loudness envelope of the sound signal to be consistent with the loudness envelope of the call voice signal, and obtaining a sound signal whose loudness matches the call voice signal.

[0011] In one embodiment, the sound signal includes at least one of the following sound signals pre-stored in the terminal: a sound signal of a preset frequency band; a sound signal of a preset timbre; a sound signal played continuously within a preset duration.

[0012] According to a second aspect of an embodiment of the present disclosure, there is provided a voice communication device, including:

[0013] an acquisition unit, configured to acquire a call voice signal and a sound signal for generating a concealed sound signal in response to the terminal making a voice call;

[0014] A generating unit, configured to generate a masking sound signal based on the sound signal and the call voice signal;

[0015] The playing unit is used to play the call voice signal and the masking sound signal.

[0016] In one implementation, the playback unit plays the call voice signal and the masker sound signal in the following manner: controlling a first sound emitting device of the terminal to emit the call voice signal, and controlling a second sound emitting device of the terminal to emit the masker sound signal.

[0017] In one implementation, the first sound-emitting device is a diaphragm on a side of a dipole speaker in the terminal close to a user, and the second sound-emitting device is a diaphragm on a side of a dipole speaker in the terminal far from a user; or

[0018] The first sound-emitting device is a receiver of the terminal, and the second sound-emitting device is a speaker of the terminal, wherein the speaker is different from the receiver of the terminal.

[0019] In one embodiment, the generating unit generates a masking sound signal based on the sound signal and the call voice signal in the following manner: frequency matching the sound signal according to the frequency of the call voice signal; and using a sound signal whose frequency and loudness match the call voice signal as the masking sound signal.

[0020] In one embodiment, the generating unit performs frequency matching of the sound signal according to the frequency of the call voice signal in the following manner: obtaining the frequency spectrum of the call voice signal; performing spectrum equalization on the frequency of the sound signal in frames according to the frequency spectrum of the call voice signal to obtain a sound signal whose frequency matches that of the call voice signal; wherein the sound signal whose frequency matches that of the call voice signal includes a sound signal whose frequency spectrum distribution has a similarity with that of the call voice signal that is less than a threshold value; and spectrum equalization processing parameters used for performing spectrum equalization processing on the frequency of the sound signal change in real time based on changes in the frequency spectrum of the call voice signal.

[0021] In one embodiment, the generation unit performs loudness matching according to the loudness of the call voice signal in the following manner: obtaining the loudness envelope of the call voice signal; adjusting the loudness envelope of the sound signal to be consistent with the loudness envelope of the call voice signal, and obtaining a sound signal whose loudness matches the call voice signal.

[0022] In one implementation, the playback unit plays at least one of the following sound signals pre-stored in the terminal: a sound signal of a preset frequency band; a sound signal of a preset timbre; a sound signal played continuously within a preset duration.

[0023] According to a third aspect of an embodiment of the present disclosure, there is provided a voice communication device, including:

[0024] processor;

[0025] a memory for storing processor-executable instructions;

[0026] The processor is configured to: execute the method described in the first aspect or any one of the embodiments of the first aspect.

[0027] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the voice call method described in the first aspect or any one of the embodiments of the first aspect.

[0028] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: by obtaining a call voice signal and a sound signal for generating a masking sound signal when a voice call is made on the terminal, matching the sound signal with the call voice signal to generate a masking sound signal, and compensating for the sound leakage problem caused by the lack of synchronization between the masking sound signal and the call voice signal, thereby achieving the effect of reducing sound leakage and making the call voice signal better masked.

[0029] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0031] Figure 1 The figure is a schematic diagram of an application scenario of a method for canceling sound leakage according to an exemplary embodiment.

[0032] Figure 2 It is a schematic diagram showing a method for processing a masker sound signal according to an exemplary embodiment.

[0033] Figure 3 The figure is a flow chart of a voice call method according to an exemplary embodiment.

[0034] Figure 4 The figure is a flow chart of a voice call method according to an exemplary embodiment.

[0035] Figure 5 It is a schematic structural diagram of a terminal with a dipole speaker according to an exemplary embodiment.

[0036] Figure 6 The figure is a flow chart of a voice call method according to an exemplary embodiment.

[0037] Figure 7 The figure is a flow chart showing a method for generating a masker signal based on a sound signal and a call voice signal according to an exemplary embodiment.

[0038] Figure 8 The present invention is a flowchart showing a method for frequency matching a sound signal based on a call voice signal according to an exemplary embodiment.

[0039] Fig. 9 The present invention is a flowchart showing a method for performing loudness matching on a sound signal based on a call voice signal according to an exemplary embodiment.

[0040] Fig.10The figure is a flow chart showing a method of processing a sound signal according to an exemplary embodiment.

[0041] Fig.11 The figure is a block diagram of a voice communication device according to an exemplary embodiment.

[0042] Fig.12 The invention is a block diagram showing a device for voice communication according to an exemplary embodiment. DETAILED DESCRIPTION

[0043] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0044] The voice call method provided by the present disclosure is applied to a scenario in which a terminal makes a voice call, for example, to a scenario in which a mobile phone makes a voice call.

[0045] At present, when a terminal is making a voice call, there will be sound leakage, which may lead to the leakage of the content of the voice call, user privacy and even business secrets. In order to ensure the privacy and security of the voice call, hardware methods such as controlling the directivity of the speaker and voice signal processing at the receiving end can be used to reduce the sound leakage problem, or masking sound can be played during the voice call to reduce the sound leakage problem.

[0046] Figure 1 In a schematic diagram of an application scenario of a method for canceling sound leakage according to an exemplary embodiment, Figure 1 As shown, the handset 3 plays the call voice signal, and the speaker 4 plays the masking sound signal. The masking sound signal is the inverted signal of the voice signal. However, due to the limitation of the terminal structure, the voice signal played by the handset 3 and the masking sound signal played by the speaker 4 cannot strictly maintain phase synchronization. Therefore, the masking sound signal cannot completely offset the call voice signal, and even in some frequency bands, the masking sound signal is superimposed on the call voice signal, causing more significant sound leakage.

[0047] When making a voice call, the fundamental frequency and amplitude of the call voice signal are extracted, and the noise peak is extracted from the amplitude of the noise signal that matches the fundamental frequency. The extracted fundamental frequency and noise peak are used to synthesize the masking sound. However, when the user is making a voice call, the frequency spectrum of the call voice signal is irregular, making it difficult to accurately extract the fundamental frequency. Therefore, the masking sound synthesized by the fundamental frequency and noise peak cannot mask the call voice signal well.

[0048] Figure 2FIG. 1 is a schematic diagram showing a method for processing a masking sound signal according to an exemplary embodiment. Figure 2 As shown in the figure, when a voice call is made, the call voice signal is frame-inverted and scrambled, and the processed call voice signal is output as a masking sound signal, so as to mask the call voice signal. However, the masking sound signal obtained by frame-inverting and scrambling the call voice signal is a noise signal with a large degree of annoyance, which is easy to cause noise interference to the surrounding environment.

[0049] When the terminal is making a voice call, the masking sound signal cannot well mask the call voice signal, and the played masking sound signal is likely to cause noise interference to the surrounding environment.

[0050] In the voice call method provided by the present disclosure, when making a voice call, a call voice signal and a sound signal for generating a masking sound are obtained, and a masking sound signal is generated based on the call voice signal and the sound signal to compensate for the sound leakage problem caused by the lack of synchronization between the masking sound signal and the call voice signal, thereby covering the call voice signal and reducing the sound leakage phenomenon.

[0051] Figure 3 is a flow chart of a voice call method according to an exemplary embodiment. Figure 3 As shown, the voice call method is used in a terminal and includes the following steps.

[0052] In step S11, in response to the terminal making a voice call, a call voice signal and a sound signal for generating a concealed sound signal are acquired.

[0053] Among them, the sound signal is different from the call voice signal.

[0054] The masking sound signal is a sound signal used to mask other sound signals.

[0055] In step S12, a masking sound signal is generated based on the sound signal and the call voice signal.

[0056] The sound signal is processed based on the call voice signal, and the processed sound signal is used as a masking sound signal.

[0057] The masking sound signal is used to mask the call voice signal.

[0058] In step S13, the call speech signal and the masking sound signal are played.

[0059] In the embodiment of the present disclosure, when a terminal makes a voice call, a call voice signal and a sound signal heard by the user are obtained. The sound signal is different from the call voice signal. The sound signal is processed based on the call voice signal to obtain a masking sound signal, and the call voice signal and the masking sound signal are played.

[0060] In the disclosed embodiment, a sound signal different from the call voice signal is processed based on the call voice signal, and the sound signal generated after the processing is played as a masking sound signal, so that the masking sound signal is similar to the call voice signal, so that the played voice signal can be better covered when the call voice signal is played, thereby reducing sound leakage and achieving a better sound masking effect.

[0061] The following is an explanation of the playback control method involved in the above embodiment.

[0062] In the disclosed embodiment, the call voice signal and the masking sound signal are played by different sound generating devices.

[0063] Among them, the sound-emitting device that plays the call voice signal is called the first sound-emitting device; the sound-emitting device that plays the masking sound signal is called the second sound-emitting device.

[0064] The first sound-emitting device may be a diaphragm of a dipole speaker in the terminal close to the user, and the second sound-emitting device may be a diaphragm of a dipole speaker in the terminal far from the user. Alternatively, the first sound-emitting device may be a handset of the terminal, and the second sound-emitting device may be a speaker of the terminal.

[0065] Figure 4 is a flow chart of a voice call method according to an exemplary embodiment. Figure 4 As shown, the voice call method is used in a terminal, comprising the following steps:

[0066] In step S21, in response to the terminal making a voice call, a call voice signal and a sound signal for generating a concealed sound signal are acquired.

[0067] In step S22, a masking sound signal is generated based on the sound signal and the call voice signal.

[0068] In step S23, the diaphragm of the dipole speaker in the terminal close to the user side is controlled to emit a call voice signal, and the diaphragm of the dipole speaker far from the user side is controlled to emit a masking sound signal.

[0069] Figure 5 FIG. 1 is a schematic diagram showing a structure of a terminal having a dipole speaker according to an exemplary embodiment. Figure 5 As shown, the dipole speaker is located above the terminal, wherein the diaphragm 1 on the side of the dipole speaker close to the user is the front side of the dipole speaker, which is used to play the call voice signal. The diaphragm 2 on the side of the dipole speaker away from the user is the back side of the dipole speaker, which is used to play the masking sound signal.

[0070] In the embodiment of the present disclosure, the terminal has a speaker with a dipole structure. When the terminal makes a voice call, a call voice signal and a sound signal in the voice call are obtained, and the sound signal is processed based on the call voice signal to obtain a masking sound signal. The call voice signal is emitted by the diaphragm on the side of the speaker with a dipole structure close to the user, and the masking sound signal is emitted by the diaphragm on the side of the speaker with a dipole structure far from the user.

[0071] In the disclosed embodiment, the call voice signal is emitted by the diaphragm on the side of the speaker with a dipole structure close to the user, and the masking sound signal is emitted by the diaphragm on the side of the speaker with a dipole structure far from the user. According to the structure of the dipole speaker, the phase of the masking sound signal can be synchronized with the phase of the call voice signal, so that the masking sound signal can better mask the call voice signal, thereby reducing sound leakage and achieving a better masking effect.

[0072] Figure 6 is a flow chart of a voice call method according to an exemplary embodiment. Figure 6 As shown, the voice call method is used in a terminal, comprising the following steps:

[0073] In step S31, in response to the terminal making a voice call, a call voice signal and a sound signal for generating a concealed sound signal are acquired.

[0074] In step S32, a masking sound signal is generated based on the sound signal and the call voice signal.

[0075] In step S33, the handset of the control terminal sends out a call voice signal, and the speaker of the control terminal sends out a masking sound signal.

[0076] In the embodiment of the present disclosure, when the terminal makes a voice call, a call voice signal and a sound signal in the voice call are obtained, the sound signal is processed based on the call voice signal to obtain a masking sound signal, and the signal is emitted through the terminal speaker, while the call voice signal can be emitted by the terminal receiver.

[0077] In the disclosed embodiment, a call voice signal is sent through a terminal receiver and a masking sound signal is sent through a terminal speaker, which reduces the requirements on the terminal structure and enables the terminal to play the call voice signal and the masking sound signal based on its own existing hardware, so there is no need to change the terminal hardware structure.

[0078] In the embodiment of the present disclosure, the sound signal used to generate the masking sound is different from the call voice signal. The sound signal is matched based on the call voice signal, and the matched sound signal is used as the masking sound signal.

[0079] The matching of the sound signal based on the call voice signal may be frequency matching of the sound signal based on the call voice signal.

[0080] The matching of the sound signal based on the call voice signal may be loudness matching of the sound signal based on the call voice signal.

[0081] Figure 7 is a flow chart showing a method for generating a masking sound signal based on a sound signal and a call voice signal according to an exemplary embodiment. Figure 7 As shown, the voice call method is used in a terminal, comprising the following steps:

[0082] In step S41, the sound signal is frequency matched according to the frequency of the call voice signal, and the loudness is matched according to the loudness of the call voice signal.

[0083] Among them, frequency matching makes the frequency spectrum of the sound signal similar to the frequency spectrum of the call voice signal.

[0084] Among them, loudness matching makes the loudness change of the sound signal consistent with the loudness change of the call voice signal.

[0085] In step S42, a sound signal whose frequency and loudness match the call voice signal is used as a masking sound signal.

[0086] In the disclosed embodiment, when the terminal makes a voice call, a call voice signal and a sound signal are obtained, the obtained sound signal is frequency matched and loudness matched with the call voice signal to obtain a masking sound signal, and the call voice signal and the masking sound signal are played.

[0087] In one scenario, after acquiring a call voice signal and a sound signal, the sound signal can be frequency matched according to the call voice signal so that the frequency spectra of the call voice signal and the sound signal are similar. The sound signal can be loudness matched according to the call voice signal so that the loudness of the sound signal is consistent with the loudness of the call voice signal.

[0088] In one scenario, after obtaining a call voice signal and a sound signal, the sound signal can be matched in loudness according to the call voice signal to make the sound signal loudness consistent with the call voice signal loudness. According to the call voice signal, the sound signal can be matched in frequency to make the call voice signal and the sound signal have similar frequency spectra.

[0089] In the disclosed embodiment, a sound signal after frequency matching and loudness matching according to the spectrum and loudness of the call voice signal is used as a masking sound signal. Therefore, the spectrum and loudness of the masking sound signal are similar to the spectrum and loudness of the call voice, so that the masking sound signal can better cover the call voice signal, thereby reducing call leakage and achieving a sound masking effect.

[0090] In the disclosed embodiment, the spectrum of the masking sound signal is similar to the spectrum of the call voice signal, and the loudness of the masking sound signal is the same as the loudness of the call voice signal, that is, the volume of the masking sound signal played by the terminal is the same as the volume of the call voice signal played. When the terminal plays the call voice signal and the masking sound signal, for the user using the terminal, since the user is closer to the sound device that plays the call voice signal and farther from the sound device that plays the masking sound signal, the volume of the call voice signal obtained by the user using the terminal is greater than the volume of the sound signal. Therefore, the user using the terminal can use the masking sound as background sound and obtain the call voice signal for voice calls. For the crowd in the surrounding environment of the terminal, the volume of the call voice signal obtained by the crowd in the surrounding environment is similar to the volume of the sound signal. Therefore, the masking sound signal can completely cover the call voice signal, so that the crowd in the surrounding environment of the terminal obtains the signal is the masking sound signal, thereby achieving the purpose of sound masking and ensuring the privacy and security of the user's voice call.

[0091] In the embodiment of the present disclosure, the spectrum of the masking sound signal may be a spectrum obtained by frequency matching the sound signal according to the frequency of the call voice signal.

[0092] Figure 8 is a flow chart showing a method for frequency matching a sound signal based on a call voice signal according to an exemplary embodiment. Figure 8 As shown, the frequency matching method is used in a terminal, comprising the following steps:

[0093] In step S51, the frequency spectrum of the call voice signal is obtained.

[0094] In step S52, according to the frequency spectrum of the call voice signal, the frequency spectrum equalization processing is performed on the frequency of the sound signal in frames to obtain a sound signal whose frequency matches the call voice signal.

[0095] In the embodiment of the present disclosure, when the sound signal whose frequency matches the call voice signal includes a sound signal whose spectral distribution has a similarity with the spectral distribution of the call voice signal that is less than a threshold, the spectral equalization processing parameters used for spectral equalization processing of the frequency of the sound signal change in real time based on the spectral changes of the call voice signal.

[0096] In the embodiment of the present disclosure, frequency matching of the sound signal can be performed by analyzing the spectrum of the call voice signal and the spectrum of the sound signal frame by frame, and performing spectrum equalization (EQ) processing on the sound signal frame by frame according to the spectrum of the call voice signal, so that the spectrum distribution of the sound signal after spectrum equalization processing is similar to that of the call voice signal.

[0097] The spectrum equalization processing may be to adjust the spectrum equalization parameters according to the call voice signal.

[0098] In one scenario, when the terminal is making a voice call, the spectrum of the sound signal and the spectrum of the call voice signal are obtained. If the similarity between the spectrum distribution of the sound signal and the spectrum distribution of the call voice signal is less than a threshold, the current call voice signal is analyzed to obtain the spectrum equalization parameters corresponding to the current voice call signal. The frequency of the sound signal is processed frame by frame according to the current spectrum equalization parameters. For example, when the terminal is making a voice call, the sound signal and the call voice signal are obtained, wherein the call voice signal may be the timbre of the user's voice. The user's timbre is analyzed to obtain spectrum equalization parameters, including frequency, gain, and bandwidth. The sound signal is processed based on the spectrum equalization parameters so that the spectrum of the sound signal after processing is similar to the spectrum of the user's voice, thereby achieving the effect of sound masking.

[0099] In the disclosed embodiment, the frequency of the sound signal is made similar to the frequency of the call voice signal through frequency matching, thereby ensuring that the call voice signal can be covered by the sound signal with similar frequency, thereby achieving the effect of sound masking.

[0100] In the embodiment of the present disclosure, the loudness envelope of the masking sound signal may be obtained by performing loudness matching of the sound signal according to the loudness of the call voice signal.

[0101] Fig. 9 is a flow chart showing a method for loudness matching of a sound signal based on a call voice signal according to an exemplary embodiment. Fig. 9 As shown, the loudness matching method is used in a terminal, comprising the following steps:

[0102] In step S61, the loudness envelope of the call speech signal is obtained.

[0103] In step S62, the loudness envelope of the sound signal is adjusted to be consistent with the loudness envelope of the call voice signal, so as to obtain a sound signal whose loudness matches the call voice signal.

[0104] In the disclosed embodiment, when a terminal makes a voice call, the loudness of the call voice signal is obtained, and the loudness envelope of the call voice signal is analyzed in real time, wherein the loudness envelope is a line connecting the loudness peaks, and the loudness envelope reflects the change in the volume of the call voice signal. The sound signal is played according to the loudness envelope of the call voice signal, so as to obtain a sound signal with the same loudness as the call voice signal.

[0105] In the disclosed embodiment, loudness matching is used to make the loudness of the call voice signal consistent with the loudness of the sound signal, so that the call voice signal can be masked while ensuring that the loudness of the sound signal is not too loud, thereby affecting the user's voice call.

[0106] In the embodiment of the present disclosure, when a terminal makes a voice call, a sound signal for generating a masker sound signal is acquired, and the sound signal for generating a masker sound is pre-stored in the terminal.

[0107] In the embodiment of the present disclosure, the sound signal pre-stored in the terminal may be a sound signal of a preset frequency band or a preset timbre.

[0108] In the embodiment of the present disclosure, the sound signal pre-stored in the terminal may be a sound signal that is played continuously within a preset time period.

[0109] In the embodiment of the present disclosure, the frequency band and timbre of the sound signal of the preset frequency band or preset timbre are collected and stored in the terminal. For example, music is used as a sound signal, the frequency and timbre of the frequency band when the music is played are collected and stored in the terminal. Or the sound of rain in nature is used as a sound signal, the frequency and timbre of any frequency band of the rain sound are collected and stored in the terminal.

[0110] The preset frequency band can control the pitch of the sound. For example, the preset frequency band can be a frequency band of music.

[0111] The sound signal of the preset frequency band or preset timbre pre-stored in the terminal may be a music signal or a natural sound signal. For example, the natural sound signal may be the sound of flowing water, the sound of birds, etc. The sound signal of the preset frequency band or preset timbre is not limited here.

[0112] In one scenario, the sound signal pre-stored in the terminal may be a sound signal that is played continuously within a preset time length, so the terminal can obtain a continuous sound signal when making a voice call. The acquired call voice signal may be a discontinuous signal. For example, a discontinuous call voice signal may be a pause when the user is speaking. The masking sound signal obtained based on the sound signal and the call voice signal is a continuous signal. When the terminal makes a voice call, the continuous masking sound signal can completely cover the discontinuous voice signal, thereby avoiding sound leakage caused by the asynchrony between the masking sound signal and the call voice signal.

[0113] In the disclosed embodiment, when a preset frequency band or preset timbre is used as a masking sound, the masking sound is a relatively pleasant sound. Therefore, when the terminal plays the masking sound, it can avoid generating noise signals, thereby reducing interference to users in the surrounding environment.

[0114] In the embodiments of the present disclosure, a voice call method of a terminal with a dipole speaker is described in combination with the following examples.

[0115] Among them, the sound signal is not used for a music signal of a call voice signal as an example.

[0116] When the user makes a voice call, the call voice signal and the music signal preset in the terminal are obtained. Fig.10 FIG. 1 is a flow chart showing a method of processing a sound signal according to an exemplary embodiment. Fig.10 As shown, the acquired music signal is frequency matched and loudness matched based on the call voice signal. The music signal after frequency matching and loudness matching is used as a masking sound signal and played by the back diaphragm of the dipole speaker. The call voice signal is played by the front diaphragm of the dipole speaker.

[0117] Among them, frequency matching can be to obtain the spectrum of the music signal and the spectrum of the call voice signal, adjust the spectrum equalization parameters according to the call voice signal, and perform spectrum equalization processing on the music signal according to the spectrum of the call voice signal, so as to obtain the music signal after frequency matching.

[0118] The loudness of the frequency-matched music signal can be matched by obtaining the loudness envelope of the frequency-matched music signal and the loudness envelope of the call voice signal, and applying the loudness envelope of the call voice signal to the frequency-matched music signal to obtain a music signal whose frequency and loudness match the call voice signal, and use the music signal whose frequency and loudness match the call voice signal as a masking sound signal.

[0119] In the disclosed embodiment, the spectrum and loudness of the masking sound signal are similar to those of the call voice signal, and the continuous masking sound signal can better mask the call voice signal. In addition, the music signal whose frequency and loudness match the call voice signal is used as the masking sound signal to make the masking sound signal more pleasant to the ear, avoiding the generation of noise signals and interfering with other users.

[0120] Based on the same concept, the embodiment of the present disclosure also provides a voice communication device.

[0121] It is understandable that the voice call device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0122] Fig.11 1 is a block diagram of a voice communication device 100 according to an exemplary embodiment. Fig.11The device includes an acquisition unit 101, a generation unit 102 and a playback unit 103.

[0123] an acquisition unit, configured to acquire a call voice signal and a sound signal for generating a concealed sound signal in response to the terminal making a voice call;

[0124] A generating unit, configured to generate a masking sound signal based on the sound signal and the call voice signal;

[0125] The playing unit is used to play the call voice signal and the masking sound signal.

[0126] In one implementation, the playing unit 103 plays the call voice signal and the masking sound signal in the following manner: controlling the first sound emitting device of the terminal to emit the call voice signal, and controlling the second sound emitting device of the terminal to emit the masking sound signal.

[0127] In one implementation, the first sound-emitting device is a diaphragm of a dipole speaker in the terminal close to the user, and the second sound-emitting device is a diaphragm of a dipole speaker in the terminal far from the user. Alternatively, the first sound-emitting device is a receiver of the terminal, and the second sound-emitting device is a speaker of the terminal.

[0128] In one implementation, the generation unit 102 generates the masking sound signal based on the sound signal and the call voice signal in the following manner: frequency matching the sound signal according to the frequency of the call voice signal, and using the sound signal whose frequency and loudness match the call voice signal as the masking sound signal.

[0129] In one implementation, the generation unit 102 performs frequency matching of the sound signal according to the frequency of the call voice signal in the following manner: the frequency spectrum of the call voice signal is obtained. According to the frequency spectrum of the call voice signal, the frequency of the sound signal is subjected to spectral equalization processing in frames to obtain a sound signal whose frequency matches that of the call voice signal. The sound signal whose frequency matches that of the call voice signal includes a sound signal whose frequency spectrum distribution is less than a threshold value. The spectral equalization processing parameters used for spectral equalization processing of the frequency of the sound signal change in real time based on the change of the frequency spectrum of the call voice signal.

[0130] In one implementation, the generation unit 102 performs loudness matching according to the loudness of the call voice signal in the following manner: obtaining the loudness envelope of the call voice signal, adjusting the loudness envelope of the sound signal to be consistent with the loudness envelope of the call voice signal, and obtaining a sound signal whose loudness matches the call voice signal.

[0131] In one implementation, the playing unit 103 plays at least one of the following sound signals pre-stored in the terminal: a sound signal of a preset frequency band; a sound signal of a preset timbre; a sound signal played continuously within a preset duration.

[0132] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0133] Fig.12 2 is a block diagram of a device 200 for voice calls according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0134] Reference Fig.12 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0135] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0136] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0137] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0138] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0139] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0140] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0141] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0142] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0143] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0144] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0145] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0146] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0147] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0148] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0149] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0150] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modifications, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0151] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A voice call method, characterized in that: include: In response to the terminal making a voice call, acquiring a call voice signal and a sound signal for generating a masking sound signal; generating a masking sound signal based on the sound signal and the call voice signal; The call voice signal and the masking sound signal are played.

2. The voice call method according to claim 1, characterized in that: The playing of the call voice signal and the masking sound signal includes: The first sound-emitting device of the terminal is controlled to emit the call voice signal, and the second sound-emitting device of the terminal is controlled to emit the masking sound signal.

3. The method according to claim 2, characterized in that The first sound-generating device is a diaphragm on a side of a dipole speaker in the terminal close to the user, and the second sound-generating device is a diaphragm on a side of the dipole speaker far from the user; or The first sound-emitting device is a receiver of the terminal, and the second sound-emitting device is a speaker of the terminal.

4. The method according to any one of claims 1 to 3, characterized in that: The generating a masking sound signal based on the sound signal and the call voice signal comprises: Performing frequency matching on the sound signal according to the frequency of the call voice signal, and performing loudness matching on the sound signal according to the loudness of the call voice signal; The sound signal whose frequency and loudness match the call voice signal is used as the masking sound signal.

5. The method according to claim 4, characterized in that The frequency matching of the sound signal according to the frequency of the call voice signal includes: Acquire the frequency spectrum of the call voice signal; According to the frequency spectrum of the call voice signal, performing spectrum equalization processing on the frequency of the sound signal in frames to obtain a sound signal whose frequency matches the call voice signal; The sound signal whose frequency matches the call voice signal includes a similarity between the frequency spectrum distribution of the sound signal and the frequency spectrum distribution of the call voice signal being less than a threshold value; The spectrum equalization processing parameters used for performing spectrum equalization processing on the frequency of the sound signal change in real time based on the spectrum change of the call voice signal.

6. The method according to claim 4, characterized in that The performing loudness matching according to the loudness of the call voice signal includes: Obtaining a loudness envelope of the call voice signal; The loudness envelope of the sound signal is adjusted to be consistent with the loudness envelope of the call voice signal, so as to obtain a sound signal whose loudness matches the call voice signal.

7. The voice call method according to claim 1, characterized in that: The sound signal includes at least one of the following sound signals pre-stored in the terminal: Sound signals of preset frequency bands; Sound signals with preset timbres; A sound signal that plays continuously for a preset duration.

8. A voice communication device, characterized in that: include: an acquisition unit, configured to acquire a call voice signal and a sound signal for generating a concealed sound signal in response to the terminal making a voice call; A generating unit, configured to generate a masking sound signal based on the sound signal and the call voice signal; The playing unit is used to play the call voice signal and the masking sound signal.

9. A voice communication device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: execute the voice call method according to any one of claims 1-7.

10. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the terminal, the terminal is enabled to execute the method described in any one of claims 1 to 7.

Images