Signal processing method, device and equipment and computer readable storage medium

Abstract

The invention relates to the technical field of signal processing, in particular to a signal processing method, device and equipment and a computer readable storage medium, and the method comprises the steps: obtaining a bone conduction sound signal through a bone conduction sensor, and obtaining an environment sound signal of an external environment where a call device is located through a microphone of the call device; transmitting the bone conduction sound signal as a call sound signal of a current-end call user to call equipment of an opposite-end call user; according to the environment sound signal or the bone conduction sound signal, carrying out constant-amplitude phase reversal processing to obtain a phase reversal sound signal, and playing the phase reversal sound signal by adopting a loudspeaker of the communication equipment. According to the invention, the privacy security of the user during the call is improved under the condition that the call effect is not influenced.

Description

Technical Field

[0001] The present invention relates to the field of signal processing technology, and in particular to a signal processing method, device, equipment and computer-readable storage medium. Background Art

[0002] With the development of technology, audio and video calls have become an important means for people to communicate over long distances. During an audio or video call, the user's voice can easily be heard by people in the environment or picked up by the audio equipment in the environment, which puts the user's privacy at risk of being leaked; if the user wants to protect his or her call privacy, he or she can only lower the volume of his or her call to avoid being heard or picked up. However, this method can easily make the other end of the call unable to hear the user's voice clearly, reducing the call quality and affecting the user's call experience. Summary of the invention

[0003] The main purpose of the present invention is to provide a signal processing method, device, equipment and computer-readable storage medium, aiming to improve the privacy security of users during calls without affecting the call quality.

[0004] To achieve the above object, the present invention provides a signal processing method, which is applied to a communication device, on which a bone conduction sensor is provided, and comprises the following steps:

[0005] Acquire a bone conduction sound signal through the bone conduction sensor, and acquire an ambient sound signal of the external environment of the calling device through the microphone of the calling device;

[0006] Transmitting the bone conduction sound signal as a call sound signal of the current call user to a call device of the other call user;

[0007] An inverted sound signal is obtained by performing equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal, and the inverted sound signal is played using a speaker of the communication device.

[0008] Optionally, the step of using a speaker of the communication device to play the reverse phase sound signal includes:

[0009] If it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, the speaker of the call device is used to play the reverse phase sound signal.

[0010] Optionally, if it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, before the step of using the speaker of the call device to play the reverse phase sound signal, the step further includes:

[0011] Determining a first signal volume of the bone conduction sound signal, and determining a second signal volume of a call sound signal of the opposite end call user;

[0012] If the volume of the first signal is greater than a first preset threshold, it is determined that the current end calling user is in a speaking state;

[0013] If the volume of the second signal is less than or equal to a second preset threshold, it is determined that the opposite-end calling user is not in a speaking state.

[0014] Optionally, at least two speakers are provided on the communication device, and the step of using the speakers of the communication device to play the reverse phase sound signal includes:

[0015] Determine any one of the at least two speakers as a target speaker, so as to play a call audio signal of the opposite-end call user through the target speaker;

[0016] The anti-phase sound signal is played using a speaker other than the target speaker among the at least two speakers.

[0017] Optionally, the step of performing equal-amplitude inversion processing on the bone conduction sound signal to obtain an inverted sound signal further includes:

[0018] Obtaining a preset privacy opening distance, and calculating an air conduction attenuation value of a call sound signal of the current end call user within the privacy opening distance;

[0019] Performing signal attenuation processing on the bone conduction sound signal based on the air conduction attenuation value to obtain an attenuated sound signal;

[0020] The attenuated sound signal is processed with equal amplitude and inversion to obtain an inverted sound signal.

[0021] Optionally, before the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user, the method further includes:

[0022] Determine the signal amplitude corresponding to each frequency point in the preset frequency band in the bone conduction sound signal, and detect whether the amplitude fluctuation degree of each signal amplitude is greater than the preset fluctuation degree;

[0023] If the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user is performed;

[0024] If the amplitude fluctuation degree is greater than the preset fluctuation degree, amplitude processing is performed on each of the signal amplitudes to obtain an amplitude-processed bone conduction sound signal, and the amplitude-processed bone conduction sound signal is transmitted as the call sound signal of the current call user to the call device of the other call user.

[0025] Optionally, the step of performing amplitude processing on each of the signal amplitudes to obtain an amplitude-processed bone conduction sound signal comprises:

[0026] determining a target amplitude based on each of the signal amplitudes;

[0027] The signal amplitude of each frequency point is adjusted to be consistent with the target amplitude to obtain a bone conduction sound signal after amplitude processing.

[0028] To achieve the above object, the present invention further provides a signal processing device, which is deployed on a communication device, and a bone conduction sensor is provided on the communication device. The signal processing device includes:

[0029] An acquisition module, used to acquire a bone conduction sound signal through the bone conduction sensor, and acquire an ambient sound signal of an external environment of the calling device through the microphone of the calling device;

[0030] A transmission module, used to transmit the bone conduction sound signal as a call sound signal of the current call user to a call device of the other call user;

[0031] The playing module is used to perform equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal to obtain an inverted sound signal, and use the speaker of the communication device to play the inverted sound signal.

[0032] To achieve the above-mentioned purpose, the present invention also provides a signal processing device, which includes: a memory, a processor, and a signal processing program stored in the memory and executable on the processor, and the signal processing program implements the steps of the signal processing method described above when executed by the processor.

[0033] In addition, to achieve the above-mentioned purpose, the present invention further proposes a computer-readable storage medium, on which a signal processing program is stored, and when the signal processing program is executed by a processor, the steps of the signal processing method described above are implemented.

[0034] In the present invention, a bone conduction sensor is arranged on a calling device, a bone conduction sound signal is obtained through the bone conduction sensor, and an ambient sound signal of the external environment of the calling device is obtained through the microphone of the calling device; the bone conduction sound signal is transmitted to the calling device of the calling user at the other end as the calling sound signal of the current end calling user; equal-amplitude inversion processing is performed according to the ambient sound signal or the bone conduction sound signal to obtain an inverted sound signal, and the inverted sound signal is played using the speaker of the calling device.

[0035] When a user makes a call, the sound signal of the user's speech is included in the environmental sound signal, and can be picked up by the bone conduction sensor to obtain the bone conduction sound signal. The present invention performs equal-amplitude inversion processing on the environmental sound signal or the bone conduction sound signal, and the obtained inverted sound signal contains a sound signal with equal amplitude and inverted phase to the sound signal of the user's speech. Therefore, when the inverted sound signal is played, it can be attenuated or offset with the sound signal of the user's speech, thereby reducing the risk of the sound signal of the user's call being transmitted in the external environment and improving the privacy and security of the user's call.

[0036] At the same time, the present invention picks up the user's bone conduction sound signal through the bone conduction sensor and transmits the bone conduction sound signal to the calling user at the other end. Compared with obtaining the sound signal of the user's speech through a microphone, the bone conduction sound signal in the present invention can be unaffected by the external environment, and is not affected by the impact of the playing of the reverse sound signal on the ambient sound signal, so that the sound signal of the current calling user can be transmitted to the calling user more clearly and accurately, ensuring the call effect.

[0037] In summary, the present invention improves the privacy security of users during calls without affecting the call quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 A schematic diagram of the structure of the hardware operating environment involved in the embodiment of the present invention;

[0039] Figure 2 It is a flowchart of a first embodiment of a signal processing method of the present invention;

[0040] Figure 3 A schematic diagram of a flow chart of an embodiment of a signal processing method of the present invention;

[0041] Figure 4 A schematic diagram of a flow chart of an embodiment of a signal processing method of the present invention;

[0042] Figure 5 A schematic diagram of a system structure involved in an implementation manner of a signal processing method of the present invention;

[0043] Figure 6Schematic diagram of functional modules of a preferred embodiment of a signal processing device of the present invention.

[0044] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0045] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0046] like Figure 1 As shown, Figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

[0047] It should be noted that the signal processing device in the embodiment of the present invention may be a communication device with audio and video call functions, or an electronic device that establishes a communication connection with the communication device, such as headphones, smart glasses, head-mounted display devices, etc., and no specific restrictions are made here.

[0048] like Figure 1 As shown, the signal processing device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0049] Those skilled in the art will understand that Figure 1 The device structure shown in the figure does not constitute a limitation on the signal processing device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0050] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a signal processing program. The operating system is a program that manages and controls the hardware and software resources of the device and supports the operation of the signal processing program and other software or programs. Figure 1In the device shown, the user interface 1003 is mainly used for data communication with the client; the network interface 1004 is mainly used for establishing a communication connection with the server; and the processor 1001 can be used to call the signal processing program stored in the memory 1005 and perform the following operations:

[0051] Acquire a bone conduction sound signal through the bone conduction sensor, and acquire an ambient sound signal of the external environment of the calling device through the microphone of the calling device;

[0052] Transmitting the bone conduction sound signal as a call sound signal of the current call user to a call device of the other call user;

[0053] An inverted sound signal is obtained by performing equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal, and the inverted sound signal is played using a speaker of the communication device.

[0054] Furthermore, the step of using the speaker of the communication device to play the reverse phase sound signal includes:

[0055] If it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, the speaker of the call device is used to play the reverse phase sound signal.

[0056] Further, if it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, before the step of using the speaker of the call device to play the reverse phase sound signal, the processor 1001 may also be used to call the signal processing program stored in the memory 1005 to perform the following operations:

[0057] Determining a first signal volume of the bone conduction sound signal, and determining a second signal volume of a call sound signal of the opposite end call user;

[0058] If the volume of the first signal is greater than a first preset threshold, it is determined that the current end calling user is in a speaking state;

[0059] If the volume of the second signal is less than or equal to a second preset threshold, it is determined that the opposite-end calling user is not in a speaking state.

[0060] Furthermore, at least two loudspeakers are provided on the communication device, and the step of using the loudspeakers of the communication device to play the reverse phase sound signal includes:

[0061] Determine any one of the at least two speakers as a target speaker, so as to play a call audio signal of the opposite-end call user through the target speaker;

[0062] The anti-phase sound signal is played using a speaker other than the target speaker among the at least two speakers.

[0063] Furthermore, the step of performing equal-amplitude inversion processing on the bone conduction sound signal to obtain an inverted sound signal also includes:

[0064] Obtaining a preset privacy opening distance, and calculating an air conduction attenuation value of a call sound signal of the current end call user within the privacy opening distance;

[0065] Performing signal attenuation processing on the bone conduction sound signal based on the air conduction attenuation value to obtain an attenuated sound signal;

[0066] The attenuated sound signal is processed with equal amplitude and inversion to obtain an inverted sound signal.

[0067] Furthermore, before the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user, the processor 1001 may also be used to call the signal processing program stored in the memory 1005 to perform the following operations:

[0068] Determine the signal amplitude corresponding to each frequency point in the preset frequency band in the bone conduction sound signal, and detect whether the amplitude fluctuation degree of each signal amplitude is greater than the preset fluctuation degree;

[0069] If the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user is performed;

[0070] If the amplitude fluctuation degree is greater than the preset fluctuation degree, amplitude processing is performed on each of the signal amplitudes to obtain an amplitude-processed bone conduction sound signal, and the amplitude-processed bone conduction sound signal is transmitted as the call sound signal of the current call user to the call device of the other call user.

[0071] Furthermore, the step of performing amplitude processing on each of the signal amplitudes to obtain the amplitude-processed bone conduction sound signal comprises:

[0072] determining a target amplitude based on each of the signal amplitudes;

[0073] The signal amplitude of each frequency point is adjusted to be consistent with the target amplitude to obtain a bone conduction sound signal after amplitude processing.

[0074] Based on the above structure, various embodiments of the signal processing method are proposed.

[0075] Reference Figure 2 , Figure 2FIG. 4 is a flow chart of a first embodiment of a signal processing method according to the present invention.

[0076] The embodiments of the present invention provide embodiments of the signal processing method. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here. In this embodiment, the execution subject of the signal processing method may be a call device, and the call device may be a communication device with audio and video call functions, such as a tablet computer, a personal computer, a smart phone and other devices, or a device that supports call functions and establishes a communication connection with the communication device, such as headphones, smart glasses, head-mounted display devices and other devices. This is not limited in this embodiment. For the sake of convenience of description, the execution subject is omitted to explain each embodiment.

[0077] In this embodiment, a bone conduction sensor is set on the call device, which can be a call device with bone conduction function or a call device without bone conduction function to implement the following embodiments. Further, in a feasible implementation, a bone conduction sensor is set on a call device without bone conduction function, and the setting position of the bone conduction sensor is not limited here. For example, in a feasible implementation, when a user uses a call device, he needs to answer the call sound signal of the opposite call user, so the bone conduction sensor can be set on the device side where the call speaker (that is, the speaker used to play the sound signal of the opposite call user) is located to ensure that the bone conduction sensor is close to the user's body and obtain the human body vibration generated when the user speaks as much as possible, so that the sound signal of the user's speech is clearer. It should be noted that the distance between the bone conduction sensor and the call speaker on the same side can be set to avoid the bone conduction sensor from picking up the vibration of the call speaker; in another feasible implementation, it can also be set according to the specific structure and use method of the call device. For example, if the call device is a smart glasses, the bone conduction sensor can be set on the temple or nose pad to make the bone conduction sensor as close to the user as possible. There is no specific limitation here.

[0078] In this embodiment, the signal processing method includes:

[0079] Step S10, obtaining a bone conduction sound signal through the bone conduction sensor, and obtaining an ambient sound signal of the external environment of the calling device through the microphone of the calling device;

[0080] In this embodiment, the users at both ends of the audio and video call are respectively referred to as the current call user and the opposite call user.

[0081] The bone conduction sound signal is obtained through the bone conduction sensor. The bone conduction sound signal is transmitted to the other end user as the call sound signal of the current call user. In addition, the bone conduction sound signal can also be used as a reference signal for subsequent equal amplitude inversion processing to offset the sound signal transmitted to the external environment when the current call user speaks.

[0082] The ambient sound signal of the external environment in which the calling device is located is obtained through the microphone of the calling device. The ambient sound signal can also be used as a reference signal for subsequent equal-amplitude inversion processing to offset the sound signal transmitted to the external environment when the front-end calling user speaks.

[0083] Step S20, transmitting the bone conduction sound signal as a call sound signal of the current call user to a call device of the other call user;

[0084] In this embodiment, the bone conduction sound signal is transmitted as the call sound signal of the current call user to the call device of the other call user.

[0085] The bone conduction sound signal may include the sound signal of the current call user's speech, or may not include the sound signal of the user's speech. Therefore, in a feasible implementation, the signal energy, frequency and other indicators of the bone conduction sound signal can be detected. When it is determined that the bone conduction sound signal includes the sound signal of the user's speech, the bone conduction sound signal can be transmitted to the call device of the other call user as the call sound signal of the current call user.

[0086] The bone conduction sound signal may also contain interference sound signals, which may be caused by the bone conduction sensor picking up interference vibrations other than the vibrations of the current call user's speech, such as vibrations caused by the impact of the call device or vibrations caused by the severe shaking of the call device itself. Therefore, in a feasible implementation, before the bone conduction sound signal is transmitted to the call device of the other end call user, the bone conduction sound signal can be processed, and the processed sound signal can be used as the call sound signal of the current call user to filter out the interference sound signal generated by the interference vibration, thereby improving the signal purity of the sound signal heard by the other end call user and enhancing the user's call experience.

[0087] Step S30, performing equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal to obtain an inverted sound signal, and using the speaker of the communication device to play the inverted sound signal.

[0088] In this embodiment, the inverted sound signal is obtained by performing equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal. In a specific implementation, the ambient sound signal or the bone conduction sound signal may be directly subjected to equal-amplitude inversion processing; or the ambient sound signal or the bone conduction sound signal may be processed and then subjected to equal-amplitude inversion processing. For example, the ambient sound signal or the bone conduction sound signal may be first filtered to retain the frequency band of human speech, so as to avoid interference with the normal activities of the user in the external environment when the inverted sound signal is played.

[0089] The speaker of the call device is used to play the reverse phase sound signal. Since the speaker on the call device also needs to play the sound signal of the other end call user, it is necessary to determine whether the speaker plays the reverse phase sound signal or the sound signal of the other end call user before the speaker plays the sound signal. Different numbers of speakers can correspond to different determination methods. For example, in one feasible implementation, when the number of speakers on the call device is one, the sound signal of the other end call user can be played when the other end call user is speaking, and the reverse phase sound signal can be played when the current end call user is not speaking; when the number of speakers on the call device is multiple, some of the speakers can be used to play the sound signal of the other end call user, and the other speakers can be used to play the reverse phase sound signal. The details are not repeated here.

[0090] Furthermore, in a feasible implementation manner, before step S20, the method further includes:

[0091] Step S40, determining the signal amplitude corresponding to each frequency point in the preset frequency band in the bone conduction sound signal, and detecting whether the amplitude fluctuation degree of each signal amplitude is greater than the preset fluctuation degree;

[0092] When using a calling device, the vibration signal obtained by the bone conduction sensor may be sometimes louder and sometimes softer because the calling device may not always be in close contact with the human skin and / or the voice of the front-end user may be sometimes louder and sometimes softer when speaking, which makes the amplitude of the bone conduction sound signal unstable, affecting the auditory experience of the other-end user. Therefore, in this embodiment, before transmitting the bone conduction sound signal to the other-end user, it is first detected whether the amplitude of the bone conduction sound signal is stable.

[0093] Specifically, in this embodiment, a frequency band for amplitude stability detection is preset, hereinafter referred to as a preset frequency band, and the preset frequency band is set to the frequency band of human speech, and can be set to the conventional frequency band of human speech based on experience, such as 300-700Hz; or the frequency band where the energy is concentrated in the historical speech sound signal of the current end call user can be determined as the preset frequency band. The setting of the preset frequency band can make the frequency band of human speech be paid attention to during the amplitude stability detection process. Compared with the full-band detection of the bone conduction sound signal, the setting of the preset frequency band can reduce the amount of calculation of the signal processing system of the call device, improve the processing efficiency, and reduce the delay of the call sound signal.

[0094] In this embodiment, the signal amplitude corresponding to each frequency point of the preset frequency band in the bone conduction sound signal is determined, and the amplitude fluctuation degree of each signal amplitude is detected whether it is greater than the preset fluctuation degree. In a specific embodiment, the amplitude fluctuation degree of each signal amplitude can be evaluated by detecting statistical indicators such as variance and range between each signal amplitude. For example, in a feasible embodiment, the amplitude fluctuation degree of each signal amplitude can be evaluated by the variance between each signal amplitude. The specific process can be: detecting whether the absolute value of the variance between each signal amplitude is less than a preset threshold; if the absolute value of the variance between each signal amplitude is less than the preset threshold, it is determined that the discrete degree between each signal amplitude is low, that is, the amplitude fluctuation degree of each signal amplitude does not exceed the preset fluctuation degree; if the absolute value of the variance between each signal amplitude is greater than or equal to the preset threshold, it is determined that the discrete degree between each signal amplitude is high, that is, the amplitude fluctuation degree of each signal amplitude exceeds the preset fluctuation degree.

[0095] Step S50: If the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user is executed.

[0096] If the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, it is determined that the amplitude fluctuation of the bone conduction sound signal is relatively gentle and the amplitude of the bone conduction sound signal is stable. At this time, the bone conduction sound signal is transmitted to the call device of the other end call user as the call sound signal of the current end call user.

[0097] Step S60: If the amplitude fluctuation degree is greater than the preset fluctuation degree, amplitude processing is performed on each of the signal amplitudes to obtain an amplitude-processed bone conduction sound signal, and the amplitude-processed bone conduction sound signal is transmitted as the call sound signal of the current call user to the call device of the other call user.

[0098] If the amplitude fluctuation degree is greater than the preset fluctuation degree, it is determined that the amplitude fluctuation of the bone conduction sound signal is more violent and the amplitude of the bone conduction sound signal is unstable. At this time, amplitude processing is performed on the amplitudes of each signal to stabilize the amplitude of the bone conduction sound signal, and the bone conduction sound signal after amplitude processing is transmitted to the call device of the other end call user as the call sound signal of the current end call user.

[0099] In one feasible implementation, a reference for amplitude processing (hereinafter referred to as target amplitude for distinction) may be determined from each signal amplitude, and each signal amplitude may be adjusted to be consistent with the target amplitude or the difference with the target amplitude is within a preset difference range, so as to obtain the bone conduction sound signal after amplitude processing; in another feasible implementation, it may also be a preset amplitude range, and each signal amplitude may be adjusted to be within the preset amplitude range, so as to obtain the bone conduction sound signal after amplitude processing. There is no specific limitation here, and it can be set according to actual needs.

[0100] In this embodiment, if the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, the bone conduction sound signal is used as the call sound signal of the current call user and transmitted to the call device of the other call user; if the amplitude fluctuation degree is greater than the preset fluctuation degree, the amplitude of each signal is processed, and the bone conduction sound signal after the amplitude processing is used as the call sound signal of the current call user and transmitted to the call device of the other call user. This embodiment achieves the stability of the call sound signal heard by the other call user and improves the user's auditory experience during the call.

[0101] Furthermore, in a feasible implementation manner, the entire frequency band of the bone conduction sound signal may be processed as in steps S40 to S60, which will not be elaborated herein.

[0102] Further, in a feasible implementation manner, step S60 includes:

[0103] Step S601, determining a target amplitude based on each of the signal amplitudes;

[0104] In this implementation, the target amplitude is determined based on each signal amplitude, and specifically, the median, average or maximum value of each signal amplitude may be used as the target amplitude, which is not limited here.

[0105] Step S602, adjusting the signal amplitude of each frequency point to be consistent with the target amplitude to obtain a bone conduction sound signal after amplitude processing.

[0106] The signal amplitude of each frequency point is adjusted to be consistent with the target amplitude to obtain the target sound signal. This embodiment stabilizes the amplitude of the bone conduction sound signal after amplitude processing, and uses the bone conduction sound signal after amplitude processing as the call sound signal of the current call user to improve the auditory experience of the other call user.

[0107] In this embodiment, a bone conduction sensor is set on the calling device, a bone conduction sound signal is obtained through the bone conduction sensor, and an ambient sound signal of the external environment of the calling device is obtained through the microphone of the calling device; the bone conduction sound signal is transmitted to the calling device of the calling user at the other end as the calling sound signal of the current end calling user; equal-amplitude inversion processing is performed according to the ambient sound signal or the bone conduction sound signal to obtain an inverted sound signal, and the inverted sound signal is played using the speaker of the calling device.

[0108] When a user makes a call, the sound signal of the user's speech is included in the ambient sound signal, and can be picked up by the bone conduction sensor to obtain the bone conduction sound signal. In this embodiment, by performing equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal, the obtained inverted sound signal contains a sound signal of equal amplitude and inverted phase to the sound signal of the user's speech, so that when the inverted sound signal is played, it can be attenuated or offset with the sound signal of the user's speech, thereby reducing the risk of the sound signal of the user's call being transmitted in the external environment and improving the privacy and security of the user's call.

[0109] At the same time, this embodiment picks up the user's bone conduction sound signal through the bone conduction sensor and transmits the bone conduction sound signal to the calling device of the user at the other end. Compared with obtaining the sound signal of the user's speech through a microphone, the bone conduction sound signal in this embodiment can be unaffected by the external environment, and is not affected by the impact of the playing of the reverse sound signal on the ambient sound signal, so that the sound signal of the current calling user can be transmitted to the calling user more clearly and accurately, ensuring the call effect.

[0110] In summary, this embodiment improves the privacy security of users during calls without affecting the quality of the calls.

[0111] Further, based on the above first embodiment, a second embodiment of the signal processing method of the present invention is proposed, referring to Figure 3 In this embodiment, step S30 includes:

[0112] Step S301: If it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, the speaker of the call device is used to play the reverse phase sound signal.

[0113] In this embodiment, it is determined whether the speaker plays the reverse phase sound signal or the opposite end sound signal according to the speaking state of the current end call user and / or the opposite end call user. Specifically, if it is determined that the current end call user is in the speaking state and / or the opposite end call user is not in the speaking state, the speaker of the call device is used to play the reverse phase sound signal.

[0114] Furthermore, if the current call user is not in a speaking state and / or the opposite call user is in a speaking state, the speaker of the call device may be used to play the call audio signal of the opposite call user.

[0115] Furthermore, if both the current-end calling user and the opposite-end calling user are in a speaking state, it can be determined according to the preset signal priority whether the playing speaker plays the reverse-phase sound signal or the opposite-end sound signal.

[0116] In one feasible implementation, whether the speaker is in a speaking state can be determined based on the acoustic features of the sound signal. Acoustic features refer to physical quantities that represent the acoustic characteristics of speech, such as the energy concentration area, resonance peak frequency, resonance peak intensity and bandwidth that represent the timbre, as well as the duration, fundamental frequency, average voice power, etc. that represent the rhythmic characteristics of speech. In another feasible implementation, whether the speaker is in a speaking state can also be detected by various speech detection algorithms, which are not limited here.

[0117] It should be noted that this embodiment does not limit the number of speakers, which can be one or more. In a feasible implementation, when there are multiple speakers, each speaker can be controlled by the method of this embodiment; or some of the speakers can be controlled by the method of this embodiment, and the other speakers can be used as fixed playback channels for the reverse phase sound signal or the opposite end sound signal.

[0118] Furthermore, in a feasible implementation manner, before step S301, the method further includes:

[0119] Step S302, determining a first signal volume of the bone conduction sound signal, and determining a second signal volume of a call sound signal of the opposite end call user;

[0120] Determine the signal volume of the bone conduction sound signal, hereinafter referred to as the first signal volume for distinction. Specifically, the decibel value of the bone conduction sound signal (hereinafter referred to as the call decibel for distinction) may be used as the first signal volume; or the volume levels corresponding to different decibel ranges may be pre-set, and the volume level corresponding to the decibel range in which the call decibel of the bone conduction sound signal is located may be used as the first signal volume. Furthermore, in a feasible implementation, the maximum decibel of the bone conduction sound signal may be used as the call decibel; or the average decibel of the bone conduction sound signal may be used as the call decibel; or the median or mode of the decibels of each signal of the bone conduction sound signal may be used as the call decibel, and there is no limitation here.

[0121] The call sound signal of the opposite-end call user is obtained, and the signal volume of the call sound signal of the opposite-end call user is determined, which is hereinafter referred to as the second signal volume for distinction. Specifically, the second signal volume should be consistent with the call decibel used by the first signal volume, that is, if the maximum decibel of the bone conduction sound signal is the call decibel corresponding to the first signal volume, then the maximum decibel of the call sound signal of the opposite-end call user is the call decibel corresponding to the second signal volume, so that the indicators used for speech state detection at both ends are consistent, thereby improving the accuracy of the detection result.

[0122] Step S303: if the volume of the first signal is greater than a preset volume threshold, it is determined that the current end call user is in a speaking state;

[0123] In this implementation, a volume threshold is preset for detecting the speaking state of the current calling user, hereinafter referred to as the first preset threshold for distinction. The preset volume threshold can be set specifically according to demand and is not limited here.

[0124] If the volume of the first signal is greater than the preset volume threshold, it is determined that the current call user is in a speaking state; if the volume of the first signal is less than or equal to the preset volume threshold, it is determined that the current call user is not in a speaking state.

[0125] Step S304: If the volume of the second signal is less than or equal to a second preset threshold, it is determined that the opposite-end calling user is not in a speaking state.

[0126] In this embodiment, a volume threshold for detecting the speech state of the opposite-end call user is preset, which is referred to as the second preset threshold for distinction. The values ​​of the first preset threshold and the second preset threshold may be the same or different. For example, in a feasible embodiment, if the bone conduction sound signal after amplitude processing is a call sound signal, when the sound heard by the front-end call user is different from the actual sound signal of the opposite-end call user, the first preset threshold and the second preset threshold may be set to be different to improve the detection accuracy.

[0127] In this implementation, if the second signal volume is less than or equal to the second preset threshold, it is determined that the opposite-end call user is not in a speaking state; if the second signal volume is greater than the second preset threshold, it is determined that the opposite-end call user is in a speaking state.

[0128] Further, in a feasible implementation manner, at least two speakers are provided on the communication device. Figure 4 , the step S30 comprises:

[0129] Step S305, determining any one of the at least two speakers as a target speaker, so as to play a call audio signal of the opposite-end call user through the target speaker;

[0130] In this implementation manner, any one of the at least two speakers is determined as a target speaker, so that a call audio signal of the opposite-end call user is played through the target speaker.

[0131] Step S306: Use a speaker other than the target speaker among the at least two speakers to play the anti-phase sound signal.

[0132] A speaker other than the target speaker among the at least two speakers is used to play the anti-phase sound signal.

[0133] Further, in a feasible implementation manner, in step S30: the step of performing equal-amplitude inversion processing on the bone conduction sound signal to obtain an inverted sound signal further includes:

[0134] Step S307, obtaining a preset privacy opening distance, and determining an air conduction attenuation value of a call sound signal of the current end call user within the privacy opening distance;

[0135] In this implementation, a preset privacy opening distance is obtained. The privacy opening distance is the distance that the call sound signal of the current call user is allowed to propagate. It can be a factory setting or a setting by the current call user himself.

[0136] Calculate the air conduction attenuation value of the call sound signal of the current call user within the privacy opening distance, where the air conduction attenuation value within the privacy opening distance refers to the signal attenuation when the call sound signal of the current call user is transmitted through the air to a position away from the current call user's position by the privacy opening distance. The calculation formula of the air conduction attenuation value can be:

[0137] AdiV=10lg[1 / (4πr^2)]

[0138] Among them, AdiV is the air conduction attenuation value, and r is the privacy opening distance.

[0139] Step S308, performing signal attenuation processing on the bone conduction sound signal based on the air conduction attenuation value to obtain an attenuated sound signal;

[0140] The bone conduction sound signal is subjected to signal attenuation processing based on the air conduction attenuation value to obtain an attenuated sound signal. The specific signal attenuation processing is not limited here.

[0141] Step S309: performing equal-amplitude inversion processing on the attenuated sound signal to obtain an inverted sound signal.

[0142] The attenuated sound signal is processed with equal amplitude and inversion to obtain an inverted sound signal.

[0143] In some call scenarios, the front-end call user may need people within a certain distance to be able to hear the content of his or her call, but does not want people outside the distance to hear it. For example, when the front-end call user is gathering with friends, the front-end call user may need friends around him or her to know what he or she is talking about, but does not want people outside the distance to hear it; for another example, when the front-end call user is holding a work meeting in a public environment, the front-end call user may need colleagues around him or her to be able to record the content of his or her speech, but does not want non-colleagues to hear the content of his or her work. This implementation method allows the privacy opening distance to be set based on the center of the current call user, so that people within the privacy opening distance can hear the call sound of the current call user, and reduce the call sound that can be heard by people outside the privacy opening distance. While protecting the user's privacy, the user's normal work, social interaction, etc. are not affected, thereby improving the user's call experience.

[0144] In this embodiment, when it is determined that the current call user is in a speaking state and / or the opposite call user is not in a speaking state, the speaker of the call device is used to play the reverse phase sound signal. This embodiment avoids the playback conflict between the reverse phase sound signal and the call sound signal of the opposite call user, thereby improving the privacy security of the user during the call, while not affecting the effect of the user answering the call.

[0145] Further, in one possible implementation, referring to Figure 5 , when the calling user at the front end can set two speakers on their calling device, namely speaker 1 and speaker 2, the specific signal processing process can be:

[0146] When the bone conduction sensor on the calling device of the front-end calling user obtains the vibration signal to obtain the bone conduction sound signal, the bone conduction sound signal is sent to the other-end calling user as the calling sound signal of the current-end calling user; the calling sound signal of the other-end calling user is broadcast through the speaker 1.

[0147] When the microphone on the calling device of the front-end calling user obtains the ambient sound signal, the ambient sound signal is processed with equal amplitude and inverted phase to obtain an inverted sound signal, which is broadcasted through the loudspeaker 2.

[0148] In addition, the embodiment of the present invention also provides a signal processing device, referring to Figure 6 The signal processing device is deployed on a call device, a bone conduction sensor is provided on the call device, and the signal processing device includes:

[0149] An acquisition module 10 is used to acquire a bone conduction sound signal through the bone conduction sensor, and acquire an ambient sound signal of the external environment of the calling device through the microphone of the calling device;

[0150] A transmission module 20, configured to transmit the bone conduction sound signal as a call sound signal of a current call user to a call device of a remote call user;

[0151] The playing module 30 is used to perform equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal to obtain an inverted sound signal, and use the speaker of the communication device to play the inverted sound signal.

[0152] Furthermore, the playing module 30 is also used for:

[0153] If it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, the speaker of the call device is used to play the reverse phase sound signal.

[0154] Furthermore, the signal processing device further includes a volume detection module, which is used to:

[0155] Determining a first signal volume of the bone conduction sound signal, and determining a second signal volume of a call sound signal of the opposite end call user;

[0156] If the volume of the first signal is greater than a first preset threshold, it is determined that the current end call user is in a speaking state;

[0157] If the volume of the second signal is less than or equal to a second preset threshold, it is determined that the opposite-end calling user is not in a speaking state.

[0158] Furthermore, at least two speakers are provided on the call device, and the playing module 30 is further used for:

[0159] Determine any one of the at least two speakers as a target speaker, so as to play a call audio signal of the opposite-end call user through the target speaker;

[0160] The anti-phase sound signal is played using a speaker other than the target speaker among the at least two speakers.

[0161] Furthermore, the playing module 30 is also used for:

[0162] Obtaining a preset privacy opening distance, and calculating an air conduction attenuation value of a call sound signal of the current end call user within the privacy opening distance;

[0163] Performing signal attenuation processing on the bone conduction sound signal based on the air conduction attenuation value to obtain an attenuated sound signal;

[0164] The attenuated sound signal is processed with equal amplitude and inversion to obtain an inverted sound signal.

[0165] Furthermore, the signal processing device further includes an amplitude detection module, which is used to:

[0166] Determine the signal amplitude corresponding to each frequency point in the preset frequency band in the bone conduction sound signal, and detect whether the amplitude fluctuation degree of each signal amplitude is greater than the preset fluctuation degree;

[0167] If the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user is performed;

[0168] If the amplitude fluctuation degree is greater than the preset fluctuation degree, amplitude processing is performed on each of the signal amplitudes to obtain an amplitude-processed bone conduction sound signal, and the amplitude-processed bone conduction sound signal is transmitted as the call sound signal of the current call user to the call device of the other call user.

[0169] Furthermore, the amplitude detection module is also used for:

[0170] determining a target amplitude based on each of the signal amplitudes;

[0171] The signal amplitude of each frequency point is adjusted to be consistent with the target amplitude to obtain a bone conduction sound signal after amplitude processing.

[0172] The various embodiments of the signal processing device of the present invention may refer to the various embodiments of the signal processing method of the present invention, which will not be described in detail here.

[0173] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a signal processing program is stored. When the signal processing program is executed by a processor, the steps of the signal processing method described below are implemented.

[0174] The various embodiments of the signal processing device and the computer-readable storage medium of the present invention may refer to the various embodiments of the signal processing method of the present invention, which will not be described in detail here.

[0175] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0176] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0177] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0178] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A signal processing method, characterized in that: The signal processing method is applied to a communication device, on which a bone conduction sensor is provided, and the signal processing method comprises the following steps: Acquire a bone conduction sound signal through the bone conduction sensor, and acquire an ambient sound signal of the external environment of the calling device through the microphone of the calling device; Transmitting the bone conduction sound signal as a call sound signal of the current call user to a call device of the other call user; An inverted sound signal is obtained by performing equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal, and the inverted sound signal is played using a speaker of the communication device.

2. The signal processing method according to claim 1, characterized in that: The step of using the speaker of the communication device to play the reverse phase sound signal comprises: If it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, the speaker of the call device is used to play the reverse phase sound signal.

3. The signal processing method according to claim 2, characterized in that: Before the step of using the speaker of the call device to play the reverse phase sound signal if it is determined that the current end call user is in a speaking state and / or the opposite end call user is not in a speaking state, the step further includes: Determining a first signal volume of the bone conduction sound signal, and determining a second signal volume of a call sound signal of the opposite end call user; If the volume of the first signal is greater than a first preset threshold, it is determined that the current end call user is in a speaking state; If the volume of the second signal is less than or equal to a second preset threshold, it is determined that the opposite-end calling user is not in a speaking state.

4. The signal processing method according to claim 1, characterized in that: At least two speakers are provided on the communication device, and the step of using the speakers of the communication device to play the reverse phase sound signal comprises: Determine any one of the at least two speakers as a target speaker, so as to play a call audio signal of the opposite-end call user through the target speaker; The anti-phase sound signal is played using a speaker other than the target speaker among the at least two speakers.

5. The signal processing method according to claim 1, characterized in that: The step of performing equal-amplitude inversion processing on the bone conduction sound signal to obtain an inverted sound signal also includes: Obtaining a preset privacy opening distance, and calculating an air conduction attenuation value of a call sound signal of the current end call user within the privacy opening distance; Performing signal attenuation processing on the bone conduction sound signal based on the air conduction attenuation value to obtain an attenuated sound signal; The attenuated sound signal is processed with equal amplitude and inversion to obtain an inverted sound signal.

6. The signal processing method according to any one of claims 1 to 5, characterized in that: Before the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user, the method further includes: Determine the signal amplitude corresponding to each frequency point in the preset frequency band in the bone conduction sound signal, and detect whether the amplitude fluctuation degree of each signal amplitude is greater than the preset fluctuation degree; If the amplitude fluctuation degree is less than or equal to the preset fluctuation degree, the step of transmitting the bone conduction sound signal as the call sound signal of the current call user to the call device of the other call user is performed; If the amplitude fluctuation degree is greater than the preset fluctuation degree, amplitude processing is performed on each of the signal amplitudes to obtain an amplitude-processed bone conduction sound signal, and the amplitude-processed bone conduction sound signal is transmitted to the call device of the other-end call user as the call sound signal of the current-end call user.

7. The signal processing method according to claim 6, characterized in that: The step of performing amplitude processing on each of the signal amplitudes to obtain the amplitude-processed bone conduction sound signal comprises: determining a target amplitude based on each of the signal amplitudes; The signal amplitude of each frequency point is adjusted to be consistent with the target amplitude to obtain a bone conduction sound signal after amplitude processing.

8. A signal processing device, characterized in that: The signal processing device is deployed on a call device, a bone conduction sensor is provided on the call device, and the signal processing device includes: An acquisition module, used to acquire a bone conduction sound signal through the bone conduction sensor, and acquire an ambient sound signal of an external environment of the calling device through the microphone of the calling device; A transmission module, used to transmit the bone conduction sound signal as a call sound signal of the current call user to a call device of the other call user; The playing module is used to perform equal-amplitude inversion processing on the ambient sound signal or the bone conduction sound signal to obtain an inverted sound signal, and use the speaker of the communication device to play the inverted sound signal.

9. A signal processing device, characterized in that: The signal processing device comprises: a memory, a processor, and a signal processing program stored in the memory and executable on the processor, wherein the signal processing program implements the steps of the signal processing method according to any one of claims 1 to 7 when executed by the processor.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a signal processing program, and when the signal processing program is executed by a processor, the steps of the signal processing method according to any one of claims 1 to 7 are implemented.

Images