Call method, electronic equipment and computer storage medium
By adjusting call audio amplitude and introducing masking sound signals with opposite phase, the electronic device addresses sound leakage issues, ensuring user privacy and enhanced calling experience.
Patent Information
- Application Number
- CN202411197892.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-28
- Publication Date
- 2024-12-24
- Estimated Expiration
- 2044-08-28
AI Technical Summary
Electronic devices face the challenge of user privacy leakage due to sound leakage from call audio output, which can be heard by others in the surrounding environment, especially in quiet settings.
The electronic device identifies ambient noise levels and detects the presence of individuals, adjusting call audio amplitude and introducing masking sound signals with opposite phase to prevent sound leakage, using separate sound output channels for the receiver and speaker.
This approach effectively reduces sound leakage, enhancing user privacy by ensuring the local user can hear the call audio while preventing others from obtaining private content, improving the calling experience.
Smart Images

Figure CN119182847A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to a communication method, an electronic device and a computer storage medium. Background Art
[0002] With the development of terminal technology, more and more applications are installed on electronic devices, and users can experience different functions through applications installed on electronic devices. For example, users can talk to other users through telephone applications or social applications installed on electronic devices to achieve quick communication. Users can put the receiver (or handset) of the electronic device close to their ears, and the sound output by the receiver can be input into the human ear and also enter the surrounding environment. If there are people around the electronic device, the sound entering the surrounding environment can easily be heard by other people around the electronic device, and the electronic device is at risk of user privacy leakage. Summary of the invention
[0003] The present application provides a calling method, an electronic device method, and a computer storage medium. The electronic device can identify the intensity of the ambient noise in which the electronic device is located and detect whether there is a person near the electronic device. When the electronic device is in a quiet environment and identifies a person, the electronic device can adjust the amplitude of the call data to reduce the leakage sound volume of the call audio corresponding to the call data played by the electronic device through a receiver. Alternatively, the electronic device can also play a concealed sound signal corresponding to the call audio played through the receiver to offset the leakage sound data of the call audio and prevent people near the electronic device from obtaining the private content in the call audio. This method improves the anti-leakage sound effect and also improves the user's calling experience.
[0004] In a first aspect, the present application provides a method for making a call. The method includes: when the amplitude of a first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays a first call audio through a receiver and plays a first masking sound signal through a speaker, the amplitude of the first masking sound signal is equal to the amplitude of the first call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0005] It should be understood that in some embodiments, the speaker and the receiver are arranged in one module but have different sound output channels. The speaker and the receiver can be driven separately so that the sounds emitted by the speaker and the receiver are offset in the spatial area to prevent sound leakage.
[0006] It should be noted that the masking sound signal is not limited to being played through a loudspeaker, but can also be played through other devices, which is not limited in this application.
[0007] Through this method, when the electronic device is in a quiet environment and recognizes a person, the electronic device can play the call audio through the receiver while also playing a hidden sound signal corresponding to the call audio through the speaker. The hidden sound signal is used to offset the leakage data of the call audio, preventing people near the electronic device from obtaining the private content in the call audio, thereby improving the anti-leakage effect and the user's call experience.
[0008] The amplitude of the first masking sound signal is equal to the amplitude of the first call audio, which may mean that the difference between the amplitude of the first masking sound signal and the amplitude of the first call audio may be within an error range, for example, the error range may be between AdB-BdB, for example, A may be 0, B may be 5, then the error range may be between 0dB-5dB.
[0009] The phase of the first masking sound signal is opposite to the phase of the first call audio, which may mean that the difference between the phase of the first masking sound signal and the phase of the first call audio may be within an error range, for example, the error range may be between C degrees and D degrees, for example, C may be 0, D may be 5, then the error range may be between 0 degrees and 5 degrees.
[0010] Optionally, the first call audio is obtained based on the first call data.
[0011] In some embodiments, the amplitude of the first call audio is the same as the amplitude of the call audio corresponding to the first call data, that is, the electronic device does not change the amplitude of the first call data.
[0012] In some embodiments, the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data, or the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data at least at one point in time, that is, the electronic device also changes the amplitude of the first call data.
[0013] Exemplarily, the first call data may also be referred to as call data A.
[0014] Exemplarily, the first call audio may be Figure 2C The call audio K shown, the first masking sound signal can be Figure 2C The masking sound signal L is shown.
[0015] Exemplarily, the first call audio may be Figure 4A The call audio B shown in the figure, the first masking sound signal can be Figure 4A The masking sound signal B is shown.
[0016] Exemplarily, the first call audio may be Fig. 6A The call audio D shown in the figure, the first masking sound signal can be Fig. 6AThe masking sound signal D is shown.
[0017] Exemplarily, the first call audio may be Fig. 7A The call audio I shown in the figure, the first masking sound signal can be Fig. 7A The masking sound signal I is shown.
[0018] In combination with the first aspect, in a possible implementation method, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, the electronic device plays a second call audio through a receiver and plays a second masking sound signal through a speaker, the amplitude of the second masking sound signal is equal to the amplitude of the second call audio, and the phase of the second masking sound signal is opposite to the phase of the second call audio, wherein the second call audio is different from the first call audio.
[0019] In this way, when the electronic device is in a quiet environment and no person is recognized, there may be someone near the electronic device but the electronic device has not recognized it. The electronic device can also play the second call audio through the receiver while playing the hidden sound signal corresponding to the second call audio through the speaker to offset the leakage data of the second call audio, prevent people near the electronic device from obtaining the private content in the second call audio, thereby improving the anti-leakage effect and the user's call experience.
[0020] Exemplarily, the first call audio may be Figure 2C The call audio M shown, the second masking sound signal can be Figure 2C The masking sound signal N is shown.
[0021] Exemplarily, the first call audio may be Figure 4A The call audio C shown, the second masking sound signal can be Figure 4A The masking sound signal C is shown.
[0022] Exemplarily, the first call audio may be Fig. 6A The call audio E shown, the second masking sound signal can be Fig. 6A The masking sound signal E is shown.
[0023] Exemplarily, the first call audio may be Fig. 7A The call audio J shown, the second masking sound signal can be Fig. 7A The masking sound signal J is shown.
[0024] In combination with the first aspect, in a possible implementation manner, the first call audio and the second call audio are obtained based on the first call data, and the second call audio and the first call audio have different amplitudes at at least one time point.
[0025] In this way, when the electronic device is in a quiet environment, when the electronic device detects that there is a person near the electronic device and when it does not detect that there is a person near the electronic device, the electronic device can play different call audio. For example, the amplitude of the call audio played by the electronic device is different, which can not only ensure that the local user can accurately obtain the content of the call audio, but also further improve the effect of preventing sound leakage.
[0026] Optionally, the amplitude of the second call audio may be the same as the amplitude of the first call audio, that is, the electronic device may not change the amplitude of the call audio, but only play the masking sound signal.
[0027] Optionally, when the electronic device is in a quiet environment and no person is recognized, the electronic device plays the second call audio through the receiver and plays the concealed sound signal corresponding to the second call audio through the speaker. The electronic device can prompt the user whether to improve the sound leakage prevention effect, for example, by displaying a control. After receiving the user's input, for example, the user clicks the control, the electronic device can improve the sound leakage prevention effect, for example, the amplitude and / or phase of the played call audio can be changed, and the corresponding masking signal amplitude and / or phase can be changed. For example, the play of the second call audio can be changed to the play of the first call audio.
[0028] In combination with the first aspect, in a possible implementation method, when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays the third call audio through the receiver and plays the third masking sound signal through the speaker, the amplitude of the third masking sound signal is equal to the amplitude of the third call audio, and the phase of the third masking sound signal is opposite to the phase of the third call audio.
[0029] In this way, when the electronic device is between a quiet environment and a noisy environment, the call audio played by the electronic device through the receiver may also be obtained by people near the electronic device. While playing the call audio through the receiver, the electronic device can also play the covert sound signal corresponding to the call audio through the speaker to offset the leakage data of the call audio, prevent people near the electronic device from obtaining the private content in the call audio, and improve the anti-leakage effect.
[0030] Exemplarily, the third call audio may be Figure 2D The call audio O shown, the third masking sound signal can be Figure 2D The masking sound signal P is shown.
[0031] Exemplarily, the third call audio may be Figure 4B The call audio F shown, the third masking sound signal can be Figure 4B The masking sound signal F is shown.
[0032] Exemplarily, the third call audio may be Figure 6B The call audio G shown, the third masking sound signal can be Figure 6B The masking sound signal G is shown.
[0033] Exemplarily, the third call audio may be Figure 7B The call audio Q shown, the third masking sound signal can be Figure 7B The masking sound signal Q is shown.
[0034] In combination with the first aspect, in a possible implementation manner, the third call audio is obtained based on the first call data, and the third call audio and the first call audio have different amplitudes at at least one time point.
[0035] In this way, in different environments, the electronic device can play different call audios, and generate and play different masking sound signals based on the different call audios, further improving the anti-sound leakage effect of the electronic device in different environments.
[0036] Optionally, the amplitude of the third call audio may be the same as the amplitude of the first call audio, that is, the electronic device may not change the amplitude of the call audio, but only play the masking sound signal.
[0037] In combination with the first aspect, in a possible implementation method, the method also includes: when the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fourth call audio through a receiver, the amplitude of the fourth call audio is greater than the amplitude of the call audio corresponding to the first call data, and the fourth call audio is obtained based on the first call data.
[0038] In this way, in a noisy environment, the electronic device can increase the amplitude of the call audio to ensure that the local user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0039] Exemplarily, the fourth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B Call audio H is shown.
[0040] Optionally, in a noisy environment, the electronic device may also play a masking sound signal corresponding to the fourth call audio through a speaker.
[0041] Exemplarily, the masking sound signal corresponding to the fourth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0042] Preferably, in a noisy environment, the local user does not care whether the sound is missed, and the electronic device may not play the masking sound signal corresponding to the fourth call audio to save power consumption of the electronic device.
[0043] In combination with the first aspect, in a possible implementation manner, the electronic device recognizes the person, including the electronic device recognizing the person through a camera.
[0044] Preferably, the camera is a rear camera of an electronic device.
[0045] Optionally, when the electronic device plays the call audio through the receiver, the electronic device turns on the camera and confirms whether the electronic device recognizes a person through the camera.
[0046] In combination with the first aspect, in a possible implementation, before the electronic device plays the first call audio through the receiver, the method also includes: the electronic device obtains first information, the first information includes any one or more of the following: sensor data, a base station connection status of the electronic device, a device connection status of the electronic device, and location information of the electronic device, the sensor data includes acceleration data and / or gyroscope data; when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the first call audio through the receiver, specifically including: when the electronic device confirms that the electronic device is in the first scene based on the first information, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the first call audio.
[0047] In combination with the first aspect, in a possible implementation, the method also includes: when the electronic device confirms that the electronic device is in the second scene based on the first information, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a fifth call audio through a receiver, wherein the second scene is different from the first scene, the fifth call audio and the first call audio have different amplitudes at at least one time point, and the fifth call audio is obtained based on the first call data.
[0048] The first scenario and the second scenario may be scenarios where the electronic device is in a relatively closed environment. In scenarios where the electronic device is in a relatively closed environment, due to the presence of sound reflection, the sound leakage problem of the call audio played by the electronic device through the receiver is more serious. In different closed scenarios, the sound reflection intensity is different, and the sound leakage problem of the call audio corresponding to the call data played by the electronic device through the receiver is also different.
[0049] In this way, the electronic device can identify different preset scenes and play different call audio. For example, the electronic device can identify different preset scenes and process the call data differently to achieve the purpose of playing different call audio, further improving the sound leakage prevention effect.
[0050] For example, when the first scene includes an elevator scene and the second scene includes a car scene, the first call audio may be Figure 4A The call audio B shown, the fifth call audio can be Fig. 6A Call audio D is shown.
[0051] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on different scenarios, for example, the electronic device may play call audio with different amplitudes. Figure 4A , Figure 4B , Fig. 6A , Figure 6B Description in the Examples.
[0052] In combination with the first aspect, in a possible implementation, the method also includes: when the electronic device confirms based on the first information that the electronic device is not in the first scene and the second scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio, the sixth call audio has a different amplitude from the first call audio and the fifth call audio at least at one time point, and the sixth call audio is obtained based on the first call data.
[0053] In this way, when the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, and can also improve the anti-leakage sound effect of the electronic device in the non-preset scenario.
[0054] Exemplarily, the sixth call audio may be Fig. 7A Call audio I is shown.
[0055] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on non-preset scenarios, for example, the electronic device may play call audio with different amplitudes. Fig. 7A , Figure 7B Description in the Examples.
[0056] In combination with the first aspect, in a possible implementation manner, the first scenario includes an elevator scenario, and when the first information satisfies a first condition, the electronic device is in the elevator scenario;
[0057] The first condition includes any one or more of the following: within the first time period, the electronic device moves in the horizontal direction; within the second time period, the electronic device moves in the vertical direction; the second time period is a time period after the first time period; the device connection status of the electronic device includes that the electronic device is connected to Wi-Fi; and the location information of the electronic device is near an office building / community / hospital / shopping mall.
[0058] For example, how the electronic device recognizes the elevator scene can be referred to Figure 3A-3K Description in the Examples.
[0059] In combination with the first aspect, in a possible implementation, the second scenario includes a riding scenario, and when the first information satisfies the second condition, the electronic device is in the riding scenario; the second condition includes any one or more of the following: the electronic device switches from connecting to the first base station to connecting to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection state of the electronic device includes establishing a connection between the electronic device and the vehicle, and the position of the electronic device is continuously changing.
[0060] For example, how the electronic device identifies the riding scene can be referred to Figure 5 Description in the Examples.
[0061] In combination with the first aspect, in a possible implementation method, the first call audio is obtained based on the first call data and second information, and the second information includes any one or more of the following: the amplitude corresponding to the first call data at different time points, the volume value of the call audio played by the electronic device through the receiver, and the amplitude corresponding to the first ambient sound at different time points.
[0062] In a second aspect, the present application provides a call method. The method includes: an electronic device acquires first call data; when no ambient sound is acquired, the electronic device plays a first call audio through a receiver, and the first call audio is obtained based on the first call data; when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays a second call audio through a receiver, and the second call audio is obtained based on the first call data; the first call audio and the second call audio have different amplitudes at at least one time point.
[0063] Through this method, after the electronic device obtains call data, the electronic device can identify the intensity of the ambient noise in which the electronic device is located and detect whether there is a person near the electronic device. When the electronic device is in a quiet environment and a person is identified, the electronic device can adjust the amplitude of the call data to reduce the sound leakage of the call audio corresponding to the call data played by the electronic device through the receiver, thereby improving the sound leakage prevention effect.
[0064] Optionally, while the electronic device plays the second call audio through the receiver, it can also play the first masking sound signal corresponding to the second call audio through the speaker, the amplitude of the first masking sound signal is equal to the amplitude of the second call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0065] It should be understood that in some embodiments, the speaker and the receiver are arranged in one module but have different sound output channels. The speaker and the receiver can be driven separately so that the sounds emitted by the speaker and the receiver are offset in the spatial area to prevent sound leakage.
[0066] It should be noted that the masking sound signal is not limited to being played through a loudspeaker, but can also be played through other devices, which is not limited in this application.
[0067] In this way, the first masking sound signal can offset the sound leakage data of the second call audio played by the electronic device through the receiver, which can further improve the sound leakage prevention effect.
[0068] Exemplarily, the first call data may also be referred to as call data A. The first call audio may also be referred to as call audio A corresponding to the call data A.
[0069] Exemplarily, the second call audio may be Figure 2C The call audio K shown, the first masking sound signal can be Figure 2C The masking sound signal L is shown.
[0070] Exemplarily, the second call audio may be Figure 4A The call audio B shown in the figure, the first masking sound signal can be Figure 4A The masking sound signal B is shown.
[0071] Exemplarily, the second call audio may be Fig. 6A The call audio D shown in the figure, the first masking sound signal can be Fig. 6A The masking sound signal D is shown.
[0072] Exemplarily, the second call audio may be Fig. 7A The call audio I shown in the figure, the first masking sound signal can be Fig. 7A The masking sound signal I is shown.
[0073] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, before the electronic device plays the second call audio through the receiver, the electronic device can prompt the user whether it needs to improve the sound leakage prevention effect, for example, by displaying a control. After receiving the user's input, such as the user clicking the control, the electronic device can improve the sound leakage prevention effect, for example, it can change the amplitude and / or phase of the played call audio, and change the corresponding masking signal amplitude and / or phase. For example, the second call audio can be played. After the user confirms that the sound leakage prevention effect is not improved, the electronic device can continue to play the first call audio.
[0074] In combination with the second aspect, in a possible implementation, the method also includes: when the amplitude of the first ambient sound is less than a first threshold and the electronic device does not recognize a person, the electronic device plays a third call audio through a receiver, the third call audio has an amplitude different from the second call audio and the first call audio at at least one time point, and the third call audio is obtained based on the first call data.
[0075] In this way, when the electronic device is in a quiet environment and no person is recognized, there may be someone near the electronic device but the electronic device has not recognized it. The electronic device can play different call audio. For example, the amplitude of the call audio played by the electronic device is different. This can not only ensure that the local user can accurately obtain the content of the call audio, but also further improve the anti-leakage effect.
[0076] Optionally, the electronic device can also play a hidden sound signal corresponding to the third call audio through the speaker while playing the third call audio through the receiver, so as to offset the leakage data of the third call audio and prevent people near the electronic device from obtaining the private content in the third call audio, thereby improving the anti-leakage effect and the user's calling experience.
[0077] Exemplarily, the third call audio may be Figure 2C The call audio M shown, the covert sound signal corresponding to the third call audio may be Figure 2C The masking sound signal N is shown.
[0078] Exemplarily, the third call audio may be Figure 4A The call audio C shown, the covert sound signal corresponding to the third call audio may be Figure 4A The masking sound signal C is shown.
[0079] Exemplarily, the third call audio may be Fig. 6A The call audio E shown, the covert sound signal corresponding to the third call audio may be Fig. 6A The masking sound signal E is shown.
[0080] Exemplarily, the third call audio may be Fig. 7A The call audio J shown in the figure, the covert sound signal corresponding to the third call audio may be Fig. 7A The masking sound signal J is shown.
[0081] In combination with the second aspect, in a possible implementation, the method also includes: when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays a fourth call audio through a receiver, the amplitude of the fourth call audio is different from the second call audio and the first call audio at least at one time point, and the fourth call audio is obtained based on the first call data.
[0082] In this way, when the electronic device is between a quiet environment and a noisy environment, the call audio played by the electronic device through the receiver may also be obtained by people near the electronic device. The electronic device can also play different call audios, for example, the amplitude of the call audio played by the electronic device is different, which can not only ensure that the local user can accurately obtain the content of the call audio, but also further improve the anti-leakage effect.
[0083] Optionally, the electronic device may also play a hidden sound signal corresponding to the fourth call audio through a speaker while playing the fourth call audio through a receiver, so as to offset the leakage data of the fourth call audio and prevent people near the electronic device from obtaining private content in the fourth call audio, thereby improving the anti-leakage effect and the user's calling experience.
[0084] Exemplarily, the fourth call audio may be Figure 2D The hidden sound signal corresponding to the call audio O shown in the figure may be Figure 2D The masking sound signal P is shown.
[0085] Exemplarily, the fourth call audio may be Figure 4B The call audio F shown, the covert sound signal corresponding to the fourth call audio may be Figure 4B The masking sound signal F is shown.
[0086] Exemplarily, the fourth call audio may be Figure 6B The call audio G shown, the covert sound signal corresponding to the fourth call audio may be Figure 6B The masking sound signal G is shown.
[0087] Exemplarily, the fourth call audio may be Figure 7B The call audio Q shown, the covert sound signal corresponding to the fourth call audio may be Figure 7B The masking sound signal Q is shown.
[0088] In combination with the second aspect, in a possible implementation method, the method also includes: when the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fifth call audio through a receiver, the amplitude of the fifth call audio is greater than the amplitude of the first call data, and the fifth call audio is obtained based on the first call data.
[0089] In this way, in a noisy environment, the electronic device can increase the amplitude of the call audio to ensure that the local user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0090] Exemplarily, the fifth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B Call audio H is shown.
[0091] Optionally, in a noisy environment, the electronic device may also play a masking sound signal corresponding to the fourth call audio through a speaker.
[0092] Exemplarily, the masking sound signal corresponding to the fourth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0093] Preferably, in a noisy environment, the local user does not care whether the sound is missed, and the electronic device may not play the masking sound signal corresponding to the fourth call audio to save power consumption of the electronic device.
[0094] In combination with the second aspect, in a possible implementation, the fifth call audio is obtained based on the amplitude of the first ambient sound and the first call data.
[0095] In conjunction with the second aspect, in a possible implementation manner, the electronic device recognizes the person, including the electronic device recognizing the person through a camera.
[0096] Preferably, the camera is a rear camera of an electronic device.
[0097] Optionally, when the electronic device plays the call audio through the receiver, the electronic device turns on the camera and confirms whether the electronic device recognizes a person through the camera.
[0098] In combination with the second aspect, in a possible implementation, before the electronic device plays the second call audio through the receiver, the method also includes: the electronic device obtains first information, the first information includes any one or more of the following: sensor data, the base station connection status of the electronic device, the device connection status of the electronic device, the location information of the electronic device, the sensor data includes acceleration data and / or gyroscope data; when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver, specifically including: when the electronic device confirms that the electronic device is in the first scene based on the first information, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver.
[0099] In combination with the second aspect, in a possible implementation, the method also includes: when the electronic device confirms that the electronic device is in the second scene based on the first information, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the sixth call audio through the receiver, wherein the second scene is different from the first scene, the sixth call audio and the second call audio have different amplitudes at at least one time point, and the sixth call audio is obtained based on the first call data.
[0100] The first scenario and the second scenario may be scenarios where the electronic device is in a relatively closed environment. In scenarios where the electronic device is in a relatively closed environment, due to the presence of sound reflection, the sound leakage problem of the call audio played by the electronic device through the receiver is more serious. In different closed scenarios, the sound reflection intensity is different, and the sound leakage problem of the call audio corresponding to the call data played by the electronic device through the receiver is also different.
[0101] In this way, the electronic device can identify different preset scenes and play different call audio. For example, the electronic device can identify different preset scenes and process the call data differently to achieve the purpose of playing different call audio, further improving the sound leakage prevention effect.
[0102] For example, when the first scene includes an elevator scene and the second scene includes a car scene, the first call audio may be Figure 4A The call audio B shown, the sixth call audio can be Fig. 6A Call audio D is shown.
[0103] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on different scenarios, for example, the electronic device may play call audio with different amplitudes. Figure 4A , Figure 4B , Fig. 6A , Figure 6B Description in the examples.
[0104] In combination with the second aspect, in a possible implementation, the method also includes: when the electronic device confirms based on the first information that the electronic device is not in the first scene and the second scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a seventh call audio through a receiver, the seventh call audio and the second call audio and the sixth call audio have different amplitudes at at least one time point, and the seventh call audio is obtained based on the first call data.
[0105] In this way, when the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, and can also improve the anti-leakage sound effect of the electronic device in the non-preset scenario.
[0106] Exemplarily, the seventh call audio may be Fig. 7A Call audio I is shown.
[0107] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on non-preset scenarios, for example, the electronic device may play call audio with different amplitudes. Fig. 7A , Figure 7B Description in the examples.
[0108] In combination with the second aspect, in a possible implementation, the first scene includes an elevator scene, and when the first information satisfies a first condition, the electronic device is in an elevator scene; the first condition includes any one or more of the following: within a first time period, the electronic device moves in a horizontal direction, within a second time period, the electronic device moves in a vertical direction, the second time period is a time period after the first time period, the device connection status of the electronic device includes that the electronic device is connected to Wi-Fi, and the location information of the electronic device is near an office building / community / hospital / shopping mall.
[0109] For example, how the electronic device recognizes the elevator scene can be referred to Figure 3A-3K Description in the examples.
[0110] In combination with the second aspect, in a possible implementation, the second scenario includes a riding scenario, and when the first information satisfies the second condition, the electronic device is in the riding scenario; the second condition includes any one or more of the following: the electronic device switches from connecting to the first base station to connecting to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection state of the electronic device includes establishing a connection between the electronic device and the vehicle, and the position of the electronic device is continuously changing.
[0111] For example, how the electronic device identifies the riding scene can be referred to Figure 5 Description in the examples.
[0112] In combination with the second aspect, in one possible implementation method, the second call audio is obtained based on the first call data and the second information, and the second information includes any one or more of the following: the amplitude corresponding to the first call data at different time points, the volume value of the call audio played by the electronic device through the receiver, and the amplitude corresponding to the first ambient sound at different time points.
[0113] In a third aspect, the present application provides an electronic device, which includes a memory and a processor, wherein the memory is used to store a computer program; the processor is used to call the computer program so that the electronic device executes a calling method provided in any possible implementation of any of the above aspects.
[0114] In a fourth aspect, the present application provides a computer-readable storage medium, including instructions, which, when executed on an electronic device, enable the electronic device to execute a calling method provided in any possible implementation of any of the above aspects.
[0115] In a fifth aspect, the present application provides a computer program product, which includes computer instructions. When the computer instructions are run on an electronic device, the electronic device executes a calling method provided in any possible implementation of any of the above aspects.
[0116] In a sixth aspect, the present application provides a chip, which is applied to an electronic device, and the chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute a calling method provided in any possible implementation of any of the above aspects.
[0117] It can be understood that the beneficial effects provided by the third to sixth aspects mentioned above can refer to the beneficial effects in the corresponding methods and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0118] Figure 1The hardware structure diagram of the electronic device 100 is exemplarily shown;
[0119] Figure 2A The software structure block diagram of the electronic device 100 is exemplarily shown;
[0120] Figure 2B A schematic diagram showing a process flow of the electronic device 100 playing call audio through a receiver;
[0121] Figure 2C A schematic flow chart of a method for the electronic device 100 to process call audio played through a receiver when the noise level of the first ambient sound is less than a first threshold is shown;
[0122] Figure 2D A schematic flow chart of a method for the electronic device 100 to process call audio played through a receiver when the noise level of the first ambient sound is greater than a first threshold is shown;
[0123] Figure 3A-3D A schematic diagram showing a user waiting for an elevator and walking into the elevator;
[0124] Figure 3E A schematic diagram of a travel route when a user walks into an elevator is shown;
[0125] Figure 3F A schematic diagram showing a user ascending in an elevator;
[0126] Figure 3G A schematic diagram exemplarily showing changes in the acceleration of the electronic device 100 in the horizontal direction within a first time period;
[0127] Figure 3H A schematic diagram exemplarily showing changes in the acceleration of the electronic device 100 in the vertical direction within a first time period;
[0128] Fig. 3I A schematic diagram exemplarily showing changes in the acceleration of the electronic device 100 in the horizontal direction within the second time period;
[0129] Figure 3J A schematic diagram exemplarily shows a change in the acceleration of the electronic device 100 in the vertical direction within a second time period;
[0130] Figure 3K Another schematic diagram showing, by way of example, changes in the acceleration of the electronic device 100 in the vertical direction within a second time period;
[0131] Figure 4A Another schematic diagram of a method for the electronic device 100 to process call data based on an anti-sound leakage model of an elevator scene when the noise level of the first ambient sound is less than a first threshold is shown;
[0132] Figure 4B Another flowchart of a method for the electronic device 100 to process call audio played through a receiver when the noise level of the first ambient sound is greater than a first threshold is shown;
[0133] Figure 5 A schematic diagram showing a change in the base station to which the electronic device 100 is connected after the location of the electronic device 100 is changed;
[0134] Fig. 6A A schematic flow chart of another method for the electronic device 100 to process the call audio played through the receiver when the noise level of the first ambient sound is less than the first threshold value is shown;
[0135] Figure 6B A schematic flow chart of another method for the electronic device 100 to process the call audio played through the receiver when the noise level of the first ambient sound is greater than the first threshold value is shown;
[0136] Fig. 7A A schematic flow chart of another method for the electronic device 100 to process call data based on a sound leakage prevention model for a non-preset scenario when the noise level of the first ambient sound is less than a first threshold is shown;
[0137] Figure 7B A schematic flow chart of another method for the electronic device 100 to process call data based on a sound leakage prevention model for a non-preset scenario when the noise level of the first ambient sound is greater than a first threshold is shown;
[0138] Figure 8 A method flow chart of a calling method provided by the present application is shown. DETAILED DESCRIPTION
[0139] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a "or" relationship.
[0140] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
[0141] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.
[0142] The structure of the electronic device involved in this application is introduced below.
[0143] Please refer to Figure 1 , Figure 1 The schematic diagram of the hardware structure of the electronic device 100 is exemplarily shown.
[0144] like Figure 1As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a display screen 194, a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include one or more sensors, such as a gyroscope sensor, an acceleration sensor, etc. In some embodiments, the sensor module 180 may also include one or more of a pressure sensor, an air pressure sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, a magnetic sensor, a distance sensor, a touch sensor, etc.
[0145] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0146] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0147] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
[0148] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved. In some embodiments, the processor 110 may include one or more interfaces, such as a universal serial bus (USB) interface, etc.
[0149] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a MiniUSB interface, a MicroUSB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0150] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.
[0151] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the display screen 194 and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0152] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0153] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network.
[0154] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.
[0155] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0156] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.
[0157] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
[0158] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0159] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.
[0160] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0161] In some embodiments, the camera 193 may be used to capture images and confirm whether the images include images of people, so that the electronic device 100 can confirm whether there are people in the environment where the electronic device 100 is located.
[0162] Optionally, the electronic device 100 may capture images through a rear camera and confirm whether there is anyone in the environment where the electronic device 100 is located.
[0163] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0164] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0165] The external memory interface 120 can be used to connect an external memory card, such as a MicroSD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement a data storage function.
[0166] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc.
[0167] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0168] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.
[0169] In some embodiments, the number of receivers 170B on the electronic device 100 may include one or more. The electronic device 100 may play the call data received by the electronic device 100 through one or more receivers 170B, so that the user of the electronic device 100 can obtain the audio content in the call data. For example, the electronic device 100 may include a receiver 170B, and the receiver 170B may be located at the top of the display screen, and the electronic device 100 may play the call data received by the electronic device 100 through the receiver 170B.
[0170] It should be noted that the electronic device 100 is not limited to one receiver 170B, and may also include more receivers 170B, which is not limited in the present application.
[0171] In some embodiments, the electronic device 100 may further include one or more masking signal generators. The electronic device 100 may generate a masking sound signal based on the call audio, and play the masking sound signal through the masking signal generator. The difference between the amplitude of the masking sound signal and the amplitude of the call audio played by the receiver is within the error range, and the phase of the masking sound signal is opposite to the phase of the call audio played by the receiver. The distance of the bystander relative to the receiver on the electronic device 100 and the distance of the bystander relative to the masking signal generator on the electronic device 100 are close, so the masking sound signal can mask the leakage data of the call audio played by the electronic device 100 through the receiver to the bystander, thereby preventing the bystander from obtaining the privacy information in the call audio due to the leakage.
[0172] For example, the electronic device 100 may include two masking signal sounders, one masking signal sounder may be located at the top end of the display screen, and the other masking signal sounder may be located at the bottom end of the display screen.
[0173] In some embodiments, the masking signal generator may be a speaker. It should be understood that in some embodiments, the speaker and the receiver are arranged in one module but have different sound output channels. The speaker and the receiver may be driven separately so that the sounds emitted by the speaker and the receiver are offset in the spatial area to prevent sound leakage.
[0174] In the embodiment of the present application, the user of the electronic device 100 may be referred to as a local user, and users other than the electronic device 100, that is, other users in the environment where the electronic device 100 is located, may be referred to as listeners.
[0175] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a gravity sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
[0176] In some embodiments, the electronic device 100 determines whether it is in a preset scene based on acceleration data collected by the acceleration sensor and / or gyroscope data collected by the gyroscope sensor. The preset scene includes but is not limited to: elevator scene, car scene, etc.
[0177] The buttons 190 include a power button, a volume button, etc. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, messages, missed calls, notifications, etc.
[0178] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the electronic device 100 by inserting the SIM card interface 195 or removing the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications.
[0179] The electronic device 100 may be a mobile phone, a tablet computer, a laptop computer, a smart watch, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The specific type of the electronic device 100 is not limited in the embodiment of the present application.
[0180] Please refer to Figure 2A , Figure 2A The software structure block diagram of the electronic device 100 is exemplarily shown.
[0181] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, system runtime (AndroidRuntime) and system library, and kernel layer.
[0182] The application layer can include a series of application packages.
[0183] like Figure 2A As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, Bluetooth, music, short message, etc.
[0184] The application framework layer provides API and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0185] like Figure 2A As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a preset scene recognition module, and the like.
[0186] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the display screen, capture the display screen, etc.
[0187] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0188] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views (view controls). For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0189] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0190] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0191] The notification manager enables applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the display in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0192] The preset scene recognition module can obtain information such as base station connection status, sensor data, location information of the electronic device 100, device connection status of the electronic device 100, and judge whether the electronic device 100 is in a preset scene based on any one or more of the above information. The preset scene may refer to a relatively closed environment scene, for example, the preset scene may include but is not limited to an elevator scene and a car scene. If it is determined that the electronic device 100 is in a preset scene and the electronic device 100 is playing call data through a receiver, the electronic device 100 may adjust the amplitude and / or phase of the call data.
[0193] Optionally, in different preset scenarios, the electronic device 100 adjusts the amplitude and / or phase of the call data at different intensities to improve the sound leakage prevention effect in different preset scenarios.
[0194] Not limited to adjusting the amplitude and / or phase of the call data, the electronic device 100 can also adjust other information of the call data, and this application does not limit this.
[0195] The core library consists of two parts: one is the function that the Java language needs to call, and the other is the core library of the system.
[0196] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0197] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0198] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0199] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0200] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0201] A 2D graphics engine is a drawing engine for 2D drawings.
[0202] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0203] Figure 2B A schematic diagram of the processing flow of the electronic device 100 playing call audio through a receiver is shown.
[0204] like Figure 2B As shown, the electronic device 100 includes an analog to digital converter (ADC), an audio processor, a digital to analog converter (DAC), and a receiver.
[0205] The audio processor can be Figure 1 The processor 110 shown in the figure, the analog-to-digital converter is used to convert the analog signal into a digital signal, and the digital-to-analog converter is used to convert the digital signal into an analog signal. The ADC and the DAC are used to convert the analog signal into a digital signal. Figure 1 Not shown.
[0206] Optionally, the electronic device 100 may further include a communication unit, which may be Figure 1 A mobile communication unit 150 or a wireless communication unit 160 is shown.
[0207] The communication unit is used to obtain audio data, which may refer to analog domain signals. The audio data may be sent to the electronic device 100 by other electronic devices that establish a call connection with the electronic device 100.
[0208] The electronic device 100 can establish a call connection with other electronic devices through a telephone application, and other electronic devices can send audio data to a base station, and the base station then sends the audio data to the electronic device 100.
[0209] The electronic device 100 can also establish a call connection with other electronic devices through the social application. The other electronic devices can send audio data to the social application server, and the social application server can then send the audio data to the electronic device 100.
[0210] After acquiring the audio data, the communication unit may send the audio data to the ADC, which may convert the analog audio data into digital signals, such as obtaining call data, which is a digital signal. The ADC then sends the call data to the audio processor.
[0211] The audio processor is used to process the call data differently based on the scene in which the electronic device 100 is located, the noisiness of the ambient sound, and whether the electronic device 100 recognizes a person, so as to improve the anti-leakage effect in different scenes.
[0212] For how the audio processor processes call data, please refer to Figure 2C-Figure 2D , Figure 4A-4B , Figure 6A-6B , Figure 7A-7B Description in the examples.
[0213] The audio processor can obtain processed call data based on the call data, and the processed call data is also a digital domain signal. The amplitude and / or phase of the processed call data are different from the amplitude and / or phase of the call data.
[0214] Optionally, the audio processor may increase or decrease the amplitude of the call data at different time points by the same amplitude, or the audio processor may increase or decrease the amplitude of the call data at different time points by different amplitudes.
[0215] After obtaining the processed call data, the audio processor can send the processed call data to the DAC, which is used to convert digital domain signals into analog domain signals. For example, the DAC can obtain a call audio signal based on the processed call data, and the call audio signal can be the analog domain signal corresponding to the processed call data.
[0216] After acquiring the call audio signal, the DAC may send the call audio signal to the receiver, and the receiver may play the call audio based on the call audio signal, so that the user may obtain the audio content in the call audio. The call audio mentioned in this application may refer to an analog domain signal.
[0217] In some embodiments, the audio processor may include a filter. The filter processes the call data to obtain a masking sound signal. The masking sound signal is converted into an analog signal by a DAC, and the analog signal is sent to the masking sound signal generator for output.
[0218] Next, a call data playing method provided by the present application is introduced in detail with reference to the accompanying drawings.
[0219] In some embodiments, when the electronic device 100 obtains call data and plays the call audio corresponding to the call data through the receiver, the electronic device 100 can collect the ambient sound signal and confirm whether the noisiness of the ambient sound signal (or the amplitude of the ambient sound signal) is less than the first threshold. If the noisiness of the ambient sound signal is less than the first threshold, it means that the electronic device 100 is in a relatively quiet scene, and the leakage sound data is easily obtained by the listeners near the electronic device 100. In the case where the noisiness of the first ambient sound is less than the first threshold, the electronic device 100 can further confirm whether a person is recognized. When the electronic device 100 recognizes a person, the call audio played by the electronic device 100 through the receiver is more easily obtained by the listeners near the electronic device 100 than when the electronic device 100 does not recognize a person. Therefore, the electronic device can process the played call audio. For example, for the scene where the electronic device 100 recognizes a person and for the scene where the electronic device 100 does not recognize a person, the electronic device 100 can process the call data differently to change the played call audio to improve the sound leakage prevention effect.
[0220] Figure 2C The figure shows a flowchart of a method for the electronic device 100 to process the call audio played through the receiver when the noise level of the first ambient sound is less than the first threshold.
[0221] S201A: The electronic device 100 collects a first ambient sound through a microphone.
[0222] The electronic device 100 can collect the first environmental sound through the microphone. The first environmental sound is used to confirm the noisiness of the environment where the electronic device 100 is located, so that the electronic device 100 can process the call data received by the electronic device 100 based on different noisiness.
[0223] Optionally, the electronic device 100 can collect the first ambient sound using its own microphone, or can collect the first ambient sound using the microphone of another electronic device that has established a near-field connection with the electronic device 100. When the electronic device 100 is connected to another electronic device, such as a watch via Bluetooth, the electronic device 100 can also collect the first ambient sound through the microphone of the watch.
[0224] Optionally, after the electronic device 100 establishes a call connection with another electronic device, the electronic device 100 may collect the first ambient sound through a microphone.
[0225] Optionally, when the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver, the electronic device 100 collects the first ambient sound through the microphone.
[0226] Optionally, the electronic device 100 may also collect the first ambient sound periodically / irregularly, and the present application does not limit the timing when the electronic device 100 collects the first ambient sound.
[0227] For example, when the ambient noise is high, the electronic device 100 can increase the amplitude of the call data so that the local user can accurately obtain the audio content of the call data.
[0228] For another example, when the ambient noise is low, the private content in the call data is more easily obtained by the bystander, and the electronic device 100 needs to improve the anti-leakage effect of the electronic device 100. The electronic device 100 can further confirm whether the electronic device 100 recognizes a person. When the electronic device 100 recognizes a person or the electronic device 100 does not recognize a person, the electronic device 100 can process the call data based on different anti-leakage models, and different anti-leakage strategies can be used for different scenarios, which can not only improve the anti-leakage effect of different scenarios, but also ensure that the local user accurately obtains the audio content in the call audio. For details, please refer to the description in S204A-S207A.
[0229] S202A: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is less than a first threshold.
[0230] When the noise level of the first ambient sound is greater than the first threshold, it indicates that the electronic device 100 is in a non-quiet environment, which may affect the local user's acquisition of the audio content in the call audio. The electronic device 100 may increase the amplitude of the call audio. For example, the amplitude of the call audio may be increased by increasing the amplitude of the call data, that is, executing S208A.
[0231] When the noisiness of the first ambient sound is less than the first threshold, it indicates that the ambient noise of the electronic device 100 is relatively small and the electronic device 100 is in a quiet environment. If the electronic device 100 plays the call audio corresponding to the call data through the receiver, the private content in the call audio may be obtained by the bystander. The electronic device 100 may perform sound leakage prevention processing on the call data, i.e., execute S203A-S207A.
[0232] S203A: The electronic device 100 detects whether there is a person near the electronic device 100.
[0233] When the noise level of the first ambient sound is less than the first threshold, the electronic device 100 can further identify whether there is a person near the electronic device 100. When it is detected that there is a person near the electronic device 100, the call audio played by the electronic device 100 through the receiver is more easily acquired by the person near the electronic device 100 than when it is detected that there is no one near the electronic device 100. Therefore, the electronic device 100 can play different call audio for the scenario where the electronic device 10 detects that there is a person nearby and for the scenario where the electronic device 100 detects that there is no one nearby. For example, the purpose of playing different call audio can be achieved by processing the call data differently.
[0234] For scenarios where the electronic device 100 detects that there are people nearby and scenarios where the electronic device 100 detects that there are no people nearby, the electronic device 100 can construct different sound leakage prevention models and process call data according to the different sound leakage prevention models.
[0235] Optionally, the electronic device 100 may detect whether there is a person near the electronic device 100 by collecting images through a camera, or may detect whether there is a person near the electronic device 100 by transmitting and receiving ultrasonic signals.
[0236] When the electronic device 100 detects that there is a person near the electronic device 100, S204A to S205A are executed.
[0237] When the electronic device 100 detects that there is no person near the electronic device 100, S206A to S207A are executed.
[0238] Optionally, S203A may be executed before, after, or simultaneously with S202A. S203A may also be executed periodically / irregularly / continuously after the electronic device 100 is turned on. S203A may also be executed when it is detected that the electronic device 100 plays a call audio through a receiver. The present application does not limit the timing of the electronic device 100 detecting whether there is a person near the electronic device 100.
[0239] When the electronic device 100 detects that there is a person near the electronic device 100:
[0240] S204A: The electronic device 100 processes the call data A based on the sound leakage prevention model J to obtain the call audio K and the masking sound signal L. The amplitude of the masking sound signal L is close to the amplitude of the call audio K, and the phase is opposite.
[0241] S205A: The electronic device 100 plays the call audio K through the receiver and plays the masking sound signal L through the masking signal generator.
[0242] It should be understood that in some embodiments, the masking signal generator may be a speaker, and the speaker and the receiver are arranged in one module but have different sound output channels. The speaker and the receiver may be driven separately so that the sounds emitted by the speaker and the receiver are offset in the spatial area to prevent sound leakage.
[0243] It should be noted that the masking signal generator is not limited to a loudspeaker, but may also be other devices, which is not limited in the present application.
[0244] Optionally, call data A may refer to call data within a period of time.
[0245] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal L. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio K is the same as the amplitude of the call audio A corresponding to the call data A.
[0246] The call audio A corresponding to the call data A may refer to the call audio played by the electronic device 100 through the receiver when the sound leakage prevention function is not turned on. When the sound leakage prevention function is not turned on, the electronic device 100 does not need to adjust the amplitude and / or phase of the call data A. The electronic device 100 only needs to convert the call data A in the digital domain into the call audio A in the analog domain and play the call audio A through the receiver.
[0247] Optionally, the electronic device 100 may receive a user's request to turn on / off the sound leakage prevention function in a setting application of the electronic device 100 .
[0248] The call data A may be a digital domain signal, and the call audio A may be an analog domain signal. Optionally, the call audio A may be audio after the call data A is processed by a digital-to-analog converter.
[0249] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal L. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio K is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio K and the call audio A are different at at least one time point.
[0250] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal L.
[0251] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal L as an example.
[0252] The electronic device 100 processes the call data A based on the sound leakage prevention model J to obtain the call audio K, which may mean that the electronic device 100 processes the call data A based on the sound leakage prevention model J to obtain the processed call data A, the amplitude and / or phase of the processed call data A are different from the amplitude and / or phase of the call data A, and the processed call data A is then processed by a digital-to-analog converter to obtain the call audio K. The call audio K may be an analog domain signal.
[0253] When the electronic device 100 confirms that the noisiness of the first ambient sound is less than the first threshold and the electronic device 100 detects that there is a person near the electronic device 100, the electronic device 100 can obtain the sound leakage prevention model J, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model J to obtain the call audio K and the masking sound signal L, the amplitude of the call audio K is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio K is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal L and the amplitude of the call audio K is within the error range, and the phase of the masking sound signal L is opposite to the phase of the call audio K.
[0254] The specific implementation of the sound leakage prevention model J processing the call data A to obtain the call audio K and the masking sound signal L is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0255] When the electronic device 100 fails to recognize a person, since the environment in which the electronic device 100 is located is relatively quiet, there may be people around the electronic device 100, but the electronic device 100 has not recognized them. The electronic device 100 can process the call data A based on the anti-sound leakage model K, and play the call audio M and the masking sound signal N to reduce the risk of sound leakage.
[0256] When the electronic device 100 detects that there is no one near the electronic device 100:
[0257] S206A: The electronic device 100 processes the call data A based on the sound leakage prevention model K to obtain the call audio M and the masking sound signal N. The amplitude of the masking sound signal N is close to that of the call audio M, and the phase is opposite.
[0258] S207A: The electronic device 100 plays the call audio M through the receiver and plays the masking sound signal N through the masking signal generator.
[0259] After the sound leakage prevention function is turned on, the electronic device 100 can obtain ambient sound and detect whether there is a person near the electronic device 100. And based on the noisiness of the ambient sound and whether the electronic device 100 recognizes a person, the amplitude and / or phase of the call data A are adjusted. For example, when the noisiness of the ambient sound is less than the first threshold and no person is recognized, the electronic device 100 can adjust the amplitude and / or phase of the call data A to obtain the call audio M.
[0260] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal N. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio M is the same as the amplitude of the call audio A corresponding to the call data A.
[0261] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal N. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio M is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio M and the call audio A are different at at least one time point.
[0262] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal N.
[0263] The specific implementation of S206A-S207A is similar to the specific implementation of S204A-S205A. For the description of S206A-S207A, reference can be made to the introduction in S204A-S205A, and this application will not repeat them here.
[0264] The difference between S204A-S205A and S206A-S207A is that the sound leakage prevention model K is different from the sound leakage prevention model J, the call audio M is different from the call audio K, and the masking sound signal N is different from the masking sound signal L. The sound leakage prevention model K is a sound leakage prevention model corresponding to the case where the noisiness of the first environmental sound is less than the first threshold and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model J is a sound leakage prevention model corresponding to the case where the noisiness of the first environmental sound is less than the first threshold and the electronic device 100 detects that there is someone nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model K on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model J on the call data A after processing, or in other words, the amplitude of the call audio M is greater than the amplitude of the call audio K, or in other words, under the same distance outside the ear, the sound leakage level of the call audio M played by the electronic device 100 through the receiver is greater than the sound leakage level of the call audio K played by the electronic device 100 through the receiver.
[0265] S208A, the electronic device 100 executes Figure 2D Example.
[0266] Figure 2D The figure shows a flow chart of a method for the electronic device 100 to process the call audio played through the receiver when the noise level of the first ambient sound is greater than the first threshold.
[0267] S201B: The noisiness of the first ambient sound is greater than a first threshold.
[0268] S202B: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is greater than a second threshold.
[0269] The second threshold is greater than the first threshold. For example, the first threshold may be 45 decibels, and the second threshold may be 60 decibels.
[0270] When the noisiness of the first ambient sound is greater than the first threshold, the electronic device 100 may further confirm whether the noisiness of the first ambient sound is greater than the second threshold.
[0271] That is to say, the present application further refines the situation where the noisiness of the first ambient sound is greater than the first threshold into two scenarios: one scenario is that the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, and the other scenario is that the noisiness of the first ambient sound is greater than the second threshold.
[0272] When the noise level of the first ambient sound is greater than the second threshold, it can be considered that the current electronic device 100 is in a noisy environment. In this case, even if the electronic device 100 has sound leakage, it is difficult for an onlooker to obtain the private content in the call audio. The electronic device 100 should give priority to ensuring that in a noisy environment, the local user can accurately obtain the audio content in the call audio corresponding to the call data played by the electronic device 100 through the receiver, that is, execute S203B-S204B.
[0273] S203B, the electronic device 100 increases the amplitude of the call data A, obtains the call audio H and the masking sound signal H corresponding to the call audio H, the amplitude of the masking sound signal H is close to the amplitude of the call audio H, and the phase is opposite.
[0274] S204B: The electronic device 100 plays the call audio H through the receiver and plays the masking sound signal H through the masking signal generator.
[0275] When the noisiness of the first ambient sound is greater than the second threshold, it means that the ambient noise of the electronic device 100 is relatively large. In order to ensure that the local user can accurately obtain the audio content in the call audio played by the electronic device 100 through the receiver, the electronic device 100 can increase the amplitude of the call data A to obtain call audio H. The amplitude of call audio H is greater than the amplitude of call audio A corresponding to the call data A, and the call audio H is played through the receiver.
[0276] Optionally, the amplitude of the call audio H at at least one time point is greater than the amplitude of the call audio A corresponding to the call data A.
[0277] Optionally, the electronic device 100 increases the amplitude of the call data A. The amplitudes of the call data A at different time points may be increased by the same amplitude, or the amplitudes of the call data A at different time points may be increased by different amplitudes.
[0278] Optionally, the increase in the amplitude of the call data A may be related to the noisiness of the first ambient sound. The noisier the first ambient sound is, the greater the increase in the amplitude of the call data A. When the amplitude of the call data A is increased to a preset value, the amplitude of the call data A is no longer increased.
[0279] Optionally, when the noisiness of the first ambient sound is greater than the second threshold, not only the amplitude of the call data A is adjusted, but other information of the call data A, such as the phase of the call data A, may also be adjusted. Optionally, the adjustment strategy of the phase of the call data A may be related to the time distribution of the first ambient sound.
[0280] Optionally, the electronic device 100 may also generate a masking sound signal H of the call audio H based on the call audio H. The difference between the amplitude of the masking sound signal H and the amplitude of the call audio H is within an error range, and the phase of the masking sound signal H is opposite to the phase of the call audio H. The electronic device 100 may play the masking sound signal H through a masking signal generator. The masking sound signal H is used to offset the sound leakage data when the electronic device 100 plays the call audio H through a receiver.
[0281] Optionally, when the noisiness of the first ambient sound is greater than the second threshold, the ambient noise of the electronic device 100 is relatively large, and the local user does not care about sound leakage. The electronic device 100 may not generate or play the masking sound signal H, thereby reducing the power consumption of the electronic device 100.
[0282] When the noise level of the first ambient sound is greater than the first threshold and less than the second threshold, it can be considered that the current electronic device 100 is between a quiet environment and a noisy environment. In this case, private content in the call data may be obtained by an onlooker, and the call data also needs to be processed to prevent sound leakage, that is, execute S205B-S206B.
[0283] S205B, the electronic device 100 processes the call data A based on the sound leakage prevention model L to obtain the call audio O and the masking sound signal P. The amplitude of the masking sound signal P is close to that of the call audio O, and the phase is opposite.
[0284] S206B: The electronic device 100 plays the call audio O through the receiver and plays the masking sound signal P through the masking signal generator.
[0285] When the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 is between a quiet environment and a noisy environment. When the electronic device 100 plays the call audio A corresponding to the call data A through the receiver, the local user of the electronic device 100 can obtain the audio content in the call audio A more clearly, but the bystander may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0286] Therefore, when the electronic device 100 confirms that the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 can obtain the anti-sound leakage model L and process the call data A based on the anti-sound leakage model L to obtain the call audio O and the masking sound signal P.
[0287] Optionally, the sound leakage prevention model L may be a pre-trained model. The sound leakage prevention model L may also be updated periodically / irregularly.
[0288] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal P. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio M is the same as the amplitude of the call audio A corresponding to the call data A.
[0289] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal P. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio O is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio O and the call audio A are different at at least one time point.
[0290] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal P.
[0291] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal P as an example.
[0292] The electronic device 100 processes the call data A based on the sound leakage prevention model L, which may mean that the electronic device 100 processes the amplitude and / or phase of the call data A based on the sound leakage prevention model L to obtain the call audio O. The amplitude of the call audio O is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio O is different from the phase of the call audio A corresponding to the call data A.
[0293] Optionally, the electronic device 100 processes the amplitude of the call data A based on the sound leakage prevention model L, and may increase or reduce the amplitude of the call data A at different time points by the same amplitude, or may increase or reduce the amplitude of the call data A at different time points by different amplitudes.
[0294] Optionally, the adjustment of the amplitude of call data A is related to the amplitude distribution of the first ambient sound and the amplitude distribution of call data A. The amplitude corresponding to certain time points of call data A can be increased, and the amplitude corresponding to certain time points of call data A can also be reduced. For example, when the amplitude of the ambient sound is large, the amplitude reduction of call data A is small, and when the amplitude of the ambient sound is small, the amplitude reduction of call data A is large. In this way, the electronic device 100 adjusts the amplitude of call data A based on the anti-leakage model L to obtain call audio O, so that the loudness of call audio O played by the electronic device 100 through the receiver is reduced, and the loudness of the leakage data distributed by the call audio O played by the electronic device 100 through the receiver is also reduced to improve the anti-leakage effect.
[0295] Optionally, the phase adjustment of the call data A may also be related to the phase distribution of the ambient sound, so that the time distribution of the leaked sound data of the call audio O is similar to the time distribution of the ambient sound in which the electronic device 100 is located, and the ambient sound near the electronic device 100 may also offset the leaked sound data of the call audio O played by the electronic device 100, thereby reducing the occurrence of leaked sound.
[0296] The electronic device 100 is also used to generate a masking sound signal P for the call audio O, the difference between the amplitude of the masking sound signal P and the amplitude of the call audio O is within an error range, and the phase of the masking sound signal P is opposite to the phase of the call audio O.
[0297] Optionally, the masking sound signal P may be generated by the electronic device 100 based on the sound leakage prevention model L, or may not be generated based on the sound leakage prevention model L.
[0298] After acquiring the call audio O and the masking sound signal P, the electronic device 100 can play the call audio O through the receiver and play the masking sound signal P through the masking signal generator. The masking sound signal P can offset the sound leakage data of the call audio O played by the electronic device 100 through the receiver, thereby reducing the occurrence of sound leakage.
[0299] Optionally, before processing the call data A based on the sound leakage prevention model L, the electronic device 100 can obtain any one or more of the amplitudes of the call data A at different time points, the volume values of the audio played by the receiver of the electronic device 100, and the amplitudes of the first ambient sound at different time points, and input any one or more of the above information and the call data A into the sound leakage prevention model L. The sound leakage prevention model L can process the amplitude and / or phase of the call data A to obtain the call audio O.
[0300] Optionally, S202B may not be executed. When the noisiness of the first ambient sound is greater than the first threshold, the electronic device 100 may only execute S203B-S204B or S205B-S206B.
[0301] In summary, the sound leakage prevention model L, the sound leakage prevention model J, and the sound leakage prevention model K are different, and the call audio O, the call audio K, and the call audio M are also different. The sound leakage prevention model L may be the sound leakage prevention model corresponding to the case where the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. The sound leakage prevention model J may be the sound leakage prevention model corresponding to the case where the noisiness of the first ambient sound is less than the first threshold and the electronic device 100 detects that there is someone nearby. The sound leakage prevention model K may be the sound leakage prevention model corresponding to the case where the noisiness of the first ambient sound is less than the first threshold and the electronic device 100 detects that there is no one nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model L on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model K on the call data A after processing, and the sound leakage prevention effect of the sound leakage prevention model K on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model J on the call data A after processing. In other words, the amplitude of the call audio O is greater than the amplitude of the call audio M, and the amplitude of the call audio M is greater than the amplitude of the call audio K. In other words, at the same distance outside the ear, the leakage sound level of the call audio O played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio M played by the electronic device 100 through the receiver, and the leakage sound level of the call audio M played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio K played by the electronic device 100 through the receiver.
[0302] exist Figure 2C and Figure 2D In the embodiment, the electronic device 100 only needs to identify the noisiness of the ambient sound and detect whether there is a person near the electronic device 100, and process the call data through different anti-sound leakage models based on different conditions to improve the anti-sound leakage effect under different conditions.
[0303] pass Figure 2C and Figure 2D According to the method shown, during the process of the electronic device 100 playing the call audio corresponding to the call data through the receiver, the electronic device 100 can detect the ambient noise level and detect whether there is anyone near the electronic device 100. When the ambient noise level is different and there is someone near the electronic device 100 or there is no one near the electronic device 100, the electronic device 100 can obtain different anti-leakage models and process the amplitude and / or phase of the call data based on the anti-leakage model. Without affecting the local user's accurate acquisition of the audio content in the call audio, the present application can also improve the anti-leakage effect, prevent the bystander from obtaining the private content in the call audio, and improve the user's call experience.
[0304] In some embodiments, when the electronic device 100 is in a relatively closed environment, due to the presence of sound reflection, the sound leakage problem of the call audio corresponding to the call data played by the electronic device 100 through the receiver is more serious. In addition, in different closed scenes, the sound reflection intensity is different, and the sound leakage problem of the call audio corresponding to the call data played by the electronic device 100 through the receiver is also different.
[0305] In order to improve the sound leakage prevention effect, the electronic device 100 can identify different preset scenarios and play different call audio. For example, the electronic device 100 can identify different preset scenarios and process the call data differently to achieve the purpose of playing different call audio. Exemplarily, the electronic device 100 processes the call data differently based on the sound leakage prevention model of the preset scenario to achieve the purpose of playing different call audio. The preset scenario may refer to a scenario with a relatively closed environment, and the preset scenario includes but is not limited to an elevator scenario, a car scenario, and the like.
[0306] In an embodiment of the present application, the electronic device 100 can obtain at least one information such as base station connection status, sensor data, device connection status of the electronic device 100, location information of the electronic device 100, etc. to determine whether the electronic device 100 is in a preset scene.
[0307] The base station connection state may refer to whether the base station connected to the electronic device 100 has changed. For example, if the electronic device 100 switches from being connected to base station A to being connected to base station B, it can be determined that the base station connected to the electronic device 100 has changed.
[0308] The sensor data may include but is not limited to: acceleration data, gyroscope data, etc. The acceleration data may be acquired by the electronic device 100 through an acceleration sensor, and the gyroscope data may be acquired by the electronic device 100 through a gyroscope sensor.
[0309] The device connection state may refer to whether the electronic device 100 has established a communication connection with other devices. The communication connection includes but is not limited to a Bluetooth connection, a local area network connection, a Wi-Fi connection, and the like.
[0310] Optionally, the recognition of preset scenes may be continuously performed after the electronic device 100 is powered on, and the determination of preset scenes may also be performed after the electronic device 100 enters a call state, which is not limited in the present application.
[0311] Since the environment of the preset scene is relatively closed, it is more likely to cause the problem of call audio leakage, and the private content in the call audio is also more likely to be obtained by the listeners in the preset scene. Therefore, if the electronic device 100 is in the preset scene, the electronic device 100 can process the call data based on the anti-leakage model of the preset scene to reduce the occurrence of leakage and protect the privacy of the user.
[0312] The electronic device 100 processes the call data based on the sound leakage prevention model of the preset scenario, which may refer to adjusting the amplitude and / or phase of the call data based on the sound leakage prevention model of the preset scenario. The electronic device 100 may also adjust other information of the call data, which is not limited in this application.
[0313] Optionally, the sound leakage prevention model may be different for different preset scenarios, that is, the electronic device 100 has different strengths of adjusting the amplitude and / or phase of the call data. This method can improve the sound leakage prevention effect in different preset scenarios.
[0314] In other embodiments, if the electronic device 100 is in a non-preset scenario, the electronic device 100 may also process the call data based on the sound leakage prevention model of the non-preset scenario to improve the call quality.
[0315] The following introduces the two scenarios of call leakage prevention processing in preset scenarios and call leakage prevention processing in non-preset scenarios.
[0316] 1. Preset scenario call leakage prevention processing.
[0317] The preset scenario call leakage prevention processing may mean that when the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and the electronic device 100 is in the preset scenario, the electronic device 100 may process the call data based on the preset scenario's leakage prevention model.
[0318] The preset scenario call leakage prevention processing may include but is not limited to: elevator scenario call leakage prevention processing and vehicle scenario call leakage prevention processing.
[0319] 1. Anti-leakage processing for elevator scene calls.
[0320] The anti-leakage processing of calls in an elevator scenario may refer to when the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and the electronic device 100 is in an elevator scenario, the electronic device 100 processes the call data based on the anti-leakage model of the elevator scenario.
[0321] Since the environment in the elevator is relatively closed and quiet, if there is an onlooker in the elevator, when the electronic device 100 plays the call audio through the receiver, the onlooker in the elevator may hear the private content in the call audio played by the electronic device 100 through the receiver, resulting in the leakage of the user's private data.
[0322] Therefore, when the electronic device 100 confirms that the call audio is played through the receiver and is in an elevator scene, the electronic device 100 needs to process the call data based on the anti-sound leakage model of the elevator scene to improve the anti-sound leakage effect of the elevator scene and prevent bystanders in the elevator from obtaining private content in the call audio.
[0323] (1) Identify elevator scenes
[0324] Optionally, the electronic device 100 may determine whether it is currently in an elevator scene based on sensor data. The sensor data may include but is not limited to: acceleration data and / or gyroscope data, etc. The acceleration data may be obtained by the electronic device 100 through an acceleration sensor, and the gyroscope data may be obtained by the electronic device 100 through a gyroscope sensor.
[0325] Optionally, not limited to sensor data, the electronic device 100 may also combine other more information, such as location information of the electronic device 100, device connection status of the electronic device 100, etc., to determine whether it is currently in an elevator scene.
[0326] Optionally, the judgment of the elevator scene can be continuously executed after the electronic device 100 is turned on, and the judgment of the elevator scene can also be executed after the electronic device 100 enters a call state, which is not limited in this application.
[0327] Generally speaking, a user's elevator ride includes two stages: the elevator walk-in stage and the elevator ascending or descending stage. In different stages, the sensor data acquired by the electronic device 100 has different changing trends.
[0328] A. Entering the elevator stage
[0329] Figure 3A-3D A schematic diagram showing a user waiting for an elevator and walking into the elevator.
[0330] like Figure 3A As shown, at time t1, the user can wait for the elevator at the corresponding floor. While waiting for the elevator, the user can talk with other electronic devices through the electronic device 100, and the electronic device 100 can play the call data sent by other electronic devices through the receiver. The user can hold the electronic device 100 and put the electronic device 100 close to the ear, so that the user can hear the audio content of the call data played by the electronic device 100 through the receiver.
[0331] At time t1, the user is in a stationary state, and the acceleration data and / or gyroscope data of the electronic device 100 are substantially unchanged. For example, the acceleration data only contains the gravity acceleration in the vertical direction.
[0332] When the elevator reaches the user's floor, the user can walk toward the elevator and be inside the elevator, so that the user's position can rise or fall with the elevator.
[0333] If the elevator reaches the user's floor at time t1, the user can start walking straight into the elevator after the elevator door opens.
[0334] For example Figure 3A and Figure 3B As shown, the user can walk directly into the elevator and be at the Figure 3B Position shown.
[0335] For example Figure 3B and Figure 3C As shown, the user can continue to walk straight into the elevator and be at the elevator at time t3. Figure 3C Position shown.
[0336] For example Figure 3C and Figure 3D As shown, the user can continue to walk straight into the elevator and be at the elevator at time t4. Figure 3C Position shown.
[0337] like Figure 3D As shown, at time t4, the user is already in the elevator, then the user can stop walking in the horizontal direction, and after the elevator door closes, go up or down with the elevator.
[0338] Figure 3E A schematic diagram of the travel route of a user in the stage of walking into an elevator is shown.
[0339] like Figure 3E As shown, after the elevator door opens, the user can walk straight into the elevator in the horizontal direction. For example, the user walks straight in the horizontal direction from the position at time t1 to the position at time t2, and then walks straight in the horizontal direction from the position at time t3 to the position at time t4. At time t4, the user is already in the elevator and the user can stop walking in the horizontal direction.
[0340] from Figure 3E The shown route shows that the user has been moving horizontally throughout the entire period of entering the elevator. The user's state changes as follows: switching from a stationary state to a horizontally moving state, and then switching from a horizontally moving state to a stationary state.
[0341] B. The ascending stage or the descending stage of the elevator.
[0342] The principles of taking an elevator in stages of ascending and taking an elevator in stages of descending are similar. The process of taking an elevator in stages of descending is the opposite of the process of the user taking an elevator ascending. This application only takes the user taking an elevator ascending as an example for explanation.
[0343] Figure 3F A schematic diagram showing a user ascending in an elevator.
[0344] If at time t4, the user has walked towards the elevator, the user can stop walking in the horizontal direction, and after the elevator door closes, the user's position can rise or fall with the elevator.
[0345] like Figure 3F As shown in (a) in the figure, the user's position can rise with the user elevator and be located at time t5. Figure 3F The position shown in (a) in FIG.
[0346] like Figure 3F (a) and Figure 3F As shown in (b) in FIG. 1 , the user's position can continue to rise with the user elevator and is located at time t6. Figure 3F The position shown in (b) in FIG.
[0347] like Figure 3F (b) and Figure 3F As shown in (c) in FIG. 1 , the user's position can continue to rise with the user elevator and is located at time t7. Figure 3F The position shown in (c) in FIG.
[0348] from Figure 3F It can be seen from the shown route that the user has been moving in the vertical direction during the entire stage of the user taking the elevator up, and the user's state is switched from a static state to a vertical motion state.
[0349] Based on the above analysis, the electronic device 100 can obtain sensor data, which may include but is not limited to acceleration data and / or gyroscope data. If based on the sensor data, it is confirmed that the electronic device 100 moves in the horizontal direction during the first time period, and the electronic device 100 moves in the vertical direction during the second time period, and the second time period is a time period after the first time period. This means that during the first time period, the user is in the stage of walking into the elevator, and during the second time period, the user is in the stage of taking the elevator up or down, then the electronic device 100 can confirm that the electronic device 100 is in the scene of taking the elevator.
[0350] Exemplarily, the first time period may be Figure 3A-3D From time t1 to time t4, the second time period can be Figure 3F The time from t5 to t7 is shown.
[0351] In some embodiments, the electronic device 100 can also confirm that the electronic device 100 is in the stage of walking into the elevator and the stage of ascending / descending the elevator based on the change in the acceleration of the electronic device 100.
[0352] For example, within the first time period, if the acceleration of the electronic device 100 in the horizontal direction gradually increases from a minimum value and then gradually decreases to a minimum value, it can be confirmed that the user is in the stage of walking into the elevator.
[0353] The electronic device 100 can continuously / irregularly / periodically obtain the acceleration of the electronic device 100 in the horizontal direction, such as Figure 3G As shown, if the acceleration of the electronic device 100 in the horizontal direction gradually increases from a minimum value and then gradually decreases to a minimum value, it can be determined that the user switches from a static state to a horizontal moving state, and then from a horizontal moving state to a static state, and the user is in the stage of walking into the elevator.
[0354] Optionally, the minimum value may be a value close to zero.
[0355] It should be noted that Figure 3G The change of the acceleration of the electronic device 100 in the horizontal direction is merely shown as an example and does not constitute a limitation.
[0356] For another example, in the first time period, if the acceleration of the electronic device 100 in the vertical direction hardly changes and is close to a fixed value, it can be confirmed that the user is in the stage of walking into the elevator.
[0357] The electronic device 100 can continuously / irregularly / periodically obtain the acceleration of the electronic device 100 in the vertical direction, such as Figure 3H As shown, there is gravitational acceleration in the vertical direction of the electronic device 100. If the acceleration of the electronic device 100 in the vertical direction hardly changes and is stable near a fixed value, it can be determined that the user is not moving in the vertical direction, and the user is in the stage of walking into the elevator.
[0358] Alternatively, the fixed value can be the acceleration due to gravity.
[0359] It should be noted that Figure 3H The change of the acceleration of the electronic device 100 in the vertical direction is merely shown as an example and does not constitute a limitation.
[0360] For another example, in the second time period, if the acceleration of the electronic device 100 in the horizontal direction has almost no change and is close to a minimum value, such as Fig. 3I As shown, the acceleration of the electronic device 100 in the vertical direction gradually increases from a minimum value, such as Figure 3J As shown, it can be confirmed that the user is in the descending stage of taking the elevator.
[0361] For another example, during the second time period, if the acceleration of the electronic device 100 in the horizontal direction has almost no change and is close to a minimum value, such as Fig. 3I As shown, the acceleration of the electronic device 100 in the vertical direction gradually decreases from a minimum value, such as Figure 3K As shown, it can be confirmed that the user is in the ascending stage of taking the elevator.
[0362] Optionally, the minimum value may be a value close to 0, and the fixed value may be the acceleration due to gravity.
[0363] In some embodiments, the electronic device 100 can also confirm the displacement change of the electronic device 100 based on the sensor data to confirm whether the user is in the stage of walking into the elevator.
[0364] For example, during the first time period, the electronic device 100 may obtain sensor data, which may include but is not limited to acceleration data and / or gyroscope data. If it is confirmed based on the sensor data that the displacement of the electronic device 100 in the horizontal direction gradually increases from a minimum value, and the displacement in the vertical direction is almost unchanged, it can be confirmed that the user is in the stage of walking into the elevator.
[0365] For another example, during the second time period, if it is confirmed based on the sensor data that the displacement of the electronic device 100 in the horizontal direction has almost no change and is close to the minimum value, and the displacement of the electronic device 100 in the vertical direction gradually increases from the minimum value, it can be confirmed that the user is in the descending stage of the elevator. During the second time period, if it is confirmed based on the sensor data that the displacement of the electronic device 100 in the horizontal direction has almost no change and is close to the minimum value, and the displacement of the electronic device 100 in the vertical direction gradually decreases from the minimum value, it can be confirmed that the user is in the ascending stage of the elevator.
[0366] Optionally, the minimum value may be a value close to zero.
[0367] In some embodiments, the electronic device 100 can also confirm whether the user is in the stage of walking into the elevator in combination with the location information and / or device connection status of the electronic device 100. For example, if the electronic device 100 confirms that the location information of the electronic device 100 is near buildings such as office buildings / residential buildings in the community / hospitals / shopping malls, and the electronic device 100 is connected to Wi-Fi, it can be confirmed that the electronic device 100 is indoors, outdoor sports scenes can be excluded, and the accuracy of confirming whether the electronic device 100 is in the elevator scene can be improved to avoid misidentification.
[0368] It is not limited to confirming that the electronic device 100 is in an elevator scene based on sensor data, location information of the electronic device 100, device connection status of the electronic device 100 and other information. The electronic device 100 can also confirm whether the user is in an elevator scene based on other more information, and this application does not limit this.
[0369] (2) Processing call data based on the anti-leakage model in the elevator scenario
[0370] Figure 4A Another flowchart of a method in which the electronic device 100 processes call data based on an anti-sound leakage model of an elevator scenario when the noisiness of the first ambient sound is less than a first threshold is shown.
[0371] S401A, the electronic device 100 obtains first information, and confirms the elevator scene based on the first information, where the first information includes but is not limited to any one or more of the following: sensor data, location information of the electronic device 100, and device connection status of the electronic device 100.
[0372] The sensor data includes, but is not limited to, acceleration data and / or gyroscope data.
[0373] In some embodiments, S401 A may be executed continuously / periodically / irregularly after the electronic device 100 is turned on. On the one hand, before the electronic device 100 plays the call audio corresponding to the call data through the receiver, the electronic device 100 has confirmed based on the first information that the electronic device 100 is in the elevator scene, that is, the electronic device 100 is in the elevator. After the electronic device 100 is in the elevator, if the electronic device 100 plays the call audio corresponding to the call data through the receiver again, the electronic device 100 can process the call data based on the anti-leakage model of the elevator scene in time, without having to judge in real time whether it is in the elevator scene after playing the call audio corresponding to the call data through the receiver, which can speed up the processing speed of the electronic device 100 for the call data. On the other hand, based on the above analysis, the electronic device 100 in the elevator scene includes two stages, the stage of walking into the elevator, the stage of taking the elevator up or down. If the first information is obtained continuously / periodically / irregularly after the electronic device 100 is turned on, the electronic device 100 can determine whether the electronic device 100 is in an elevator scene based on the first information obtained in the two stages of walking into the elevator and taking the elevator ascent or descent, which can improve the accuracy of the electronic device 100 in confirming that the electronic device 100 is in the elevator scene.
[0374] In other embodiments, S401A may also be executed after the electronic device 100 plays the call audio corresponding to the call data through the receiver, and the first information may be data of a period of time before and after the moment when the electronic device 100 plays the call audio corresponding to the call data through the receiver.
[0375] In one possible implementation, before the electronic device 100 is in the elevator scene, that is, before the electronic device 100 is in the elevator, the electronic device 100 has played the call audio corresponding to the call data through the receiver. In this case, if the user walks into the elevator and takes the elevator up or down, the electronic device 100 can obtain the first information in the two stages of the elevator stage, the elevator up stage or the elevator down stage, and judge that the electronic device 100 is in the elevator scene based on the first information obtained in the two stages of the elevator stage, the elevator up stage or the elevator down stage.
[0376] In other possible implementations, the electronic device 100 plays the call audio through the receiver after the electronic device 100 is in the elevator scene, that is, after the electronic device 100 is in the elevator. In this case, after the electronic device 100 is in the elevator scene and plays the call audio through the receiver, the electronic device 100 may only obtain the first information in the ascending stage or descending stage of the elevator. Compared with combining the first information in the two stages of entering the elevator stage and ascending stage or descending stage of the elevator to determine whether the electronic device 100 is in the elevator scene, the accuracy needs to be improved.
[0377] This application does not limit the execution timing of S401 A.
[0378] S402A: The electronic device 100 collects a first ambient sound through a microphone.
[0379] For the description of S402A, reference may be made to S201A, and this application will not go into details here.
[0380] S402A may be executed before S401A or simultaneously with S401A, and this application does not limit this.
[0381] S403A: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is less than a first threshold.
[0382] For the description of S403A, please refer to S202A, and this application will not go into details here.
[0383] When the noisiness of the first ambient sound is less than the first threshold, S404A-S408A are executed.
[0384] When the noisiness of the first ambient sound is greater than the first threshold, S409A is executed.
[0385] When the noise level of the first ambient sound is less than the first threshold:
[0386] S404A: The electronic device 100 detects whether there is a person near the electronic device 100.
[0387] For the introduction of S404A, please refer to the description in S203A, and this application will not go into details here.
[0388] When a person is detected near the electronic device 100 , S405A to S406A are executed.
[0389] When it is detected that there is no person near the electronic device 100, S407A to S408A are executed.
[0390] When a person is detected near the electronic device 100:
[0391] S405A, the electronic device 100 processes the call data A based on the sound leakage prevention model A to obtain the call audio B and the masking sound signal B. The amplitude of the masking sound signal B is close to that of the call audio B, and the phase is opposite.
[0392] S406A: The electronic device 100 plays the call audio B through the receiver and plays the masking sound signal B through the masking signal generator.
[0393] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal B. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio B is the same as the amplitude of the call audio A corresponding to the call data A.
[0394] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal B. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio B is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitude of the call audio B is different from the amplitude of the call audio A at at least one time point.
[0395] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal B.
[0396] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal B as an example.
[0397] When it is confirmed that the electronic device 100 is in an elevator scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is a person nearby, the electronic device 100 can obtain the sound leakage prevention model A, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model A to obtain the call audio B and the masking sound signal B, the amplitude of the call audio B is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio B is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal B and the amplitude of the call audio B is within the error range, and the phase of the masking sound signal B is opposite to the phase of the call audio B.
[0398] The specific implementation of the sound leakage prevention model A processing the call data A to obtain the call data A and the masking sound signal A is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0399] When it is detected that there is no one near the electronic device 100:
[0400] S407A: The electronic device 100 processes the call data A based on the sound leakage prevention model B to obtain the call audio C and the masking sound signal C. The amplitude of the masking sound signal C is close to that of the call audio C, and the phase is opposite.
[0401] S408A: The electronic device 100 plays the call audio C through the receiver and plays the masking sound signal C through the masking signal generator.
[0402] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal C. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio C is the same as the amplitude of the call audio A corresponding to the call data A.
[0403] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal C. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio C is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio C and the call audio A are different at at least one time point.
[0404] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal C.
[0405] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal C as an example.
[0406] When it is confirmed that the electronic device 100 is in an elevator scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby, the electronic device 100 can obtain the sound leakage prevention model B, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model B to obtain the call audio C and the masking sound signal C, the amplitude of the call audio C is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio C is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal C and the amplitude of the call audio C is within the error range, and the phase of the masking sound signal C is opposite to the phase of the call audio C.
[0407] The specific implementation of the sound leakage prevention model B processing the call audio B to obtain the call audio C and the masking sound signal C is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0408] It should be noted that the sound leakage prevention model B is also different from the sound leakage prevention model A. The sound leakage prevention model B may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a vehicle scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model A may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a vehicle scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is someone nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model B on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model A on the call data A after processing, or that the amplitude of the call audio C is greater than the amplitude of the call audio B, or that, at the same distance outside the ear, the sound leakage level of the call audio C played by the electronic device 100 through the receiver is greater than the sound leakage level of the call audio B played by the electronic device 100 through the receiver.
[0409] S409A, the electronic device 100 executes Figure 4B Example.
[0410] Figure 4B Another flowchart of a method for the electronic device 100 to process call audio played through a receiver when the noise level of the first ambient sound is greater than a first threshold is shown.
[0411] When the noise level of the first ambient sound is greater than the first threshold:
[0412] S401B: The noisiness of the first ambient sound is greater than a first threshold.
[0413] S402B: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is greater than a second threshold.
[0414] For the description of S402B, please refer to S202B, and this application will not go into details here.
[0415] S403B, the electronic device 100 increases the amplitude of the call data A, obtains the call audio H and the masking sound signal H corresponding to the call audio H, and the amplitude of the masking sound signal H is close to the amplitude of the call audio H, and the phase is opposite.
[0416] Optionally, the call audio H and the call audio A have different amplitudes at at least one time point.
[0417] S404B: The electronic device 100 plays the call audio H through the receiver and plays the masking sound signal H through the masking signal generator.
[0418] For the description of S403B-S404B, reference may be made to S203B-S204B, and this application will not go into details here.
[0419] Optionally, the increase in the amplitude of the call data A may be related not only to the noisiness of the first ambient sound, but also to a preset scene, such as an elevator scene and a vehicle scene. When the noisiness of the call data and the ambient sound is the same, the increase in the amplitude of the call data A may be different in the elevator scene and the vehicle scene.
[0420] S405B: The electronic device 100 processes the call data A based on the sound leakage prevention model E to obtain the call audio F and the masking sound signal F. The amplitude of the masking sound signal F is close to that of the call audio F, and the phase is opposite.
[0421] S406B: The electronic device 100 plays the call audio F through the receiver and plays the masking sound signal F through the masking signal generator.
[0422] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal F. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio F is the same as the amplitude of the call audio A corresponding to the call data A.
[0423] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal F. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio F is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio F and the call audio A are different at at least one time point.
[0424] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal F.
[0425] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal F as an example.
[0426] When the electronic device 100 is in an elevator scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 is between a quiet environment and a noisy environment. When the electronic device 100 confirms that the call audio A corresponding to the call data A is played through the receiver, the local user of the electronic device 100 can obtain the audio content in the call audio A more clearly, but the bystander may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0427] Therefore, when the electronic device 100 is in an elevator scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 can obtain the anti-sound leakage model E and process the call data A based on the anti-sound leakage model E to obtain the call audio F and the masking sound signal F.
[0428] The specific implementation of the sound leakage prevention model E processing the call data A to obtain the call audio F and the masking sound signal F is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0429] Optionally, the electronic device 100 may not execute the judgment step S402B. After S401B, the electronic device 100 may only execute S403B-S404B or the electronic device 100 may only execute S405B-S406B. This application does not limit this.
[0430] In summary, the sound leakage prevention model E, the sound leakage prevention model B, and the sound leakage prevention model A are different, and the call audio F, the call audio C, and the call audio B are also different. The sound leakage prevention model E is the sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. The sound leakage prevention model B is the sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model A is the sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is someone nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model E on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model B on the call data A after processing, and the sound leakage prevention effect of the sound leakage prevention model B on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model A on the call data A after processing. In other words, the amplitude of the call audio F is greater than the amplitude of the call audio C, and the amplitude of the call audio C is greater than the amplitude of the call audio B. In other words, at the same distance outside the ear, the leakage sound level of the call audio F played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio C played by the electronic device 100 through the receiver, and the leakage sound level of the call audio C played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio B played by the electronic device 100 through the receiver.
[0431] 2. Anti-leakage processing for calls in car scenarios.
[0432] Anti-leakage sound processing for calls in a vehicle-riding scenario may mean that when the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver, and the electronic device 100 is in a vehicle-riding scenario, the electronic device 100 may process the call data based on the anti-leakage sound model of the vehicle-riding scenario.
[0433] Since the environment inside the vehicle is relatively closed, if there is an eavesdropper in the vehicle, when the electronic device 100 plays the call audio corresponding to the call data through the receiver, the eavesdropper in the vehicle may hear the private content in the call audio played by the electronic device 100 through the receiver, resulting in the leakage of the user's private data.
[0434] Therefore, when the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and is in a vehicle scene, the electronic device 100 needs to process the call data based on the anti-sound leakage model of the vehicle scene to prevent bystanders in the vehicle from hearing the content of the call audio played by the electronic device 100 through the receiver.
[0435] Optionally, the environment inside the vehicle and the environment inside the elevator are both relatively closed, and there is close-range sound reflection in both, but the sound reflection intensity inside the vehicle is different from that inside the elevator, and the sound leakage intensity inside the vehicle is also different from that inside the elevator. Therefore, for the vehicle scene and the elevator scene, the electronic device 100 can use different anti-sound leakage models to process the call data, which can improve the anti-sound leakage effect in different scenes.
[0436] Optionally, it is not limited to the elevator scenario and the sound leakage prevention scenario, and may include other preset scenarios, which are not limited in this application. For different preset scenarios, the electronic device 100 may use different sound leakage prevention models to process the call data.
[0437] (1) Identify the riding scene
[0438] Optionally, the electronic device 100 can determine whether it is currently in a riding scene based on information such as base station connection status, sensor data, device connection status, location information, etc.
[0439] The base station connection state may refer to whether the base station connected to the electronic device 100 has changed. For example, if the electronic device 100 switches from being connected to a first base station to being connected to a second base station, it may be determined that the base station connected to the electronic device 100 has changed.
[0440] The sensor data may include but is not limited to: acceleration data and / or gyroscope data, etc. The acceleration data may be acquired by the electronic device 100 through an acceleration sensor, and the gyroscope data may be acquired by the electronic device 100 through a gyroscope sensor.
[0441] Optionally, the electronic device 100 is not limited to the base station connection status, sensor data, device connection status, and location information, and can also combine other more information to determine whether it is currently in a riding scene.
[0442] Optionally, the judgment of the riding scene can be continuously executed after the electronic device 100 is turned on, and the judgment of the riding scene can also be executed after the electronic device 100 enters a call state, which is not limited in the present application.
[0443] The riding scenarios may include but are not limited to riding in a car, a bus, a high-speed train, a train, etc.
[0444] The electronic device 100 can confirm whether the user is in a vehicle riding scenario based on but not limited to any one or more of the following methods.
[0445] Method 1: If the base station to which the electronic device 100 is connected changes, it can be confirmed that the electronic device 100 is in a vehicle riding scenario.
[0446] In some embodiments, if the user is in a vehicle, the location of the electronic device 100 may change as the location of the vehicle changes. When the location of the vehicle changes, the location of the electronic device 100 will also change. Generally speaking, the base station connected to the electronic device 100 covers a certain area. When the electronic device 100 exceeds the coverage area of the base station, the electronic device 100 will disconnect from the base station and switch to another base station.
[0447] Figure 5 A schematic diagram showing a change in the base station to which the electronic device 100 is connected after the location of the electronic device 100 is changed.
[0448] like Figure 5 As shown, when the vehicle drives to position A, the electronic device 100 is also located near position A, and the electronic device 100 can be connected to base station A.
[0449] The vehicle can continue to drive to the destination. When the vehicle drives to position B, the electronic device 100 is also located near position B. If the coverage area of base station A does not include position B, the electronic device 100 will be disconnected from base station A. If the coverage area of base station B includes position B, the electronic device 100 can be connected to base station B.
[0450] The vehicle can continue to drive to the destination. When the vehicle drives to position C, the electronic device 100 is also located near position C. If the coverage area of base station B does not include position C, the electronic device 100 will be disconnected from base station B. If the coverage area of base station C includes position C, the electronic device 100 can be connected to base station C.
[0451] By analogy, during the driving process of the vehicle, the electronic device 100 can switch to connect to different base stations as the position of the vehicle changes. If it is detected that the base station connected to the electronic device 100 has changed, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0452] Optionally, if the electronic device 100 continuously switches and connects to m different base stations, it can be confirmed that the electronic device 100 is in a vehicle riding scenario, where m is a positive integer greater than or equal to 1.
[0453] Method 2: The electronic device 100 obtains sensor data. If it is confirmed based on the sensor data that the electronic device 100 moves in a horizontal direction, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0454] The electronic device 100 may acquire sensor data, which may include but is not limited to acceleration data and / or gyroscope data. If it is determined based on the sensor data that the electronic device 100 continuously moves in the horizontal direction, it may be determined that the electronic device 100 is in a vehicle riding scene.
[0455] Method three: when the acceleration of the electronic device 100 in the horizontal direction gradually increases from a minimum value, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0456] Optionally, when the vehicle starts and begins to travel toward the destination, the vehicle may switch from a parked state to a horizontal motion state, and accordingly, the acceleration of the electronic device 100 in the horizontal direction may gradually increase from a minimum value. When it is detected that the acceleration of the electronic device 100 in the horizontal direction gradually increases from a minimum value, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0457] Exemplarily, the minimum value may be a value close to zero.
[0458] Optionally, when the vehicle starts and begins to travel toward the destination, the vehicle may switch from a parked state to a moving state in the horizontal direction, and the moving state of the vehicle in the vertical direction hardly changes. Accordingly, the acceleration of the electronic device 100 in the vertical direction hardly changes and is close to a fixed value. When it is detected that the acceleration of the electronic device 100 in the vertical direction hardly changes, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0459] Exemplarily, the fixed value may be the acceleration due to gravity.
[0460] Method 4: When the horizontal displacement of the electronic device 100 gradually increases, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0461] Optionally, when the vehicle starts and begins to travel toward the destination, the electronic device 100 can obtain sensor data. If it is confirmed based on the sensor data that the horizontal displacement of the electronic device 100 gradually increases, it can be determined that the electronic device 100 is in a riding scene.
[0462] Method 5: When it is detected that the electronic device 100 has established a connection with the vehicle, it can be confirmed that the electronic device 100 is in a vehicle riding scene.
[0463] Method 6: When the vehicle is traveling to the destination, the position of the vehicle changes in real time, and the position of the electronic device 100 also changes with the position of the vehicle. If it is detected that the position information of the electronic device 100 is continuously changing, it can be confirmed that the electronic device 100 is in a vehicle scene.
[0464] It is not limited to confirming that the electronic device 100 is in a riding scene based on sensor data, location information of the electronic device 100, device connection status of the electronic device 100 and other information, but it is also possible to confirm whether the user is in a riding scene based on other more information, and this application does not limit this.
[0465] (2) Processing call data based on the anti-leakage model in the riding scenario
[0466] Fig. 6A A flowchart of another method for the electronic device 100 to process call audio played through a receiver when the noise level of the first ambient sound is less than a first threshold is shown.
[0467] S601A, the electronic device 100 obtains first information, and confirms that it is in a riding scene based on the first information. The first information includes but is not limited to any one or more of the following: sensor data, location information of the electronic device 100, and device connection status of the electronic device 100.
[0468] S602A: The electronic device 100 collects a first ambient sound through a microphone.
[0469] For the description of S601A-S602A, reference may be made to the description of S401A-S402A, and this application will not go into details here.
[0470] S603A: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is less than a first threshold.
[0471] When the noisiness of the first ambient sound is greater than the first threshold, S609A is executed.
[0472] When the noisiness of the first ambient sound is less than the first threshold, steps S604A to S608A are executed.
[0473] The specific implementation of S603A is similar to that of S202A, and reference may be made to the description in S202A, which will not be repeated in this application.
[0474] When the noise level of the first ambient sound is less than the first threshold:
[0475] S604A: The electronic device 100 detects whether there is a person near the electronic device 100.
[0476] For the introduction of S604A, please refer to the description in S203A, and this application will not go into details here.
[0477] When it is detected that there is a person near the electronic device 100, S605A-S606A are executed.
[0478] When it is detected that there is no person near the electronic device 100, S607A to S608A are executed.
[0479] When a person is detected near the electronic device 100:
[0480] S605A: The electronic device 100 processes the call data A based on the sound leakage prevention model C to obtain the call audio D and the masking sound signal D. The amplitude of the masking sound signal D is close to that of the call audio D, and the phase is opposite.
[0481] S606A: The electronic device 100 plays the call audio D through the receiver and plays the masking sound signal D through the masking signal generator.
[0482] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal D. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio D is the same as the amplitude of the call audio A corresponding to the call data A.
[0483] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal D. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio D is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitude of the call audio D is different from the amplitude of the call audio A at at least one time point.
[0484] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal D.
[0485] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal D as an example.
[0486] When it is confirmed that the electronic device 100 is in a vehicle riding scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is a person nearby, the electronic device 100 can obtain the sound leakage prevention model C, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model C to obtain the call audio D and the masking sound signal D, the amplitude of the call audio D is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio D is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal D and the amplitude of the call audio D is within the error range, and the phase of the masking sound signal D is opposite to the phase of the call audio D.
[0487] The specific implementation of the sound leakage prevention model C processing the call data A to obtain the call audio D and the masking sound signal D is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0488] The sound leakage prevention model C is different from the sound leakage prevention model A, the call audio D is different from the call audio B, and the masking sound signal D is different from the masking sound signal B. The sound leakage prevention model C is a sound leakage prevention model corresponding to the case where the electronic device 100 is in a car scene, the first ambient sound is less than the first threshold, and a person is detected near the electronic device 100. The sound leakage prevention model A is a sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, the first ambient sound is less than the first threshold, and a person is detected near the electronic device 100. It can also be said that the sound leakage prevention effect of the sound leakage prevention model C on the call data A after processing is different from the sound leakage prevention effect of the sound leakage prevention model A on the call data A after processing, or the amplitude of the call audio D is different from the amplitude of the call audio B, or the sound leakage level of the electronic device 100 playing the call audio B through the receiver at the same distance outside the ear is different from the sound leakage level of the electronic device 100 playing the call audio B through the receiver.
[0489] When it is detected that there is no one near the electronic device 100:
[0490] S607A: The electronic device 100 processes the call data A based on the sound leakage prevention model D to obtain the call audio E and the masking sound signal E. The amplitude of the masking sound signal E is close to that of the call audio E, and the phase is opposite.
[0491] S608A: The electronic device 100 plays the call audio E through the receiver and plays the masking sound signal E through the masking signal generator.
[0492] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal E. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio E is the same as the amplitude of the call audio A corresponding to the call data A.
[0493] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal E. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio E is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio E and the call audio A are different at at least one time point.
[0494] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal E.
[0495] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal E as an example.
[0496] When it is confirmed that the electronic device 100 is in a vehicle riding scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby, the electronic device 100 can obtain the sound leakage prevention model D, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model D to obtain the call audio E and the masking sound signal E, the amplitude of the call audio E is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio E is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal E and the amplitude of the call audio E is within the error range, and the phase of the masking sound signal E is opposite to the phase of the call audio E.
[0497] The anti-leakage model D processes the call data A to obtain the call audio E and the masking sound signal E, which is similar to the specific implementation of the anti-leakage model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0498] The sound leakage prevention model D is different from the sound leakage prevention model B. The sound leakage prevention model D is a sound leakage prevention model corresponding to the case where the electronic device 100 is in a vehicle scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model B is a sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model D on the call data A after processing is different from the sound leakage prevention effect of the sound leakage prevention model B on the call data A after processing, or the amplitude of the call audio E is different from the amplitude of the call audio C, or the sound leakage level of the call audio E played by the electronic device 100 through the receiver at the same distance outside the ear is different from the sound leakage level of the call audio C played by the electronic device 100 through the receiver.
[0499] S609A, the electronic device 100 executes Figure 6B Example.
[0500] Figure 6B A flowchart of another method for the electronic device 100 to process call audio played through a receiver when the noise level of the first ambient sound is greater than a first threshold is shown.
[0501] When the noise level of the first ambient sound is greater than the first threshold:
[0502] S601B: The noisiness of the first ambient sound is greater than a first threshold.
[0503] S602B: The electronic device 100 needs to confirm whether the noise level of the first ambient sound is greater than a second threshold.
[0504] When the noisiness of the first ambient sound is greater than the second threshold, steps S603B to S604B are executed.
[0505] When the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, S605B-S606B are executed.
[0506] The specific implementation of S602B is similar to that of S202B, and reference may be made to the description in S202B, which will not be repeated in this application.
[0507] S603B, the electronic device 100 increases the amplitude of the call data A, obtains the call audio H and the masking sound signal H corresponding to the call audio H, the amplitude of the masking sound signal H is close to the amplitude of the call audio H, and the phase is opposite.
[0508] Optionally, the call audio H and the call audio A have different amplitudes at at least one time point.
[0509] S604B: The electronic device 100 plays the call audio H through the receiver and plays the masking sound signal H through the masking signal generator.
[0510] For the description of S603B-S604B, please refer to S203B-S204B, and this application will not go into details here.
[0511] Optionally, the increase in the amplitude of the call data A may be related not only to the noisiness of the first ambient sound, but also to a preset scene, such as an elevator scene and a vehicle scene. When the noisiness of the call data and the ambient sound is the same, the increase in the amplitude of the call data A may be different in the elevator scene and the vehicle scene.
[0512] S605B: The electronic device 100 processes the call data A based on the sound leakage prevention model F to obtain the call audio G and the masking sound signal G. The amplitude of the masking sound signal G is close to that of the call audio G, and the phase is opposite.
[0513] S606B: The electronic device 100 plays the call audio G through the receiver and plays the masking sound signal G through the masking signal generator.
[0514] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal G. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio G is the same as the amplitude of the call audio A corresponding to the call data A.
[0515] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal G. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio G is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio G and the call audio A are different at at least one time point.
[0516] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal G.
[0517] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal G as an example.
[0518] When the electronic device 100 is in a riding scene and the noise level of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 is between a quiet environment and a noisy environment. When the electronic device 100 plays the call audio A corresponding to the call data A through the receiver, the local user of the electronic device 100 can obtain the audio content in the call audio A more clearly, but the bystander may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0519] Therefore, when the electronic device 100 is in a riding scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 can obtain the anti-sound leakage model F and process the call data A based on the anti-sound leakage model F to obtain the call audio G and the masking sound signal G.
[0520] The specific implementation of the sound leakage prevention model F processing the call data A to obtain the call audio G and the masking sound signal G is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0521] It should be noted that there are close-range sound reflections in different vehicles and elevators, but the sound reflection intensity in the vehicle is different from that in the elevator. Therefore, for the vehicle scene and the elevator scene, the sound leakage strength of the call data is different, and the electronic device 100 can process the played call audio differently. For example, the electronic device 100 can process the call data based on different anti-leakage models to achieve the purpose of processing the played call audio differently, so as to improve the anti-leakage effect of the vehicle scene and the anti-leakage effect of the elevator scene. Therefore, the anti-leakage model F and the anti-leakage model E can be different, the call audio G is different from the call audio F, and the masking sound signal G is different from the masking sound signal F. The anti-leakage model F is the corresponding anti-leakage model when the electronic device 100 is in a car scene and the noisiness of the first environmental sound is greater than the first threshold and less than the second threshold. The anti-leakage model E is the corresponding anti-leakage model when the electronic device 100 is in an elevator scene and the noisiness of the first environmental sound is greater than the first threshold and less than the second threshold. It can also be said that the anti-leakage effect of the call data A after being processed by the anti-leakage model F is different from the anti-leakage effect of the call data A after being processed by the anti-leakage model E, or, the amplitude of the call audio G is different from the amplitude of the call audio F, or, under the same distance outside the ear, the leakage sound level of the call audio G played through the receiver by the electronic device 100 is different from the leakage sound level of the call audio F played through the receiver by the electronic device 100.
[0522] In summary, the sound leakage prevention model F, the sound leakage prevention model D and the sound leakage prevention model C are different, and the call audio G, the call audio E and the call audio D are also different. The sound leakage prevention model F may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a riding scene, and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. The sound leakage prevention model D may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a riding scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model C may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a riding scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is someone nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model F on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model D on the call data A after processing, and the sound leakage prevention effect of the sound leakage prevention model D on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model C on the call data A after processing. In other words, the amplitude of the call audio G is greater than the amplitude of the call audio E, and the amplitude of the call audio E is greater than the amplitude of the call audio D. In other words, at the same distance outside the ear, the leakage sound level of the call audio G played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio E played by the electronic device 100 through the receiver, and the leakage sound level of the call audio E played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio D played by the electronic device 100 through the receiver.
[0523] Optionally, the electronic device 100 may not distinguish between the elevator scene and the car scene. For the elevator scene and the car scene, the electronic device 100 may use the same anti-leakage model to process the call data. For example, the anti-leakage model E and the anti-leakage model F may be the same, the anti-leakage model A and the anti-leakage model C may be the same, and the anti-leakage model B and the anti-leakage model D may be the same.
[0524] 2. Anti-leakage processing for calls in non-preset scenarios.
[0525] Anti-leakage processing for calls in non-preset scenarios may mean that when the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver, and the electronic device 100 is in a non-preset scenario, the electronic device 100 may process the call data based on the anti-leakage model of the non-preset scenario to reduce the occurrence of sound leakage.
[0526] When the electronic device 100 fails to recognize a preset scene based on the first information, for example, fails to recognize an elevator scene and a vehicle riding scene, it can be determined that the user is in a non-preset scene.
[0527] Fig. 7A A flowchart of another method in which the electronic device 100 processes call data based on a sound leakage prevention model for a non-preset scenario when the noise level of the first ambient sound is less than a first threshold is shown.
[0528] S701A, the electronic device 100 obtains first information, and confirms based on the first information that a preset scene is not recognized, the first information including but not limited to any one or more of the following: sensor data, location information of the electronic device 100, and device connection status of the electronic device 100.
[0529] S702A: The electronic device 100 collects a first ambient sound through a microphone.
[0530] When the electronic device 100 fails to recognize the above-mentioned preset scene based on the first information, it can be considered that the electronic device 100 fails to recognize the preset scene.
[0531] For the description of S701A-S702A, reference may be made to the description of S401A-S402A, and this application will not go into details here.
[0532] S703A: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is less than a first threshold.
[0533] When the noisiness of the first environmental sound is greater than the first threshold, S709A is executed.
[0534] When the noisiness of the first ambient sound is less than the first threshold, steps S704A to S708A are executed.
[0535] The specific implementation of S703A is similar to that of S202A, and reference may be made to the description in S202A, which will not be repeated in this application.
[0536] When the noise level of the first ambient sound is less than the first threshold:
[0537] S704A: The electronic device 100 detects whether there is a person near the electronic device 100.
[0538] For the introduction of S704A, please refer to the description in S203A, and this application will not go into details here.
[0539] When it is detected that there is a person near the electronic device 100, S705A to S706A are executed.
[0540] When it is detected that there is no person near the electronic device 100, S707A to S708A are executed.
[0541] When a person is detected near the electronic device 100:
[0542] S705A, the electronic device 100 processes the call data A based on the sound leakage prevention model H to obtain the call audio I and the masking sound signal I. The amplitude of the masking sound signal I is close to the amplitude of the call audio I, and the phase is opposite.
[0543] S706A: The electronic device 100 plays the call audio I through the receiver and plays the masking sound signal I through the masking signal generator.
[0544] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal I. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio I is the same as the amplitude of the call audio A corresponding to the call data A.
[0545] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal I. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio I is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio I and the call audio A are different at at least one time point.
[0546] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal I.
[0547] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal I as an example.
[0548] When it is confirmed that the electronic device 100 is in a non-preset scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is a person nearby, the electronic device 100 can obtain the sound leakage prevention model H, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model H to obtain the call audio I and the masking sound signal I, the amplitude of the call audio I is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio I is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal I and the amplitude of the call audio I is within the error range, and the phase of the masking sound signal I is opposite to the phase of the call audio I.
[0549] The specific implementation of the sound leakage prevention model H processing the call data A to obtain the call audio I and the masking sound signal I is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0550] The sound leakage prevention model H is different from the sound leakage prevention model A and the sound leakage prevention model C, the call audio I is different from the call audio B and the call audio D, and the masking sound signal I is different from the masking sound signal B and the masking call audio D. The sound leakage prevention model H is the sound leakage prevention model corresponding to the case where the electronic device 100 is in a non-preset scene, the first ambient sound is less than the first threshold, and a person is detected near the electronic device 100. The sound leakage prevention model A is the sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, the first ambient sound is less than the first threshold, and a person is detected near the electronic device 100. The sound leakage prevention model C is the sound leakage prevention model corresponding to the case where the electronic device 100 is in a car scene, the first ambient sound is less than the first threshold, and a person is detected near the electronic device 100. It can also be said that the sound leakage prevention effect of the sound leakage prevention model H on the call data A after processing the sound leakage prevention model A is smaller than the sound leakage prevention effect of the sound leakage prevention model A after processing the call data A, and is also smaller than the sound leakage prevention effect of the sound leakage prevention model C after processing the call data A. In other words, the amplitude of the call audio I is smaller than the amplitude of the call audio B, and is also smaller than the amplitude of the call audio D. In other words, at the same distance outside the ear, the leakage sound level of the call audio I played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio B played by the electronic device 100 through the receiver, and is also greater than the leakage sound level of the call audio D played by the electronic device 100 through the receiver.
[0551] When it is detected that there is no one near the electronic device 100:
[0552] S707A: The electronic device 100 processes the call data A based on the sound leakage prevention model I to obtain the call audio J and the masking sound signal J. The amplitude of the masking sound signal J is close to that of the call audio J, and the phase is opposite.
[0553] S708A: The electronic device 100 plays the call audio J through the receiver and plays the masking sound signal J through the masking signal generator.
[0554] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal J. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio J is the same as the amplitude of the call audio A corresponding to the call data A.
[0555] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal J. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio J is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio J and the call audio A are different at at least one time point.
[0556] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal J.
[0557] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal J as an example.
[0558] When it is confirmed that the electronic device 100 is in a non-preset scene, the noise level of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby, the electronic device 100 can obtain the sound leakage prevention model I, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model I to obtain the call audio J and the masking sound signal J, the amplitude of the call audio J is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio J is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal J and the amplitude of the call audio J is within the error range, and the phase of the masking sound signal J is opposite to the phase of the call audio J.
[0559] The anti-leakage model I processes call data A to obtain call audio J and masking sound signal J, which is similar to the specific implementation of the anti-leakage model L processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0560] The sound leakage prevention model I is different from the sound leakage prevention model B and the sound leakage prevention model D. The sound leakage prevention model I is a sound leakage prevention model corresponding to the case where the electronic device 100 is in a non-preset scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model B is a sound leakage prevention model corresponding to the case where the electronic device 100 is in an elevator scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model D is a sound leakage prevention model corresponding to the case where the electronic device 100 is in a car scene, the noisiness of the ambient sound near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that there is no one nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model I on the call data A after processing the sound leakage prevention model B is smaller than the sound leakage prevention effect of the call data A after processing the sound leakage prevention model B, and is also smaller than the sound leakage prevention effect of the call data A after processing the sound leakage prevention model B. In other words, the amplitude of the call audio J is smaller than the amplitude of the call audio C, and is also smaller than the amplitude of the call audio E. In other words, at the same distance outside the ear, the leakage sound level of the call audio J played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio C played by the electronic device 100 through the receiver, and is also greater than the leakage sound level of the call audio E played by the electronic device 100 through the receiver.
[0561] S709A, the electronic device 100 executes Figure 7B Example.
[0562] Figure 7B A flowchart of another method in which the electronic device 100 processes call data based on a sound leakage prevention model for a non-preset scenario when the noise level of the first ambient sound is greater than a first threshold is shown.
[0563] When the noise level of the first ambient sound is greater than the first threshold:
[0564] S701B: The noisiness of the first ambient sound is greater than a first threshold.
[0565] S702B: The electronic device 100 needs to confirm whether the noisiness of the first ambient sound is greater than a second threshold.
[0566] When the noisiness of the first ambient sound is greater than the second threshold, steps S703B to S704B are executed.
[0567] When the noisiness of the first environmental sound is greater than the first threshold and less than the second threshold, S705B-S706B are executed.
[0568] For the introduction of S702B, please refer to the description in S202B, and this application will not go into details here.
[0569] S703B, the electronic device 100 increases the amplitude of the call data A, obtains the call audio H and the masking sound signal H corresponding to the call audio H, the amplitude of the masking sound signal H is close to the amplitude of the call audio H, and the phase is opposite.
[0570] Optionally, the call audio H and the call audio A have different amplitudes at at least one time point.
[0571] S704B: The electronic device 100 plays the call audio H through the receiver and plays the masking sound signal H through the masking signal generator.
[0572] For the description of S703B-S704B, please refer to S203B-S204B, and this application will not go into details here.
[0573] In some embodiments, the increase in the amplitude of the call data A may be related not only to the noisiness of the first ambient sound, but also to a non-preset scenario. When the electronic device 100 is in a non-preset scenario, the electronic device 100 may also increase the amplitude of the call data A based on a preset rule of the non-preset scenario. In other words, when the noisiness of the call data and the ambient sound is the same, the increase in the amplitude of the call data A may be different in the preset scenario and the non-preset scenario.
[0574] S705B: The electronic device 100 processes the call data A based on the sound leakage prevention model G to obtain the call audio Q and the masking sound signal Q. The amplitude of the masking sound signal Q is close to that of the call audio Q, and the phase is opposite.
[0575] S706B: The electronic device 100 plays the call audio Q through the receiver and plays the masking sound signal Q through the masking signal generator.
[0576] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal Q. The electronic device 100 not changing the amplitude of the call data A may mean that the amplitude of the call audio Q is the same as the amplitude of the call audio A corresponding to the call data A.
[0577] Optionally, the electronic device 100 may also only change the amplitude of the call data A, without generating or playing the masking sound signal Q. The electronic device 100 changes the amplitude of the call data A, which may mean that the amplitude of the call audio Q is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio Q and the call audio A are different at at least one time point.
[0578] Optionally, the electronic device 100 may also change the amplitude of the call data A, and generate and play the masking sound signal Q.
[0579] The following embodiments of the present application are described by taking the electronic device 100 changing the amplitude of the call data A and generating and playing the masking sound signal Q as an example.
[0580] When the electronic device 100 is in a non-preset scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 is between a quiet environment and a noisy environment. When the electronic device 100 plays the call audio A corresponding to the call data A through the receiver, the local user of the electronic device 100 can obtain the audio content in the call audio A more clearly, but the bystander may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0581] Therefore, when the electronic device 100 is in a non-preset scenario and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 can obtain the anti-sound leakage model G and process the call data A based on the anti-sound leakage model G to obtain the call audio Q and the masking sound signal Q.
[0582] The specific implementation of the sound leakage prevention model G processing the call data A to obtain the call audio Q and the masking sound signal Q is similar to the specific implementation of the sound leakage prevention model L processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the description in S205B-S206B, and this application will not repeat them here.
[0583] It should be noted that the sound reflection intensity is different for preset scenes and non-preset scenes. Therefore, the sound leakage strength of call data is different for preset scenes and non-preset scenes. The electronic device 100 can process the call data based on different anti-leakage models to improve the anti-leakage effect of the preset scene and the anti-leakage effect of the non-preset scene. That is, the anti-leakage model G is different from the anti-leakage model E and the anti-leakage model F, the call audio Q is different from the call audio F and the call audio G, and the masking sound signal Q is different from the masking sound signal F and the masking sound signal G. The anti-leakage model G is the anti-leakage model corresponding to the case where the electronic device 100 is in a non-preset scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. The anti-leakage model E is the anti-leakage model corresponding to the case where the electronic device 100 is in an elevator scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. The anti-leakage model F is the anti-leakage model corresponding to the case where the electronic device 100 is in a car scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. It can also be said that the anti-leakage effect of the anti-leakage model G on the call data A after processing is weaker than the anti-leakage effect of the anti-leakage model E on the call data A, and is also weaker than the anti-leakage effect of the anti-leakage model F on the call data A after processing. In other words, the amplitude of the call audio Q is smaller than the amplitude of the call audio F, and is also smaller than the amplitude of the call audio G. In other words, at the same distance outside the ear, the leakage sound level of the call audio Q played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio F played by the electronic device 100 through the receiver, and is also greater than the leakage sound level of the call audio G played by the electronic device 100 through the receiver.
[0584] In summary, the sound leakage prevention model G, the sound leakage prevention model I, and the sound leakage prevention model H are different, and the call audio Q, the call audio J, and the call audio I are also different. The sound leakage prevention model G may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a non-preset scene and the noisiness of the first ambient sound is greater than the first threshold and less than the second threshold. The sound leakage prevention model I may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a non-preset scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is no one nearby. The sound leakage prevention model H may be the sound leakage prevention model corresponding to the case where the electronic device 100 is in a non-preset scene, the noisiness of the first ambient sound is less than the first threshold, and the electronic device 100 detects that there is someone nearby. It can also be said that the sound leakage prevention effect of the sound leakage prevention model G on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model I on the call data A after processing, and the sound leakage prevention effect of the sound leakage prevention model I on the call data A after processing is weaker than the sound leakage prevention effect of the sound leakage prevention model H on the call data A after processing. In other words, the amplitude of the call audio Q is greater than the amplitude of the call audio J, and the amplitude of the call audio J is greater than the amplitude of the call audio I. In other words, at the same distance outside the ear, the leakage sound level of the call audio Q played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio J played by the electronic device 100 through the receiver, and the leakage sound level of the call audio J played by the electronic device 100 through the receiver is greater than the leakage sound level of the call audio I played by the electronic device 100 through the receiver.
[0585] pass Figure 4A-4B , Figure 6A-6B and Figure 7A-7B According to the method shown, the electronic device 100 can identify different scenarios. In different scenarios, the call data played by the electronic device 100 through the receiver has different sound leakage strengths. In different scenarios, the electronic device 100 can obtain different anti-sound leakage models and process the amplitude and / or phase of the call data based on the anti-sound leakage model. Without affecting the local user's accurate acquisition of the audio content in the call data, the anti-sound leakage effect in different scenarios can also be improved, preventing the bystander from obtaining the private content in the call data, thereby improving the user's call experience.
[0586] The present application provides a calling method, an electronic device method, and a computer storage medium. The electronic device can identify the intensity of the ambient noise in which the electronic device is located and detect whether there is a person near the electronic device. When the electronic device is in a quiet environment and identifies a person, the electronic device can adjust the amplitude of the call data to reduce the leakage sound volume of the call audio corresponding to the call data played by the electronic device through a receiver. Alternatively, the electronic device can also play a concealed sound signal corresponding to the call audio played through the receiver to offset the leakage sound data of the call audio and prevent people near the electronic device from obtaining the private content in the call audio. This method improves the anti-leakage sound effect and also improves the user's calling experience.
[0587] Next, the two calling methods provided by this application are introduced respectively.
[0588] The present application provides a calling method, which includes: when the amplitude of a first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays a first call audio through a receiver and plays a first masking sound signal through a speaker, the amplitude of the first masking sound signal is equal to the amplitude of the first call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0589] It should be understood that in some embodiments, the speaker and the receiver are arranged in one module but have different sound output channels. The speaker and the receiver can be driven separately so that the sounds emitted by the speaker and the receiver are offset in the spatial area to prevent sound leakage.
[0590] Through this method, when the electronic device is in a quiet environment and recognizes a person, the electronic device can play the call audio through the receiver while also playing the hidden sound signal corresponding to the call audio through the speaker to offset the leakage data of the call audio, preventing people near the electronic device from obtaining the private content in the call audio, thereby improving the anti-leakage effect and the user's call experience.
[0591] The amplitude of the first masking sound signal is equal to the amplitude of the first call audio, which may mean that the difference between the amplitude of the first masking sound signal and the amplitude of the first call audio may be within an error range, for example, the error range may be between AdB-BdB, for example, A may be 0, B may be 5, then the error range may be between 0dB-5dB.
[0592] The phase of the first masking sound signal is opposite to the phase of the first call audio, which may mean that the difference between the phase of the first masking sound signal and the phase of the first call audio may be within an error range, for example, the error range may be between C degrees and D degrees, for example, C may be 0, D may be 5, then the error range may be between 0 degrees and 5 degrees.
[0593] Optionally, the first call audio is obtained based on the first call data.
[0594] In some embodiments, the amplitude of the first call audio is the same as the amplitude of the call audio corresponding to the first call data, that is, the electronic device does not change the amplitude of the first call data.
[0595] In some embodiments, the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data, or the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data at least at one point in time, that is, the electronic device also changes the amplitude of the first call data.
[0596] Exemplarily, the first call data may also be referred to as call data A.
[0597] Exemplarily, the first call audio may be Figure 2C The call audio K shown, the first masking sound signal can be Figure 2C The masking sound signal L is shown.
[0598] Exemplarily, the first call audio may be Figure 4A The call audio B shown in the figure, the first masking sound signal can be Figure 4A The masking sound signal B is shown.
[0599] Exemplarily, the first call audio may be Fig. 6A The call audio D shown in the figure, the first masking sound signal can be Fig. 6A The masking sound signal D is shown.
[0600] Exemplarily, the first call audio may be Fig. 7A The call audio I shown in the figure, the first masking sound signal can be Fig. 7A The masking sound signal I is shown.
[0601] In one possible implementation, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, the electronic device plays the second call audio through the receiver and plays the second masking sound signal through the speaker, the amplitude of the second masking sound signal is equal to the amplitude of the second call audio, and the phase of the second masking sound signal is opposite to the phase of the second call audio, wherein the second call audio is different from the first call audio.
[0602] In this way, when the electronic device is in a quiet environment and no person is recognized, there may be someone near the electronic device but the electronic device has not recognized it. The electronic device can also play the call audio through the receiver while playing the hidden sound signal corresponding to the call audio through the speaker to offset the leakage data of the call audio, prevent people near the electronic device from obtaining the private content in the call audio, improve the anti-leakage effect, and improve the user's call experience.
[0603] Exemplarily, the first call audio may be Figure 2C The call audio M shown, the second masking sound signal can be Figure 2C The masking sound signal N is shown.
[0604] Exemplarily, the first call audio may be Figure 4A The call audio C shown, the second masking sound signal can be Figure 4A The masking sound signal C is shown.
[0605] Exemplarily, the first call audio may be Fig. 6A The call audio E shown, the second masking sound signal can be Fig. 6A The masking sound signal E is shown.
[0606] Exemplarily, the first call audio may be Fig. 7A The call audio J shown, the second masking sound signal can be Fig. 7A The masking sound signal J is shown.
[0607] In a possible implementation, the first call audio and the second call audio are obtained based on the first call data, and the second call audio and the first call audio have different amplitudes at at least one time point.
[0608] In this way, when the electronic device is in a quiet environment, when the electronic device detects that there is a person near the electronic device and when it does not detect that there is a person near the electronic device, the electronic device can play different call audio. For example, the amplitude of the call audio played by the electronic device is different, which can not only ensure that the local user can accurately obtain the content of the call audio, but also further improve the effect of preventing sound leakage.
[0609] Optionally, the amplitude of the second call audio may be the same as the amplitude of the first call audio, that is, the electronic device may not change the amplitude of the call audio, but only play the masking sound signal.
[0610] Optionally, when the electronic device is in a quiet environment and no person is recognized, the electronic device plays the second call audio through the receiver and plays the concealed sound signal corresponding to the second call audio through the speaker. The electronic device can prompt the user whether to improve the sound leakage prevention effect, for example, by displaying a control. After receiving the user's input, for example, the user clicks the control, the electronic device can improve the sound leakage prevention effect, for example, the amplitude and / or phase of the played call audio can be changed, and the corresponding masking signal amplitude and / or phase can be changed. For example, the play of the second call audio can be changed to the play of the first call audio.
[0611] In one possible implementation, when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays the third call audio through the receiver and plays the third masking sound signal through the speaker, the amplitude of the third masking sound signal is equal to the amplitude of the third call audio, and the phase of the third masking sound signal is opposite to the phase of the third call audio.
[0612] In this way, when the electronic device is between a quiet environment and a noisy environment, the call audio played by the electronic device through the receiver may also be obtained by people near the electronic device. While playing the call audio through the receiver, the electronic device can also play the covert sound signal corresponding to the call audio through the speaker to offset the leakage data of the call audio, prevent people near the electronic device from obtaining the private content in the call audio, and improve the anti-leakage effect.
[0613] Exemplarily, the third call audio may be Figure 2D The call audio O shown, the third masking sound signal can be Figure 2D The masking sound signal P is shown.
[0614] Exemplarily, the third call audio may be Figure 4B The call audio F shown, the third masking sound signal can be Figure 4B The masking sound signal F is shown.
[0615] Exemplarily, the third call audio may be Figure 6B The call audio G shown, the third masking sound signal can be Figure 6B The masking sound signal G is shown.
[0616] Exemplarily, the third call audio may be Figure 7B The call audio Q shown, the third masking sound signal can be Figure 7B The masking sound signal Q is shown.
[0617] In a possible implementation, the third call audio is obtained based on the first call data, and the third call audio and the first call audio have different amplitudes at at least one time point.
[0618] In this way, in different environments, the electronic device can play different call audios, and generate and play different masking sound signals based on the different call audios, further improving the anti-sound leakage effect of the electronic device in different environments.
[0619] Optionally, the amplitude of the third call audio may be the same as the amplitude of the first call audio, that is, the electronic device may not change the amplitude of the call audio, but only play the masking sound signal.
[0620] In one possible implementation, the method also includes: when the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fourth call audio through a receiver, the amplitude of the fourth call audio is greater than the amplitude of the call audio corresponding to the first call data, and the fourth call audio is obtained based on the first call data.
[0621] In this way, in a noisy environment, the electronic device can increase the amplitude of the call audio to ensure that the local user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0622] Exemplarily, the fourth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B Call audio H is shown.
[0623] Optionally, in a noisy environment, the electronic device may also play a masking sound signal corresponding to the fourth call audio through a speaker.
[0624] Exemplarily, the masking sound signal corresponding to the fourth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0625] Preferably, in a noisy environment, the local user does not care whether the sound is missed, and the electronic device may not play the masking sound signal corresponding to the fourth call audio to save power consumption of the electronic device.
[0626] In a possible implementation, the electronic device recognizes the person, including the electronic device recognizing the person through a camera.
[0627] Preferably, the camera is a rear camera of an electronic device.
[0628] Optionally, when the electronic device plays the call audio through the receiver, the electronic device turns on the camera and confirms whether the electronic device recognizes a person through the camera.
[0629] In one possible implementation, before the electronic device plays the first call audio through the receiver, the method also includes: the electronic device obtains first information, the first information includes any one or more of the following: sensor data, a base station connection status of the electronic device, a device connection status of the electronic device, and location information of the electronic device, the sensor data includes acceleration data and / or gyroscope data; when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the first call audio through the receiver, specifically including: when the electronic device confirms that the electronic device is in the first scene based on the first information, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the first call audio.
[0630] In one possible implementation, the method also includes: when the electronic device confirms that the electronic device is in a second scene based on the first information, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a fifth call audio through a receiver, wherein the second scene is different from the first scene, the fifth call audio and the first call audio have different amplitudes at at least one time point, and the fifth call audio is obtained based on the first call data.
[0631] The first scenario and the second scenario may be scenarios where the electronic device is in a relatively closed environment. In scenarios where the electronic device is in a relatively closed environment, due to the presence of sound reflection, the sound leakage problem of the call audio played by the electronic device through the receiver is more serious. In different closed scenarios, the sound reflection intensity is different, and the sound leakage problem of the call audio corresponding to the call data played by the electronic device through the receiver is also different.
[0632] In this way, the electronic device can identify different preset scenes and play different call audio. For example, the electronic device can identify different preset scenes and process the call data differently to achieve the purpose of playing different call audio, further improving the sound leakage prevention effect.
[0633] For example, when the first scene includes an elevator scene and the second scene includes a car scene, the first call audio may be Figure 4A The call audio B shown, the fifth call audio can be Fig. 6A Call audio D is shown.
[0634] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on different scenarios, for example, the electronic device may play call audio with different amplitudes. Figure 4A , Figure 4B , Fig. 6A , Figure 6B Description in the examples.
[0635] In one possible implementation, the method also includes: when the electronic device confirms based on the first information that the electronic device is not in the first scene and the second scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio, the sixth call audio has a different amplitude from the first call audio and the fifth call audio at least at one time point, and the sixth call audio is obtained based on the first call data.
[0636] In this way, when the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, and can also improve the anti-leakage sound effect of the electronic device in the non-preset scenario.
[0637] Exemplarily, the sixth call audio may be Fig. 7A Call audio I is shown.
[0638] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on non-preset scenarios, for example, the electronic device may play call audio with different amplitudes. Fig. 7A , Figure 7B Description in the examples.
[0639] In a possible implementation, the first scene includes an elevator scene, and when the first information satisfies the first condition, the electronic device is in the elevator scene;
[0640] The first condition includes any one or more of the following: within the first time period, the electronic device moves in the horizontal direction; within the second time period, the electronic device moves in the vertical direction; the second time period is a time period after the first time period; the device connection status of the electronic device includes that the electronic device is connected to Wi-Fi; and the location information of the electronic device is near an office building / community / hospital / shopping mall.
[0641] For example, how the electronic device recognizes the elevator scene can be referred to Figure 3A-3K Description in the examples.
[0642] In one possible implementation, the second scenario includes a riding scenario, and when the first information satisfies the second condition, the electronic device is in the riding scenario; the second condition includes any one or more of the following: the electronic device switches from connecting to the first base station to connecting to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection state of the electronic device includes establishing a connection between the electronic device and the vehicle, and the position of the electronic device is continuously changing.
[0643] For example, how the electronic device identifies the riding scene can be referred to Figure 5 Description in the Examples.
[0644] In one possible implementation, the first call audio is obtained based on the first call data and second information, and the second information includes any one or more of the following: the amplitude corresponding to the first call data at different time points, the volume value of the call audio played by the electronic device through the receiver, and the amplitude corresponding to the first ambient sound at different time points.
[0645] Figure 8 A method flow chart of a calling method provided by the present application is shown.
[0646] S801. The electronic device obtains first call data.
[0647] S802: When no ambient sound is obtained, the electronic device plays a first call audio through a receiver, where the first call audio is obtained based on the first call data.
[0648] S803. When the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays a second call audio through a receiver, where the second call audio is obtained based on the first call data, and the first call audio and the second call audio have different amplitudes at at least one time point.
[0649] Through this method, after the electronic device obtains call data, the electronic device can identify the intensity of the ambient noise in which the electronic device is located and detect whether there is a person near the electronic device. When the electronic device is in a quiet environment and a person is identified, the electronic device can adjust the amplitude of the call data to reduce the sound leakage of the call audio corresponding to the call data played by the electronic device through the receiver, thereby improving the sound leakage prevention effect.
[0650] Optionally, while the electronic device plays the second call audio through the receiver, it can also play the first masking sound signal corresponding to the second call audio through the speaker, the amplitude of the first masking sound signal is equal to the amplitude of the second call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0651] In this way, the first masking sound signal can offset the sound leakage data of the second call audio played by the electronic device through the receiver, which can further improve the sound leakage prevention effect.
[0652] Exemplarily, the first call data may also be referred to as call data A. The first call audio may also be referred to as call audio A corresponding to the call data A.
[0653] Exemplarily, the second call audio may be Figure 2C The call audio K shown, the first masking sound signal can be Figure 2C The masking sound signal L is shown.
[0654] Exemplarily, the second call audio may be Figure 4A The call audio B shown in the figure, the first masking sound signal can be Figure 4A The masking sound signal B is shown.
[0655] Exemplarily, the second call audio may be Fig. 6A The call audio D shown in the figure, the first masking sound signal can be Fig. 6A The masking sound signal D is shown.
[0656] Exemplarily, the second call audio may be Fig. 7A The call audio I shown in the figure, the first masking sound signal can be Fig. 7A The masking sound signal I is shown.
[0657] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, before the electronic device plays the second call audio through the receiver, the electronic device can prompt the user whether it needs to improve the sound leakage prevention effect, for example, by displaying a control. After receiving the user's input, such as the user clicking the control, the electronic device can improve the sound leakage prevention effect, for example, it can change the amplitude and / or phase of the played call audio, and change the corresponding masking signal amplitude and / or phase. For example, the second call audio can be played. After the user confirms that the sound leakage prevention effect is not improved, the electronic device can continue to play the first call audio.
[0658] In one possible implementation, the method also includes: when the amplitude of the first ambient sound is less than a first threshold and the electronic device does not recognize a person, the electronic device plays a third call audio through a receiver, the third call audio has an amplitude different from the second call audio and the first call audio at least at one time point, and the third call audio is obtained based on the first call data.
[0659] In this way, when the electronic device is in a quiet environment and no person is recognized, there may be someone near the electronic device but the electronic device has not recognized it. The electronic device can play different call audio. For example, the amplitude of the call audio played by the electronic device is different. This can not only ensure that the local user can accurately obtain the content of the call audio, but also further improve the anti-leakage effect.
[0660] Optionally, the electronic device can also play a hidden sound signal corresponding to the third call audio through the speaker while playing the third call audio through the receiver, so as to offset the leakage data of the third call audio and prevent people near the electronic device from obtaining the private content in the third call audio, thereby improving the anti-leakage effect and the user's calling experience.
[0661] Exemplarily, the third call audio may be Figure 2C The call audio M shown, the covert sound signal corresponding to the third call audio may be Figure 2C The masking sound signal N is shown.
[0662] Exemplarily, the third call audio may be Figure 4A The call audio C shown, the covert sound signal corresponding to the third call audio may be Figure 4A The masking sound signal C is shown.
[0663] Exemplarily, the third call audio may be Fig. 6A The call audio E shown, the covert sound signal corresponding to the third call audio may be Fig. 6A The masking sound signal E is shown.
[0664] Exemplarily, the third call audio may be Fig. 7A The call audio J shown in the figure, the covert sound signal corresponding to the third call audio may be Fig. 7A The masking sound signal J is shown.
[0665] In one possible implementation, the method also includes: when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays a fourth call audio through a receiver, the amplitude of the fourth call audio is different from the second call audio and the first call audio at least at one time point, and the fourth call audio is obtained based on the first call data.
[0666] In this way, when the electronic device is between a quiet environment and a noisy environment, the call audio played by the electronic device through the receiver may also be obtained by people near the electronic device. The electronic device can also play different call audios, for example, the amplitude of the call audio played by the electronic device is different, which can not only ensure that the local user can accurately obtain the content of the call audio, but also further improve the anti-leakage effect.
[0667] Optionally, the electronic device may also play a hidden sound signal corresponding to the fourth call audio through a speaker while playing the fourth call audio through a receiver, so as to offset the leakage data of the fourth call audio and prevent people near the electronic device from obtaining private content in the fourth call audio, thereby improving the anti-leakage effect and the user's calling experience.
[0668] Exemplarily, the fourth call audio may be Figure 2D The hidden sound signal corresponding to the call audio O shown in the figure may be Figure 2D The masking sound signal P is shown.
[0669] Exemplarily, the fourth call audio may be Figure 4B The call audio F shown, the covert sound signal corresponding to the fourth call audio may be Figure 4B The masking sound signal F is shown.
[0670] Exemplarily, the fourth call audio may be Figure 6B The call audio G shown, the covert sound signal corresponding to the fourth call audio may be Figure 6B The masking sound signal G is shown.
[0671] Exemplarily, the fourth call audio may be Figure 7B The call audio Q shown, the covert sound signal corresponding to the fourth call audio may be Figure 7B The masking sound signal Q is shown.
[0672] In one possible implementation, the method also includes: when the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fifth call audio through a receiver, the amplitude of the fifth call audio is greater than the amplitude of the first call data, and the fifth call audio is obtained based on the first call data.
[0673] In this way, in a noisy environment, the electronic device can increase the amplitude of the call audio to ensure that the local user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0674] Exemplarily, the fifth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B Call audio H is shown.
[0675] Optionally, in a noisy environment, the electronic device may also play a masking sound signal corresponding to the fourth call audio through a speaker.
[0676] Exemplarily, the masking sound signal corresponding to the fourth call audio may be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0677] Preferably, in a noisy environment, the local user does not care whether the sound is missed, and the electronic device may not play the masking sound signal corresponding to the fourth call audio to save power consumption of the electronic device.
[0678] In one possible implementation, the fifth call audio is obtained based on the amplitude of the first ambient sound and the first call data.
[0679] In a possible implementation, the electronic device recognizes the person, including the electronic device recognizing the person through a camera.
[0680] Preferably, the camera is a rear camera of an electronic device.
[0681] Optionally, when the electronic device plays the call audio through the receiver, the electronic device turns on the camera and confirms whether the electronic device recognizes a person through the camera.
[0682] In one possible implementation, before the electronic device plays the second call audio through the receiver, the method also includes: the electronic device obtains first information, the first information includes any one or more of the following: sensor data, a base station connection status of the electronic device, a device connection status of the electronic device, and location information of the electronic device, the sensor data includes acceleration data and / or gyroscope data; when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver, specifically including: when the electronic device confirms that the electronic device is in the first scene based on the first information, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver.
[0683] In one possible implementation, the method also includes: when the electronic device confirms that the electronic device is in a second scene based on the first information, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio through a receiver, wherein the second scene is different from the first scene, the sixth call audio and the second call audio have different amplitudes at at least one time point, and the sixth call audio is obtained based on the first call data.
[0684] The first scenario and the second scenario may be scenarios where the electronic device is in a relatively closed environment. In scenarios where the electronic device is in a relatively closed environment, due to the presence of sound reflection, the sound leakage problem of the call audio played by the electronic device through the receiver is more serious. In different closed scenarios, the sound reflection intensity is different, and the sound leakage problem of the call audio corresponding to the call data played by the electronic device through the receiver is also different.
[0685] In this way, the electronic device can identify different preset scenes and play different call audio. For example, the electronic device can identify different preset scenes and process the call data differently to achieve the purpose of playing different call audio, further improving the sound leakage prevention effect.
[0686] For example, when the first scene includes an elevator scene and the second scene includes a car scene, the first call audio may be Figure 4A The call audio B shown, the sixth call audio can be Fig. 6A Call audio D is shown.
[0687] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on different scenarios, for example, the electronic device may play call audio with different amplitudes. Figure 4A , Figure 4B , Fig. 6A , Figure 6B Description in the Examples.
[0688] In one possible implementation, the method also includes: when the electronic device confirms based on the first information that the electronic device is not in the first scene and the second scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a seventh call audio through a receiver, the seventh call audio and the second call audio and the sixth call audio have different amplitudes at at least one time point, and the seventh call audio is obtained based on the first call data.
[0689] In this way, when the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, and can also improve the anti-leakage sound effect of the electronic device in the non-preset scenario.
[0690] Exemplarily, the seventh call audio may be Fig. 7A Call audio I is shown.
[0691] Optionally, when the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, or when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, or when the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on non-preset scenarios, for example, the electronic device may play call audio with different amplitudes. Fig. 7A , Figure 7B Description in the Examples.
[0692] In one possible implementation, the first scene includes an elevator scene. When the first information satisfies a first condition, the electronic device is in an elevator scene; the first condition includes any one or more of the following: within a first time period, the electronic device moves in a horizontal direction, within a second time period, the electronic device moves in a vertical direction, the second time period is a time period after the first time period, the device connection status of the electronic device includes that the electronic device is connected to Wi-Fi, and the location information of the electronic device is near an office building / community / hospital / shopping mall.
[0693] For example, how the electronic device recognizes the elevator scene can be referred to Figure 3A-3K Description in the examples.
[0694] In one possible implementation, the second scenario includes a riding scenario, and when the first information satisfies the second condition, the electronic device is in the riding scenario; the second condition includes any one or more of the following: the electronic device switches from connecting to the first base station to connecting to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection state of the electronic device includes establishing a connection between the electronic device and the vehicle, and the position of the electronic device is continuously changing.
[0695] For example, how the electronic device identifies the riding scene can be referred to Figure 5 Description in the examples.
[0696] In one possible implementation, the second call audio is obtained based on the first call data and second information, and the second information includes any one or more of the following: the amplitude corresponding to the first call data at different time points, the volume value of the call audio played by the electronic device through the receiver, and the amplitude corresponding to the first ambient sound at different time points.
[0697] The present application provides an electronic device, which includes a memory and a processor, wherein the memory is used to store a computer program; the processor is used to call the computer program so that the electronic device executes each step of a call method provided by the present application.
[0698] The present application provides a computer-readable storage medium, including instructions. When the instructions are executed on an electronic device, the electronic device executes each step of a call method provided by the present application.
[0699] The present application provides a computer program product, which includes computer instructions. When the computer instructions are run on an electronic device, the electronic device executes each step of a call method provided by the present application.
[0700] The present application provides a chip, which is applied to an electronic device. The chip includes one or more processors, and the processor is used to call computer instructions to enable the electronic device to execute various steps in a call method provided by the present application.
[0701] It is understandable that the various user interfaces described in the embodiments of the present application are only example interfaces and do not limit the present application scheme. In other embodiments, the user interface may adopt a different interface layout, may include more or fewer controls, and may increase or decrease other functional options, as long as they are based on the same inventive concept provided by the present application, they are all within the scope of protection of the present application.
[0702] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of the present application.
[0703] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
Claims
1. A method for making a call, characterized in that: The method comprises: When the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays the first call audio through the receiver and plays the first masking sound signal through the speaker, the amplitude of the first masking sound signal is equal to the amplitude of the first call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
2. The method according to claim 1, characterized in that When the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, the electronic device plays a second call audio through a receiver and plays a second masking sound signal through a speaker, the amplitude of the second masking sound signal is equal to the amplitude of the second call audio, the phase of the second masking sound signal is opposite to the phase of the second call audio, and the second call audio is different from the first call audio.
3. The method according to claim 2, characterized in that The first call audio and the second call audio are obtained based on the first call data, and the second call audio and the first call audio have different amplitudes at at least one time point.
4. The method according to any one of claims 1 to 3, characterized in that: When the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays the third call audio through the receiver and plays the third masking sound signal through the speaker, the amplitude of the third masking sound signal is equal to the amplitude of the third call audio, and the phase of the third masking sound signal is opposite to the phase of the third call audio.
5. The method according to claim 4, characterized in that The third call audio is obtained based on the first call data, and the third call audio and the first call audio have different amplitudes at at least one time point.
6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: When the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fourth call audio through the receiver, the amplitude of the fourth call audio is greater than the amplitude of the call audio corresponding to the first call data, and the fourth call audio is obtained based on the first call data.
7. The method according to any one of claims 1 to 6, characterized in that: The electronic device recognizes the person, including the electronic device recognizing the person through a camera.
8. The method according to any one of claims 1 to 7, characterized in that: Before the electronic device plays the first call audio through the receiver, the method further includes: The electronic device acquires first information, where the first information includes any one or more of the following: sensor data, a base station connection state of the electronic device, a device connection state of the electronic device, and location information of the electronic device, where the sensor data includes acceleration data and / or gyroscope data; When the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays the first call audio through the receiver, specifically including: When the electronic device confirms, based on the first information, that the electronic device is in a first scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays the first call audio.
9. The method according to claim 8, characterized in that The method further comprises: When the electronic device confirms, based on the first information, that the electronic device is in the second scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a fifth call audio through a receiver, wherein the second scene is different from the first scene, the fifth call audio and the first call audio have different amplitudes at at least one time point, and the fifth call audio is obtained based on the first call data.
10. The method according to claim 9, characterized in that The method further comprises: When the electronic device confirms, based on the first information, that the electronic device is not in the first scene and the second scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio, the sixth call audio has an amplitude different from the first call audio and the fifth call audio at least at one time point, and the sixth call audio is obtained based on the first call data.
11. The method according to any one of claims 11 to 10, characterized in that: The first scene includes an elevator scene, and when the first information satisfies a first condition, the electronic device is in the elevator scene; The first condition includes any one or more of the following: within a first time period, the electronic device moves in a horizontal direction; within a second time period, the electronic device moves in a vertical direction, the second time period is a time period after the first time period; the device connection status of the electronic device includes that the electronic device is connected to Wi-Fi; and the location information of the electronic device is near an office building / community / hospital / shopping mall.
12. The method according to claim 9 or 10, characterized in that: The second scenario includes a vehicle riding scenario, and when the first information satisfies a second condition, the electronic device is in the vehicle riding scenario; The second condition includes any one or more of the following: the electronic device switches from being connected to a first base station to being connected to a second base station, the second base station is different from the first base station, the electronic device moves in a horizontal direction, the device connection state of the electronic device includes establishing a connection between the electronic device and a vehicle, and the position of the electronic device is continuously changing.
13. The method according to any one of claims 1 to 12, characterized in that: The first call audio is obtained based on the first call data and second information, and the second information includes any one or more of the following: the amplitude corresponding to the first call data at different time points, the volume value of the call audio played by the electronic device through the receiver, and the amplitude corresponding to the first ambient sound at different time points.
14. A method for making a call, characterized in that: The method comprises: The electronic device obtains the first call data; In the case where the ambient sound is not acquired, the electronic device plays a first call audio through a receiver, where the first call audio is obtained based on the first call data; When the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays a second call audio through the receiver, where the second call audio is obtained based on the first call data; The first call audio and the second call audio have different amplitudes at at least one time point.
15. The method according to claim 14, characterized in that The method further comprises: When the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, the electronic device plays a third call audio through the receiver, the third call audio has a different amplitude from the second call audio and the first call audio at least at one time point, and the third call audio is obtained based on the first call data.
16. The method according to claim 14 or 15, characterized in that The method further comprises: When the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays a fourth call audio through the receiver, the amplitude of the fourth call audio is different from the second call audio and the first call audio at least at one time point, and the fourth call audio is obtained based on the first call data.
17. The method according to any one of claims 14 to 16, characterized in that: The method further comprises: When the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays the fifth call audio through the receiver, the amplitude of the fifth call audio is greater than the amplitude of the first call data, and the fifth call audio is obtained based on the first call data.
18. The method according to claim 17, characterized in that The fifth call audio is obtained based on the amplitude of the first ambient sound and the first call data.
19. The method according to any one of claims 14 to 18, characterized in that: The electronic device recognizes the person, including the electronic device recognizing the person through a camera.
20. The method according to any one of claims 14 to 19, characterized in that: Before the electronic device plays the second call audio through the receiver, the method further includes: The electronic device acquires first information, where the first information includes any one or more of the following: sensor data, a base station connection state of the electronic device, a device connection state of the electronic device, and location information of the electronic device, where the sensor data includes acceleration data and / or gyroscope data; When the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver, specifically including: When the electronic device confirms, based on the first information, that the electronic device is in the first scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver.
21. The method according to claim 20, characterized in that The method further comprises: When the electronic device confirms, based on the first information, that the electronic device is in the second scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays the sixth call audio through the receiver, wherein the second scene is different from the first scene, the sixth call audio and the second call audio have different amplitudes at at least one time point, and the sixth call audio is obtained based on the first call data.
22. The method according to claim 21, characterized in that The method further comprises: When the electronic device confirms based on the first information that the electronic device is not in the first scene and the second scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a seventh call audio through the receiver, the seventh call audio and the second call audio and the sixth call audio have different amplitudes at at least one time point, and the seventh call audio is obtained based on the first call data.
23. The method according to any one of claims 20 to 22, characterized in that: The first scene includes an elevator scene, and when the first information satisfies a first condition, the electronic device is in the elevator scene; The first condition includes any one or more of the following: within a first time period, the electronic device moves in a horizontal direction; within a second time period, the electronic device moves in a vertical direction, the second time period is a time period after the first time period; the device connection status of the electronic device includes that the electronic device is connected to Wi-Fi; and the location information of the electronic device is near an office building / community / hospital / shopping mall.
24. The method according to claim 21 or 22, characterized in that The second scenario includes a vehicle riding scenario, and when the first information satisfies a second condition, the electronic device is in the vehicle riding scenario; The second condition includes any one or more of the following: the electronic device switches from being connected to a first base station to being connected to a second base station, the second base station is different from the first base station, the electronic device moves in a horizontal direction, the device connection state of the electronic device includes establishing a connection between the electronic device and a vehicle, and the position of the electronic device is continuously changing.
25. The method according to any one of claims 14 to 24, characterized in that: The second call audio is obtained based on the first call data and second information, and the second information includes any one or more of the following: the amplitude corresponding to the first call data at different time points, the volume value of the call audio played by the electronic device through the receiver, and the amplitude corresponding to the first ambient sound at different time points.
26. The method according to any one of claims 14 to 25, characterized in that: The method further comprises: When the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays a first masking sound signal through a speaker, the amplitude of the first masking sound signal is equal to the amplitude of the second call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
27. An electronic device, characterized in that: The electronic device comprises a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to call the computer program so that the electronic device executes the method according to any one of claims 1 to 26.
28. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 26.
29. A computer program product, characterized in that The computer program product comprises computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes the method according to any one of claims 1 to 26.
Citation Information
Patent Citations
Scene perception method and device and storage medium
CN118118775A
Voice leakage prevention call control method and device and electronic equipment
CN118283157A
Sound channel mode switching method and device and storage medium
CN118394296A
