A communication method, an electronic device, and a computer storage medium
By recognizing environmental noise and the presence of people, adjusting the amplitude of the call audio and playing a masking sound signal with opposite phase, the problem of audio leakage during electronic device calls is solved, achieving better privacy protection and user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2024-08-28
- Publication Date
- 2026-05-26
AI Technical Summary
Electronic devices have a problem with audio leakage during calls, especially in quiet environments, where people nearby may hear the user's private conversations, leading to privacy breaches.
By identifying the intensity of ambient noise and the presence of people, the amplitude of the call audio is adjusted, and a masking sound signal with opposite phase is played through the speaker to cancel out sound leakage, or the amplitude of the call audio is increased in noisy environments to ensure that the user can hear it.
It effectively prevents audio leakage during calls, protects user privacy, and enhances the call experience.
Smart Images

Figure CN119182847B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of terminal technology, and in particular to a communication method, electronic device, and computer storage medium. Background Technology
[0002] With the development of terminal technology, more and more applications are installed on electronic devices, allowing users to experience different functions. For example, users can use phone or social applications installed on their electronic devices to make calls and communicate quickly with other users. Users can hold the receiver (or earpiece) of an electronic device close to their ear; the sound output from the receiver can enter the user's ear and also enter the surrounding environment. If there are people around the electronic device, the sound entering the surrounding environment can easily be heard by others, posing a risk of user privacy leakage. Summary of the Invention
[0003] This application provides a call method, an electronic device method, and a computer storage medium. The electronic device can detect the ambient noise level and whether anyone is nearby. When the electronic device is in a quiet environment and a person is detected, it can adjust the amplitude of the call data to reduce the leakage noise of the call audio corresponding to the call data played through the receiver. Alternatively, the electronic device can play a covert sound signal corresponding to the call audio played through the receiver to cancel out the leakage data and prevent people near the electronic device from accessing the private content of the call audio. This method improves the anti-leakage effect and enhances the user's call experience.
[0004] In a first aspect, this application provides a method for making a call. The method includes: when the amplitude of a first ambient sound is less than a first threshold and an electronic device detects a person, the electronic device plays a first call audio through a receiver and plays a first masking sound signal through a speaker. The amplitude of the first masking sound signal is equal to the amplitude of the first call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0005] It should be understood that in some embodiments, the speaker and receiver are housed in a single module but have different output channels. The speaker and receiver can be driven separately, so that the sounds emitted by the speaker and receiver cancel each other out in the spatial area, thus preventing sound leakage.
[0006] It should be noted that the masking sound signal is not limited to being played through a speaker; it can also be played through other devices. This application does not limit this.
[0007] This method allows an electronic device to play a covert audio signal corresponding to the call audio through a speaker while playing the call audio through the receiver, in a quiet environment and when a person is detected. The covert audio signal is used to cancel out the leaked audio data, preventing people near the electronic device from obtaining the private content in the call audio, thus improving the anti-leakage effect and enhancing the user's call experience.
[0008] The amplitude of the first masking sound signal is equal to the amplitude of the first call audio. This means that the difference between the amplitude of the first masking sound signal and the amplitude of the first call audio can be within the error range. For example, the error range can be between AdB and BdB. For example, A can be 0 and B can be 5, so the error range can be between 0dB and 5dB.
[0009] The phase of the first masking sound signal is opposite to the phase of the first call audio. This means that the difference between the phase of the first masking sound signal and the phase of the first call audio can be within an error range. For example, the error range can be between C degrees and D degrees. For example, C can be 0 and D can be 5, so the error range can be between 0 degrees and 5 degrees.
[0010] Optionally, the audio of the first call is obtained based on the data from the first call.
[0011] In some embodiments, the amplitude of the first call audio is the same as the amplitude of the call audio corresponding to the first call data, that is, the electronic device does not change the amplitude of the first call data.
[0012] In some embodiments, the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data, or the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data at least at one point in time, that is, the electronic device also changes the amplitude of the first call data.
[0013] For example, the first call data can also be referred to as call data A.
[0014] For example, the first call audio could be Figure 2C The first masking sound signal in the call audio K shown can be... Figure 2C The masking sound signal L is shown.
[0015] For example, the first call audio could be Figure 4A The first masking sound signal in the audio B of the call shown can be... Figure 4A The masking sound signal B is shown.
[0016] For example, the first call audio could be Figure 6A The first masking sound signal in the call audio D shown can be... Figure 6AThe masking sound signal D is shown.
[0017] For example, the first call audio could be Figure 7A The first masking sound signal in the call audio I shown can be... Figure 7A The masking sound signal I is shown.
[0018] In conjunction with the first aspect, in one possible implementation, when the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, the electronic device plays a second call audio through the receiver and plays a second masking sound signal through the speaker. The amplitude of the second masking sound signal is equal to the amplitude of the second call audio, and the phase of the second masking sound signal is opposite to the phase of the second call audio. The second call audio is different from the first call audio.
[0019] In this way, even if the electronic device is in a quiet environment and no person is detected, there may be someone nearby that the electronic device just hasn't detected. The electronic device can play the second call audio through the receiver and the corresponding covert sound signal through the speaker to cancel out the leaked audio data of the second call audio. This prevents people near the electronic device from obtaining the private content of the second call audio, improves the anti-leakage effect, and enhances the user's call experience.
[0020] For example, the first call audio could be Figure 2C The second masking sound signal in the call audio M shown can be... Figure 2C The masking sound signal N is shown.
[0021] For example, the first call audio could be Figure 4A The second masking sound signal in the audio C of the call shown can be... Figure 4A The masking sound signal C is shown.
[0022] For example, the first call audio could be Figure 6A The second masking sound signal in the call audio E shown can be... Figure 6A The masking sound signal E is shown.
[0023] For example, the first call audio could be Figure 7A The second masking sound signal can be the audio signal J shown in the call audio. Figure 7A The masking sound signal J is shown.
[0024] In conjunction with the first aspect, in one possible implementation, the first call audio and the second call audio are obtained based on the first call data, and the amplitudes of the second call audio and the first call audio are different at at least one point in time.
[0025] In this way, when the electronic device is in a quiet environment, and when the electronic device detects someone nearby versus when it does not, the electronic device can play different call audio, such as different amplitudes of the call audio played by the electronic device. This not only ensures that the user can accurately obtain the content of the call audio, but also further improves the anti-leakage effect.
[0026] Optionally, the amplitude of the second call audio can be the same as that of the first call audio, meaning the electronic device can play the masking sound signal without changing the amplitude of the call audio.
[0027] Optionally, when the electronic device is in a quiet environment and no person is detected, the electronic device plays a second call audio through the receiver and a corresponding masking sound signal through the speaker. The electronic device can prompt the user whether to improve the anti-leakage effect, for example, through a display control. After receiving user input, such as the user clicking the control, the electronic device can improve the anti-leakage effect, for example, by changing the amplitude and / or phase of the played call audio and changing the amplitude and / or phase of the corresponding masking signal. For example, it can switch from playing the second call audio to playing the first call audio.
[0028] In conjunction with the first aspect, in one possible implementation, when the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays a third call audio through the receiver and plays a third masking sound signal through the speaker. The amplitude of the third masking sound signal is equal to the amplitude of the third call audio, and the phase of the third masking sound signal is opposite to the phase of the third call audio.
[0029] Thus, even in environments between quiet and noisy, the audio of a call played through the receiver could still be heard by people nearby. Alternatively, the electronic device could simultaneously play a covert audio signal through its speaker while playing the call audio through the receiver, thus canceling out any leaked audio data and preventing people nearby from accessing the private content of the call audio. This also improves the effectiveness of preventing audio leakage.
[0030] For example, the third call audio could be Figure 2D The third masking sound signal shown in the call audio O can be... Figure 2D The masking sound signal P is shown.
[0031] For example, the third call audio could be Figure 4B The third masking sound signal in the call audio F shown can be... Figure 4B The masking sound signal F is shown.
[0032] For example, the third call audio could be Figure 6B The third masking sound signal in the call audio G shown can be... Figure 6B The masking sound signal G is shown.
[0033] For example, the third call audio could be Figure 7B The call audio Q shown can be the third masking sound signal. Figure 7B The masking sound signal Q is shown.
[0034] In conjunction with the first aspect, in one possible implementation, the third call audio is obtained based on the first call data, and the amplitude of the third call audio and the first call audio are different at at least one point in time.
[0035] In this way, electronic devices can play different call audio in different environments, and generate and play different masking sound signals based on the different call audio, further improving the anti-sound leakage effect of electronic devices in different environments.
[0036] Optionally, the amplitude of the third call audio can be the same as that of the first call audio, meaning the electronic device can play the masking sound signal without changing the amplitude of the call audio.
[0037] In conjunction with the first aspect, in one possible implementation, the method further includes: when the amplitude of the first ambient sound is greater than a second threshold, the electronic device plays a fourth call audio through the receiver, the amplitude of the fourth call audio being greater than the amplitude of the call audio corresponding to the first call data, and the fourth call audio being obtained based on the first call data.
[0038] In this way, in noisy environments, electronic devices can amplify the amplitude of call audio to ensure that the user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0039] For example, the fourth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The audio of the call shown is H.
[0040] Optionally, in noisy environments, electronic devices can also play masked sound signals corresponding to the fourth call audio through a speaker.
[0041] For example, the masking sound signal corresponding to the fourth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0042] Preferably, in noisy environments, where the user is not concerned about sound leakage, the electronic device may not play the masking sound signal corresponding to the fourth call audio, thereby saving power consumption.
[0043] In conjunction with the first aspect, in one possible implementation, the electronic device identifies a person, including the electronic device identifying a person via a camera.
[0044] Preferably, the camera is a rear-facing camera of an electronic device.
[0045] Optionally, while the electronic device is playing call audio through the receiver, the electronic device then turns on the camera and confirms whether the electronic device has recognized the person through the camera.
[0046] In conjunction with the first aspect, in one possible implementation, before the electronic device plays the first call audio through the receiver, the method further includes: the electronic device acquiring first information, the first information including any one or more of the following: sensor data, the base station connection status of the electronic device, the device connection status of the electronic device, and the location information of the electronic device, wherein the sensor data includes acceleration data and / or gyroscope data; and when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the first call audio through the receiver, specifically including: when the electronic device confirms based on the first information that the electronic device is in a first scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the first call audio.
[0047] In conjunction with the first aspect, in one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is in a second scenario, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a fifth call audio through a receiver, wherein the second scenario is different from the first scenario, the amplitude of the fifth call audio and the first call audio are different at at least one point in time, and the fifth call audio is obtained based on the first call data.
[0048] The first and second scenarios can both involve electronic devices operating in relatively enclosed environments. In these environments, sound reflection causes more severe audio leakage when the electronic device transmits call audio through the receiver. Furthermore, the intensity of sound reflection varies across different enclosed environments, resulting in varying degrees of audio leakage when the electronic device transmits call data through the receiver.
[0049] In this way, electronic devices can recognize different preset scenarios and play different call audio. For example, electronic devices can recognize different preset scenarios and process call data differently to achieve the purpose of playing different call audio, thereby further improving the sound leakage prevention effect.
[0050] For example, when the first scenario includes an elevator scenario and the second scenario includes a car ride scenario, the first call audio can be... Figure 4A The fifth call audio, shown in call audio B, can be... Figure 6A The audio of the call shown is D.
[0051] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device can also play different call audio based on different scenarios. For example, the electronic device can play call audio with different amplitudes. For details, please refer to... Figure 4A , Figure 4B , Figure 6A , Figure 6B Description in the embodiments.
[0052] In conjunction with the first aspect, in one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is not in the first scenario or the second scenario, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio, the sixth call audio having an amplitude different from the first call audio and the fifth call audio at at least one point in time, and the sixth call audio is obtained based on the first call data.
[0053] In this way, if the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, which can also improve the anti-leakage effect of the electronic device in the non-preset scenario.
[0054] For example, the audio of the sixth call could be Figure 7A The audio of the call shown is I.
[0055] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on a non-preset scenario. For example, the electronic device may play call audio with different amplitudes. For details, please refer to... Figure 7A , Figure 7B Description in the embodiments.
[0056] In conjunction with the first aspect, in one possible implementation, the first scenario includes an elevator scenario, where the electronic device is in the elevator scenario when the first information meets the first condition.
[0057] The first condition includes any one or more of the following: during the first time period, the electronic device moves horizontally; during the second time period, the electronic device moves vertically, the second time period being a time period following the first time period; the device connection status of the electronic device includes the electronic device being connected to Wi-Fi; and the location information of the electronic device is near an office building / residential area / hospital / shopping mall.
[0058] For example, regarding how electronic devices can identify elevator scenarios, you can refer to... Figures 3A-3K Description in the embodiments.
[0059] In conjunction with the first aspect, in one possible implementation, the second scenario includes a vehicle-riding scenario. When the first information satisfies the second condition, the electronic device is in a vehicle-riding scenario. The second condition includes any one or more of the following: the electronic device switches from being connected to the first base station to being connected to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection status of the electronic device includes the electronic device establishing a connection with the vehicle, and the location of the electronic device is constantly changing.
[0060] For example, regarding how electronic devices can identify passenger scenarios, you can refer to... Figure 5 Description in the embodiments.
[0061] In conjunction with the first aspect, in one possible implementation, the first call audio is obtained based on the first call data and the second information, the second information including any one or more of the following: the amplitude of the first call data at different time points, the volume of the call audio played by the electronic device through the receiver, and the amplitude of the first ambient sound at different time points.
[0062] Secondly, this application provides a call method. The method includes: an electronic device acquiring first call data; in the absence of ambient sound, the electronic device playing first call audio through a receiver, the first call audio being obtained based on the first call data; and in the case where the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device playing second call audio through the receiver, the second call audio being obtained based on the first call data; the amplitudes of the first call audio and the second call audio are different at at least one point in time.
[0063] Using this method, after acquiring call data, the electronic device can identify the ambient noise level and detect whether there are people nearby. When the electronic device is in a quiet environment and a person is detected, it can adjust the amplitude of the call data to reduce the leakage of audio transmitted through the receiver, thus improving the anti-leakage effect.
[0064] Optionally, while playing the second call audio through the receiver, the electronic device may also play the first masking sound signal corresponding to the second call audio through the speaker. The amplitude of the first masking sound signal is equal to the amplitude of the second call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0065] It should be understood that in some embodiments, the speaker and receiver are housed in a single module but have different output channels. The speaker and receiver can be driven separately, so that the sounds emitted by the speaker and receiver cancel each other out in the spatial area, thus preventing sound leakage.
[0066] It should be noted that the masking sound signal is not limited to being played through a speaker; it can also be played through other devices. This application does not limit this.
[0067] In this way, the first masking sound signal can cancel out the leakage data of the second call audio played by the electronic device through the receiver, which can further improve the anti-leakage effect.
[0068] For example, the first call data can also be referred to as call data A. The first call audio can also be referred to as call audio A corresponding to call data A.
[0069] For example, the second call audio could be Figure 2C The first masking sound signal in the call audio K shown can be... Figure 2C The masking sound signal L is shown.
[0070] For example, the second call audio could be Figure 4A The first masking sound signal in the audio B of the call shown can be... Figure 4A The masking sound signal B is shown.
[0071] For example, the second call audio could be Figure 6A The first masking sound signal in the call audio D shown can be... Figure 6A The masking sound signal D is shown.
[0072] For example, the second call audio could be Figure 7A The first masking sound signal in the call audio I shown can be... Figure 7A The masking sound signal I is shown.
[0073] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device detects a person, before playing the second call audio through the receiver, the electronic device can prompt the user whether to enhance the anti-leakage effect. This can be done, for example, by displaying a control. After receiving user input, such as the user clicking the control, the electronic device can enhance the anti-leakage effect by changing the amplitude and / or phase of the played call audio and the corresponding masking signal amplitude and / or phase. For example, it can play the second call audio. If the user confirms that the anti-leakage effect should not be enhanced, the electronic device can continue playing the first call audio.
[0074] In conjunction with the second aspect, in one possible implementation, the method further includes: when the amplitude of the first ambient sound is less than a first threshold and the electronic device does not recognize a person, the electronic device plays a third call audio through the receiver, wherein the amplitude of the third call audio is different from that of the second call audio and the first call audio at least at one point in time, and the third call audio is obtained based on the first call data.
[0075] In this way, even if the electronic device is in a quiet environment and no person is detected, there may be someone nearby that the electronic device just hasn't detected. The electronic device can play different call audio, such as different amplitudes of the call audio played by the electronic device. This not only ensures that the user can accurately obtain the content of the call audio, but also further improves the sound leakage prevention effect.
[0076] Optionally, while playing the third call audio through the receiver, the electronic device can also play a covert sound signal corresponding to the third call audio through the speaker to cancel out the leaked audio data of the third call audio, prevent people near the electronic device from obtaining the private content in the third call audio, improve the anti-leakage effect, and enhance the user's call experience.
[0077] For example, the third call audio could be Figure 2C The covert sound signal corresponding to the third call audio M shown can be... Figure 2C The masking sound signal N is shown.
[0078] For example, the third call audio could be Figure 4A The covert sound signal corresponding to the third call audio C shown can be... Figure 4A The masking sound signal C is shown.
[0079] For example, the third call audio could be Figure 6A The covert sound signal corresponding to the third call audio E shown can be... Figure 6A The masking sound signal E is shown.
[0080] For example, the third call audio could be Figure 7A The covert sound signal corresponding to the third call audio J shown can be... Figure 7A The masking sound signal J is shown.
[0081] In conjunction with the second aspect, in one possible implementation, the method further includes: when the amplitude of the first ambient sound is greater than a first threshold and less than a second threshold, the electronic device plays a fourth call audio through the receiver, wherein the amplitude of the fourth call audio is different from that of the second call audio and the first call audio at least at one point in time, and the fourth call audio is obtained based on the first call data.
[0082] Thus, even in environments between quiet and noisy, the audio played by the electronic device through its receiver could still be heard by people nearby. The electronic device can also play different audio frequencies, such as varying amplitudes, which not only ensures the user accurately receives the audio content but also further improves the anti-leakage effect.
[0083] Optionally, the electronic device can also play a covert sound signal corresponding to the fourth call audio through the speaker while playing the fourth call audio through the receiver, in order to cancel out the leaked audio data of the fourth call audio, prevent people near the electronic device from obtaining the private content in the fourth call audio, improve the anti-leakage effect, and improve the user's call experience.
[0084] For example, the fourth call audio could be Figure 2D The covert sound signal corresponding to the fourth call audio (O) shown can be... Figure 2D The masking sound signal P is shown.
[0085] For example, the fourth call audio could be Figure 4B The covert sound signal corresponding to the fourth call audio F shown can be... Figure 4B The masking sound signal F is shown.
[0086] For example, the fourth call audio could be Figure 6B The covert sound signal corresponding to the fourth call audio G shown can be... Figure 6B The masking sound signal G is shown.
[0087] For example, the fourth call audio could be Figure 7B The covert sound signal corresponding to the fourth call audio, Q, shown in the diagram, can be... Figure 7B The masking sound signal Q is shown.
[0088] In conjunction with the second aspect, in one possible implementation, the method further includes: when the amplitude of the first ambient sound is greater than a second threshold, the electronic device plays a fifth call audio through the receiver, the amplitude of the fifth call audio being greater than the amplitude of the first call data, and the fifth call audio being obtained based on the first call data.
[0089] In this way, in noisy environments, electronic devices can amplify the amplitude of call audio to ensure that the user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0090] For example, the fifth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The audio of the call shown is H.
[0091] Optionally, in noisy environments, electronic devices can also play masked sound signals corresponding to the fourth call audio through a speaker.
[0092] For example, the masking sound signal corresponding to the fourth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0093] Preferably, in noisy environments, where the user is not concerned about sound leakage, the electronic device may not play the masking sound signal corresponding to the fourth call audio, thereby saving power consumption.
[0094] In conjunction with the second aspect, in one possible implementation, the fifth call audio is obtained based on the amplitude of the first ambient sound and the first call data.
[0095] In conjunction with the second aspect, in one possible implementation, the electronic device identifies a person, including the electronic device identifying a person through a camera.
[0096] Preferably, the camera is a rear-facing camera of an electronic device.
[0097] Optionally, while the electronic device is playing call audio through the receiver, the electronic device then turns on the camera and confirms whether the electronic device has recognized the person through the camera.
[0098] In conjunction with the second aspect, in one possible implementation, before the electronic device plays the second call audio through the receiver, the method further includes: the electronic device acquiring first information, the first information including any one or more of the following: sensor data, the base station connection status of the electronic device, the device connection status of the electronic device, and the location information of the electronic device, wherein the sensor data includes acceleration data and / or gyroscope data; and when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver, specifically including: when the electronic device confirms based on the first information that the electronic device is in a first scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver.
[0099] In conjunction with the second aspect, in one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is in the second scenario, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio through the receiver, wherein the second scenario is different from the first scenario, the amplitude of the sixth call audio and the second call audio are different at at least one point in time, and the sixth call audio is obtained based on the first call data.
[0100] The first and second scenarios can both involve electronic devices operating in relatively enclosed environments. In these environments, sound reflection causes more severe audio leakage when the electronic device transmits call audio through the receiver. Furthermore, the intensity of sound reflection varies across different enclosed environments, resulting in varying degrees of audio leakage when the electronic device transmits call data through the receiver.
[0101] In this way, electronic devices can recognize different preset scenarios and play different call audio. For example, electronic devices can recognize different preset scenarios and process call data differently to achieve the purpose of playing different call audio, thereby further improving the sound leakage prevention effect.
[0102] For example, when the first scenario includes an elevator scenario and the second scenario includes a car ride scenario, the first call audio can be... Figure 4A The sixth call audio, shown in call audio B, can be... Figure 6A The audio of the call shown is D.
[0103] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device can also play different call audio based on different scenarios. For example, the electronic device can play call audio with different amplitudes. For details, please refer to... Figure 4A , Figure 4B , Figure 6A , Figure 6B Description in the embodiments.
[0104] In conjunction with the second aspect, in one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is not in the first scenario or the second scenario, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a seventh call audio through the receiver. The amplitude of the seventh call audio is different from that of the second call audio and the sixth call audio at least at one point in time. The seventh call audio is obtained based on the first call data.
[0105] In this way, if the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, which can also improve the anti-leakage effect of the electronic device in the non-preset scenario.
[0106] For example, the audio of the seventh call could be Figure 7A The audio of the call shown is I.
[0107] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on a non-preset scenario. For example, the electronic device may play call audio with different amplitudes. For details, please refer to... Figure 7A , Figure 7B Description in the embodiments.
[0108] In conjunction with the second aspect, in one possible implementation, the first scenario includes an elevator scenario. When the first information meets the first condition, the electronic device is in the elevator scenario. The first condition includes any one or more of the following: during a first time period, the electronic device moves horizontally; during a second time period, the electronic device moves vertically, the second time period being a time period following the first time period; the device connection status of the electronic device includes the electronic device being connected to Wi-Fi; and the location information of the electronic device is near an office building / residential area / hospital / shopping mall.
[0109] For example, regarding how electronic devices can identify elevator scenarios, you can refer to... Figures 3A-3K Description in the embodiments.
[0110] In conjunction with the second aspect, in one possible implementation, the second scenario includes a vehicle-riding scenario. When the first information satisfies the second condition, the electronic device is in a vehicle-riding scenario. The second condition includes any one or more of the following: the electronic device switches from being connected to the first base station to being connected to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection status of the electronic device includes the electronic device establishing a connection with the vehicle, and the location of the electronic device is constantly changing.
[0111] For example, regarding how electronic devices can identify passenger scenarios, you can refer to... Figure 5 Description in the embodiments.
[0112] In conjunction with the second aspect, in one possible implementation, the second call audio is obtained based on the first call data and the second information, the second information including any one or more of the following: the amplitude of the first call data at different time points, the volume of the call audio played by the electronic device through the receiver, and the amplitude of the first ambient sound at different time points.
[0113] Thirdly, this application provides an electronic device, which includes a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to invoke the computer program, causing the electronic device to execute a call method provided in any possible implementation of any of the above aspects.
[0114] Fourthly, this application provides a computationally readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform a call method provided in any possible implementation of any of the above aspects.
[0115] Fifthly, this application provides a computer program product containing computer instructions that, when executed on an electronic device, cause the electronic device to perform a call method provided in any possible implementation of any of the above aspects.
[0116] Sixthly, this application provides a chip applied to an electronic device, the chip including one or more processors, the processors being used to invoke computer instructions to cause the electronic device to execute a call method provided in any possible implementation of any of the above aspects.
[0117] Understandably, the beneficial effects provided in aspects three through six above can be referred to in the beneficial effects of the corresponding methods, and will not be repeated here. Attached Figure Description
[0118] Figure 1An exemplary schematic diagram of the hardware structure of electronic device 100 is shown;
[0119] Figure 2A An exemplary software structure block diagram of electronic device 100 is shown;
[0120] Figure 2B A schematic diagram of the processing flow of the electronic device 100 playing call audio through the receiver is shown;
[0121] Figure 2C A schematic flowchart of a processing method in which electronic device 100 plays call audio through a receiver when the noise level of a first ambient sound is less than a first threshold is shown.
[0122] Figure 2D A schematic flowchart of a processing method in which electronic device 100 plays call audio through a receiver when the noise level of a first ambient sound is greater than a first threshold is shown.
[0123] Figures 3A-3D The diagram illustrates a user waiting for and entering an elevator.
[0124] Figure 3E This diagram illustrates the user's movement route as they enter the elevator.
[0125] Figure 3F A schematic diagram showing a user ascending in an elevator is provided.
[0126] Figure 3G An exemplary schematic diagram illustrates the change in the horizontal acceleration of the electronic device 100 during a first time period;
[0127] Figure 3H An exemplary schematic diagram illustrates the change in the vertical acceleration of the electronic device 100 during a first time period;
[0128] Figure 3I An exemplary schematic diagram illustrates the change in the horizontal acceleration of the electronic device 100 during a second time period;
[0129] Figure 3J An exemplary schematic diagram illustrates the change in the vertical acceleration of an electronic device 100 during a second time period;
[0130] Figure 3K An exemplary schematic diagram illustrates another variation in the vertical acceleration of the electronic device 100 during a second time period;
[0131] Figure 4A This paper presents a schematic diagram of another method for electronic device 100 to process call data based on an elevator scenario anti-leakage model when the noise level of the first ambient sound is less than a first threshold.
[0132] Figure 4B This diagram illustrates another processing method in which electronic device 100 plays call audio through a receiver when the noise level of the first ambient sound is greater than a first threshold.
[0133] Figure 5 A schematic diagram is shown showing how the connected base station changes after the location of an electronic device 100 changes.
[0134] Figure 6A This paper presents a schematic diagram of another processing method in which electronic device 100 plays call audio through a receiver when the noise level of the first ambient sound is less than a first threshold.
[0135] Figure 6B This paper presents a schematic diagram of another processing method in which electronic device 100 plays call audio through a receiver when the noise level of the first ambient sound is greater than a first threshold.
[0136] Figure 7A The diagram illustrates another method for electronic device 100 to process call data based on a non-preset scenario anti-leakage model when the noise level of the first ambient sound is less than a first threshold.
[0137] Figure 7B The diagram illustrates another method for electronic device 100 to process call data based on a non-preset scenario anti-leakage model when the noise level of the first ambient sound is greater than a first threshold.
[0138] Figure 8 A flowchart illustrating a call method provided in this application is shown. Detailed Implementation
[0139] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.
[0140] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.
[0141] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.
[0142] The structure of the electronic device involved in this application is described below.
[0143] Please refer to Figure 1 , Figure 1 An exemplary schematic diagram of the hardware structure of electronic device 100 is shown.
[0144] like Figure 1As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a display screen 194, a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include one or more sensors, such as a gyroscope sensor, an accelerometer sensor, etc. In some embodiments, the sensor module 180 may also include one or more of the following sensors: a pressure sensor, a barometric pressure sensor, a proximity sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, a magnetic sensor, a distance sensor, a touch sensor, etc.
[0145] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0146] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0147] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0148] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system. In some embodiments, the processor 110 may include one or more interfaces, such as a universal serial bus (USB) interface.
[0149] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, or USB Type-C port. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0150] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0151] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0152] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0153] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network.
[0154] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.
[0155] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, frequency modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.
[0156] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering.
[0157] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0158] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0159] The ISP is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye.
[0160] Camera 193 is used to capture still images or videos. In some embodiments, electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0161] In some embodiments, the camera 193 can be used to capture images and confirm whether the images include images of people, so that the electronic device 100 can confirm whether there are people in the environment in which the electronic device 100 is located.
[0162] Optionally, the electronic device 100 can capture images via a rear-facing camera and confirm whether there are people in the environment in which the electronic device 100 is located.
[0163] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0164] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0165] The external memory interface 120 can be used to connect an external memory card, such as a MicroSD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage functions.
[0166] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.).
[0167] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0168] Audio module 170 is used to convert digital audio information into analog audio signal output, and also to convert analog audio input into digital audio signal. Audio module 170 can also be used for encoding and decoding audio signals. In some examples, audio module 170 may be located in processor 110, or some functional modules of audio module 170 may be located in processor 110. Speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. Receiver 170B, also called a "handset," is used to convert audio electrical signals into sound signals. Microphone 170C, also called a "microphone" or "microphone," is used to convert sound signals into electrical signals. Headphone jack 170D is used to connect wired headphones.
[0169] In some embodiments, the number of receivers 170B on the electronic device 100 may include one or more. The electronic device 100 can play call data received by the electronic device 100 through one or more receivers 170B, allowing users of the electronic device 100 to access the audio content of the call data. For example, the electronic device 100 may include a single receiver 170B, which may be located at the top of the display screen, and the electronic device 100 can play call data received by the electronic device 100 through this single receiver 170B.
[0170] It should be noted that the electronic device 100 is not limited to one receiver 170B; it may include other receivers 170B as well. This application does not limit this.
[0171] In some embodiments, the electronic device 100 may further include one or more masking signal transmitters. The electronic device 100 can generate a masking sound signal based on the call audio and play the masking sound signal through the masking signal transmitter. The difference between the amplitude of the masking sound signal and the amplitude of the call audio played by the receiver is within an error range, and the phase of the masking sound signal is opposite to the phase of the call audio played by the receiver. Since the distance between the eavesdropper and the receiver on the electronic device 100 is close to the distance between the eavesdropper and the masking signal transmitter on the electronic device 100, the masking sound signal can mask the leaked audio data of the call audio played by the electronic device 100 through the receiver, preventing the eavesdropper from obtaining private information in the call audio due to leaked audio.
[0172] For example, electronic device 100 may include two masking signal transmitters, one of which may be located at the top of the display screen and the other at the bottom of the display screen.
[0173] In some embodiments, the masking signal transmitter can be a loudspeaker. It should be understood that in some embodiments, the loudspeaker and receiver are housed in a single module but have different output channels. The loudspeaker and receiver can be driven separately, such that the sounds emitted by the loudspeaker and receiver cancel each other out in a spatial area, achieving sound leakage prevention.
[0174] In this embodiment of the application, the user of the electronic device 100 can be referred to as the local user, and the non-user of the electronic device 100, that is, other users in the environment where the electronic device 100 is located, can be referred to as eavesdroppers.
[0175] The sensor module 180 may include pressure sensors, gyroscope sensors, barometric pressure sensors, magnetic sensors, accelerometers, gravity sensors, distance sensors, proximity sensors, fingerprint sensors, temperature sensors, touch sensors, ambient light sensors, bone conduction sensors, etc.
[0176] In some embodiments, the electronic device 100 determines whether it is in a preset scenario based on acceleration data collected by an accelerometer and / or gyroscope data collected by a gyroscope sensor. Preset scenarios include, but are not limited to, elevator scenarios, vehicle riding scenarios, etc.
[0177] Buttons 190 include a power button, volume buttons, etc. Motor 191 can generate vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, and also to indicate messages, missed calls, notifications, etc.
[0178] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to achieve functions such as making calls and data communication.
[0179] Electronic device 100 can be a mobile phone, tablet computer, laptop computer, smartwatch, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), etc. This application embodiment does not limit the specific type of electronic device 100.
[0180] Please refer to Figure 2A , Figure 2A An exemplary software structure block diagram of an electronic device 100 is shown.
[0181] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, [the following is omitted as the text is incomplete and likely refers to a specific implementation or feature]. The system is divided into four layers, from top to bottom: application layer, application framework layer, system runtime (AndroidRuntime) and system libraries, and kernel layer.
[0182] The application layer can include a series of application packages.
[0183] like Figure 2A As shown, the application package can include applications such as camera, gallery, calendar, call, map, navigation, Bluetooth, music, and SMS.
[0184] The application framework layer provides APIs and a programming framework for applications within the application layer. The application framework layer includes some predefined functions.
[0185] like Figure 2A As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, preset scene recognition module, etc.
[0186] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture the screen, among other things.
[0187] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0188] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views (view controls). For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0189] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).
[0190] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0191] The notification manager allows applications to display notifications in the status bar (such as the pull-down notification bar). It can be used to convey informational messages and can disappear automatically after a short pause without user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0192] The preset scene recognition module can acquire information such as base station connection status, sensor data, location information of electronic device 100, and device connection status of electronic device 100, and determine whether electronic device 100 is in a preset scene based on any one or more of the above information. A preset scene can refer to a relatively enclosed environment; for example, preset scenes can include, but are not limited to, elevator scenes and vehicle riding scenes. If it is determined that electronic device 100 is in a preset scene, and electronic device 100 is playing call data through a receiver, electronic device 100 can adjust the amplitude and / or phase of the call data.
[0193] Optionally, in different preset scenarios, the electronic device 100 adjusts the amplitude and / or phase of the call data at different intensities to improve the sound leakage prevention effect in different preset scenarios.
[0194] In addition to adjusting the amplitude and / or phase of the call data, the electronic device 100 can also adjust other information of the call data, which is not limited in this application.
[0195] The core library consists of two parts: one part is the functionalities that the Java language needs to call, and the other part is the system's core library.
[0196] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0197] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGLES), 2D graphics engines (e.g., SGL), etc.
[0198] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0199] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0200] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0201] A 2D graphics engine is a graphics engine for 2D drawing.
[0202] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0203] Figure 2B A schematic diagram of the processing flow of an electronic device 100 playing call audio through a receiver is shown.
[0204] like Figure 2B As shown, the electronic device 100 includes an analog-to-digital converter (ADC), an audio processor, a digital-to-analog converter (DAC), and a receiver.
[0205] Audio processors can be Figure 1 The processor 110 shown includes an analog-to-digital converter for converting analog signals to digital signals, a digital-to-analog converter for converting digital signals to analog signals, and an ADC and DAC. Figure 1 Not shown in the image.
[0206] Optionally, the electronic device 100 may also include a communication unit, which may be: Figure 1 The mobile communication unit 150 or wireless communication unit 160 shown.
[0207] The communication unit is used to acquire audio data, which may refer to analog domain signals. The audio data may be sent to electronic device 100 by other electronic devices that have established a communication connection with electronic device 100.
[0208] Electronic device 100 can establish a call connection with other electronic devices through a telephone application. Other electronic devices can send audio data to a base station, and the base station can then send the audio data back to electronic device 100.
[0209] Electronic device 100 can also establish call connections with other electronic devices through social applications. Other electronic devices can send audio data to the social application server, and the social application server can then send the audio data to electronic device 100.
[0210] After acquiring the audio data, the communication unit can send the audio data to the ADC, which can convert the analog-domain audio data into a digital-domain signal, such as call data, which is a digital-domain signal. The ADC then sends the call data to the audio processor.
[0211] The audio processor is used to process call data differently based on the scene where the electronic device 100 is located, the noise level of the ambient sound, and whether the electronic device 100 has recognized a person, so as to improve the sound leakage prevention effect in different scenarios.
[0212] For information on how audio processors process call data, please refer to [link / reference]. Figures 2C-2D , Figures 4A-4B , Figures 6A-6B , Figures 7A-7B Description in the embodiments.
[0213] An audio processor can obtain processed call data based on call data; the processed call data is also a digital domain signal. The amplitude and / or phase of the processed call data differ from the amplitude and / or phase of the original call data.
[0214] Optionally, the audio processor can either increase or decrease the amplitude of the call data by the same amount at different time points, or it can increase or decrease the amplitude of the call data by different amounts at different time points.
[0215] After acquiring the processed call data, the audio processor can send the processed call data to the DAC. The DAC is used to convert digital domain signals into analog domain signals. For example, the DAC can obtain the call audio signal based on the processed call data. The call audio signal can be the analog domain signal corresponding to the processed call data.
[0216] After acquiring the call audio signal, the DAC can send the call audio signal to the receiver, which can then play the call audio based on the signal, allowing the user to access the audio content within the call audio. The call audio mentioned in this application may refer to an analog domain signal.
[0217] In some embodiments, the audio processor may include a filter. The filter processes the call data to obtain a masked audio signal. The masked audio signal is converted into an analog signal by a DAC, and the analog signal is sent to the output of the masked audio signal generator.
[0218] The following section provides a detailed description of a call data playback method provided in this application, with reference to the accompanying drawings.
[0219] In some embodiments, before the electronic device 100 acquires call data and plays the corresponding call audio through the receiver, the electronic device 100 can collect ambient sound signals and confirm whether the noise level (or amplitude) of the ambient sound signals is less than a first threshold. If the noise level of the ambient sound signals is less than the first threshold, it indicates that the electronic device 100 is in a relatively quiet environment, and leaked audio data is easily acquired by bystanders near the electronic device 100. If the noise level of the first ambient sound is less than the first threshold, the electronic device 100 can further confirm whether a person has been identified. When the electronic device 100 identifies a person, compared to when the electronic device 100 does not identify a person, the call audio played by the electronic device 100 through the receiver is more easily acquired by bystanders near the electronic device 100. Therefore, the electronic device can process the played call audio. For example, for scenarios where the electronic device 100 identifies a person and scenarios where the electronic device 100 does not identify a person, the electronic device 100 can perform different processing on the call data to change the played call audio, thereby improving the anti-leakage effect.
[0220] Figure 2C A schematic flowchart of a processing method is shown in which an electronic device 100 plays call audio through a receiver when the noise level of a first ambient sound is less than a first threshold.
[0221] S201A, electronic device 100 collects first ambient sound through a microphone.
[0222] Electronic device 100 can collect first ambient sound through a microphone. The first ambient sound is used to determine the noise level of the environment in which electronic device 100 is located, so that electronic device 100 can process the call data received by electronic device 100 based on different noise levels.
[0223] Optionally, the electronic device 100 can use its own microphone to collect the first ambient sound, or it can use the microphone of another electronic device that has established a near-field connection with the device to collect the first ambient sound. When the electronic device 100 is connected to other electronic devices, such as a watch connected via Bluetooth, the electronic device 100 can also collect the first ambient sound through the watch's microphone.
[0224] Optionally, after electronic device 100 establishes a communication connection with other electronic devices, electronic device 100 can collect first ambient sound through a microphone.
[0225] Optionally, after the electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver, the electronic device 100 then collects the first ambient sound through the microphone.
[0226] Optionally, the electronic device 100 may also collect the first ambient sound periodically or intermittently. This application does not limit the timing of the electronic device 100 collecting the first ambient sound.
[0227] For example, in noisy environments, electronic device 100 can increase the amplitude of call data, enabling the user to accurately obtain the audio content of the call data.
[0228] For example, in environments with low ambient noise, private information in call data is more easily accessed by eavesdroppers, necessitating improved audio leakage prevention by electronic device 100. Electronic device 100 can further verify whether it has detected a person. Whether it has detected a person or not, it can process the call data based on different audio leakage prevention models. Different strategies can be implemented for different scenarios, improving audio leakage prevention in various situations while ensuring the user accurately accesses the audio content. For details, please refer to the descriptions in S204A-S207A.
[0229] S202A, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is less than the first threshold.
[0230] If the ambient noise level exceeds a first threshold, it indicates that the electronic device 100 is in a non-quiet environment, which may affect the user's ability to access audio content during a call. The electronic device 100 can then increase the amplitude of the call audio. For example, this can be achieved by increasing the amplitude of the call data, i.e., by executing S208A.
[0231] If the ambient noise level is less than the first threshold, it indicates that the ambient noise level of the electronic device 100 is low and the electronic device 100 is in a quiet environment. If the electronic device 100 plays the call audio corresponding to the call data through the receiver, the private content in the call audio may be obtained by an eavesdropper. The electronic device 100 can perform anti-leakage processing on the call data, that is, execute S203A-S207A.
[0232] S203A, Electronic device 100 detects whether there are people near electronic device 100.
[0233] If the ambient noise level is less than a first threshold, the electronic device 100 can further identify whether there is anyone nearby. When someone is detected nearby, the audio played by the electronic device 100 through the receiver is more easily heard by that person compared to when no one is detected. Therefore, the electronic device 100 can play different audio depending on whether it detects someone nearby or not. For example, different audio can be played by processing the call data differently.
[0234] For scenarios where electronic device 100 detects someone nearby and scenarios where electronic device 100 detects no one nearby, electronic device 100 can construct different anti-leakage models and process call data according to different anti-leakage models.
[0235] Optionally, the electronic device 100 can detect whether there is anyone near it by capturing images with a camera, or by transmitting and receiving ultrasonic signals.
[0236] If electronic device 100 detects that someone is near electronic device 100, execute S204A-S205A.
[0237] If electronic device 100 detects that no one is near electronic device 100, execute S206A-S207A.
[0238] Optionally, S203A can be executed before, after, or simultaneously with S202A. S203A can also be executed periodically / irregularly / continuously after the electronic device 100 is powered on. S203A can also be executed when it is detected that the electronic device 100 is playing call audio through the receiver. This application does not limit the timing of the execution of the electronic device 100's detection of whether there is someone nearby.
[0239] When electronic device 100 detects someone nearby:
[0240] S204A and electronic device 100 process call data A based on the anti-leakage model J to obtain call audio K and masking sound signal L. The amplitude of the masking sound signal L is close to the amplitude of the call audio K but opposite in phase.
[0241] S205A, electronic device 100 plays call audio K through a receiver and plays masking sound signal L through a masking signal transmitter.
[0242] It should be understood that in some embodiments, the masking signal transmitter may be a loudspeaker, and the loudspeaker and receiver may be housed in a single module but with different output channels. The loudspeaker and receiver may be driven separately, such that the sounds emitted by the loudspeaker and receiver cancel each other out in the spatial area, thereby preventing sound leakage.
[0243] It should be noted that the masking signal transmitter is not limited to a loudspeaker, but can also be other devices, and this application does not limit it.
[0244] Optionally, call data A can refer to call data within a time segment.
[0245] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal L. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio K is the same as the amplitude of the call audio A corresponding to the call data A.
[0246] The call audio A corresponding to call data A can refer to the call audio played by electronic device 100 through the receiver when the anti-leakage function is not enabled. When the anti-leakage function is not enabled, electronic device 100 does not need to adjust the amplitude and / or phase of call data A. Electronic device 100 only needs to convert the digital domain call data A into the analog domain call audio A and play the call audio A through the receiver.
[0247] Optionally, the electronic device 100 may receive a user's message to enable / disable the sound leakage prevention function in the settings application of the electronic device 100.
[0248] Call data A can be a digital domain signal, and call audio A can be an analog domain signal. Optionally, call audio A can be the audio processed from call data A by a digital-to-analog converter.
[0249] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal L. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio K is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio K and the call audio A are different at at least one point in time.
[0250] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal L.
[0251] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal L as an example.
[0252] Electronic device 100 processes call data A based on a sound leakage prevention model J to obtain call audio K. This can refer to electronic device 100 processing call data A based on the sound leakage prevention model J to obtain processed call data A, where the amplitude and / or phase of the processed call data A differs from that of the original call data A. The processed call data A is then processed by a digital-to-analog converter to obtain call audio K. Call audio K can be an analog domain signal.
[0253] When electronic device 100 confirms that the noise level of the first ambient sound is less than a first threshold and electronic device 100 detects someone near electronic device 100, electronic device 100 can acquire a sound leakage prevention model J, and process the amplitude and / or phase of call data A based on the sound leakage prevention model J to obtain call audio K and masking sound signal L. The amplitude of call audio K is different from the amplitude of call audio A corresponding to call data A, and the phase of call audio K is different from the phase of call audio A corresponding to call data A. The difference between the amplitude of masking sound signal L and the amplitude of call audio K is within the error range, and the phase of masking sound signal L is opposite to the phase of call audio K.
[0254] The specific implementation of the anti-leakage model J in processing call data A to obtain call audio K and masking sound signal L is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the descriptions in S205B-S206B, which will not be repeated here.
[0255] If the electronic device 100 does not detect a person, and the environment in which the electronic device 100 is located is relatively quiet, there may be people around the electronic device 100 that the electronic device 100 just did not detect. The electronic device 100 can process the call data A based on the anti-leakage model K and play the call audio M and the masking sound signal N to reduce the risk of sound leakage.
[0256] When electronic device 100 detects that no one is near it:
[0257] S206A, electronic device 100 processes call data A based on anti-leakage model K to obtain call audio M and masking sound signal N. The amplitude of masking sound signal N is close to the amplitude of call audio M but opposite in phase.
[0258] S207A, electronic device 100 plays call audio M through a receiver and plays masking sound signal N through a masking signal transmitter.
[0259] After enabling the anti-leakage function, the electronic device 100 can acquire ambient sound and detect whether there are people nearby. Based on the noise level of the ambient sound and whether the electronic device 100 has detected a person, it adjusts the amplitude and / or phase of the call data A. For example, if the ambient noise level is less than a first threshold and no person is detected, the electronic device 100 can adjust the amplitude and / or phase of the call data A to obtain the call audio M.
[0260] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal N. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio M is the same as the amplitude of the call audio A corresponding to the call data A.
[0261] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal N. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio M is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio M and the call audio A are different at at least one point in time.
[0262] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal N.
[0263] The specific implementations of S206A-S207A are similar to those of S204A-S205A. For a description of S206A-S207A, please refer to the descriptions in S204A-S205A; these will not be repeated here.
[0264] The differences between S204A-S205A and S206A-S207A lie in the following: the anti-leakage model K differs from the anti-leakage model J; the call audio M differs from the call audio K; and the masking sound signal N differs from the masking sound signal L. Anti-leakage model K is the anti-leakage model corresponding to the condition where the ambient noise level is less than a first threshold and the electronic device 100 detects no one nearby. Anti-leakage model J is the anti-leakage model corresponding to the condition where the ambient noise level is less than the first threshold and the electronic device 100 detects someone nearby. In other words, the anti-leakage effect of anti-leakage model K on call data A is weaker than that of anti-leakage model J; or, the amplitude of call audio M is greater than the amplitude of call audio K; or, at the same ear distance, the leakage intensity of call audio M played by the electronic device 100 through the receiver is greater than the leakage intensity of call audio K played by the electronic device 100 through the receiver.
[0265] S208A, Electronic Device 100 Execution Figure 2D Example.
[0266] Figure 2D A schematic flowchart of a processing method is shown in which an electronic device 100 plays call audio through a receiver when the noise level of a first ambient sound is greater than a first threshold.
[0267] S201B, The noise level of the first ambient sound is greater than the first threshold.
[0268] S202B, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is greater than the second threshold.
[0269] The second threshold is greater than the first threshold. For example, the first threshold could be 45 dB and the second threshold could be 60 dB.
[0270] If the noise level of the first ambient sound is greater than a first threshold, the electronic device 100 can further confirm whether the noise level of the first ambient sound is greater than a second threshold.
[0271] In other words, this application further refines the situation where the noise level of the first ambient sound is greater than the first threshold into two scenarios. One scenario is that the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, and the other scenario is that the noise level of the first ambient sound is greater than the second threshold.
[0272] When the noise level of the first ambient sound exceeds the second threshold, the electronic device 100 is considered to be in a noisy environment. In this case, even if the electronic device 100 has sound leakage, it is difficult for an eavesdropper to obtain the private content in the call audio. The electronic device 100 must prioritize ensuring that, even in a noisy environment, the user can accurately obtain the audio content in the call audio corresponding to the call data played by the electronic device 100 through the receiver, i.e., execute S203B-S204B.
[0273] S203B, electronic device 100 amplifies the amplitude of call data A to obtain call audio H and a masking sound signal H corresponding to call audio H. The amplitude of the masking sound signal H is close to the amplitude of call audio H but opposite in phase.
[0274] S204B, electronic device 100 plays call audio H through receiver and plays masking sound signal H through masking signal transmitter.
[0275] When the noise level of the first ambient sound is greater than the second threshold, it indicates that the ambient noise of the electronic device 100 is relatively high. In order to ensure that the user can accurately obtain the audio content in the call audio played by the electronic device 100 through the receiver, the electronic device 100 can increase the amplitude of the call data A to obtain the call audio H. The amplitude of the call audio H is greater than the amplitude of the call audio A corresponding to the call data A, and the call audio H is played through the receiver.
[0276] Optionally, the amplitude of the call audio H at at least one time point is greater than the amplitude of the call audio A corresponding to the call data A.
[0277] Optionally, the electronic device 100 can increase the amplitude of call data A by increasing the amplitude of call data A by the same amount at different time points, or by increasing the amplitude of call data A by different amounts at different time points.
[0278] Optionally, the increase in the amplitude of call data A can be related to the noise level of the first ambient sound; the greater the noise level of the first ambient sound, the greater the increase in the amplitude of call data A. Once the amplitude of call data A reaches a preset value, the amplitude of call data A will no longer be increased.
[0279] Optionally, when the noise level of the first ambient sound exceeds the second threshold, adjustments can be made not only to the amplitude of call data A, but also to other information of call data A, such as the phase of call data A. Optionally, the phase adjustment strategy for call data A can be related to the temporal distribution of the first ambient sound.
[0280] Optionally, the electronic device 100 can also generate a masking sound signal H based on the call audio H. The difference between the amplitude of the masking sound signal H and the amplitude of the call audio H is within the error range, and the phase of the masking sound signal H is opposite to the phase of the call audio H. The electronic device 100 can play the masking sound signal H through a masking signal transmitter. The masking sound signal H is used to cancel out sound leakage data when the electronic device 100 plays the call audio H through the receiver.
[0281] Optionally, when the noise level of the first ambient sound is greater than the second threshold, the ambient noise of the electronic device 100 is relatively high, and the user does not care about sound leakage, the electronic device 100 may not generate or play the masking sound signal H, which can reduce the power consumption of the electronic device 100.
[0282] When the ambient noise level is greater than a first threshold but less than a second threshold, the electronic device 100 can be considered to be in a state between a quiet and a noisy environment. In this case, private information in the call data may be obtained by an eavesdropper, and the call data needs to be protected against audio leakage, i.e., S205B-S206B is executed.
[0283] S205B and electronic device 100 process call data A based on the anti-leakage model L to obtain call audio O and masking sound signal P. The amplitude of the masking sound signal P is close to the amplitude of the call audio O but opposite in phase.
[0284] S206B, electronic device 100 plays call audio O through a receiver and plays masking sound signal P through a masking signal transmitter.
[0285] When the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device 100 is in a quiet environment and a noisy environment. When the electronic device 100 plays the call audio A corresponding to the call data A through the receiver, the user of the electronic device 100 can clearly obtain the audio content in the call audio A, but an eavesdropper may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0286] Therefore, when the electronic device 100 confirms that the noise level of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device 100 can acquire the anti-leakage model L and process the call data A based on the anti-leakage model L to obtain the call audio O and the masking sound signal P.
[0287] Optionally, the sound leakage prevention model L can be a pre-trained model. The sound leakage prevention model L can also be updated periodically / irregularly.
[0288] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal P. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio M is the same as the amplitude of the call audio A corresponding to the call data A.
[0289] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal P. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio O is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio O and the call audio A are different at at least one point in time.
[0290] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal P.
[0291] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal P as an example.
[0292] Electronic device 100 processes call data A based on a sound leakage prevention model L. This can refer to electronic device 100 processing the amplitude and / or phase of call data A based on the sound leakage prevention model L to obtain call audio O. The amplitude of call audio O is different from the amplitude of call audio A corresponding to call data A, and the phase of call audio O is different from the phase of call audio A corresponding to call data A.
[0293] Optionally, the electronic device 100 processes the amplitude of the call data A based on the anti-leakage model L. It can increase or decrease the amplitude of the call data A at different time points by the same amount, or increase or decrease the amplitude of the call data at different time points by different amounts.
[0294] Optionally, the adjustment of the amplitude of call data A is related to the amplitude distribution of the first ambient sound and the amplitude distribution of call data A. The amplitude of call data A at certain time points can be increased, and the amplitude of call data A at certain time points can be decreased. For example, when the amplitude of the ambient sound is large, the amplitude reduction of call data A is small, and when the amplitude of the ambient sound is small, the amplitude reduction of call data A is large. In this way, the electronic device 100 adjusts the amplitude of call data A based on the anti-leakage model L to obtain call audio O, which reduces the loudness of call audio O played by the electronic device 100 through the receiver, and also reduces the loudness of the leaked data in the distribution of call audio O played by the electronic device 100 through the receiver, thereby improving the anti-leakage effect.
[0295] Optionally, the phase adjustment of call data A can also be related to the phase distribution of ambient sound. This makes the temporal distribution of the leaked audio data of call audio O similar to the temporal distribution of the ambient sound in which electronic device 100 is located. The ambient sound near electronic device 100 can also cancel out the leaked audio data of call audio O played by electronic device 100, reducing the occurrence of leaked audio.
[0296] The electronic device 100 is also used to generate a masking sound signal P for the call audio O, wherein the difference between the amplitude of the masking sound signal P and the amplitude of the call audio O is within the error range, and the phase of the masking sound signal P is opposite to the phase of the call audio O.
[0297] Optionally, the masking sound signal P may be generated by the electronic device 100 based on the sound leakage prevention model L, or it may not be generated based on the sound leakage prevention model L.
[0298] After acquiring the call audio O and the masking sound signal P, the electronic device 100 can play the call audio O through the receiver and play the masking sound signal P through the masking signal transmitter. The masking sound signal P can cancel out the leakage data of the call audio O played by the electronic device 100 through the receiver, reducing the occurrence of leakage.
[0299] Optionally, before processing the call data A based on the anti-leakage model L, the electronic device 100 can acquire any one or more of the following information: the amplitude of the call data A at different time points, the volume of the audio played by the receiver of the electronic device 100, and the amplitude of the first ambient sound at different time points. The electronic device 100 can then input the above information and the call data A into the anti-leakage model L, which can process the amplitude and / or phase of the call data A to obtain the call audio O.
[0300] Optionally, S202B can be omitted. When the noise level of the first ambient sound is greater than the first threshold, the electronic device 100 can execute only S203B-S204B or S205B-S206B.
[0301] In summary, the sound leakage prevention models L, J, and K are different, and the call audio values O, K, and M are also different. Model L can be the model corresponding to the condition where the ambient noise level is greater than a first threshold but less than a second threshold. Model J can be the model corresponding to the condition where the ambient noise level is less than the first threshold and the electronic device 100 detects someone nearby. Model K can be the model corresponding to the condition where the ambient noise level is less than the first threshold and the electronic device 100 detects no one nearby. In other words, the sound leakage prevention effect of model L after processing call data A is weaker than that of model K, and the sound leakage prevention effect of model K after processing call data A is weaker than that of model J. Or, the amplitude of call audio O is greater than the amplitude of call audio M, and the amplitude of call audio M is greater than the amplitude of call audio K. In other words, under the same external ear distance, the leakage sound intensity of the electronic device 100 playing the call audio O through the receiver is greater than the leakage sound intensity of the electronic device 100 playing the call audio M through the receiver, and the leakage sound intensity of the electronic device 100 playing the call audio M through the receiver is greater than the leakage sound intensity of the electronic device 100 playing the call audio K through the receiver.
[0302] exist Figure 2C and Figure 2D In this embodiment, the electronic device 100 only needs to identify the noise level of the ambient sound and detect whether there are people near the electronic device 100, and process the call data according to different anti-leakage models based on different conditions to improve the anti-leakage effect under different conditions.
[0303] pass Figure 2C and Figure 2D The method shown allows the electronic device 100 to detect ambient noise levels and the presence of people nearby while playing call audio corresponding to call data through the receiver. Depending on the ambient noise level and whether or not someone is nearby, the electronic device 100 can acquire different anti-leakage models and process the amplitude and / or phase of the call data based on these models. Without affecting the user's ability to accurately access the audio content in the call audio, this application can further improve the anti-leakage effect, prevent eavesdroppers from accessing private content in the call audio, and enhance the user's call experience.
[0304] In some embodiments, when the electronic device 100 is in a relatively enclosed environment, the sound leakage problem is more severe when the electronic device 100 plays the call audio corresponding to the call data through the receiver due to sound reflection. Furthermore, the intensity of sound reflection varies in different enclosed environments, resulting in different levels of sound leakage when the electronic device 100 plays the call audio corresponding to the call data through the receiver.
[0305] To improve sound leakage prevention, the electronic device 100 can recognize different preset scenarios and play different call audio. For example, the electronic device 100 can recognize different preset scenarios and process the call data differently to achieve the purpose of playing different call audio. For instance, the electronic device 100 processes the call data differently based on a sound leakage prevention model for a preset scenario to achieve the purpose of playing different call audio. Preset scenarios can refer to relatively enclosed environments, including but not limited to elevator scenarios, vehicle travel scenarios, etc.
[0306] In this embodiment of the application, the electronic device 100 can obtain at least one type of information, such as base station connection status, sensor data, device connection status of the electronic device 100, and location information of the electronic device 100, to determine whether the electronic device 100 is in a preset scenario.
[0307] The base station connection status can refer to whether the base station to which electronic device 100 is connected has changed. For example, if electronic device 100 switches from being connected to base station A to being connected to base station B, it can be determined that the base station to which electronic device 100 is connected has changed.
[0308] Sensor data may include, but is not limited to, acceleration data and gyroscope data. Acceleration data may be acquired by electronic device 100 through an accelerometer sensor, and gyroscope data may be acquired by electronic device 100 through a gyroscope sensor.
[0309] Device connection status refers to whether electronic device 100 has established a communication connection with other devices. Communication connections include, but are not limited to, Bluetooth connections, local area network connections, Wi-Fi connections, etc.
[0310] Optionally, the recognition of the preset scenario can be performed continuously after the electronic device 100 is powered on, and the judgment of the preset scenario can also be performed after the electronic device 100 enters the call state. This application does not limit this.
[0311] Because the environment of a preset scenario is relatively enclosed, audio leakage during calls is more likely to occur, and private content in the call audio is more easily accessed by eavesdroppers within the preset scenario. Therefore, when the electronic device 100 is in a preset scenario, it can process the call data based on the preset scenario's anti-leakage model to reduce audio leakage and protect the user's privacy.
[0312] The electronic device 100 processes call data based on a preset scenario-based anti-leakage model, which may refer to adjusting the amplitude and / or phase of the call data based on the preset scenario-based anti-leakage model. The electronic device 100 may also adjust other information of the call data, which is not limited in this application.
[0313] Optionally, the anti-leakage model can be different for different preset scenarios, that is, the intensity of amplitude and / or phase adjustment of the call data by the electronic device 100 is different. This method can improve the anti-leakage effect in different preset scenarios.
[0314] In other embodiments, if the electronic device 100 is in a non-preset scenario, the electronic device 100 can also process the call data based on the non-preset scenario anti-leakage model to improve the call quality.
[0315] The following section will introduce two scenarios: preset scenario call leakage prevention and non-preset scenario call leakage prevention.
[0316] I. Preset scenario call anti-leakage processing.
[0317] Preset scenario call leakage prevention processing refers to the process by which electronic device 100 processes call data based on the preset scenario's leakage prevention model when electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and electronic device 100 is in a preset scenario.
[0318] Preset scenario call leakage prevention processing may include, but is not limited to: elevator scenario call leakage prevention processing and vehicle scenario call leakage prevention processing.
[0319] 1. Sound leakage prevention measures for elevator-based voice communication.
[0320] Elevator scenario call leakage prevention processing refers to the process by which electronic device 100 processes the call data based on the elevator scenario leakage prevention model when electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and electronic device 100 is in an elevator scenario.
[0321] Because the environment inside an elevator is relatively enclosed and quiet, if there are eavesdroppers inside, when the electronic device 100 plays audio messages through its receiver, the eavesdroppers may hear private content in the audio messages played by the electronic device 100 through its receiver, leading to the leakage of the user's private data.
[0322] Therefore, when electronic device 100 confirms that it is playing call audio through the receiver and is in an elevator scenario, electronic device 100 needs to process the call data based on the elevator scenario's anti-leakage model to improve the anti-leakage effect in the elevator scenario and prevent bystanders in the elevator from obtaining the private content in the call audio.
[0323] (1) Identifying elevator scenes
[0324] Optionally, the electronic device 100 can determine whether it is currently in an elevator scenario based on sensor data. Sensor data may include, but is not limited to, acceleration data and / or gyroscope data. Acceleration data can be acquired by the electronic device 100 through an accelerometer sensor, and gyroscope data can be acquired by the electronic device 100 through a gyroscope sensor.
[0325] Optionally, in addition to sensor data, electronic device 100 can also combine other information, such as the location information of electronic device 100 and the device connection status of electronic device 100, to determine whether it is currently in an elevator scenario.
[0326] Optionally, the elevator scenario determination can be performed continuously after the electronic device 100 is powered on, or it can be performed after the electronic device 100 enters the call state. This application does not limit this.
[0327] Generally, a user's experience riding an elevator involves two phases: entering the elevator and ascending or descending. During these different phases, the sensor data acquired by the electronic device 100 exhibits different trends of change.
[0328] A. Entering the elevator
[0329] Figures 3A-3D The diagram illustrates a user waiting for and entering an elevator.
[0330] like Figure 3A As shown, at time t1, the user can wait for the elevator on the corresponding floor. While waiting for the elevator, the user can make calls with other electronic devices through electronic device 100. Electronic device 100 can play the call data sent by other electronic devices through the receiver. The user can hold electronic device 100 and bring it close to their ear so that the user can hear the audio content of the call data played by electronic device 100 through the receiver.
[0331] At time t1, the user is stationary, and the acceleration data and / or gyroscope data of the electronic device 100 remain essentially unchanged. For example, the acceleration data may only include gravitational acceleration in the vertical direction.
[0332] When the elevator arrives at the user's floor, the user can walk towards the elevator and be inside it, allowing the user's position to rise or fall with the elevator.
[0333] If the elevator arrives at the user's floor at time t1, the user can start walking straight into the elevator after the elevator doors open.
[0334] For example Figure 3A and Figure 3B As shown, the user can walk directly into the elevator and be located at time t2. Figure 3B The location shown.
[0335] For example Figure 3B and Figure 3C As shown, the user can continue walking directly into the elevator and will be located at time t3. Figure 3C The location shown.
[0336] For example Figure 3C and Figure 3D As shown, the user can continue walking directly into the elevator and will be located at time t4. Figure 3C The location shown.
[0337] like Figure 3D As shown, at time t4, the user is already inside the elevator, so the user can stop walking horizontally and then move up or down with the elevator after the elevator doors close.
[0338] Figure 3E This diagram illustrates the user's route as they enter the elevator.
[0339] like Figure 3E As shown, after the elevator doors open, the user can walk straight into the elevator horizontally. For example, the user can walk horizontally from their position at time t1 to their position at time t2, and then from their position at time t3 to their position at time t4. At time t4, the user is already inside the elevator and can stop walking horizontally.
[0340] from Figure 3E As shown in the diagram, the user moves horizontally throughout the entire process of entering the elevator. The user's state changes as follows: from a stationary state to a horizontally moving state, and then from a horizontally moving state back to a stationary state.
[0341] B. During the upward or downward phase of the elevator.
[0342] The principle of elevator ascending and descending is similar. The process of elevator descending is the opposite of the process of elevator ascending. This application will only use the example of elevator ascending as an illustration.
[0343] Figure 3F This diagram illustrates a user ascending in an elevator.
[0344] If the user has already walked towards the elevator at time t4, the user can stop walking horizontally. After the elevator doors close, the user's position can rise or fall with the elevator.
[0345] like Figure 3F As shown in (a), the user's position can rise with the user's elevator and be located at time t5. Figure 3F The position shown in (a) is shown in the image.
[0346] like Figure 3F (a) and Figure 3F As shown in (b), the user's position can continue to rise with the user elevator and at time t6, the user's position is... Figure 3F The position shown in (b) is shown in the diagram.
[0347] like Figure 3F (b) and Figure 3F As shown in (c), the user's position can continue to rise with the user elevator and be located at time t7. Figure 3F The position shown in (c) is shown in the diagram.
[0348] from Figure 3F As shown in the diagram, the user is moving vertically throughout the entire ascent of the elevator. The user's state transitions from a stationary state to a state of vertical movement.
[0349] Based on the above analysis, electronic device 100 can acquire sensor data, which may include, but is not limited to, acceleration data and / or gyroscope data. If, based on the sensor data, it is confirmed that electronic device 100 moves horizontally during a first time period and vertically during a second time period (the second time period being the period following the first), this indicates that the user was entering the elevator during the first time period and was either ascending or descending during the second time period. Therefore, electronic device 100 can confirm that it is in an elevator riding scenario.
[0350] For example, the first time period could be Figures 3A-3D The second time period, from time t1 to time t4, can be... Figure 3F The time intervals from t5 to t7 are shown.
[0351] In some embodiments, the electronic device 100 may also determine whether it is in the elevator entry phase or the elevator ascending / descending phase based on the acceleration change of the electronic device 100.
[0352] For example, if the acceleration of the electronic device 100 in the horizontal direction gradually increases from a minimum value and then gradually decreases back to a minimum value during the first time period, it can be confirmed that the user is in the process of entering the elevator.
[0353] The electronic device 100 can continuously / intermittently / periodically acquire the acceleration of the electronic device 100 in the horizontal direction, such as Figure 3G As shown, if the acceleration of the electronic device 100 in the horizontal direction gradually increases from a minimum value and then gradually decreases back to a minimum value, it can be determined that the user has switched from a stationary state to a horizontal motion state, and then switched from a horizontal motion state back to a stationary state, indicating that the user is in the process of entering the elevator.
[0354] Optionally, the minimum value can be a value close to 0.
[0355] It should be noted that, Figure 3G The illustration of the change in acceleration of the electronic device 100 in the horizontal direction is merely illustrative and does not constitute a limitation.
[0356] For example, if the acceleration of the electronic device 100 in the vertical direction remains almost constant during the first time period, it can be confirmed that the user is in the process of entering the elevator.
[0357] The electronic device 100 can continuously / intermittently / periodically acquire the acceleration of the electronic device 100 in the vertical direction, such as... Figure 3H As shown, there is gravitational acceleration in the vertical direction of electronic device 100. If the acceleration of electronic device 100 in the vertical direction is almost unchanged and remains stable near a fixed value, it can be determined that the user is not moving in the vertical direction, and the user is in the process of entering the elevator.
[0358] Optionally, the fixed value can be gravitational acceleration.
[0359] It should be noted that, Figure 3H The change in acceleration of the electronic device 100 in the vertical direction is shown only as an example and is not intended to be limiting.
[0360] For example, during the second time period, if the acceleration of the electronic device 100 in the horizontal direction remains almost unchanged, approaching a minimum value, such as... Figure 3I As shown, the acceleration of the electronic device 100 in the vertical direction gradually increases from a minimum value, such as... Figure 3J As shown, this confirms that the user is in the descent phase of the elevator.
[0361] For example, during the second time period, if the acceleration of electronic device 100 in the horizontal direction remains almost unchanged, approaching a minimum value, such as... Figure 3I As shown, the acceleration of the electronic device 100 in the vertical direction gradually decreases from a minimum value, such as... Figure 3K As shown, this confirms that the user is in the upward phase of the elevator.
[0362] Optionally, the minimum value can be a value close to 0, and the fixed value can be the acceleration due to gravity.
[0363] In some embodiments, the electronic device 100 can also determine the displacement change of the electronic device 100 based on sensor data to confirm whether the user is in the process of entering the elevator.
[0364] For example, during the first time period, electronic device 100 can acquire sensor data, which may include, but is not limited to, acceleration data and / or gyroscope data. If, based on the sensor data, it is determined that the displacement of electronic device 100 in the horizontal direction gradually increases from a minimum value while the displacement in the vertical direction remains almost unchanged, it can be confirmed that the user is in the process of entering the elevator.
[0365] For example, in the second time period, if sensor data confirms that the horizontal displacement of electronic device 100 remains almost unchanged, close to a minimum, while the vertical displacement gradually increases from a minimum, then it can be confirmed that the user is in the elevator's downward phase. Conversely, if sensor data confirms that the horizontal displacement of electronic device 100 remains almost unchanged, close to a minimum, while the vertical displacement gradually decreases from a minimum, then it can be confirmed that the user is in the elevator's upward phase.
[0366] Optionally, the minimum value can be a value close to 0.
[0367] In some embodiments, the electronic device 100 can also combine its location information and / or device connection status to confirm whether a user is entering an elevator. For example, if the electronic device 100 confirms that its location information is near buildings such as office buildings, residential buildings in a community, hospitals, or shopping malls, and that the electronic device 100 is connected to Wi-Fi, it can be confirmed that the electronic device 100 is indoors, ruling out outdoor activity scenarios. This can improve the accuracy of confirming whether the electronic device 100 is in an elevator scenario and avoid misidentification.
[0368] This application does not limit the determination of whether the electronic device 100 is in an elevator scene based on sensor data, location information of the electronic device 100, device connection status of the electronic device 100, etc. The electronic device 100 can also determine whether the user is in an elevator scene based on other more information, and this application does not limit this.
[0369] (2) Processing call data using a sound leakage prevention model based on elevator scenarios.
[0370] Figure 4A This paper presents a schematic diagram of another method for electronic device 100 to process call data based on an elevator scenario anti-leakage model when the noise level of the first ambient sound is less than a first threshold.
[0371] S401A, electronic device 100 acquires first information and confirms the elevator scenario based on the first information. The first information includes, but is not limited to, any one or more of the following: sensor data, location information of electronic device 100, and device connection status of electronic device 100.
[0372] Sensor data includes, but is not limited to, acceleration data and / or gyroscope data.
[0373] In some embodiments, S401 A can be executed continuously / periodically / irregularly after the electronic device 100 is powered on. On one hand, if the electronic device 100 has already confirmed that it is in an elevator scenario based on the first information before playing the call audio corresponding to the call data through the receiver, i.e., the electronic device 100 is inside the elevator, then after the electronic device 100 is inside the elevator, if it then plays the call audio corresponding to the call data through the receiver, the electronic device 100 can process the call data in a timely manner based on the elevator scenario's anti-leakage model, without needing to determine whether it is in an elevator scenario in real time after playing the call audio corresponding to the call data through the receiver, which can speed up the electronic device 100's processing speed of the call data. On the other hand, based on the above analysis, the electronic device 100 being in an elevator scenario includes two stages: entering the elevator stage and riding the elevator upward or downward stage. If the electronic device 100 continuously / periodically / irregularly acquires the first information after being powered on, the electronic device 100 can combine the first information acquired in the two stages of entering the elevator, riding the elevator ascending or descending to determine whether the electronic device 100 is in an elevator scene, which can improve the accuracy of the electronic device 100 in confirming that the electronic device 100 is in an elevator scene.
[0374] In other embodiments, S401A may also be executed after the electronic device 100 plays the call audio corresponding to the call data through the receiver. The first information may be data from a period of time before and after the moment when the electronic device 100 plays the call audio corresponding to the call data through the receiver.
[0375] In one possible implementation, before the electronic device 100 enters the elevator scenario, i.e., before the electronic device 100 is inside the elevator, the electronic device 100 has already played the call audio corresponding to the call data through the receiver. In this case, if the user enters the elevator and rides the elevator up or down, the electronic device 100 can obtain first information from both the entering elevator stage and the ascending or descending elevator stage, and combine the first information obtained from both stages to determine that the electronic device 100 is in an elevator scenario.
[0376] In other possible implementations, the electronic device 100 plays the audio call through the receiver only after it has entered the elevator scenario, i.e., after it is inside the elevator. In this case, after the electronic device 100 has entered the elevator scenario and then plays the audio call through the receiver, it may only obtain the first piece of information from the elevator's ascending or descending phase. Compared to combining the first pieces of information from both the entering and ascending / descending phases to determine whether the electronic device 100 is in an elevator scenario, the accuracy needs to be improved.
[0377] This application does not limit the timing of the execution of S401 A.
[0378] S402A, electronic device 100 collects first ambient sound through a microphone.
[0379] For a description of S402A, please refer to S201A; this application will not repeat it here.
[0380] S402A can be executed before S401A or simultaneously with S401A; this application does not limit this.
[0381] S403A, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is less than the first threshold.
[0382] For a description of S403A, please refer to S202A; this application will not repeat it here.
[0383] If the ambient noise level is less than a first threshold, execute S404A-S408A.
[0384] If the noise level of the first ambient sound exceeds the first threshold, execute S409A.
[0385] When the noise level of the first ambient sound is less than the first threshold:
[0386] S404A, Electronic device 100 detects whether there is anyone near electronic device 100.
[0387] For an introduction to S404A, please refer to the description in S203A; this application will not repeat it here.
[0388] If someone is detected near electronic device 100, execute S405A-S406A.
[0389] If no one is detected near electronic device 100, execute S407A-S408A.
[0390] When someone is detected near electronic device 100:
[0391] S405A and electronic device 100 process call data A based on anti-leakage model A to obtain call audio B and masking sound signal B. The amplitude of masking sound signal B is close to the amplitude of call audio B but opposite in phase.
[0392] S406A, electronic device 100 plays call audio B through a receiver and plays masking sound signal B through a masking signal transmitter.
[0393] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal B. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio B is the same as the amplitude of the call audio A corresponding to the call data A.
[0394] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal B. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio B is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio B and the call audio A are different at at least one point in time.
[0395] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal B.
[0396] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal B as an example.
[0397] If it is confirmed that the electronic device 100 is in an elevator scenario, the noise level of the first ambient sound is less than a first threshold, and the electronic device 100 detects someone nearby, the electronic device 100 can acquire a sound leakage prevention model A, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model A to obtain the call audio B and the masking sound signal B. The amplitude of the call audio B is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio B is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal B and the amplitude of the call audio B is within the error range, and the phase of the masking sound signal B is opposite to the phase of the call audio B.
[0398] The specific implementation of the anti-leakage model A in processing call data A to obtain call data A and masked sound signal A is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masked sound signal P. For details, please refer to the description in S205B-S206B, which will not be repeated here.
[0399] When no one is detected near electronic device 100:
[0400] S407A and electronic device 100 process call data A based on anti-leakage model B to obtain call audio C and masking sound signal C. The amplitude of masking sound signal C is close to the amplitude of call audio C but opposite in phase.
[0401] S408A, electronic device 100 plays call audio C through a receiver and plays masked sound signal C through a masked signal transmitter.
[0402] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal C. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio C is the same as the amplitude of the call audio A corresponding to the call data A.
[0403] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal C. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio C is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio C and the call audio A are different at at least one point in time.
[0404] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal C.
[0405] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal C as an example.
[0406] If it is confirmed that the electronic device 100 is in an elevator scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby, the electronic device 100 can acquire the anti-leakage model B, and process the amplitude and / or phase of the call data A based on the anti-leakage model B to obtain the call audio C and the masking sound signal C. The amplitude of the call audio C is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio C is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal C and the amplitude of the call audio C is within the error range, and the phase of the masking sound signal C is opposite to the phase of the call audio C.
[0407] The specific implementation of the anti-leakage model B in processing the call audio B to obtain the call audio C and the masking sound signal C is similar to the specific implementation of the anti-leakage model L in processing the call data A to obtain the call audio O and the masking sound signal P. For details, please refer to the descriptions in S205B-S206B, which will not be repeated here.
[0408] It should be noted that anti-leakage model B is different from anti-leakage model A. Anti-leakage model B can be the anti-leakage model corresponding to the following conditions: the electronic device 100 is in a vehicle-riding scenario, the ambient noise level near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that no one is nearby. Anti-leakage model A can be the anti-leakage model corresponding to the following conditions: the electronic device 100 is in a vehicle-riding scenario, the ambient noise level near the electronic device 100 is less than the first threshold, and the electronic device 100 detects that someone is nearby. In other words, the anti-leakage effect of anti-leakage model B after processing call data A is weaker than that of anti-leakage model A after processing call data A; or, the amplitude of call audio C is greater than the amplitude of call audio B; or, at the same ear distance, the leakage intensity of call audio C played by the electronic device 100 through the receiver is greater than the leakage intensity of call audio B played by the electronic device 100 through the receiver.
[0409] S409A, Electronic Device 100 Execution Figure 4B Example.
[0410] Figure 4B This diagram illustrates another processing method in which electronic device 100 plays call audio through a receiver when the noise level of the first ambient sound is greater than a first threshold.
[0411] When the noise level of the first ambient sound exceeds the first threshold:
[0412] S401B, The noise level of the first ambient sound is greater than the first threshold.
[0413] S402B, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is greater than the second threshold.
[0414] For a description of S402B, please refer to S202B; this application will not repeat it here.
[0415] S403B, electronic device 100 amplifies the amplitude of call data A to obtain call audio H and a masking sound signal H corresponding to call audio H. The amplitude of the masking sound signal H is close to the amplitude of call audio H but opposite in phase.
[0416] Optionally, the amplitudes of call audio H and call audio A are different at at least one point in time.
[0417] S404B, electronic device 100 plays call audio H through a receiver and plays masking sound signal H through a masking signal transmitter.
[0418] For a description of S403B-S404B, please refer to S203B-S204B; this application will not repeat it here.
[0419] Optionally, the increase in the amplitude of call data A can be related not only to the noise level of the initial ambient sound but also to a preset scenario, such as an elevator scenario or a car-riding scenario. Given the same noise level for both call data and ambient sound, the degree of increase in the amplitude of call data A can differ between elevator and car-riding scenarios.
[0420] S405B and electronic device 100 process call data A based on the anti-leakage model E to obtain call audio F and masking sound signal F. The amplitude of the masking sound signal F is close to the amplitude of the call audio F but opposite in phase.
[0421] S406B, electronic device 100 plays call audio F through a receiver and plays masking sound signal F through a masking signal transmitter.
[0422] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal F. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio F is the same as the amplitude of the call audio A corresponding to the call data A.
[0423] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal F. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio F is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio F and the call audio A are different at at least one point in time.
[0424] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal F.
[0425] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal F as an example.
[0426] When electronic device 100 is in an elevator scenario and the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, electronic device 100 is in a quiet environment and a noisy environment. When electronic device 100 confirms that it is playing the call audio A corresponding to call data A through the receiver, the user of electronic device 100 can obtain the audio content in call audio A relatively clearly. However, bystanders may also obtain the private content in call audio A played by electronic device 100 through the receiver.
[0427] Therefore, when the electronic device 100 is in an elevator scenario and the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device 100 can acquire the anti-leakage model E and process the call data A based on the anti-leakage model E to obtain the call audio F and the masking sound signal F.
[0428] The specific implementation of the anti-leakage model E in processing call data A to obtain call audio F and masking sound signal F is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the descriptions in S205B-S206B, which will not be repeated here.
[0429] Optionally, the electronic device 100 may not execute the judgment step of S402B. After S401B, the electronic device 100 may only execute S403B-S404B or only execute S405B-S406B. This application does not limit this.
[0430] In summary, the sound leakage prevention models E, B, and A are different, and the call audio values F, C, and B are also different. Sound leakage prevention model E is the model corresponding to the scenario where the electronic device 100 is in an elevator, and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. Sound leakage prevention model B is the model corresponding to the scenario where the electronic device 100 is in an elevator, the noise level of the first ambient sound is less than the first threshold, and the electronic device 100 detects that no one is nearby. Sound leakage prevention model A is the model corresponding to the scenario where the electronic device 100 is in an elevator, the noise level of the first ambient sound is less than the first threshold, and the electronic device 100 detects that someone is nearby. In other words, the sound leakage prevention effect of model E after processing call data A is weaker than that of model B, and the sound leakage prevention effect of model B after processing call data A is weaker than that of model A. In other words, the amplitude of call audio F is greater than the amplitude of call audio C, and the amplitude of call audio C is greater than the amplitude of call audio B. Alternatively, at the same external ear distance, the leakage sound intensity of call audio F played by electronic device 100 through the receiver is greater than the leakage sound intensity of call audio C played by electronic device 100 through the receiver, and the leakage sound intensity of call audio C played by electronic device 100 through the receiver is greater than the leakage sound intensity of call audio B played by electronic device 100 through the receiver.
[0431] 2. Sound leakage prevention during calls while traveling.
[0432] The anti-leakage processing for calls in a car-riding scenario refers to the process by which electronic device 100 processes the call data based on the anti-leakage model of the car-riding scenario when electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and electronic device 100 is in a car-riding scenario.
[0433] Because the environment inside a vehicle is relatively enclosed, if there is an eavesdropper inside the vehicle, when the electronic device 100 plays the call audio corresponding to the call data through the receiver, the eavesdropper inside the vehicle may hear the private content in the call audio played by the electronic device 100 through the receiver, resulting in the leakage of the user's privacy data.
[0434] Therefore, when electronic device 100 confirms that the call audio corresponding to the call data is being played through the receiver and is in a vehicle scenario, electronic device 100 needs to process the call data based on the anti-leakage model of the vehicle scenario to prevent bystanders in the vehicle from hearing the content of the call audio played by electronic device 100 through the receiver.
[0435] Optionally, both the environments inside a vehicle and an elevator are relatively enclosed, and both exhibit near-field sound reflection. However, the intensity of sound reflection differs between vehicles and elevators, as does the intensity of sound leakage. Therefore, for vehicle and elevator scenarios, the electronic device 100 can use different sound leakage prevention models to process call data, thereby improving the sound leakage prevention effect in different scenarios.
[0436] Optionally, and not limited to elevator and anti-leakage scenarios, other preset scenarios may also be included, which this application does not limit. For different preset scenarios, the electronic device 100 can use different anti-leakage models to process call data.
[0437] (1) Identify the riding scenario
[0438] Optionally, the electronic device 100 can determine whether it is currently in a vehicle-riding scenario based on information such as base station connection status, sensor data, device connection status, and location information.
[0439] The base station connection status can refer to whether the base station to which electronic device 100 is connected has changed. For example, if electronic device 100 switches from being connected to the first base station to being connected to the second base station, it can be determined that the base station to which electronic device 100 is connected has changed.
[0440] Sensor data may include, but is not limited to, acceleration data and / or gyroscope data. Acceleration data may be acquired by electronic device 100 through an acceleration sensor, and gyroscope data may be acquired by electronic device 100 through a gyroscope sensor.
[0441] Optionally, in addition to base station connection status, sensor data, device connection status, and location information, electronic device 100 can also combine other information to determine whether it is currently in a vehicle-riding scenario.
[0442] Optionally, the determination of the travel scenario can be performed continuously after the electronic device 100 is turned on, or it can be performed after the electronic device 100 enters the call state. This application does not limit this.
[0443] Travel scenarios can include, but are not limited to, taking a car, a bus, a high-speed train, or a regular train.
[0444] Electronic device 100 may confirm whether a user is in a vehicle-riding scenario based on, but not limited to, any one or more of the following methods.
[0445] Method 1: If the base station connected to electronic device 100 changes, it can be confirmed that electronic device 100 is in a vehicle-riding scenario.
[0446] In some embodiments, if the user is inside a vehicle, the location of the electronic device 100 can change as the vehicle's location changes. The location of the electronic device 100 will also change after the vehicle's location changes. Generally, the base station connected to the electronic device 100 intelligently covers a certain area. When the electronic device 100 exceeds the base station's coverage area, it will disconnect from that base station and connect to another base station.
[0447] Figure 5 A schematic diagram is shown showing how the connected base station changes after the location of an electronic device 100 changes.
[0448] like Figure 5 As shown, when the vehicle travels to location A, electronic device 100 is also located near location A, and electronic device 100 can connect to base station A.
[0449] The vehicle can continue driving towards its destination. When the vehicle reaches location B, electronic device 100 is also located near location B. If the coverage area of base station A does not include location B, electronic device 100 will disconnect from base station A. If the coverage area of base station B includes location B, electronic device 100 can connect to base station B.
[0450] The vehicle can continue driving towards its destination. When the vehicle reaches location C, electronic device 100 is also located near location C. If the coverage area of base station B does not include location C, electronic device 100 will disconnect from base station B. If the coverage area of base station C includes location C, then electronic device 100 can connect to base station C.
[0451] Similarly, during vehicle operation, electronic device 100 can switch its connection to different base stations as the vehicle's location changes. If a change in the base station connected to electronic device 100 is detected, it can be confirmed that electronic device 100 is in a passenger scenario.
[0452] Optionally, if the electronic device 100 continuously switches and connects to m different base stations, it can be confirmed that the electronic device 100 is in a vehicle-riding scenario, where m is a positive integer greater than or equal to 1.
[0453] Method 2: Electronic device 100 acquires sensor data. If it is confirmed based on the sensor data that electronic device 100 is moving in the horizontal direction, it can be confirmed that electronic device 100 is in a vehicle-riding scenario.
[0454] The electronic device 100 can acquire sensor data, which may include, but is not limited to, acceleration data and / or gyroscope data. If, based on the sensor data, it is determined that the electronic device 100 is continuously moving in the horizontal direction, it can be determined that the electronic device 100 is in a vehicle-riding scenario.
[0455] Method 3: When the acceleration of electronic device 100 in the horizontal direction gradually increases from a minimum value, it can be confirmed that electronic device 100 is in a vehicle-riding scenario.
[0456] Optionally, when the vehicle starts and begins to move towards its destination, the vehicle can switch from a stationary state to a horizontally moving state. Correspondingly, the horizontal acceleration of the electronic device 100 can gradually increase from a minimum value. When it is detected that the horizontal acceleration of the electronic device 100 gradually increases from a minimum value, it can be confirmed that the electronic device 100 is in a passenger scenario.
[0457] For example, a minimum value can be a value close to 0.
[0458] Optionally, when the vehicle starts and begins to move towards its destination, the vehicle can switch from a stationary state to a horizontal motion state, while the vertical motion of the vehicle remains almost unchanged. Correspondingly, the acceleration of the electronic device 100 in the vertical direction remains almost unchanged, approaching a fixed value. When the near-unchanged vertical acceleration of the electronic device 100 is detected, it can be confirmed that the electronic device 100 is in a passenger scenario.
[0459] For example, the fixed value could be gravitational acceleration.
[0460] Method 4: If the horizontal displacement of electronic device 100 gradually increases, it can be confirmed that electronic device 100 is in a vehicle-riding scenario.
[0461] Optionally, when the vehicle starts and begins to travel towards its destination, the electronic device 100 can acquire sensor data. If the sensor data confirms that the horizontal displacement of the electronic device 100 is gradually increasing, it can be determined that the electronic device 100 is in a passenger scenario.
[0462] Method 5: Once the electronic device 100 is detected to have established a connection with the vehicle, it can be confirmed that the electronic device 100 is in a vehicle-riding scenario.
[0463] Method Six: As the vehicle travels towards its destination, its position changes in real time, and the position of the electronic device 100 also changes accordingly. If the location information of the electronic device 100 is detected to be continuously changing, it can be confirmed that the electronic device 100 is in a passenger scenario.
[0464] This application does not limit itself to confirming whether the electronic device 100 is in a riding scenario based on sensor data, the location information of the electronic device 100, the device connection status of the electronic device 100, etc. It can also confirm whether the user is in a riding scenario based on other more information.
[0465] (2) Processing call data using a voice leakage prevention model based on the riding scenario.
[0466] Figure 6A This diagram illustrates another processing method in which electronic device 100 plays call audio through a receiver when the noise level of the first ambient sound is less than a first threshold.
[0467] S601A, the electronic device 100 obtains first information and confirms that it is in a vehicle riding scenario based on the first information. The first information includes, but is not limited to, any one or more of the following: sensor data, location information of the electronic device 100, and device connection status of the electronic device 100.
[0468] S602A, electronic device 100 collects ambient sound through a microphone.
[0469] For the descriptions of S601A-S602A, please refer to the descriptions in S401A-S402A; these will not be repeated here.
[0470] S603A, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is less than the first threshold.
[0471] If the noise level of the first ambient sound exceeds a first threshold, execute S609A.
[0472] If the ambient noise level is less than a first threshold, execute S604A-S608A.
[0473] The specific implementation of S603A is similar to that of S202A, and can be found in the description in S202A. This application will not repeat the details here.
[0474] When the noise level of the first ambient sound is less than the first threshold:
[0475] S604A, Electronic device 100 detects whether there are people near electronic device 100.
[0476] For an introduction to S604A, please refer to the description in S203A; this application will not repeat it here.
[0477] If someone is detected near electronic device 100, execute S605A-S606A.
[0478] If no one is detected near electronic device 100, execute S607A-S608A.
[0479] When someone is detected near electronic device 100:
[0480] S605A and electronic device 100 process call data A based on the anti-leakage model C to obtain call audio D and masking sound signal D. The amplitude of the masking sound signal D is close to the amplitude of the call audio D but opposite in phase.
[0481] S606A, electronic device 100 plays call audio D through a receiver and plays masking sound signal D through a masking signal transmitter.
[0482] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal D. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio D is the same as the amplitude of the call audio A corresponding to the call data A.
[0483] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal D. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio D is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio D and the call audio A are different at at least one point in time.
[0484] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal D.
[0485] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal D as an example.
[0486] If it is confirmed that the electronic device 100 is in a vehicle-riding scenario, the noise level of the first ambient sound is less than a first threshold, and the electronic device 100 detects someone nearby, the electronic device 100 can acquire a sound leakage prevention model C, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model C to obtain the call audio D and the masking sound signal D. The amplitude of the call audio D is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio D is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal D and the amplitude of the call audio D is within the error range, and the phase of the masking sound signal D is opposite to the phase of the call audio D.
[0487] The specific implementation of the anti-leakage model C in processing call data A to obtain call audio D and masking sound signal D is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the description in S205B-S206B, which will not be repeated here.
[0488] The sound leakage prevention model C differs from the sound leakage prevention model A. The call audio D differs from the call audio B, and the masking sound signal D differs from the masking sound signal B. Sound leakage prevention model C is the model corresponding to the scenario where the electronic device 100 is in a vehicle-riding scenario, the ambient sound level is below the first threshold, and someone is detected near the electronic device 100. Sound leakage prevention model A is the model corresponding to the scenario where the electronic device 100 is in an elevator scenario, the ambient sound level is below the first threshold, and someone is detected near the electronic device 100. In other words, the sound leakage prevention effect of sound leakage prevention model C after processing call data A differs from that of sound leakage prevention model A. Alternatively, the amplitude of call audio D differs from the amplitude of call audio B. Or, at the same ear distance, the sound leakage intensity of call audio B played by the electronic device 100 through the receiver differs from that played by the electronic device 100 through the receiver.
[0489] When no one is detected near electronic device 100:
[0490] S607A, electronic device 100 processes call data A based on anti-leakage model D to obtain call audio E and masking sound signal E. The amplitude of masking sound signal E is close to the amplitude of call audio E but opposite in phase.
[0491] S608A, electronic device 100 plays call audio E through receiver and plays masking sound signal E through masking signal transmitter.
[0492] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal E. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio E is the same as the amplitude of the call audio A corresponding to the call data A.
[0493] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal E. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio E is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio E and the call audio A are different at at least one point in time.
[0494] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal E.
[0495] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal E as an example.
[0496] If it is confirmed that the electronic device 100 is in a vehicle-riding scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby, the electronic device 100 can acquire a sound leakage prevention model D, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model D to obtain the call audio E and the masking sound signal E. The amplitude of the call audio E is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio E is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal E and the amplitude of the call audio E is within the error range, and the phase of the masking sound signal E is opposite to the phase of the call audio E.
[0497] The anti-leakage model D processes call data A to obtain call audio E and masking sound signal E, which is similar to the anti-leakage model L processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the description in S205B-S206B, which will not be repeated here.
[0498] Anti-leakage model D differs from anti-leakage model B. Anti-leakage model D is designed for situations where the electronic device 100 is in a vehicle-riding scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby. Anti-leakage model B is designed for situations where the electronic device 100 is in an elevator scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby. In other words, the anti-leakage effect of anti-leakage model D on call data A differs from that of anti-leakage model B. Alternatively, the amplitude of call audio E differs from the amplitude of call audio C. Or, at the same ear distance, the leakage intensity of call audio E played by the electronic device 100 through the receiver differs from the leakage intensity of call audio C played by the electronic device 100 through the receiver.
[0499] S609A, Electronic Device 100 Execution Figure 6B Example.
[0500] Figure 6B This diagram illustrates another processing method in which electronic device 100 plays call audio through a receiver when the noise level of the first ambient sound is greater than a first threshold.
[0501] When the noise level of the first ambient sound exceeds the first threshold:
[0502] S601B, The noise level of the first ambient sound is greater than the first threshold.
[0503] S602B, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is greater than the second threshold.
[0504] When the noise level of the first ambient sound exceeds the second threshold, execute S603B-S604B.
[0505] When the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, execute S605B-S606B.
[0506] The specific implementation of S602B is similar to that of S202B, and can be found in the description in S202B. This application will not repeat the details here.
[0507] S603B, electronic device 100 amplifies the amplitude of call data A to obtain call audio H and a masking sound signal H corresponding to call audio H. The amplitude of the masking sound signal H is close to the amplitude of call audio H but opposite in phase.
[0508] Optionally, the amplitudes of call audio H and call audio A are different at at least one point in time.
[0509] S604B, electronic device 100 plays call audio H through a receiver and plays masking sound signal H through a masking signal transmitter.
[0510] For a description of S603B-S604B, please refer to S203B-S204B; this application will not repeat it here.
[0511] Optionally, the increase in the amplitude of call data A can be related not only to the noise level of the initial ambient sound but also to a preset scenario, such as an elevator scenario or a car-riding scenario. Given the same noise level for both call data and ambient sound, the degree of increase in the amplitude of call data A can differ between elevator and car-riding scenarios.
[0512] S605B and electronic device 100 process call data A based on the anti-leakage model F to obtain call audio G and masking sound signal G. The amplitude of the masking sound signal G is close to the amplitude of the call audio G but opposite in phase.
[0513] S606B, electronic device 100 plays call audio G through a receiver and plays masking sound signal G through a masking signal transmitter.
[0514] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal G. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio G is the same as the amplitude of the call audio A corresponding to the call data A.
[0515] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal G. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio G is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio G and the call audio A are different at at least one point in time.
[0516] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal G.
[0517] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal G as an example.
[0518] When the electronic device 100 is in a vehicle-riding scenario and the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device 100 is in a quiet environment and a noisy environment. When the electronic device 100 plays the call audio A corresponding to the call data A through the receiver, the user of the electronic device 100 can clearly obtain the audio content in the call audio A. However, bystanders may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0519] Therefore, when the electronic device 100 is in a vehicle-riding scenario and the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device 100 can acquire the anti-leakage model F and process the call data A based on the anti-leakage model F to obtain the call audio G and the masking sound signal G.
[0520] The specific implementation of the anti-leakage model F in processing call data A to obtain call audio G and masking sound signal G is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the descriptions in S205B-S206B, which will not be repeated here.
[0521] It should be noted that close-range sound reflections exist in both vehicles and elevators, but the intensity of sound reflection differs between the two scenarios. Therefore, the level of sound leakage in call data varies depending on the vehicle and elevator environment. The electronic device 100 can process the played call audio differently. For example, the electronic device 100 can process the call data based on different anti-leakage models to improve the anti-leakage effect in both vehicle and elevator scenarios. Therefore, anti-leakage models F and E can be different, as can call audio G and call audio F, and masking signal G and masking signal F. Anti-leakage model F is the model corresponding to the scenario where the electronic device 100 is in a vehicle environment and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. Anti-leakage model E is the model corresponding to the scenario where the electronic device 100 is in an elevator environment and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. In other words, the anti-leakage effect of the anti-leakage model F after processing the call data A is different from that of the anti-leakage model E after processing the call data A. Or, the amplitude of the call audio G is different from the amplitude of the call audio F. Or, under the same external ear distance, the leakage intensity of the call audio G played by the electronic device 100 through the receiver is different from the leakage intensity of the call audio F played by the electronic device 100 through the receiver.
[0522] In summary, the sound leakage prevention models F, D, and C are different, as are the call audio values G, E, and D. Model F can be considered when the electronic device 100 is in a vehicle-riding scenario, and the ambient noise level is greater than a first threshold but less than a second threshold. Model D can be considered when the electronic device 100 is in a vehicle-riding scenario, the ambient noise level is less than the first threshold, and the electronic device 100 detects no one nearby. Model C can be considered when the electronic device 100 is in a vehicle-riding scenario, the ambient noise level is less than the first threshold, and the electronic device 100 detects someone nearby. In other words, the sound leakage prevention effect of model F after processing call data A is weaker than that of model D, and the sound leakage prevention effect of model D after processing call data A is weaker than that of model C. In other words, the amplitude of call audio G is greater than the amplitude of call audio E, and the amplitude of call audio E is greater than the amplitude of call audio D. Alternatively, at the same external ear distance, the leakage sound intensity of call audio G played by electronic device 100 through the receiver is greater than the leakage sound intensity of call audio E played by electronic device 100 through the receiver, and the leakage sound intensity of call audio E played by electronic device 100 through the receiver is greater than the leakage sound intensity of call audio D played by electronic device 100 through the receiver.
[0523] Optionally, the electronic device 100 may not distinguish between elevator and vehicle scenarios. For both elevator and vehicle scenarios, the electronic device 100 can use the same anti-leakage model to process the call data. For example, anti-leakage model E and anti-leakage model F can be the same, anti-leakage model A and anti-leakage model C can be the same, and anti-leakage model B and anti-leakage model D can be the same.
[0524] II. Non-preset scenario call anti-leakage processing.
[0525] Non-preset scenario call leakage prevention processing refers to the process by which electronic device 100 processes call data based on a non-preset scenario leakage prevention model when electronic device 100 confirms that the call audio corresponding to the call data is played through the receiver and electronic device 100 is in a non-preset scenario, thereby reducing the occurrence of leakage.
[0526] If the electronic device 100 fails to recognize a preset scenario based on the first information, such as failing to recognize an elevator scenario or a car ride scenario, it can confirm that the user is in a non-preset scenario.
[0527] Figure 7A The diagram illustrates another method for electronic device 100 to process call data based on a non-preset scenario anti-leakage model when the noise level of the first ambient sound is less than a first threshold.
[0528] S701A, the electronic device 100 obtains first information and confirms that the preset scene has not been identified based on the first information. The first information includes, but is not limited to, any one or more of the following: sensor data, location information of the electronic device 100, and device connection status of the electronic device 100.
[0529] S702A, electronic device 100 collects ambient sound through a microphone.
[0530] If the electronic device 100 fails to recognize the aforementioned preset scenario based on the first information, it can be considered that the electronic device 100 has not recognized the preset scenario.
[0531] For the descriptions of S701A-S702A, please refer to the descriptions in S401A-S402A; these will not be repeated here.
[0532] S703A, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is less than the first threshold.
[0533] If the ambient noise level is greater than a first threshold, execute S709A.
[0534] If the ambient noise level is less than a first threshold, execute S704A-S708A.
[0535] The specific implementation of S703A is similar to that of S202A, and can be found in the description in S202A. This application will not repeat the details here.
[0536] When the noise level of the first ambient sound is less than the first threshold:
[0537] S704A, Electronic device 100 detects whether there is anyone near electronic device 100.
[0538] For an introduction to S704A, please refer to the description in S203A; this application will not repeat it here.
[0539] If someone is detected near electronic device 100, execute S705A-S706A.
[0540] If no one is detected near electronic device 100, execute S707A-S708A.
[0541] When someone is detected near electronic device 100:
[0542] S705A and electronic device 100 process call data A based on the anti-leakage model H to obtain call audio I and masking sound signal I. The amplitude of masking sound signal I is close to the amplitude of call audio I but opposite in phase.
[0543] S706A, electronic device 100 plays call audio I through receiver and plays masking sound signal I through masking signal transmitter.
[0544] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal I. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio I is the same as the amplitude of the call audio A corresponding to the call data A.
[0545] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal I. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio I is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio I and the call audio A are different at at least one point in time.
[0546] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal I.
[0547] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal I as an example.
[0548] If it is confirmed that the electronic device 100 is in a non-preset scenario, the noise level of the first ambient sound is less than a first threshold, and the electronic device 100 detects someone nearby, the electronic device 100 can acquire a sound leakage prevention model H, and process the amplitude and / or phase of the call data A based on the sound leakage prevention model H to obtain the call audio I and the masking sound signal I. The amplitude of the call audio I is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio I is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal I and the amplitude of the call audio I is within the error range, and the phase of the masking sound signal I is opposite to the phase of the call audio I.
[0549] The specific implementation of the anti-leakage model H in processing call data A to obtain call audio I and masking sound signal I is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the description in S205B-S206B, which will not be repeated here.
[0550] The sound leakage prevention model H differs from sound leakage prevention models A and C. The call audio I differs from call audio B and call audio D. The masking signal I also differs from masking signal B and masking call audio D. Sound leakage prevention model H is the model corresponding to the following conditions: the electronic device 100 is in a non-preset scenario, the ambient sound level is below the first threshold, and someone is detected near the electronic device 100. Sound leakage prevention model A is the model corresponding to the following conditions: the electronic device 100 is in an elevator scenario, the ambient sound level is below the first threshold, and someone is detected near the electronic device 100. Sound leakage prevention model C is the model corresponding to the following conditions: the electronic device 100 is in a vehicle scenario, the ambient sound level is below the first threshold, and someone is detected near the electronic device 100. In other words, the sound leakage prevention effect of the sound leakage prevention model H after processing call data A is less than that of the sound leakage prevention model A after processing call data A, and also less than that of the sound leakage prevention model C after processing call data A. Or, the amplitude of call audio I is less than that of call audio B, and also less than that of call audio D. Or, under the same external ear distance, the sound leakage intensity of call audio I played by electronic device 100 through the receiver is greater than that of call audio B played by electronic device 100 through the receiver, and also greater than that of call audio D played by electronic device 100 through the receiver.
[0551] When no one is detected near electronic device 100:
[0552] S707A and electronic device 100 process call data A based on anti-leakage model I to obtain call audio J and masking sound signal J. The amplitude of masking sound signal J is close to the amplitude of call audio J but opposite in phase.
[0553] S708A, electronic device 100 plays call audio J through receiver and plays masking sound signal J through masking signal transmitter.
[0554] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal J. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio J is the same as the amplitude of the call audio A corresponding to the call data A.
[0555] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal J. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio J is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio J and the call audio A are different at at least one point in time.
[0556] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal J.
[0557] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal J as an example.
[0558] If it is confirmed that the electronic device 100 is in a non-preset scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby, the electronic device 100 can acquire the anti-leakage model I and process the amplitude and / or phase of the call data A based on the anti-leakage model I to obtain the call audio J and the masking sound signal J. The amplitude of the call audio J is different from the amplitude of the call audio A corresponding to the call data A, and the phase of the call audio J is different from the phase of the call audio A corresponding to the call data A. The difference between the amplitude of the masking sound signal J and the amplitude of the call audio J is within the error range, and the phase of the masking sound signal J is opposite to the phase of the call audio J.
[0559] The anti-leakage model I processes call data A to obtain call audio J and masking sound signal J, and the anti-leakage model L processes call data A to obtain call audio O and masking sound signal P. The specific implementation is similar to that of the anti-leakage model L, which processes call data A to obtain call audio O and masking sound signal P. For details, please refer to the description in S205B-S206B, which will not be repeated here.
[0560] The sound leakage prevention model I differs from sound leakage prevention models B and D. Sound leakage prevention model I is for situations where the electronic device 100 is in a non-preset scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby. Sound leakage prevention model B is for situations where the electronic device 100 is in an elevator scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby. Sound leakage prevention model D is for situations where the electronic device 100 is in a vehicle scenario, the ambient noise level near the electronic device 100 is less than a first threshold, and the electronic device 100 detects that no one is nearby. In other words, the sound leakage prevention effect of anti-leakage model I after processing call data A is less than that of anti-leakage model B after processing call data A. Alternatively, the amplitude of call audio J is less than the amplitude of call audio C and also less than the amplitude of call audio E. Or, under the same external ear distance, the sound leakage intensity of call audio J played by electronic device 100 through the receiver is greater than the sound leakage intensity of call audio C played by electronic device 100 through the receiver, and also greater than the sound leakage intensity of call audio E played by electronic device 100 through the receiver.
[0561] S709A, Electronic Device 100 Execution Figure 7B Example.
[0562] Figure 7B The diagram illustrates another method for electronic device 100 to process call data based on a non-preset scenario anti-leakage model when the noise level of the first ambient sound is greater than a first threshold.
[0563] When the noise level of the first ambient sound exceeds the first threshold:
[0564] S701B, The noise level of the first ambient sound is greater than the first threshold.
[0565] S702B, Electronic device 100 needs to confirm whether the noise level of the first ambient sound is greater than the second threshold.
[0566] When the noise level of the first ambient sound is greater than the second threshold, execute S703B-S704B.
[0567] When the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, execute S705B-S706B.
[0568] For an introduction to S702B, please refer to the description in S202B; this application will not repeat it here.
[0569] S703B, electronic device 100 amplifies the amplitude of call data A to obtain call audio H and a masking sound signal H corresponding to call audio H. The amplitude of the masking sound signal H is close to the amplitude of call audio H but opposite in phase.
[0570] Optionally, the amplitudes of call audio H and call audio A are different at at least one point in time.
[0571] S704B, electronic device 100 plays call audio H through a receiver and plays masking sound signal H through a masking signal transmitter.
[0572] For a description of S703B-S704B, please refer to S203B-S204B; this application will not repeat it here.
[0573] In some embodiments, the increase in the amplitude of call data A can be related not only to the noise level of the first ambient sound but also to a non-preset scenario. When the electronic device 100 is in a non-preset scenario, the electronic device 100 can also increase the amplitude of call data A based on preset rules for the non-preset scenario. In other words, even with the same noise level in both call data and ambient sound, the degree of increase in the amplitude of call data A can differ between preset and non-preset scenarios.
[0574] S705B and electronic device 100 process call data A based on the anti-leakage model G to obtain call audio Q and masking sound signal Q. The amplitude of the masking sound signal Q is close to the amplitude of the call audio Q but opposite in phase.
[0575] S706B, electronic device 100 plays call audio Q through a receiver and plays masking sound signal Q through a masking signal transmitter.
[0576] Optionally, the electronic device 100 may not change the amplitude of the call data A, but only generate and play the masking sound signal Q. The electronic device 100 not changing the amplitude of the call data A can mean that the amplitude of the call audio Q is the same as the amplitude of the call audio A corresponding to the call data A.
[0577] Optionally, the electronic device 100 may only change the amplitude of the call data A without generating or playing the masking sound signal Q. The electronic device 100 changing the amplitude of the call data A can mean that the amplitude of the call audio Q is different from the amplitude of the call audio A corresponding to the call data A, or that the amplitudes of the call audio Q and the call audio A are different at at least one point in time.
[0578] Optionally, the electronic device 100 may also change the amplitude of the call data A and generate and play the masking sound signal Q.
[0579] The following embodiments of this application illustrate the use of an electronic device 100 changing the amplitude of call data A and generating and playing a masking sound signal Q as an example.
[0580] When the electronic device 100 is in a non-preset scenario and the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device 100 is in a quiet environment and a noisy environment. When the electronic device 100 plays the call audio A corresponding to the call data A through the receiver, the user of the electronic device 100 can clearly obtain the audio content in the call audio A. However, an eavesdropper may also obtain the private content in the call audio A played by the electronic device 100 through the receiver.
[0581] Therefore, when the electronic device 100 is in a non-preset scenario and the noise level of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device 100 can acquire the anti-leakage model G and process the call data A based on the anti-leakage model G to obtain the call audio Q and the masking sound signal Q.
[0582] The specific implementation of the anti-leakage model G in processing call data A to obtain call audio Q and masking sound signal Q is similar to the specific implementation of the anti-leakage model L in processing call data A to obtain call audio O and masking sound signal P. For details, please refer to the description in S205B-S206B, which will not be repeated here.
[0583] It should be noted that the sound reflection intensity differs between preset and non-preset scenarios. Therefore, the leakage of call data varies depending on the scenario. Electronic device 100 can process call data based on different anti-leakage models to improve the anti-leakage effect in both preset and non-preset scenarios. Specifically, anti-leakage model G differs from anti-leakage models E and F; call audio Q differs from call audio F and G; and the masking signal Q differs from masking signals F and G. Anti-leakage model G is the model corresponding to the scenario where electronic device 100 is in a non-preset scenario and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. Anti-leakage model E is the model corresponding to the scenario where electronic device 100 is in an elevator scenario and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. Anti-leakage model F is the model corresponding to the scenario where electronic device 100 is in a vehicle scenario and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. In other words, the anti-leakage effect of the anti-leakage model G on the processed call data A is weaker than that of the anti-leakage model E on the processed call data A, and also weaker than that of the anti-leakage model F on the processed call data A. Or, the amplitude of the call audio Q is smaller than the amplitude of the call audio F, and also smaller than the amplitude of the call audio G. Or, under the same external ear distance, the leakage intensity of the call audio Q played by the electronic device 100 through the receiver is greater than the leakage intensity of the call audio F played by the electronic device 100 through the receiver, and also greater than the leakage intensity of the call audio G played by the electronic device 100 through the receiver.
[0584] In summary, the anti-leakage models G, I, and H are different, and the call audio values Q, J, and I are also different. Anti-leakage model G can be the model corresponding to the situation where the electronic device 100 is in a non-preset scenario, and the noise level of the first ambient sound is greater than a first threshold but less than a second threshold. Anti-leakage model I can be the model corresponding to the situation where the electronic device 100 is in a non-preset scenario, the noise level of the first ambient sound is less than the first threshold, and the electronic device 100 detects that no one is nearby. Anti-leakage model H can be the model corresponding to the situation where the electronic device 100 is in a non-preset scenario, the noise level of the first ambient sound is less than the first threshold, and the electronic device 100 detects that someone is nearby. In other words, the anti-leakage effect of anti-leakage model G after processing call data A is weaker than that of anti-leakage model I, and the anti-leakage effect of anti-leakage model I after processing call data A is weaker than that of anti-leakage model H. In other words, the amplitude of call audio Q is greater than the amplitude of call audio J, and the amplitude of call audio J is greater than the amplitude of call audio I. Alternatively, at the same external ear distance, the leakage sound intensity of call audio Q played by electronic device 100 through the receiver is greater than the leakage sound intensity of call audio J played by electronic device 100 through the receiver, and the leakage sound intensity of call audio J played by electronic device 100 through the receiver is greater than the leakage sound intensity of call audio I played by electronic device 100 through the receiver.
[0585] pass Figures 4A-4B , Figures 6A-6B and Figures 7A-7B The method shown allows the electronic device 100 to identify different scenarios, in which the leakage intensity of the call data played by the electronic device 100 through the receiver varies. In different scenarios, the electronic device 100 can acquire different anti-leakage models and process the amplitude and / or phase of the call data based on these models. Without affecting the user's accurate acquisition of the audio content in the call data, this method can improve the anti-leakage effect in different scenarios, prevent eavesdroppers from accessing private content in the call data, and enhance the user's call experience.
[0586] This application provides a call method, an electronic device method, and a computer storage medium. The electronic device can detect the ambient noise level and whether anyone is nearby. When the electronic device is in a quiet environment and a person is detected, it can adjust the amplitude of the call data to reduce the leakage noise of the call audio corresponding to the call data played through the receiver. Alternatively, the electronic device can play a covert sound signal corresponding to the call audio played through the receiver to cancel out the leakage data and prevent people near the electronic device from accessing the private content of the call audio. This method improves the anti-leakage effect and enhances the user's call experience.
[0587] The following sections will introduce the two call methods provided in this application.
[0588] This application provides a call method, which includes: when the amplitude of a first ambient sound is less than a first threshold and an electronic device detects a person, the electronic device plays a first call audio through a receiver and plays a first masking sound signal through a speaker. The amplitude of the first masking sound signal is equal to the amplitude of the first call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0589] It should be understood that in some embodiments, the speaker and receiver are housed in a single module but have different output channels. The speaker and receiver can be driven separately, so that the sounds emitted by the speaker and receiver cancel each other out in the spatial area, thus preventing sound leakage.
[0590] This method allows an electronic device to play a covert audio signal corresponding to the call audio through a speaker while playing the call audio through the receiver, in a quiet environment and when a person is detected. This cancels out the leaked audio data, prevents people near the electronic device from accessing the private content of the call audio, improves the anti-leakage effect, and enhances the user's call experience.
[0591] The amplitude of the first masking sound signal is equal to the amplitude of the first call audio. This means that the difference between the amplitude of the first masking sound signal and the amplitude of the first call audio can be within the error range. For example, the error range can be between AdB and BdB. For example, A can be 0 and B can be 5, so the error range can be between 0dB and 5dB.
[0592] The phase of the first masking sound signal is opposite to the phase of the first call audio. This means that the difference between the phase of the first masking sound signal and the phase of the first call audio can be within an error range. For example, the error range can be between C degrees and D degrees. For example, C can be 0 and D can be 5, so the error range can be between 0 degrees and 5 degrees.
[0593] Optionally, the audio of the first call is obtained based on the data from the first call.
[0594] In some embodiments, the amplitude of the first call audio is the same as the amplitude of the call audio corresponding to the first call data, that is, the electronic device does not change the amplitude of the first call data.
[0595] In some embodiments, the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data, or the amplitude of the first call audio is different from the amplitude of the call audio corresponding to the first call data at least at one point in time, that is, the electronic device also changes the amplitude of the first call data.
[0596] For example, the first call data can also be referred to as call data A.
[0597] For example, the first call audio could be Figure 2C The first masking sound signal in the call audio K shown can be... Figure 2C The masking sound signal L is shown.
[0598] For example, the first call audio could be Figure 4A The first masking sound signal in the audio B of the call shown can be... Figure 4A The masking sound signal B is shown.
[0599] For example, the first call audio could be Figure 6A The first masking sound signal in the call audio D shown can be... Figure 6A The masking sound signal D is shown.
[0600] For example, the first call audio could be Figure 7A The first masking sound signal in the call audio I shown can be... Figure 7A The masking sound signal I is shown.
[0601] In one possible implementation, when the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, the electronic device plays a second call audio through the receiver and a second masking sound signal through the speaker. The amplitude of the second masking sound signal is equal to the amplitude of the second call audio, and the phase of the second masking sound signal is opposite to the phase of the second call audio. The second call audio is different from the first call audio.
[0602] In this way, even when the electronic device is in a quiet environment and no person is detected, there may be someone nearby that the electronic device simply has not detected. The electronic device can play the call audio through the receiver and simultaneously play the corresponding covert sound signal through the speaker to cancel out the leaked audio data. This prevents people near the electronic device from obtaining the private content of the call audio, improves the anti-leakage effect, and enhances the user's call experience.
[0603] For example, the first call audio could be Figure 2C The second masking sound signal in the call audio M shown can be... Figure 2C The masking sound signal N is shown.
[0604] For example, the first call audio could be Figure 4A The second masking sound signal in the audio C of the call shown can be... Figure 4A The masking sound signal C is shown.
[0605] For example, the first call audio could be Figure 6A The second masking sound signal in the call audio E shown can be... Figure 6A The masking sound signal E is shown.
[0606] For example, the first call audio could be Figure 7A The second masking sound signal can be the audio signal J shown in the call audio. Figure 7A The masking sound signal J is shown.
[0607] In one possible implementation, the first call audio and the second call audio are obtained based on the first call data, and the amplitudes of the second call audio and the first call audio are different at at least one point in time.
[0608] In this way, when the electronic device is in a quiet environment, and when the electronic device detects someone nearby versus when it does not, the electronic device can play different call audio, such as different amplitudes of the call audio played by the electronic device. This not only ensures that the user can accurately obtain the content of the call audio, but also further improves the anti-leakage effect.
[0609] Optionally, the amplitude of the second call audio can be the same as that of the first call audio, meaning the electronic device can play the masking sound signal without changing the amplitude of the call audio.
[0610] Optionally, when the electronic device is in a quiet environment and no person is detected, the electronic device plays a second call audio through the receiver and a corresponding masking sound signal through the speaker. The electronic device can prompt the user whether to improve the anti-leakage effect, for example, through a display control. After receiving user input, such as the user clicking the control, the electronic device can improve the anti-leakage effect, for example, by changing the amplitude and / or phase of the played call audio and changing the amplitude and / or phase of the corresponding masking signal. For example, it can switch from playing the second call audio to playing the first call audio.
[0611] In one possible implementation, when the amplitude of the first ambient sound is greater than a first threshold and less than a second threshold, the electronic device plays a third call audio through a receiver and a third masking sound signal through a speaker. The amplitude of the third masking sound signal is equal to the amplitude of the third call audio, and the phase of the third masking sound signal is opposite to the phase of the third call audio.
[0612] Thus, even in environments between quiet and noisy, the audio of a call played through the receiver could still be heard by people nearby. Alternatively, the electronic device could simultaneously play a covert audio signal through its speaker while playing the call audio through the receiver, thus canceling out any leaked audio data and preventing people nearby from accessing the private content of the call audio. This also improves the effectiveness of preventing audio leakage.
[0613] For example, the third call audio could be Figure 2D The third masking sound signal shown in the call audio O can be... Figure 2D The masking sound signal P is shown.
[0614] For example, the third call audio could be Figure 4B The third masking sound signal in the call audio F shown can be... Figure 4B The masking sound signal F is shown.
[0615] For example, the third call audio could be Figure 6B The third masking sound signal in the call audio G shown can be... Figure 6B The masking sound signal G is shown.
[0616] For example, the third call audio could be Figure 7B The call audio Q shown can be the third masking sound signal. Figure 7B The masking sound signal Q is shown.
[0617] In one possible implementation, the third call audio is obtained based on the first call data, and the amplitude of the third call audio and the first call audio are different at at least one point in time.
[0618] In this way, electronic devices can play different call audio in different environments, and generate and play different masking sound signals based on the different call audio, further improving the anti-sound leakage effect of electronic devices in different environments.
[0619] Optionally, the amplitude of the third call audio can be the same as that of the first call audio, meaning the electronic device can play the masking sound signal without changing the amplitude of the call audio.
[0620] In one possible implementation, the method further includes: when the amplitude of the first ambient sound is greater than a second threshold, the electronic device plays a fourth call audio through the receiver, the amplitude of the fourth call audio being greater than the amplitude of the call audio corresponding to the first call data, and the fourth call audio being obtained based on the first call data.
[0621] In this way, in noisy environments, electronic devices can amplify the amplitude of call audio to ensure that the user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0622] For example, the fourth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The audio of the call shown is H.
[0623] Optionally, in noisy environments, electronic devices can also play masked sound signals corresponding to the fourth call audio through a speaker.
[0624] For example, the masking sound signal corresponding to the fourth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0625] Preferably, in noisy environments, where the user is not concerned about sound leakage, the electronic device may not play the masking sound signal corresponding to the fourth call audio, thereby saving power consumption.
[0626] In one possible implementation, the electronic device identifies a person, including by the electronic device identifying a person through a camera.
[0627] Preferably, the camera is a rear-facing camera of an electronic device.
[0628] Optionally, while the electronic device is playing call audio through the receiver, the electronic device then turns on the camera and confirms whether the electronic device has recognized the person through the camera.
[0629] In one possible implementation, before the electronic device plays the first call audio through the receiver, the method further includes: the electronic device acquiring first information, the first information including any one or more of the following: sensor data, base station connection status of the electronic device, device connection status of the electronic device, and location information of the electronic device, wherein the sensor data includes acceleration data and / or gyroscope data; and when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the first call audio through the receiver, specifically including: when the electronic device confirms based on the first information that the electronic device is in a first scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the first call audio.
[0630] In one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is in a second scenario, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a fifth call audio through a receiver, wherein the second scenario is different from the first scenario, the amplitude of the fifth call audio and the first call audio are different at at least one point in time, and the fifth call audio is obtained based on the first call data.
[0631] The first and second scenarios can both involve electronic devices operating in relatively enclosed environments. In these environments, sound reflection causes more severe audio leakage when the electronic device transmits call audio through the receiver. Furthermore, the intensity of sound reflection varies across different enclosed environments, resulting in varying degrees of audio leakage when the electronic device transmits call data through the receiver.
[0632] In this way, electronic devices can recognize different preset scenarios and play different call audio. For example, electronic devices can recognize different preset scenarios and process call data differently to achieve the purpose of playing different call audio, thereby further improving the sound leakage prevention effect.
[0633] For example, when the first scenario includes an elevator scenario and the second scenario includes a car ride scenario, the first call audio can be... Figure 4A The fifth call audio, shown in call audio B, can be... Figure 6A The audio of the call shown is D.
[0634] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device can also play different call audio based on different scenarios. For example, the electronic device can play call audio with different amplitudes. For details, please refer to... Figure 4A , Figure 4B , Figure 6A , Figure 6B Description in the embodiments.
[0635] In one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is not in the first scenario or the second scenario, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio, the sixth call audio having an amplitude different from the first call audio and the fifth call audio at at least one point in time, and the sixth call audio is obtained based on the first call data.
[0636] In this way, if the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, which can also improve the anti-leakage effect of the electronic device in the non-preset scenario.
[0637] For example, the audio of the sixth call could be Figure 7A The audio of the call shown is I.
[0638] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on a non-preset scenario. For example, the electronic device may play call audio with different amplitudes. For details, please refer to... Figure 7A , Figure 7B Description in the embodiments.
[0639] In one possible implementation, the first scenario includes an elevator scenario, where the electronic device is in the elevator scenario when the first information meets the first condition.
[0640] The first condition includes any one or more of the following: during the first time period, the electronic device moves horizontally; during the second time period, the electronic device moves vertically, the second time period being a time period following the first time period; the device connection status of the electronic device includes the electronic device being connected to Wi-Fi; and the location information of the electronic device is near an office building / residential area / hospital / shopping mall.
[0641] For example, regarding how electronic devices can identify elevator scenarios, you can refer to... Figures 3A-3K Description in the embodiments.
[0642] In one possible implementation, the second scenario includes a vehicle-riding scenario. When the first information satisfies the second condition, the electronic device is in the vehicle-riding scenario. The second condition includes any one or more of the following: the electronic device switches from being connected to the first base station to being connected to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection status of the electronic device includes the electronic device establishing a connection with the vehicle, and the location of the electronic device is constantly changing.
[0643] For example, regarding how electronic devices can identify passenger scenarios, you can refer to... Figure 5 Description in the embodiments.
[0644] In one possible implementation, the first call audio is obtained based on the first call data and the second information, which includes any one or more of the following: the amplitude of the first call data at different time points, the volume of the call audio played by the electronic device through the receiver, and the amplitude of the first ambient sound at different time points.
[0645] Figure 8 A flowchart illustrating a call method provided in this application is shown.
[0646] S801, The electronic device acquires the first call data.
[0647] S802. In the absence of ambient sound, the electronic device plays the first call audio through the receiver. The first call audio is obtained based on the first call data.
[0648] S803, when the amplitude of the first ambient sound is less than the first threshold and the electronic device recognizes a person, the electronic device plays a second call audio through the receiver. The second call audio is obtained based on the first call data, and the amplitudes of the first call audio and the second call audio are different at at least one point in time.
[0649] Using this method, after acquiring call data, the electronic device can identify the ambient noise level and detect whether there are people nearby. When the electronic device is in a quiet environment and a person is detected, it can adjust the amplitude of the call data to reduce the leakage of audio transmitted through the receiver, thus improving the anti-leakage effect.
[0650] Optionally, while playing the second call audio through the receiver, the electronic device may also play the first masking sound signal corresponding to the second call audio through the speaker. The amplitude of the first masking sound signal is equal to the amplitude of the second call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
[0651] In this way, the first masking sound signal can cancel out the leakage data of the second call audio played by the electronic device through the receiver, which can further improve the anti-leakage effect.
[0652] For example, the first call data can also be referred to as call data A. The first call audio can also be referred to as call audio A corresponding to call data A.
[0653] For example, the second call audio could be Figure 2C The first masking sound signal in the call audio K shown can be... Figure 2C The masking sound signal L is shown.
[0654] For example, the second call audio could be Figure 4A The first masking sound signal in the audio B of the call shown can be... Figure 4A The masking sound signal B is shown.
[0655] For example, the second call audio could be Figure 6A The first masking sound signal in the call audio D shown can be... Figure 6A The masking sound signal D is shown.
[0656] For example, the second call audio could be Figure 7A The first masking sound signal in the call audio I shown can be... Figure 7A The masking sound signal I is shown.
[0657] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device detects a person, before playing the second call audio through the receiver, the electronic device can prompt the user whether to enhance the anti-leakage effect. This can be done, for example, by displaying a control. After receiving user input, such as the user clicking the control, the electronic device can enhance the anti-leakage effect by changing the amplitude and / or phase of the played call audio and the corresponding masking signal amplitude and / or phase. For example, it can play the second call audio. If the user confirms that the anti-leakage effect should not be enhanced, the electronic device can continue playing the first call audio.
[0658] In one possible implementation, the method further includes: when the amplitude of the first ambient sound is less than a first threshold and the electronic device does not recognize a person, the electronic device plays a third call audio through a receiver, wherein the amplitude of the third call audio is different from that of the second call audio and the first call audio at least at one point in time, and the third call audio is obtained based on the first call data.
[0659] In this way, even if the electronic device is in a quiet environment and no person is detected, there may be someone nearby that the electronic device just hasn't detected. The electronic device can play different call audio, such as different amplitudes of the call audio played by the electronic device. This not only ensures that the user can accurately obtain the content of the call audio, but also further improves the sound leakage prevention effect.
[0660] Optionally, while playing the third call audio through the receiver, the electronic device can also play a covert sound signal corresponding to the third call audio through the speaker to cancel out the leaked audio data of the third call audio, prevent people near the electronic device from obtaining the private content in the third call audio, improve the anti-leakage effect, and enhance the user's call experience.
[0661] For example, the third call audio could be Figure 2C The covert sound signal corresponding to the third call audio M shown can be... Figure 2C The masking sound signal N is shown.
[0662] For example, the third call audio could be Figure 4A The covert sound signal corresponding to the third call audio C shown can be... Figure 4A The masking sound signal C is shown.
[0663] For example, the third call audio could be Figure 6A The covert sound signal corresponding to the third call audio E shown can be... Figure 6A The masking sound signal E is shown.
[0664] For example, the third call audio could be Figure 7A The covert sound signal corresponding to the third call audio J shown can be... Figure 7A The masking sound signal J is shown.
[0665] In one possible implementation, the method further includes: when the amplitude of the first ambient sound is greater than a first threshold and less than a second threshold, the electronic device plays a fourth call audio through a receiver, wherein the amplitude of the fourth call audio is different from that of the second call audio and the first call audio at least at one point in time, and the fourth call audio is obtained based on the first call data.
[0666] Thus, even in environments between quiet and noisy, the audio played by the electronic device through its receiver could still be heard by people nearby. The electronic device can also play different audio frequencies, such as varying amplitudes, which not only ensures the user accurately receives the audio content but also further improves the anti-leakage effect.
[0667] Optionally, the electronic device can also play a covert sound signal corresponding to the fourth call audio through the speaker while playing the fourth call audio through the receiver, in order to cancel out the leaked audio data of the fourth call audio, prevent people near the electronic device from obtaining the private content in the fourth call audio, improve the anti-leakage effect, and improve the user's call experience.
[0668] For example, the fourth call audio could be Figure 2D The covert sound signal corresponding to the fourth call audio (O) shown can be... Figure 2D The masking sound signal P is shown.
[0669] For example, the fourth call audio could be Figure 4B The covert sound signal corresponding to the fourth call audio F shown can be... Figure 4B The masking sound signal F is shown.
[0670] For example, the fourth call audio could be Figure 6B The covert sound signal corresponding to the fourth call audio G shown can be... Figure 6B The masking sound signal G is shown.
[0671] For example, the fourth call audio could be Figure 7B The covert sound signal corresponding to the fourth call audio, Q, shown in the diagram, can be... Figure 7B The masking sound signal Q is shown.
[0672] In one possible implementation, the method further includes: when the amplitude of the first ambient sound is greater than a second threshold, the electronic device plays a fifth call audio through a receiver, the amplitude of the fifth call audio being greater than the amplitude of the first call data, and the fifth call audio being obtained based on the first call data.
[0673] In this way, in noisy environments, electronic devices can amplify the amplitude of call audio to ensure that the user can accurately obtain the content of the call audio played by the electronic device through the receiver.
[0674] For example, the fifth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The audio of the call shown is H.
[0675] Optionally, in noisy environments, electronic devices can also play masked sound signals corresponding to the fourth call audio through a speaker.
[0676] For example, the masking sound signal corresponding to the fourth call audio could be Figure 2D or Figure 4B or Figure 6B or Figure 7B The masking sound signal H is shown.
[0677] Preferably, in noisy environments, where the user is not concerned about sound leakage, the electronic device may not play the masking sound signal corresponding to the fourth call audio, thereby saving power consumption.
[0678] In one possible implementation, the fifth call audio is obtained based on the amplitude of the first ambient sound and the first call data.
[0679] In one possible implementation, the electronic device identifies a person, including by the electronic device identifying a person through a camera.
[0680] Preferably, the camera is a rear-facing camera of an electronic device.
[0681] Optionally, while the electronic device is playing call audio through the receiver, the electronic device then turns on the camera and confirms whether the electronic device has recognized the person through the camera.
[0682] In one possible implementation, before the electronic device plays the second call audio through the receiver, the method further includes: the electronic device acquiring first information, the first information including any one or more of the following: sensor data, base station connection status of the electronic device, device connection status of the electronic device, and location information of the electronic device, wherein the sensor data includes acceleration data and / or gyroscope data; and when the amplitude of the first ambient sound is less than a first threshold and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver, specifically including: when the electronic device confirms based on the first information that the electronic device is in a first scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the second call audio through the receiver.
[0683] In one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is in a second scenario, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio through a receiver, wherein the second scenario is different from the first scenario, the amplitude of the sixth call audio and the second call audio are different at at least one point in time, and the sixth call audio is obtained based on the first call data.
[0684] The first and second scenarios can both involve electronic devices operating in relatively enclosed environments. In these environments, sound reflection causes more severe audio leakage when the electronic device transmits call audio through the receiver. Furthermore, the intensity of sound reflection varies across different enclosed environments, resulting in varying degrees of audio leakage when the electronic device transmits call data through the receiver.
[0685] In this way, electronic devices can recognize different preset scenarios and play different call audio. For example, electronic devices can recognize different preset scenarios and process call data differently to achieve the purpose of playing different call audio, thereby further improving the sound leakage prevention effect.
[0686] For example, when the first scenario includes an elevator scenario and the second scenario includes a car ride scenario, the first call audio can be... Figure 4A The sixth call audio, shown in call audio B, can be... Figure 6A The audio of the call shown is D.
[0687] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device can also play different call audio based on different scenarios. For example, the electronic device can play call audio with different amplitudes. For details, please refer to... Figure 4A , Figure 4B , Figure 6A , Figure 6B Description in the embodiments.
[0688] In one possible implementation, the method further includes: when the electronic device confirms based on the first information that the electronic device is not in the first scenario or the second scenario, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a seventh call audio through the receiver. The amplitude of the seventh call audio is different from that of the second call audio and the sixth call audio at least at one point in time. The seventh call audio is obtained based on the first call data.
[0689] In this way, if the preset scenario is not recognized, the electronic device can process the call data differently based on the non-preset scenario, which can also improve the anti-leakage effect of the electronic device in the non-preset scenario.
[0690] For example, the audio of the seventh call could be Figure 7A The audio of the call shown is I.
[0691] Optionally, if the amplitude of the first ambient sound is less than a first threshold and the electronic device does not detect a person, or if the amplitude of the first ambient sound is greater than the first threshold but less than a second threshold, or if the amplitude of the first ambient sound is greater than the second threshold, the electronic device may also play different call audio based on a non-preset scenario. For example, the electronic device may play call audio with different amplitudes. For details, please refer to... Figure 7A , Figure 7B Description in the embodiments.
[0692] In one possible implementation, the first scenario includes an elevator scenario. When the first information meets the first condition, the electronic device is in the elevator scenario. The first condition includes any one or more of the following: the electronic device moves horizontally during a first time period; the electronic device moves vertically during a second time period, the second time period being a time period following the first time period; the device connection status of the electronic device includes the electronic device being connected to Wi-Fi; and the location information of the electronic device is near an office building / residential area / hospital / shopping mall.
[0693] For example, regarding how electronic devices can identify elevator scenarios, you can refer to... Figures 3A-3K Description in the embodiments.
[0694] In one possible implementation, the second scenario includes a vehicle-riding scenario. When the first information satisfies the second condition, the electronic device is in the vehicle-riding scenario. The second condition includes any one or more of the following: the electronic device switches from being connected to the first base station to being connected to the second base station, the second base station is different from the first base station, the electronic device moves in the horizontal direction, the device connection status of the electronic device includes the electronic device establishing a connection with the vehicle, and the location of the electronic device is constantly changing.
[0695] For example, regarding how electronic devices can identify passenger scenarios, you can refer to... Figure 5 Description in the embodiments.
[0696] In one possible implementation, the second call audio is obtained based on the first call data and the second information, the second information including any one or more of the following: the amplitude of the first call data at different time points, the volume of the call audio played by the electronic device through the receiver, and the amplitude of the first ambient sound at different time points.
[0697] This application provides an electronic device, which includes a memory and a processor. The memory is used to store a computer program, and the processor is used to invoke the computer program to cause the electronic device to execute various steps in a call method provided in this application.
[0698] This application provides a computationally readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform various steps in a call method provided in this application.
[0699] This application provides a computer program product containing computer instructions that, when executed on an electronic device, cause the electronic device to perform various steps in a call method provided in this application.
[0700] This application provides a chip for use in an electronic device. The chip includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform various steps in a call method provided in this application.
[0701] It is understood that the user interfaces described in the embodiments of this application are merely example interfaces and do not constitute a limitation on the solution of this application. In other embodiments, the user interface may adopt different interface layouts, may include more or fewer controls, and may add or remove other functional options, as long as they are based on the same inventive concept provided in this application, they are all within the protection scope of this application.
[0702] It should be noted that, without causing contradictions or conflicts, any feature in any embodiment of this application, or any part of any feature, can be combined, and the combined technical solution is also within the scope of the embodiments of this application.
[0703] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A method for making a call, characterized in that, The method includes: Electronic devices acquire first information; When the electronic device confirms based on the first information that it is in a first scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a first call audio through the receiver and a first masking sound signal through the speaker. The amplitude of the first masking sound signal is equal to the amplitude of the first call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio. When the electronic device confirms based on the first information that it is in the second scenario, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays the fifth call audio through the receiver and plays the fifth masking sound signal through the speaker. In this scenario, the second scenario and the first scenario are different closed scenarios. The sound reflection intensity of the second scenario is different from that of the first scenario. The amplitude of the fifth call audio and the first call audio are different at at least one point in time. The amplitude of the fifth masking sound signal is equal to the amplitude of the fifth call audio. The phase of the fifth masking sound signal is opposite to the phase of the fifth call audio. The amplitude difference between the fifth call audio and the first call audio is determined based on the sound reflection intensity of the first scenario and the sound reflection intensity of the second scenario.
2. The method according to claim 1, characterized in that, When the amplitude of the first ambient sound is less than the first threshold and the electronic device does not detect a person, the electronic device plays a second call audio through the receiver and a second masking sound signal through the speaker. The amplitude of the second masking sound signal is equal to the amplitude of the second call audio, and the phase of the second masking sound signal is opposite to the phase of the second call audio. The second call audio is different from the first call audio.
3. The method according to claim 2, characterized in that, The first call audio, the second call audio, and the fifth call audio are obtained based on the first call data. The amplitude of the second call audio and the first call audio is different at at least one point in time.
4. The method according to any one of claims 1-3, characterized in that, When the amplitude of the first ambient sound is greater than the first threshold and less than the second threshold, the electronic device plays a third call audio through the receiver and a third masking sound signal through the speaker. The amplitude of the third masking sound signal is equal to the amplitude of the third call audio, and the phase of the third masking sound signal is opposite to the phase of the third call audio.
5. The method according to claim 4, characterized in that, The third call audio is obtained based on the first call data, and the amplitude of the third call audio and the first call audio are different at at least one point in time.
6. The method according to any one of claims 1-3, characterized in that, The method further includes: When the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fourth call audio through the receiver. The amplitude of the fourth call audio is greater than the amplitude of the call audio corresponding to the first call data. The fourth call audio is obtained based on the first call data.
7. The method according to any one of claims 1-3, characterized in that, The electronic device identifies a person, including the electronic device identifying a person through a camera.
8. The method according to any one of claims 1-3, characterized in that, The first information includes any one or more of the following: sensor data, base station connection status of the electronic device, device connection status of the electronic device, and location information of the electronic device. The sensor data includes acceleration data and / or gyroscope data.
9. The method according to claim 1, characterized in that, The method further includes: When the electronic device confirms, based on the first information, that it is not in the first scenario or the second scenario, that the amplitude of the first ambient sound is less than the first threshold, and that the electronic device has detected a person, the electronic device plays a sixth call audio. The sixth call audio has a different amplitude from the first call audio and the fifth call audio at at least one point in time. The sixth call audio is obtained based on the first call data.
10. The method according to claim 1, characterized in that, The first scenario includes an elevator scenario. When the first information meets the first condition, the electronic device is in the elevator scenario. The first condition includes any one or more of the following: during a first time period, the electronic device moves in the horizontal direction; during a second time period, the electronic device moves in the vertical direction, the second time period being a time period following the first time period; the device connection status of the electronic device includes the electronic device being connected to Wi-Fi; and the location information of the electronic device is near an office building / residential area / hospital / shopping mall.
11. The method according to claim 1, characterized in that, The second scenario includes a car-riding scenario. When the first information meets the second condition, the electronic device is in the car-riding scenario. The second condition includes any one or more of the following: the electronic device switches from being connected to the first base station to being connected to the second base station, the second base station being different from the first base station; the electronic device moves in the horizontal direction; the device connection status of the electronic device includes the electronic device establishing a connection with the vehicle; and the location of the electronic device is constantly changing.
12. The method according to any one of claims 1-3, characterized in that, The first call audio is obtained based on the first call data and the second information, the second information including any one or more of the following: the amplitude of the first call data at different time points, the volume of the call audio played by the electronic device through the receiver, and the amplitude of the first ambient sound at different time points.
13. A method for making a call, characterized in that, The method includes: The electronic device acquires first call data; in the absence of ambient sound, the electronic device plays first call audio through the receiver, the first call audio being obtained based on the first call data; The electronic device acquires first information; When the electronic device confirms based on the first information that it is in a first scene, the amplitude of the first ambient sound is less than a first threshold, and the electronic device recognizes a person, the electronic device plays a second call audio through the receiver. The second call audio is obtained based on the first call data, and the amplitudes of the first call audio and the second call audio are different at at least one point in time. When the electronic device confirms based on the first information that it is in the second scene, the amplitude of the first ambient sound is less than the first threshold, and the electronic device recognizes a person, the electronic device plays a sixth call audio through the receiver. The amplitude of the sixth call audio is different from that of the second call audio at at least one point in time. The sixth call audio is obtained based on the first call data. The second scene and the first scene are different closed scenes. The sound reflection intensity of the second scene is different from that of the first scene. The amplitude difference between the sixth call audio and the second call audio is determined based on the sound reflection intensity of the first scene and the sound reflection intensity of the second scene.
14. The method according to claim 13, characterized in that, The method further includes: When the amplitude of the first ambient sound is less than the first threshold and the electronic device does not recognize a person, the electronic device plays a third call audio through the receiver. The amplitude of the third call audio is different from that of the second call audio and the first call audio at at least one point in time. The third call audio is obtained based on the first call data.
15. The method according to claim 13 or 14, characterized in that, The method further includes: When the amplitude of the first ambient sound is greater than the first threshold but less than the second threshold, the electronic device plays a fourth call audio through the receiver. The amplitude of the fourth call audio is different from that of the second call audio and the first call audio at at least one point in time. The fourth call audio is obtained based on the first call data.
16. The method according to claim 13 or 14, characterized in that, The method further includes: When the amplitude of the first ambient sound is greater than the second threshold, the electronic device plays a fifth call audio through the receiver. The amplitude of the fifth call audio is greater than the amplitude of the first call data, and the fifth call audio is obtained based on the first call data.
17. The method according to claim 16, characterized in that, The fifth call audio is obtained based on the amplitude of the first ambient sound and the first call data.
18. The method according to claim 13 or 14, characterized in that, The electronic device identifies a person, including the electronic device identifying a person through a camera.
19. The method according to claim 13, characterized in that, The method further includes: When the electronic device confirms, based on the first information, that it is not in the first scenario or the second scenario, that the amplitude of the first ambient sound is less than the first threshold, and that the electronic device has detected a person, the electronic device plays a seventh call audio through the receiver. The amplitude of the seventh call audio is different from that of the second call audio and the sixth call audio at at least one point in time. The seventh call audio is obtained based on the first call data.
20. The method according to claim 13 or 19, characterized in that, The first scenario includes an elevator scenario. When the first information meets the first condition, the electronic device is in the elevator scenario. The first condition includes any one or more of the following: during a first time period, the electronic device moves in the horizontal direction; during a second time period, the electronic device moves in the vertical direction, the second time period being a time period following the first time period; the device connection status of the electronic device includes the electronic device being connected to Wi-Fi; and the location information of the electronic device is near an office building / residential area / hospital / shopping mall.
21. The method according to claim 13 or 19, characterized in that, The second scenario includes a car-riding scenario. When the first information meets the second condition, the electronic device is in the car-riding scenario. The second condition includes any one or more of the following: the electronic device switches from being connected to the first base station to being connected to the second base station, the second base station being different from the first base station; the electronic device moves in the horizontal direction; the device connection status of the electronic device includes the electronic device establishing a connection with the vehicle; and the location of the electronic device is constantly changing.
22. The method according to claim 13 or 14, characterized in that, The second call audio is obtained based on the first call data and the second information, the second information including any one or more of the following: the amplitude of the first call data at different time points, the volume of the call audio played by the electronic device through the receiver, and the amplitude of the first ambient sound at different time points.
23. The method according to claim 13 or 14, characterized in that, The method further includes: When the amplitude of the first ambient sound is less than the first threshold and the electronic device detects a person, the electronic device plays a first masking sound signal through a speaker. The amplitude of the first masking sound signal is equal to the amplitude of the second call audio, and the phase of the first masking sound signal is opposite to the phase of the first call audio.
24. An electronic device, characterized in that, The electronic device includes a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to invoke the computer program to cause the electronic device to perform the method of any one of claims 1-23.
25. A computationally readable storage medium, comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device performs the method of any one of claims 1-23.
26. A computer program product, characterized in that, The computer program product includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the method of any one of claims 1-23.