Audio processing method, electronic equipment and computer readable storage medium

Abstract

The invention provides an audio processing method, electronic equipment and a computer readable storage medium, and the method comprises the steps: carrying out the semantic analysis of call audio data in a call process between first electronic equipment and second electronic equipment, and obtaining a target semantic analysis result, the call audio data comprising call audio data from the second electronic equipment; an audio processing strategy is adjusted based on the target semantic analysis result, the audio processing strategy comprises an uplink audio processing strategy, and the uplink audio processing strategy is used for processing call audio data collected by the first electronic device. According to the embodiment of the invention, in the call process, the uplink audio processing strategy of the electronic equipment can be dynamically adjusted by performing semantic analysis on the call audio data from the opposite end, so that the call quality can be improved, and a user can obtain better call experience.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to an audio processing method, an electronic device, and a computer-readable storage medium. Background Art

[0002] As the processing capabilities of terminal devices such as mobile phones and tablets become increasingly powerful, audio processing technology based on audio noise reduction has also been widely used in terminal devices such as mobile phones and tablets.

[0003] When users use their mobile phones to make daily calls, one or both parties may be in a noisy environment (such as a shopping mall, high-speed rail station, airport, etc. with a lot of people), which causes one party to be unable to hear what the other party is saying, resulting in poor call quality. Summary of the invention

[0004] The embodiments of the present application disclose an audio processing method, an electronic device, and a computer-readable storage medium. During a call, by performing semantic analysis on the call audio data from the other end, the uplink audio processing strategy of the electronic device can be dynamically adjusted, thereby improving the call quality and allowing the user to obtain a better call experience.

[0005] The first aspect discloses an audio processing method, which can be applied to a first electronic device, or to a module (e.g., a processor) in the first electronic device, or to a logic module or software that can implement all or part of the functions of the first electronic device. The following description is given by taking the application to the first electronic device as an example. The communication method may include: during a call between the first electronic device and the second electronic device, performing semantic analysis on the call audio data to obtain a target semantic analysis result; the call audio data includes call audio data from the second electronic device; adjusting the audio processing strategy based on the target semantic analysis result; wherein the audio processing strategy includes an uplink audio processing strategy, and the uplink audio processing strategy is used to process the call audio data collected by the first electronic device.

[0006] In an embodiment of the present application, during a call, the first electronic device can perform semantic analysis on the call audio data from the second electronic device (such as "Your voice is so soft", "It's too noisy over there, I can't hear you clearly") to obtain a semantic analysis result. Based on the semantic analysis result, the first electronic device can understand the actual call experience of the user of the other end (the second electronic device) or the call audio quality of the local end (the first electronic device), such as whether the noise on the local end is large, whether the sound on the local end is small, etc. Therefore, the first electronic device can dynamically adjust the uplink audio processing strategy of the local end based on the semantic analysis result (such as selecting a higher level of noise reduction intensity when the other end feedbacks that the noise on the local end is large). Afterwards, the first electronic device can process the call audio data collected by the first electronic device through the adjusted uplink audio processing strategy, which can make the audio quality of the call audio data sent to the second electronic device better, so that the user of the other end can get a better call experience.

[0007] In combination with the first aspect, in a possible implementation manner, the uplink audio processing strategy includes one or more of uplink noise reduction strength, uplink audio gain, and uplink noise reduction scenario.

[0008] In an embodiment of the present application, for the uplink audio processing strategy, multiple options such as uplink noise reduction intensity, uplink audio gain, and uplink noise reduction scenario may be included. Among them, the uplink noise reduction intensity can be used to adjust the degree of noise elimination, and can be used to meet the noise reduction needs of different users and various scenarios. For example, a weak noise reduction intensity can eliminate a small part of the noise, a medium noise reduction intensity can eliminate most of the noise, and a strong noise reduction intensity can completely eliminate the noise. The uplink audio gain can be used to adjust the amplitude of the audio data transmitted to the second electronic device side, that is, the volume can be adjusted. By adjusting the uplink audio gain, the user at the other end can hear more clearly. As for the noise reduction scenario, different noise reduction scenarios can correspond to different noise reduction models. By adjusting the appropriate noise reduction scenario, the best noise reduction effect can be obtained, and the impact on the target voice can be minimized while reducing the noise.

[0009] In combination with the first aspect, in a possible implementation, the call audio data also includes call audio data collected by the first electronic device.

[0010] In an embodiment of the present application, the call audio data also includes call audio data collected by the first electronic device, that is, the call audio data of the local end. In this way, the first electronic device can obtain a more complete and accurate semantic analysis result based on the conversation context (the conversation between the local user and the other end user), thereby ensuring that the uplink noise reduction strategy can be adjusted more accurately.

[0011] In combination with the first aspect, in a possible implementation manner, the audio processing strategy also includes a downlink audio processing strategy.

[0012] In combination with the first aspect, in a possible implementation manner, the downlink audio processing strategy includes one or more of downlink noise reduction strength, downlink audio gain, and downlink noise reduction scenario.

[0013] In an embodiment of the present application, the first electronic device can also dynamically adjust the downlink audio processing strategy based on the semantic analysis results of the call audio data, such as the noise reduction scenario, noise reduction intensity, etc., so that the local user can obtain a better call experience.

[0014] In combination with the first aspect, in a possible implementation, adjusting the audio processing strategy based on the target semantic analysis result includes: when the target semantic analysis result is one of multiple preset semantic analysis results, adjusting the audio processing strategy based on the adjustment strategy corresponding to the target semantic result; the multiple preset semantic analysis results are all configured with corresponding adjustment strategies, and the adjustment strategies are used to indicate the parameters in the audio processing strategy that need to be adjusted and the adjustment method.

[0015] In an embodiment of the present application, multiple preset semantic analysis results and adjustment strategies corresponding to each preset semantic analysis result can be configured in advance. In this way, it can be ensured that the first electronic device can efficiently and accurately adjust the uplink audio processing strategy based on the semantic analysis results of the call audio data.

[0016] In combination with the first aspect, in a possible implementation, the method further includes: initiating positioning to obtain a first positioning result; and adjusting an uplink noise reduction scenario based on the first positioning result, where different noise reduction scenarios correspond to different noise reduction models.

[0017] In the embodiment of the present application, the uplink noise reduction scenario in which the local end is currently located can be accurately determined through positioning, so that the most appropriate noise reduction model can be used for noise reduction processing, thereby ensuring the best noise reduction effect.

[0018] In combination with the first aspect, in a possible implementation, the method further includes: receiving first indication information from the second electronic device, the first indication information being used to indicate an audio quality problem of the first electronic device; and adjusting an uplink audio processing strategy based on the first indication information.

[0019] In an embodiment of the present application, the first electronic device may also adjust the uplink audio processing strategy based on the first indication information from the second electronic device to improve the quality of the call audio so that the opposite end user obtains a better call experience.

[0020] In combination with the first aspect, in a possible implementation, adjusting the uplink audio processing strategy based on the first indication information includes: adjusting the uplink audio processing strategy based on the adjustment strategy corresponding to the first indication information; the first indication information includes multiple value conditions, and the multiple value conditions are all configured with corresponding adjustment strategies, and the adjustment strategy is used to indicate the parameters in the audio processing strategy that need to be adjusted and the adjustment method.

[0021] In an embodiment of the present application, multiple possible scenarios can be determined in advance, each scenario can correspond to a value of indication information, and a corresponding adjustment strategy can be pre-configured for each value of indication information. In this way, it can be ensured that the first electronic device can efficiently and accurately adjust the uplink audio processing strategy based on the first indication information.

[0022] In combination with the first aspect, in a possible implementation, before adjusting the audio processing strategy based on the target semantic analysis result, the method also includes: performing semantic analysis on the sixth audio data to obtain a sixth semantic analysis result; the sixth audio data includes call audio data from the second electronic device and / or call audio data collected by the first electronic device; when the sixth semantic analysis result is one of multiple preset semantic analysis results, turning on the smart call mode; adjusting the audio processing strategy based on the target semantic analysis result includes: when the smart call mode is turned on, adjusting the audio processing strategy based on the target semantic analysis result.

[0023] In the embodiment of the present application, since in most cases, the first electronic device is usually in an environment with less noise or basically no noise, the smart call mode can be turned off by default each time the first electronic device makes a call. In this case, the first electronic device does not need to perform noise reduction and other processing. During the call, the first electronic device can perform semantic analysis on the call audio data from the second electronic device. When it is determined based on the semantic analysis that there is a problem with the call audio quality (such as the noise on the local end is large and the sound on the local end is small), the first electronic device can turn on the smart call mode again and perform noise reduction and other processing. It can be seen that in this way, the first electronic device can only turn on the smart call mode for noise reduction and other processing when it is determined based on the semantic analysis result that specific conditions are met. In this way, meaningless noise reduction processing of the first electronic device can be avoided as much as possible, and the overall power consumption of the first electronic device can be reduced.

[0024] In combination with the first aspect, in a possible implementation, before adjusting the audio processing strategy based on the target semantic analysis result, the method also includes: receiving a first request message from the second electronic device, the first request message being used to request to activate a smart call mode; activating the smart call mode based on the first request message; adjusting the audio processing strategy based on the target semantic analysis result includes: adjusting the audio processing strategy based on the target semantic analysis result when the smart call mode is activated.

[0025] In combination with the first aspect, in a possible implementation, the method also includes: receiving a second request message from the second electronic device, the second request message being used to request adjustment of the uplink audio processing strategy, the second request message including parameters in the uplink audio processing strategy that need to be adjusted and corresponding parameter values; adjusting the uplink audio processing strategy based on the second request message.

[0026] In an embodiment of the present application, the first electronic device can also directly turn on the smart call mode based on the request message from the second electronic device, or directly adjust the uplink audio processing strategy, which can improve the flexibility of turning on the smart call mode and the flexibility of adjusting the uplink audio processing strategy. Exemplarily, the second electronic device can provide a corresponding control for requesting the other end to turn on the smart call mode, and a control for requesting the other end to adjust the uplink audio processing strategy. In this way, the user of the second electronic device can request the other end to turn on the smart call mode or adjust the uplink audio processing strategy according to the actual call experience, so as to improve the call quality and enable themselves to obtain a better call experience.

[0027] In combination with the first aspect, in a possible implementation, the method also includes: displaying a first user interface, the first user interface including an audio processing configuration control; in response to a user operation acting on the audio processing configuration control, displaying a second user interface; the second user interface including an upstream audio processing configuration area, the upstream audio processing configuration area including one or more of a noise reduction intensity configuration area, an audio gain configuration area, and a noise reduction scene configuration area, the noise reduction intensity configuration area including multiple noise reduction intensity options, the audio gain configuration area including multiple audio gain options, and the noise reduction scene configuration area including multiple noise reduction scene options; in response to a user operation acting on the first option, changing the first option to a selected state, and enabling the audio processing strategy corresponding to the first option; the first option is any option in the second user interface.

[0028] In the embodiment of the present application, the first electronic device may further provide a configuration interface corresponding to the uplink audio processing strategy, which may facilitate manual adjustment by the user and may further improve the flexibility of adjusting the uplink audio processing strategy.

[0029] In combination with the first aspect, in a possible implementation, the method also includes: receiving fourth audio data from the second electronic device; processing the fourth audio data based on the current downlink audio processing strategy to obtain fifth audio data; analyzing the fifth audio data to determine an audio quality problem of the fifth audio data; and adjusting the downlink audio processing strategy based on the audio quality problem of the fifth audio data.

[0030] In an embodiment of the present application, the first electronic device can also analyze the audio data processed by the local downlink audio processing strategy, and then adjust the downlink audio processing strategy based on the analysis results, so as to ensure the accuracy of the downlink audio processing strategy and enable the local user to obtain a better call experience.

[0031] The second aspect discloses an audio processing method, which can be applied to a first electronic device, or to a module (e.g., a processor) in the first electronic device, or to a logic module or software that can realize all or part of the functions of the first electronic device. The following description is given by taking the application to the first electronic device as an example. The communication method may include: during a call between the first electronic device and the second electronic device, performing semantic analysis on the call audio data to obtain a target semantic analysis result; the call audio data includes the call audio data collected by the first electronic device; adjusting the audio processing strategy based on the target semantic analysis result; the audio processing strategy includes a downlink audio processing strategy, and the downlink audio processing strategy is used to process the call audio data from the second electronic device.

[0032] In combination with the second aspect, in a possible implementation, the downlink audio processing strategy includes one or more of downlink noise reduction strength, downlink audio gain, and downlink noise reduction scenario.

[0033] In combination with the second aspect, in a possible implementation, the audio processing strategy also includes an uplink audio processing strategy.

[0034] In combination with the second aspect, in a possible implementation, the uplink audio processing strategy includes one or more of uplink noise reduction strength, uplink audio gain, and uplink noise reduction scenario.

[0035] In combination with the second aspect, in a possible implementation, the call audio data also includes call audio data from the second electronic device.

[0036] It should be noted that the technical solution of the second aspect of the present application may correspond to or be similar to the technical solution of the first aspect, and the relevant beneficial effects can refer to the beneficial effects of the first aspect.

[0037] The third aspect discloses an audio processing method, which can be applied to a first electronic device, or to a module (e.g., a processor) in the first electronic device, or to a logic module or software that can implement all or part of the functions of the first electronic device. The following description is given by taking the application to the first electronic device as an example. The communication method may include: during a call between the first electronic device and the second electronic device, performing semantic analysis on the call audio data to obtain a target semantic analysis result; the call audio data includes call audio data from the second electronic device; adjusting the audio processing strategy based on the target semantic analysis result; wherein the audio processing strategy includes a downlink audio processing strategy, and the downlink audio processing strategy is used to process the call audio data from the second electronic device.

[0038] In combination with the third aspect, in a possible implementation, the downlink audio processing strategy includes one or more of downlink noise reduction strength, downlink audio gain, and downlink noise reduction scenario.

[0039] In combination with the third aspect, in a possible implementation, the audio processing strategy also includes an uplink audio processing strategy.

[0040] In combination with the third aspect, in a possible implementation, the uplink audio processing strategy includes one or more of uplink noise reduction strength, uplink audio gain, and uplink noise reduction scenario.

[0041] In combination with the third aspect, in a possible implementation, the call audio data also includes call audio data collected by the first electronic device.

[0042] It should be noted that the technical solution of the third aspect of the present application may correspond to or be similar to the technical solution of the first aspect, and the relevant beneficial effects can refer to the beneficial effects of the first aspect.

[0043] The fourth aspect discloses an audio processing method, which can be applied to a first electronic device, or to a module (e.g., a processor) in the first electronic device, or to a logic module or software that can implement all or part of the functions of the first electronic device. The following description is given by taking the application to the first electronic device as an example. The communication method may include: during a call between the first electronic device and the second electronic device, performing semantic analysis on the call audio data to obtain a target semantic analysis result; the call audio data includes call audio data collected by the first electronic device; adjusting the audio processing strategy based on the target semantic analysis result; the audio processing strategy includes an uplink audio processing strategy, and the uplink audio processing strategy is used to process the call audio data collected by the first electronic device.

[0044] In combination with the fourth aspect, in a possible implementation, the uplink audio processing strategy includes one or more of uplink noise reduction strength, uplink audio gain, and uplink noise reduction scenario.

[0045] In combination with the fourth aspect, in a possible implementation, the audio processing strategy also includes a downlink audio processing strategy.

[0046] In combination with the fourth aspect, in a possible implementation, the downlink audio processing strategy includes one or more of downlink noise reduction strength, downlink audio gain, and downlink noise reduction scenario.

[0047] In combination with the fourth aspect, in a possible implementation, the call audio data also includes call audio data from the second electronic device.

[0048] It should be noted that the technical solution of the fourth aspect of the present application may correspond to or be similar to the technical solution of the first aspect, and the relevant beneficial effects can refer to the beneficial effects of the first aspect.

[0049] The fifth aspect discloses an electronic device, which may be a first electronic device, and includes a processor and a communication interface; the communication interface is used to receive and send data; the processor calls a computer program or computer instruction stored in a memory to implement a method as provided in the first aspect and any possible implementation of the first aspect, or implements a method as provided in the second aspect and any possible implementation of the second aspect, or implements a method as provided in the third aspect and any possible implementation of the third aspect, or implements a method as provided in the fourth aspect and any possible implementation of the fourth aspect.

[0050] As a possible implementation, the communication device disclosed in the fifth aspect may include one or more processors.

[0051] Optionally, the communication device disclosed in the fifth aspect above also includes one or more memories.

[0052] The sixth aspect discloses a computer-readable storage medium having a computer program or computer instructions stored thereon. When the computer program or computer instructions are executed, the method provided in the first aspect and any possible implementation of the first aspect is implemented, or the method provided in the second aspect and any possible implementation of the second aspect is implemented, or the method provided in the third aspect and any possible implementation of the third aspect is implemented, or the method provided in the fourth aspect and any possible implementation of the fourth aspect is implemented.

[0053] The seventh aspect discloses a chip, comprising a processor, for executing a program stored in a memory. When the program is executed, the chip executes the method provided in the first aspect and any possible implementation of the first aspect, or executes the method provided in the second aspect and any possible implementation of the second aspect, or executes the method provided in the third aspect and any possible implementation of the third aspect, or executes the method provided in the fourth aspect and any possible implementation of the fourth aspect.

[0054] As a possible implementation, the memory is located outside the chip.

[0055] The eighth aspect discloses a computer program product, which includes a computer program code. When the computer program code is run, the method provided in the first aspect and any possible implementation of the first aspect is executed, or the method provided in the second aspect and any possible implementation of the second aspect is executed, or the method provided in the third aspect and any possible implementation of the third aspect is executed, or the method provided in the fourth aspect and any possible implementation of the fourth aspect is executed.

[0056] It should be understood that the implementation and beneficial effects of the above-mentioned multiple aspects or any possible implementation methods of the present application can be referenced to each other. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0058] Figure 1 It is a structural diagram of a communication system provided in an embodiment of the present application;

[0059] Figure 2 is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of the present application;

[0060] Figure 3 is a schematic diagram of a software structure of an electronic device 100 provided in an embodiment of the present application;

[0061] Figure 4A to Figure 4H It is a schematic diagram of a scenario in which some electronic devices 100 provide a smart call mode and related audio processing configurations provided by an embodiment of the present application;

[0062] Figure 5A to Figure 5DIt is a schematic diagram of a scenario in which some electronic devices 100 intelligently adjust audio processing strategies provided by an embodiment of the present application;

[0063] Figure 6A to Figure 6C It is a schematic diagram of a scenario in which some electronic devices 100 provided in an embodiment of the present application provide noise reduction scene selection and intelligently adjust the audio processing strategy based on the positioning result;

[0064] Figure 7A to Figure 7F It is a schematic diagram of a scenario in which some electronic devices 100 provided in an embodiment of the present application provide a smart call mode, and uplink and downlink related audio processing configurations;

[0065] Figure 8A to Figure 8E It is a schematic diagram of a scenario in which some electronic devices 200 request the electronic device 100 to turn on the smart call mode and adjust the uplink audio processing strategy provided by an embodiment of the present application;

[0066] Fig. 9 It is a flowchart of an audio processing method provided in an embodiment of the present application;

[0067] Fig.10 It is a flowchart of another audio processing method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0068] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0069] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0070] The term "user interface (UI)" in the following embodiments of the present application refers to the medium interface for interaction and information exchange between an application (APP) or an operating system (OS) and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that can be recognized by the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0071] Audio processing technologies such as intelligent noise reduction and intelligent compensation have been widely used in various scenarios in daily life, such as calls, recordings, live broadcasts, etc. For example, during calls, live broadcasts, etc., the local electronic device may be in a noisy environment. At this time, the collected external audio may include environmental noise (such as traffic noise, keyboard tapping, noisy voices, etc.) in addition to the target voice. Therefore, the local electronic device can perform noise reduction processing on the collected external audio in real time to reduce / eliminate environmental noise, and then send the noise-reduced audio to the other electronic device, so that the user at the other end can clearly hear the target voice. In addition, after receiving the audio, the other electronic device can also perform noise reduction processing, compensation processing (such as signal frequency band loss compensation, packet loss signal compensation, etc.) to obtain better call quality, etc.

[0072] This application provides an audio processing method. Among them, in an audio scenario such as a voice call or a video call, the first electronic device can perform semantic analysis on the received audio data from the second electronic device and dynamically adjust the audio processing strategy based on the semantic analysis result. For example, if the semantic analysis result of a certain segment of audio data (such as "It's so noisy on your side", "The noise on your side is so loud", etc.) from the second electronic device by the first electronic device is "The current noise is relatively large", then the first electronic device can adjust the current noise reduction intensity, such as changing the noise reduction intensity from "weak" to "medium". After that, if the semantic analysis result of a certain segment of audio data (such as "It's still so noisy on your side", "The noise on your side is still so loud", etc.) from the second electronic device by the first electronic device is still "The current noise is relatively large", then the first electronic device can continue to adjust the current noise reduction intensity, such as changing the noise reduction intensity from "medium" to "strong". Another example is that if the semantic analysis result of a certain segment of audio data (such as "Your voice is so small", "I can't hear what you're saying", etc.) from the second electronic device by the first electronic device is "The current voice is relatively small", then the first electronic device can increase the current audio gain, such as changing the audio gain from x1 decibels (dB) to x2 dB, where x1 < x2. Another example is that if the semantic analysis result of a certain segment of audio data (such as "Your voice is so loud", "You can speak more quietly", etc.) from the second electronic device by the first electronic device is "The current voice is relatively large", then the first electronic device can decrease the current audio gain, such as changing the audio gain from x2 dB to x1 dB. It can be seen that in the above method, for audio scenarios such as voice calls and video calls, the first electronic device can dynamically adjust the audio processing strategy (such as noise reduction intensity, audio gain, etc.) based on the semantic analysis result of the audio data, which can improve the audio quality in scenarios such as calls and live broadcasts, thereby improving the user experience.

[0073] In another embodiment, in an audio scenario such as a voice call or a video call between a first electronic device and a second electronic device, the second electronic device can analyze the audio data from the first electronic device in real time, and then return the analysis result to the first electronic device, and the first electronic device can dynamically adjust the audio processing strategy based on the analysis result. Exemplarily, the second electronic device can analyze the audio data from the first electronic device based on the voice quality detection algorithm, and can obtain a real-time voice quality score. If the voice quality score is greater than the quality score threshold (such as 6, the voice quality score is 1 to 10), the first electronic device can not process it. If the voice quality score is less than or equal to the quality score threshold, the first electronic device can determine the reason for the voice quality score being lower than the quality score threshold based on the corresponding audio data (such as too low audio amplitude, more noise in the audio data, etc.), and then return the reason to the first electronic device, and the first electronic device can dynamically adjust the audio processing strategy based on the reason. For example, if the reason for the voice quality score being lower than the quality score threshold is that the audio data includes more noise, that is, it indicates that the noise on the first electronic device side is larger, then the first electronic device can adjust the current noise reduction strength, such as adjusting the noise reduction strength from "weak" to "medium".

[0074] In another embodiment, since the noise sources in different scenarios (such as subway stations, offices, construction sites, etc.) may be different, multiple audio processing scenarios can be pre-defined, and different noise reduction models can be configured for different audio processing scenarios. In audio scenarios such as voice calls and video calls between the first electronic device and the second electronic device, the first electronic device can determine the current audio processing scenario based on the positioning result, and then automatically help the user select the noise reduction model corresponding to the audio processing scenario for processing, which can ensure better audio quality. In addition, the first electronic device can also provide a corresponding configuration interface to facilitate the user to manually select the corresponding audio processing scenario. For example, the first electronic device can display a corresponding audio processing configuration interface in response to user input, and the audio processing configuration interface includes multiple audio processing scenario options, and the user can select the corresponding audio processing scenario option by touching or clicking. Afterwards, the first electronic device can use the noise reduction model corresponding to the audio processing scenario option selected by the user for processing, which can ensure better audio quality.

[0075] Please refer to Figure 1 , Figure 1 A structural diagram of a communication system provided in an embodiment of the present application is exemplified.

[0076] The communication system may include an electronic device 100 and an electronic device 200. The electronic device 100 and the electronic device 200 may perform an audio call, such as a voice call, a video call, etc. The electronic device 100 may be a first electronic device, and the electronic device 200 may be a second electronic device.

[0077] The electronic device 100 and the electronic device 200 may be equipped with Or portable electronic devices with other operating systems, such as mobile phones, tablet computers, wearable devices (such as smart watches, smart bracelets, etc.), etc., can also be augmented reality (AR) devices, virtual reality (VR) devices, laptop computers with touch-sensitive surfaces or touch panels, desktop computers with touch-sensitive surfaces or touch panels, and other non-portable electronic devices. Electronic device 100 and electronic device 200 can also be chips or processing systems in the above-mentioned devices. The embodiments of the present application do not limit the types of electronic devices 100 and electronic devices 200.

[0078] Among them, in audio scenarios such as voice calls and video calls between the electronic device 100 and the electronic device 200, the electronic device 100 can perform semantic analysis on the audio data from the electronic device 200, and dynamically adjust the audio processing strategy based on the semantic analysis results. The electronic device 100 can also dynamically adjust the audio processing strategy based on the analysis results returned by the electronic device 200. The electronic device 100 can also determine the current audio processing scenario based on the positioning results, and then automatically adopt the noise reduction model corresponding to the audio processing scenario. Similarly, the electronic device 200 can perform semantic analysis on the audio data from the electronic device 100, and dynamically adjust the audio processing strategy based on the semantic analysis results. The electronic device 200 can also dynamically adjust the audio processing strategy based on the analysis results returned by the electronic device 100. The electronic device 200 can also determine the current audio processing scenario based on the positioning results, and then automatically adopt the noise reduction model corresponding to the audio processing scenario.

[0079] It should be noted that the system architecture and business scenarios (or application scenarios) described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application.

[0080] The structure of the electronic device 100 involved in this application is introduced below.

[0081] Figure 2 The hardware structure diagram of the electronic device 100 provided in the embodiment of the present application is exemplified.

[0082] like Figure 2As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0083] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0084] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0085] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0086] The processor 110 may also be provided with a memory for storing instructions and data. In some examples, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0087] The USB interface 130 is an interface that complies with USB standard specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 may be used to connect a charger to charge the electronic device 100, or may be used to transmit data between the electronic device 100 and a peripheral device. It may also be used to connect headphones to play audio through the headphones.

[0088] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 140 charges the battery 142, it can also power the electronic device through the power management module 141.

[0089] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0090] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0091] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0092] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1.

[0093] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0094] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0095] The display screen 194 is used to display images, videos, etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.

[0096] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0097] The ISP is used to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, and the light signal is converted into an electrical signal. The camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye.

[0098] The camera 193 is used to capture still images or videos. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0099] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0100] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0101] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0102] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0103] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0104] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some examples, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 170B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 170C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 170D is used to connect wired headphones.

[0105] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.

[0106] The buttons 190 include a power button, a volume button, etc. The motor 191 can generate a vibration prompt. The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, messages, missed calls, notifications, etc.

[0107] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or removing it from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some examples, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0108] The electronic device 100 may be equipped with Hongmeng system ( The electronic device 100 may be an electronic device running an operating system such as Windows XP or other operating systems, such as a mobile phone, a tablet computer, a laptop computer, a smart watch, a smart bracelet, etc. The specific type of the electronic device 100 is not limited in the present embodiment.

[0109] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. Taking the system as an example, the software structure of the electronic device 100 is exemplified.

[0110] Figure 3 It is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0111] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. The system is divided into four layers, from top to bottom: application layer, application framework layer, Android runtime and system library, and kernel layer.

[0112] The application layer can include a series of application packages.

[0113] like Figure 3 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, short message, etc.

[0114] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0115] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, an activity manager, and the like.

[0116] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0117] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0118] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0119] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0120] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0121] The notification manager enables applications to display notification information in the status bar (such as the pull-down notification bar). It can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0122] The activity manager is responsible for managing activities, starting, switching, and scheduling components in the system, as well as managing and scheduling applications. The activity manager can be called by upper-level applications to open corresponding activities.

[0123] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0124] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0125] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0126] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0127] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0128] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0129] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0130] A 2D graphics engine is a drawing engine for 2D drawings.

[0131] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0132] The hardware structure and software structure of the electronic device 200 may also be as follows Figure 2 and Figure 3 As shown, the embodiment of the present application does not specifically limit the hardware structure and software structure of the electronic device 200.

[0133] The following describes the usage scenarios involved in the embodiments of the present application in conjunction with the user interface of the electronic device 100.

[0134] Figure 4A to Figure 4H The diagram exemplarily shows a scenario in which the electronic device 100 provides a smart call mode and related audio processing configurations.

[0135] like Figure 4A As shown, the electronic device 100 can display a user interface 410. The user interface 410 displays a page with application icons placed on it. The page may include multiple application icons (e.g., a clock application icon, a calendar application icon, a gallery application icon, a memo application icon, a file management application icon, etc.). A page indicator may also be displayed below the multiple application icons to indicate the positional relationship between the currently displayed page and other pages. There are multiple tray icons (e.g., a camera application icon, an address book application icon, a phone application icon 411, and an information application icon) below the page indicator. The tray icon remains displayed when the page is switched. It should be understood that the embodiment of the present application does not limit the content displayed on the user interface 410. In response to a user operation acting on the above-mentioned application icon or tray icon, such as a touch operation, the electronic device 100 can open an application corresponding to the application icon or the tray icon.

[0136] For example, in response to a user operation on the phone application icon 411, the electronic device 100 may open the phone application and display a Figure 4BThe user interface 420 shown in FIG. 4 may include a dialing keyboard, a number display area, a dialing control (such as a dialing control 421), etc. The user may input the number to be dialed through the dialing keyboard, and then, in response to the user operation on the dialing control 421, such as a touch operation, the electronic device 100 may dial the corresponding number, and after the dialing is connected, a screen such as FIG. Figure 4C User interface 430 is shown.

[0137] like Figure 4C As shown, in response to a user operation of sliding downward on the top status bar of the user interface 430, the electronic device 100 may display the following Figure 4D The user interface 440 shown. Exemplarily, the user interface 440 may be a notification information interface. It should be understood that the notification information interface may also be opened through other user interfaces, and the embodiments of the present application are not limited thereto. The user interface 440 may include a call status card 441 and a smart call mode card 445. Among them, the call status card 441 may be used to display call-related information, such as call time, call number, etc. The call status card 441 may also include a mute control 442, a hang-up control 443, and a hands-free control 444. In response to a user operation on the mute control 442, the electronic device 100 may turn off or turn on the mute function. When the mute function is turned on, the other end of the call can hear the sound of the local end. When the mute function is turned off, the other end of the call cannot hear the sound of the local end. In response to a user operation on the hang-up control 443, the electronic device 100 may hang up the current call. In response to user operations on the hands-free control 444, the electronic device 100 can turn off or on the hands-free function. When the hands-free function is turned on, the voice of the other party can be played through the speaker at a louder volume. When the hands-free function is turned off, the voice of the other party can be played through the earpiece at a lower volume.

[0138] The smart call mode card 445 may include information related to the smart call mode, such as whether the smart call mode is turned on (such as currently turned off), prompt information related to the smart adjustment of the audio processing strategy, and a control to turn on or off the smart call mode. Figure 4D As shown, in response to a user operation on the expansion control 446, such as a touch operation, the electronic device 100 may display Figure 4E User interface 440 is shown. It is understandable that due to the limited screen size of the electronic device 100, usually, in the notification information interface, some cards with more content may only present part of the content, and the electronic device 100 may respond to the user operation of the user acting on the display control corresponding to a card to expand the complete content of the card. In other words, the user can view the complete content of the card by touching the user operation of the expansion control.

[0139] like Figure 4EAs shown, the complete content of the smart call mode card 445 can be displayed in the user interface 440, and the smart call mode card 445 can display an audio processing configuration control 447 and a control 448 for turning on the smart call mode, as well as a hide control 449. The audio processing configuration control 447 can be used to open the audio processing configuration interface, and can be used to configure relevant audio processing parameters, such as noise reduction intensity, audio gain, etc. The control 448 for turning on the smart call mode can be used to turn on the smart call mode. The hide control 449 can be used to hide the complete content of the smart call mode card 445, and only present part of the content, which is opposite to the expand control.

[0140] like Figure 4E As shown, in response to the user operation acting on the smart call mode start control 448, the electronic device 100 can start the smart call mode and can display the following Figure 4F The user interface 440 is shown. Figure 4F In the user interface 440 shown, a prompt message "Enabled, optimizing call quality" is displayed, indicating that the smart call mode has been enabled. Figure 4F In the user interface 440 shown, a smart call mode off control 450 may also be displayed. The smart call mode off control 450 may be used to turn off the smart call mode.

[0141] like Figure 4F As shown, in response to a user operation on the audio processing configuration control 447, such as a touch operation, the electronic device 100 may display Figure 4G The user interface 460 shown is an audio processing configuration interface. In the user interface 460, a configuration area for noise reduction intensity and a configuration area for audio gain may be displayed. The configuration area for noise reduction intensity may be used to adjust the noise reduction intensity. For example, the noise reduction intensity may include three levels, namely weak, medium and strong, and the currently selected noise reduction intensity is weak. The noise reduction intensity here may be the noise reduction intensity of the electronic device 100 for noise reduction processing of the collected external audio. The stronger the noise reduction intensity, the stronger the ability to reduce / eliminate environmental noise. In some embodiments, each time the electronic device makes a call, if the user does not change the audio processing configuration, the default noise reduction intensity may be weak. The audio gain may include multiple options, such as 0dB, 3dB, 5dB, 10dB, 12dB, 15dB, etc., and the currently selected audio gain is 5dB. The audio gain here may be the audio gain of the electronic device 100 for audio processing of the collected external audio. The stronger the audio gain, the louder the sound that the other end can hear.

[0142] The return control 461 can be used to trigger the electronic device 100 to return to the previous user interface, that is, to display Figure 4F User interface 440 is shown.

[0143] like Figure 4G As shown, in response to a user operation, such as a touch operation, on the optional control 462 corresponding to the noise reduction intensity, the electronic device 100 may display the following Figure 4H The user interface 460 shown. In the user interface 460, the selection control 462 corresponding to the noise reduction strength is in a selected state, indicating that the current electronic device 100 switches the noise reduction strength to medium. It should be understood that in the embodiment of the present application, each noise reduction strength can correspond to a noise reduction model, and different noise reduction strengths correspond to different noise reduction models. When switching the noise reduction strength, the electronic device 100 can switch the noise reduction model used accordingly. Among them, for the same noise reduction model (such as a neural network model with the same structure), different noise reduction parameters can be understood as different noise reduction models in the embodiment of the present application, that is, if any one of the noise reduction model and the model parameter is different, it can be regarded as a different noise reduction model. Exemplarily, the noise reduction model corresponding to the weak noise reduction strength can be noise reduction model 1 (model 1 + model parameter 1), the noise reduction model corresponding to the medium noise reduction strength can be noise reduction model 2 (model 1 + model parameter 2), and the noise reduction model corresponding to the strong noise reduction strength can be noise reduction model 3 (model 1 + model parameter 3). Noise reduction model 1, noise reduction model 2 and noise reduction model 3 can use a unified model 1, but the model parameters are different. As another example, the denoising model corresponding to weak denoising intensity may be denoising model 1 (model 1 + model parameter 1), the denoising model corresponding to medium denoising intensity may be denoising model 2 (model 2 + model parameter 2), and the denoising model corresponding to strong denoising intensity may be denoising model 3 (model 3 + model parameter 3). Noise reduction model 1, denoising model 2 and denoising model 3 may use different models, and the model parameters may be different.

[0144] It should be understood that the embodiments of the present application do not limit the level division of noise reduction intensity, and can also be divided into more or fewer noise reduction levels. Similarly, the embodiments of the present application do not limit the options of audio gain, and can also include more or fewer audio gain options.

[0145] It can be seen that based on the above audio processing configuration interface, users can select different noise reduction intensities and audio gains according to actual needs to improve the call quality of the other end user. For example, if during a call, the other end user feedbacks that the noise is too loud, if the currently selected noise reduction level is weak, then a higher level of noise reduction intensity can be selected, such as medium or strong. For another example, if during a call, the other end user feedbacks that the sound is too quiet, if the currently selected audio gain is 5dB, then a larger audio gain can be selected, such as 10dB or 15dB.

[0146] It is understandable that, in some cases, the noise reduction strength may also be the noise reduction strength of the electronic device 100 for the audio received from other electronic devices (such as the electronic device 200). The stronger the noise reduction strength, the stronger the ability to reduce / eliminate the noise in the received audio. Similarly, the audio gain may also be the audio gain of the electronic device 100 for the audio received from other electronic devices (such as the electronic device 200). The stronger the audio gain, the louder the sound that can be heard at the local end.

[0147] The above briefly introduces the scenario in which the user manually adjusts the audio processing strategy, but in the embodiment of the present application, in audio scenarios such as voice calls and video calls, the electronic device 100 can also automatically adjust the audio processing strategy, which can improve the adjustment efficiency of the audio processing strategy and improve the user experience. For example, the electronic device 100 can perform semantic analysis on the received audio of the other end, and then intelligently adjust the audio processing strategy based on the result of the semantic analysis. For another example, the electronic device 100 can receive audio quality problems fed back by the electronic device of the other end (such as the electronic device 200), and then automatically adjust the audio processing strategy based on the feedback of the other end.

[0148] Figure 5A to Figure 5D The schematic diagram exemplarily shows a scenario in which the electronic device 100 provides an intelligent call mode and intelligently adjusts the audio processing strategy.

[0149] After the smart call mode is turned on, the electronic device 100 can perform real-time semantic analysis on the audio received from the other end of the call. If the semantic analysis result of a certain section of audio data (such as "It's so noisy over there", "The noise over there is so loud", etc.) is "The current noise is relatively loud", then the electronic device 100 can adjust the current noise reduction intensity, such as adjusting the noise reduction intensity from "weak" to "medium". If the semantic analysis result of a certain section of audio data (such as "Your voice is so soft", "I can't hear what you are saying", etc.) is "The current voice is relatively soft", then the electronic device 100 can increase the current audio gain, such as adjusting the audio gain from 5dB to 10dB. In the embodiment of the present application, semantic analysis can also be referred to as semantic understanding.

[0150] like Figure 5A As shown, assuming that at the 10th second (s) of the call, the electronic device 100 determines based on the semantic analysis result that the current local noise is relatively loud, then the electronic device 100 can automatically adjust the noise reduction intensity from "weak" to "medium". In addition, the smart call mode card 445 may include relevant prompt information, such as the display area 451 in the smart call mode card 445 may display relevant prompt information, so as to inform the user that the noise reduction intensity has been automatically adjusted.

[0151] like Figure 5BAs shown, assuming that at the 20th second of a call, the electronic device 100's semantic analysis result of the audio received from the other end of the call (such as "your voice is so soft", "I can't hear what you are saying", etc.) is "the current voice is relatively soft", then the electronic device 100 can automatically adjust the audio gain from 3dB to 10dB, and relevant prompt information can be displayed in the display area 452 in the smart call mode card 445 to inform the user that the audio gain has been automatically adjusted.

[0152] The following describes a method for automatically adjusting the audio processing strategy based on feedback from the peer electronic device.

[0153] After the smart call mode is turned on, when the electronic device 100 receives feedback from the other end electronic device (such as the electronic device 200) about the audio quality problem, the electronic device 100 can adjust the current audio processing strategy based on the audio quality problem fed back by the other end. For example, if the other end feeds back that "the current noise is relatively loud", the electronic device 100 can adjust the current noise reduction strength, such as adjusting the noise reduction strength from "weak" to "medium". If the other end feeds back that "the current sound is relatively quiet", the electronic device 100 can increase the current audio gain, such as adjusting the audio gain from 5dB to 10dB.

[0154] like Figure 5C As shown, assuming that in the 10th second of a call, the electronic device 100 receives feedback from the other electronic device about an audio quality problem ("the current noise is relatively loud"), then the electronic device 100 can automatically adjust the noise reduction intensity from "weak" to "medium", and relevant prompt information can be displayed in the display area 453 in the smart call mode card 445 to inform the user that the noise reduction intensity has been automatically adjusted.

[0155] like Figure 5D As shown, assuming that at the 20th second of a call, the electronic device 100 receives feedback from the other end's electronic device regarding an audio quality problem ("the current sound is relatively low"), then the electronic device 100 can automatically adjust the audio gain from 3dB to 10dB, and relevant prompt information can be displayed in the display area 454 in the smart call mode card 445 to inform the user that the audio gain has been automatically adjusted.

[0156] Figure 6A to Figure 6C The electronic device 100 provides noise reduction scene selection and intelligently adjusts the audio processing strategy based on the positioning result.

[0157] It is understandable that in daily life, users often need to use the call function in different scenarios, and the noise sources in different scenarios may be different. Therefore, if the electronic device 100 uses the same noise reduction model for all scenarios, it may result in poor noise reduction effect in some scenarios. In the embodiment of the present application, in order to provide users with a better call experience, a noise reduction model can be configured for a variety of different scenarios (such as offices, shopping malls, railway stations, subway stations, etc.) to achieve better noise reduction effect.

[0158] like Fig. 6A As shown, in the user interface 460, a configuration area for noise reduction scenes can also be displayed. The configuration area for noise reduction scenes can be used to adjust the noise reduction scenes. Exemplarily, the noise reduction scenes can include general, office, shopping mall, subway station, railway station, construction site, and so on. Normally, the "general" noise reduction scene can be selected. The noise reduction model corresponding to the "general" noise reduction scene can meet the usage requirements of most scenes, but the noise reduction effect may be weaker than the dedicated noise reduction model in a specific scene. It can be understood that the noise reduction scenes here are only exemplary. In other embodiments of the present application, more or fewer noise reduction scenes may be included.

[0159] Assuming that the current user is in a shopping mall, in order to obtain a better noise reduction effect, the user can switch the noise reduction scene to the shopping mall. Fig. 6A As shown, in response to a user operation, such as a touch operation, acting on the selection control 463 corresponding to the mall, the electronic device 100 may display the following Figure 6B The user interface 460 shown. In the user interface 460, the shopping mall corresponding selection control 463 is in a selected state, indicating that the current electronic device 100 switches the noise reduction scene to the shopping mall, and the noise reduction model can also be switched from the noise reduction model corresponding to the general scene to the noise reduction model corresponding to the shopping mall scene.

[0160] In order to improve the user experience, the electronic device 100 can also adjust the noise reduction scene based on the real-time positioning result during the call, that is, switch the noise reduction model of the corresponding scene based on the real-time positioning result.

[0161] like Figure 6C As shown, assuming that at the 20th second of the call, the electronic device 100 determines that it is currently located in a shopping mall based on the positioning result, then the noise reduction scene can be automatically adjusted to the shopping mall, and the noise reduction model corresponding to the shopping mall scene can be switched to be used. In addition, the display area 455 in the smart call mode card 445 can display relevant prompt information to inform the user that the noise reduction scene has been automatically adjusted.

[0162] Figure 7A to Figure 7F The schematic diagram exemplarily shows a scenario in which the electronic device 100 provides a smart call mode and uplink and uplink-related audio processing configurations.

[0163] It can be understood that for audio scenarios such as voice calls and video calls, they are generally bidirectional, that is, audio from the other end electronic device can be received, and external audio collected by the local end can also be sent to the other end. The local electronic device sending the external audio collected by the local end to the other end electronic device can be called uplink, and the local electronic device receiving the audio sent by the other end electronic device can be called downlink. Therefore, for the audio processing function (such as noise reduction function) of the electronic device 100, it can be divided into uplink audio processing and downlink audio processing. The uplink audio processing can be the processing of the external audio collected by the electronic device 100, and the downlink audio processing can be the processing of the audio received from the other end electronic device (such as the electronic device 200). The uplink processing is mainly to reduce / eliminate the noise in the external audio collected by the local end, and to adjust the audio amplitude so that the user at the other end can hear the target voice more clearly. The downlink processing is mainly to reduce / eliminate the noise in the audio received from the other end electronic device, and to adjust the audio amplitude so that the user at the local end can hear the target voice more clearly.

[0164] Usually, the two parties in a call are in different environments (such as user A is in a quiet room, and user B is in a crowded shopping mall). Therefore, the electronic device 100 can provide functions for uplink audio processing and downlink audio processing respectively.

[0165] like Fig. 7A As shown, in response to the user operation acting on the smart call mode start control 448, the electronic device 100 can start the smart call mode and can display the following Figure 7B The user interface 440 is shown. Figure 7B In the user interface 440 shown, a prompt message "Enabled (uplink + downlink), optimizing call quality" is displayed in the display area 471, indicating that the smart call mode has been enabled, and both the uplink audio processing and the downlink audio processing functions are enabled. When the uplink audio processing function is enabled, the mute control 442 may be lit. When the downlink audio processing function is enabled, the hands-free control 444 may be lit.

[0166] like Figure 7B As shown, in response to a user operation on the hands-free control 444, such as double-clicking, the electronic device 100 may display Figure 7C The user interface 440 is shown. Figure 7C In the user interface 440 shown, the hands-free control 444 is in a non-lit state, indicating that the electronic device 100 has turned off the downlink audio processing function. In addition, the prompt information also only shows that only the uplink audio processing function is turned on.

[0167] like Figure 7C As shown, in response to a user operation on the mute control 442, such as double-clicking, the electronic device 100 may display Fig.7D The user interface 440 is shown. Fig.7D In the user interface 440 shown, the mute control 442 is in a non-lit state, indicating that the electronic device 100 has turned off the uplink audio processing function. At this time, since both the uplink audio processing function and the downlink audio processing function are turned off, the smart call mode is in a turned off state.

[0168] It is understandable that the electronic device 100 can re-enable the uplink audio processing function by performing a user operation on the mute control 442 again, such as double-clicking. Similarly, the electronic device 100 can re-enable the downlink audio processing function by performing a user operation on the hands-free control 444 again, such as double-clicking.

[0169] like Fig.7D As shown, in response to a user operation on the audio processing configuration control 447, such as a touch operation, the electronic device 100 may display Fig. 7E The user interface 460 shown. In the user interface 460, an uplink audio processing configuration area 472 and a downlink audio processing configuration area 473 may be displayed. Both the uplink audio processing configuration area 472 and the downlink audio processing configuration area 473 may include a configuration area for noise reduction intensity, a configuration area for audio gain, and a configuration area for noise reduction scenes.

[0170] Users can use Fig. 7E The user interface 460 shown configures the audio processing strategy for the uplink audio and the downlink audio. For example, assuming that the shopping mall where the electronic device 100 is located has a large noise environment, the user can set the uplink noise reduction scene to the shopping mall and set the noise reduction intensity to medium. Figure 7F shown.

[0171] It is understandable that, in addition to the user manually setting the uplink and downlink audio processing strategies, during the call of the electronic device 100, the electronic device 100 can also automatically adjust the uplink and downlink noise reduction strength, audio gain and noise reduction scene based on semantic analysis or feedback from the other end electronic device. The electronic device 100 can also adjust the uplink noise reduction scene based on the positioning result, which will not be described in detail here.

[0172] Figure 8A to Figure 8E The schematic diagram exemplarily shows a scenario in which the electronic device 200 requests the electronic device 100 to turn on the smart call mode and adjust the uplink audio processing strategy.

[0173] See also Fig. 8A ,exist Fig. 8AIn the user interface 470 shown, a call status card and a smart call mode card may be displayed. Among them, the call status card can be used to display call-related information, such as call time, call number, etc. The smart call mode card may display an audio processing configuration control (this end), a control for turning on the smart call mode, a peer audio processing configuration control 471, and a hidden control. The audio processing configuration control (this end) can be used to open the local audio processing configuration interface, and the peer audio processing configuration control 471 can be used to open the peer audio processing configuration interface. The control for turning on the smart call mode can be used to turn on the smart call mode. The user interface 470 may be a notification information interface of the electronic device 200.

[0174] In response to a user operation, such as a touch operation, on the peer audio processing configuration control 471, the electronic device 200 may display the following information: Figure 8B User interface 480 is shown. In user interface 480, two areas may be displayed, area 481 is an area for requesting the other party to turn on the smart call mode, and area 482 is a configuration area for requesting the other party to adjust the noise reduction intensity, audio gain, and noise reduction scene. In area 481, a send request control 4811 may be included, and the send request control 4811 may be used to trigger the electronic device 200 to send a request message to the call partner for requesting to turn on the smart call mode.

[0175] In response to a user operation (such as a touch operation) acting on the send request control 4811, the electronic device 200 may send a request message (a first request message) to the electronic device 100, and the request message is used to request to enable the smart call mode. Accordingly, the electronic device 100 may receive a request message from the electronic device 200, and then the electronic device 100 may pop up a prompt message box based on the request message. The prompt message box may display prompt information, and the prompt information is used to prompt the opposite user to request to enable the smart call mode. Exemplarily, the prompt information may be "The opposite user requests to enable the smart call mode." For example, assuming that the electronic device 100 currently displays a call interface, after the electronic device 100 receives the request message from the electronic device 200, a prompt message box may pop up on the call interface, such as Figure 8C As shown, the electronic device 100 may display a user interface 430, in which a prompt information box 431 may be displayed. The prompt information box 431 displays a prompt information "the other party requests to turn on the smart call mode", as well as a corresponding confirmation control 4311 and a rejection control 4312. Among them, the confirmation control 4311 can be used to confirm / accept the request sent by the other party, and the rejection control 4312 can be used to reject the request sent by the other party.

[0176] Exemplarily, in response to a user operation (such as a touch operation) acting on the determination control 4311, the electronic device 100 can turn on the smart call mode. Figure 4F In response to a user operation (such as a touch operation) acting on the rejection control 4312, the electronic device 100 may not process it, or the electronic device 100 may send an indication message to the electronic device 200, where the indication message is used to indicate the rejection of the request of the electronic device 200, that is, to indicate the rejection of turning on the smart call mode.

[0177] like Fig.8D As shown, in area 482, the user can select noise reduction intensity, audio gain, and noise reduction scene, etc., and the user can send a request to the electronic device 100 through the electronic device 200 to request the electronic device 100 to adjust the uplink audio processing strategy. Exemplarily, the user can touch or click the selection control 463 corresponding to the shopping mall to select the noise reduction scene as the shopping mall. Afterwards, the user can click or touch the control 4822. In response to the operation, the electronic device 200 can send a corresponding request message to the electronic device 100, and the request message is used to request adjustment of the uplink audio processing strategy. The request message can carry the audio processing parameters to be adjusted and the corresponding parameter values, such as {noise reduction scene: shopping mall}. Accordingly, the electronic device 100 can receive a request message from the electronic device 200, and then the electronic device 100 can pop up a prompt information box based on the request message, and the prompt information box can display prompt information, which can be used to prompt the opposite end user to request adjustment of the uplink audio processing strategy. For example, assuming that the electronic device 100 currently displays a call interface, after the electronic device 100 receives a request message from the electronic device 200, a prompt information box may pop up on the call interface, such as Fig. 8E As shown, the electronic device 100 may display a user interface 430, in which a prompt information box 432 may be displayed. The prompt information box 432 displays a prompt message "The peer end requests to switch the noise reduction scene to the shopping mall", as well as a corresponding confirmation control 4321 and a rejection control 4322. Among them, the confirmation control 4311 can be used to confirm / accept the request sent by the peer end, and the rejection control 4312 can be used to reject the request sent by the peer end.

[0178] Exemplarily, in response to a user operation (such as a touch operation) acting on the determination control 4321, the electronic device 100 may switch the uplink noise reduction scene to a shopping mall. In response to a user operation (such as a touch operation) acting on the rejection control 4322, the electronic device 100 may not process it, or the electronic device 100 may send an indication message to the electronic device 200, the indication message being used to indicate the rejection of the request of the electronic device 200, that is, indicating the rejection of switching the uplink noise reduction scene to a shopping mall.

[0179] It is understandable that the above Figure 8A-8E The user interface is only an exemplary description. For example, in some possible implementations, the electronic device 200 may also provide a control for requesting the other end to turn off the smart call mode. For another example, in some possible implementations, the electronic device 200 may also provide a configuration of a corresponding downlink audio processing strategy for the other end, which is not limited in the embodiments of the present application.

[0180] In some possible implementations, in audio scenarios such as voice calls and video calls, the electronic device 100 may, during the process of processing audio (such as call audio), present in real time on a user interface visual graphics (such as time domain graphs, spectrum graphs, time-spectrum graphs, etc.) of the processed original audio and processed audio (such as audio after noise reduction, audio after gain adjustment, etc.), as well as other visual graphics that can present the audio processing effects.

[0181] In the embodiment of the present application, the audio processed by the electronic device may be audio collected from the outside, such as audio collected from the outside through a microphone during a call. The audio processed by the electronic device may also be audio received from other electronic devices, such as audio sent by the other electronic device during a call.

[0182] It can be seen that through the above method, the user can view the visual graphics of the original audio and the processed audio in real time. By comparing the visual graphics of the original audio and the processed audio, the user can intuitively understand the processing effect and processing capability of audio processing such as noise reduction of electronic devices.

[0183] For example, during a call, the electronic device can collect audio in real time through a microphone, and can perform real-time noise reduction processing on the collected audio, and can present a time domain graph of the original collected audio and the audio after noise reduction processing in real time on the user interface. The user can know how much ambient noise is filtered through the time domain graph of the original collected audio and the audio after noise reduction processing, and can intuitively feel / understand the real-time noise reduction effect of the electronic device.

[0184] The following is an exemplary description of the processing flow of the technical solution provided in the embodiment of the present application. Fig. 9 , Fig. 9is a flowchart of an audio processing method disclosed in an embodiment of the present application. Fig. 9 As shown, the method may include but is not limited to the following steps:

[0185] 901. During a call between the electronic device 100 and the electronic device 200, the electronic device 200 sends first audio data to the electronic device 100.

[0186] For example, assume that user A holds electronic device 100 and user B holds electronic device 200. When user A needs to contact user B, user A and user B can make a call (such as a voice call, a video call, etc.) through electronic device 100 and electronic device 200. It can be understood that the call here can be a cellular call, or a call function provided by various communication applications, social applications, etc., which is not limited in the embodiments of the present application.

[0187] During the conversation between the electronic device 100 and the electronic device 200, the electronic device 100 can collect external sounds, such as external environmental sounds and the voice of user A, through its own microphone in real time, and can send corresponding audio data to the electronic device 200. Accordingly, the electronic device 200 can receive audio data from the electronic device 100. Similarly, the electronic device 200 can also collect external sounds, such as external environmental sounds and the voice of user B, through its own microphone in real time, and can send corresponding audio data (such as first audio data) to the electronic device 100. Accordingly, the electronic device 100 can receive audio data from the electronic device 200.

[0188] 902. The electronic device 100 performs semantic analysis based on the first audio data to obtain a first semantic analysis result.

[0189] The electronic device 100 can receive the audio data from the electronic device 200 in real time, and can perform semantic analysis in real time, so as to dynamically adjust the current uplink audio processing strategy based on the semantic analysis result.

[0190] Exemplarily, the electronic device 100 may receive the first audio data from the electronic device 200, and then the electronic device 100 may perform semantic analysis on the first audio data to obtain a first semantic analysis result. For example, the first audio data may be "it's so noisy over there", "the noise over there is so loud", "it's a bit noisy over there, I can't hear clearly", "it's still so noisy over there", "the noise over there is still so loud", etc., and the first semantic analysis results corresponding to these audio data may be "the external noise on the current local end is relatively loud". For another example, the first audio data may be "your voice is so soft", "I can't hear what you are saying", "can you speak louder", "your voice is still a little soft", etc., and the corresponding first semantic analysis results may be "the current local end voice is relatively soft". For another example, the first audio data may be "your voice is so loud", "can you speak softer", "your voice is too loud", etc., and the corresponding first semantic analysis results may be "the current local end voice is relatively loud".

[0191] In some possible implementations, the electronic device 100 may perform semantic analysis on the first audio data only when the smart call mode is turned on, so as to dynamically adjust the current uplink audio processing strategy based on the semantic analysis result. That is to say, when the smart call mode is turned off, the electronic device 100 may not perform any processing. In other possible implementations, when the smart call mode is turned off, the electronic device 100 may also perform semantic analysis on the first audio data, so as to determine whether to turn on the smart call mode based on the semantic analysis result. Moreover, after turning on the smart call mode, the electronic device 100 may continue to perform semantic analysis on subsequent audio data, so as to dynamically adjust the current uplink audio processing strategy based on the semantic analysis result. For example, during the initial call, the smart call mode is in the off state by default. After that, the electronic device 100 may automatically turn on the smart call mode when the semantic analysis result is "the current external noise at this end is relatively large", "the current sound at this end is relatively small" or "the current sound at this end is relatively large", so as to perform audio processing such as uplink noise reduction and adjustment of the uplink audio amplitude. In this way, during a call, the intelligent call mode can be automatically turned on based on the semantic analysis results, which can meet usage needs in a timely manner. While ensuring call quality, it can also reduce the overall power consumption of electronic devices.

[0192] It is understandable that when the smart call mode is turned on, the electronic device 100 can perform corresponding processing based on the audio processing configuration, such as performing noise reduction processing based on the configured noise reduction intensity, and adjusting the audio amplitude based on the configured audio gain.

[0193] It should be noted that the embodiment of the present application does not specifically limit the semantic analysis model used by the electronic device 100, which can be a deep neural network model or other semantic analysis model. In addition, it should be understood that for audio data, the semantic analysis model can first convert the audio data into text, that is, extract the content of the target voice in the audio data, and then perform semantic analysis based on the text (that is, analyze and understand the text). In other words, the semantic analysis model can include the function of voice-to-text conversion and the function of semantic analysis.

[0194] 903. The electronic device 100 adjusts the uplink audio processing strategy based on the first semantic analysis result.

[0195] After obtaining the first semantic analysis result, the electronic device 100 may adjust the currently used uplink audio processing strategy based on the first semantic analysis result.

[0196] It is understandable that the conversation between user A and user B usually includes a lot of content that does not involve audio quality or audio effects (such as noise, sound volume, etc.), but only the semantic analysis results corresponding to the conversation content related to audio quality will affect the audio processing strategy. Therefore, the electronic device 100 can adjust the currently used uplink audio processing strategy based on the first semantic analysis result when the first semantic analysis result is related to the audio quality. In other words, the electronic device 100 can adjust the currently used uplink audio processing strategy based on the first semantic analysis result when it is confirmed based on the first semantic analysis result that the audio effect of the call needs to be improved. For example, the first semantic analysis result is "the external noise on this end is relatively large at present", "the sound on this end is relatively small at present" or "the sound on this end is relatively large at present", etc., all of which indicate that the audio effect of the call is poor, and the electronic device 100 can determine that the audio effect of the call needs to be improved.

[0197] Exemplarily, if the result of the first semantic analysis is "the current external noise on this end is relatively large", it indicates that the current uplink noise reduction strength is not enough, and the electronic device 100 can select a larger uplink noise reduction strength. For example, if the current uplink noise reduction strength is "weak", the electronic device 100 can adjust the uplink noise reduction strength to "medium" or "strong", and if the current uplink noise reduction strength is "medium", the electronic device 100 can adjust the uplink noise reduction strength to "strong". In the embodiment of the present application, for each uplink noise reduction strength, a corresponding noise reduction model can be configured. When a certain uplink noise reduction strength is selected, the collected external audio can be processed by the noise reduction model corresponding to the uplink noise reduction strength. The embodiment of the present application does not specifically limit the noise reduction model used by the electronic device 100, which can be a deep neural network model or other noise reduction model. It should be noted that for some users, during a call, when the target voice is mixed with a little ambient sound, the listening experience is best. Therefore, by providing a variety of noise reduction strengths, the flexibility of noise reduction can be improved, the noise reduction needs of different users can be met, and the user can get a better user experience.

[0198] For example, if the first semantic analysis result is "the current local sound is relatively low", it indicates that the current uplink audio gain is insufficient, and the electronic device 100 can select a larger uplink audio gain. For example, if the current uplink audio gain is 5dB, the electronic device 100 can adjust the uplink audio gain to a larger audio gain such as 8dB, 10dB, or 12dB.

[0199] As another example, if the first semantic analysis result is "the current sound on this end is relatively loud", it indicates that the current uplink audio gain is relatively large, and the electronic device 100 can select a smaller uplink audio gain. For example, if the current uplink audio gain is 10dB, the electronic device 100 can adjust the uplink audio gain to a smaller audio gain such as 8dB or 5dB. It is understandable that when a certain uplink audio gain (such as 5dB) is set, the electronic device 100 can perform corresponding gain processing (such as 5dB gain processing) on ​​the collected external audio, and then send the gain-processed audio data to the electronic device 200.

[0200] It is understandable that, in some cases, the first semantic analysis result may also be "the current external noise on this end is relatively loud, and the current sound on this end is relatively quiet." In this case, the electronic device 100 may adjust the uplink noise reduction strength and the uplink audio gain at the same time.

[0201] It should be noted that, in a possible implementation, some semantic analysis results and corresponding adjustment strategies can be pre-configured, and then the electronic device 100 can compare the first semantic analysis result with the pre-configured semantic analysis result. If the first semantic analysis result is the same as a pre-configured semantic analysis result, the corresponding adjustment strategy can be adopted. Among them, these pre-configured semantic analysis results can represent the situation where the audio effect of the call needs to be improved, and the adjustment strategy can be used to indicate the parameters (such as noise reduction intensity, audio gain, etc.) in the audio processing strategy that need to be adjusted and the adjustment method (such as selecting a higher level parameter). Exemplarily, the pre-configured semantic analysis results may include "the current external noise at this end is relatively large", "the current sound at this end is relatively small", and "the current sound at this end is relatively large". Among them, the adjustment strategy corresponding to "the current external noise at this end is relatively large" can be to select a higher level of uplink noise reduction intensity, the adjustment strategy corresponding to "the current sound at this end is relatively small" can be to select a higher level of uplink audio gain, and the adjustment strategy corresponding to "the current sound at this end is relatively large" can be to select a lower level of uplink audio gain. In this way, when the first semantic analysis result is one of multiple preset semantic results, the electronic device 100 can adjust the uplink audio processing strategy based on the first semantic analysis result, that is, adjust the uplink audio processing strategy based on the adjustment strategy corresponding to the first semantic analysis result.

[0202] In the above implementation, the electronic device 100 mainly performs semantic analysis on the audio data from the electronic device 200, and then dynamically adjusts the uplink audio processing strategy based on the semantic analysis result. In addition to dynamically adjusting the uplink audio processing strategy based on the semantic analysis, in the embodiment of the present application, the electronic device 100 can also analyze the audio data (such as the first audio data) from the electronic device 200, determine the noise situation in the corresponding audio data, and then dynamically adjust the uplink audio processing strategy based on the real-time noise situation. Exemplarily, the electronic device 100 can analyze the first audio data to determine the ratio of the noise to the target voice in the first audio data, such as the amplitude ratio of the noise to the target voice. If the amplitude ratio of the noise to the target voice is less than a threshold value 1 (such as 0.5), it indicates that the noise of the other end (such as the electronic device 200 or the user B side) is small, and the uplink noise reduction strength can be adjusted to weak. If the amplitude ratio of the noise to the target voice is greater than or equal to the threshold value 1 (such as 0.5) and less than the threshold value 2 (such as 1.5), it indicates that the noise of the other end is large, and the uplink noise reduction strength can be adjusted to medium. If the amplitude ratio of the noise to the target voice is greater than or equal to the threshold value 2, it indicates that the noise of the other end is large, and the uplink noise reduction strength can be adjusted to strong. Because the larger the amplitude ratio of the noise to the target voice, the noisier the environment of the other end is, and the noisier the environment of the other end is, the more affected the call of the user of the other end is, and the more likely it is that it cannot be heard clearly. Therefore, when the environment of the other end is noisier, the electronic device 100 can adopt a higher level of noise reduction intensity, so that the noise in the audio data sent to the other end can be reduced as much as possible, thereby reducing the impact on the user of the other end.

[0203] 904. The electronic device 200 sends first indication information to the electronic device 100, where the first indication information is used to indicate an audio quality problem of the electronic device 100.

[0204] During a call between electronic device 100 and electronic device 200, electronic device 200 may monitor the call quality of electronic device 100 in real time. When electronic device 100 has an audio quality problem, electronic device 200 may send a first indication message to electronic device 100. The first indication message may be used to indicate the audio quality problem of electronic device 100.

[0205] Specifically, in a possible implementation, the electronic device 200 can score the audio data (such as the third audio data) from the electronic device 100 based on the voice quality detection algorithm, and obtain a real-time voice quality score. If the voice quality score is greater than the quality score threshold (such as 6, the voice quality score is 1 to 10), it indicates that the call quality of the electronic device 100 is good, and the electronic device 200 can do no processing. On the contrary, if the voice quality score is less than or equal to the quality score threshold, it indicates that the call quality of the electronic device 100 is poor. The electronic device 200 can determine the reason why the voice quality score is lower than the quality score threshold based on the corresponding audio data (such as the current external noise on the local end is relatively large, the current sound on the local end is relatively small, etc.), and then the electronic device 200 can send a first indication information to the electronic device 100. The first indication information can be used to indicate the reason why the voice quality score is lower than the quality score threshold, that is, the audio quality problem existing in the third audio data. Exemplarily, assuming that the electronic device 200 scores the third audio data from the electronic device 100 and obtains a voice quality score of 5, the electronic device 200 can determine that the voice quality score is less than the quality score threshold (such as 6). After that, the electronic device 200 can analyze the third audio data to determine the reason why the voice quality score is lower than the quality score threshold. For example, by analyzing the third audio data, the electronic device 200 can determine that the reason why the voice quality score is lower than the quality score threshold is that "the third audio data includes too much environmental noise". It should be noted that the embodiment of the present application does not limit the way in which the electronic device 200 analyzes the audio quality problem existing in the third audio data. For example, the electronic device 200 can calculate the average amplitude of the third audio data and judge whether the sound is louder or smaller by the average amplitude.

[0206] In the embodiment of the present application, there are multiple implementation methods for the first indication information. For example, the first indication information may be text content directly indicating the audio effect, such as "the current external noise on this end is relatively loud", "the current sound on this end is relatively quiet", or "the current sound on this end is relatively loud", or the first indication information may be an identifier of the audio effect, such as the identifier "0" may indicate "the current external noise on this end is relatively loud", the identifier "1" may indicate "the current sound on this end is relatively quiet", and the identifier "2" may indicate "the current sound on this end is relatively loud".

[0207] In the embodiment of the present application, a (dedicated) communication channel may be established between the electronic device 100 and the electronic device 200, and the electronic device 200 may send the first indication information through the communication channel.

[0208] It should be understood that the above-mentioned method of determining the audio quality problem of the electronic device 100 is only an exemplary description, and the embodiments of the present application do not limit this. For example, in some possible implementations, the voice quality detection algorithm used by the electronic device 200 can score each dimension of the audio data from the electronic device 100, and can directly determine whether the corresponding audio data includes more noise, and whether the audio amplitude is large or small.

[0209] 905. The electronic device 100 adjusts the uplink audio processing strategy based on the first indication information.

[0210] After the electronic device 100 receives the first indication information from the electronic device 200, the electronic device 100 may adjust the currently used uplink audio processing strategy based on the first indication information.

[0211] Exemplarily, if the first indication information indicates that "the current external noise at the local end is relatively large", it indicates that the current uplink noise reduction strength is insufficient, and the electronic device 100 can select a greater uplink noise reduction strength. For example, if the current uplink noise reduction strength is "weak", the electronic device 100 can adjust the uplink noise reduction strength to "medium" or "strong", and if the current uplink noise reduction strength is "medium", the electronic device 100 can adjust the uplink noise reduction strength to "strong".

[0212] For example, if the first indication information indicates that "the current local sound is relatively low", it indicates that the current uplink audio gain is insufficient, and the electronic device 100 can select a larger uplink audio gain. For example, if the current uplink audio gain is 5dB, the electronic device 100 can adjust the uplink audio gain to a larger audio gain such as 8dB, 10dB, or 12dB.

[0213] For example, if the first indication information indicates that "the current local sound is relatively loud", it means that the current uplink audio gain is relatively large, and the electronic device 100 can select a smaller uplink audio gain. For example, if the current uplink audio gain is 10dB, the electronic device 100 can adjust the uplink audio gain to a smaller audio gain such as 8dB or 5dB.

[0214] It should be noted that, in a possible implementation, a corresponding adjustment strategy can be configured for each value of the first indication information, and then, when the electronic device 100 receives the first indication information from the electronic device 200, it can directly adopt the corresponding adjustment strategy. Among them, the adjustment strategy can be used to indicate the parameters (such as noise reduction intensity, audio gain, etc.) in the audio processing strategy that need to be adjusted and the adjustment method (such as selecting a higher level parameter). Exemplarily, when the first indication information is a text content that directly represents the audio effect, it can include "the current external noise at this end is relatively large", "the current sound at this end is relatively small", "the current sound at this end is relatively large" and other value situations. Among them, the adjustment strategy corresponding to "the current external noise at this end is relatively large" can be to select a higher level of uplink noise reduction intensity, the adjustment strategy corresponding to "the current sound at this end is relatively small" can be to select a higher level of uplink audio gain, and the adjustment strategy corresponding to "the current sound at this end is relatively large" can be to select a lower level of uplink audio gain. In this way, the electronic device 100 can adjust the uplink audio processing strategy based on the adjustment strategy corresponding to the first indication information.

[0215] In the above implementation, the electronic device 200 can feed back quality problems or indication information to the electronic device 100, and then the electronic device 100 can adjust the uplink audio processing strategy based on the quality problems or indication information. In this way, the electronic device 100 will usually adjust the uplink audio processing strategy based on the corresponding configuration, such as a corresponding adjustment strategy can be configured for each value of the first indication information. In addition to this implementation, in an embodiment of the present application, the electronic device 100 can also receive a request message from the electronic device 200, and adjust the uplink audio processing strategy based on the request message. Exemplarily, the electronic device 200 can provide a user interface for configuring the audio processing of the opposite end, and the user can select one or more configurations of noise reduction scene, audio gain, and noise reduction strength based on the user interface. Afterwards, the user can click or touch the corresponding confirmation control (such as Fig.8DControl 4822 shown), in response to this operation, the electronic device 200 may send a second request message to the electronic device 100, the second request message being used to request adjustment of the uplink audio processing strategy, the second request message including the parameters in the uplink audio processing strategy that need to be adjusted (such as the noise reduction scenario) and the corresponding parameter values ​​(shopping mall). Accordingly, the electronic device 100 may receive the second request message from the electronic device 200, after which the electronic device 100 may pop up a corresponding prompt message box, the prompt message box being used to prompt the user that the other end is requesting adjustment of the uplink audio processing strategy, the prompt message box may also include corresponding confirmation controls and rejection controls, the confirmation control being used to determine or receive the other end's request, the rejection control being used to reject the other end's request. In some possible implementations, after the electronic device 100 receives the second request message from the electronic device 200, it may adjust the uplink audio processing strategy directly based on the second request message, such as switching the noise reduction scenario from the current "general" to "shopping mall". For the specific user interface corresponding to the above description, please refer to Figure 8A-8E The user interface shown.

[0216] In some possible implementations, when the smart call mode of the electronic device 100 is not turned on, the electronic device 200 may also send a first request message to the electronic device 100, and the first request message may be used to request to turn on the smart call mode. Accordingly, the electronic device 100 may receive the first request message from the electronic device 200, and then the electronic device 100 may pop up a corresponding prompt message box, and the prompt message box is used to prompt the user to request the other party to turn on the smart call mode. The prompt message box may also include a corresponding confirmation control and a rejection control. The confirmation control may be used to determine or receive the request of the other party, and the rejection control may be used to reject the request of the other party. In some possible implementations, after the electronic device 100 receives the first request message from the electronic device 200, the smart call mode may be turned on directly based on the first request message. In the embodiment of the present application, there may be multiple situations in which the electronic device 200 sends the first request message, and several examples are shown below. In the first, the electronic device 200 may respond to the user operation and then send the first request message to the electronic device 100, such as Figure 8B As shown, the electronic device 200 can respond to the user operation acting on the send request control 4811 to send a first request message to the electronic device 100. Second, the electronic device 200 can score the audio data (such as the third audio data) from the electronic device 100 based on the voice quality detection algorithm, and can obtain a real-time voice quality score. If the voice quality score is less than or equal to the quality score threshold (such as 6), it indicates that the audio quality of the audio data from the electronic device 100 is poor. In this case, the electronic device 200 can send a first request message to the electronic device 100.

[0217] 906. The electronic device 100 adjusts the uplink noise reduction scenario based on the first positioning result.

[0218] In an embodiment of the present application, a variety of uplink noise reduction scenarios / audio processing scenarios are provided, and different uplink noise reduction scenarios correspond to different noise reduction models. Therefore, in order to obtain a better uplink noise reduction effect, the electronic device 100 can dynamically adjust the uplink noise reduction scenario based on the first positioning result. Among them, the first positioning result can be a positioning result obtained during the call between the electronic device 100 and the electronic device 200, or it can be a positioning result obtained before the electronic device 100 and the electronic device 200 have a call. For example, when the electronic device 100 and the electronic device 200 just have a call, the electronic device 100 can initiate positioning (such as satellite positioning), and the obtained positioning result can be used as the first positioning result. For another example, some time before the electronic device 100 and the electronic device 200 have a call (such as the first few seconds), the electronic device 100 initiates positioning to obtain a positioning result, and the positioning result can be used as the first positioning result.

[0219] For example, during a call between the electronic device 100 and the electronic device 200, assuming that the currently set uplink noise reduction scene is "general", if the first positioning result is "XX shopping mall, B district, A city", in this case, the electronic device 100 can switch the uplink noise reduction scene to "shopping mall". Similarly, if the first positioning result is "XX subway station", in this case, the electronic device 100 can switch the uplink noise reduction scene to "subway station".

[0220] It is understandable that since the position of the electronic device 100 may change in real time, during the call between the electronic device 100 and the electronic device 200, the electronic device 100 may initiate positioning periodically (such as 30 seconds) to adjust the noise reduction scene in a timely manner.

[0221] It can be understood that in the above implementation, the electronic device 100 can adjust the uplink noise reduction scene based on the positioning result. In another possible implementation, the electronic device 100 can also adjust the uplink noise reduction scene based on semantic analysis. Specifically, the electronic device 100 can obtain the audio data of the local end and the audio data from the electronic device 200 in real time, and then perform real-time semantic analysis, and can dynamically adjust the uplink noise reduction scene based on the semantic analysis result. Exemplarily, assume that the conversation between user A and user B includes (user B: where are you, user A: I am in the mall). In this case, the electronic device 100 performs semantic analysis on the audio data of the local end and the audio data from the electronic device 200, and the obtained semantic analysis result can be "the current local end is in the mall", so the electronic device 100 can switch the uplink noise reduction scene to the mall.

[0222] It is understandable that the three processing methods of dynamically adjusting the uplink audio processing strategy based on semantic analysis, dynamically adjusting the uplink audio processing strategy based on the first indication information, and dynamically adjusting the uplink noise reduction scenario based on the positioning results can be parallel technical means, and there is no dependency between each other. Therefore, in some possible implementations, the electronic device 100 can adopt any one or more of these three methods for processing, and the embodiments of the present application are not limited here. For example, the electronic device 100 can dynamically adjust the uplink audio processing strategy based only on semantic analysis. For another example, the electronic device can dynamically adjust the uplink audio processing strategy based only on the first indication information. For another example, the electronic device 100 can dynamically adjust the uplink noise reduction scenario based only on the positioning results.

[0223] The embodiment of the present application does not limit the execution order of steps 901 to 903, steps 904 to 905, and step 906.

[0224] In the embodiment of the present application, the audio processing may include uplink audio processing and downlink audio processing. Fig. 9 The following mainly describes the case where the electronic device 100 only includes an uplink audio processing function. The downlink audio processing is similar to the uplink audio processing, and can be referenced to each other. The following briefly describes the case where the electronic device 100 only includes a downlink audio processing function.

[0225] See also Fig.10 , Fig.10 FIG. 1 is a flow chart of another audio processing method disclosed in an embodiment of the present application. Fig.10 As shown, the method may include but is not limited to the following steps:

[0226] 1001. During a call between the electronic device 100 and the electronic device 200, the electronic device 100 performs semantic analysis based on the second audio data to obtain a second semantic analysis result.

[0227] For example, assuming that user A holds electronic device 100 and user B holds electronic device 200, when user A needs to contact user B, user A and user B can have a conversation (such as a voice call, video call, etc.) through electronic device 100 and electronic device 200.

[0228] During the conversation between the electronic device 100 and the electronic device 200, the electronic device 100 can collect external sounds, such as external environmental sounds and the voice of user A, through its own microphone in real time, and can send corresponding audio data (such as second audio data) to the electronic device 200. Accordingly, the electronic device 200 can receive audio data from the electronic device 100. Similarly, the electronic device 200 can also collect external sounds, such as external environmental sounds and the voice of user B, through its own microphone in real time, and can send corresponding audio data to the electronic device 100. Accordingly, the electronic device 100 can receive audio data from the electronic device 200.

[0229] In an embodiment of the present application, the electronic device 100 can perform semantic analysis on the collected external audio in real time, so as to dynamically adjust the current downlink audio processing strategy based on the semantic analysis result.

[0230] Exemplarily, the electronic device 100 may obtain the second audio data collected by itself, and then the electronic device 100 may perform semantic analysis on the second audio data to obtain a second semantic analysis result. For example, the second audio data may be "it's so noisy over there", "the noise over there is so loud", "it's a bit noisy over there, I can't hear clearly", "it's still so noisy over there", "the noise over there is still so loud", etc., and the second semantic analysis results corresponding to these audio data may be "the current noise on the other end is relatively loud". For another example, the second audio data may be "your voice is so soft", "I can't hear what you are saying", "can you speak louder", "your voice is still a little soft", etc., and the corresponding second semantic analysis results may be "the current voice on the other end is relatively soft". For another example, the second audio data may be "your voice is so loud", "can you speak softer", "your voice is too loud", etc., and the corresponding second semantic analysis results may be "the current voice on the other end is relatively loud".

[0231] In some possible implementations, the electronic device 100 may perform semantic analysis on the second audio data only when the smart call mode is turned on, so as to dynamically adjust the current downlink audio processing strategy based on the semantic analysis result. That is to say, when the smart call mode is turned off, the electronic device 100 may not perform any processing. In other possible implementations, when the smart call mode is turned off, the electronic device 100 may also perform semantic analysis on the second audio data, so as to determine whether to turn on the smart call mode based on the semantic analysis result. Moreover, after turning on the smart call mode, the electronic device 100 may continue to perform semantic analysis on the subsequent collected audio data, so as to dynamically adjust the current downlink audio processing strategy based on the semantic analysis result. For example, the electronic device 100 may automatically turn on the smart call mode when the semantic analysis result is "the current noise on the other end is relatively large", "the current sound on the other end is relatively small" or "the current sound on the other end is relatively large", so as to perform audio processing such as downlink noise reduction and adjusting the audio amplitude. In this way, during the call, the smart call mode can be automatically turned on based on the semantic analysis result, which can meet the use needs in a timely manner, and while ensuring the call quality, the overall power consumption of the electronic device can also be reduced.

[0232] 1002. The electronic device 100 adjusts the downlink audio processing strategy based on the second semantic analysis result.

[0233] After obtaining the second semantic analysis result, the electronic device may adjust the currently used downlink audio processing strategy based on the second semantic analysis result.

[0234] It is understandable that the conversation between user A and user B usually includes a lot of content that does not involve audio quality or audio effects (such as noise, sound volume, etc.), but only the semantic analysis results corresponding to the conversation content related to audio quality will affect the audio processing strategy. Therefore, the electronic device 100 can adjust the currently used uplink audio processing strategy based on the second semantic analysis result when the second semantic analysis result is related to the audio quality. In other words, the electronic device 100 can adjust the currently used uplink audio processing strategy based on the second semantic analysis result when it is confirmed based on the second semantic analysis result that the audio effect of the call needs to be improved. For example, the second semantic analysis result is "the current noise on the other end is relatively large", "the current sound on the other end is relatively small" or "the current sound on the other end is relatively large", etc., all of which indicate that the audio effect of the call is poor, and the electronic device 100 can determine that the audio effect of the call needs to be improved.

[0235] Exemplarily, if the second semantic analysis result is "the current noise on the other end is relatively loud", it indicates that the current downlink noise reduction strength is insufficient, and the electronic device 100 can select a larger downlink noise reduction strength. For example, if the current downlink noise reduction strength is "weak", the electronic device 100 can adjust the downlink noise reduction strength to "medium" or "strong". If the current downlink noise reduction strength is "medium", the electronic device 100 can adjust the downlink noise reduction strength to "strong". In the embodiment of the present application, a corresponding noise reduction model can be configured for each downlink noise reduction strength. When a certain downlink noise reduction strength is selected, the audio data received from the electronic device 200 can be processed by the noise reduction model corresponding to the downlink noise reduction strength.

[0236] For example, if the second semantic analysis result is "the current sound of the other end is relatively low", it indicates that the current downlink audio gain is insufficient, and the electronic device 100 can select a larger downlink audio gain. For example, if the current downlink audio gain is 5dB, the electronic device 100 can adjust the downlink audio gain to a larger audio gain such as 8dB, 10dB, or 12dB.

[0237] As another example, if the second semantic analysis result is "the current sound of the other end is relatively loud", it indicates that the current downlink audio gain is relatively large, and the electronic device 100 can select a smaller downlink audio gain. For example, if the current downlink audio gain is 10dB, the electronic device 100 can adjust the downlink audio gain to a smaller audio gain such as 8dB or 5dB. It is understandable that when a certain downlink audio gain (such as 5dB) is set, the electronic device 100 can perform corresponding downlink gain processing (such as 5dB gain processing) on ​​the audio received from the electronic device 200, and then play the corresponding audio through a receiver or speaker.

[0238] It should be noted that, in a possible implementation, some semantic analysis results and corresponding adjustment strategies can be preconfigured, and then the electronic device 100 can compare the second semantic analysis result with the preconfigured semantic analysis result. If the second semantic analysis result is the same as a preconfigured semantic analysis result, the corresponding adjustment strategy can be adopted. Among them, these preconfigured semantic analysis results can represent the situation where the audio effect of the call needs to be improved, and the adjustment strategy can be used to indicate the parameters and adjustment methods in the audio processing strategy that need to be adjusted. Exemplarily, the preconfigured semantic analysis results may include "the current noise of the opposite end is relatively large", "the current sound of the opposite end is relatively small", and "the current sound of the opposite end is relatively large". Among them, the adjustment strategy corresponding to "the current noise of the opposite end is relatively large" can be to select a higher level of downlink noise reduction intensity, the adjustment strategy corresponding to "the current sound of the opposite end is relatively small" can be to select a higher level of downlink audio gain, and the adjustment strategy corresponding to "the current sound of the opposite end is relatively large" can be to select a lower level of downlink audio gain. In this way, when the second semantic analysis result is one of a plurality of preset semantic results, the electronic device 100 can adjust the downlink audio processing strategy based on the second semantic analysis result, that is, adjust the downlink audio processing strategy based on the adjustment strategy corresponding to the second semantic analysis result.

[0239] 1003. The electronic device 200 sends the fourth audio data to the electronic device 100.

[0240] During the call between the electronic device 100 and the electronic device 200, the electronic device 200 can collect external sounds through the microphone, obtain corresponding fourth audio data, and then send the fourth audio data to the electronic device 100. Accordingly, the electronic device 100 can receive the fourth audio data from the electronic device 200.

[0241] 1004. The electronic device 100 performs audio processing on the fourth audio data to obtain fifth audio data.

[0242] After receiving the fourth audio data, the electronic device 100 can process the fourth audio data according to the current downlink audio processing strategy to obtain the fifth audio data. In other words, the fifth audio data is the audio data obtained by the electronic device 100 performing noise reduction processing, gain processing, etc. according to the current downlink audio processing strategy.

[0243] 1005. The electronic device 100 analyzes the fifth audio data and determines an audio quality problem of the fifth audio data.

[0244] During a call between the electronic device 100 and the electronic device 200, the electronic device 100 can process the audio data from the electronic device 200 in real time through the downlink audio processing strategy of the local end, and can monitor the call quality of the processed audio data (such as the fifth audio data) in real time. When there is an audio quality problem in the processed audio data, the electronic device 100 can adjust the currently used downlink audio processing strategy based on the audio quality problem.

[0245] Specifically, in a possible implementation, the electronic device 100 can score the fifth audio data based on the voice quality detection algorithm, and can obtain a real-time voice quality score. If the voice quality score is greater than the quality score threshold (such as 6, the voice quality score is 1 to 10), it indicates that the electronic device 100 can not process the audio from the electronic device 200 after processing. If the voice quality score is less than or equal to the quality score threshold, it indicates that the call quality of the electronic device 200 is poor. The electronic device 100 can determine the reason why the voice quality score is lower than the quality score threshold based on the corresponding audio data (such as the current external noise is relatively large, the current sound is relatively small, etc.). Exemplarily, assuming that the electronic device 100 scores the fifth audio data from the electronic device 200 and obtains a voice quality score of 5, the electronic device 100 can determine that the voice quality score is less than the quality score threshold (such as 6). After that, the electronic device 100 can analyze the fifth audio data to determine the reason why the voice quality score is lower than the quality score threshold. For example, the electronic device 100 can determine that the reason why the voice quality score is lower than the quality score threshold is that "the fifth audio data includes too much environmental noise" by analyzing the fifth audio data.

[0246] 1006. The electronic device 100 adjusts the downlink audio processing strategy based on the audio quality problem of the fifth audio data.

[0247] After the electronic device 100 determines the audio quality problem of the fifth audio data, it may adjust the currently used downlink audio processing strategy based on the audio quality problem of the fifth audio data.

[0248] For example, if the audio quality problem of the fifth audio data is "external noise is relatively loud", it indicates that the current downlink noise reduction strength is insufficient, and the electronic device 100 can select a greater downlink noise reduction strength. For example, if the current downlink noise reduction strength is "weak", the electronic device 100 can adjust the downlink noise reduction strength to "medium" or "strong", and if the current downlink noise reduction strength is "medium", the electronic device 100 can adjust the downlink noise reduction strength to "strong".

[0249] For example, if the audio quality problem of the fifth audio data is "the sound is relatively low", it indicates that the current downlink audio gain is insufficient, and the electronic device 100 can select a larger downlink audio gain. For example, if the current downlink audio gain is 5dB, the electronic device 100 can adjust the downlink audio gain to a larger audio gain such as 8dB, 10dB, or 12dB.

[0250] For example, if the audio quality problem of the fifth audio data is "the current sound is relatively loud", it indicates that the current downlink audio gain is relatively large, and the electronic device 100 can select a smaller downlink audio gain. For example, if the current downlink audio gain is 10 dB, the electronic device 100 can adjust the downlink audio gain to a smaller audio gain such as 8 dB or 5 dB.

[0251] 1007. The electronic device 100 adjusts the downlink noise reduction scenario based on the second positioning result.

[0252] In an embodiment of the present application, a variety of downlink noise reduction scenarios / audio processing scenarios are provided, and different downlink noise reduction scenarios correspond to different noise reduction models. Therefore, in order to obtain a better noise reduction effect, the electronic device 100 can dynamically adjust the downlink noise reduction scenario based on the second positioning result. Among them, the second positioning result can be a positioning result obtained during the call between the electronic device 100 and the electronic device 200, or it can be a positioning result obtained before the electronic device 100 and the electronic device 200 talk. For example, when the electronic device 100 and the electronic device 200 just talk, the electronic device 200 can initiate positioning (such as satellite positioning), and the obtained positioning result can be used as the second positioning result, and the second positioning result can be sent to the electronic device 100. For another example, some time before the electronic device 100 and the electronic device 200 talk (such as the first few seconds), the electronic device 200 initiates positioning to obtain a positioning result, and the positioning result can be used as the second positioning result.

[0253] It is understandable that since the position of the electronic device 200 may change in real time, during a call between the electronic device 100 and the electronic device 200, the electronic device 200 may initiate positioning periodically (e.g., 30 seconds) and may send positioning results to the electronic device 100 so that the electronic device 100 can adjust the downlink noise reduction scenario in a timely manner.

[0254] In another possible implementation, the electronic device 100 can also adjust the downlink noise reduction scene based on semantic analysis. Specifically, the electronic device 100 can obtain the audio data of the local end and the audio data from the electronic device 200 in real time, and then perform real-time semantic analysis, and can dynamically adjust the downlink noise reduction scene based on the semantic analysis results. Exemplarily, assuming that the conversation between user A and user B includes (user A: where are you, user B: I'm in the mall), in this case, the electronic device 100 performs semantic analysis on the audio data of the local end and the audio data from the electronic device 200, and the obtained semantic analysis result can be "the other end is currently in the mall", so the electronic device 100 can switch the downlink noise reduction scene to the mall.

[0255] The embodiment of the present application does not limit the execution order of steps 1001 to 1003, steps 1004 to 1005, and step 1006.

[0256] The above respectively exemplifies the uplink audio processing and the downlink audio processing, but it should be understood that in some possible implementations, the electronic device can support both the uplink audio processing and the downlink audio processing, which is not limited in the embodiments of the present application. Moreover, for the same noise reduction scenario, at the same noise reduction intensity, the noise reduction model used for the uplink and downlink can be the same.

[0257] In the above processing flow, for uplink audio processing and downlink audio processing, the electronic device 100 can automatically adjust the noise reduction strength, audio gain and noise reduction scene based on the semantic analysis results, and can also automatically adjust the noise reduction scene based on positioning, and also supports users to manually adjust the noise reduction strength, audio gain and noise reduction scene. In this way, the most suitable noise reduction model and corresponding audio gain can be selected according to the actual situation, which can improve the call quality and enable users to have a better call experience.

[0258] It should be understood that the sending in the embodiments of the present application can be direct sending or indirect sending. Direct sending means that a device or module sends information / data directly to a corresponding device or module, and indirect sending means that a device or module sends information / data to a corresponding device or module through other devices or modules.

[0259] Obviously, the embodiments described above are only a part of the embodiments of the present application, rather than all the embodiments. The reference to "embodiment" herein means that the specific features, structures or characteristics described in conjunction with the embodiments may be included in at least one embodiment of the present embodiment application. The phrase appearing in various positions in the specification is not necessarily the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. It can be understood explicitly and implicitly by those skilled in the art that the embodiments described herein can be combined with other embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application. The terms "including" and "having" and any of their variations in the present application are intended to cover non-exclusive inclusion. For example, a series of steps or units are included, or optionally, steps or units not listed are also included, or other steps or units inherent to these processes, methods, products or devices are optionally included. It can be understood that in some embodiments, the equal sign of the above-mentioned conditional judgment can be greater than one end or less than one end. For example, the above-mentioned conditional judgment that a threshold is greater than, less than or equal to can also be changed to a conditional judgment that the threshold is greater than, equal to or less than, which is not limited here. It can also be understood that, with respect to an architecture having multiple devices or modules, if one of the devices or modules generates information and another device or module uses the information, there may be multiple ways for the other device to obtain the information. For example, the device or module that generates the information may send the information directly to the device or module that uses the information (equivalent to direct sending), or the device or module that generates the information may send the information to the device or module that uses the information through other devices or modules (equivalent to indirect sending).

[0260] It is to be understood that only the part relevant to the present application is shown in the accompanying drawings, but not all of the content. It should be understood that some exemplary embodiments are described as processing or methods depicted as flow charts. Although the flow chart describes each operation (or step) as sequential processing, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged as long as it is logical. When its operation is completed, the processing can be terminated, but it can also have additional steps not included in the accompanying drawings. The processing can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0261] As used in this specification, the terms "component", "module", "system", "unit", etc. are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a unit can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or distributed between two or more computers. In addition, these units can be executed from various computer-readable media having various data structures stored thereon. For example, a unit can communicate through local and / or remote processes based on signals having one or more data packets (e.g., data from a second unit interacting with another unit in a local system, a distributed system, and / or a network. For example, the Internet interacts with other systems via signals).

[0262] The specific implementation methods described above further illustrate the purpose, technical solutions and beneficial effects of the present application in detail. It should be understood that the above description is only the specific implementation methods of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the present application should be included in the scope of protection of the present application.

Claims

1. An audio processing method, applied to a first electronic device, characterized in that: include: During a call between the first electronic device and the second electronic device, performing semantic analysis on call audio data to obtain a target semantic analysis result; the call audio data includes call audio data from the second electronic device; Adjusting the audio processing strategy based on the target semantic analysis result; The audio processing strategy includes an uplink audio processing strategy, and the uplink audio processing strategy is used to process the call audio data collected by the first electronic device.

2. The method according to claim 1, characterized in that The uplink audio processing strategy includes one or more of uplink noise reduction strength, uplink audio gain, and uplink noise reduction scenario.

3. The method according to claim 1 or 2, characterized in that: The adjusting the audio processing strategy based on the target semantic analysis result comprises: In the case where the target semantic analysis result is one of a plurality of preset semantic analysis results, The audio processing strategy is adjusted based on the adjustment strategy corresponding to the target semantic result; the multiple preset semantic analysis results are all configured with corresponding adjustment strategies, and the adjustment strategies are used to indicate the parameters in the audio processing strategy that need to be adjusted and the adjustment method.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: Initiate positioning and obtain the first positioning result; The uplink noise reduction scenario is adjusted based on the first positioning result, and different noise reduction scenarios correspond to different noise reduction models.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: receiving first indication information from the second electronic device, where the first indication information is used to indicate an audio quality problem of the first electronic device; Adjust the uplink audio processing strategy based on the first indication information.

6. The method according to claim 5, characterized in that The adjusting the uplink audio processing strategy based on the first indication information includes: The uplink audio processing strategy is adjusted based on the adjustment strategy corresponding to the first indication information; the first indication information includes multiple value conditions, and the multiple value conditions are all configured with corresponding adjustment strategies, and the adjustment strategy is used to indicate the parameters in the audio processing strategy that need to be adjusted and the adjustment method.

7. The method according to any one of claims 1 to 6, characterized in that: Before adjusting the audio processing strategy based on the target semantic analysis result, the method further includes: Performing semantic analysis on the sixth audio data to obtain a sixth semantic analysis result; the sixth audio data includes call audio data from the second electronic device and / or call audio data collected by the first electronic device; When the sixth semantic analysis result is one of a plurality of preset semantic analysis results, enabling the smart call mode; The adjusting the audio processing strategy based on the target semantic analysis result comprises: When the smart call mode is turned on, the audio processing strategy is adjusted based on the target semantic analysis result.

8. The method according to any one of claims 1 to 6, characterized in that: Before adjusting the audio processing strategy based on the target semantic analysis result, the method further includes: Receiving a first request message from the second electronic device, where the first request message is used to request to enable a smart call mode; Enable the smart call mode based on the first request message; The adjusting the audio processing strategy based on the target semantic analysis result comprises: When the smart call mode is turned on, the audio processing strategy is adjusted based on the target semantic analysis result.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: receiving a second request message from the second electronic device, where the second request message is used to request adjustment of the uplink audio processing strategy, and the second request message includes parameters in the uplink audio processing strategy to be adjusted and corresponding parameter values; The uplink audio processing strategy is adjusted based on the second request message.

10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: displaying a first user interface, the first user interface comprising audio processing configuration controls; In response to a user operation acting on the audio processing configuration control, a second user interface is displayed; the second user interface includes an upstream audio processing configuration area, the upstream audio processing configuration area includes one or more of a noise reduction intensity configuration area, an audio gain configuration area, and a noise reduction scene configuration area, the noise reduction intensity configuration area includes a plurality of noise reduction intensity options, the audio gain configuration area includes a plurality of audio gain options, and the noise reduction scene configuration area includes a plurality of noise reduction scene options; In response to a user operation on a first option, the first option is changed to a selected state, and an audio processing strategy corresponding to the first option is enabled; the first option is any option in the second user interface.

11. An electronic device, characterized in that: It comprises a processor and a communication interface; the communication interface is used to receive and send data; the processor calls a computer program or computer instruction stored in a memory to implement the method according to any one of claims 1 to 10.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program or a computer instruction, and the computer program or the computer instruction is executed by a processor to implement the method according to any one of claims 1 to 10.

13. A computer program product, characterized in that The computer program product comprises computer program codes or computer instructions, and when the computer program codes or computer instructions are executed, the method according to any one of claims 1 to 10 is implemented.

Images