Volume adjustment method, intelligent terminal and storage medium
By monitoring call type and audio data, the smart terminal automatically adjusts the volume, solving the problem of call volume requirements in different scenarios, improving call quality and user experience.
Patent Information
- Application Number
- CN202411281600.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-12
- Publication Date
- 2024-12-06
AI Technical Summary
Smart terminals find it difficult to meet the user's call volume needs under different call types, resulting in difficult to hear clearly in noisy scenes or excessively loud in quiet scenes, revealing the call content.
By monitoring the current call type, obtaining the corresponding volume adjustment parameters, preprocessing audio data to separate ambient noise and target voice, determining the target volume based on the adjustment parameters and data, and performing volume adjustments, suitable for hands-free, headphones and video calls etc.
It realizes automatic volume adjustment of smart terminals under different call types, meets users' call needs in different scenarios, and improves call quality and user experience.
Smart Images

Figure CN119094647A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of intelligent terminals, and in particular to a volume adjustment method, an intelligent terminal and a storage medium. Background Art
[0002] With the popularization of smart terminals such as mobile phones, smart terminals have become indispensable electronic products in people’s daily lives.
[0003] During a call on a smart terminal, the call volume often uses the volume value set by the user during the last call. This can easily lead to the user having difficulty hearing the other party's speech due to the call volume being too low when talking in a noisy scene, or when the user is talking in a relatively quiet scene, the call content may be leaked due to the call volume being too high.
[0004] In the process of conceiving and implementing the present application, the inventors discovered that there are at least the following technical problems: the call volume of the smart terminal is difficult to meet the call needs of users under different call types.
[0005] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention
[0006] In response to the above technical problems, the present application provides a volume adjustment method, a smart terminal and a storage medium, which can automatically adjust the call volume of the smart terminal to meet the user's call needs under different call types.
[0007] The present application provides a volume adjustment method, which can be applied to a smart terminal, and the method includes:
[0008] When in a call state, monitor the current call type;
[0009] Obtaining a first volume adjustment parameter corresponding to the call type;
[0010] The collected audio data is acquired, a target volume is determined according to the first volume adjustment parameter and the audio data, and a call volume adjustment operation is performed according to the target volume.
[0011] Optionally, the call type includes any one of the following:
[0012] Voice calls played through handset, voice calls played through hands-free, voice calls played through headset, video calls, and voice calls in games.
[0013] Optionally, determining a target volume according to the first volume adjustment parameter and the audio data includes:
[0014] Preprocessing the audio data to separate environmental noise data and first target voice data in the audio data;
[0015] The target volume is determined according to the first volume adjustment parameter, the environmental noise data and / or the first target voice data.
[0016] Optionally, the first target voice data includes one's own voice data.
[0017] Optionally, the volume adjustment parameter includes at least one of the following: a volume gain parameter, a dynamic range compression parameter, a noise suppression parameter, an automatic gain control parameter, and an equalizer parameter;
[0018] The target volume is positively correlated with the environmental noise data and / or the first target voice data.
[0019] Optionally, the method further comprises:
[0020] Acquire the received second audio data of the other party of the call;
[0021] Processing the second audio data according to the target volume;
[0022] The processed second audio data is output.
[0023] Optionally, the processing the second audio data according to the target volume includes:
[0024] Separating the environmental noise data and the second target voice data in the second audio data, wherein the second target voice data includes the voice data of the other party of the call;
[0025] The volume of the second target voice data is adjusted according to the target volume.
[0026] The present application also provides a volume adjustment device, comprising:
[0027] A monitoring module, used to monitor the current call type when the smart terminal is in a call state;
[0028] An acquisition module, used to acquire a first volume adjustment parameter corresponding to the call type;
[0029] The processing module is used to obtain the collected audio data, determine the target volume according to the first volume adjustment parameter and the audio data, and perform a call volume adjustment operation according to the target volume.
[0030] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the volume adjustment method described above are implemented.
[0031] The present application also provides a storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the volume adjustment method are implemented.
[0032] As described above, the volume adjustment method provided by the present application can be applied to a smart terminal, comprising the steps of:
[0033] When in a call state, monitor the current call type; obtain a first volume adjustment parameter corresponding to the call type; obtain the collected audio data, determine the target volume based on the above-mentioned first volume adjustment parameter and the audio data, and perform a call volume adjustment operation according to the target volume.
[0034] Through the technical solution of the present application, when the smart terminal is in a call state, the call volume of the smart terminal is automatically adjusted according to the current call type and the collected audio data, wherein different call types use different volume adjustment parameters, thereby meeting the user's call needs under different call types. BRIEF DESCRIPTION OF THE DRAWINGS
[0035] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.
[0036] Figure 1 A schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application;
[0037] Figure 2 A communication network system architecture diagram provided in an embodiment of the present application;
[0038] Figure 3 A flow chart of the steps of a volume adjustment method provided in an embodiment of the present application;
[0039] Figure 4 A schematic diagram of an audio data processing flow provided in an embodiment of the present application;
[0040] Figure 5 A schematic diagram of another audio data processing flow provided in an embodiment of the present application;
[0041] Figure 6 A module schematic diagram of a volume adjustment device provided in an embodiment of the present application.
[0042] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION
[0043] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.
[0044] Optionally, in this document, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context in the specific embodiment.
[0045] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.
[0046] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.
[0047] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0048] Optionally, in this article, step codes such as S301, S302, etc. are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S302 first and then S301, etc., but these should all be within the scope of protection of this application.
[0049] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0050] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application, and have no specific meanings. Therefore, "module", "component" or "unit" can be used in a mixed manner.
[0051] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.
[0052] The following description will be made by taking a mobile terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.
[0053] See also Figure 1 , which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, the mobile terminal 100 may include: RF (Radio Frequency, radio frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the mobile terminal shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0054] Combine the following Figure 1 The following is a detailed introduction to the various components of the mobile terminal:
[0055] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution), 5G and 6G, etc.
[0056] WiFi is a short-range wireless transmission technology. Mobile terminals can help users send and receive emails, browse web pages, and access streaming media through WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not a necessary component of the mobile terminal and can be omitted as needed without changing the essence of the present application.
[0057] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, an earpiece, a buzzer, etc.
[0058] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.
[0059] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured on the mobile phone, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.
[0060] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.
[0061] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute the command sent by the processor 110. In addition, the touch panel 1071 can be implemented in at least two types such as resistive, capacitive, infrared and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.
[0062] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to implement the input and output functions of the mobile terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to implement the input and output functions of the mobile terminal, which is not limited here.
[0063] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.
[0064] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0065] The processor 110 is the control center of the mobile terminal. It uses various interfaces and lines to connect various parts of the entire mobile terminal. It executes various functions of the mobile terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the mobile terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.
[0066] The mobile terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.
[0067] although Figure 1 Not shown, the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.
[0068] To facilitate understanding of the embodiments of the present application, the communication network system on which the smart terminal of the present application is based is described below.
[0069] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.
[0070] Optionally, UE201 may be the above-mentioned mobile terminal 100, which will not be described in detail here.
[0071] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .
[0072] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the parameter and charging control parameter decision point for service data flow and IP bearer resources, and it selects and provides available parameters and charging control decisions for the parameter and charging execution function unit (not shown in the figure).
[0073] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.
[0074] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.
[0075] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.
[0076] Reference Figure 3 , Figure 3 The following is a flow chart of the steps of a volume adjustment method provided in an embodiment of the present application. In some embodiments of the present application, the volume adjustment method includes:
[0077] S301. When in a call state, monitor the current call type.
[0078] In some implementations, when it is detected that the smart terminal enters a call state, the current call type is monitored.
[0079] In some embodiments, when a call application (such as a phone application, a video call application, a voice chat function in a game application, etc.) on a smart terminal is activated and enters a call state, these applications can report the current call type to the system through their internal logic or application programming interface (API). The system can monitor these reports and determine the current call type of the smart terminal based on the content of the reports.
[0080] In some implementations, the operating system of the smart terminal generally provides a series of system services, which can monitor changes in call status and infer the call type by analyzing information such as currently active applications, audio output devices, network status, etc. For example, if it is detected that the audio output device is set to an earpiece and the phone application is in the foreground, it can be determined that the current voice call is played by the earpiece.
[0081] Optionally, the call type includes any one of the following:
[0082] Playing voice calls through the handset: refers to playing the call sound through the handset of the smart terminal.
[0083] Hands-free voice call playback: refers to playing the call sound directly through the speaker of the smart terminal without using the handset.
[0084] Playing voice calls through headphones: refers to playing call sounds through headphones connected to the smart terminal.
[0085] Video call: includes playing the call sound through the speaker of the smart terminal and playing the call sound through the headset connected to the smart terminal.
[0086] In-game voice call: refers to real-time voice calls between players through smart terminals during the game, including playing the call sound through the speaker of the smart terminal and playing the call sound through headphones connected to the smart terminal.
[0087] In some implementations, the above-mentioned call types such as handset-played voice calls, hands-free-played voice calls, and headset-played voice calls are not limited to specific communication methods or technical platforms. They can cover a variety of call scenarios, including but not limited to operator calls and network APP calls.
[0088] Among them, operator calls can refer to voice calls made through network services provided by telecom operators, which rely on the operator's mobile communication network (such as 2G, 3G, 4G, 5G, etc.) or fixed telephone network. In operator calls, users can use handsets, speakers or headphones to play call sounds, depending on the user's personal preferences and current device status.
[0089] Network APP calls are voice calls made through Instant Messaging (IM) software. Users can also use a handset, speakerphone or headset to play the call audio.
[0090] S302: Obtain a first volume adjustment parameter corresponding to the call type.
[0091] In some implementations, the smart terminal may maintain a volume adjustment parameter library, which includes multiple sets of volume adjustment parameters, each set of volume adjustment parameters corresponding to a different call type. After determining the current call type, the smart terminal may query the volume adjustment parameter library to quickly obtain the volume adjustment parameter corresponding to the current call type.
[0092] Optionally, the volume adjustment parameter includes at least one of the following items:
[0093] Volume gain parameter: used to adjust the strength of the audio signal. During a call, if the received audio signal is weak, you can increase the volume gain to enhance the signal and make the sound louder. On the contrary, if the audio signal is too strong, it may cause distortion or discomfort, in which case you need to appropriately reduce the volume gain.
[0094] Dynamic range compression parameters: used to reduce the difference between the maximum and minimum volume in the audio signal. During a call, this helps balance the volume of different sound sources (such as human voices, environmental noise, etc.), making the overall listening experience more uniform and comfortable. By adjusting the dynamic range compression parameters, the system can reduce the impact of sudden high or low sounds on the listener while maintaining sound clarity.
[0095] Noise suppression parameters: used to reduce or eliminate background noise in audio signals. During a call, background noise may interfere with call quality and affect the user's listening experience. By adjusting the noise suppression parameters, the system can intelligently identify and suppress these noises, making the call clearer.
[0096] Automatic Gain Control Parameters: A technology that automatically adjusts the gain of audio signals. During a call, the gain can be automatically adjusted according to the strength of the received audio signal to ensure the stability and clarity of the sound. By adjusting the automatic gain control parameters, the system can adapt to different call environments and conditions and provide consistent call quality.
[0097] Equalizer parameters: used to adjust the strength of different frequency components in the audio signal. During a call, the equalizer parameters can help improve the clarity of the human voice, enhance the bass effect or highlight the treble part, etc.
[0098] It should be noted that the above volume adjustment parameters can be used individually or in combination to meet different call types and user needs.
[0099] In some implementations, different call types correspond to different volume adjustment parameters.
[0100] For example, a handset call may use a lower volume gain and a higher noise suppression strength by default to reduce the impact of background noise on call quality; whereas a hands-free call may use a higher volume gain to ensure that the sound can be transmitted clearly.
[0101] S303: Acquire the collected audio data, determine the target volume according to the first volume adjustment parameter and the audio data, and perform a call volume adjustment operation according to the target volume.
[0102] In some implementations, audio data during a call may be acquired in real time to facilitate subsequent volume adjustment processing.
[0103] Exemplarily, the audio data may be collected by an audio collection device (such as a microphone) of the smart terminal.
[0104] Optionally, the audio data may be an original analog signal, including the voices of both parties on the call, possible background noise, and environmental noise.
[0105] In some implementations, the audio data may be analyzed and processed first, and a target volume value suitable for the current call type may be calculated based on various settings in the first volume adjustment parameter (such as gain value, dynamic range compression parameter, etc.). The target volume value is the most suitable sound intensity in the current call environment, which is neither too loud to cause discomfort nor too low to affect the call quality.
[0106] In some implementations, the call volume adjustment operation is performed according to the target volume, wherein if the current call type is hands-free playback, the output parameters of the speaker are adjusted; if the current call type is earphone or receiver playback, the output parameters of the earphone or receiver are adjusted.
[0107] The volume adjustment method provided in the embodiment of the present application automatically adjusts the call volume of the smart terminal according to the current call type and the collected audio data when the smart terminal is in a call state, wherein different call types correspond to different volume adjustment parameters, thereby satisfying the user's call needs under different call types.
[0108] Based on the contents described in the above embodiments, in some embodiments of the present application, determining the target volume according to the first volume adjustment parameter and the audio data includes:
[0109] The audio data is preprocessed to separate the environmental noise data and the first target voice data in the audio data.
[0110] In some implementations, first audio data collected by a microphone may be acquired; the first audio data may be preprocessed to separate environmental noise data and first target voice data in the first audio data, where the first target voice data includes one's own voice data.
[0111] Reference Figure 4 , Figure 4 A schematic diagram of an audio data processing flow provided in an embodiment of the present application.
[0112] In some implementations, the above audio data processing flow includes:
[0113] S401, Audio Data Collection
[0114] In some implementations, during a call, the smart terminal may use a microphone to collect sounds around the smart terminal to obtain the above audio data.
[0115] S402, Audio Data Analysis
[0116] In some implementations, the audio data is analyzed to determine the own environmental sound and the own speech sound in the audio data.
[0117] In some implementations, the audio data may be annotated to distinguish the time periods of the speaker's own speech and the ambient sound.
[0118] S403, audio data separation
[0119] In some implementations, one's own environmental sound and one's own speech sound may be separated from the audio data based on the above-mentioned annotation information.
[0120] In some embodiments, a deep learning model suitable for sound source separation may be pre-selected, and then the model may be trained using statistical properties of the audio signal (such as temporal consistency, spatial difference, etc.). For example, the model may be trained using a mixture consistency loss, which encourages the model to recover a sound source signal that is statistically similar to the original mixed audio from the mixed audio.
[0121] The above audio data is input into the trained model, and the model will output the mask of each sound source or directly output the separated sound source signal. According to the mask or signal output by the model, the self-speech sound and the environmental sound in the above audio data are separated.
[0122] In some implementations, the target volume may be determined based on the first volume adjustment parameter, ambient noise data, and / or first target voice data.
[0123] Optionally, the target volume is positively correlated with the ambient noise data and / or the first target voice data.
[0124] The environmental noise data indicates the noise level in the current environment and may be a numerical value, wherein a larger numerical value indicates a greater noise level.
[0125] The first target voice data represents one's own voice data, and may also be a numerical value, where a larger numerical value indicates a louder voice of one's own speech.
[0126] In some implementations, the target volume may be determined based only on environmental noise data.
[0127] For example, when the ambient noise increases, increasing the target volume can help the user hear the other party's voice clearly. When the ambient noise decreases, lowering the target volume can prevent the other party's voice from affecting other people around or leaking personal privacy.
[0128] In some implementations, the target volume may be determined based only on the first target voice data.
[0129] For example, when the volume of one's own speech increases, it means that the user's current environment does not have the risk of affecting other people around or leaking personal privacy, so the above-mentioned target volume can be increased synchronously; when the volume of one's own speech decreases, it means that the user's current environment may have the risk of affecting other people around or leaking personal privacy, so the above-mentioned target volume can be lowered synchronously.
[0130] In some implementations, the target volume may be determined by combining the environmental noise data and the first target voice data.
[0131] For example, when the ambient noise and the volume of one's own voice increase at the same time, increasing the target volume simultaneously can help the user hear the voice of the other party clearly. When the ambient noise and the volume of one's own voice decrease at the same time, decreasing the target volume simultaneously can prevent the voice of the other party from affecting other people around or leaking personal privacy. When the ambient noise decreases and the volume of one's own voice increases (the user may have moved from outdoor to indoor), the target volume can also be increased. When the ambient noise increases and the volume of one's own voice decreases (the user may have moved from indoor to outdoor), the target volume can also be decreased.
[0132] In an embodiment of the present application, the target volume is determined based on the above-mentioned first volume adjustment parameter, the ambient noise data and / or the first target voice data, so that the volume adjustment can be achieved more accurately to meet the user's call needs.
[0133] Based on the contents described in the above embodiments, in some embodiments of the present application, the above method further includes:
[0134] Acquire the second audio data received from the other party of the call; process the second audio data according to the above target volume; and output the processed second audio data.
[0135] In some implementations, the smart terminal may obtain the received real-time audio data stream sent by the other party of the call, that is, the second audio data, and process the second audio data according to the target volume before outputting it.
[0136] In some implementations, the processing of the second audio data according to the target volume includes:
[0137] The environmental noise data and the second target voice data in the second audio data are separated, and the second target voice data includes the voice data of the other party of the call; and the volume of the second target voice data is adjusted according to the target volume.
[0138] In some implementations, the volume of the voice data of the other party in the call may be adjusted according to the determined target volume.
[0139] For example, if the volume of the other party's voice data is lower than the target volume, it is amplified; if it is higher than the target volume, it is reduced.
[0140] In some implementations, a denoising algorithm (such as spectral subtraction, Wiener filtering, etc.) may also be used to eliminate environmental noise data in the second audio data to reduce noise interference and improve the clarity of the second target speech data.
[0141] Reference Figure 5 , Figure 5This is another schematic diagram of an audio data processing flow provided in an embodiment of the present application.
[0142] In some implementations, the above audio data processing flow includes:
[0143] S501, Audio Data Collection
[0144] In some implementations, during a call, the smart terminal may obtain a call data packet received by the smart terminal, and obtain the second audio data by parsing the call data packet.
[0145] It is understandable that during a call, the smart terminal communicates with the other party through a mobile communication network. The voice data of both parties are encapsulated into data packets and transmitted in the network. The communication module (such as baseband chip, radio frequency module, etc.) of the smart terminal is responsible for receiving call data packets from the network. These data packets contain the audio data of both parties.
[0146] S502: Second audio data analysis
[0147] In some implementations, the second audio data is analyzed to determine the environmental noise data and the voice data of the other party in the second audio data.
[0148] S503: Second audio data separation
[0149] The environmental noise data and the voice data of the other party of the call are separated from the second audio data.
[0150] In some embodiments, the second audio data may be input into a pre-trained model, which will output a mask for each sound source or directly output a separated sound source signal. Based on the mask or signal output by the model, the ambient noise data in the second audio data is separated from the voice data of the other party.
[0151] S504: Preprocessing of the second audio data
[0152] In some implementations, the volume of the voice data of the other party in the call may be adjusted according to the determined target volume.
[0153] In addition, a denoising algorithm may be used to eliminate environmental noise data in the second audio data to reduce noise interference and improve the clarity of the second target voice data.
[0154] S505: Output the processed voice data of the other party.
[0155] In the embodiment of the present application, by separating the ambient noise data and the second target voice data (i.e., the voice data of the other party in the call) in the second audio data, the impact of background noise on the call quality can be significantly reduced. This helps to ensure the clarity and intelligibility of the call and improve the user experience. In addition, by adjusting the volume of the second target voice data according to the target volume, it can be ensured that the voices of both parties in the call maintain an appropriate loudness at the receiving end, avoiding unclear hearing or discomfort caused by excessive or low volume.
[0156] In some embodiments of the present application, a volume adjustment device is also provided. Figure 6 , Figure 6 Schematic diagram of a module of a volume adjustment device provided in an embodiment of the present application. In some embodiments of the present application, the volume adjustment device 60 includes:
[0157] The monitoring module 601 is used to monitor the current call type when the smart terminal is in a call state.
[0158] The acquisition module 602 is used to acquire a first volume adjustment parameter corresponding to the above call type.
[0159] The processing module 603 is used to obtain the collected audio data, determine the target volume according to the first volume adjustment parameter and the audio data, and perform the call volume adjustment operation according to the target volume.
[0160] As described above, the volume adjustment device provided in the embodiment of the present application can be applied to a smart terminal. When the smart terminal is in a call state, the call volume of the smart terminal is automatically adjusted according to the current call type and the collected audio data, wherein different call types correspond to different volume adjustment parameters, thereby satisfying the user's call needs under different call types.
[0161] In some embodiments, the call type includes any one of the following:
[0162] Voice calls played through handset, voice calls played through hands-free, voice calls played through headset, video calls, and voice calls in games.
[0163] In some embodiments, the processing module 603 is used to:
[0164] Preprocessing the audio data to separate the environmental noise data and the first target voice data in the audio data;
[0165] A target volume is determined according to the first volume adjustment parameter, the above-mentioned environmental noise data and / or the first target voice data.
[0166] In some embodiments, the first target voice data includes one's own voice data.
[0167] In some embodiments, the volume adjustment parameter includes at least one of the following: a volume gain parameter, a dynamic range compression parameter, a noise suppression parameter, an automatic gain control parameter, and an equalizer parameter;
[0168] The target volume is positively correlated with the environmental noise data and / or the first target voice data.
[0169] In some embodiments, the processing module 603 is further configured to:
[0170] Acquire the received second audio data of the other party of the call;
[0171] Processing the second audio data according to the target volume;
[0172] The processed second audio data is output.
[0173] In some embodiments, the processing module 603 is used to:
[0174] Separating the environmental noise data and the second target voice data from the second audio data, wherein the second target voice data includes the voice data of the other party of the call;
[0175] According to the target volume, the volume of the second target voice data is adjusted.
[0176] The volume adjustment device provided in the embodiment of the present application can be used to execute the technical solution of the volume adjustment method described in the above embodiment. Its implementation principle and technical effect are similar and will not be repeated here.
[0177] An embodiment of the present application further provides an intelligent terminal, including a memory and a processor. The memory stores a processing program, and when the processing program is executed by the processor, the steps of the volume adjustment method in any of the above embodiments are implemented.
[0178] An embodiment of the present application further provides a storage medium, on which a processing program is stored. When the processing program is executed by a processor, the steps of the volume adjustment method in any of the above embodiments are implemented.
[0179] In the embodiments of the smart terminal and the storage medium provided in the present application, all technical features of any of the above-mentioned volume adjustment method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the above-mentioned method embodiments, and will not be repeated here.
[0180] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the volume adjustment method in the above various possible implementation modes.
[0181] An embodiment of the present application further provides a chip, including a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the volume adjustment method in various possible implementation modes as described above.
[0182] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0183] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
[0184] The steps in the volume adjustment method provided in the embodiment of the present application can be adjusted in order, combined, and deleted according to actual needs.
[0185] The units in the intelligent terminal adopted in the embodiment of the present application can be merged, divided and deleted according to actual needs.
[0186] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.
[0187] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0188] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.
[0189] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.
[0190] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. Computer instructions can be stored in a storage medium, or transmitted from one storage medium to another storage medium. For example, computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. Available media can be magnetic media, (e.g., floppy disk, storage disk, tape), optical media (e.g., DVD), or semiconductor media (e.g., solid-state storage disk Solid State Disk (SSD)), etc.
[0191] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A volume adjustment method, characterized in that: The method comprises: When in a call state, monitor the current call type; Obtaining a first volume adjustment parameter corresponding to the call type; The collected audio data is acquired, a target volume is determined according to the first volume adjustment parameter and the audio data, and a call volume adjustment operation is performed according to the target volume.
2. The method according to claim 1, characterized in that The call type includes any one of the following: Voice calls played through handset, voice calls played through hands-free, voice calls played through headset, video calls, and voice calls in games.
3. The method according to claim 1 or 2, characterized in that: The determining the target volume according to the first volume adjustment parameter and the audio data includes: Preprocessing the audio data to separate environmental noise data and first target voice data in the audio data; The target volume is determined according to the first volume adjustment parameter, the environmental noise data and / or the first target voice data.
4. The method according to claim 3, characterized in that The first target voice data includes own voice data.
5. The method according to claim 4, characterized in that The volume adjustment parameter includes at least one of the following: a volume gain parameter, a dynamic range compression parameter, a noise suppression parameter, an automatic gain control parameter, and an equalizer parameter; The target volume is positively correlated with the environmental noise data and / or the first target voice data.
6. The method according to claim 1 or 2, characterized in that: The method further comprises: Acquire the received second audio data of the other party of the call; Processing the second audio data according to the target volume; The processed second audio data is output.
7. The method according to claim 6, characterized in that The processing of the second audio data according to the target volume includes: Separating the environmental noise data and the second target voice data in the second audio data, wherein the second target voice data includes the voice data of the other party of the call; The volume of the second target voice data is adjusted according to the target volume.
8. A volume adjustment device, characterized in that: The device comprises: A monitoring module, used to monitor the current call type when the smart terminal is in a call state; An acquisition module, used to acquire a first volume adjustment parameter corresponding to the call type; The processing module is used to obtain the collected audio data, determine the target volume according to the first volume adjustment parameter and the audio data, and perform a call volume adjustment operation according to the target volume.
9. An intelligent terminal, characterized in that: The intelligent terminal comprises: a memory and a processor, wherein a processing program is stored in the memory, and when the processing program is executed by the processor, the steps of the volume adjustment method according to any one of claims 1 to 7 are implemented.
10. A storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the steps of the volume adjustment method according to any one of claims 1 to 7 are implemented.
Citation Information
Cited By
Radio capable of adaptively adjusting volume and adaptive volume adjusting method thereof
CN119945473A
