Volume control method and device, audio playing equipment and storage medium
By obtaining the audio playback data and environmental noise data of the audio playback device, using preset mapping relationships and algorithm models, combining user characteristics and distance information, the volume is automatically adjusted, which solves the problem of users frequently adjusting the volume, and realizes adaptive control and accuracy of the volume.
Patent Information
- Application Number
- CN202410123055.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-29
- Publication Date
- 2025-07-29
AI Technical Summary
Users need to frequently adjust the volume through physical buttons or remote control to adapt to changes in ambient noise and audio playback types, resulting in inconvenient operation.
By obtaining the audio playback data and environmental noise data of the audio playback device, using preset mapping relationships and algorithm models, the volume is automatically adjusted to adaptively adaptive control of the volume, combined with user characteristics and distance information.
It realizes automatic volume adjustment, reduces user manual operations, and improves the accuracy and user experience of volume control.
Smart Images

Figure CN120390178A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of device control, and in particular, to a volume control method, apparatus, audio playback device, and storage medium. Background Art
[0002] With the development of electronic technology, the use of terminals has become increasingly popular. Among them, the use of terminals often involves volume adjustment. In related technologies, many terminals are provided with physical buttons for adjusting the volume, or a remote control for the supporting terminal is provided to achieve the adjustment of the terminal volume. However, the usage environment of the terminal and the types of audio playback vary greatly. Changes in environmental noise, playback types, etc. will also affect the volume of the terminal, resulting in users needing to frequently adjust the volume through physical buttons or remote controls. Summary of the Invention
[0003] This application provides a volume control method, apparatus, audio playback device, and storage medium, aiming to solve the technical problem that users in the prior art need to frequently adjust the volume through physical buttons or remote controls.
[0004] In a first aspect, this application provides a volume control method, including:
[0005] Obtain the audio playback data of the audio playback device to be adjusted, as well as the environmental noise data, where the audio playback data includes a first frequency and a first amplitude;
[0006] Determine a second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency;
[0007] Determine the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude;
[0008] Control the audio playback device to output volume according to the target volume.
[0009] In a possible implementation manner of this application, the determining the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude includes:
[0010] Extract the frequency domain features and time domain features in the environmental noise data through a feature extraction module in a preset scenario model;
[0011] Perform classification processing on the frequency domain features and time domain features through a classification module in the preset scenario model, and output the target scenario parameters corresponding to the environmental noise data;
[0012] Determine the target volume according to the target scenario parameters and the difference between the first amplitude and the second amplitude.
[0013] In a possible implementation manner of the present application, before determining the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude, the method further includes:
[0014] Obtaining an environmental image of the environment corresponding to the audio playback device, and extracting user features of a user on the environmental image, where the user features include at least one of user age, user identification, and user gender;
[0015] Obtaining a target distance between the audio playback device and the user;
[0016] Determining the target volume according to the environmental noise data, and the difference between the first amplitude and the second amplitude, includes:
[0017] Determining the target volume according to the environmental noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude.
[0018] In a possible implementation manner of the present application, determining the target volume according to the environmental noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude, includes:
[0019] Processing the user features through a user feature processing module in the volume algorithm model to obtain an initial volume;
[0020] Processing the environmental noise data, the target distance, and the difference between the first amplitude and the second amplitude through a parameter processing module in the volume algorithm model to obtain a corrected volume;
[0021] Fusing the initial volume and the corrected volume through a fusion module in the volume algorithm model, and outputting to obtain the target volume.
[0022] In a possible implementation manner of the present application, after fusing the initial volume and the corrected volume through a fusion module in the volume algorithm model and outputting to obtain the target volume, the method further includes:
[0023] If an operation for adjusting the target volume is detected within a preset duration, obtaining an adjustment volume corresponding to the operation;
[0024] Updating the volume algorithm model according to the adjustment volume, the environmental noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude.
[0025] In a possible implementation manner of the present application, after obtaining the target distance between the audio playback device and the user, the method further includes:
[0026] If the environmental image includes at least two users, according to the corresponding relationship between the target distance and the users, and the corresponding relationship between the users, determine the user characteristics corresponding to each target distance;
[0027] According to the user characteristics corresponding to each target distance, determine the fusion weight corresponding to each target distance, and fuse the target distances according to the fusion weight to obtain the fused target distance;
[0028] Execute the step of determining the target volume according to the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude according to the fused target distance.
[0029] In a possible implementation manner of the present application, before determining the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency, the method further includes:
[0030] Identify the target audio interval to which the first frequency belongs, and obtain the target mapping relationship associated with the target audio interval and stored;
[0031] The determination of the mapping relationship includes the steps of:
[0032] Collect the actual audio data corresponding to different audio test data during playback, and extract the actual amplitude corresponding to each second frequency in the actual audio data, where the second frequency is included in the audio test data;
[0033] Divide the audio intervals according to the distribution information of the actual amplitudes corresponding to the second frequencies;
[0034] In each audio interval, create a mapping relationship according to the distribution information of the actual amplitudes corresponding to the second frequencies, and store the mapping relationship corresponding to the audio interval.
[0035] In a second aspect, the present application further provides a volume control device, and the device includes:
[0036] An acquisition module, configured to acquire the audio playback data of the audio playback device to be adjusted and environmental noise data, where the audio playback data includes a first frequency and a first amplitude;
[0037] A first determination module, configured to determine the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency;
[0038] A second determination module, configured to determine a target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude;
[0039] An output module, configured to control the audio playback device to output volume according to the target volume.
[0040] In a third aspect, the present application further provides an audio playback device, which includes:
[0041] One or more processors;
[0042] A memory; and
[0043] One or more applications, where the one or more applications are stored in the memory and are configured to be executed by the processor to implement the volume control method described in any one of the above.
[0044] In a fourth aspect, the present application further provides a computer-readable storage medium, which is characterized in that a computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in the volume control method described in any one of the above.
[0045] The present application provides a volume control method, device, audio playback device and storage medium. By obtaining audio playback data of an audio playback device to be adjusted and environmental noise data, the audio playback data includes a first frequency and a first amplitude; determining a second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency; determining a target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude; controlling the audio playback device to output volume according to the target volume. This solution obtains the audio playback data of the audio playback device, analyzes the audio playback data, determines the second amplitude corresponding to the audio playback data through the mapping relationship to represent the amplitude perceived by the user corresponding to the frequency in the audio playback data, and determines the difference between the first amplitude and the second amplitude to determine the deviation between the amplitude perceived by the user and the playback amplitude (first amplitude) in the audio playback data played by the audio playback device. Furthermore, in combination with the environmental noise data, the target volume is determined for volume adjustment, and the volume is adaptively adjusted in combination with the user's volume perception of different audio playback data played in different playback modes of the program and the environmental noise on the audio playback device, avoiding the disadvantages of the user frequently adjusting the volume through physical buttons or a remote control, realizing automatic volume control, and ensuring the accuracy of volume control. Description of the Drawings
[0046] To more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the accompanying drawings required for the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those skilled in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.
[0047] Figure 1 is a schematic diagram of the scenario of the volume control method provided by the embodiments of the present application;
[0048] Figure 2 is a schematic flowchart of an embodiment of the volume control method provided by the embodiments of the present application;
[0049] Figure 3 is a schematic flowchart of one implementation scheme for determining the target volume in the volume control method provided by the embodiments of the present application;
[0050] Figure 4 is a schematic flowchart of another implementation scheme for the volume control method provided by the embodiments of the present application;
[0051] Figure 5 is a schematic flowchart of yet another implementation scheme for the volume control method provided by the embodiments of the present application;
[0052] Figure 6 is a schematic diagram for creating a distribution relationship according to the corresponding relationship between the actual amplitude and the second frequency in the volume control method provided by the embodiments of the present application;
[0053] Figure 7 is a schematic flowchart of a specific implementation manner of the volume control method provided by the embodiments of the present application;
[0054] Figure 8 is a schematic structural diagram of an embodiment of the volume control device provided by the embodiments of the present application;
[0055] Figure 9 is a schematic structural diagram of an embodiment of the volume playback device provided by the embodiments of the present application. Detailed implementation manners
[0056] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some embodiments of the present invention, rather than all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present invention.
[0057] In the description of the present invention, it should be understood that the orientation or positional relationship indicated by terms such as "center", "longitudinal", "transverse", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it should not be construed as a limitation to the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include one or more of the said features. In the description of the present invention, "a plurality of" means two or more unless otherwise specifically defined.
[0058] In the embodiments of the present application, "and / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / ", unless otherwise specified, generally represents an "or" relationship between the associated objects before and after.
[0059] In the present application, the term "exemplary" is used to mean "serving as an example, illustration, or explanation". Any embodiment described as "exemplary" in the present application is not necessarily construed as being more preferred or having more advantages than other embodiments. In order for any person skilled in the art to implement and use the present invention, the following description is given. In the following description, details are set forth for purposes of explanation. It should be understood that those of ordinary skill in the art can recognize that the present invention can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the present invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope that conforms to the principles and features disclosed in the present application.
[0060] The embodiments of the present application provide a volume control method, device, audio playback device, and computer-readable storage medium (the computer-readable storage medium may be abbreviated as the storage medium in full text), which will be described in detail below respectively.
[0061] The volume control method in the embodiments of the present invention is applied to a volume control device, which is arranged in an audio playback device. The audio playback device is provided with one or more processors, a memory, and one or more application programs. One or more of the application programs are stored in the memory and configured to be executed by the processor to implement the volume control method. The audio playback device can be a terminal, such as a mobile phone, a tablet computer, a television, or an interactive smart tablet. The audio playback device can also be a server or a service cluster composed of multiple servers.
[0062] As Figure 1 shown, Figure 1 FIG. is a schematic diagram of the scenario of the volume control method in the embodiments of the present application. In the volume control scenario of the embodiments of the present invention, the audio playback device 100 (the volume control device is integrated in the audio playback device 100) is included. In the audio playback device 100, a computer-readable storage medium corresponding to volume control runs to execute the steps of volume control.
[0063] It can be understood that Figure 1 the audio playback device in the scenario of the volume control method shown, or the devices included in the audio playback device do not constitute a limitation to the embodiments of the present invention. That is, the number of devices, the types of devices included in the scenario of the volume control method, or the number of devices and the types of devices included in each device do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution required to be protected in the embodiments of the present invention.
[0064] In the embodiments of the present invention, the audio playback device 100 is mainly used for: obtaining the audio playback data of the audio playback device to be adjusted and the environmental noise data, where the audio playback data includes a first frequency and a first amplitude; determining the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency; determining the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude; and controlling the audio playback device to perform volume output according to the target volume.
[0065] In the embodiments of the present invention, the audio playback device 100 can be an independent audio playback device, or a network of audio playback devices or a cluster of audio playback devices composed of audio playback devices. For example, the audio playback device 100 described in the embodiments of the present invention includes, but is not limited to, a computer, a network host, a single network audio playback device, a set of multiple network audio playback devices, or a cloud audio playback device composed of multiple audio playback devices. Among them, the cloud audio playback device is composed of a large number of computers or network audio playback devices based on cloud computing.
[0066] Those skilled in the art can understand that Figure 1The application environment shown is only one application scenario of the solution of this application, and does not constitute a limitation on the application scenario of the solution of this application. Other application environments may also include more or fewer audio playback devices than those shown in Figure 1 or the network connection relationship of the audio playback devices. For example, Figure 1 only 1 audio playback device is shown in . It can be understood that the scenario of this volume control method may also include one or more other audio playback devices, which are not specifically limited here; the audio playback device 100 may also include a memory for storing data.
[0067] In addition, in the scenario of the volume control method of this application, the audio playback device 100 may be provided with a display device 200, or the audio playback device 100 is not provided with a display device and is communicatively connected to an external display device. The display device 200 is used to output the result of the execution of the volume control method in the audio playback device. The audio playback device 100 can access the background database 300 (the background database can be in the local memory of the audio playback device, and the background database can also be set in the cloud). The background database 300 stores information related to volume control.
[0068] It should be noted that Figure 1 the schematic diagram of the scenario of the volume control method shown is only an example. The scenario of the volume control method described in the embodiments of the present invention is for more clearly explaining the technical solution of the embodiments of the present invention, and does not constitute a limitation on the technical solution provided by the embodiments of the present invention.
[0069] Based on the above scenario of the volume control method, embodiments of the volume control method are proposed.
[0070] As shown in Figure 2 is a schematic flowchart of an embodiment of the volume control method in an embodiment of this application. The volume control method includes steps S201 - S204:
[0071] S201. Obtain the audio playback data of the audio playback device to be adjusted and the environmental noise data. The audio playback data includes a first frequency and a first amplitude.
[0072] Among them, the audio playback data, that is, the spectrum corresponding to the output when the audio playback device plays any program or any audio. It can be understood that the spectrum is generally an image including the relationship between the frequency and amplitude of at least one single signal; that is, further, it can be understood that the first frequency and the first amplitude may correspondingly include multiple, and each first frequency has a corresponding first amplitude.
[0073] Specifically, the audio playback data can be obtained by acquiring data segments of the audio output channels of the audio playback device, or by accessing a database corresponding to the current playback program mode of the audio playback device to obtain pre-stored audio playback data corresponding to the program mode. Exemplarily, different program modes have different sound effect systems, and corresponding preset spectra or audio playback data to be played are stored for different sound effect systems. The audio playback data can be accessed through the access address (user / standard / movie / news / sport) corresponding to the sound effect system to achieve the acquisition of the audio playback data.
[0074] Among them, the environmental noise data, that is, the environmental noise data of the environment corresponding to the audio playback device. Exemplarily, the environmental noise data can be noise audio, noise decibels, etc. The present application does not make specific limitations. The environmental noise data can be acquired by a noise collection device. Exemplarily, the ADMP521 is a high-performance digital MEMS microphone module with low noise and high sensitivity, suitable for high-demand audio recording and speech recognition applications, and can collect the decibels of the current environment in real time as the audio playback data.
[0075] Specifically, in the implementation scheme of the present application, the volume control method is applied to an audio playback device. The audio playback device can be an electronic device such as a TV, mobile phone, tablet, computer, etc. that can perform audio playback. During the audio playback process, the audio playback device can obtain the audio playback data of the audio playback device and collect the environmental noise data according to the adjustment frequency or in response to the volume automatic adjustment instruction.
[0076] S202. Determine the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency.
[0077] Among them, the target mapping relationship can be a preset general mapping relationship, or one of the mapping relationships respectively set for different frequency ranges. It can be understood that the mapping relationship can be created by playing audio test data (with the same format as the audio playback data) and collecting the actual audio data perceived by the user, according to the corresponding relationship between the amplitude in the actual audio data and the frequency in the audio test data. It can be understood that the mapping relationship can be a mapping table, a mapping model, or a calculation formula. The present application does not make specific limitations.
[0078] Among them, the second amplitude, that is, the amplitude corresponding to the first frequency in the actual audio data perceived by the user. It can be understood that the propagation losses of different audio playback data are different, so the volume perceived by the user is also different, and the amplitude is the determining factor of the volume. Therefore, the second amplitude determined according to the mapping relationship can represent the amplitude after the propagation loss of the first amplitude.
[0079] Specifically, in one implementation of the present application, after the audio playback device obtains the audio playback data and the environmental noise data, the second amplitude is output by inputting the first frequency into the corresponding target mapping relationship.
[0080] S203. Determine the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude.
[0081] Specifically, the present application does not specifically limit the implementation manner of determining the target volume according to the noise data and the difference. Exemplarily:
[0082] In some implementations of the present application, the environmental noise data is the noise decibel value. By calculating the difference between the first amplitude and the second amplitude and looking up the preset volume mapping table according to the environmental noise data, the target volume corresponding to the difference and the environmental noise data is obtained.
[0083] In other implementations of the present application, the environmental noise data is the noise audio. By analyzing the environmental noise audio and identifying scenes such as quiet, human voice, white noise, etc. according to the sound frequency domain / intensity in the noise audio, the target scene parameters of the current environment are determined, such as the human conversation scene, the environmental noise scene, etc. Further, calculate the difference between the first amplitude and the second amplitude, input the target scene parameters and the difference into the preset volume algorithm model, and output the target volume.
[0084] S204. Control the audio playback device to output volume according to the target volume.
[0085] Specifically, in the implementation of the present application, after the audio playback device determines the target volume according to the above implementation, the target volume is sent to the volume control module of the audio playback device to control the audio playback device to perform audio output according to the target volume.
[0086] It can be understood that different sound effect systems emphasize different audio focuses, so the frequencies corresponding to different sound effect systems are different. And due to different propagation losses and different user perception sensitivities to different frequencies, it will cause users to perceive different volumes under different sound effect systems played at the same volume, which may further lead to the volume not meeting the user's needs. Therefore, in this implementation, according to the difference between the first amplitude actually output by the audio playback device and the second amplitude corresponding to the user's perceived volume information, combined with the environmental noise of the environment corresponding to the audio playback device, a target volume is re-determined to ensure the accuracy of the target volume. At the same time, the audio playback device is controlled to perform volume output according to the target volume to achieve automatic volume control.
[0087] Further, based on the above embodiments, refer to Figure 3 , Figure 3 which is a schematic flowchart of one of the implementation schemes for determining the target volume in the volume control method provided by the embodiments of the present application, specifically including steps S301 - S303:
[0088] S301. Extract the frequency - domain features and time - domain features in the environmental noise data through the feature extraction module in the preset scene model.
[0089] Specifically, the preset scene model mainly uses the scene model algorithm: identify scenes such as quiet, human voice, white noise, etc. according to the sound frequency domain / intensity. Specifically: through the feature extraction module in the preset scene model, extract the frequency - domain features and time - domain features in the environmental noise data, 如 such as sound intensity and spectral features.
[0090] S302. Classify the frequency - domain features and time - domain features through the classification module in the preset scene model, and output the target scene parameters corresponding to the environmental noise data.
[0091] It can be understood that the feature extraction module in the preset scene model is an input data processing module, and the classification module can be obtained through training. Exemplarily, prepare an environmental noise data set with labeled scenes, extract the features of the environmental noise data to obtain the frequency - domain features and time - domain features, use the extracted features as the input, and use the scene label as the target output; use the machine learning algorithm SVM (SVM algorithm, full name Support Vector Machine (SVM) algorithm, which is a powerful supervised learning algorithm widely used in classification and regression problems) to train the features and labels, and establish a classification model as the classification module in the preset scene model. Its key classification decision function can be expressed as:
[0092] f(x) = sign(Σα_i y_i K(x_i,x)+b);
[0093] where x is the input feature vector, α_i is the weight of the SVM model, y_i is the label, K(x_i,x) is the kernel function, and b is the bias term;
[0094] Further, use the trained classification model as the classification module (sub - model) in the preset scene model. When in use, classify the frequency - domain features and time - domain features through the classification module in the preset scene model, and output the target scene parameters corresponding to the environmental noise data.
[0095] S303. Determine the target volume according to the target scenario parameter and the difference between the first amplitude and the second amplitude.
[0096] Specifically, in one implementation of the present application, input the target scenario parameter and the difference between the first amplitude and the second amplitude into a preset volume algorithm model, and output the target volume.
[0097] It can be understood that, in some implementations of the present application, the output end corresponding to the target scenario parameter output by the preset scenario model can be connected to one of the input ends of the volume algorithm model, that is, input the environmental noise data into the preset scenario model, and the output of the preset scenario model is input into the volume algorithm model.
[0098] In this solution, the target scenario parameter is identified through the environmental noise data, and the target volume is corrected according to the target scenario parameter combined with the difference, reducing the data processing amount of the combined processing of the environmental noise data and the difference, and improving the data processing efficiency.
[0099] Further, on the basis of the above implementation, see Figure 4 , Figure 4 which is a schematic flowchart of another implementation of the volume control method provided by the embodiment of the present application, specifically including steps S401 - S406:
[0100] S401. Obtain the audio playback data of the audio playback device to be adjusted and the environmental noise data, where the audio playback data includes the first frequency and the first amplitude.
[0101] S402. Determine the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency.
[0102] Specifically, the specific implementation steps of steps S401 - S402 refer to any of the above implementations.
[0103] S403. Obtain the environmental image of the environment corresponding to the audio playback device, and extract the user features of the user on the environmental image.
[0104] Among them, the user features include at least one of the user age, user identification, and user gender.
[0105] Specifically, the environmental image can be collected by an image acquisition device installed on the audio playback device or an image acquisition device installed in the environmental space corresponding to the audio playback device and communicating with the audio playback device, and the user features of the user on the environmental image are extracted by means of portrait recognition feature extraction.
[0106] Exemplarily, in some embodiments of the present application, the user feature includes the user's age. After the audio playback device obtains the environmental image, it inputs the environmental image into a preset person algorithm model for processing. Specifically, by performing a screenshot process on the environmental image, a face image is obtained, and age identity recognition is performed on the face image. In the age identity recognition of the portrait, a convolutional neural network (CNN) algorithm based on deep learning is used. Among them, by using a pre-trained VGGNet model, accurate age recognition can be achieved. The specific implementation is as follows:
[0107] A. Input: Use the face image as the input of the CNN;
[0108] B. Feature extraction: The CNN extracts the feature representation of the face image through multiple convolutional and pooling layers;
[0109] C. Age prediction: Map the extracted features to the output layer for age prediction through a fully connected layer, and the user's age is output.
[0110] Specifically, the implementation function of age identity recognition can be obtained through training. The loss function in the specific training process: Generally, the mean squared error (MSE) is used as the loss function to minimize the error between the predicted age and the real age. The formula is as follows:
[0111] L = (1 / N) * Σ(y_pred - y_true)^2;
[0112] Among them, L is the loss function, N is the number of samples, y_pred is the predicted age, and y_true is the real age.
[0113] Training: Use a large number of face image data with labeled ages for training, and adjust the network weights through the backpropagation algorithm to make the prediction results more accurate.
[0114] S404. Obtain the target distance between the audio playback device and the user.
[0115] Specifically, after the audio playback device extracts the user characteristics, it obtains the target distance between each user and the audio playback device. It can be understood that the target distance can be obtained by performing user recognition on the environmental image and coordinate transformation to obtain the target distance corresponding to each user, or by using ultrasonic positioning system technology. By using a high-performance ultrasonic ranging sensor, Hokuyo UST-10LX, which has a small size and lightweight design, it provides stable measurement performance and high accuracy. Its principle is to use ultrasonic sensors to measure the distance between a person and a base station, and calculate the spatial position of the person through the measurement results of multiple base stations. This technology can provide high accuracy and perform well in indoor environments.
[0116] S405. Determine the target volume according to the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude.
[0117] Specifically, in the implementation scheme of the present application, the specific implementation manner of determining the target volume is not specifically limited in the present application. Exemplarily:
[0118] In one implementation scheme of the present application, by looking up a preset relationship group, obtain the environmental noise data, the user characteristics, the target distance, and the target volume corresponding to the difference between the first amplitude and the second amplitude.
[0119] In some other implementation schemes of the present application, determine the first volume through user characteristics; further correct the first volume through the target scenario to determine the second volume; further correct the second volume through the target position to determine the third volume; further correct the third volume through the difference between the first amplitude and the second amplitude to determine the target volume. Exemplarily, the user characteristic is recognized as a child (the definition of a child can be achieved through an age threshold) (volume 1) -> the target scenario is quiet (changed to volume 2) -> the target position is 1.5 m in the center (changed to volume 3) -> the program mode is user (the difference between the first amplitude and the second amplitude) (changed to volume 4), which is used as the target volume.
[0120] S406. Control the audio playback device to output volume according to the target volume.
[0121] The specific implementation manner of the specific step S406 is not specifically limited in the present application.
[0122] Exemplarily, in some other embodiments of the present application, an audio playback device obtains audio playback data of the audio playback device to be adjusted and environmental noise data, where the audio playback data includes a first frequency and a first amplitude; determines a second amplitude corresponding to the first frequency according to a target mapping relationship corresponding to the first frequency; obtains an environmental image of the environment corresponding to the audio playback device and extracts user features of a user on the environmental image, where the user features include at least one of user age, user identifier, and user gender; and determines a target volume according to the environmental noise data, the user features, and a difference between the first amplitude and the second amplitude, where the target volume is implemented by referring to the above and finding a mapping table or inputting a volume algorithm model in the same way.
[0123] Exemplarily, in some other embodiments of the present application, an audio playback device obtains audio playback data of the audio playback device to be adjusted and environmental noise data, where the audio playback data includes a first frequency and a first amplitude; determines a second amplitude corresponding to the first frequency according to a target mapping relationship corresponding to the first frequency; obtains a target distance between a user and the audio playback device in the environment corresponding to the audio playback device; and determines a target volume according to the environmental noise data, the target distance, and a difference between the first amplitude and the second amplitude, where the target volume is implemented by referring to the above and finding a mapping table or inputting a volume algorithm model in the same way.
[0124] Furthermore, the embodiments of the present application combine user features and / or user distance to determine the target volume to ensure the accuracy of the target volume.
[0125] Furthermore, on the basis of the above embodiments, the present application also provides a specific implementation manner for determining a target volume through a volume algorithm model, which specifically includes the steps of:
[0126] (1) Process the user features through a user feature processing module in the volume algorithm model to obtain an initial volume;
[0127] It can be understood that the user feature processing module can be a prediction module, a mapping module, etc., and is trained to have the function of obtaining a corresponding initial volume according to user features. Specifically, the present application does not make any limitations.
[0128] (2) Process the environmental noise data, the target distance, and a difference between the first amplitude and the second amplitude through a parameter processing module in the volume algorithm model to obtain a corrected volume;
[0129] Specifically, the parameter processing module may be a fusion module. Exemplarily, in one implementation of the present application, the fusion module has corresponding fusion coefficients for each parameter, processes each parameter through the fusion coefficients, and then performs superposition to achieve fusion. It can be understood that the fusion function of the fusion module can be obtained through training.
[0130] (3) Fuse the initial volume and the corrected volume through the fusion module in the volume algorithm model, and output the target volume;
[0131] Specifically, in the implementation of the present application, the audio playback device processes the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude through the volume algorithm model to obtain the determined target volume.
[0132] It can be understood that in the implementation of the present application, the environmental noise data input into the volume algorithm model may be the noise decibel value and the data of the noise audio.
[0133] In some other implementations of the present application, the volume algorithm model may include an environmental noise data processing module. The environmental noise processing module identifies the corresponding target scenario for the input environmental noise data. Further, through the parameter processing module in the volume algorithm model, the target scenario parameters, the target distance, and the difference between the first amplitude and the second amplitude are processed to obtain the corrected volume. Specifically, the present application does not make specific limitations.
[0134] Further, on the basis of the above implementation, refer to Figure 5 , Figure 5 which is a schematic flow diagram of another implementation of the volume control method provided by the embodiment of the present application, specifically including steps S501 - S510:
[0135] S501. Obtain the audio playback data of the audio playback device to be adjusted and the environmental noise data, where the audio playback data includes the first frequency and the first amplitude.
[0136] S502. Determine the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency.
[0137] S503. Obtain the environmental image of the environment corresponding to the audio playback device, and extract the user characteristics of the user on the environmental image.
[0138] Among them, the user characteristics include at least one of the user age, the user identifier, and the user gender.
[0139] S504. Obtain the target distance between the audio playback device and the user.
[0140] S505. Process the user characteristics through the user characteristics processing module in the volume algorithm model to obtain the initial volume.
[0141] S506. Process the environmental noise data, the target distance, and the difference between the first amplitude and the second amplitude through the parameter processing module in the volume algorithm model to obtain the corrected volume.
[0142] S507. Fuse the initial volume and the corrected volume through the fusion module in the volume algorithm model, and output the target volume.
[0143] S508. Control the audio playback device to output volume according to the target volume.
[0144] Specifically, the implementation manners of steps S501 - S508 can be referred to as shown in any of the above embodiments.
[0145] S509. If an operation to adjust the target volume is detected within a preset duration, obtain the adjustment volume corresponding to the operation.
[0146] Specifically, the setting of the preset duration is not specifically limited in this application. It can be 1 minute, 2 minutes, etc. After the audio playback device determines the target volume and plays according to the target volume, by detecting whether the user adjusts the target volume within the preset duration, the preset duration is mainly set to avoid changes in the environmental noise data, the target distance, and the difference between the first amplitude and the second amplitude due to too long a duration. If an operation to adjust the target volume is detected within the preset duration, it indicates that the calculated target volume is inaccurate, and then further obtain the increased volume corresponding to the user's operation, and control the audio playback device to play according to the adjustment volume.
[0147] S510. Update the volume algorithm model according to the adjustment volume, the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude.
[0148] Furthermore, obtain the adjustment volume corresponding to the operation, set the adjustment volume as the labeled volume corresponding to the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude, and update the volume algorithm model to ensure the accuracy of the volume algorithm model.
[0149] Further, on the basis of the above embodiments, the present application also provides an implementation method for correcting the target distance. After obtaining the target distance between the audio playback device and the user in the above embodiments, the user included in the environmental image is further identified. If there are at least two users included in the environmental image, then according to the corresponding relationship between the target distance and the user, and the corresponding relationship between the users, the user characteristics corresponding to each target distance are determined; and further, according to the user characteristics corresponding to each target distance, the fusion weights corresponding to each target distance are determined, and the target distances are fused according to the fusion weights to obtain the fused target distance; in the embodiments of the present application, the target distance is adjusted and fused according to the corresponding relationship between the user characteristics and the target distance to obtain the final target distance, so that the final target distance contains user characteristic information. Further, according to the fused target distance, the step of determining the target volume according to the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude is performed. The accuracy of the target volume is improved. It can be understood that if the user corresponding to the user characteristics is determined to be an elderly person according to the elderly age threshold, the weight of the target distance corresponding to the elderly person is greater, which is used to expand the target distance of the elderly person, so that the obtained target volume can meet the characteristic that the hearing ability of the elderly is lower than that of the young people, and the accuracy of the target volume is improved.
[0150] Further, on the basis of the above embodiments, the present application also provides an embodiment of the volume control method, which specifically includes the following steps:
[0151] (1) Obtain the audio playback data of the audio playback device to be adjusted and the environmental noise data, where the audio playback data includes a first frequency and a first amplitude;
[0152] (2) Identify the target audio range to which the first frequency belongs, and obtain the target mapping relationship associated and stored with the target audio range
[0153] (3) Determine the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency;
[0154] (4) Determine the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude;
[0155] (5) Control the audio playback device to output the volume according to the target volume.
[0156] Specifically, in the solution of this application, the application divides frequencies into different frequency intervals according to the corresponding distribution relationship between the actual amplitudes corresponding to different frequencies, and creates corresponding mapping relationships for each interval. When in use, by determining the target audio interval to which the frequency belongs, the target mapping relationship associated with the target audio interval is obtained. The specific implementation methods include:
[0157] A. Collect the actual audio data corresponding to different audio test data during playback, and extract the actual amplitudes corresponding to each second frequency in the actual audio data, where the second frequency is included in the audio test data;
[0158] Among them, the audio test data is the spectrum output during the playback of the audio playback device, and the actual audio data is the collected spectrum collected by the spectrum collection device after the audio playback device plays the audio test data. After collecting the actual audio data corresponding to different audio test data during playback, the actual amplitudes corresponding to each second frequency in the actual audio data are extracted to obtain the actual amplitudes corresponding to the second frequency in the audio test data.
[0159] B. Divide the audio intervals according to the distribution information of the actual amplitudes corresponding to each second frequency;
[0160] Further, a relationship graph is created according to the corresponding relationship between the actual amplitude and the second frequency. Among them, refer to Figure 6 , Figure 6 , where the X-axis represents the frequency and the Y-axis represents different amplitude amounts. Exemplarily, in the implementation solution of this application, the actual audio data corresponding to different audio test data during playback is collected by the spectrum collection device. For any one audio test data, a curve is drawn to represent the distribution according to the corresponding relationship between the second audio in it and the actual amplitude in the collected actual audio data. It can be understood that the corresponding relationship between the second audio in the audio test data and the actual amplitude in the collected actual audio data can be determined by aligning and processing the similarity and length of the audio test data and the actual audio data, and there is no specific limitation.
[0161] C. In each audio interval, create a mapping relationship according to the distribution information of the actual amplitudes corresponding to each second frequency, and store the mapping relationship corresponding to the audio interval.
[0162] Further, after determining the distribution information of the actual amplitudes corresponding to each second frequency, a calculation function is created according to the distribution law (the above curve) of the distribution information as the mapping relationship, and the mapping relationship is stored corresponding to the audio interval.
[0163] Specifically, in the implementation solution of this application, the following conclusions are obtained:
[0164] Below 1 kHz, the lower the frequency, the louder the sound needs to be to have the same loudness.
[0165] Between 2 kHz and 5 kHz is the most sensitive area of the human ear, and the human ear is more sensitive to this area at low volumes than at high volumes.
[0166] The sensitivity of the human ear to volume is slightly worse between 1 kHz and 2 kHz.
[0167] Above 6 kHz, the sensitivity of the human ear gradually decreases, but compared to low frequencies, the impact of volume on the sensitivity of the human ear to low frequencies is higher than that of frequencies above 5 kHz.
[0168] Overall, the human ear has better sensitivity to mid - frequencies. At low volumes, the human ear is less sensitive to high and low frequencies, but as the volume increases, the difference in the human ear's response to different frequencies gradually becomes smaller.
[0169] Using the above conclusions, establish the corresponding curve function of this model as the mapping relationship. Specifically for different frequency ranges:
[0170] 20 hz - 1.8 khz: y = a / x + b;
[0171] 1.8 khz - 9 khz: y = cx 2 + d;
[0172] 9 khz - 20 khz: y = ex 2 + f;
[0173] Among them, the X - axis represents the frequency, the Y - axis represents different amplitude values, and a / b / c / d / e / f are constants. Then, through the mapping relationship, the calculation of the first amplitude is realized.
[0174] This method of this application should be able to automatically adjust the volume according to factors such as the environment, user needs, and hearing characteristics, providing a better movie - watching experience and the effect of protecting hearing.
[0175] Specifically, see Figure 7 , Figure 7Provide an implementation method of a volume control method. Specifically, this volume control method is applied to a TV set. An environmental image is collected by an image acquisition module, and the characteristics of the person are determined. The characteristics of the viewing crowd are obtained as user characteristics by using an image algorithm. A position acquisition module collects the spatial position of the person to determine the target distance. The decibels of the current environment are collected in real time by a distribution acquisition module. The current scene is analyzed by an algorithm. Further, the audio playback data of the current program mode (user / movie / news / sport) is used as input and input into the volume algorithm (volume algorithm model) respectively. A volume value is initially calculated as the target volume value. If it is detected that the user adjusts based on the target volume value (user fine-tuning), the corresponding data is fed back to the machine learning model for catenary update. Further, the updated parameters are fed back to the volume algorithm (volume algorithm model) to update the volume algorithm (volume algorithm model).
[0176] The implementation solution of this application provides a volume control method. By obtaining the audio playback data of the audio playback device to be adjusted and the environmental noise data, the audio playback data includes a first frequency and a first amplitude; according to the target mapping relationship corresponding to the first frequency, the second amplitude corresponding to the first frequency is determined; according to the environmental noise data and the difference between the first amplitude and the second amplitude, the target volume is determined; the audio playback device is controlled to output the volume according to the target volume. This solution obtains the audio playback data of the audio playback device, analyzes the audio playback data, determines the second amplitude corresponding to the audio playback data through the mapping relationship to represent the amplitude perceived by the user corresponding to the frequency in the audio playback data, and determines the difference between the first amplitude and the second amplitude to determine the deviation between the amplitude perceived by the user and the playback amplitude (first amplitude) in the audio playback data played by the audio playback device. Furthermore, in combination with the environmental noise data, the target volume is determined for volume adjustment, and the volume is adaptively adjusted in combination with the volume perception of the user for different audio playback data in different playback modes of the program and the environmental noise on the audio playback device, avoiding the disadvantages of the user frequently adjusting the volume through physical buttons or a remote control, realizing automatic control of the volume, and ensuring the accuracy of volume control.
[0177] To better implement the volume control method in the embodiments of this application, on the basis of the volume control method, an embodiment of this application also provides a volume control device, as Figure 8 shown. The volume control device includes modules 801-804:
[0178] An acquisition module 801, configured to acquire the audio playback data of the audio playback device to be adjusted and the environmental noise data, where the audio playback data includes a first frequency and a first amplitude;
[0179] The first determination module 802 is configured to determine a second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency;
[0180] The second determination module 803 is configured to determine a target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude;
[0181] The output module 804 is configured to control the audio playback device to output volume according to the target volume.
[0182] In one implementation of the present application, the second determination module 803 is configured to determine a target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude, specifically including:
[0183] Extracting frequency domain features and time domain features in the environmental noise data through a feature extraction module in a preset scenario model;
[0184] Classifying the frequency domain features and time domain features through a classification module in the preset scenario model, and outputting target scenario parameters corresponding to the environmental noise data;
[0185] Determining a target volume according to the target scenario parameters and the difference between the first amplitude and the second amplitude.
[0186] In one implementation of the present application, before the second determination module 803 is configured to determine a target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude, it specifically further includes:
[0187] Obtaining an environmental image of the environment corresponding to the audio playback device, and extracting user features of the user on the environmental image, where the user features include at least one of user age, user identifier, and user gender;
[0188] Obtaining a target distance between the audio playback device and the user;
[0189] For determining the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude, it specifically includes:
[0190] Determining a target volume according to the environmental noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude.
[0191] In one embodiment of the present application, the second determination module 803 is configured to determine a target volume according to the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude, specifically including:
[0192] Process the user characteristics through the user characteristics processing module in the volume algorithm model to obtain an initial volume;
[0193] Process the environmental noise data, the target distance, and the difference between the first amplitude and the second amplitude through the parameter processing module in the volume algorithm model to obtain a corrected volume;
[0194] Fuse the initial volume and the corrected volume through the fusion module in the volume algorithm model, and output the target volume.
[0195] In one embodiment of the present application, after the second determination module 803 fuses the initial volume and the corrected volume through the fusion module in the volume algorithm model and outputs the target volume, it specifically further includes:
[0196] If an operation to adjust the target volume is detected within a preset duration, obtain the adjustment volume corresponding to the operation;
[0197] Update the volume algorithm model according to the adjustment volume, the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude.
[0198] In one embodiment of the present application, after the second determination module 803 obtains the target distance between the audio playback device and the user, it specifically further includes:
[0199] If the environmental image includes at least two users, determine the user characteristics corresponding to each target distance according to the corresponding relationship between the target distance and the users, and the corresponding relationship between the users;
[0200] Determine the fusion weights corresponding to each target distance according to the user characteristics corresponding to each target distance, and fuse the target distances according to the fusion weights to obtain a fused target distance;
[0201] Execute the step of determining the target volume according to the environmental noise data, the user characteristics, the target distance, and the difference between the first amplitude and the second amplitude according to the fused target distance.
[0202] In one implementation of the present application, before the first determination module 802 determines the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency, it specifically further includes:
[0203] Identify the target audio interval to which the first frequency belongs, and obtain the target mapping relationship associated and stored with the target audio interval;
[0204] The determination of the mapping relationship includes the steps of:
[0205] Collect the actual audio data corresponding to different audio test data during playback, and extract the actual amplitude corresponding to each second frequency in the actual audio data, where the second frequency is included in the audio test data;
[0206] Divide the audio interval according to the distribution information of the actual amplitude corresponding to each second frequency;
[0207] Within each audio interval, create a mapping relationship according to the distribution information of the actual amplitude corresponding to each second frequency, and store the mapping relationship corresponding to the audio interval.
[0208] The implementation of the present application provides a volume control device. By setting an acquisition module for acquiring the audio playback data of the audio playback device to be adjusted and environmental noise data, the audio playback data includes a first frequency and a first amplitude; a first determination module for determining the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency; a second determination module for determining the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude; and an output module for controlling the audio playback device to perform volume output according to the target volume. This solution acquires the audio playback data of the audio playback device, analyzes the audio playback data, determines the second amplitude corresponding to the audio playback data through the mapping relationship to represent the user-perceived amplitude corresponding to the frequency in the audio playback data, determines the difference between the first amplitude and the second amplitude to determine the deviation between the user-perceived amplitude and the playback amplitude (first amplitude) in the audio playback data played by the audio playback device, and then combines the environmental noise data to determine the target volume for volume adjustment, adaptively adjusting the volume of the audio playback device according to the user's volume perception of different audio playback data in different playback modes of the program and the environmental noise, avoiding the disadvantages of the user frequently adjusting the volume through physical buttons or a remote control, realizing automatic volume control, and ensuring the accuracy of volume control.
[0209] Further, on the basis of the above implementation, the present application also provides an integrated circuit board, and the integrated circuit board includes:
[0210] The circuit board body;
[0211] One or more processors, disposed on the circuit board body;
[0212] A memory, disposed on the circuit board body and connected to the processor; and
[0213] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the volume control method described in any one of the above embodiments.
[0214] It can be understood that the processor and the memory may be integrated on the circuit board body. It can be understood that in some other embodiments of the present application, the embodiments of the present invention further provide an audio playback device, such as Figure 9 as shown, Figure 9 is a schematic structural diagram of an embodiment of the audio playback device provided in the embodiments of the present application.
[0215] The audio playback device includes:
[0216] One or more processors;
[0217] A memory; and
[0218] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to perform the steps in the volume control method described in any one of the embodiments of the above volume control method embodiments.
[0219] Combined with the above embodiments, it can be seen that in some embodiments of the present application, the audio playback device part includes the integrated circuit board of the above embodiments, and the one or more processors and the memory in the audio playback device part are all integrated on the circuit board body included in the integrated circuit board, and the circuit board body is provided in the audio playback device.
[0220] It can be understood that in some other embodiments of the present application, the processor and the memory in the audio playback device may also not be integrated on the integrated circuit board, that is, the processor and the memory are respectively provided as components of the audio playback device in the electronic device.
[0221] Specifically, the electronic device may include components such as a processor 1001 with one or more processing cores, a memory 1002 with one or more computer-readable storage media, a power supply 1003, and an input unit 1004. Those skilled in the art can understand, Figure 9The structure of the audio playback device shown does not constitute a limitation on the audio playback device, and it may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0222] Among them, the processor 1001 is the volume control center, which connects various parts of the entire audio playback device using various interfaces and lines. By running or executing software programs and / or modules stored in the memory 1002, and by calling the data stored in the memory 1002, it performs various functions of the audio playback device and processes data, thereby monitoring the entire audio playback device. It can be understood that the processor 1001 transmits signals to the controller. Optionally, the processor 1001 may include one or more processing cores; preferably, the processor 1001 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 1001.
[0223] The memory 1002 can be used to store software programs and modules. The processor 1001 executes various functional applications and data processing by running the software programs and modules stored in the memory 1002. The memory 1002 may mainly include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, image playback function, etc.), etc.; the data storage area can store data created according to the use of the audio playback device. In addition, the memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. Correspondingly, the memory 1002 may also include a memory controller to provide the processor 1001 with access to the memory 1002.
[0224] In some embodiments of the present application, the volume control device can be implemented in the form of a computer program, and the computer program can run on an audio playback device as shown in Figure 9 The memory of the audio playback device may store each program module that constitutes the volume control method device. For example, Figure 8 the order acquisition module 801, the first determination module 802, the second determination module 803, and the output module 804 shown in
[0225] For example, Figure 9 the audio playback device shown in Figure 8The acquisition module 801 in the volume control method and apparatus shown executes step S201. The audio playback device can execute step S202 through the first determination module 802. The audio playback device can execute step S203 through the second determination module 803. The audio playback device can execute step S204 through the output module 804. The audio playback device includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the audio playback device is used to provide computing and control capabilities. The memory of the audio playback device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the audio playback device is used to communicate with an external audio playback device through a network connection. When the computer program is executed by the processor, a volume control method is implemented.
[0226] The audio playback device further includes a power supply 1003 for supplying power to each component. Preferably, the power supply 1003 can be logically connected to the processor 1001 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 1003 can also include any components such as one or more DC or AC power supplies, a recharge system, a power failure detection circuit, a power converter or inverter, and a power status indicator.
[0227] The audio playback device may further include an input unit 1004, and the input unit 1004 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.
[0228] Although not shown, the audio playback device may further include a display unit, etc., which will not be elaborated here. Specifically, in this embodiment, the processor 1001 in the audio playback device will load the executable files corresponding to the processes of one or more application programs into the memory 1002 according to the following instructions, and the processor 1001 will run the application programs stored in the memory 1002 to implement various functions as follows:
[0229] Obtain the audio playback data of the audio playback device to be adjusted, as well as the environmental noise data, where the audio playback data includes a first frequency and a first amplitude;
[0230] According to the target mapping relationship corresponding to the first frequency, determine the second amplitude corresponding to the first frequency;
[0231] According to the environmental noise data, and the difference between the first amplitude and the second amplitude, determine the target volume;
[0232] Control the audio playback device to output volume according to the target volume.
[0233] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructions, or by controlling related hardware through instructions. The instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.
[0234] For this purpose, an embodiment of the present invention provides a computer-readable storage medium (which can be simply referred to as a storage medium). The computer-readable storage medium may include: a read-only memory (ROM, Read Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disc, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the volume control methods provided by the embodiments of the present invention. For example, when the computer program is loaded by the processor, the following steps may be executed:
[0235] Obtain the audio playback data of the audio playback device to be adjusted, as well as the environmental noise data. The audio playback data includes a first frequency and a first amplitude;
[0236] Determine a second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency;
[0237] Determine the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude;
[0238] Control the audio playback device to output volume according to the target volume.
[0239] In the above embodiments, the descriptions of the various embodiments have their own emphases. For the parts not detailed in a certain embodiment, reference may be made to the detailed descriptions of other embodiments above, and details will not be repeated here.
[0240] In specific implementation, the above-mentioned units or structures can be implemented as independent entities, or can be combined arbitrarily to be implemented as the same or several entities. The specific implementation of the above-mentioned units or structures can refer to the method embodiments above, and details will not be repeated here.
[0241] The specific implementation of the above operations can refer to the previous embodiments, and details will not be repeated here.
[0242] The above has introduced in detail a volume control method, device, audio playback device, and storage medium provided by the embodiments of the present application. Specific examples are used herein to elaborate on the principles and implementation manners of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to the present invention.
Claims
1. A volume control method, characterized in that, Including: Obtain the audio playback data of the audio playback device to be adjusted and the ambient noise data, where the audio playback data includes a first frequency and a first amplitude; Determine a second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency; Determine a target volume according to the ambient noise data and the difference between the first amplitude and the second amplitude; Control the audio playback device to output volume according to the target volume.
2. The volume control method according to claim 1, characterized in that The determining the target volume according to the ambient noise data and the difference between the first amplitude and the second amplitude includes: Extract the frequency domain features and time domain features in the ambient noise data through a feature extraction module in a preset scenario model; Perform classification processing on the frequency domain features and time domain features through a classification module in the preset scenario model, and output target scenario parameters corresponding to the ambient noise data; Determine the target volume according to the target scenario parameters and the difference between the first amplitude and the second amplitude.
3. The volume control method according to claim 1, characterized in that, Before the determining the target volume according to the ambient noise data and the difference between the first amplitude and the second amplitude, it further includes: Obtain an environmental image of the environment corresponding to the audio playback device, and extract user features of the user on the environmental image, where the user features include at least one of user age, user identifier, and user gender; Obtain a target distance between the audio playback device and the user; The determining the target volume according to the ambient noise data and the difference between the first amplitude and the second amplitude includes: Determine the target volume according to the ambient noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude.
4. The volume control method according to claim 3, wherein The determining the target volume according to the ambient noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude includes: Process the user features through a user feature processing module in a volume algorithm model to obtain an initial volume; Process the ambient noise data, the target distance, and the difference between the first amplitude and the second amplitude through a parameter processing module in the volume algorithm model to obtain a corrected volume; Fuse the initial volume and the corrected volume through a fusion module in the volume algorithm model, and output the target volume.
5. The volume control method according to claim 4, characterized in that, After the fusing the initial volume and the corrected volume through the fusion module in the volume algorithm model and outputting the target volume, it further includes: If an operation to adjust the target volume is detected within a preset duration, obtain the adjustment volume corresponding to the operation; Update the volume algorithm model according to the adjustment volume, the ambient noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude.
6. The volume control method according to claim 3, wherein After the obtaining the target distance between the audio playback device and the user, it further includes: If there are at least two users in the environmental image, determine the user features corresponding to each of the target distances according to the corresponding relationship between the target distances and the users, and the corresponding relationship between the users and the users; Determine the fusion weights corresponding to each of the target distances according to the user features corresponding to each of the target distances, and fuse the target distances according to the fusion weights to obtain the fused target distance; Execute the step of determining the target volume according to the environmental noise data, the user features, the target distance, and the difference between the first amplitude and the second amplitude according to the fused target distance.
7. The volume control method according to any one of claims 1-6, characterized in that Before determining the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency, further include: Identify the target audio interval to which the first frequency belongs, and obtain the target mapping relationship associated and stored with the target audio interval; The determination of the mapping relationship includes the steps: Collect the actual audio data corresponding to different audio test data during playback, and extract the actual amplitudes corresponding to each second frequency in the actual audio data, where the audio test data includes the second frequency; Divide the audio intervals according to the distribution information of the actual amplitudes corresponding to each second frequency; Within each audio interval, create a mapping relationship according to the distribution information of the actual amplitudes corresponding to each second frequency, and store the mapping relationship corresponding to the audio interval.
8. A volume control device, characterized in that, The device includes: An acquisition module, configured to acquire the audio playback data of the audio playback device to be adjusted and environmental noise data, where the audio playback data includes a first frequency and a first amplitude; A first determination module, configured to determine the second amplitude corresponding to the first frequency according to the target mapping relationship corresponding to the first frequency; A second determination module, configured to determine the target volume according to the environmental noise data and the difference between the first amplitude and the second amplitude; An output module, configured to control the audio playback device to perform volume output according to the target volume.
9. An integrated circuit board, characterized in that, The integrated circuit board includes: A circuit board body; One or more processors, disposed on the circuit board body; A memory, disposed on the circuit board body and connected to the processor; and One or more application programs, where the one or more application programs are stored in the memory and configured to be executed by the processor to implement the volume control method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that, A computer program is stored thereon, and the computer program is loaded by the processor to execute the steps in the volume control method according to any one of claims 1 to 7.