Sound effect adjusting method and device, intelligent equipment, storage medium and program product

Abstract

The invention is suitable for the technical field of audio processing, and provides a sound effect adjusting method and device, intelligent equipment, a storage medium and a program product, and the method comprises the steps: receiving a sound effect adjusting request which comprises an identifier of to-be-adjusted audio data and sound effect demand description information of to-be-adjusted audio; the sound effect demand description information is used for indicating the sound effect expected by the user; in response to the sound effect adjustment request, determining a target audio parameter of a sound effect equalizer of the intelligent device based on the sound effect demand description information; according to the target audio parameter, a sound effect equalizer is controlled to carry out sound effect optimization on the to-be-adjusted audio data, target sound effect data is obtained, and the target sound effect data conforms to the sound effect expected by the user; and controlling an audio playing device of the intelligent equipment to play the target sound effect data. According to the scheme, the sound effect adjustment time is shortened, the situation of improper parameter setting is also reduced, the intelligence and convenience of sound effect adjustment are improved, and the sound effect adjustment efficiency and the sound effect adjustment effect are improved.

Description

Technical Field

[0001] The present invention relates to the field of audio processing technology, and in particular to a sound effect adjustment method, device, intelligent device, storage medium and program product. Background Art

[0002] With the popularization of smart devices (such as vehicles) and the rapid development of multimedia content, audio playback and sound optimization have become an indispensable part of modern life, and users' desire to adjust audio effects to improve sound quality is becoming more and more urgent.

[0003] The inventors found that the sound effect adjustment in the related art usually relies on the sound effect equalizer, and the user needs to manually adjust the audio parameters of the sound effect equalizer to achieve sound effect optimization. This method not only requires the user to have certain professional knowledge, but the user may also need to make multiple adjustments to achieve a satisfactory effect. The sound effect adjustment process is cumbersome and time-consuming, and it is also easy to have improper parameter settings and reduce sound quality, resulting in low sound effect adjustment efficiency and poor sound effect adjustment effect. Summary of the invention

[0004] The present invention provides a sound effect adjustment method, apparatus, intelligent device, storage medium and program product to solve the problems in the related art that the sound effect adjustment process is cumbersome and time-consuming, and the sound quality is easily reduced due to improper parameter settings, resulting in low sound effect adjustment efficiency and poor sound effect adjustment effect.

[0005] In a first aspect, an embodiment of the present application provides a method for adjusting sound effects, comprising:

[0006] receiving a sound effect adjustment request, the sound effect adjustment request including an identifier of the audio data to be adjusted and sound effect requirement description information of the audio data to be adjusted; the sound effect requirement description information is used to indicate the sound effect expected by the user;

[0007] In response to the sound effect adjustment request, determining a target audio parameter of a sound effect equalizer of the smart device based on the sound effect requirement description information;

[0008] According to the target audio parameters, the sound effect equalizer is controlled to optimize the sound effect of the audio data to be adjusted, so as to obtain the target sound effect data, and the target sound effect data meets the sound effect expected by the user;

[0009] The audio playback device of the smart device is controlled to play the target sound effect data.

[0010] Optionally, determining a target audio parameter of a sound effect equalizer of the smart device based on the sound effect requirement description information includes:

[0011] Determine the user sound effect adjustment type based on the sound effect requirement description information;

[0012] When the user sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters. The preset mapping data includes a mapping relationship between one or more known sound effects and corresponding audio parameters.

[0013] Optionally, after determining the user sound effect adjustment type based on the sound effect requirement description information, the method further includes:

[0014] When the user sound effect adjustment type is sound effect adjustment of a specified song, multiple song names in a preset song library are matched with the name of the specified song, and each song name in the preset song library is bound with a song audio parameter;

[0015] In the case where the name of the designated song is matched, the song audio parameters bound to the song name that matches the designated song in the preset song library are determined as the target audio parameters.

[0016] Optionally, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain target audio parameters, including:

[0017] Performing similarity matching between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data;

[0018] The standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted and sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain target audio parameters.

[0019] Optionally, the standard sound effect data includes standard audio parameters of multiple standard sound effects, and the standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted and sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain target audio parameters, including:

[0020] In the case where standard description information of a standard sound effect whose similarity is greater than or equal to the first threshold is matched, determining a target audio parameter in the standard sound effect data, where the target audio parameter is a standard audio parameter of the standard sound effect whose similarity is greater than or equal to the first threshold;

[0021] If the standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is not matched, the sound effect recognition model is called to perform sound effect parameter identification on the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information, and the target audio parameters are output, and the second threshold is less than the first threshold.

[0022] Optionally, performing similarity matching between the sound effect requirement description information and standard description information of multiple standard sound effects in the standard sound effect data includes:

[0023] The user's historical sound effect adjustment data and sound effect requirement description information are input into a preset large language model to expand the sound effect detail information of the sound effect requirement description information, and determine the expanded sound effect requirement description information;

[0024] The expanded sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity.

[0025] Optionally, the sound effect recognition model is trained as follows:

[0026] Acquire multiple historical audio data and preset mapping data, the historical audio data corresponding to the sound effect description information and standard audio parameters;

[0027] Input the preset mapping data, historical audio data and sound effect description information of the historical audio data into a preset multimodal audio model to perform sound effect and parameter recognition to obtain recognized audio parameters;

[0028] Determining a model loss value based on standard audio parameters and recognition audio parameters of historical audio data;

[0029] When the model loss value meets the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model.

[0030] Optionally, controlling an audio effect equalizer to optimize the audio data to be adjusted according to the target audio parameter to obtain the target audio effect data includes:

[0031] Inputting the target audio parameters and the audio data to be adjusted into the sound effect equalizer to generate a tuning curve for the audio data to be adjusted;

[0032] Displaying an operation page of the sound effect equalizer on a display screen of the smart device, the operation page including a tuning curve, the tuning curve including one or more frequency points with adjustable parameter values;

[0033] Receiving a parameter adjustment operation for a parameter value at any frequency point;

[0034] In response to the parameter adjustment operation, the target audio parameter is updated to obtain the updated target audio parameter;

[0035] The sound effect equalizer is controlled to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters to obtain the target sound effect data.

[0036] In a second aspect, an embodiment of the present application provides a sound effect adjustment device, comprising:

[0037] A receiving module, used to receive a sound effect adjustment request, the sound effect adjustment request includes an identifier of the audio data to be adjusted and sound effect requirement description information of the audio to be adjusted, the sound effect requirement description information is used to indicate the sound effect expected by the user;

[0038] A response module, configured to respond to the sound effect adjustment request and determine a target audio parameter of a sound effect equalizer of the smart device based on the sound effect requirement description information;

[0039] A control module, used to control the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, and obtain the target sound effect data, and the target sound effect data meets the sound effect expected by the user;

[0040] The control module is also used to control the audio playback device of the smart device to play the target sound effect data.

[0041] In a third aspect, an embodiment of the present application provides an intelligent device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above-mentioned sound effect adjustment method when executing the computer program.

[0042] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned sound effect adjustment method are implemented.

[0043] In a fifth aspect, the present application provides a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, the steps of implementing the above-mentioned sound effect adjustment method are implemented.

[0044] In a solution provided by the above-mentioned sound effect adjustment method, device, smart device, storage medium and program product, a sound effect adjustment request is received, the sound effect adjustment request includes an identification of the audio data to be adjusted and the sound effect requirement description information of the audio to be adjusted; the sound effect requirement description information is used to indicate the sound effect expected by the user; in response to the sound effect adjustment request, the target audio parameters of the sound effect equalizer of the smart device are determined based on the sound effect requirement description information; according to the target audio parameters, the sound effect equalizer is controlled to optimize the sound effect of the audio data to be adjusted to obtain the target sound effect data, and the target sound effect data meets the sound effect expected by the user; the audio playback device of the smart device is controlled to play the target sound effect data. In this embodiment, the target audio parameters of the sound effect equalizer of the smart device are automatically determined based on the sound effect requirement description information, so that the sound effect equalizer can quickly optimize the sound effect adjustment of the audio data to be adjusted, shortening the time of sound effect adjustment, and reducing the situation of improper parameter setting, thereby improving the intelligence and convenience of sound effect adjustment, and improving the efficiency and effect of sound effect adjustment. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0046] Figure 1 is a schematic diagram of a structure of an intelligent device in one embodiment of the present invention;

[0047] Figure 2 is a flow chart of a sound effect adjustment method according to an embodiment of the present invention;

[0048] Figure 3 yes Figure 2 A schematic diagram of an implementation process of step S20;

[0049] Figure 4 yes Figure 2 Another implementation flow diagram of step S20;

[0050] Figure 5 is a schematic diagram of the training process of a sound effect recognition model in one embodiment of the present invention;

[0051] Figure 6 yes Figure 3 Another implementation flow diagram of step S22;

[0052] Figure 7 yes Figure 2 A schematic diagram of an implementation process of step S30;

[0053] Figure 8 yes Figure 1 A structural schematic diagram of a medium sound effect adjustment device;

[0054] Fig. 9 2 is another structural diagram of an intelligent device in one embodiment of the present invention. DETAILED DESCRIPTION

[0055] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0056] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or their collections. It should also be understood that the term "and / or" used in the present specification and the appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes these combinations.

[0057] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0058] References to "one embodiment" or "some embodiments" etc. described in the present specification mean that one or more embodiments of the present invention include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0059] It should be understood that the order of execution of the steps in the following embodiments does not imply a precedence of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0060] In order to illustrate the technical solution of the present invention, specific embodiments are provided below for illustration.

[0061] The sound effect adjustment method provided by the embodiment of the present invention can be applied in Figure 1 In the smart device shown, the smart device includes a sound equalizer and a sound adjustment device.

[0062] The sound effect equalizer communicates with the sound effect adjustment device via a network or cable. The sound effect equalizer is used to optimize the sound effect of the audio data to be adjusted. Optionally, the smart device in the embodiment of the present application is also connected to the audio playback device. The audio playback device is used to play the target sound effect data optimized by the sound effect equalizer.

[0063] The audio playback device may be an audio playback device inside the smart device, that is, the audio playback device is a part of the smart device, such as a car speaker (also referred to as a horn). When the smart device is a vehicle, the car speaker may be a speaker deployed at different locations inside the vehicle. For example, it may be deployed in the front and / or rear rows of the vehicle. When the smart device is a mobile phone or other device, the audio playback device may also be a speaker device of the mobile phone. In another possible implementation, the audio playback device may also be a separately deployed device independent of the smart device. For example, the audio playback device may be a speaker connected to the smart device via Bluetooth / WIFI or other wired or wireless methods, a mobile phone / tablet with an audio playback function, a television, headphones, and other devices with an audio or video playback function.

[0064] During the operation of the smart device, the user can send a sound effect adjustment request to the smart device through an input device in the smart device or an external terminal device. The sound effect adjustment request includes an identifier of the audio data to be adjusted and a description of the sound effect requirements of the audio to be adjusted. Among them, the identifier of the audio data to be adjusted is used to obtain the audio data to be adjusted according to the representation, and the identifier of the audio data to be adjusted can be an audio name, such as a song name. As an example, the audio data to be adjusted involved in the embodiments of the present application can refer to audio from a music player, video soundtrack or game music, etc., or audio or music of a video, etc. The sound effect requirement description information is used to indicate the sound effects expected by the user.

[0065] The sound effect adjustment device in the smart device receives the sound effect adjustment request, and in response to the sound effect adjustment request, determines the target audio parameters of the sound effect equalizer of the smart device based on the sound effect requirement description information; then, the sound effect adjustment device controls the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, obtains the target sound effect data, and controls the audio playback device of the smart device to play the target sound effect data. The target sound effect data obtained by the sound effect equalizer by optimizing the audio data to be adjusted with the target audio parameters meets the sound effect expected by the user, that is, the target sound effect data meets the sound effect expected by the user.

[0066] In this embodiment, the target audio parameters of the sound equalizer of the smart device are automatically determined based on the sound effect requirement description information, so that the sound equalizer can quickly optimize the sound effect adjustment of the audio data to be adjusted. Through intelligent sound effect optimization, the user does not need to understand the complex audio adjustment principles, but only needs to provide the desired sound effect description to automatically complete the sound effect parameter determination and sound effect adjustment, which shortens the time for sound effect adjustment and reduces the situation of improper parameter setting, thereby enhancing the intelligence and convenience of sound effect adjustment, and improving the efficiency and effect of sound effect adjustment.

[0067] In addition, by combining the user's sound effect needs, automatic adjustment of sound equalizer parameters and real-time audio optimization, the solution can achieve highly personalized, precise and efficient sound effect adjustment, improve the overall performance and user experience of audio equipment, and make sound effect adjustment more intuitive, convenient and precise, meeting the diverse needs of users.

[0068] The sound effect adjustment device in this embodiment can be a related device in the smart device. In other embodiments, the sound effect adjustment device can also be a device outside the smart device that is connected to the smart device network, such as various personal computers, laptops, smart phones, tablet computers and other terminal devices, as well as servers. The server can be implemented as an independent server or a server cluster composed of multiple servers.

[0069] The smart device in this embodiment may be a vehicle. The vehicle includes a smart cockpit system, and the sound effect adjustment method provided in the embodiment of the present application may also be implemented by the smart cockpit system. The smart cockpit system may be implemented by an independent server or a server cluster consisting of multiple servers.

[0070] Among them, the smart cockpit system can be a complete system consisting of a central control platform, a full LCD instrument, a central control display, an entertainment system, a smart speaker, a car networking module, a streaming media rearview mirror, a telematics system, etc. The smart cockpit system can be centered on the cockpit area controller, realize the functions of the above-mentioned smart cockpit system on a unified software and hardware platform, and integrate the system of intelligent interaction, intelligent scenes, and personalized services. The smart cockpit system can form the basis for human-vehicle interaction and the interconnection between the car and the outside world. The usage scenarios of the smart cockpit system can generally cover all scenarios in which users use the vehicle. Specifically, the scenarios in which users use the vehicle can include the time scenarios before the user uses the vehicle, the time scenarios during the user's use of the vehicle, and the time scenarios after the user uses the vehicle. The scenarios in which users use the vehicle can also include the spatial scenes of the driver, the co-pilot, the rear passengers, and the relevant people or objects outside the car. Compared with the past command interaction, the human-computer interaction of the smart cockpit system can combine the usage scenarios of the vehicle and the user, based on image recognition, voice recognition, environmental perception, etc., to achieve an intelligent effect that is more in line with user needs. In other words, the smart cockpit system refers to the vehicle electronic systems equipped with intelligent and networked on-board equipment and services, such as on-board infotainment systems, instrument panels, head-up displays (HUD), streaming media rearview mirrors, voice interaction systems, and other vehicle electronic systems.

[0071] In one embodiment, if Figure 2 As shown, a sound effect adjustment method is provided, which can be Figure 1The method may be performed by a sound effect adjustment device in the embodiment of the present invention, or the method may be performed by a smart device. Taking the method applied to the sound effect adjustment device as an example, the method includes the following steps:

[0072] S10: Receive a sound effect adjustment request, where the sound effect adjustment request includes an identifier of the audio data to be adjusted and sound effect requirement description information of the audio data to be adjusted.

[0073] The user can send a sound effect adjustment request to the smart device through an input device or an external terminal device in the smart device; the sound effect adjustment device of the smart device receives the sound effect adjustment request. The sound effect adjustment device includes the identification of the audio data to be adjusted and the sound effect requirement description information of the audio to be adjusted. The identification of the audio data to be adjusted is used to obtain the audio data to be adjusted according to the representation, and the identification of the audio data to be adjusted can be an audio name, such as a song name. The sound effect requirement description information is used to indicate the sound effect desired by the user.

[0074] S20: In response to the sound effect adjustment request, determine a target audio parameter of a sound effect equalizer of the smart device based on the sound effect requirement description information.

[0075] The sound effect adjustment device responds to the sound effect adjustment request and determines the target audio parameters of the sound effect equalizer of the smart device based on the sound effect requirement description information. The target sound effect data obtained by the sound effect equalizer by optimizing the audio data to be adjusted with the target audio parameters conforms to the sound effect expected by the user, that is, the target sound effect data conforms to the sound effect expected by the user.

[0076] S30: Controlling the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters to obtain the target sound effect data.

[0077] After determining the target audio parameters of the sound effect equalizer, the sound effect adjustment device controls the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters to obtain the target sound effect data.

[0078] For example, the sound effect adjustment device can obtain the audio data to be adjusted according to the identifier of the audio data to be adjusted, and input the audio data to be adjusted and the target audio parameters into the sound effect equalizer. The sound effect equalizer directly uses the target audio parameters to adjust the audio data and optimize the sound effect to obtain the target sound effect data.

[0079] S40: Controlling the audio playback device of the smart device to play the target sound effect data.

[0080] After obtaining the target sound effect data, the sound effect adjustment device controls the audio playing device of the smart device to play the target sound effect data.

[0081] In this embodiment, a sound effect adjustment request is received, the sound effect adjustment request includes an identification of the audio data to be adjusted and sound effect requirement description information of the audio to be adjusted; the sound effect requirement description information is used to indicate the sound effect expected by the user; in response to the sound effect adjustment request, the target audio parameters of the sound effect equalizer of the smart device are determined based on the sound effect requirement description information; the sound effect equalizer is controlled to optimize the sound effect of the audio data to be adjusted according to the target audio parameters to obtain the target sound effect data, and the target sound effect data meets the sound effect expected by the user; the audio playback device of the smart device is controlled to play the target sound effect data. The target audio parameters of the sound effect equalizer of the smart device are automatically determined based on the sound effect requirement description information, so that the sound effect equalizer can quickly optimize the sound effect adjustment of the audio data to be adjusted, shortening the time for sound effect adjustment, and reducing the situation of improper parameter setting, thereby improving the intelligence and convenience of sound effect adjustment, and improving the efficiency and effect of sound effect adjustment.

[0082] In one embodiment, if Figure 3 As shown, in step S20, the target audio parameters of the sound effect equalizer of the smart device are determined based on the sound effect requirement description information, which specifically includes the following steps:

[0083] S21: Determine the user sound effect adjustment type based on the sound effect requirement description information.

[0084] The sound effect adjustment device determines the user sound effect adjustment type based on the sound effect requirement description information. The sound effect adjustment device can use a pre-trained intention recognition model to identify the intention and sound effect adjustment type of the sound effect requirement description information to determine the user sound effect adjustment type.

[0085] Among them, user sound effect adjustment types include semantic sound effect adjustment and sound effect adjustment of specified songs. Semantic sound effect adjustment is a type of sound effect adjustment that does not have a clear sound effect style, but indicates the sound effect through descriptive information.

[0086] S22: When the user sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters.

[0087] The preset mapping data is sound effect and audio parameter mapping data, which is used to reflect the mapping relationship between one or more known sound effects and corresponding audio parameters. The preset mapping data includes the mapping relationship between different standard sound effects and sound effect parameters of the sound effect equalizer.

[0088] The sound effect recognition model is a model obtained by training a preset multimodal audio model based on the standard sound effect data of multiple historical audio data and preset mapping data. The standard sound effect data of each historical audio data is obtained by pre-identifying and marking the sound effect of the historical audio data, and the standard sound effect data includes the standard sound effects, standard description information and standard audio parameters of multiple pre-calibrated historical audio data.

[0089] When it is determined that the user's sound effect adjustment type is semantic sound effect adjustment, the sound effect adjustment device obtains pre-calibrated preset mapping data and audio data to be adjusted (obtained through the identification of the audio data to be adjusted). Among them, the preset mapping data is a mapping relationship between different standard sound effects and audio parameters of the sound effect equalizer, which is pre-constructed according to the sound effects and corresponding audio parameters of different audio data. Among them, standard sound effects may include various types of sound effects such as audio style, instrument characteristics, and subjective listening evaluation. Different audio styles have different mapped audio parameters; different instrument characteristics have different mapped audio parameters; different subjective listening evaluations have different mapped audio parameters. The sound effects expected by the user may include one or more of various types such as audio style, instrument characteristics, and subjective listening evaluation.

[0090] Then, the sound effect adjustment device inputs the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information into the sound effect recognition model to identify the sound effect parameters, and obtain the target audio parameters of the sound effect equalizer of the smart device. The sound effect recognition model can identify the sound effect expected by the user based on the direct relationship between the semantic information and the sound effect, and then automatically calculate the target audio parameters of the sound effect equalizer that meet the user's expected sound effect based on the pre-calibrated preset mapping data. The sound effect recognition model can accurately identify the target audio parameters of the user's expected sound effect, reducing the complexity and inaccuracy of manually adjusting audio parameters in related technologies and improving the ease of use of the sound effect adjustment device.

[0091] In this embodiment, the user sound effect adjustment type is determined based on the sound effect requirement description information, and when the user sound effect adjustment type is determined to be semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition, and the target audio parameters of the sound effect equalizer of the smart device are obtained. Through intelligent sound effect requirement recognition and audio parameter adjustment, the sound effect optimization is made more accurate and convenient, and the introduction of the semantic sound effect adjustment mode makes the sound effect adjustment more in line with the user's intuitive needs, while also improving the intelligence level of the audio device, ultimately bringing a richer and more personalized audio experience.

[0092] In one embodiment, if Figure 4As shown, in step S20, the target audio parameters of the sound effect equalizer of the smart device are determined based on the sound effect requirement description information, which specifically includes the following steps:

[0093] S21: Determine the user sound effect adjustment type based on the sound effect requirement description information.

[0094] S23: When the user sound effect adjustment type is sound effect adjustment of a specified song, multiple song names in the preset song library are matched with the name of the specified song.

[0095] The sound effect adjustment device determines the user sound effect adjustment type based on the sound effect requirement description information; when it is determined that the user sound effect adjustment type is the sound effect adjustment of a specified song, the sound effect adjustment device matches multiple song names in a preset song library with the name of the specified song.

[0096] Among them, each song name in the preset song library is bound to a song audio parameter, and the song audio parameter is obtained by performing an audio parameter analysis based on the sound effect equalizer on the audio data of the song name. The sound effect adjustment device can pre-acquire the song audio data of multiple different song names on the market; based on the audio parameter setting of the sound effect equalizer, the audio parameters of the audio data of each song name are analyzed and extracted to obtain the song audio parameters that meet the audio parameter setting of the sound effect equalizer, and the song name and the song audio parameters of the audio data of the song name are bound and stored in the preset song library.

[0097] S24: When the name of the designated song is matched, the song audio parameters bound to the song name matching the designated song in the preset song library are determined as target audio parameters.

[0098] When the name of the designated song is matched, the sound effect adjustment device determines the song audio parameters bound to the song name matching the designated song in the preset song library as the target audio parameters.

[0099] In this embodiment, after determining the user's sound effect adjustment type based on the sound effect requirement description information, when determining that the user's sound effect adjustment type is the sound effect adjustment of a specified song, multiple song names in the preset song library are matched with the name of the specified song, and when the name of the specified song is matched, the song audio parameters bound to the song name that matches the specified song in the preset song library are determined as the target audio parameters. By matching the specified song name with the song name in the preset song library, the song sound effect expected by the user can be quickly identified, and the audio parameters related to the song can be directly called as the target audio parameters of the sound effect equalizer; the user only needs to simply select or specify the song, and the sound effect processing device can automatically find the optimized sound effect settings corresponding to the song, which greatly improves the efficiency and accuracy of the sound effect adjustment.

[0100] In one embodiment, before inputting the preset mapping data, the audio data to be adjusted and the sound effect requirement description information into the sound effect recognition model for sound effect parameter recognition, it is necessary to first obtain the pre-trained sound effect recognition model. Figure 5 As shown in the figure, the sound effect recognition model is trained as follows:

[0101] S01: Acquire a plurality of historical audio data and preset mapping data, wherein the historical audio data correspond to sound effect description information and standard audio parameters.

[0102] The sound effect adjustment device also needs to pre-establish a mapping relationship between different standard sound effects and the sound effect parameters of the sound effect equalizer to obtain preset mapping data, that is, the preset mapping data includes the sound effect parameters of the sound effect equalizer corresponding to different standard sound effects, that is, includes standard audio parameters of different standard sound effects.

[0103] At the same time, the sound effect adjustment device can pre-acquire multiple different historical audio data on the market, which historical audio data can be audio data of different songs, and obtain sound effect related description information of each historical audio data from network data. The sound effect related description information of the historical audio data includes the audio style, instrument characteristics and subjective listening evaluation of the historical audio data by different users.

[0104] Then, the sound effect adjustment device determines and labels the sound effects of the historical audio data according to a plurality of predetermined standard sound effects, and obtains one or more standard sound effects of the historical audio data; based on the one or more standard sound effects of the historical audio data, the standard audio parameters corresponding to one or more standard sound effects are determined in the standard sound effect data, and the standard audio parameters of the historical audio data are obtained. In other embodiments, the sound effect parameters of the sound effect equalizer can also be extracted and corrected for each historical audio data, and the standard audio parameters of each historical audio data can be obtained.

[0105] The standard sound effect data includes a plurality of pre-calibrated standard sound effects, standard description information and standard audio parameters of each standard sound effect, and may also include the type of each standard sound effect. The standard sound effect data is obtained by analyzing different audio data. The standard audio parameters in the standard sound effect are adapted to the sound effect parameters of the sound effect equalizer in the smart device.

[0106] S02: inputting preset mapping data, historical audio data and sound effect description information of the historical audio data into a preset multimodal audio model to perform sound effect and parameter recognition to obtain recognized audio parameters.

[0107] The audio adjustment device inputs preset mapping data, historical audio data and sound effect description information of the historical audio data into a preset multimodal audio model to perform sound effect and parameter recognition to obtain recognized audio parameters.

[0108] S03: Determine a model loss value based on standard audio parameters and recognition audio parameters of historical audio data.

[0109] The audio adjustment device determines the model loss value according to the standard audio parameters and the recognition audio parameters of the historical audio data. For example, the similarity between the standard audio parameters and the recognition audio parameters can be directly calculated, or the variance or covariance between the standard audio parameters and the recognition audio parameters can be calculated as the model loss value.

[0110] S04: When the model loss value satisfies the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model.

[0111] When the model loss value does not meet the convergence condition, the audio adjustment device continues to update the parameters of the preset multimodal audio model using the standard sound effects and standard description information of the multiple historical audio data, that is, executes steps S02 to S03 until the model loss value does not meet the convergence condition. When the model loss value meets the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model.

[0112] In this embodiment, pre-calibrated preset mapping data and multiple historical audio data are obtained, and the multiple historical audio data correspond to sound effect description information and standard audio parameters. The preset mapping data and the sound effect description information of the historical audio data are input into a preset multimodal audio model for sound effect and parameter recognition to obtain recognized audio parameters; the model loss value is determined according to the standard audio parameters and recognized audio parameters of the historical audio data; when the model loss value meets the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model. The multimodal audio model combines historical audio data with sound effect description information, dynamically optimizes sound effect parameters and iteratively updates according to the model loss value, and finally realizes an accurate and robust sound effect recognition model. By integrating historical audio data and sound effect description information, the sound effect recognition model can fully understand different sound effect description information and recognize accurate sound effects and their audio parameters.

[0113] In one embodiment, if Figure 6 As shown, in step S22, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters, which specifically includes the following steps:

[0114] S221: Perform similarity matching between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data.

[0115] When it is determined that the user sound effect adjustment type is semantic sound effect adjustment, the sound effect adjustment device performs similarity matching between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data. If the similarity between the sound effect requirement description information and the standard description information of the standard sound effect is greater than a certain threshold, it means that the sound effect requirement description information matches the standard description information of the standard sound effect, that is, the standard description information of the standard sound effect is matched.

[0116] The standard sound effect data includes a plurality of pre-calibrated standard sound effects, standard description information and standard audio parameters of each standard sound effect, and may also include the type of each standard sound effect. The standard sound effect data is obtained by analyzing different audio data. The standard audio parameters in the standard sound effect are adapted to the sound effect parameters of the sound effect equalizer in the smart device.

[0117] Among them, standard sound effects may include various types of sound effects such as audio style (such as song style), instrument characteristics and subjective listening evaluation. Subjective listening evaluation includes evaluation descriptions of user subjective listening sound effects such as fullness, width, clarity, and warmth; instrument characteristics include descriptions of different instruments and / or different instrument timbre characteristics, such as boosting drums, reducing drums, the warmth of guitars, and the clear high notes of pianos; audio styles represent different audio styles, including hip-hop, country, pop, jazz, classical, pop, electronic and other styles. The standard sound effect parameters of standard sound effects include parameter groups for different frequency bands, and the parameter groups for each frequency band are represented by one or more parameters such as different frequencies, gains, bandwidths and equalizer types. The equalizer type table includes Peak, Highshelf, and Low shelf.

[0118] Among them, some standard sound effects and their standard audio parameters can be shown in Table 1:

[0119]

[0120]

[0121] In this embodiment, multiple standard sound effects, standard description information of each standard sound effect, standard audio parameters, and types of standard sound effects are merely illustrative. In other embodiments, the standard sound effects may also include other sound effects, and the standard description information of each standard sound effect, standard audio parameters, and types of standard sound effects may also be other, which will not be repeated here.

[0122] S222: inputting the standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted and sound effect requirement description information into a sound effect recognition model to perform sound effect parameter recognition to obtain target audio parameters.

[0123] The sound effect adjustment device inputs the standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted and sound effect requirement description information into the sound effect recognition model to perform sound effect parameter recognition to obtain target audio parameters.

[0124] Optionally, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition, and obtain the target audio parameters of the sound effect equalizer of the smart device, including:

[0125] In this embodiment, the sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity, and the standard description information of at least one standard sound effect that is matched, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters to obtain the target audio parameters. This solution matches the user's sound effect requirements with the standard description information of the standard sound effects by similarity, combines the preset mapping data, intelligently identifies the audio parameters and automatically optimizes the sound effects, significantly improving the accuracy, efficiency, and intelligence level of the sound effect adjustment. Users can easily achieve personalized sound effect adjustment through a simple sound effect requirement description, thereby obtaining an audio experience that better meets their needs. This not only simplifies the sound effect adjustment process, but also improves the intelligent adaptability and sound quality performance of audio equipment.

[0126] In one embodiment, the standard sound effect data includes standard audio parameters of multiple standard sound effects. In step S222, the standard description information of at least one standard sound effect to be matched, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters, which specifically includes the following steps:

[0127] S2221: When matching standard description information of a standard sound effect whose similarity is greater than or equal to a first threshold, determining a target audio parameter in the standard sound effect data.

[0128] In this embodiment, the standard sound effect data includes a plurality of pre-calibrated standard sound effects, standard description information of each standard sound effect, and standard audio parameters. The sound effect adjustment device performs similarity matching between the sound effect requirement description information and the standard description information of a plurality of standard sound effects in the standard sound effect data, and determines the target audio parameters in the standard sound effect data when the standard description information of the standard sound effect whose similarity is greater than or equal to a first threshold is matched, wherein the target audio parameters are the standard audio parameters of the standard sound effect whose similarity is greater than or equal to the first threshold.

[0129] That is, when the standard description information of a standard sound effect with a similarity greater than or equal to a first threshold is matched, the sound effect adjustment device determines the matched standard sound effect with a similarity greater than or equal to the first threshold as the first standard sound effect; when there are multiple first standard sound effects, the sound effect adjustment device determines the standard audio parameters of the first standard sound effect with the greatest similarity in the standard sound effect data as the target audio parameters of the sound effect equalizer; when there is one first standard sound effect, the sound effect adjustment device determines the standard audio parameters of the first standard sound effect in the standard sound effect data as the target audio parameters of the sound effect equalizer.

[0130] When the similarity is greater than or equal to the first threshold, the audio parameters of the matching standard sound effect are directly used as the target audio parameters. This ensures fast and precise adjustment of the sound effect under high similarity conditions, and can efficiently provide users with expected sound effects without further processing.

[0131] S2222: When the standard description information of the standard sound effect whose similarity is greater than or equal to the first threshold is not matched, the sound effect recognition model is called to identify the sound effect parameters of the standard description information of the standard sound effect whose similarity is greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information, and the target audio parameters are output.

[0132] In the case where the standard description information of the standard sound effect with a similarity greater than the first threshold is not matched, that is, in the case where the standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is not matched, the sound effect adjustment device calls the sound effect recognition model to perform sound effect parameter recognition on the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information, and outputs the target audio parameters. The second threshold is less than the first threshold.

[0133] If the similarity fails to reach the first threshold, the adjustment process will not be terminated immediately. Instead, the optimization will continue by calling the sound effect recognition model. By matching the standard description data of the standard sound effect of the second threshold, the sound effect parameters can be identified based on the preset mapping data, the audio data to be adjusted and the sound effect requirement description information, and the audio parameters that meet the user's expectations can be output.

[0134] In this embodiment, when the standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is matched, the target audio parameters are determined in the standard sound effect data, and the target audio parameters are the standard audio parameters of the standard sound effect with a similarity greater than or equal to the first threshold; when the standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is not matched, the sound effect recognition model is called to identify the sound effect parameters of the standard description information of the matched standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information, and the target audio parameters are output, and the second threshold is less than the first threshold. By setting two different similarity thresholds, the sound effect adjustment process is both efficient and flexible. When the similarity is high, the most matching standard sound effect parameters are directly selected, which reduces the calculation and adjustment time; when the similarity is low, that is, the requirements are more complex, accurate optimization is performed through model recognition, which effectively improves the efficiency and accuracy of sound effect adjustment and enhances the adaptability and intelligence of the device.

[0135] In one embodiment, in step S221, similarity matching is performed between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data, which specifically includes the following steps:

[0136] S2211: Input the user's historical sound effect adjustment data and sound effect demand description information into a preset large language model to expand the sound effect detail information of the sound effect demand description information, and determine the expanded sound effect demand description information.

[0137] The sound effect adjustment device obtains the user's historical sound effect adjustment data on the smart device or the network. The historical sound effect adjustment data is obtained after the user agrees, and the historical sound effect adjustment data includes information such as the user's evaluation of the historical audio data and the sound effect preference. The sound effect adjustment device inputs the user's historical sound effect adjustment data and the sound effect requirement description information into a preset large language model to expand the sound effect detail information of the sound effect requirement description information, and determines the expanded sound effect requirement description information.

[0138] S2212: Perform similarity matching on the expanded sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data.

[0139] The sound effect adjustment device performs similarity matching between the expanded sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data.

[0140] In this embodiment, the user's historical sound effect adjustment data and sound effect demand description information are input into a preset large language model to expand the sound effect detail information of the sound effect demand description information, and the expanded sound effect demand description information is determined; the expanded sound effect demand description information is similarity matched with the standard description information of multiple standard sound effects in the standard sound effect data. This solution realizes the intelligent expansion of the sound effect demand description information by inputting the user's historical sound effect adjustment data and sound effect demand description information into a large language model, enhances the details and accuracy of the sound effect demand, and makes the sound effect adjustment more in line with the user's personalized needs. Subsequently, the expanded sound effect demand is similarity matched with the standard description information of the standard sound effect, thereby improving the accuracy and intelligence level of the adjustment result.

[0141] In one embodiment, if Figure 7 As shown, in step S22, the sound effect equalizer is controlled according to the target audio parameter to optimize the sound effect of the audio data to be adjusted to obtain the target sound effect data, which specifically includes the following steps:

[0142] S31: Inputting the target audio parameters and the audio data to be adjusted into an audio equalizer to generate a tuning curve for the audio data to be adjusted.

[0143] The sound effect adjustment device inputs the target audio parameters and the audio data to be adjusted into the sound effect equalizer of the smart device, and generates a tuning curve for the audio data to be adjusted through the sound effect equalizer.

[0144] S32: Displaying an operation page of the sound equalizer on a display screen of the smart device, where the operation page includes a tuning curve, and the tuning curve includes one or more frequency points whose parameter values ​​can be adjusted.

[0145] The sound effect adjustment device displays the operation page of the sound effect equalizer on the display screen of the smart device. The operation page includes a tuning curve. The tuning curve includes one or more frequency points. The parameter values ​​of the frequency points can be adjusted, that is, the tuning curve includes one or more frequency points with adjustable parameter values. The parameter values ​​of the adjustable parameter value frequency points include frequency, gain, bandwidth and equalization type. The equalization types of the frequency points include high pass, low pass, peak, shelf and other equalization types.

[0146] S33: Receive a parameter adjustment operation for a parameter value at any frequency point.

[0147] The sound effect adjustment device receives a parameter adjustment operation from a user for a parameter value at any frequency point.

[0148] Among them, users can select different equalization types for different frequency points through the equalization type control on the operation page, and can drag the frequency points in the tuning curve to change the frequency, gain, bandwidth and other parameter values ​​of the frequency points. They can also change the frequency, gain, bandwidth and other parameter values ​​through different knobs on the operation page.

[0149] S34: In response to the parameter adjustment operation, the target audio parameters are updated to obtain updated target audio parameters.

[0150] The sound effect adjustment device updates the target audio parameter to obtain the updated target audio parameter in response to the user's parameter adjustment operation on the parameter value of any frequency point.

[0151] S35: Control the sound effect equalizer to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters to obtain the target sound effect data.

[0152] The sound effect adjustment device controls the sound effect equalizer to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters to obtain the target sound effect data.

[0153] Among them, after obtaining the target audio parameters, the sound effect adjustment device controls the sound effect equalizer to optimize the sound effect of the audio data to be adjusted based on the target audio parameters, obtains the target sound effect data and controls the audio playback device to play it. In the process of playing the target sound effect data, the operation page of the sound effect equalizer can be displayed on the display screen of the smart device, and the parameter adjustment operation for the parameter value of any frequency point can be received. In response to the parameter adjustment operation, the target audio parameters are updated to obtain the updated target audio parameters, and then the sound effect equalizer is controlled to continue to optimize the sound effect of the target sound effect data with the updated target audio parameters and play it, so as to update the playback effect of the target sound effect data in real time.

[0154] In this embodiment, the target audio parameters and the audio data to be adjusted are input into the sound effect equalizer to generate a tuning curve for the audio data to be adjusted, and the operation page of the sound effect equalizer is displayed on the display screen of the smart device, the operation page includes a tuning curve, and the tuning curve includes one or more frequency points whose parameter values ​​can be adjusted; a parameter adjustment operation for the parameter value of any frequency point is received; in response to the parameter adjustment operation, the target audio parameters are updated to obtain the updated target audio parameters; and the sound effect equalizer is controlled to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters to obtain the target sound effect data. This solution provides users with an intuitive, flexible and accurate sound effect adjustment experience through the tuning curve and the operation page of the sound effect equalizer, so that users can accurately adjust the audio parameters based on real-time feedback, thereby optimizing the sound effect output. In addition, the sound effect adjustment device can continue to optimize the sound effect according to the updated target audio parameters to ensure that the sound effect data finally output fully meets the user's sound effect requirements.

[0155] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0156] In one embodiment, a sound effect adjustment device is provided, and the sound effect adjustment device corresponds to the sound effect adjustment method in the above embodiment. Figure 8 As shown, the sound effect adjustment device includes a receiving module 801, a response module 802 and a control module 803. The detailed description of each functional module is as follows:

[0157] The receiving module 801 is used to receive a sound effect adjustment request, where the sound effect adjustment request includes an identifier of the audio data to be adjusted and sound effect requirement description information of the audio data to be adjusted, where the sound effect requirement description information is used to indicate the sound effect desired by the user;

[0158] A response module 802 is used to respond to the sound effect adjustment request and call the identification module to determine the target audio parameters of the sound effect equalizer of the smart device based on the sound effect requirement description information;

[0159] The control module 803 is used to control the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, so as to obtain the target sound effect data, and the target sound effect data meets the sound effect expected by the user;

[0160] The control module 803 is also used to control the audio playing device of the smart device to play the target sound effect data.

[0161] Optionally, the response module 802 is specifically configured to:

[0162] Determine the user sound effect adjustment type based on the sound effect requirement description information;

[0163] When the user sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters. The preset mapping data is used to reflect the mapping relationship between one or more known sound effects and the corresponding audio parameters.

[0164] Optionally, the response module 802 is further configured to:

[0165] When the user sound effect adjustment type is sound effect adjustment of a specified song, multiple song names in a preset song library are matched with the name of the specified song, and each song name in the preset song library is bound with a song audio parameter;

[0166] In the case where the name of the designated song is matched, the song audio parameters bound to the song name that matches the designated song in the preset song library are determined as the target audio parameters.

[0167] Optionally, the response module 802 is further configured to:

[0168] Performing similarity matching between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data;

[0169] The standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted and sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain target audio parameters.

[0170] Optionally, the standard sound effect data includes standard audio parameters of a plurality of standard sound effects, and the response module 802 is further specifically configured to:

[0171] In the case where standard description information of a standard sound effect whose similarity is greater than or equal to the first threshold is matched, determining a target audio parameter in the standard sound effect data, where the target audio parameter is a standard audio parameter of the standard sound effect whose similarity is greater than or equal to the first threshold;

[0172] If the standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is not matched, the sound effect recognition model is called to perform sound effect parameter identification on the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information, and the target audio parameters are output, and the second threshold is less than the first threshold.

[0173] Optionally, the response module 802 is further configured to:

[0174] The user's historical sound effect adjustment data and sound effect requirement description information are input into a preset large language model to expand the sound effect detail information of the sound effect requirement description information, and determine the expanded sound effect requirement description information;

[0175] The expanded sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity.

[0176] Optionally, the sound effect adjustment device includes a training module 804, and the training module 804 is used to:

[0177] Acquire multiple historical audio data and pre-calibrated preset mapping data, the historical audio data corresponding to the sound effect description information and standard audio parameters;

[0178] Input the preset mapping data, historical audio data and sound effect description information of the historical audio data into a preset multimodal audio model to perform sound effect and parameter recognition to obtain recognized audio parameters;

[0179] Determining a model loss value based on standard audio parameters and recognition audio parameters of historical audio data;

[0180] When the model loss value fails to meet the convergence conditions, continue to use the standard sound effects and standard description information of multiple historical audio data to update and iterate the parameters of the preset multimodal audio model until the model loss value fails to meet the convergence conditions, and then output the converged preset multimodal audio model as a sound effect recognition model.

[0181] Optionally, the control module 803 is specifically used to: input the target audio parameter and the audio data to be adjusted into the sound effect equalizer to generate a tuning curve of the audio data to be adjusted; control the display screen of the smart device to display an operation page of the sound effect equalizer, the operation page includes the tuning curve, and the tuning curve includes one or more frequency points whose parameter values ​​can be adjusted;

[0182] The receiving module 801 is further used to receive a parameter adjustment operation for a parameter value of any frequency point;

[0183] The response module 802 is further configured to update the target audio parameter in response to the parameter adjustment operation to obtain the updated target audio parameter;

[0184] The control module 803 is also specifically used to control the sound effect equalizer to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters to obtain the target sound effect data.

[0185] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0186] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0187] The present application also provides an intelligent device, which can be an intelligent device or a sound effect adjustment device. Fig. 9As shown, the smart device 2 includes: at least one processor 20, a memory 21, and a computer program 22 stored in the memory 21 and executable on the at least one processor 20. When the processor 20 executes the computer program 22, the steps in any of the above-mentioned method embodiments are implemented, or when the processor 20 executes the computer program 22, the functions of each module / unit in the above-mentioned device embodiments are implemented.

[0188] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory and executed by the processor to complete the present application. The one or more modules / units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the smart device.

[0189] Those skilled in the art will understand that Fig. 9 These are merely examples of the smart device and do not constitute a limitation of the smart device. The smart device may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. For example, the smart device may also include input and output devices, network access devices, buses, etc.

[0190] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0191] The memory may be an internal storage unit of the smart device, such as a hard disk or memory of the smart device. The memory may also be an external storage device of the smart device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the smart device. Furthermore, the memory may include both an internal storage unit of the smart device and an external storage device.

[0192] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0193] An embodiment of the present application provides a computer program product. When the computer program product is run on a smart device, the smart device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0194] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium can at least include: any entity or device that can carry the computer program code to the camera / terminal device, recording medium, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, RandomAccess Memory), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0195] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0196] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0197] In the embodiments provided in the present application, it should be understood that the disclosed devices / equipment and methods can be implemented in other ways. For example, the device / equipment embodiments described above are merely schematic, for example, the division of the modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0198] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0199] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A sound effect adjustment method, characterized in that: include: Receive a sound effect adjustment request, the sound effect adjustment request including an identifier of the audio data to be adjusted and sound effect requirement description information of the audio data to be adjusted, the sound effect requirement description information being used to indicate a sound effect desired by a user; In response to the sound effect adjustment request, determining a target audio parameter of a sound effect equalizer of the smart device based on the sound effect requirement description information; Controlling the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameter to obtain target sound effect data, wherein the target sound effect data meets the sound effect expected by the user; The audio playing device of the smart device is controlled to play the target sound effect data.

2. The sound effect adjustment method according to claim 1, characterized in that: The determining the target audio parameters of the sound effect equalizer of the smart device based on the sound effect requirement description information includes: Determining a user sound effect adjustment type based on the sound effect requirement description information; In the case where the user sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter identification to obtain the target audio parameters, wherein the preset mapping data is used to reflect the mapping relationship between one or more known sound effects and corresponding audio parameters.

3. The sound effect adjustment method according to claim 2, characterized in that: The method further comprises: In the case where the user sound effect adjustment type is the sound effect adjustment of a specified song, a plurality of song names in a preset song library are matched with the name of the specified song, and each of the song names in the preset song library is bound with a song audio parameter; In the case where the name of the designated song is matched, the song audio parameters bound to the song name that matches the designated song in the preset song library are determined as the target audio parameters.

4. The sound effect adjustment method according to claim 2, characterized in that: The step of inputting the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters includes: Performing similarity matching between the sound effect requirement description information and standard description information of multiple standard sound effects in the standard sound effect data; The standard description information of at least one of the matched standard sound effects, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition to obtain the target audio parameters.

5. The sound effect adjustment method according to claim 4, characterized in that: The standard sound effect data includes a plurality of standard audio parameters of the standard sound effects, the standard description information of at least one of the standard sound effects to be matched, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information, which are input into the sound effect recognition model for sound effect parameter recognition to obtain the target audio parameters, including: In the case where the standard description information of the standard sound effect whose similarity is greater than or equal to the first threshold is matched, determining the target audio parameter in the standard sound effect data, wherein the target audio parameter is the standard audio parameter of the standard sound effect whose similarity is greater than or equal to the first threshold; In the case that the standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is not matched, the sound effect recognition model is called to perform sound effect parameter identification on the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information, and the target audio parameters are output, where the second threshold is less than the first threshold.

6. The sound effect adjustment method according to claim 4, characterized in that: The similarity matching of the sound effect requirement description information with standard description information of a plurality of standard sound effects in the standard sound effect data includes: Inputting the user's historical sound effect adjustment data and the sound effect requirement description information into a preset large language model to expand the sound effect detail information of the sound effect requirement description information, and determining the expanded sound effect requirement description information; The expanded sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity.

7. The sound effect adjustment method according to claim 2, characterized in that: The sound effect recognition model is trained in the following way: Acquire a plurality of historical audio data and the preset mapping data, wherein the historical audio data correspond to sound effect description information and standard audio parameters; Inputting the preset mapping data, the historical audio data and the sound effect description information of the historical audio data into a preset multimodal audio model to perform sound effect and parameter recognition to obtain recognized audio parameters; Determining a model loss value based on the standard audio parameters of the historical audio data and the recognition audio parameters; When the model loss value satisfies the convergence condition, the converged preset multimodal audio model is output as the sound effect recognition model.

8. The sound effect adjustment method according to any one of claims 1 to 7, characterized in that: The step of controlling the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameter to obtain the target sound effect data includes: Inputting the target audio parameter and the audio data to be adjusted into the sound effect equalizer to generate a tuning curve for the audio data to be adjusted; Displaying an operation page of the sound effect equalizer on a display screen of the smart device, wherein the operation page includes the tuning curve, and the tuning curve includes one or more frequency points whose parameter values ​​can be adjusted; receiving a parameter adjustment operation for a parameter value of any of the audio parameters; In response to the parameter adjustment operation, updating the target audio parameter to obtain an updated target audio parameter; The sound effect equalizer is controlled to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters to obtain the target sound effect data.

9. A sound effect adjustment device, characterized in that: include: A receiving module, configured to receive a sound effect adjustment request, wherein the sound effect adjustment request includes an identifier of the audio data to be adjusted and sound effect requirement description information of the audio data to be adjusted, wherein the sound effect requirement description information is used to indicate the sound effect desired by the user; A response module, configured to respond to the sound effect adjustment request and determine a target audio parameter of a sound effect equalizer of the smart device based on the sound effect requirement description information; A control module, configured to control the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameter, so as to obtain the target sound effect data, wherein the target sound effect data meets the sound effect expected by the user; The control module is also used to control the audio playback device of the smart device to play the target sound effect data.

10. An intelligent device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the sound effect adjustment method according to any one of claims 1 to 8 are implemented.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the sound effect adjustment method according to any one of claims 1 to 8 are implemented.

12. A computer program product, characterized in that The computer program product comprises a computer program, which, when executed by a processor, implements the steps of the sound effect adjustment method according to any one of claims 1 to 8.

Images