Sound effect adjusting method and device, intelligent device, storage medium and program product

Abstract

The application is suitable for the technical field of audio processing, and provides an audio effect adjusting method and device, intelligent equipment, a storage medium and a program product. The method comprises the following steps: receiving an audio effect adjusting request, wherein the audio effect adjusting request comprises the identification of to-be-adjusted audio data and audio effect demand description information of the to-be-adjusted audio; the audio effect demand description information is used for indicating the audio effect expected by a user; in response to the audio effect adjusting request, target audio parameters of an audio effect equalizer of the intelligent equipment are determined based on the audio effect demand description information; the target audio parameters are used to control the audio effect equalizer to perform audio effect optimization on the to-be-adjusted audio data, so as to obtain target audio effect data, wherein the target audio effect data meets the audio effect expected by the user; and the audio playback device of the intelligent equipment is controlled to play the target audio effect data. The scheme shortens the time of audio effect adjustment, reduces the situation of improper parameter setting, improves the intelligentization and convenience of audio effect adjustment, and improves the audio effect adjustment efficiency and the audio effect adjustment effect.

Description

Technical Field

[0001] This invention relates to the field of audio processing technology, and in particular to a sound effect adjustment method, apparatus, smart device, storage medium, and program product. Background Technology

[0002] With the widespread use of smart devices (such as vehicles) and the rapid development of multimedia content, audio playback and sound effect optimization have become an indispensable part of modern life, and users' demand to adjust audio effects to improve sound quality is becoming increasingly urgent.

[0003] The inventors discovered that sound effect adjustment in related technologies typically relies on equalizers, requiring users to manually adjust the equalizer's audio parameters to optimize sound. This method not only demands a certain level of professional knowledge from the user, but also often requires multiple adjustments to achieve satisfactory results. The sound effect adjustment process is cumbersome and time-consuming, and improper parameter settings can easily lead to reduced sound quality, resulting in low efficiency and poor sound effect adjustment. Summary of the Invention

[0004] This invention provides a sound effect adjustment method, device, smart device, storage medium, and program product to solve the problems in related technologies where the sound effect adjustment process is cumbersome and time-consuming, and is prone to sound quality degradation due to improper parameter settings, resulting in low sound effect adjustment efficiency and poor sound effect adjustment effect.

[0005] In a first aspect, embodiments of this application provide a sound effect adjustment method, including:

[0006] Receive a sound effect adjustment request. The sound effect adjustment request includes the identifier of the audio data to be adjusted and the sound effect requirement description information of the audio to be adjusted. The sound effect requirement description information is used to indicate the sound effect desired by the user.

[0007] In response to a sound effect adjustment request, the target audio parameters of the smart device's sound equalizer are determined based on the sound effect requirement description information;

[0008] The equalizer is controlled according to the target audio parameters to optimize the audio data to be adjusted, thereby obtaining the target audio data, which meets the user's desired audio effect.

[0009] Control the audio playback device of the smart device to play the target sound effect data.

[0010] Optionally, the target audio parameters of the smart device's equalizer are determined based on the audio effect requirement description information, including:

[0011] Determine the user's sound effect adjustment type based on the sound effect requirement description information;

[0012] When the user's sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters. The preset mapping data includes the mapping relationship between one or more known sound effects and their corresponding audio parameters.

[0013] Optionally, after determining the user's sound effect adjustment type based on the sound effect requirement description information, the method further includes:

[0014] When the user's sound effect adjustment type is the sound effect adjustment of a specified song, multiple song names in the preset song library are matched with the name of the specified song. Each song name in the preset song library is bound to the song's audio parameters.

[0015] If a specified song name is matched, the audio parameters of the song bound to the song name that matches the specified song in the preset song library will be determined as the target audio parameters.

[0016] Optionally, preset mapping data, audio data to be adjusted, and sound effect requirement description information are input into the sound effect recognition model to identify sound effect parameters and obtain target audio parameters, including:

[0017] The similarity matching is performed between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data;

[0018] The standard description information of at least one matched standard sound effect, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters.

[0019] Optionally, the standard sound effect data includes standard audio parameters of multiple standard sound effects. The standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted, and sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters, obtaining the target audio parameters, including:

[0020] If a standard description of a standard sound effect with a similarity greater than or equal to the first threshold is matched, the target audio parameter is determined in the standard sound effect data. The target audio parameter is the standard audio parameter of the standard sound effect with a similarity greater than or equal to the first threshold.

[0021] If no standard description information of a standard sound effect with a similarity greater than or equal to the first threshold is found, the sound effect recognition model is invoked. The standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are used to identify the sound effect parameters and output the target audio parameters. The second threshold is less than the first threshold.

[0022] Optionally, the sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data based on similarity, including:

[0023] Input the user's historical sound effect adjustment data and sound effect requirement description information into the preset large language model to expand the sound effect requirement description information with sound effect details, and determine the expanded sound effect requirement description information.

[0024] The expanded sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data based on similarity.

[0025] Optionally, the sound effect recognition model is trained in the following way:

[0026] Acquire multiple historical audio data and preset mapping data. The historical audio data corresponds to sound effect description information and standard audio parameters.

[0027] The preset mapping data, historical audio data, and sound effect description information of historical audio data are input into the preset multimodal audio model for sound effect and parameter recognition to obtain the recognized audio parameters.

[0028] The model loss value is determined based on the standard audio parameters and recognized audio parameters of historical audio data;

[0029] If the model loss value meets the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model.

[0030] Optionally, the equalizer is controlled according to the target audio parameters to optimize the audio data to be adjusted, thereby obtaining the target audio data, including:

[0031] Input the target audio parameters and the audio data to be adjusted into the sound equalizer to generate the tuning curve of the audio data to be adjusted.

[0032] The smart device displays the operation page of the sound equalizer, which includes a tuning curve and one or more frequency points with adjustable parameter values.

[0033] Receive parameter adjustment operations for parameter values ​​at any frequency point;

[0034] In response to the parameter adjustment operation, update the target audio parameters to obtain the updated target audio parameters;

[0035] The control equalizer optimizes the audio data to be adjusted with updated target audio parameters to obtain the target audio data.

[0036] Secondly, embodiments of this application provide a sound effect adjustment device, including:

[0037] The receiving module is used to receive sound effect adjustment requests. The sound effect adjustment request includes the identifier of the audio data to be adjusted and the sound effect requirement description information of the audio to be adjusted. The sound effect requirement description information is used to indicate the sound effect desired by the user.

[0038] The response module is used to respond to sound effect adjustment requests and determine the target audio parameters of the smart device's sound equalizer based on the sound effect requirement description information;

[0039] The control module is used to control the sound equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, so as to obtain the target sound effect data, which meets the user's expected sound effect.

[0040] The control module is also used to control the audio playback device of the smart device to play the target sound effect data.

[0041] Thirdly, embodiments of this application provide a smart device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the above-described sound effect adjustment method.

[0042] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the above-described sound effect adjustment method.

[0043] Fifthly, embodiments of this application provide a computer program product, which includes a computer program that, when executed by a processor, enables the implementation of the above-described sound effect adjustment method.

[0044] In one solution provided by the aforementioned sound effect adjustment method, apparatus, smart device, storage medium, and program product, a sound effect adjustment request is received. The sound effect adjustment request includes an identifier of the audio data to be adjusted and sound effect requirement description information for the audio to be adjusted. The sound effect requirement description information indicates the sound effect desired by the user. In response to the sound effect adjustment request, the target audio parameters of the smart device's sound equalizer are determined based on the sound effect requirement description information. The sound equalizer is controlled to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, resulting in target sound effect data that matches the user's desired sound effect. The audio playback device of the smart device is then controlled to play the target sound effect data. In this embodiment, the target audio parameters of the smart device's sound equalizer are automatically determined based on the sound effect requirement description information, enabling the sound equalizer to quickly optimize the sound effect of the audio data to be adjusted. This shortens the sound effect adjustment time, reduces the possibility of improper parameter settings, improves the intelligence and convenience of sound effect adjustment, and enhances the efficiency and effect of sound effect adjustment. Attached Figure Description

[0045] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 This is a schematic diagram of the structure of a smart device according to an embodiment of the present invention;

[0047] Figure 2 This is a schematic flowchart of a sound effect adjustment method in one embodiment of the present invention;

[0048] Figure 3 yes Figure 2 A schematic diagram of the implementation process of step S20;

[0049] Figure 4 yes Figure 2 Another implementation flow diagram of step S20;

[0050] Figure 5 This is a schematic diagram of the training process of a sound effect recognition model in one embodiment of the present invention;

[0051] Figure 6 yes Figure 3 Another implementation flowchart for step S22;

[0052] Figure 7 yes Figure 2 A schematic diagram of the implementation process of step S30;

[0053] Figure 8 yes Figure 1 A schematic diagram of the mid-range audio adjustment device;

[0054] Figure 9 This is another structural schematic diagram of a smart device in one embodiment of the present invention. Detailed Implementation

[0055] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0056] It should be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or collections thereof. It should also be understood that, as used in this specification and the appended claims, the term "and / or" refers to any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0057] Furthermore, in the description of this invention and the appended claims, the terms "first," "second," "third," etc., are used only to distinguish descriptions and should not be construed as indicating or implying relative importance.

[0058] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of the invention include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0059] It should be understood that the sequence number of each step in the following embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0060] To illustrate the technical solution of the present invention, specific embodiments are described below.

[0061] The sound effect adjustment method provided in this embodiment of the invention can be applied to, for example... Figure 1 The smart device shown includes a sound equalizer and a sound adjustment device.

[0062] The equalizer communicates with the audio adjustment device via a network or cable. The equalizer is used to optimize the audio data to be adjusted. Optionally, the smart device in this embodiment also communicates with an audio playback device. The audio playback device plays the target audio data optimized by the equalizer.

[0063] The audio playback device can be an internal component of a smart device, meaning it's part of the smart device, such as a car speaker (also called a loudspeaker). If the smart device is a vehicle, the car speaker can be a speaker deployed in different locations within the vehicle, such as in the front and / or rear seats. If the smart device is a mobile phone or similar device, the audio playback device can also be the phone's speaker. In another possible implementation, the audio playback device can be a separately deployed device independent of the smart device. For example, the audio playback device can be a speaker connected to the smart device via Bluetooth / Wi-Fi or other wired or wireless means, a mobile phone / tablet with audio playback capabilities, a television, headphones, or other devices with audio or video playback functions.

[0064] During the operation of a smart device, a user can send a sound effect adjustment request to the smart device through an input device within the smart device or an external terminal device. This sound effect adjustment request includes an identifier for the audio data to be adjusted and a description of the sound effect requirements for the audio data to be adjusted. The identifier for the audio data to be adjusted is used to retrieve the audio data to be adjusted; the identifier can be an audio name, such as a song title. As an example, the audio data to be adjusted in this embodiment can refer to audio from a music player, video audio tracks, game music, or audio or music from a video. The sound effect requirement description information is used to indicate the sound effect desired by the user.

[0065] The audio adjustment device in the smart device receives the audio adjustment request and, in response, determines the target audio parameters of the smart device's equalizer based on the audio effect requirement description information. Then, the audio adjustment device controls the equalizer to optimize the audio data to be adjusted according to the target audio parameters, obtaining target audio data, and controls the smart device's audio playback device to play the target audio data. Specifically, the target audio data obtained by the equalizer optimizing the audio data to be adjusted with the target audio parameters meets the user's desired audio effect; that is, the target audio data meets the user's desired audio effect.

[0066] In this embodiment, the target audio parameters of the smart device's equalizer are automatically determined based on the description of the audio effect requirements. This enables the equalizer to quickly optimize the audio data to be adjusted. Through intelligent audio effect optimization, users do not need to understand the complex principles of audio adjustment. They only need to provide the desired audio effect description, and the system can automatically complete the determination of audio effect parameters and the adjustment of audio effect. This shortens the time for audio effect adjustment, reduces the occurrence of improper parameter settings, improves the intelligence and convenience of audio effect adjustment, and enhances the efficiency and effect of audio effect adjustment.

[0067] Furthermore, by combining user sound effect needs, automatically adjusting the parameters of the sound equalizer, and optimizing audio in real time, this solution can achieve highly personalized, precise, and efficient sound effect adjustment, improve the overall performance of audio equipment and user experience, and make sound effect adjustment more intuitive, convenient, and accurate, meeting the diverse needs of users.

[0068] The sound effect adjustment device in this embodiment can be a related device in a smart device. In other embodiments, the sound effect adjustment device can also be a device external to the smart device and connected to the smart device's network, such as various personal computers, laptops, smartphones, tablets, and other terminal devices, as well as a server, which can be implemented using a standalone server or a server cluster composed of multiple servers.

[0069] The smart device in this embodiment can be a vehicle. The vehicle includes a smart cockpit system, and the sound effect adjustment method provided in this embodiment can also be implemented by the smart cockpit system. The smart cockpit system can be implemented using a standalone server or a server cluster consisting of multiple servers.

[0070] The intelligent cockpit system can be a complete system comprising a central control platform, a full LCD instrument panel, a central control display, an entertainment system, a smart speaker, as well as a vehicle networking module, a streaming media rearview mirror, and a remote information processing system. Centered on the driver's cockpit area controller, the intelligent cockpit system implements the aforementioned functions on a unified hardware and software platform, integrating intelligent interaction, intelligent scenarios, and personalized services. The intelligent cockpit system forms the foundation for human-vehicle interaction and vehicle-to-external connectivity. The usage scenarios of the intelligent cockpit system typically cover all scenarios in which users use the vehicle. Specifically, user usage scenarios can include the time before, during, and after vehicle use. User usage scenarios can also include spatial scenarios involving the driver, front passenger, rear passengers, and relevant people or objects outside the vehicle. Compared to past command-based interactions, the human-machine interaction of the intelligent cockpit system can combine vehicle and user usage scenarios, based on image recognition, voice recognition, and environmental perception, to achieve more intelligent effects that better meet user needs. In other words, a smart cockpit system refers to a vehicle electronic system equipped with intelligent and connected in-vehicle devices and services, such as in-vehicle infotainment systems, instrument panels, head-up displays (HUDs), streaming rearview mirrors, and voice interaction systems.

[0071] In one embodiment, such as Figure 2 As shown, a sound effect adjustment method is provided, which can be achieved by... Figure 1The method can be executed by a sound effect adjustment device, or it can be executed by a smart device. Taking the application of this method to a sound effect adjustment device as an example, the method includes the following steps:

[0072] S10: Receive a sound effect adjustment request. The sound effect adjustment request includes the identifier of the audio data to be adjusted and a description of the sound effect requirements of the audio to be adjusted.

[0073] Users can send sound effect adjustment requests to the smart device via an input device within the smart device or an external terminal device; the smart device's sound effect adjustment device receives the sound effect adjustment request. The sound effect adjustment request includes an identifier for the audio data to be adjusted and a description of the desired sound effect. The identifier for the audio data to be adjusted is used to retrieve the audio data to be adjusted; the identifier can be an audio name, such as a song title. The description of the desired sound effect indicates the user's preferred sound effect.

[0074] S20: In response to a sound effect adjustment request, determine the target audio parameters of the smart device's sound equalizer based on the sound effect requirement description information.

[0075] The sound effect adjustment device responds to the sound effect adjustment request and determines the target audio parameters of the smart device's sound equalizer based on the sound effect requirement description information. Specifically, the sound equalizer optimizes the audio data to be adjusted using the target audio parameters to obtain target sound effect data that matches the user's desired sound effect; that is, the target sound effect data matches the user's desired sound effect.

[0076] S30: Control the sound effect equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, and obtain the target sound effect data.

[0077] After determining the target audio parameters of the equalizer, the sound effect adjustment device controls the equalizer to optimize the sound effect data of the audio data to be adjusted according to the target audio parameters, so as to obtain the target sound effect data.

[0078] For example, the sound effect adjustment device can obtain the audio data to be adjusted based on the identifier of the audio data to be adjusted, and input the audio data to be adjusted and the target audio parameters into the sound effect equalizer. The sound effect equalizer directly uses the target audio parameters to optimize the audio data to be adjusted and obtain the target sound effect data.

[0079] S40: Controls the audio playback device of the smart device to play the target sound effect data.

[0080] After obtaining the target sound effect data, the sound effect adjustment device controls the audio playback device of the smart device to play the target sound effect data.

[0081] In this embodiment, a sound effect adjustment request is received. The sound effect adjustment request includes an identifier of the audio data to be adjusted and a sound effect requirement description information for the audio to be adjusted. The sound effect requirement description information indicates the sound effect desired by the user. In response to the sound effect adjustment request, the target audio parameters of the sound equalizer of the smart device are determined based on the sound effect requirement description information. The sound equalizer is controlled to optimize the sound effect of the audio data to be adjusted according to the target audio parameters to obtain target sound effect data that meets the user's desired sound effect. The audio playback device of the smart device is then controlled to play the target sound effect data. By automatically determining the target audio parameters of the sound equalizer of the smart device based on the sound effect requirement description information, the sound equalizer can quickly optimize the sound effect of the audio data to be adjusted, shortening the sound effect adjustment time, reducing the possibility of improper parameter settings, improving the intelligence and convenience of sound effect adjustment, and enhancing the efficiency and effect of sound effect adjustment.

[0082] In one embodiment, such as Figure 3 As shown, step S20, which involves determining the target audio parameters of the smart device's equalizer based on the audio effect requirement description information, specifically includes the following steps:

[0083] S21: Determine the user's sound effect adjustment type based on the sound effect requirement description information.

[0084] The sound effect adjustment device determines the user's sound effect adjustment type based on the sound effect demand description information. Specifically, the sound effect adjustment device can use a pre-trained intent recognition model to identify the intent and sound effect adjustment type in the sound effect demand description information to determine the user's sound effect adjustment type.

[0085] Among them, user sound effect adjustment types include semantic sound effect adjustment and sound effect adjustment for a specific song. Semantic sound effect adjustment is a type of sound effect adjustment that does not have a specific sound effect style, but instead provides sound effect instructions through descriptive information.

[0086] S22: When the user's sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters.

[0087] The preset mapping data consists of sound effect and audio parameter mapping data, used to reflect the mapping relationship between one or more known sound effects and their corresponding audio parameters. The preset mapping data includes the mapping relationship between different standard sound effects and the sound effect parameters of the sound equalizer.

[0088] The sound effect recognition model is a model trained on a pre-defined multimodal audio model based on standard sound effect data and pre-defined mapping data from multiple historical audio datasets. The standard sound effect data for each historical audio dataset is obtained by pre-identifying and labeling the sound effects of that historical audio dataset. This standard sound effect data includes pre-labeled standard sound effects, standard descriptive information, and standard audio parameters from multiple historical audio datasets.

[0089] When the user's sound effect adjustment type is determined to be semantic sound effect adjustment, the sound effect adjustment device acquires pre-calibrated preset mapping data and the audio data to be adjusted (obtained through the identifier of the audio data to be adjusted). The preset mapping data is a pre-constructed mapping relationship between different standard sound effects and the audio parameters of the sound equalizer, based on the sound effects and corresponding audio parameters of different audio data. Standard sound effects can include various types such as audio style, instrument characteristics, and subjective listening evaluation. Different audio styles have different mapped audio parameters; different instrument characteristics have different mapped audio parameters; different subjective listening evaluations have different mapped audio parameters. The sound effect desired by the user can include one or more of these types.

[0090] Then, the sound effect adjustment device inputs preset mapping data, audio data to be adjusted, and sound effect requirement description information into the sound effect recognition model for sound effect parameter recognition, thereby obtaining the target audio parameters of the smart device's sound equalizer. The sound effect recognition model can identify the user's desired sound effect based on the direct relationship between semantic information and sound effects. Then, based on pre-calibrated preset mapping data, it automatically calculates the target audio parameters of the sound equalizer that match the user's desired sound effect. The sound effect recognition model can accurately identify the target audio parameters of the user's desired sound effect, reducing the complexity and inaccuracy of manually adjusting audio parameters in related technologies and improving the ease of use of the sound effect adjustment device.

[0091] In this embodiment, the user's audio effect adjustment type is determined based on the audio effect demand description information. If the user's audio effect adjustment type is determined to be semantic audio effect adjustment, preset mapping data, the audio data to be adjusted, and the audio effect demand description information are input into the audio effect recognition model for audio effect parameter recognition, obtaining the target audio parameters of the smart device's audio equalizer. Through intelligent audio effect demand recognition and audio parameter adjustment, audio effect optimization becomes more accurate and convenient. The introduction of the semantic audio effect adjustment mode makes audio effect adjustment more in line with the user's intuitive needs, while also improving the intelligence level of the audio device, ultimately bringing a richer and more personalized audio experience.

[0092] In one embodiment, such as Figure 4As shown, step S20, which involves determining the target audio parameters of the smart device's equalizer based on the audio effect requirement description information, specifically includes the following steps:

[0093] S21: Determine the user's sound effect adjustment type based on the sound effect requirement description information.

[0094] S23: When the user's sound effect adjustment type is the sound effect adjustment of a specified song, match the names of multiple songs in the preset song library with the name of the specified song.

[0095] The sound effect adjustment device determines the user's sound effect adjustment type based on the sound effect requirement description information; if the user's sound effect adjustment type is the sound effect adjustment of a specified song, the sound effect adjustment device will match multiple song names in the preset song library with the name of the specified song.

[0096] The preset song library includes a song title linked to audio parameters, obtained through equalizer-based audio parameter analysis of the song title's audio data. The sound adjustment device can pre-acquire audio data for multiple song titles available on the market; based on the equalizer's audio parameter settings, it analyzes and extracts audio parameters from the audio data of each song title to obtain audio parameters matching the equalizer's settings. The song title and its corresponding audio parameters are then linked and stored in the preset song library.

[0097] S24: If the name of a specified song is matched, the audio parameters of the song bound to the song name that matches the specified song in the preset song library are determined as the target audio parameters.

[0098] When a specified song name is matched, the sound effect adjustment device determines the target audio parameters as the song audio parameters that are bound to the song name that matches the specified song in the preset song library.

[0099] In this embodiment, after determining the user's sound effect adjustment type based on the sound effect requirement description information, if the user's sound effect adjustment type is determined to be the sound effect adjustment of a specified song, multiple song names in the preset song library are matched with the name of the specified song. If a specified song name is matched, the audio parameters of the song bound to the song name in the preset song library are determined as the target audio parameters. By matching the specified song name with song names in the preset song library, the user's desired song sound effect can be quickly identified, and the audio parameters related to that song can be directly called as the target audio parameters of the sound effect equalizer. The user only needs to simply select or specify a song, and the sound effect processing device can automatically find the corresponding optimized sound effect settings for that song, greatly improving the efficiency and accuracy of sound effect adjustment.

[0100] In one embodiment, before inputting preset mapping data, audio data to be adjusted, and sound effect requirement description information into the sound effect recognition model for sound effect parameter recognition, a pre-trained sound effect recognition model needs to be obtained first. For example... Figure 5 As shown, the sound effect recognition model is trained in the following way:

[0101] S01: Obtain multiple historical audio data and preset mapping data. The historical audio data corresponds to sound effect description information and standard audio parameters.

[0102] The sound effect adjustment device also needs to establish a mapping relationship between different standard sound effects and sound effect equalizer parameters in advance to obtain preset mapping data. That is, the preset mapping data includes the sound effect parameters of the sound effect equalizer corresponding to different standard sound effects, which also includes the standard audio parameters of different standard sound effects.

[0103] Meanwhile, the sound effect adjustment device can pre-acquire multiple historical audio data from different sources on the market. This historical audio data can be audio data from different songs, and it can obtain sound effect-related descriptive information for each historical audio data from network data. The sound effect-related descriptive information for the historical audio data includes the audio style, instrument characteristics, and subjective listening evaluations of different users for the historical audio data.

[0104] Then, the sound effect adjustment device determines and labels the historical audio data according to a plurality of predetermined standard sound effects, thereby obtaining one or more standard sound effects for the historical audio data; based on the one or more standard sound effects of the historical audio data, standard audio parameters corresponding to one or more standard sound effects are determined in the standard sound effect data, thereby obtaining the standard audio parameters of the historical audio data. In other embodiments, the sound effect parameters of the sound effect equalizer can also be extracted and corrected for each historical audio data to obtain the standard audio parameters of each historical audio data.

[0105] The standard sound effect data includes multiple pre-calibrated standard sound effects, standard description information for each standard sound effect, and standard audio parameters. It may also include the type of each standard sound effect. This standard sound effect data is obtained by analyzing different audio data. The standard audio parameters in the standard sound effects are adapted to the sound effect parameters of the equalizer in smart devices.

[0106] S02: Input the preset mapping data, historical audio data, and sound effect description information of historical audio data into the preset multimodal audio model for sound effect and parameter recognition to obtain the recognized audio parameters.

[0107] The audio adjustment device inputs preset mapping data, historical audio data, and sound effect description information of historical audio data into a preset multimodal audio model for sound effect and parameter recognition, and obtains the recognized audio parameters.

[0108] S03: Determine the model loss value based on the standard audio parameters and recognition audio parameters of the historical audio data.

[0109] The audio adjustment device determines the model loss value based on the standard audio parameters and the recognized audio parameters from historical audio data. For example, it can directly calculate the similarity between the standard audio parameters and the recognized audio parameters, or calculate the variance or covariance between the standard audio parameters and the recognized audio parameters as the model loss value.

[0110] S04: If the model loss value meets the convergence condition, output the converged preset multimodal audio model as a sound effect recognition model.

[0111] If the model loss value does not meet the convergence condition, the audio adjustment device continues to update and iterate the parameters of the preset multimodal audio model using standard sound effects and standard description information from multiple historical audio data, i.e., executing steps S02 to S03, until the model loss value does not meet the convergence condition. If the model loss value meets the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model.

[0112] In this embodiment, pre-calibrated preset mapping data and multiple historical audio data are acquired. These historical audio data correspond to sound effect description information and standard audio parameters. The preset mapping data and the sound effect description information from the historical audio data are input into a preset multimodal audio model for sound effect and parameter recognition, resulting in recognized audio parameters. The model loss value is determined based on the standard audio parameters from the historical audio data and the recognized audio parameters. If the model loss value meets the convergence condition, the converged preset multimodal audio model is output as a sound effect recognition model. By combining the multimodal audio model with historical audio data and sound effect description information, the sound effect parameters are dynamically optimized and iteratively updated based on the model loss value, ultimately achieving an accurate and robust sound effect recognition model. By integrating historical audio data and sound effect description information, the sound effect recognition model can comprehensively understand different sound effect description information and accurately identify the sound effects and their audio parameters.

[0113] In one embodiment, such as Figure 6 As shown, in step S22, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters. Specifically, this includes the following steps:

[0114] S221: Perform similarity matching between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data.

[0115] When the user's sound effect adjustment type is determined to be semantic sound effect adjustment, the sound effect adjustment device performs similarity matching between the sound effect demand description information and the standard description information of multiple standard sound effects in the standard sound effect data. Specifically, if the similarity between the sound effect demand description information and the standard description information of the standard sound effect is greater than a certain threshold, it indicates that the sound effect demand description information matches the standard description information of that standard sound effect, that is, a match is found with the standard description information of the standard sound effect.

[0116] The standard sound effect data includes multiple pre-calibrated standard sound effects, standard description information for each standard sound effect, and standard audio parameters. It may also include the type of each standard sound effect. This standard sound effect data is obtained by analyzing different audio data. The standard audio parameters in the standard sound effects are adapted to the sound effect parameters of the equalizer in smart devices.

[0117] Standard sound effects can include various types of sound effects such as audio style (e.g., song style), instrument characteristics, and subjective listening evaluations. Subjective listening evaluations include user-subjective descriptions of sound effects such as fullness, richness, clarity, and warmth; instrument characteristics include descriptions of different instruments and / or different instrument timbre characteristics, such as boosting drums, reducing drums, the warmth of a guitar, and the clear high notes of a piano; audio style represents different audio styles, including hip-hop, country, pop, jazz, classical, and electronic styles. Standard sound effect parameters include parameter sets for different frequency bands, each frequency band represented by one or more parameters such as different frequencies, gain, bandwidth, and equalizer type. The equalizer type table includes Peak, Highshelf, and Lowshelf.

[0118] Some of the standard sound effects and their standard audio parameters are shown in Table 1:

[0119]

[0120]

[0121] In this embodiment, the multiple standard sound effects, the standard description information of each standard sound effect, the standard audio parameters, and the type of the standard sound effect are only illustrative examples. In other embodiments, the standard sound effects may also include other sound effects, and the standard description information, standard audio parameters, and type of each standard sound effect may also be other, which will not be elaborated here.

[0122] S222: Input the standard description information of at least one matched standard sound effect, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters.

[0123] The sound effect adjustment device inputs the standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted, and sound effect requirement description information into the sound effect recognition model to identify sound effect parameters and obtain target audio parameters.

[0124] Optionally, based on preset mapping data, audio data to be adjusted, and sound effect requirement description information, the sound effect recognition model is input to identify sound effect parameters, thereby obtaining the target audio parameters of the smart device's sound equalizer, including:

[0125] In this embodiment, the sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity. The standard description information of at least one matched standard sound effect, preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are then input into a sound effect recognition model to identify sound effect parameters and obtain the target audio parameters. This solution intelligently identifies audio parameters and automatically optimizes sound effects by matching user sound effect requirements with the standard description information of standard sound effects through similarity matching, combined with preset mapping data. This significantly improves the accuracy, efficiency, and intelligence level of sound effect adjustment. Users can easily achieve personalized sound effect adjustments through simple sound effect requirement descriptions, thereby obtaining an audio experience that better meets their needs. This not only simplifies the sound effect adjustment process but also improves the intelligent adaptability and sound quality performance of audio devices.

[0126] In one embodiment, the standard sound effect data includes standard audio parameters for multiple standard sound effects. Step S222 involves inputting the standard description information of at least one matched standard sound effect, preset mapping data, audio data to be adjusted, and sound effect requirement description information into a sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters. Specifically, this includes the following steps:

[0127] S2221: If a standard description of a standard sound effect with a similarity greater than or equal to the first threshold is found, the target audio parameters are determined in the standard sound effect data.

[0128] In this embodiment, the standard sound effect data includes multiple pre-calibrated standard sound effects, standard description information for each standard sound effect, and standard audio parameters. The sound effect adjustment device performs similarity matching between the sound effect requirement description information and the standard description information of the multiple standard sound effects in the standard sound effect data. If a standard description information of a standard sound effect with a similarity greater than or equal to a first threshold is matched, a target audio parameter is determined in the standard sound effect data. The target audio parameter is the standard audio parameter of the standard sound effect with a similarity greater than or equal to the first threshold.

[0129] That is, when a standard description of a standard sound effect with a similarity greater than or equal to the first threshold is matched, the sound effect adjustment device determines the matched standard sound effect with a similarity greater than or equal to the first threshold as the first standard sound effect; when there are multiple first standard sound effects, the sound effect adjustment device determines the standard audio parameters of the first standard sound effect with the highest similarity in the standard sound effect data, and uses them as the target audio parameters for the sound effect equalizer; when there is only one first standard sound effect, the sound effect adjustment device determines the standard audio parameters of the first standard sound effect in the standard sound effect data, and uses them as the target audio parameters for the sound effect equalizer.

[0130] When the similarity is greater than or equal to the first threshold, the audio parameters of the matching standard sound effect are directly used as the target audio parameters. This ensures fast and accurate adjustment of the sound effect in the case of high similarity, and can efficiently provide users with the expected sound effect without further processing.

[0131] S2222: If no standard description information of a standard sound effect with a similarity greater than or equal to the first threshold is matched, the sound effect recognition model is invoked to identify the sound effect parameters of the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information, and output the target audio parameters.

[0132] If no standard description information of a standard sound effect with a similarity greater than the first threshold is found, that is, if no standard description information of a standard sound effect that is completely identical or highly similar is found, the sound effect adjustment device calls the sound effect recognition model to identify sound effect parameters by combining the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, preset mapping data, audio data to be adjusted, and sound effect requirement description information, and outputs the target audio parameters. The second threshold is less than the first threshold.

[0133] If the similarity fails to reach the first threshold, the adjustment process will not end immediately. Instead, the sound effect recognition model will be called to continue optimization. Based on the standard description data of the standard sound effect matched to the second threshold, the sound effect parameters can be identified according to the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information, and the audio parameters that meet the user's expectations will be output.

[0134] In this embodiment, when a standard description of a standard sound effect with a similarity greater than or equal to a first threshold is matched, the target audio parameter is determined from the standard sound effect data. The target audio parameter is the standard audio parameter of the standard sound effect with a similarity greater than or equal to the first threshold. When no standard description of a standard sound effect with a similarity greater than or equal to the first threshold is matched, the sound effect recognition model is invoked to identify the sound effect parameters using the standard description of the standard sound effect with a similarity greater than or equal to a second threshold, preset mapping data, audio data to be adjusted, and sound effect requirement description information. The target audio parameter is then output, where the second threshold is less than the first threshold. By setting two different similarity thresholds, the sound effect adjustment process is both efficient and flexible. When the similarity is high, the most matching standard sound effect parameter is directly selected, reducing calculation and adjustment time. When the similarity is low, i.e., the requirement is more complex, precise optimization is performed through model recognition, effectively improving the efficiency and accuracy of sound effect adjustment and enhancing the adaptability and intelligence of the device.

[0135] In one embodiment, step S221 involves performing similarity matching between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data. This specifically includes the following steps:

[0136] S2211: Input the user's historical sound effect adjustment data and sound effect requirement description information into the preset large language model to expand the sound effect requirement description information with sound effect details, and determine the expanded sound effect requirement description information.

[0137] The sound effect adjustment device acquires historical sound effect adjustment data from the user on smart devices or the network. This historical sound effect adjustment data is acquired with the user's consent and includes information such as the user's evaluation of historical audio data and sound effect preferences. The sound effect adjustment device inputs the user's historical sound effect adjustment data and sound effect requirement description information into a preset large language model to expand the sound effect requirement description information with sound effect details, and determines the expanded sound effect requirement description information.

[0138] S2212: Perform similarity matching between the expanded sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data.

[0139] The sound effect adjustment device will perform similarity matching between the expanded sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data.

[0140] In this embodiment, the user's historical sound effect adjustment data and sound effect requirement description information are input into a preset large language model to expand the sound effect requirement description information with detailed information, thus determining the expanded sound effect requirement description information. The expanded sound effect requirement description information is then matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity. This solution, by inputting the user's historical sound effect adjustment data and sound effect requirement description information into a large language model, achieves intelligent expansion of the sound effect requirement description information, enhancing the detail and accuracy of the sound effect requirements, making the sound effect adjustment more in line with the user's personalized needs. Subsequently, the expanded sound effect requirements are matched with the standard description information of standard sound effects for similarity, improving the accuracy and intelligence of the adjustment results.

[0141] In one embodiment, such as Figure 7 As shown, step S22, which involves controlling the equalizer to optimize the audio data to be adjusted based on the target audio parameters to obtain the target audio data, specifically includes the following steps:

[0142] S31: Input the target audio parameters and the audio data to be adjusted into the sound equalizer to generate the tuning curve of the audio data to be adjusted.

[0143] The sound effect adjustment device inputs the target audio parameters and the audio data to be adjusted into the sound effect equalizer of the smart device, and generates a tuning curve for the audio data to be adjusted through the sound effect equalizer.

[0144] S32: Display the operation page of the sound equalizer on the display screen of the smart device. The operation page includes a tuning curve, which includes one or more frequency points with adjustable parameter values.

[0145] The sound effect adjustment device displays the sound equalizer's operation page on the smart device's screen. The operation page includes a tuning curve, which contains one or more frequency points. The parameter values ​​of these frequency points are adjustable; that is, the tuning curve includes one or more frequency points with adjustable parameter values. The adjustable parameter values ​​for these frequency points include frequency, gain, bandwidth, and equalization type. The equalization types for these frequency points include high-pass, low-pass, peak, and shelf equalization types.

[0146] S33: Receive parameter adjustment operations for parameter values ​​at any frequency point.

[0147] The sound effect adjustment device receives parameter adjustment operations from the user for any frequency point.

[0148] Users can select different equalization types for different frequencies using the equalization type control on the operation page, and drag and drop frequencies in the tuning curve to change parameters such as frequency, gain, and bandwidth. They can also change parameters such as frequency, gain, and bandwidth using different knobs on the operation page.

[0149] S34: In response to the parameter adjustment operation, update the target audio parameters to obtain the updated target audio parameters.

[0150] The sound effect adjustment device responds to the user's parameter adjustment operation for any frequency point and updates the target audio parameters to obtain the updated target audio parameters.

[0151] S35: Controls the sound equalizer to optimize the audio data to be adjusted with updated target audio parameters to obtain the target sound data.

[0152] The sound effect adjustment device controls the sound effect equalizer to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters in order to obtain the target sound effect data.

[0153] After obtaining the target audio parameters, the sound effect adjustment device controls the sound equalizer to optimize the audio data to be adjusted based on the target audio parameters, obtaining the target sound effect data, and then controls the audio playback device to play it. During the playback of the target sound effect data, the operation page of the sound equalizer can be displayed on the smart device's screen, receiving parameter adjustment operations for any frequency point, and responding to the parameter adjustment operations to update the target audio parameters, obtaining the updated target audio parameters. Then, the sound equalizer is controlled to continue to optimize the sound effect data of the target sound effect data with the updated target audio parameters and play it, so as to update the playback effect of the target sound effect data in real time.

[0154] In this embodiment, the target audio parameters and the audio data to be adjusted are input into the equalizer to generate a tuning curve for the audio data to be adjusted. The equalizer's operation page is displayed on the smart device's screen. The operation page includes the tuning curve, which includes one or more frequency points with adjustable parameter values. The device receives parameter adjustment operations for any frequency point. In response to the parameter adjustment operation, the target audio parameters are updated to obtain the updated target audio parameters. The equalizer is then controlled to optimize the audio data to be adjusted using the updated target audio parameters to obtain the target audio data. This solution provides users with an intuitive, flexible, and precise audio adjustment experience through the tuning curve and the equalizer's operation page. Users can precisely adjust audio parameters based on real-time feedback to optimize the audio output. Furthermore, the audio adjustment device can continue to optimize the audio based on the updated target audio parameters, ensuring that the final output audio data fully meets the user's audio requirements.

[0155] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0156] In one embodiment, a sound effect adjustment device is provided, which corresponds one-to-one with the sound effect adjustment methods described in the above embodiments. For example... Figure 8 As shown, the sound effect adjustment device includes a receiving module 801, a response module 802, and a control module 803. Detailed descriptions of each functional module are as follows:

[0157] The receiving module 801 is used to receive a sound effect adjustment request. The sound effect adjustment request includes the identifier of the audio data to be adjusted and the sound effect requirement description information of the audio to be adjusted. The sound effect requirement description information is used to indicate the sound effect desired by the user.

[0158] The response module 802 is used to respond to a sound effect adjustment request by calling the recognition module to determine the target audio parameters of the smart device's sound equalizer based on the sound effect requirement description information.

[0159] The control module 803 is used to control the sound equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, so as to obtain the target sound effect data, which meets the user's expected sound effect.

[0160] The control module 803 is also used to control the audio playback device of the smart device to play the target sound effect data.

[0161] Optionally, the response module 802 is specifically used for:

[0162] Determine the user's sound effect adjustment type based on the sound effect requirement description information;

[0163] When the user's sound effect adjustment type is semantic sound effect adjustment, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters. The preset mapping data is used to reflect the mapping relationship between one or more known sound effects and their corresponding audio parameters.

[0164] Optionally, the response module 802 is further used for:

[0165] When the user's sound effect adjustment type is the sound effect adjustment of a specified song, multiple song names in the preset song library are matched with the name of the specified song. Each song name in the preset song library is bound to the song's audio parameters.

[0166] If a specified song name is matched, the audio parameters of the song bound to the song name that matches the specified song in the preset song library will be determined as the target audio parameters.

[0167] Optionally, the response module 802 is further used for:

[0168] The similarity matching is performed between the sound effect requirement description information and the standard description information of multiple standard sound effects in the standard sound effect data;

[0169] The standard description information of at least one matched standard sound effect, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters.

[0170] Optionally, the standard sound effect data includes standard audio parameters for multiple standard sound effects, and the response module 802 is further used for:

[0171] If a standard description of a standard sound effect with a similarity greater than or equal to the first threshold is matched, the target audio parameter is determined in the standard sound effect data. The target audio parameter is the standard audio parameter of the standard sound effect with a similarity greater than or equal to the first threshold.

[0172] If no standard description information of a standard sound effect with a similarity greater than or equal to the first threshold is found, the sound effect recognition model is invoked. The standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are used to identify the sound effect parameters and output the target audio parameters. The second threshold is less than the first threshold.

[0173] Optionally, the response module 802 is further used for:

[0174] Input the user's historical sound effect adjustment data and sound effect requirement description information into the preset large language model to expand the sound effect requirement description information with sound effect details, and determine the expanded sound effect requirement description information.

[0175] The expanded sound effect requirement description information is matched with the standard description information of multiple standard sound effects in the standard sound effect data based on similarity.

[0176] Optionally, the sound effect adjustment device includes a training module 804, which is used for:

[0177] Acquire multiple historical audio data and pre-calibrated preset mapping data. The historical audio data corresponds to sound effect description information and standard audio parameters.

[0178] The preset mapping data, historical audio data, and sound effect description information of historical audio data are input into the preset multimodal audio model for sound effect and parameter recognition to obtain the recognized audio parameters.

[0179] The model loss value is determined based on the standard audio parameters and recognized audio parameters of historical audio data;

[0180] If the model loss value does not meet the convergence condition, the parameters of the preset multimodal audio model are updated and iterated using standard sound effects and standard description information from multiple historical audio data until the model loss value does not meet the convergence condition. Then, the converged preset multimodal audio model is output as the sound effect recognition model.

[0181] Optionally, the control module 803 is specifically used to: input the target audio parameters and the audio data to be adjusted into the sound equalizer, generate the tuning curve of the audio data to be adjusted; control the display screen of the smart device to display the operation page of the sound equalizer, the operation page including the tuning curve, the tuning curve including one or more frequency points with adjustable parameter values;

[0182] The receiving module 801 is also used to receive parameter adjustment operations for parameter values ​​at any frequency point;

[0183] The response module 802 is also used to update the target audio parameters in response to the parameter adjustment operation, and obtain the updated target audio parameters;

[0184] The control module 803 is also specifically used to control the sound equalizer to optimize the sound effect of the audio data to be adjusted with the updated target audio parameters in order to obtain the target sound effect data.

[0185] It should be noted that the information interaction and execution process between the above-mentioned devices / units are based on the same concept as the method embodiments of this application. For details on their specific functions and technical effects, please refer to the method embodiments section, and they will not be repeated here.

[0186] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. The specific working process of the units and modules in the above system can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0187] This application also provides a smart device, which can be a smart device or a sound effect adjustment device. For example... Figure 9As shown, the smart device 2 includes: at least one processor 20, a memory 21, and a computer program 22 stored in the memory 21 and executable on the at least one processor 20. When the processor 20 executes the computer program 22, it implements the steps in any of the above method embodiments, or when the processor 20 executes the computer program 22, it implements the functions of each module / unit in the above device embodiments.

[0188] For example, the computer program may be divided into one or more modules / units, which are stored in the memory and executed by the processor to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the smart device.

[0189] Those skilled in the art will understand that Figure 9 This is merely an example of a smart device and does not constitute a limitation on the smart device. It may include more or fewer components than shown in the figure, or combine certain components, or different components. For example, the smart device may also include input / output devices, network access devices, buses, etc.

[0190] The aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0191] The memory can be an internal storage unit of the smart device, such as the hard drive or RAM of the smart device. The memory can also be an external storage device of the smart device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the smart device. Furthermore, the memory can include both internal storage units and external storage devices of the smart device.

[0192] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps described in the various method embodiments above.

[0193] This application provides a computer program product that, when run on a smart device, enables the smart device to perform the steps described in the above-described method embodiments.

[0194] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a photographing device / terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0195] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0196] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0197] In the embodiments provided in this application, it should be understood that the disclosed apparatus / devices and methods can be implemented in other ways. For example, the apparatus / device embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0198] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0199] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application, and should all be included within the protection scope of this application.

Claims

1. A sound effect adjustment method, characterized in that, include: Receive a sound effect adjustment request, the sound effect adjustment request including the identifier of the audio data to be adjusted and the sound effect requirement description information of the audio to be adjusted, the sound effect requirement description information being used to indicate the sound effect desired by the user; In response to the sound effect adjustment request, the target audio parameters of the smart device's sound equalizer are determined based on the sound effect requirement description information; The equalizer is controlled according to the target audio parameters to optimize the audio data to be adjusted, thereby obtaining target audio data that meets the user's desired audio effect. Control the audio playback device of the smart device to play the target sound effect data; The process of determining the target audio parameters of the smart device's equalizer based on the audio effect requirement description information includes: The user's sound effect adjustment type is determined based on the aforementioned sound effect requirement description information; When the user's sound effect adjustment type is semantic sound effect adjustment, the user's historical sound effect adjustment data and the sound effect requirement description information are input into a preset large language model to expand the sound effect requirement description information with sound effect detail information, and the expanded sound effect requirement description information is determined. The expanded sound effect requirement description information is then matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity matching. The standard description information of at least one of the matched standard sound effects, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters. The preset mapping data is used to reflect the mapping relationship between one or more known sound effects and their corresponding audio parameters.

2. The sound effect adjustment method as described in claim 1, characterized in that, The method further includes: When the user's sound effect adjustment type is the sound effect adjustment of a specified song, multiple song names in the preset song library are matched with the name of the specified song, and each song name in the preset song library is bound to song audio parameters; If the name of the specified song is matched, the audio parameters of the song bound to the name of the song that matches the specified song in the preset song library are determined as the target audio parameters.

3. The sound effect adjustment method as described in claim 1, characterized in that, The standard sound effect data includes standard audio parameters of multiple standard sound effects. The standard description information of at least one matched standard sound effect, preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to perform sound effect parameter recognition, thereby obtaining the target audio parameters, including: If a standard description of the standard sound effect with a similarity greater than or equal to a first threshold is matched, the target audio parameter is determined in the standard sound effect data. The target audio parameter is the standard audio parameter of the standard sound effect with a similarity greater than or equal to the first threshold. If no standard description information of the standard sound effect with a similarity greater than or equal to the first threshold is matched, the sound effect recognition model is invoked to identify sound effect parameters by performing sound effect parameter recognition on the standard description information of the standard sound effect with a similarity greater than or equal to the second threshold, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information, and outputting the target audio parameters, wherein the second threshold is less than the first threshold.

4. The sound effect adjustment method as described in claim 1, characterized in that, The sound effect recognition model is trained in the following way: Acquire multiple historical audio data and the preset mapping data, wherein the historical audio data corresponds to sound effect description information and standard audio parameters; The preset mapping data, the historical audio data, and the sound effect description information of the historical audio data are input into a preset multimodal audio model for sound effect and parameter recognition to obtain the recognized audio parameters. The model loss value is determined based on the standard audio parameters of the historical audio data and the recognized audio parameters; If the model loss value meets the convergence condition, the converged preset multimodal audio model is output as the sound effect recognition model.

5. The sound effect adjustment method according to any one of claims 1-4, characterized in that, The step of controlling the equalizer to optimize the audio data to be adjusted based on the target audio parameters to obtain the target audio data includes: The target audio parameters and the audio data to be adjusted are input into the sound equalizer to generate the tuning curve of the audio data to be adjusted. The operation page of the sound equalizer is displayed on the display screen of the smart device. The operation page includes the tuning curve, which includes one or more frequency points with adjustable parameter values. Receive parameter adjustment operations for the parameter value of any of the audio parameters; In response to the parameter adjustment operation, the target audio parameters are updated to obtain the updated target audio parameters; The equalizer is controlled to optimize the audio data to be adjusted using the updated target audio parameters to obtain the target audio data.

6. A sound effect adjustment device, characterized in that, include: The receiving module is used to receive a sound effect adjustment request, wherein the sound effect adjustment request includes an identifier of the audio data to be adjusted and sound effect requirement description information of the audio to be adjusted, wherein the sound effect requirement description information is used to indicate the sound effect desired by the user; The response module is used to respond to the sound effect adjustment request and determine the target audio parameters of the sound equalizer of the smart device based on the sound effect requirement description information; The control module is used to control the sound equalizer to optimize the sound effect of the audio data to be adjusted according to the target audio parameters, so as to obtain target sound effect data, which meets the sound effect expected by the user. The control module is also used to control the audio playback device of the smart device to play the target sound effect data; The response module is specifically used for: The user's sound effect adjustment type is determined based on the aforementioned sound effect requirement description information; When the user's sound effect adjustment type is semantic sound effect adjustment, the user's historical sound effect adjustment data and the sound effect requirement description information are input into a preset large language model to expand the sound effect requirement description information with sound effect detail information, and the expanded sound effect requirement description information is determined. The expanded sound effect requirement description information is then matched with the standard description information of multiple standard sound effects in the standard sound effect data for similarity matching. The standard description information of at least one of the matched standard sound effects, the preset mapping data, the audio data to be adjusted, and the sound effect requirement description information are input into the sound effect recognition model to identify the sound effect parameters and obtain the target audio parameters. The preset mapping data is used to reflect the mapping relationship between one or more known sound effects and their corresponding audio parameters.

7. A smart device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the sound effect adjustment method as described in any one of claims 1 to 5.

8. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the sound effect adjustment method as described in any one of claims 1 to 5.

9. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, enables the implementation of the sound effect adjustment method as described in any one of claims 1 to 5.

Images