Audio media generation method and device, electronic equipment, medium and program product

Abstract

The invention relates to an audio media generation method and device, electronic equipment, a medium and program product quality. The method comprises the steps that a media creation page is displayed; in response to the timbre viewing instruction, displaying at least one to-be-selected timbre on the media creation page; in response to an audition test instruction for a first tone in the at least one to-be-selected tone, playing a first audio corresponding to the first tone; in response to a timbre selection instruction for the first timbre, taking the first timbre as a selected timbre; and in response to the media generation instruction, generating a target audio media having the same timbre as the first timbre. By using the technical scheme provided by the embodiment of the invention, the adaptability between the audio timbre in the audio media and the user demand can be improved while the audio media generation interaction efficiency is improved, and the generation effect and quality of the audio media are improved.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a method, apparatus, electronic device, medium, and program product for generating audio media. Background Technology

[0002] With the development of artificial intelligence technology, AI-based audio media content generation has been widely applied in many fields. In more and more application scenarios, users have put forward higher requirements for the personalization and emotional expression of the voice in the generated audio media. Often, after generating audio media such as videos, due to dissatisfaction with the voice effect, repeated generation interactions are performed, resulting in problems such as long operation time and low interaction efficiency in the audio media generation process. Summary of the Invention

[0003] This disclosure provides a method, apparatus, electronic device, medium, and program product for generating audio media, to at least solve the technical problems of long operation time and low interaction efficiency in the audio media generation process of related technologies. The technical solution of this disclosure is as follows: According to a first aspect of the present disclosure, a method for generating audio media is provided, comprising: Display the media creation page; In response to a timbre viewing command, at least one timbre to be selected is displayed on the media creation page; In response to a listening instruction for a first timbre among at least one selectable timbres, play the first audio corresponding to the first timbre; In response to the timbre selection command for the first timbre, the first timbre is selected as the timbre; In response to the media generation instruction, a target audio media with the same timbre as the first timbre is generated.

[0004] In an optional embodiment, the media creation page includes a media description input box; displaying at least one selectable timbre on the media creation page in response to a timbre viewing command includes: When a preset character is detected in the media description input box, the timbre viewing command is triggered, and at least one timbre to be selected is displayed on the media creation page.

[0005] In an optional embodiment, the step of selecting the first timbre as the selected timbre in response to a timbre selection instruction for the first timbre includes: In response to the timbre selection instruction for the first timbre, the timbre identification information corresponding to the first timbre is entered in the media description input box.

[0006] In an optional embodiment, the method further includes: In response to a timbre creation trigger command, a timbre creation interface is displayed, the timbre creation interface including at least one timbre creation entry, the at least one timbre creation entry corresponding to different audio media sources; In response to a trigger command based on a target timbre creation entry in the at least one timbre creation entry, at least one selectable audio medium corresponding to the target timbre creation entry is displayed; In response to a selection instruction for a target selection medium among at least one selectable audio media, a second audio with the same timbre as the audio in the target selection medium is generated; The timbre creation module is configured to execute a timbre creation confirmation command triggered based on the second audio to create a timbre corresponding to the second audio.

[0007] In an optional embodiment, the at least one audio media source corresponding to the at least one timbre creation entry includes at least one of the historical creation source, local upload source, or real-time acquisition source corresponding to the current account; when the audio media source corresponding to the target timbre creation entry is the historical creation source, the step of displaying at least one selectable audio media corresponding to the target timbre creation entry in response to the trigger command based on the target timbre creation entry among the at least one timbre creation entries includes: In response to a trigger command that creates an entry based on the target timbre, at least one historical audio media created by the current account is displayed.

[0008] In an optional embodiment, after generating a second audio with the same timbre as the audio in the target selected medium, the method further includes: Display at least one second adjustment control for the second audio; Each of the at least one second adjustment control corresponds to a preset acoustic attribute, and any one of the at least one second adjustment controls is used to trigger an adjustment of the second audio in the corresponding preset acoustic attribute dimension.

[0009] In an optional embodiment, generating a target audio medium having the same timbre as the first timbre in response to a media generation instruction includes: In response to the media generation instruction, the target audio media is generated based on the acoustic properties of the first audio, wherein the acoustic properties of the audio corresponding to the target audio media are the same as those of the first audio.

[0010] In an optional embodiment, after selecting the first timbre as the selected timbre in response to a timbre selection instruction for the first timbre, the method further includes: Display at least one first adjustment control for the first audio; Each of the at least one first adjustment control corresponds to a preset acoustic attribute, and any one of the at least one first adjustment controls is used to trigger an adjustment of the first audio in the corresponding preset acoustic attribute dimension.

[0011] In an optional embodiment, displaying at least one selectable timbre on the media creation page in response to a timbre viewing command includes: In response to the timbre viewing command, the media creation page displays timbre identification information corresponding to at least one selectable timbre and preset sound icons corresponding to each of the at least one selectable timbre. The method further includes: During the playback of the first audio corresponding to the first timbre, a preset sound icon corresponding to the first timbre is displayed based on preset animation effects.

[0012] In an optional embodiment, the at least one selectable timbre includes at least one created timbre created by the current account or at least one preset timbre; when the at least one selectable timbre includes the at least one created timbre and the at least one preset timbre, the at least one created timbre is ordered before the at least one preset timbre, and the at least one created timbre is ordered in ascending order based on the creation time of the at least one created timbre.

[0013] In an optional embodiment, displaying at least one selectable timbre on the media creation page in response to a timbre viewing command includes: In response to the timbre viewing command, the timbre identification information corresponding to each of the at least one selectable timbre and the recommendation index data corresponding to each of the at least one selectable timbre are displayed on the media creation page; The recommended index data corresponding to any of the selected timbres is used to indicate at least one of the first historical usage data of the current account for any of the selected timbres or the second historical usage data of the current user account for any of the selected timbres.

[0014] In an optional embodiment, before displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction, the method further includes: In response to a description information input instruction, the media description information corresponding to the description information input instruction is displayed on the media creation page; In response to the timbre viewing command, displaying at least one selectable timbre on the media creation page includes: In response to the timbre viewing command, the timbre identification information corresponding to the at least one timbre to be selected and the recommended information corresponding to the target timbre are displayed on the media creation page; The target timbre is the timbre among the at least one selectable timbres that matches the media description information.

[0015] According to a second aspect of the present disclosure, an audio media generation apparatus is provided, comprising: The media creation page display module is configured to display the media creation page; The candidate timbre display module is configured to execute a timbre viewing command and display at least one candidate timbre on the media creation page; The audio playback module is configured to execute a first audio corresponding to the first timbre in response to an audition command for at least one selectable timbre. The timbre selection module is configured to execute a timbre selection instruction in response to the first timbre, and to select the first timbre as the selected timbre. The audio media generation module is configured to execute a media generation instruction to generate a target audio media with the same timbre as the first timbre.

[0016] In an optional embodiment, the media creation page includes a media description input box; the selectable timbre display module includes: The first timbre display unit is configured to trigger the timbre viewing instruction when a preset character is detected in the media description input box, and to display the at least one selectable timbre on the media creation page.

[0017] In an optional embodiment, the timbre selection module includes: The timbre identification information input unit is configured to execute a timbre selection instruction for the first timbre by inputting timbre identification information corresponding to the first timbre into the media description input box.

[0018] In an optional embodiment, the apparatus further includes: The timbre creation interface display module is configured to execute a timbre creation trigger command and display a timbre creation interface. The timbre creation interface includes at least one timbre creation entry point, and the at least one timbre creation entry point corresponds to different audio media sources. The audio media display module is configured to execute a trigger command in response to a target timbre creation entry in the at least one timbre creation entry, and display at least one selectable audio media corresponding to the target timbre creation entry; The audio generation module is configured to execute, in response to a selection instruction for a target selected medium among at least one selectable audio media, a second audio with the same timbre as the audio in the target selected medium; The timbre creation module is configured to execute a timbre creation confirmation command triggered based on the second audio to create a timbre corresponding to the second audio.

[0019] In an optional embodiment, the at least one audio media source corresponding to the at least one timbre creation entry includes at least one of the historical creation source, local upload source, or real-time acquisition source corresponding to the current account; when the audio media source corresponding to the target timbre creation entry is the historical creation source, the audio media display module includes: The historical creation display unit is configured to execute a trigger command in response to the entry point created based on the target timbre, and display at least one historical audio media created by the current account.

[0020] In an optional embodiment, the apparatus further includes: The second adjustment control display module is configured to display at least one second adjustment control of the second audio after generating a second audio with the same timbre as the audio in the target selected media; Each of the at least one second adjustment control corresponds to a preset acoustic attribute, and any one of the at least one second adjustment controls is used to trigger an adjustment of the second audio in the corresponding preset acoustic attribute dimension.

[0021] In an optional embodiment, the audio media generation module includes: An audio media generation unit is configured to execute, in response to the media generation instruction, the generation of the target audio media based on the acoustic properties of the first audio, wherein the acoustic properties of the audio corresponding to the target audio media are the same as those of the first audio.

[0022] In an optional embodiment, the apparatus further includes: The first adjustment control display module is configured to display at least one first adjustment control of the first audio after the first timbre is selected as the first timbre in response to the timbre selection instruction for the first timbre. Each of the at least one first adjustment control corresponds to a preset acoustic attribute, and any one of the at least one first adjustment controls is used to trigger an adjustment of the first audio in the corresponding preset acoustic attribute dimension.

[0023] In an optional embodiment, the selectable timbre display module includes: The second timbre display unit is configured to execute a response to the timbre viewing instruction by displaying timbre identification information corresponding to at least one selectable timbre and a preset sound icon corresponding to each of the at least one selectable timbre on the media creation page. The device further includes: The motion effect rendering module is configured to render a preset sound icon corresponding to the first timbre based on preset motion effects during the first audio playback process corresponding to the first timbre.

[0024] In an optional embodiment, the at least one selectable timbre includes at least one created timbre created by the current account or at least one preset timbre; when the at least one selectable timbre includes the at least one created timbre and the at least one preset timbre, the at least one created timbre is ordered before the at least one preset timbre, and the at least one created timbre is ordered in ascending order based on the creation time of the at least one created timbre.

[0025] In an optional embodiment, the selectable timbre display module includes: The third timbre display unit is configured to execute a response to the timbre viewing instruction and display timbre identification information and recommendation index data corresponding to each of the at least one selectable timbre on the media creation page. The recommended index data corresponding to any of the selected timbres is used to indicate at least one of the first historical usage data of the current account for any of the selected timbres or the second historical usage data of the current user account for any of the selected timbres.

[0026] In an optional embodiment, the apparatus further includes: The media description information input module is configured to, in response to the description information input instruction, display the media description information corresponding to the description information input instruction on the media creation page before displaying at least one selectable timbre on the media creation page in response to the timbre viewing instruction; The selectable timbre display module includes: The fourth timbre display unit is configured to execute a response to the timbre viewing instruction, displaying timbre identification information corresponding to the at least one selectable timbre and recommended information corresponding to the target timbre on the media creation page; The target timbre is the timbre among the at least one selectable timbres that matches the media description information.

[0027] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement any of the audio media generation methods provided in this disclosure.

[0028] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any of the audio media generation methods provided in the present disclosure. According to a fifth aspect of the present disclosure, a computer program product comprising computer program instructions is provided, which, when executed by a processor on a computer, cause the computer to perform any of the audio media generation methods provided in the present disclosure as described above.

[0029] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects: During the creation of audio media, at least one candidate timbre can be displayed, and a listening command for that timbre can be triggered to play the corresponding first audio. This allows users to preview the audio timbre of the audio media to be created beforehand and select the desired timbre accordingly. This ensures that the audio timbre in the generated target audio media is the desired timbre, avoiding repeated media generation interactions caused by unsuitable timbres, reducing the interaction time during media generation, improving the efficiency of audio media generation, and also improving the compatibility between the audio timbre in the audio media and user needs, thereby improving the generation effect and quality of the audio media.

[0030] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0031] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0032] Figure 1 This is a schematic diagram illustrating an application environment according to an exemplary embodiment; Figure 2 This is a flowchart illustrating a method for generating audio media according to an exemplary embodiment; Figure 3 This is a schematic diagram of a media creation page according to an exemplary embodiment. Figure 4 This is a schematic diagram of another media creating a page, according to an exemplary embodiment; Figure 5 This is a schematic diagram illustrating page changes during a timbre creation process according to an exemplary embodiment; Figure 6 This is a schematic diagram illustrating a preset sound icon corresponding to a first timbre based on preset animation effects, according to an exemplary embodiment. Figure 7 This is a block diagram of an audio media generation apparatus according to an exemplary embodiment; Figure 8 This is a block diagram illustrating an electronic device for generating audio media according to an exemplary embodiment. Detailed Implementation

[0033] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0034] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar concepts and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0035] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0036] Please see Figure 1 , Figure 1 This is a schematic diagram illustrating an application environment according to an exemplary embodiment, which may include a terminal 100 and a server 200.

[0037] In an optional embodiment, terminal 100 can be used to provide services such as the creation of audio media (video, audio, etc.) to any user. Specifically, terminal 100 can be, but is not limited to, electronic devices such as smartphones, desktop computers, tablets, laptops, smart speakers, digital assistants, augmented reality (AR) / virtual reality (VR) devices, and smart wearable devices, or software running on the aforementioned electronic devices, such as applications. Optionally, the operating system running on the electronic device can be, but is not limited to, Android, iOS, Linux, Windows, etc.

[0038] In an optional embodiment, server 200 can provide background services to terminal 100. Specifically, server 200 can be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server providing cloud computing services.

[0039] In addition, it should be noted that, Figure 1 The example shown is merely one application environment provided by this disclosure. In practical applications, other application environments may also be included, such as more terminals.

[0040] In the embodiments described in this specification, the terminal 100 and the server 200 can be directly or indirectly connected through wired or wireless communication, and this disclosure does not impose any restrictions.

[0041] Figure 2 This is a flowchart illustrating an audio media generation method according to an exemplary embodiment. This method can be executed by a terminal or implemented through interaction between the terminal and a server, such as... Figure 2 As shown, the method may include the following steps: In step S201, the media creation page is displayed.

[0042] In one specific embodiment, the media creation page can be a page for creating audio media. Optionally, the media creation page can be a page for creating audio media based on artificial intelligence technology. Specifically, audio media can be media content carrying sound information, and for example, it can include at least one of audio, audio-visual (video), etc.

[0043] In an optional embodiment, taking the scenario of dubbing educational courseware, film and television dramas, etc., as an example, the aforementioned media creation page can be an audio creation page. Optionally, the audio creation page can support the generation of audio based on at least one preset audio generation model; specifically, any preset audio generation model can be an artificial intelligence model capable of generating audio; optionally, at least one preset audio generation model can include at least one of a text-based audio model or an audio-to-audio model; specifically, the text-based audio model can be an artificial intelligence model that generates audio based on text information; the audio-to-audio model can be an artificial intelligence model that generates audio based on audio.

[0044] In an optional embodiment, taking video creation scenarios such as short video creation, corporate promotional video creation, virtual human video interaction, and live streaming (live video) scenarios where digital humans or other non-real people conduct live broadcasts as examples, the aforementioned media creation page can be a video creation page. Optionally, the video creation page can support video generation based on at least one preset video generation model. Specifically, any preset video generation model can be a generative artificial intelligence model capable of generating videos. Optionally, at least one preset video generation model can include at least one of text-based video models, image-based video models, or multimodal video generation models. Specifically, a text-based video model can be a generative artificial intelligence model that generates videos based on text information; an image-based video model can be a generative artificial intelligence model that generates videos based on images; and a multimodal video generation model can be a generative artificial intelligence model that generates videos based on multimodal information. Specifically, multimodal information can include at least two modalities of information such as text, images, audio, and video.

[0045] In a specific embodiment, such as Figure 3 As shown, Figure 3 This is a schematic diagram of a media creation page according to an exemplary embodiment; optionally, combined with Figure 3 As can be seen, this media creation page can be a video creation page, and this video creation page supports video generation based on text-based video models, graph-based video models, or multimodal video models, and currently, video generation based on text-based video models is selected.

[0046] In step S203, in response to the timbre viewing instruction, at least one timbre to be selected is displayed on the media creation page.

[0047] In one specific embodiment, the timbre viewing command can be a command that triggers the viewing of the timbre to be selected; in an optional embodiment, at least one timbre to be selected can be displayed in the media creation interface in the form of a pop-up window or the like; optionally, the above-mentioned display of at least one timbre to be selected includes: displaying the timbre identification information corresponding to each of the at least one timbre to be selected; the timbre identification information can be information that can identify the corresponding timbre to be selected, a name reflecting the characteristics of the timbre to be selected, etc. Optionally, a preset sound icon corresponding to each of the at least one timbre to be selected can also be displayed. Specifically, the preset sound icon can be a visual symbol representing sound attributes.

[0048] In an optional embodiment, the media creation page may include a media description input box; correspondingly, the media creation page includes a media description input box; displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction may include: When a preset character is detected in the media description input box, a sound viewing command is triggered, and at least one sound to be selected is displayed on the media creation page.

[0049] In one specific embodiment, the media description input box can be used to input descriptive information of the audio media to be generated. In another specific embodiment, the preset character can be a pre-set character that triggers the display of at least one selectable timbre. Specifically, the preset character can be set according to actual application requirements, such as @, *, etc.

[0050] In one specific embodiment, taking the display of at least one selectable timbre on the media creation page as an example, such as... Figure 4 As shown, Figure 4 This is a schematic diagram of another media creation page illustrated according to an exemplary embodiment; specifically, in conjunction with... Figure 4 As can be seen, the preset character can be @; and the media creation page displays multiple selectable timbres, each with its corresponding timbre identifier information 401 and its corresponding preset sound icon 402.

[0051] In the above embodiments, when a preset character is detected in the media description input box, a timbre viewing command is triggered, and at least one timbre to be selected is displayed on the media creation page. This not only allows for one-click display of the timbre to be selected, greatly improving the convenience and efficiency of timbre selection, but also enables the use of timbre as one of the media description information in scenarios where audio media is generated in conjunction with the input media description information. This achieves aggregated input of media description information, simplifies the media description information setting process, ensures the continuity of content during the media description information setting process, and thus further improves media creation efficiency.

[0052] Furthermore, it should be noted that entering preset characters in the media description input box is only one way to trigger the tone viewing command. In practical applications, other methods can also be used, such as setting up corresponding viewing controls and triggering tone viewing commands through touch operations such as clicking or long-pressing the viewing controls.

[0053] In one specific embodiment, the at least one selectable timbre can be a timbre that can be used in the audio media creation process. Optionally, any selectable timbre can correspond to an audio, that is, an audio corresponding to the selectable timbre. In an optional embodiment, the at least one selectable timbre includes at least one of at least one created timbre created by the current account or at least one preset timbre. Specifically, the at least one created timbre created by the current account can be a timbre created by the current account; the at least one preset timbre can be a timbre provided by the platform.

[0054] In an optional embodiment, when at least one selectable timbre includes at least one created timbre and at least one preset timbre, the at least one created timbre is ordered before the at least one preset timbre, and the at least one created timbre is ordered in order from latest to earliest based on the creation time of the at least one created timbre, that is, the most recently created (latest created) is placed first.

[0055] In the above embodiments, at least one selectable timbre includes at least one created timbre created by the current account or at least one preset timbre, which can enrich the source of selectable timbres. When at least one selectable timbre includes at least one created timbre and at least one preset timbre, the at least one created timbre is sorted before the at least one preset timbre. The at least one created timbre is sorted in order from latest to earliest based on the creation time of the at least one created timbre. This can effectively recommend user-created timbres and put the most recently created (latest created) timbre at the top, which can help users select the timbre they need more quickly. This can improve the efficiency of timbre selection and the efficiency of audio media generation.

[0056] In an optional embodiment, the above method may further include: In response to a timbre creation trigger command, a timbre creation interface is displayed, which includes at least one timbre creation entry point. In response to a trigger command based on a target timbre creation entry in at least one timbre creation entry, at least one selectable audio medium corresponding to the target timbre creation entry is displayed; In response to a selection instruction for a target selected medium among at least one selectable audio media, a second audio with the same timbre as the audio in the target selected medium is generated; In response to a timbre creation confirmation command triggered based on the second audio, create the timbre corresponding to the second audio.

[0057] In one specific embodiment, the tone creation trigger command can be a command that triggers the display of the tone creation interface; optionally, the media creation page can include a tone creation trigger control; specifically, the tone creation trigger control can be used to trigger the tone creation trigger command; correspondingly, the tone creation trigger command can be triggered by touch operations such as clicking or long-pressing the tone creation trigger control; optionally, the tone creation trigger control can be continuously displayed on the media creation page, or it can be triggered through a certain entry point, and correspondingly, the display of the tone creation trigger control on the media creation page can also be canceled. Optionally, the tone creation trigger command can also be triggered on other pages.

[0058] In one specific embodiment, the timbre creation interface can be an interface used for timbre creation; optionally, the timbre creation interface can be an independent page, or it can be displayed on a page through pop-ups or other means, such as on the media creation page.

[0059] In one specific embodiment, the at least one timbre creation entry point corresponds to different audio media sources. Specifically, the audio media source can be the source of the audio media used to extract (generate) the timbre. Optionally, the at least one audio media source corresponding to the at least one timbre creation entry point includes at least one of the following: historical creation source, local upload source, or real-time acquisition source corresponding to the current account. Specifically, the historical creation source can be the audio media source used for extracting the timbre from the historical creations of the current account. Specifically, the local upload source can be the audio media source used for extracting the timbre from local audio media. Specifically, the real-time acquisition source can be the audio media source used for extracting the timbre from real-time acquired audio media.

[0060] In a specific embodiment, the target timbre creation entry can be any one of the at least one timbre creation entry; specifically, the triggering instruction based on the target timbre creation entry can be an instruction to trigger the display of at least one selectable audio media corresponding to the target timbre creation entry, that is, an instruction to trigger the display of at least one selectable audio media source corresponding to the target timbre creation entry.

[0061] In an optional embodiment, when the audio media source corresponding to the target timbre creation entry is a historical creation source, the at least one selectable audio media corresponding to the target timbre creation entry can be at least one historically created audio media of the current account; correspondingly, the above-mentioned response to the trigger instruction based on the target timbre creation entry in at least one timbre creation entry, displaying at least one selectable audio media corresponding to the target timbre creation entry, may include: In response to a trigger command that creates an entry based on the target timbre, display at least one historical audio media creation from the current account.

[0062] In one specific embodiment, at least one historical audio media created by the current account can be an audio media already created by the current account.

[0063] In the above embodiments, setting up a timbre creation entry point corresponding to at least one audio media source among historical creation sources, local upload sources, or real-time acquisition sources can improve the diversity of audio media sources used in the timbre creation process, enhance the flexibility of timbre extraction, and when timbre creation is triggered by combining the entry point corresponding to the historical creation source, the audio media used for timbre extraction can be selected from the user's historical creations. This allows for the direct reuse of timbre features from existing resources, significantly reducing the time and operational costs of timbre creation, while also improving resource reuse rate.

[0064] In one specific embodiment, in order to ensure the quality of the uploaded audio media and its compatibility with the platform's audio media processing, the format requirements and / or duration requirements of the audio media for which the timbre is extracted can be preset; accordingly, audio media that do not meet the format or duration requirements can be not displayed or set to an unselectable state.

[0065] In a specific embodiment, the target selection medium can be any selected audio medium from at least one candidate audio medium. Optionally, the selection instruction for the target selection medium can be to select the target selection medium as the audio medium for timbre extraction. Specifically, the generation of a second audio with the same timbre as the audio in the target selection medium can be combined with timbre cloning technology. Specifically, artificial intelligence technology can be used to extract the audio in the target selection medium and combine it to generate an audio with the same timbre. Specifically, the second audio can be an audio with the same timbre as the audio in the target selection medium. Optionally, the second audio can be displayed on the timbre creation interface. Optionally, the user can set the timbre identification information corresponding to the second audio. Optionally, the timbre identification information corresponding to the second audio can also be automatically generated. Optionally, the user can play the second audio on the timbre creation interface to confirm the corresponding timbre.

[0066] In one specific embodiment, the aforementioned timbre creation confirmation instruction can be an instruction to confirm the creation of a timbre corresponding to the second audio. Optionally, a corresponding confirmation control can be set in the timbre creation interface. Optionally, the aforementioned timbre creation confirmation instruction can be triggered by touch operations such as clicking or long-pressing the confirmation control to create a timbre corresponding to the second audio. Optionally, the second audio and the corresponding timbre identification information can be sent to the server and saved for later use.

[0067] In a specific embodiment, such as Figure 5 As shown, Figure 5 This is a schematic diagram illustrating page changes during a timbre creation process according to an exemplary embodiment. Specifically, in conjunction with... Figure 5 As shown in Figure a, the media creation page can be seen, and the interface corresponding to 501 can be a sound creation interface; the sound creation interface includes a sound creation entry 5011 corresponding to the local upload source and a sound creation entry 5012 corresponding to the historical creation source. Optionally, the sound creation entry 5011 corresponding to the local upload source can be used to trigger the display of at least one local audio media corresponding to the local upload source; optionally, the sound creation entry 5012 corresponding to the historical creation source can be used to trigger the display of at least one historically created audio media corresponding to the historical creation source; furthermore, a target media can be selected from at least one local audio media or at least one historically created audio media; correspondingly, such as Figure 5 The timbre creation interface shown in Figure b can display a second audio file that has the same timbre as the audio file in the target selected media. Optionally, the user can name the timbre corresponding to the generated second audio file (i.e., set the corresponding timbre identification information) and trigger the timbre creation confirmation command by clicking the "Confirm Creation" control or other touch operations to create the timbre corresponding to the second audio file.

[0068] In the above embodiments, by setting at least one timbre creation entry corresponding to different audio media sources in the timbre creation interface, the diversity of audio media sources used in the timbre creation process can be improved, thereby enhancing the flexibility of timbre extraction.

[0069] In an optional embodiment, after generating a second audio with the same timbre as the audio in the target selected media, the method may further include: Display at least one second adjustment control for the second audio; In one specific embodiment, each of the at least one second adjustment control corresponds to a preset acoustic attribute, and any one of the at least one second adjustment controls can be used to trigger an adjustment of the second audio in the corresponding preset acoustic attribute dimension. Optionally, the at least one preset acoustic attribute corresponding to the at least one second adjustment control can be an adjustable timbre feature attribute. Correspondingly, the at least one preset acoustic attribute may not include timbre (timbre belongs to inherent timbre feature attributes). For example, the at least one preset acoustic attribute corresponding to the at least one second adjustment control may include at least one attribute of speech rate and pitch. Correspondingly, the second adjustment control corresponding to speech rate (attribute) can be used to trigger an adjustment of the speech rate corresponding to the second audio; the second adjustment control corresponding to pitch (attribute) can be used to trigger an adjustment of the pitch corresponding to the second audio. Optionally, the adjustment of the adjustable timbre feature attribute will not change the timbre corresponding to the audio.

[0070] In one specific embodiment, the user can adjust the second audio based on the second adjustment control according to actual needs; that is, adjust the audio corresponding to the currently created timbre. Accordingly, the above-mentioned creation of the timbre corresponding to the second audio in response to the timbre creation confirmation command triggered based on the second audio may include: creating the timbre corresponding to the adjusted second audio in response to the timbre creation confirmation command triggered based on the adjusted second audio.

[0071] In the above embodiments, after generating a second audio with the same timbre as the audio in the target selected media, at least one second adjustment control of the second audio can be displayed to facilitate the user to adjust the acoustic properties of the audio corresponding to the currently created timbre, thereby better improving the adaptability between the acoustic properties of the audio in the audio media created by combining the audio corresponding to the timbre and the user's needs.

[0072] In an optional embodiment, displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction may include: In response to the timbre viewing command, the media creation page displays the timbre identification information corresponding to at least one timbre to be selected and the recommended index data corresponding to at least one timbre to be selected. In one specific embodiment, the recommendation metric data corresponding to any candidate timbre can be used to indicate at least one of the following: first historical usage data of the current account for any candidate timbre or second historical usage data of a user account within the current platform for any candidate timbre. Specifically, the first historical usage data can be data reflecting the usage of the corresponding candidate timbre by the current account when the audio media was created, such as the number of uses and / or frequency of use. Specifically, the second historical usage data can be data reflecting the usage of the corresponding candidate timbre by a user account within the current platform when the audio media was created, such as the number of uses and / or frequency of use.

[0073] In an optional embodiment, the recommended indicator data corresponding to any candidate timbre may include at least one of the first historical usage data of the current account for any candidate timbre or the second historical usage data of a user account within the current platform for any candidate timbre; optionally, it may also be combined with preset quantization rules to quantize at least one of the first historical usage data of the current account for any candidate timbre or the second historical usage data of a user account within the current platform for any candidate timbre into a corresponding numerical value, or a character representation such as "low", "medium", "high".

[0074] In an optional embodiment, when the recommendation index data is numerical, if the recommendation index data corresponding to a certain candidate timbre can be used to indicate the first historical usage data of the current account for any candidate timbre, and the first historical usage data is zero, the recommendation index data corresponding to the candidate timbre can be empty; optionally, if the recommendation index data corresponding to a certain candidate timbre can be used to indicate the second historical usage data of the current user account for any candidate timbre, and the second historical usage data is zero, the recommendation index data corresponding to the candidate timbre can be empty; optionally, if the recommendation index data corresponding to a certain candidate timbre can be used to indicate both the first historical usage data of the current account for any candidate timbre and the second historical usage data of the current user account for any candidate timbre, and both the first and second historical usage data are zero, the recommendation index data corresponding to the candidate timbre can be empty.

[0075] In the above embodiments, while displaying the timbre identification information corresponding to each of the at least one selectable timbre on the media creation page, the recommended indicator data corresponding to each of the at least one selectable timbre is also displayed. The recommended indicator data corresponding to any selectable timbre can be used to indicate at least one of the first historical usage data of the current account for any selectable timbre or the second historical usage data of the user account within the current platform for any selectable timbre. This facilitates targeted timbre recommendations based on the historical usage data of the selectable sound effects, improves the efficiency of user timbre selection, and also better ensures the effectiveness of audio timbres in the generated audio media.

[0076] In an optional embodiment, before displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction, the above method may further include: In response to the description information input command, the media description information corresponding to the description information input command is displayed on the media creation page; Accordingly, in response to the timbre viewing command, displaying at least one timbre to be selected on the media creation page may include: In response to the timbre viewing command, the media creation page displays at least one timbre identifier corresponding to the timbre to be selected and recommended information corresponding to the target timbre; In one specific embodiment, the description information input instruction can be an instruction to input the description information of the audio media to be created (generated); specifically, the media description information corresponding to the description information input instruction can be the description information of the audio media to be created (generated); optionally, the above media description information can be input in the media description input box.

[0077] In one specific embodiment, the target timbre can be at least one of the candidate timbres that matches the media description information. Optionally, the target timbre can include one or at least two timbres. Specifically, the matching between the media description information and the candidate timbre can be determined by combining a preset matching model. Specifically, the preset matching model can be a pre-set artificial intelligence model for matching timbres with media description information. Specifically, feature information (feature vector) of the media description information and feature information (feature vector) of the audio corresponding to the candidate timbre can be extracted, and the feature information of the media description information and the feature information of the audio corresponding to the candidate timbre can be input into the preset matching model for matching processing to obtain matching index data characterizing the degree of matching between the media description information and the candidate timbre. Optionally, the matching index data can be used to determine whether the media description information and the candidate timbre match. Matching; for example, if the matching index data between a candidate timbre and the media description information is greater than or equal to a preset threshold, it can be determined that the media description information matches the candidate timbre; otherwise, it does not match. Optionally, a preset media style recognition model and a preset timbre style recognition model can be combined to identify the media style corresponding to the media description information and the timbre style corresponding to the candidate timbre, respectively. Pre-set preset matching relationships between different media styles and timbre styles are also provided. Correspondingly, if the preset matching relationship includes the matching relationship between the timbre style corresponding to a candidate timbre and the timbre style corresponding to the media description information, it can be determined that the candidate timbre matches the media description information; otherwise, it does not match. Specifically, the preset media style recognition model can be a pre-set artificial intelligence model used for identifying the media style corresponding to the media description information. Optionally, the feature information of the media description information can be input into the preset media style recognition model for style recognition to obtain the corresponding media style. Optionally, the media style can be set according to actual application needs, such as aesthetic style, retro style, etc. Specifically, the preset timbre style recognition model can be a pre-set artificial intelligence model used for timbre-to-timbre style recognition; optionally, the feature information of the audio corresponding to the timbre can be input into the preset timbre style recognition model for style recognition to obtain the corresponding timbre style. Optionally, the timbre style can be set according to actual applications, such as a cool and refined style, a retro texture style, etc. Optionally, the cool and refined style can be matched with an aesthetic style, and the retro texture style can be matched with a retro style.

[0078] In one specific embodiment, the recommendation information corresponding to the target timbre can be information that can indicate the recommended target timbre; optionally, the information format of the recommendation information can include, but is not limited to, text, icons, or at least any one of them.

[0079] In the above embodiments, if the media description information of the audio media to be created has been entered on the media creation page before triggering the timbre viewing, the media creation page can display at least one timbre identification information corresponding to the timbre to be selected and at least one recommended information corresponding to the target timbre that matches the media description information among the timbres to be selected. This can help users select a suitable timbre for the audio media to be created more quickly, and can also improve the generation effect and efficiency of the audio media.

[0080] In step S205, in response to a listening instruction for the first timbre among at least one selectable timbres, the first audio corresponding to the first timbre is played.

[0081] In one specific embodiment, the first timbre can be any one of at least one selectable timbre; optionally, the above-mentioned listening instruction can be triggered by hovering the mouse over the area where the first timbre is located (the area where the timbre identification information corresponding to the first timbre is located), clicking the area where the first timbre is located, or clicking the preset listening control corresponding to the first timbre. Specifically, the first audio can be the audio corresponding to the first timbre.

[0082] In an optional embodiment, displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction may include: In response to the timbre viewing command, the media creation page displays at least one timbre identifier information corresponding to each of the selectable timbres and at least one preset sound icon corresponding to each of the selectable timbres. Optionally, the above method may also include: During the playback of the first audio corresponding to the first timbre, a preset sound icon corresponding to the first timbre is displayed based on preset animation effects.

[0083] In one specific embodiment, the preset animation effect can be set according to the actual application. For example, such as Figure 6 , Figure 6 This is a schematic diagram illustrating a preset sound icon corresponding to a first timbre based on a preset motion effect, according to an exemplary embodiment; wherein, the preset sound icon corresponding to 601 can be a schematic diagram of the preset sound icon corresponding to the first timbre at a certain moment during the presentation of the preset motion effect.

[0084] In the above embodiments, during the playback of the first audio corresponding to the first timbre, a preset sound icon corresponding to the first timbre is presented based on a preset animation effect, which can help users understand the timbre being listened to more intuitively and conveniently, and improve the user experience during the timbre listening process.

[0085] In step S207, in response to the timbre selection command for the first timbre, the first timbre is selected as the selected timbre.

[0086] In one specific embodiment, the timbre selection instruction can be an instruction to select the first timbre as the timbre of the audio medium to be created (i.e., the selected timbre); optionally, the timbre selection instruction can be triggered by a touch operation such as clicking the area where the first timbre is located. Optionally, setting the first timbre as the selected timbre can include setting the first timbre to a selected state; for example, the styles corresponding to the selected state and the unselected state can be preset in advance, and accordingly, the style of the area where the first timbre is located (the area where the timbre identification information corresponding to the first timbre is located) can be updated from the unselected state to the selected state.

[0087] In an optional embodiment, the above-described response to a timbre selection instruction for a first timbre, selecting the first timbre as the selected timbre, may include: In response to the tone selection command for the first tone, enter the tone identifier information corresponding to the first tone in the media description input box.

[0088] In the above embodiments, in response to the timbre selection instruction for the first timbre, the timbre identifier information corresponding to the first timbre is entered in the media description input box. The timbre can be used as one of the media description information, realizing the aggregated input of media description information, simplifying the media description information setting process, ensuring the continuity of content in the media description information setting process, and thus improving the efficiency of media creation.

[0089] In step S209, in response to the media generation instruction, a target audio medium with the same timbre as the first timbre is generated.

[0090] In one specific embodiment, the media generation instruction can be an instruction to generate target audio media; optionally, the media generation instruction can be triggered by clicking the corresponding creation control or other touch operations after setting the information required to generate the audio media (media description information, etc.). For example, taking the scenario of dubbing educational courseware, film and television dramas, etc., as an example, if the corresponding dubbing audio is generated by combining a text-based audio model, the text information entered on the media creation page and the first audio corresponding to the first timbre can be input into the text-based audio model. During the audio conversion process, the timbre in the first audio is merged to generate target audio media (dubbing audio) with the same timbre as the first timbre. Optionally, if the corresponding dubbing audio is generated by combining an audio-based audio model, the original audio entered on the media creation page and the first audio corresponding to the first timbre can be input into the audio-based audio model. The timbre in the first audio is merged into the original audio to generate target audio media (dubbing audio) with the same timbre as the first timbre. For example, taking the video creation scenario as an example, if the corresponding video is generated by combining the text-based video model, the text information (media description information in text form) entered on the media creation page and the first audio corresponding to the first timbre can be input into the text-based video model. In the process of generating video by combining text, the timbre in the first audio can be integrated to generate a target audio media (video) with the same timbre as the first timbre.

[0091] In one specific embodiment, generating a target audio medium with the same timbre as the first timbre in response to the media generation instruction may include: In response to the media generation instruction, the target audio media is generated based on the acoustic properties of the first audio.

[0092] In one specific embodiment, the acoustic properties of the audio corresponding to the target audio medium are the same as those of the first audio. Specifically, the acoustic properties of the audio may include timbre; optionally, they may also include at least one of the following attributes: speech rate, pitch, etc.

[0093] In the above embodiments, during the media generation process, the target audio media is generated by combining the acoustic attributes of the selected timbre corresponding to the first audio. This not only refers to the timbre attribute corresponding to the audio, but also to other acoustic attributes, thereby enabling more comprehensive control over the acoustic attributes in the final generated audio media and ensuring the effectiveness of the generated audio media.

[0094] In an optional embodiment, after selecting the first timbre as the selected timbre in response to a timbre selection instruction for the first timbre, the above method may further include: Display at least one first adjustment control for the first audio; In one specific embodiment, each of the at least one first adjustment control corresponds to a preset acoustic attribute, and any one of the at least one first adjustment controls can be used to trigger an adjustment of the first audio in the corresponding preset acoustic attribute dimension. Optionally, the at least one preset acoustic attribute corresponding to the at least one first adjustment control can be an adjustable timbre feature attribute. Correspondingly, the at least one preset acoustic attribute corresponding to the at least one first adjustment control may not include timbre (timbre belongs to an inherent timbre feature attribute). For example, the at least one preset acoustic attribute corresponding to the at least one first adjustment control may include at least one attribute of speech rate and pitch. Correspondingly, the first adjustment control corresponding to speech rate (attribute) can be used to trigger an adjustment of the speech rate corresponding to the first audio; the first adjustment control corresponding to pitch (attribute) can be used to trigger an adjustment of the pitch corresponding to the first audio. Optionally, the adjustment of the adjustable timbre feature attribute will not change the timbre corresponding to the audio.

[0095] In one specific embodiment, the user can adjust the first audio based on the first adjustment control according to actual needs. Accordingly, the above-mentioned generation of target audio media in response to the media generation instruction and based on the acoustic properties of the first audio may include generating target audio media in response to the media generation instruction and based on the adjusted acoustic properties of the first audio.

[0096] In the above embodiments, after selecting a timbre for the audio media to be created, at least one first adjustment control of the first audio corresponding to the selected timbre can be displayed. This facilitates a more comprehensive adjustment of the acoustic attributes of the audio media to be created, thereby improving the adaptability between the acoustic attributes of the audio in the target audio media and user needs, avoiding repeated generation, and improving the efficiency of media generation interaction.

[0097] Furthermore, it should be noted that the instructions triggered by touch operation in the embodiments of this application can also be combined with at least one of voice control operation, device movement operation or gesture operation in practical applications. The embodiments of this application are not limited to the above.

[0098] As can be seen from the technical solutions provided in the embodiments of this specification above, during the creation of audio media, at least one selectable timbre can be displayed, and a listening instruction for the selectable timbre can be triggered to play the corresponding first audio. This allows users to listen to the audio timbre of the audio media to be created in advance during the creation process and select the desired timbre in a targeted manner. This ensures that the audio timbre in the generated target audio media is the desired timbre, avoids repeated media generation interactions caused by unsuitable timbre, reduces the interaction time during the media generation process, improves the efficiency of audio media generation interaction, and also improves the adaptability between the audio timbre in the audio media and the user's needs, thereby improving the generation effect and quality of the audio media.

[0099] Figure 7 This is a block diagram illustrating an audio media generation apparatus according to an exemplary embodiment. (Refer to...) Figure 7 The device includes: The media creation page display module 710 is configured to display the media creation page. The candidate timbre display module 720 is configured to execute a timbre viewing command and display at least one candidate timbre on the media creation page; The audio playback module 730 is configured to execute a first audio corresponding to the first timbre in response to an audition command for at least one selectable timbre; The timbre selection module 740 is configured to execute a timbre selection instruction in response to a first timbre, and to select the first timbre as the selected timbre. The audio media generation module 750 is configured to execute a media generation instruction to generate a target audio media with the same timbre as the first timbre.

[0100] In an optional embodiment, the media creation page includes a media description input box; the selectable timbre display module 720 includes: The first timbre display unit is configured to trigger a timbre viewing command when a preset character is detected in the media description input box, and display at least one timbre to be selected on the media creation page.

[0101] In an optional embodiment, the tone selection module 740 includes: The timbre identification information input unit is configured to execute a timbre selection instruction for the first timbre by inputting the timbre identification information corresponding to the first timbre into the media description input box.

[0102] In an optional embodiment, the above-described apparatus further includes: The tone creation interface display module is configured to respond to tone creation trigger commands and display tone creation interface. The tone creation interface includes at least one tone creation entry, and at least one tone creation entry corresponds to different audio media sources. The audio media display module is configured to execute a trigger command in response to a target timbre creation entry in at least one timbre creation entry, and display at least one selectable audio media corresponding to the target timbre creation entry; The audio generation module is configured to execute, in response to a selection instruction for at least one target selected medium among selectable audio media, a second audio with the same timbre as the audio in the target selected medium; The timbre creation module is configured to execute a timbre creation confirmation command triggered based on the second audio, and create a timbre corresponding to the second audio.

[0103] In an optional embodiment, at least one audio media source corresponding to at least one timbre creation entry includes at least one of the following: historical creation source, local upload source, or real-time acquisition source corresponding to the current account; when the audio media source corresponding to the target timbre creation entry is a historical creation source, the audio media display module includes: The Historical Creations Showcase unit is configured to execute trigger commands in response to entry points created based on target timbres, displaying at least one historical audio media creation from the current account.

[0104] In an optional embodiment, the above-described apparatus further includes: The second adjustment control display module is configured to display at least one second adjustment control of the second audio after generating a second audio with the same timbre as the audio in the target selected media; Each of the at least one second adjustment control corresponds to a preset acoustic attribute, and any one of the at least one second adjustment controls is used to trigger an adjustment of the second audio in the corresponding preset acoustic attribute dimension.

[0105] In an optional embodiment, the audio media generation module 750 includes: The audio media generation unit is configured to execute a media generation instruction in response to generate a target audio media based on the acoustic properties of a first audio source, wherein the acoustic properties of the audio source corresponding to the target audio media are the same as those of the first audio source.

[0106] In an optional embodiment, the above-described apparatus further includes: The first adjustment control display module is configured to display at least one first adjustment control of the first audio after responding to a timbre selection instruction for the first timbre and setting the first timbre as the selected timbre. Each of the at least one first adjustment control corresponds to a preset acoustic attribute, and any one of the at least one first adjustment controls is used to trigger an adjustment of the first audio in the corresponding preset acoustic attribute dimension.

[0107] In an optional embodiment, the selectable timbre display module 720 includes: The second timbre display unit is configured to respond to the timbre viewing command by displaying at least one timbre identification information corresponding to each of the selectable timbres and at least one preset sound icon corresponding to each of the selectable timbres on the media creation page. The above-mentioned device also includes: The motion effects rendering module is configured to render a preset sound icon corresponding to the first timbre based on preset motion effects during the first audio playback process corresponding to the first timbre.

[0108] In an optional embodiment, at least one selectable tone includes at least one created tone created by the current account or at least one preset tone; when at least one selectable tone includes at least one created tone and at least one preset tone, the at least one created tone is ordered before the at least one preset tone, and the at least one created tone is ordered in order from latest to earliest based on the creation time corresponding to the at least one created tone.

[0109] In an optional embodiment, the selectable timbre display module 720 includes: The third timbre display unit is configured to respond to the timbre viewing command by displaying at least one timbre identification information and at least one recommendation index data corresponding to each of the selectable timbres on the media creation page. Among them, the recommended indicator data corresponding to any candidate timbre is used to indicate at least one of the first historical usage data of the current account for any candidate timbre or the second historical usage data of the current user account for any candidate timbre.

[0110] In an optional embodiment, the above-described apparatus further includes: The media description information input module is configured to, in response to a description information input instruction, display the media description information corresponding to the description information input instruction on the media creation page before displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction. The selectable tone display module 720 includes: The fourth timbre display unit is configured to respond to timbre viewing commands by displaying at least one timbre identifier information corresponding to the timbre to be selected and recommended information corresponding to the target timbre on the media creation page. The target timbre is at least one candidate timbre that matches the media description information.

[0111] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0112] Figure 8 This is a block diagram illustrating an electronic device for generating audio media according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as follows: Figure 8 As shown. This electronic device may include an RF (Radio Frequency) circuit 810, a memory 820 including one or more computer-readable storage media, an input unit 830, a display unit 840, a sensor 850, an audio circuit 860, a WiFi (Wireless Fidelity) module 870, a processor 880 including one or more processing cores, and a power supply 890, among other components. Those skilled in the art will understand that... Figure 8 The terminal structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The RF circuit 810 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and hands it over to one or more processors 880 for processing; additionally, it transmits uplink data to the base station. Typically, the RF circuit 810 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. Furthermore, the RF circuit 810 can also communicate wirelessly with networks and other terminals. Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

[0113] The memory 820 can be used to store software programs and modules. The processor 880 executes various functional applications and data processing by running the software programs and modules stored in the memory 820. The memory 820 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for the functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 820 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 820 may also include a memory controller to provide access to the memory 820 for the processor 880 and the input unit 830.

[0114] The input unit 830 can be used to receive input digital or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, the input unit 830 may include a touch-sensitive surface 831 and other input devices 832. The touch-sensitive surface 831, also known as a touch display screen or touchpad, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch-sensitive surface 831), and drive the corresponding connected devices according to a pre-set program. Optionally, the touch-sensitive surface 831 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 880, and can also receive and execute commands sent by the processor 880. In addition, the touch-sensitive surface 831 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 831, the input unit 830 may also include other input devices 832. Specifically, other input devices 832 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc. The display unit 840 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the terminal. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. The display unit 840 may include a display panel 841, which may optionally be configured as an LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or similar display panel 841. Further, a touch-sensitive surface 831 may cover the display panel 841. When the touch-sensitive surface 831 detects a touch operation on or near it, it transmits the information to the processor 880 to determine the type of touch event. Subsequently, the processor 880 provides corresponding visual output on the display panel 841 according to the type of touch event. The touch-sensitive surface 831 and the display panel 841 can be two independent components to implement input and output functions. However, in some embodiments, the touch-sensitive surface 831 and the display panel 841 can be integrated to achieve input and output functions.

[0115] The terminal may also include at least one sensor 850, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 841 according to the ambient light level, and the proximity sensor can turn off the display panel 841 and / or the backlight when the terminal is moved to the ear. As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that identify the terminal's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometer, tapping), etc. Other sensors that may be configured on the terminal, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0116] Audio circuitry 860, speaker 861, and microphone 862 provide an audio interface between the user and the terminal. Audio circuitry 860 converts received audio data into electrical signals, which are then transmitted to speaker 861, where they are converted into sound signals for output. Conversely, microphone 862 collects sound signals, converts them into electrical signals, which are then received by audio circuitry 860, converted back into audio data, processed by processor 880, and transmitted via RF circuitry 810 to, for example, another terminal, or output to memory 820 for further processing. Audio circuitry 860 may also include an earphone jack to facilitate communication between a peripheral headset and the terminal.

[0117] WiFi is a short-range wireless transmission technology. This terminal, through the WiFi module 870, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 8 WiFi module 870 is shown, but it is understood that it is not a necessary component of the terminal and can be omitted as needed without changing the nature of the invention.

[0118] The processor 880 is the control center of the terminal, connecting various parts of the terminal through various interfaces and lines. It executes software programs and / or modules stored in the memory 820, and calls data stored in the memory 820 to perform various functions and process data, thereby enabling overall monitoring of the terminal. Optionally, the processor 880 may include one or more processing cores; preferably, the processor 880 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into the processor 880.

[0119] The terminal also includes a power supply 890 (such as a battery) to power various components. Preferably, the power supply can be logically connected to the processor 880 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 890 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0120] Although not shown, the terminal may also include a camera, Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the display unit of the terminal is a touch screen display, and the terminal also includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors of the instructions in the method embodiment of the present invention.

[0121] In an exemplary embodiment, an electronic device is also provided, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the audio media generation method as described in the embodiments of this disclosure.

[0122] In an exemplary embodiment, a computer-readable storage medium is also provided, wherein when the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the audio media generation method of the present disclosure embodiments. In an exemplary embodiment, a computer program product comprising computer program instructions is also provided, which, when executed by a processor on a computer, cause the computer to perform the audio media generation method of the present disclosure embodiments.

[0123] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This computer program can be stored in a non-volatile computer-readable storage medium. When executed, the computer program can include the processes of the embodiments of the above methods. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0124] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0125] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for generating audio media, characterized in that, include: Display the media creation page; In response to a timbre viewing command, at least one timbre to be selected is displayed on the media creation page; In response to a listening instruction for a first timbre among at least one selectable timbres, play the first audio corresponding to the first timbre; In response to the timbre selection command for the first timbre, the first timbre is selected as the timbre; In response to the media generation instruction, a target audio media with the same timbre as the first timbre is generated.

2. The method for generating audio media according to claim 1, characterized in that, The media creation page includes a media description input box; In response to the timbre viewing command, displaying at least one selectable timbre on the media creation page includes: When a preset character is detected in the media description input box, the timbre viewing command is triggered, and at least one timbre to be selected is displayed on the media creation page.

3. The method for generating audio media according to claim 2, characterized in that, The step of responding to a timbre selection instruction for the first timbre by selecting the first timbre includes: In response to the timbre selection instruction for the first timbre, the timbre identification information corresponding to the first timbre is entered in the media description input box.

4. The method for generating audio media according to any one of claims 1 to 3, characterized in that, The method further includes: In response to a timbre creation trigger command, a timbre creation interface is displayed, the timbre creation interface including at least one timbre creation entry, the at least one timbre creation entry corresponding to different audio media sources; In response to a trigger command based on a target timbre creation entry in the at least one timbre creation entry, at least one selectable audio medium corresponding to the target timbre creation entry is displayed; In response to a selection instruction for a target selection medium among at least one selectable audio media, a second audio with the same timbre as the audio in the target selection medium is generated; In response to the timbre creation confirmation command triggered based on the second audio, the timbre corresponding to the second audio is created.

5. The method for generating audio media according to claim 4, characterized in that, The at least one audio media source corresponding to the at least one timbre creation entry includes at least one of the following: the historical creation source, the local upload source, or the real-time acquisition source corresponding to the current account; When the audio media source corresponding to the target timbre creation entry is the historical creation source, the step of displaying at least one selectable audio media corresponding to the target timbre creation entry in response to the trigger command based on the target timbre creation entry among the at least one timbre creation entry includes: In response to a trigger command that creates an entry based on the target timbre, at least one historical audio media created by the current account is displayed.

6. The method for generating audio media according to claim 4, characterized in that, After generating a second audio with the same timbre as the audio in the target selected media, the method further includes: Display at least one second adjustment control for the second audio; Each of the at least one second adjustment control corresponds to a preset acoustic attribute, and any one of the at least one second adjustment controls is used to trigger an adjustment of the second audio in the corresponding preset acoustic attribute dimension.

7. The method for generating audio media according to any one of claims 1 to 3, characterized in that, The step of generating a target audio media with the same timbre as the first timbre in response to a media generation instruction includes: In response to the media generation instruction, the target audio media is generated based on the acoustic properties of the first audio, wherein the acoustic properties of the audio corresponding to the target audio media are the same as those of the first audio.

8. The method for generating audio media according to claim 7, characterized in that, After selecting the first timbre as the selected timbre in response to a timbre selection command for the first timbre, the method further includes: Display at least one first adjustment control for the first audio; Each of the at least one first adjustment control corresponds to a preset acoustic attribute, and any one of the at least one first adjustment controls is used to trigger an adjustment of the first audio in the corresponding preset acoustic attribute dimension.

9. The method for generating audio media according to any one of claims 1 to 3, characterized in that, In response to the timbre viewing command, displaying at least one selectable timbre on the media creation page includes: In response to the timbre viewing command, the media creation page displays timbre identification information corresponding to at least one selectable timbre and preset sound icons corresponding to each of the at least one selectable timbre. The method further includes: During the playback of the first audio corresponding to the first timbre, a preset sound icon corresponding to the first timbre is displayed based on preset animation effects.

10. The method for generating audio media according to any one of claims 1 to 3, characterized in that, The at least one selectable timbre includes at least one created timbre created by the current account or at least one preset timbre; when the at least one selectable timbre includes the at least one created timbre and the at least one preset timbre, the at least one created timbre is ordered before the at least one preset timbre, and the at least one created timbre is ordered in ascending order based on the creation time of the at least one created timbre.

11. The method for generating audio media according to any one of claims 1 to 3, characterized in that, In response to the timbre viewing command, displaying at least one selectable timbre on the media creation page includes: In response to the timbre viewing command, the timbre identification information corresponding to each of the at least one selectable timbre and the recommendation index data corresponding to each of the at least one selectable timbre are displayed on the media creation page; The recommended index data corresponding to any of the selected timbres is used to indicate at least one of the first historical usage data of the current account for any of the selected timbres or the second historical usage data of the current user account for any of the selected timbres.

12. The method for generating audio media according to any one of claims 1 to 3, characterized in that, Before displaying at least one selectable timbre on the media creation page in response to a timbre viewing instruction, the method further includes: In response to a description information input instruction, the media description information corresponding to the description information input instruction is displayed on the media creation page; In response to the timbre viewing command, displaying at least one selectable timbre on the media creation page includes: In response to the timbre viewing command, the timbre identification information corresponding to the at least one timbre to be selected and the recommended information corresponding to the target timbre are displayed on the media creation page; The target timbre is the timbre among the at least one selectable timbres that matches the media description information.

13. An audio media generation device, characterized in that, include: The media creation page display module is configured to display the media creation page; The candidate timbre display module is configured to execute a timbre viewing command and display at least one candidate timbre on the media creation page; The audio playback module is configured to execute a first audio corresponding to the first timbre in response to an audition command for at least one selectable timbre. The timbre selection module is configured to execute a timbre selection instruction in response to the first timbre, and to select the first timbre as the selected timbre. The audio media generation module is configured to execute a media generation instruction to generate a target audio media with the same timbre as the first timbre.

14. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the audio media generation method as described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is able to perform the audio media generation method as described in any one of claims 1 to 12.

16. A computer program product, characterized in that, It includes computer program instructions that, when executed by a computer's processor, cause the computer to perform the audio media generation method as described in any one of claims 1 to 12.

Images