Special-effect creation method and apparatus, and device, computer-readable storage medium and product

Abstract

Provided in the embodiments of the present disclosure are a special-effect creation method and apparatus, and a device, a computer-readable storage medium and a product. The special-effect creation method comprises: displaying a special-effect editing page; in response to a trigger operation of a user for an audio addition control, acquiring target audio added by the user, and determining at least one beat point corresponding to the target audio; acquiring at least one special-effect element determined by the user, wherein at least some special-effect elements are associated with the beat point; and determining target special-effect content on the basis of the target audio and the at least one special-effect element, wherein the target audio is located in a corresponding editable layer. Therefore, when performing image processing on the basis of the target special-effect content, the user does not need to manually add music, thereby improving the effect of special-effect processing. By means of determining target music as an editable layer in the target special-effect content, the user can subsequently flexibly implement an editing operation on the target music in the target special-effect content on the basis of a trigger operation for the editable layer corresponding to the target music.

Description

Special effects creation method, device, equipment, computer-readable storage medium and product

[0001] This application claims priority to Chinese Patent Application No. 202311789634.5 filed on December 22, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby cited in their entirety as part of this application. Technical Field

[0002] The embodiments of the present disclosure relate to a special effects creation method, apparatus, device, computer-readable storage medium, and product. Background Art

[0003] With the development of terminal devices, more and more application software has gradually entered users' lives. Users can publish the video content they shoot or upload on video or social media apps. To improve the display quality of the published content, users can also optimize the video content based on special effects.

[0004] However, the current special effects content creation process can only process the display effects of the image content, but cannot better add audio during the creation process, so the special effects are relatively simple, resulting in a poor user experience. Summary of the Invention

[0005] The embodiments of the present disclosure provide a special effects creation method, apparatus, device, computer-readable storage medium, and product.

[0006] In a first aspect, an embodiment of the present disclosure provides a special effects creation method, comprising:

[0007] Displaying a special effect editing page, wherein the special effect editing page includes a preset audio adding control;

[0008] In response to a user triggering operation on the audio adding control, acquiring the target audio added by the user, and determining at least one beat point corresponding to the target audio;

[0009] Acquire at least one special effect element determined by the user, wherein at least some of the special effect elements are associated with the beat points;

[0010] Target special effect content is determined based on the target audio and the at least one special effect element, wherein the target audio is located in a corresponding editable layer.

[0011] In a second aspect, an embodiment of the present disclosure provides a special effects creation device, comprising:

[0012] A display module, configured to display a special effect editing page, wherein the special effect editing page includes a preset audio adding control;

[0013] a determination module, configured to obtain the target audio added by the user in response to a user triggering operation on the audio adding control, and determine at least one beat point corresponding to the target audio;

[0014] an acquisition module, configured to acquire at least one special effect element determined by the user, wherein at least some of the special effect elements are associated with the beat points;

[0015] A processing module is used to determine target special effect content based on the target audio and the at least one special effect element, wherein the target audio is located in a corresponding editable layer.

[0016] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0017] The memory stores computer-executable instructions;

[0018] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the special effects creation method described in the first aspect and various possible designs of the first aspect.

[0019] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the special effects creation method described in the first aspect and various possible designs of the first aspect is implemented.

[0020] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the special effects creation method described in the first aspect and various possible designs of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0022] FIG1 is a flow chart of a special effects creation method provided by an embodiment of the present disclosure;

[0023] FIG2 is a flow chart of a special effects creation method provided by another embodiment of the present disclosure;

[0024] FIG3 is a schematic diagram of an interface interaction provided by an embodiment of the present disclosure;

[0025] FIG4 is a flow chart of a special effects creation method provided by another embodiment of the present disclosure;

[0026] FIG5 is another schematic diagram of an interface interaction provided by an embodiment of the present disclosure;

[0027] FIG6 is a flowchart of a special effects creation method provided by another embodiment of the present disclosure;

[0028] FIG7 is another schematic diagram of an interface interaction provided by an embodiment of the present disclosure;

[0029] FIG8 is a flowchart of a special effects creation method provided by another embodiment of the present disclosure;

[0030] FIG9 is a schematic structural diagram of a special effects creation device provided by an embodiment of the present disclosure; and

[0031] FIG10 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0033] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0034] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0035] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0036] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0037] Glossary:

[0038] Audio track: used to define the attribute information of the corresponding audio, such as timbre, timbre library, number of channels, input / output ports, volume, etc.

[0039] In order to solve the technical problem that current special effects content does not include audio, resulting in poor image processing effects based on special effects content, the present disclosure provides a special effects creation method, device, equipment, computer-readable storage medium and product.

[0040] It should be noted that the special effects creation method, device, equipment, computer-readable storage medium and product provided by the present disclosure can be applied to any special effects production scenario.

[0041] In the current special effects content creation process, generally only the display effects of image content or video content can be processed, such as adding filters, deformations, stickers, etc. to the special effects content. However, it is not possible to add audio content to the special effects content, such as background music, sound effects, etc. When performing image or video processing based on the current special effects content, if the user needs to enrich the processing effect of the image content or video content, it is necessary to manually add audio content as background music during the image or video editing process. However, the above-mentioned image processing methods are often cumbersome to operate, and the music manually added by the user is often less correlated with the special effects processing effect, resulting in poor special effects processing results.

[0042] In the process of solving the above technical problems, the inventors discovered through research that in order to enrich the special effects content, target audio can be added to the special effects content during the creation of the special effects content to obtain the target special effects content.

[0043] Furthermore, to enhance the relevance between the visual content of the target special effects content and the added target audio, the beat points corresponding to the target audio can be determined and special effects elements associated with these beat points can be added to the special effects content. This allows for a display effect where different special effects processing results are displayed as the nodes in the audio change, effectively enriching the special effects processing results.

[0044] Furthermore, to facilitate subsequent processing of the target audio added to the target special effect content, the target audio can be added as an editable layer within the special effect content. This way, when the target special effect content is created, the target audio is located in its corresponding editable layer. This allows for targeted adjustments to the target audio by selecting the editable layer corresponding to the target audio.

[0045] FIG1 is a flow chart of a special effects creation method provided by an embodiment of the present disclosure. As shown in FIG1 , the method includes:

[0046] Step 101: Display a special effect editing page, wherein the special effect editing page includes a preset audio adding control.

[0047] The execution subject of this embodiment is a special effects creation device. The special effects creation device can be coupled to a terminal device, so that it can add target audio during the special effects creation process based on a user's triggering operation on the terminal device, and determine the target audio as an editable layer corresponding to the target special effects content.

[0048] Optionally, the special effects creation device can also be coupled to a server in communication with the terminal device. This allows the device to obtain a special effects processing request sent by the terminal device based on a user's triggering operation. Based on the special effects processing request, target audio is added during the special effects creation process, and the target audio is determined as an editable layer corresponding to the target special effects content.

[0049] In this embodiment, to edit special effects content, a special effects editing page can be displayed. This special effects editing page includes multiple controls for editing special effects, such as filter editing controls, sticker editing controls, and deformation editing controls. Users can use these controls to edit elements such as filters, stickers, and deformations based on their needs.

[0050] Furthermore, to enrich the processing effects of the target special effects content, you can add audio to the target special effects content, eliminating the need to manually add music when subsequently processing images or videos based on the target special effects content. Therefore, you can also display audio addition controls within the special effects editing page.

[0051] Step 102: In response to a user triggering an operation on the audio adding control, obtaining the target audio added by the user, and determining at least one beat point corresponding to the target audio.

[0052] In this embodiment, after the audio add control is displayed, the user can determine the target audio to be added based on the audio add control. The target audio can be collected by the user in real time, selected by the user from a preset channel, or uploaded by the user from a preset storage path. The target audio can be a music clip, the audio content of a video selected by the user, or a voice recorded by the user, etc., and this disclosure does not limit this.

[0053] Furthermore, after determining the target audio, in order to enable subsequent image processing based on the target special effect content to present changes based on the audio rhythm and different special effect processing results, at least one beat point corresponding to the target audio can also be determined.

[0054] The beat point may be automatically identified based on a preset beat recognition algorithm, or may be manually added by the user according to actual needs, and the present disclosure does not impose any restrictions on this.

[0055] Step 103: Obtain at least one special effect element determined by the user, wherein at least some of the special effect elements are associated with the beat points.

[0056] In this embodiment, to enrich the processing effects of the target special effect content, the user can also specify at least one special effect element. Special effect elements include, but are not limited to, filter elements, deformation elements, sticker elements, and sound effect elements. These special effect elements can be specified using the multiple controls for editing special effects, which will not be detailed here.

[0057] Furthermore, to improve the correlation between the special effect element and the target audio, so that the special effect element can change based on the change of the target audio rhythm and present a richer processing effect, after the user determines at least one special effect element, the triggering time of the special effect element can be adjusted based on at least one beat point so that the triggering time of the special effect element matches at least two beat points, thereby obtaining at least part of the special effect elements associated with the special effect element and the beat point.

[0058] For example, a filter element can be a global special effect element. As the beat of the target audio increases, a sticker element can be added, and as the beat decreases, the sticker element stops displaying. This allows the sticker display to be linked to the beat of the target audio, improving the relevance between the special effect element and the target audio, and optimizing the processing effect of the special effect content.

[0059] Step 104: Determine target special effect content based on the target audio and the at least one special effect element, wherein the target audio is located in a corresponding editable layer.

[0060] In this embodiment, after the target audio and at least one special effect element determined based on the target audio are obtained, the target special effect content can be determined based on the target audio and the at least one special effect element.

[0061] Furthermore, to facilitate subsequent editing of the target audio, during the creation of the target special effect content, the target audio can be identified as the editable layer corresponding to the currently edited special effect content. Thus, when the target special effect content is created, the target audio is located in its corresponding editable layer, allowing subsequent users to perform targeted editing operations on the target audio based on the editable layer corresponding to the target audio.

[0062] The special effects creation method provided in this embodiment can determine the target audio based on the user's triggering operation of the audio adding control by displaying a preset audio adding control in the special effects editing page. At least one beat point corresponding to the target audio is determined, and at least one special effects element determined by the user based on the target audio is determined, wherein at least some special effects elements are associated with the beat points. The target special effects content is determined based on the target audio and the at least one special effects element, so that the target audio can be added to the target special effects content. Subsequently, when performing image or video processing based on the target special effects content, there is no need to manually add music, thereby improving the effect of the special effects processing.

[0063] In addition, by determining the special effect elements associated with the beat points in the target special effect content, when performing image processing based on the target special effect content, changes based on the audio rhythm can be presented, and different special effect processing results can be presented.

[0064] Furthermore, since the target music is located in the corresponding editable layer in the target special effect content, the audio can be adjusted in a targeted manner by selecting the editable layer corresponding to the audio.

[0065] FIG2 is a flow chart of a special effects creation method provided by another embodiment of the present disclosure. Based on any of the above embodiments, as shown in FIG2 , step 102 includes:

[0066] Step 201: In response to a user triggering operation on the audio adding control, a preset audio adding page is displayed, where the audio adding page includes at least one adding channel.

[0067] Step 202: Acquire the target audio based on the target adding channel selected by the user.

[0068] In this embodiment, after the audio add control is displayed, a preset audio add page may be displayed in response to a user triggering the audio add control. To enrich the methods for adding target audio, at least one add channel may be displayed within the audio add page. This allows the user to select a target add channel from the at least one add channel based on actual needs and retrieve the target audio based on the target add channel.

[0069] Optionally, based on any of the above embodiments, the audio adding page includes recommended channels, favorite channels and extraction channels.

[0070] Step 202 includes:

[0071] In response to the user's triggering operation on the recommendation channel, a preset recommendation list is displayed, wherein the recommendation list includes at least one recommended audio.

[0072] In response to a selection operation by the user in the recommendation list, the target recommended audio selected by the user is determined as the target audio.

[0073] Alternatively, step 202 includes:

[0074] In response to the user's triggering operation on the favorite channel, a preset favorite list is displayed, wherein the favorite list includes at least one favorite audio that the user has historically collected in the preset channel.

[0075] In response to a selection operation by the user in the favorites list, the target favorite audio selected by the user is determined as the target audio.

[0076] Alternatively, step 202 includes:

[0077] In response to the user's triggering operation on the extraction channel, a preset extraction control is displayed.

[0078] The associated content input by the user based on the extraction control is obtained, and audio corresponding to the associated content is extracted as the target audio, wherein the associated content includes link content or video content.

[0079] In this embodiment, the audio add page includes a recommended channel. Within the recommended channel, at least one recommended audio track can be determined based on the user's historical audio usage and currently popular audio tracks. In response to a user triggering the recommended channel, a preset recommendation list is displayed, displaying at least one recommended audio track. This allows the user to select from the at least one recommended audio track based on their needs. In response to the user selecting an audio track from the recommended list, the selected recommended audio track is determined as the target audio track.

[0080] Optionally, the audio add page includes a favorite channel. While browsing content in a preset channel, a user can favorite audio that interests them. The preset channel may be, for example, a short video app. The special effects creation device may establish a preset communication connection with the preset channel. After obtaining full authorization from the user, the special effects creation device may retrieve at least one favorite audio item from the preset channel.

[0081] Accordingly, in response to a user triggering an operation on a favorite channel, a preset favorite list is displayed, wherein the favorite list displays at least one favorite audio that the user has historically favorited in the preset channel. In response to a user selecting an audio in the favorite list, the target favorite audio selected by the user is determined as the target audio.

[0082] Optionally, the audio adding page includes an extraction channel. In response to a user triggering the extraction channel, a preset extraction control is displayed. Associated content input by the user based on the extraction control is obtained, and audio corresponding to the associated content is extracted as the target audio, where the associated content includes linked content or video content.

[0083] For example, when the associated content is video content, the audio in the video content may be extracted to obtain the target audio.

[0084] FIG3 is a schematic diagram of an interface interaction provided by an embodiment of the present disclosure. As shown in FIG3 , an audio add control 32 may be provided within a special effects editing page 31. In response to a user triggering audio add control 32, an audio add page 33 may be displayed. The audio add page 33 includes a recommended channel 34, a favorite channel 35, and a retrieved channel 36. Users can select the appropriate add channel based on their needs to add the target audio.

[0085] For example, in response to the user's triggering operation on extraction channel 36, extraction controls 37 may be displayed on the audio adding page 33. Extraction controls 37 include a link extraction control 38 and a video extraction control 39. The user can use the link extraction control 38 to input an audio link and then add the target audio based on the audio link. Alternatively, the user can use the video extraction control 39 to input a video and then extract the target audio from the video.

[0086] The special effects creation method provided in this embodiment displays a preset audio addition page in response to a user triggering an audio addition control. The page displays recommended channels, favorite channels, and extracted channels, allowing the user to select any channel to determine the target audio based on actual needs. This enriches the methods for determining the target audio.

[0087] Optionally, based on any of the above embodiments, step 102 includes:

[0088] At least one beat point corresponding to the target audio is identified using a preset beat recognition algorithm.

[0089] In this embodiment, the target audio can be recognized using a preset beat recognition algorithm to determine at least one beat point corresponding to the target audio. Any algorithm capable of achieving beat recognition can be used to recognize the target audio, and this disclosure does not limit this.

[0090] FIG4 is a flowchart of a special effects creation method provided by another embodiment of the present disclosure. Based on any of the above embodiments, as shown in FIG4 , step 102 includes:

[0091] Step 401: Display the audio track corresponding to the target audio and a preset beat control in the special effect editing page.

[0092] Step 402: In response to the user triggering the beat control, a preset positioning cursor is displayed on the audio track, and a preset adding control is displayed in the display area associated with the audio track.

[0093] Step 403: In response to a sliding operation triggered by the user on the audio track, determine the position of the positioning cursor when the sliding operation stops.

[0094] Step 404: In response to the user triggering the adding control, add a beat point at the location of the positioning cursor.

[0095] In this embodiment, the user can also manually add beat points to the target audio according to actual needs.

[0096] Optionally, after obtaining the target audio determined by the user, the audio track corresponding to the target audio and a preset beat control can be displayed in the special effect editing page. The user can manually add beat points to the target audio by triggering the beat control.

[0097] In response to the user triggering the beat control, the track is switched to an editable state. In this editable state, the user can view the entire content of the track corresponding to the target audio by sliding the track. In addition, the user can also determine the location of the beat point in the track according to actual needs and add the beat point to the target audio.

[0098] Optionally, a preset positioning cursor may be displayed on the track, and a preset adding control may be displayed in a display area associated with the track. In response to a user-triggered swipe operation on the track, the position of the positioning cursor when the swipe operation stops is determined. In response to the user-triggered swipe operation on the adding control, a beat point is added at the position of the positioning cursor.

[0099] FIG5 is another schematic diagram of an interface interaction provided by an embodiment of the present disclosure. As shown in FIG5 , a special effect editing page 51 displays an audio track 52 corresponding to the target audio and a preset beat control 53. In response to a user triggering the beat control 53, the audio track 52 can be switched to an editable state, a preset positioning cursor 54 can be displayed on the audio track 52, and a preset add control 55 can be displayed in the display area associated with the audio track 52. In response to a user triggering a sliding operation on the audio track 52, the position of the positioning cursor 54 when the sliding operation stops is determined. In response to a user triggering the add control 55, a beat point is added at the position of the positioning cursor 54.

[0100] The special effects creation method provided in this embodiment accurately identifies at least one beat corresponding to the target audio by using a preset beat recognition algorithm, or by manually adding the beat to the target audio based on the user's input. This allows special effects elements to be processed based on the beat, thereby presenting variations based on the audio rhythm and different special effects processing results when performing image processing based on the target special effects content.

[0101] FIG6 is a flowchart of a special effects creation method provided by another embodiment of the present disclosure. Based on any of the above embodiments, as shown in FIG6 , step 103 includes:

[0102] Step 601: Display the audio track corresponding to the target audio in the special effect editing page, and display preset associated controls in the display area associated with the audio track.

[0103] Step 602: In response to the user triggering the associated control, at least one element to be edited is displayed, wherein the element to be edited includes one or more of a filter element to be edited, a makeup element to be edited, a beautification element to be edited, a sound effect element to be edited, and a sticker element to be edited.

[0104] Step 603: In response to the user triggering the target element to be edited, the adjustable track corresponding to the element to be edited is displayed.

[0105] Step 604: Based on the user's adjustment operation on the adjustable track, determine the trigger time corresponding to the element to be edited, and obtain the adjusted special effect element.

[0106] In this embodiment, after the target audio determined by the user is obtained, the audio track corresponding to the target audio can be displayed in the special effect editing page, and the preset associated controls can be displayed in the display area associated with the audio track.

[0107] Furthermore, in response to a user triggering an associated control, at least one element to be edited may be displayed, where the element to be edited may include one or more of a filter element to be edited, a makeup element to be edited, a beautification element to be edited, a sound effect element to be edited, or a sticker element to be edited. After expanding the at least one element to be edited, the user may select the corresponding element to be edited based on actual needs.

[0108] In response to a user triggering a target element to be edited, an adjustable track corresponding to the element to be edited is displayed. The user can then adjust the trigger time corresponding to the element to be edited based on the adjustable track. Based on the user's adjustment of the adjustable track, the trigger time corresponding to the element to be edited is determined, and the adjusted special effect element is obtained.

[0109] FIG7 is another schematic diagram of an interface interaction provided by an embodiment of the present disclosure. As shown in FIG7 , an audio track 72 corresponding to the target audio is displayed in a special effect editing page 71, and a preset associated control 73 is displayed in a display area associated with the audio track 72. In response to a user triggering operation on the associated control 73, at least one element to be edited is displayed, wherein the elements to be edited include a filter element to be edited 74, a makeup element to be edited 75, and a sticker element to be edited 76. In response to a user triggering operation on a target element to be edited, an adjustable track 77 corresponding to the element to be edited is displayed. Based on the user's adjustment operation on the adjustable track 77, the trigger time corresponding to the element to be edited is determined, and the adjusted special effect element is obtained.

[0110] The special effects creation method provided in this embodiment displays the audio track corresponding to the target audio on the special effects editing page and displays preset associated controls in the display area associated with the audio track. This allows users to view all elements to be edited based on the associated controls and perform editing operations on the elements to be edited. This makes the target special effects content more tailored to the user's actual needs and improves the user experience.

[0111] Furthermore, based on any of the above embodiments, the adjustable track includes a start cursor and an end cursor.

[0112] Step 604 includes:

[0113] At least one beat point is displayed on the audio track.

[0114] In response to the user's dragging operation on the start cursor and / or the end cursor, the start cursor and / or the end cursor are dragged to the position of the beat point to obtain a special effect element associated with the beat point.

[0115] The trigger time is determined based on the display positions of the start cursor and the end cursor.

[0116] In this embodiment, in order to improve the correlation between the special effect elements and the target audio, so that the special effect elements can change based on the changes in the rhythm of the target audio and present richer processing effects, after the user determines at least one special effect element, the trigger time of the special effect element can also be adjusted based on at least one beat point so that the trigger time of the special effect element matches at least two beat points.

[0117] Optionally, the adjustable track includes a start cursor and an end cursor. The user can adjust the triggering time of the element to be edited by triggering the start cursor and the end cursor. In response to the user dragging the start cursor and / or the end cursor to the position of a beat point, the start cursor and / or the end cursor are dragged to obtain a special effect element associated with the beat point. The triggering time is determined based on the display position of the start cursor and the end cursor.

[0118] The special effects creation method provided in this embodiment displays the start cursor and the end cursor corresponding to the adjustable track, so that the user can quickly and accurately determine the triggering time of the special effects element based on the start cursor and the end cursor, thereby improving the accuracy of the special effects element triggering and further improving the display effect of the target special effects content.

[0119] FIG8 is a flowchart of a special effect creation method provided by another embodiment of the present disclosure. Based on any of the above embodiments, the special effect editing page further includes a preset editable layer control, and the method further includes:

[0120] Step 801: In response to the user triggering the editable layer control, the target audio corresponding to the target special effect content and the editable layer associated with the at least one special effect element are displayed.

[0121] Step 802: In response to the user's triggering operation on any target editable layer, display the processing effect corresponding to the target editable layer in the special effect editing page.

[0122] In this embodiment, since the target audio may be an editable layer in the target special effect content, the user may subsequently perform editing operations on the target audio based on the editable layer.

[0123] Optionally, a preset editable layer control can be displayed on the special effect editing page. In response to a user triggering the editable layer control, the target audio corresponding to the target special effect content and the editable layer associated with at least one special effect element can be displayed. The user can select any editable layer based on actual needs to perform editing operations on that editable layer.

[0124] In order to enable users to view the display effects of editable layers more intuitively, in response to the user's triggering operation on any target editable layer, the processing effect corresponding to the target editable layer is displayed in the special effect editing page.

[0125] The special effects creation method provided in this embodiment displays a preset editable layer control on the special effects editing page, allowing users to view and edit all editable layers associated with the target special effects content based on the editable layer control. In addition, by making the target audio an editable layer of the target special effects content, editing the target audio is facilitated.

[0126] Furthermore, based on any of the above embodiments, after step 801, the following steps may be further included:

[0127] An editing control corresponding to the editable layer is displayed in a display area associated with the editable layer.

[0128] In response to the user triggering operation on the editing control, the editing content determined by the user for the editable layer is obtained.

[0129] An editing operation is performed on the editable layer based on the editing content.

[0130] In this embodiment, to facilitate user editing operations on an editable layer, an edit control corresponding to the editable layer may also be displayed in the display area associated with the editable layer. In response to a user triggering the edit control, the user-determined edit content for the editable layer is obtained. Based on the edit content, the edit operation is performed on the editable layer.

[0131] Among them, the editing operation can be to adjust the display level of the editable layer, or to adjust the trigger time of the special effect element, or to adjust the special effect element, etc., and the present disclosure does not limit this.

[0132] The special effects creation method provided in this embodiment displays the editing controls corresponding to the editable layers in the display area associated with the editable layers, thereby enabling targeted editing operations on any editable layer based on the editing controls, so that the generated target special effects content is more in line with the user's personalized needs.

[0133] Optionally, based on any of the above embodiments, the special effect editing page further includes a delete control associated with the target audio. After step 103, the following steps are further included:

[0134] In response to the user triggering the deletion control, a preset prompt message is displayed in the special effect editing page, and the prompt message is used to prompt the user to delete the target audio and at least one special effect element associated with the target audio at the same time.

[0135] In this embodiment, after determining at least one special effect element based on the target audio, the user can also delete the target audio according to actual needs.

[0136] Optionally, a delete control associated with the target audio can be displayed in the special effect editing page. In response to the user triggering the delete control, the target audio can be deleted.

[0137] Because the target audio is associated with at least one special effect element, deleting the target audio will also delete the at least one special effect element. To make the deletion operation more intuitive for users, a preset prompt message is displayed on the special effect editing page in response to the user triggering the delete control. The prompt message is used to remind the user that the deletion operation will delete both the target audio and the at least one special effect element associated with the target audio.

[0138] In response to a confirmation deletion instruction input by the user based on the prompt information, a deletion operation may be performed on the target audio and at least one special effect element associated with the target audio.

[0139] The special effects creation method provided in this embodiment displays a deletion control in the special effects editing page, so that the target music and special effects elements can be quickly deleted based on the deletion control, thereby improving the special effects processing efficiency.

[0140] Optionally, based on any of the above embodiments, the special effect editing page further includes a replacement control associated with the target audio. After step 103, the following steps are further included:

[0141] In response to the user triggering the replacement control, a replacement audio list is displayed, wherein the replacement audio list includes at least one replacement audio.

[0142] In response to the user's triggering operation on any target replacement audio, a preset prompt message is displayed, where the prompt message is used to prompt the user that the replacement operation will delete at least one special effect element associated with the target audio.

[0143] Based on the replacement instruction triggered by the user, the target replacement audio is determined as the current target audio.

[0144] In this embodiment, after determining at least one special effect element based on the target audio, if the user is not satisfied with the target sound effect currently being used, the target audio can be replaced according to actual needs.

[0145] Optionally, a replacement control associated with the target audio can be displayed on the special effect editing page. In response to a user triggering the replacement control, a replacement audio list can be displayed, displaying at least one replacement audio. The at least one replacement audio can be obtained through the aforementioned adding channel. The user can select a replacement audio to replace the target audio based on actual needs.

[0146] Because the target audio is associated with at least one special effects element, replacing it will result in the deletion of at least one special effects element. To provide a more intuitive understanding of the replacement operation, a preset prompt message is displayed in response to a user triggering an operation on any target replacement audio, indicating that the replacement operation will delete at least one special effects element associated with the target audio. Based on the user-triggered replacement instruction, the target replacement audio is determined as the current target audio.

[0147] The special effects creation method provided in this embodiment displays a replacement control in the special effects editing page, so that the user can quickly replace the target music based on the replacement control, thereby improving the special effects processing efficiency and making the generated target special effects content more in line with the user's personalized needs.

[0148] Figure 9 is a schematic structural diagram of a special effects creation device provided by an embodiment of the present disclosure. As shown in Figure 9, the device includes: a display module 91, a determination module 92, an acquisition module 93, and a processing module 94. The display module 91 is used to display a special effects editing page, wherein the special effects editing page includes a preset audio adding control. The determination module 92 is used to obtain the target audio added by the user in response to the user's triggering operation on the audio adding control, and determine at least one beat point corresponding to the target audio. The acquisition module 93 is used to obtain at least one special effects element determined by the user, wherein at least part of the special effects elements are associated with the beat point. The processing module 94 is used to determine the target special effects content based on the target audio and the at least one special effects element, wherein the target audio is located in the corresponding editable layer.

[0149] Furthermore, based on any of the above embodiments, the determining module is configured to: in response to a user triggering an operation on the audio adding control, display a preset audio adding page, the audio adding page including at least one adding channel, and obtain the target audio based on the target adding channel selected by the user.

[0150] Further, based on any of the above embodiments, the audio adding page includes a recommendation channel, a collection channel, and an extraction channel. The determination module is used to: in response to the user's triggering operation on the recommendation channel, display a preset recommendation list, wherein the recommendation list includes at least one recommended audio. In response to the user's selection operation in the recommendation list, determine the target recommended audio selected by the user as the target audio. Alternatively, the determination module is used to: in response to the user's triggering operation on the collection channel, display a preset collection list, wherein the collection list includes at least one collection audio that the user has historically collected in the preset channel. In response to the user's selection operation in the collection list, determine the target collection audio selected by the user as the target audio. Alternatively, the determination module is used to: in response to the user's triggering operation on the extraction channel, display a preset extraction control. Acquire the associated content input by the user based on the extraction control, and extract the audio corresponding to the associated content as the target audio, wherein the associated content includes link content or video content.

[0151] Further, based on any of the above embodiments, the determination module is used to: identify at least one beat point corresponding to the target audio through a preset beat recognition algorithm.

[0152] Furthermore, based on any of the above embodiments, the determination module is configured to: display the audio track corresponding to the target audio and a preset beat control in the special effect editing page; in response to the user triggering the beat control, switch the audio track to an editable state, display a preset positioning cursor on the audio track, and display a preset add control in the display area associated with the audio track; in response to the user triggering a sliding operation on the audio track, determine the position of the positioning cursor when the sliding operation stops; and in response to the user triggering the add control, add a beat point at the position of the positioning cursor.

[0153] Furthermore, based on any of the above embodiments, the acquisition module is used to: display the audio track corresponding to the target audio in the special effect editing page, and display preset associated controls in the display area associated with the audio track. In response to the user's triggering operation on the associated control, at least one element to be edited is displayed, wherein the element to be edited includes one or more of a filter element to be edited, a makeup element to be edited, a beautification element to be edited, a sound effect element to be edited, and a sticker element to be edited. In response to the user's triggering operation on the target element to be edited, the adjustable track corresponding to the element to be edited is displayed. Based on the user's adjustment operation on the adjustable track, the trigger time corresponding to the element to be edited is determined, and the adjusted special effect element is obtained.

[0154] Furthermore, based on any of the above embodiments, the adjustable track includes a start cursor and an end cursor. The acquisition module is configured to: display at least one beat point on the audio track. In response to the user dragging the start cursor and / or the end cursor, the start cursor and / or the end cursor are dragged to the position of the beat point to obtain a special effect element associated with the beat point. The trigger time is determined based on the display positions of the start cursor and the end cursor.

[0155] Furthermore, based on any of the above embodiments, the special effect editing page further includes a preset editable layer control. The apparatus further includes: a display module configured to display the target audio corresponding to the target special effect content and the editable layer associated with the at least one special effect element in response to the user triggering the editable layer control. A processing module configured to display the processing effect corresponding to any target editable layer in the special effect editing page in response to the user triggering the editable layer control.

[0156] Furthermore, based on any of the above embodiments, the apparatus further comprises: a display module configured to display an edit control corresponding to the editable layer in a display area associated with the editable layer; an acquisition module configured to acquire edit content determined by the user for the editable layer in response to a user triggering an operation on the edit control; and an editing module configured to perform an editing operation on the editable layer based on the edit content.

[0157] Furthermore, based on any of the above embodiments, the special effect editing page further includes a delete control associated with the target audio. The apparatus further includes: a deletion module configured to, in response to a user triggering an operation on the delete control, display a preset prompt message on the special effect editing page, wherein the prompt message prompts the user to perform a deletion operation and simultaneously delete the target audio and at least one special effect element associated with the target audio.

[0158] Furthermore, based on any of the above embodiments, the special effect editing page also includes a replacement control associated with the target audio. The device also includes: a display module for displaying a replacement audio list in response to the user's triggering operation on the replacement control, wherein the replacement audio list includes at least one replacement audio. A processing module for displaying a preset prompt message in response to the user's triggering operation on any target replacement audio, wherein the prompt message is used to prompt the user that the replacement operation will delete at least one special effect element associated with the target audio. A replacement module for determining the target replacement audio as the current target audio based on the replacement instruction triggered by the user.

[0159] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0160] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer-readable storage medium, in which computer-executable instructions are stored. When the processor executes the computer-executable instructions, the special effects creation method described in any of the above embodiments is implemented.

[0161] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer program product, including a computer program, which, when executed by a processor, implements the special effects creation method as described in any of the above embodiments.

[0162] In order to implement the above embodiment, the present disclosure further provides an electronic device, including: a processor and a memory;

[0163] The memory stores computer-executable instructions;

[0164] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the special effects creation method described in any of the above embodiments.

[0165] FIG10 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure, wherein the electronic device 1000 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG10 is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0166] As shown in Figure 10, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage device 1008 into a random access memory (RAM) 1003. Various programs and data required for the operation of the electronic device 1000 are also stored in the RAM 1003. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0167] Typically, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device 1000 to communicate with other devices wirelessly or by wire to exchange data. Although FIG10 shows an electronic device 1000 having various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0168] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0169] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0170] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0171] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0172] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0173] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0174] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0175] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0176] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0177] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0178] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0179] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A special effects creation method, comprising: Displaying a special effect editing page, wherein the special effect editing page includes a preset audio adding control; In response to a user triggering operation on the audio adding control, acquiring the target audio added by the user, and determining at least one beat point corresponding to the target audio; Acquire at least one special effect element determined by the user, wherein at least part of the special effect elements are associated with the beat points; Target special effect content is determined based on the target audio and the at least one special effect element, wherein the target audio is located in a corresponding editable layer.

2. The method according to claim 1, wherein: The step of obtaining the target audio added by the user in response to the triggering operation of the audio adding control by the user comprises: In response to a user triggering operation on the audio adding control, displaying a preset audio adding page, wherein the audio adding page includes at least one adding channel; The target audio is acquired by adding a channel based on the target selected by the user.

3. The method according to claim 2, wherein: The audio adding page includes a recommendation channel, a collection channel and an extraction channel; The acquiring the target audio by adding a channel based on the target selected by the user comprises: In response to the user's triggering operation on the recommendation channel, displaying a preset recommendation list, wherein the recommendation list includes at least one recommended audio; In response to a selection operation by the user in the recommendation list, determining the target recommended audio selected by the user as the target audio; Alternatively, acquiring the target audio through the target adding channel selected by the user includes: In response to the user's triggering operation on the collection channel, displaying a preset collection list, wherein the collection list includes at least one collection audio that the user has historically collected in the preset channel; In response to a selection operation of the user in the favorites list, determining the target favorite audio selected by the user as the target audio; Alternatively, acquiring the target audio through the target adding channel selected by the user includes: In response to the user's triggering operation on the extraction channel, displaying a preset extraction control; The associated content input by the user based on the extraction control is obtained, and the audio corresponding to the associated content is extracted as the target audio, wherein the associated content includes link content or video content.

4. The method according to any one of claims 1 to 3, wherein: The determining at least one beat point corresponding to the target audio includes: At least one beat point corresponding to the target audio is identified by a preset beat recognition algorithm.

5. The method according to any one of claims 1 to 3, wherein: The determining at least one beat point corresponding to the target audio includes: Displaying the audio track corresponding to the target audio and a preset beat control in the special effect editing page; In response to the user's triggering operation on the beat control, a preset positioning cursor is displayed on the audio track, and a preset adding control is displayed in a display area associated with the audio track; In response to a sliding operation triggered by the user on the audio track, determining a position of the positioning cursor when the sliding operation stops; In response to the user's triggering operation on the adding control, a beat point is added at the position where the positioning cursor is located.

6. The method according to any one of claims 1 to 5, wherein: The obtaining of at least one special effect element determined by the user includes: Displaying the audio track corresponding to the target audio in the special effect editing page, and displaying a preset associated control in the display area associated with the audio track; In response to the user's triggering operation on the associated control, at least one element to be edited is displayed, wherein the element to be edited includes one or more of a filter element to be edited, a makeup element to be edited, a beautification element to be edited, a sound effect element to be edited, and a sticker element to be edited; In response to the user's triggering operation on the target element to be edited, displaying an adjustable track corresponding to the element to be edited; Based on the user's adjustment operation on the adjustable track, a trigger time corresponding to the element to be edited is determined to obtain the adjusted special effect element.

7. The method according to claim 6, wherein the adjustable track includes a start cursor and an end cursor; The determining, based on the user's adjustment operation on the adjustable track, a trigger time corresponding to the element to be edited includes: displaying at least one beat point on the audio track; In response to the user's dragging operation on the start cursor and / or the end cursor, drag the start cursor and / or the end cursor to the position of the beat point to obtain a special effect element associated with the beat point; The trigger time is determined based on the display positions of the start cursor and the end cursor.

8. The method according to any one of claims 1 to 7, wherein: The special effect editing page also includes a preset editable layer control; the method also includes: In response to the user's triggering operation on the editable layer control, displaying the target audio corresponding to the target special effect content and the editable layer associated with the at least one special effect element; In response to the user's triggering operation on any target editable layer, the processing effect corresponding to the target editable layer is displayed in the special effect editing page.

9. The method according to claim 8, wherein: After the target audio corresponding to the target special effect content and the editable layer associated with the at least one special effect element are displayed in response to the user's triggering operation on the editable layer control, the method further includes: Displaying an editing control corresponding to the editable layer in a display area associated with the editable layer; In response to a triggering operation of the editing control by the user, acquiring editing content for the editable layer determined by the user; An editing operation is performed on the editable layer based on the editing content.

10. The method according to any one of claims 1 to 9, wherein: The special effect editing page also includes a delete control associated with the target audio; after obtaining at least one special effect element determined by the user, the method further includes: In response to the user's triggering operation on the deletion control, a preset prompt message is displayed in the special effect editing page, and the prompt message is used to prompt the user to perform the deletion operation and simultaneously delete the target audio and at least one special effect element associated with the target audio.

11. The method according to any one of claims 1 to 10, wherein: The special effect editing page also includes a replacement control associated with the target audio; after obtaining at least one special effect element determined by the user, the method further includes: In response to the user triggering the replacement control, displaying a replacement audio list, wherein the replacement audio list includes at least one replacement audio; In response to the user's triggering operation on any target replacement audio, displaying preset prompt information, wherein the prompt information is used to prompt the user that the replacement operation will delete at least one special effect element associated with the target audio; Based on the replacement instruction triggered by the user, the target replacement audio is determined as the current target audio.

12. A special effects creation device, comprising: A display module is configured to display a special effect editing page, wherein the special effect editing page includes a preset audio adding control; A determination module, configured to obtain the target audio added by the user in response to a trigger operation of the audio adding control by the user, and determine at least one beat point corresponding to the target audio; an acquisition module, configured to acquire at least one special effect element determined by the user, wherein at least part of the special effect elements are associated with the beat points; The processing module is configured to determine target special effect content based on the target audio and the at least one special effect element, wherein the target audio is located in a corresponding editable layer.

13. An electronic device comprising a processor and a memory, wherein: The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor executes the special effects creation method as described in any one of claims 1 to 11.

14. A computer-readable storage medium stores computer-executable instructions, wherein: When the processor executes the computer-executable instructions, the special effects creation method as described in any one of claims 1 to 11 is implemented.

Images