Interaction method and device, electronic equipment and storage medium

Abstract

The invention relates to an interaction method and device, electronic equipment and a storage medium, and the method comprises the steps: displaying a video playing page which comprises a first video playing region and an editing option; the first video playing area is used for playing a target video; in response to a selection operation on the editing option, decomposing the target video into a plurality of sub-lens segments; displaying a video editing page, wherein the video editing page comprises a second video playing area and a split material display area; the second video playing area comprises an image of the target sub-lens segment; the sub-lens material display area comprises a first element used for obtaining the target sub-lens segment; the image of the target sub-lens segment comprises a second element; the target sub-lens section is any sub-lens section in the plurality of sub-lens sections; modifying the target element in response to a modification operation on the target element; the target element is the first element or the second element. The method can assist a user in completing reediting of a generated video, and enables the reedited video to meet the requirements of the user.

Description

Technical Field

[0001] The present disclosure relates to the field of Internet technology, and in particular to an interaction method, device, electronic device, and storage medium. Background Art

[0002] With the rapid development of science and technology, video generation technology has become a key achievement in today's digital landscape. Leveraging advanced algorithmic models, it is possible to generate videos based on specific input commands or parameters. This technology has brought innovative opportunities to numerous fields.

[0003] However, while some software or applications currently have video generation capabilities, in real-world scenarios, the videos generated directly by these software or applications often fail to meet the increasingly diverse user needs. Therefore, how to make the generated videos more relevant to user needs is an urgent issue. Summary of the Invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an interaction method, device, electronic device and storage medium.

[0005] In a first aspect, the present disclosure provides an interaction method, comprising:

[0006] Displaying a target video playback page, the target video playback page including a first video playback area and editing options; the first video playback area is used to play the target video;

[0007] In response to a selection operation of the editing option, decomposing the target video into a plurality of storyboard segments;

[0008] Displaying a video editing page, the video editing page including a second video playback area and a storyboard material display area; the second video playback area including an image of a target storyboard segment; the storyboard material display area including a first element used to obtain the target storyboard segment; the image of the target storyboard segment including a second element constituting the target storyboard segment; the target storyboard segment being any storyboard segment among the plurality of storyboard segments;

[0009] In response to a modification operation on a target element, the target element is modified; the target element is the first element or the second element.

[0010] In a second aspect, the present disclosure further provides an interactive device, comprising:

[0011] A first display module is used to display a target video playback page, wherein the target video playback page includes a first video playback area and an editing option; the first video playback area is used to play the target video;

[0012] a decomposition module, configured to decompose the target video into a plurality of storyboard segments in response to a selection operation on the editing option;

[0013] a second display module for displaying a video editing page, the video editing page including a second video playback area and a storyboard material display area; the second video playback area including an image of a target storyboard segment; the storyboard material display area including a first element used to obtain the target storyboard segment; the image of the target storyboard segment including a second element constituting the target storyboard segment; the target storyboard segment being any storyboard segment among the plurality of storyboard segments;

[0014] The modification module is used to modify the target element in response to a modification operation on the target element; the target element is the first element or the second element.

[0015] In a third aspect, the present disclosure further provides an electronic device, comprising:

[0016] one or more processors;

[0017] a storage device for storing one or more programs;

[0018] When the one or more programs are executed by the one or more processors, the one or more processors implement the interaction method described above.

[0019] In a fourth aspect, the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which implements the above-mentioned interaction method when executed by a processor.

[0020] The technical solution provided by the embodiments of the present disclosure has the following advantages over the prior art:

[0021] The technical solution provided by the embodiment of the present disclosure is to set up a target video playback page, the target video playback page includes a first video playback area and an editing option; the first video playback area is used to play the target video; in response to the selection of the editing option, the target video is decomposed into multiple storyboards; a video editing page is displayed, the video editing page includes a second video playback area and a storyboard material display area; the second video playback area includes an image of the target storyboard; the storyboard material display area includes a first element used to obtain the target storyboard; the image of the target storyboard includes a second element constituting itself; the target storyboard is any storyboard from the multiple storyboards; in response to the modification operation of the target element, the target element is modified; the target element is either the first element or the second element. Its essence is to decompose the target video into multiple storyboards, and further decompose each storyboard into its constituent elements (i.e., the first element and the second element), so that the user can freely modify one or more elements according to their own needs, thereby flexibly and finely editing the target video, effectively assisting the user in completing the task of re-editing the generated video, and making the re-edited video meet the user's needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0024] Figure 1 A flowchart of an interactive method provided in an embodiment of the present disclosure;

[0025] Figure 2-14 Schematic diagrams of display pages of several electronic devices provided in embodiments of the present disclosure;

[0026] Figure 15 is a structural diagram of an interactive device in an embodiment of the present disclosure;

[0027] Figure 16 Schematic diagram of the structure of an electronic device in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.

[0029] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0030] Figure 1 This is a flowchart of an interaction method provided by an embodiment of the present disclosure. This embodiment is applicable to situations where interaction is carried out in a client. The method can be executed by an interaction device, which can be implemented by software and / or hardware. The device can be configured in an electronic device, such as a terminal, specifically including but not limited to smart phones, PDAs, tablet computers, wearable devices with display screens, desktop computers, laptop computers, all-in-one computers, smart home devices, etc. Alternatively, this embodiment is applicable to situations where interaction is carried out in a server. The method can be executed by an interaction device, which can be implemented by software and / or hardware. The device can be configured in an electronic device, such as a server. In addition, in some scenarios, this embodiment can also be executed by the server in cooperation with the terminal.

[0031] like Figure 1 As shown, the method may specifically include:

[0032] S110. Display a target video playback page, which includes a first video playback area and editing options; the first video playback area is used to play the target video.

[0033] The target video may be, for example, a video that needs to be edited. This application does not limit the source of the target video. In some scenarios, the target video may be a video generated by software or an application with a video generation function.

[0034] The target video playback page can be, for example, a page for playing the target video. In some scenarios, if the target video is generated using software or an application with a video generation function, the target video playback page can be a result display page for displaying the generation result.

[0035] If the target video playback page is a result display page for displaying the generated results, the interactive method provided by this disclosure can be applied after the interactive link of video generation. After the video generation is completed through the interactive link of video generation, the interactive method of this disclosure can be used to modify and edit the generated results, so that the final video better meets the user's specific needs.

[0036] The first video playback area may be, for example, an area in the target video playback page for playing the target video.

[0037] The editing option can be, for example, an option displayed in the target video playback page for triggering entry into an interactive link for modifying and editing the target video. In other words, the editing option can be considered as an entry for editing the target video.

[0038] S120: In response to a selection operation on an editing option, decompose the target video into a plurality of storyboard segments.

[0039] The selection operation of the editing option may be, for example, an operation indicating that the user wishes to edit the target video.

[0040] The storyboard segments can be, for example, video segments obtained by segmenting the target video. Each video segment is a storyboard segment. In some scenarios, the target video can be understood as a plurality of storyboard segments arranged in a certain order.

[0041] It should be noted that, in its implementation, this step involves more than simply dividing the target video into multiple storyboard segments. Instead, the first and second elements corresponding to the storyboard segments must be further determined. The first element is the element used to generate the storyboard segments. The first element can include at least one of the following: subtitles, image material, video material, digital human, and sound. The second element is the element included in the image of the storyboard segment. For example, the second element can include subtitles and / or stickers.

[0042] There are many ways to implement this step, which is not limited in this application. For example, a video decomposition algorithm or model can be pre-built, and the pre-built video decomposition algorithm or model can be used to decompose the target video into multiple storyboard segments.

[0043] In other scenarios, the target video generation process includes: first determining the video script used to generate the target video; then generating the target video based on the video script. The video script includes multiple storyboards. The video script is essentially a planning scheme for the target video, which includes defining how many storyboards are needed to generate the target video, the content to be displayed in the storyboards, etc. The target video is formed by multiple storyboards arranged in a certain order. Each storyboard has a corresponding storyboard script. The storyboard script can be, for example, a plan for planning the storyboard corresponding to it. In some scenarios, the storyboard script includes which materials (such as subtitles, images, videos, digital humans, and sounds) are used to generate the storyboard segments.

[0044] Based on this, optionally, in response to the selection operation of the editing option, the target video is decomposed into multiple storyboard segments, including: in response to the selection operation of the editing option, based on the storyboard script used to generate the target video, the target video is decomposed into multiple storyboard segments.

[0045] The core idea of ​​the technical solution provided by this application is to decompose the target video into multiple storyboard segments, and further decompose each storyboard segment into its constituent elements (i.e., first element and second element). In this way, users can freely modify one or more elements according to their own needs, thereby achieving the purpose of flexible and precise editing of the target video.

[0046] Since the process of generating a target video based on a storyboard can be compared to the process of building an object using building blocks, breaking the target video into multiple storyboard segments can be considered the process of disassembling an assembled object back into its building blocks.

[0047] By setting a response to the selection operation of the editing option, the target video is decomposed into multiple storyboard segments based on the storyboard script used to generate the target video. In essence, the process of "decomposing the target video into multiple storyboard segments" is processed as the inverse process of "generating the target video based on the storyboard script". This can quickly complete the decomposition of the target video in a short time, and can help users more easily understand the impact of elements (i.e., the first element and the second element) on the target video, and then help users select the elements that need to be modified.

[0048] For example, a certain storyboard segment is generated based on image material 1, video material 1, and subtitles. The storyboard segment is the result of arranging or superimposing image material 1 and video material 1 according to a preset time sequence. In addition, image material 2 and video material 2 are inserted into the storyboard segment. Image material 2 and video material 2 are generated using a generative model. In addition, the storyboard segment also includes audio that reads the subtitle content; the image of the storyboard segment includes a basic picture and subtitles and stickers superimposed on the basic picture. Among them, the basic picture is the picture of image material 1, video material 1, image material 2, and video material 2. In this scenario, the first element includes subtitles, image material 1, video material 1, image material 2, video material 2, and sound; the second element is the subtitles and stickers superimposed on the basic picture.

[0049] In another example, a storyboard clip is generated based on a specific digital human and subtitles. Specifically, the storyboard clip shows a video of the specific digital human speaking the content described in the subtitles. The image of the storyboard clip includes a base frame and subtitles superimposed on the base frame. The base frame is the frame in which the specific digital human speaks the content described in the subtitles. In this scenario, the first element includes the digital human and the subtitles; the second element is the subtitles superimposed on the base frame.

[0050] S130, display a video editing page, the video editing page comprising a second video playing area and a shot material display area; the second video playing area comprising an image of a target shot segment; the shot material display area comprising a first element used to obtain the target shot segment; the image of the target shot segment comprising a second element constituting itself; the target shot segment being any one of a plurality of shot segments.

[0051] The video editing page may, for example, be a page used to assist a user in modifying and editing the first element or the second element of the target shot segment in the target video. The second video playing area and the shot material display area are both areas in the video editing page.

[0052] The target shot segment may, for example, be any one of the plurality of shot segments. In some scenarios, the first shot segment in a time sequence may be set as the target shot segment when the video editing page is initially displayed. In another scenario, the target shot segment may be a shot segment selected by the user from the plurality of shot segments.

[0053] Optionally, the video editing page may further comprise a shot identification display area; the shot identification display area comprising identification information of the plurality of shot segments; the identification information of the target shot segment being in a first display state; the identification information of a non-target shot segment being in a second display state.

[0054] The non-target shot segment is a shot segment other than the target shot segment in the plurality of shot segments. The identification information of the shot segment may, for example, be information used to refer to a specific shot segment. The identification information of the shot segment may specifically be a number, a name or an icon of the shot segment referred to. The identification information of each shot segment uniquely refers to a specific shot segment, and the identification information of different shot segments are different from each other. The first display state and the second display state are two different display states, and the main difference between the two display states is that the visual attributes are different. Specifically, at least one of the background color, the text color and the border color of the identification information is different between the first display state and the second display state.

[0055] By setting the identification information of the target shot segment in the first display state and the identification information of the non-target shot segment in the second display state, the essence is to prompt the user, by means of the display state of the identification information, which first element and image of which shot segment is currently displayed in the video editing page.

[0056] S140, in response to a modification operation on the target element, modifying the target element; the target element being the first element or the second element.

[0057] The target element may be, for example, an element selected by the user from the first element and the second element, and may also be an element that the user wishes to edit. The modification operation on the target element may be, for example, an operation reflecting the user's desire to modify the target element.

[0058] Optionally, the first element includes at least one of the following: subtitles, image materials, video materials, digital humans, and sound colors; if the target element is the first element, modifying the target element includes at least one of the following: replacing the target element, modifying the content of the target element, and deleting the target element; the second element includes subtitles and / or stickers; if the target element is the second element, modifying the target element includes at least one of the following: adjusting the position of the target element, adjusting the size of the target element, adjusting the rotation angle of the target element, replacing the target element, modifying the content of the target element, and deleting the target element.

[0059] In the present application, stickers can specifically be text-type stickers or image-type stickers. Among them, text-type stickers can be, for example, stickers with text as the main content, while image-type stickers are stickers with graphics, images, abstract symbols, etc. as the main content. In some scenarios, modifying the content of a text-type sticker can include: modifying the text content in the text-type sticker, the template used by the text-type sticker, the font of the text-type sticker, and the style of the text-type sticker. Modifying the content of an image-type sticker can include at least one of the following: adjusting the transparency, brightness, saturation, color temperature, hue of the image-type sticker, stroking the image-type sticker, deforming the image-type sticker, adjusting the stacking relationship between the layer where the image-type sticker is located and other layers, flipping the image-type sticker, etc.

[0060] For example, see Figure 2 The target video playback page includes a first video playback area and an editing option. The first video playback area is used to play the target video. If the user clicks the editing option, see Figure 3 , display the video editing page. Assume that the target video is decomposed into five storyboard segments, respectively recorded as storyboard 1 to storyboard 5, and set the default storyboard 1 as the target storyboard segment, see Figure 3 On the video editing page, the first element used to obtain storyboard 1 is displayed in the storyboard material display area. The first element includes video 1, image 2, subtitles, and sound. The second video playback area of ​​the video editing page is used to play the target storyboard clip (i.e., storyboard 1). The image of the target storyboard clip displayed in the second video playback area includes a second element. The second element includes subtitles, sticker 1, and sticker 2. Sticker 1 is a text-type sticker, and sticker 2 is an image-type sticker.

[0061] Define the subtitles displayed in the storyboard material display area as primary subtitles, and the subtitles displayed in the secondary video playback area as secondary subtitles. In some scenarios, the first subtitles are the complete subtitles corresponding to the target storyboard, and the second subtitles are a portion of the first subtitles. In other scenarios, both the first and second subtitles are the complete subtitles corresponding to the target storyboard.

[0062] exist Figure 3 In the example, the first subtitle is "Did you know? The summer sun seems bright and warm, but it hides invisible damage to the skin.", and the second subtitle is "Did you know?". This situation can be understood as dividing the subtitles of the storyboard into multiple sentences, and each sentence is displayed in the image of the storyboard at a different time. For example, assuming that the display time of storyboard 1 is 4s, the subtitle displayed in the image with a timestamp of the first 1s is "Did you know?"; the subtitle displayed in the image with a timestamp of 1s to 2.5s is "The summer sun seems bright and warm,"; the subtitle displayed in the image with a timestamp of 2.5s to 4s is "But it hides invisible damage to the skin." Because Figure 3 The timestamp of the image displayed in the second video playback area is 1 second ago, so the subtitle displayed in the image is "Did you know?".

[0063] Since the target video is decomposed into five storyboard segments, Figure 3 In the storyboard identification display area, there are 5 rectangular icons displayed from left to right, which are the identification information of the storyboard segments. The 5 rectangular icons correspond to storyboards 1 to 5 from left to right; among them, the first rectangular icon from the left is in the first display state, and the second to fifth rectangular icons from the left are in the second display state. In some scenes, the horizontal length of the rectangular icon can be set according to the playback duration of the storyboard segment it refers to. Specifically, the horizontal length of the rectangular icon is proportional to the playback duration of the storyboard segment it refers to.

[0064] In the video editing page, the user can select the first element or the second element, and then complete the modification of the first element or the second element. Figure 3 Based on this, if the user clicks sticker 1, sticker 1 is used as the target element. Figure 4, a selection box surrounding sticker 1 and options corresponding to sticker 1 appear around sticker 1. The selection box for sticker 1 is used to prompt the user that the user is currently in the modification mode of sticker 1. The options corresponding to sticker 1 include "Close", "Edit" and "Rotate". If the user selects the "Close" option, the modification of sticker 1 will be exited. If the user selects the "Edit" option, the sticker 1 can be edited, and the specific editing items may include at least one of the following: adjusting the text font, text style, text color, text content, using templates, etc. If the user selects the "Rotate" option, the rotation angle of sticker 1 relative to the base image can be changed. Drag the selection box surrounding sticker 1 to adjust the position of sticker 1 or adjust the size of sticker 1.

[0065] If the user clicks sticker 2, sticker 2 is used as the target element. Figure 5 , a selection box surrounding sticker 2 and options corresponding to sticker 2 appear around sticker 2. The selection box for sticker 2 is used to prompt the user that the user is currently in the modification mode of sticker 2. The options corresponding to sticker 2 include "Close", "Edit" and "Rotate". If the user selects the "Close" option, the modification of sticker 2 will be exited. If the user selects the "Edit" option, the sticker 2 can be edited, and the specific editing items may include at least one of the following: transparency, brightness, saturation, color temperature, hue, stroking sticker 2, deforming sticker 2, adjusting the stacking relationship between the layer where sticker 2 is located and other layers, flipping sticker 2, etc. If the user selects the "Rotate" option, the rotation angle of sticker 2 relative to the base image can be changed. Drag the selection box surrounding sticker 2 to adjust the position of sticker 2 or adjust the size of sticker 2.

[0066] If a selection operation of a second subtitle is detected in the second video playback area, a subtitle editing panel is displayed, and the subtitle editing panel includes the complete subtitles (i.e., the first subtitles) used for the target storyboard segment. Furthermore, the second subtitles are configured to be in an editing state in the subtitle editing panel. If a selection operation of a first subtitle is detected in the storyboard material display area, the subtitle editing panel is displayed, and the subtitle editing panel includes the complete subtitles (i.e., the first subtitles) used for the target storyboard segment.

[0067] For example, if the user Figure 3 Click on the second subtitle in the second video playback area, see Figure 6, display the subtitle editing panel, which includes the complete subtitles (i.e., the first subtitles) used to obtain the target storyboard segment. And in the subtitle editing panel, the second subtitle is in the editing state. That is, it is assumed that the user wants to modify the content of the second subtitle. If the user clicks on the first subtitle in the storyboard material display area, the subtitle editing panel is displayed, which includes the complete subtitles (i.e., the first subtitles) used to obtain the target storyboard segment. If the user further clicks on a sentence that constitutes the first subtitle, the sentence is adjusted to be in the editing state. The user can edit the sentence in the editing state.

[0068] Furthermore, the subtitle editing panel may be configured to include a hidden option corresponding to the subtitle; in response to a selection operation on the hidden option, the subtitle corresponding to the hidden option is configured not to be displayed in the target storyboard segment.

[0069] For example, in Figure 6 In the first subtitle, each sentence has a corresponding "Hide" option. If the user clicks the "Hide" option corresponding to "Did you know?", the phrase "Did you know?" will not be displayed in the target storyboard. If the target video includes a first voiceover reading the first subtitle, the first voiceover will include the audio of "Did you know?". Therefore, selecting the Hide option will have no effect on the first voiceover.

[0070] If the user clicks on the second element in the storyboard material display area, the clicked second element will be used as the target element, and a candidate material selection page will be displayed, which includes multiple candidate materials; in response to the selection operation of the target material in the candidate material selection page, the target element will be replaced with the target material.

[0071] It should be noted that, in practice, image type materials or video type materials can be used to replace image type materials, and video type materials can also be used to replace image type materials or video type materials.

[0072] For example, see Figure 3 If the user clicks on the sound in the storyboard material display area, the sound will be used as the target element. Figure 7 , displaying a timbre selection panel. The timbre selection panel includes multiple candidate timbres. If the user further clicks on timbre 7, the timbre in the target storyboard segment is replaced with timbre 7. It should be noted that the timbre in the target storyboard segment refers to the timbre used to read the subtitles.

[0073] Continue to see Figure 7 The tone selection panel also includes a volume option. If the user clicks the volume option, see Figure 8 , which displays the volume adjustment options. Users can adjust the volume of the audio reading the subtitles in the target storyboard clip.

[0074] If a digital human is displayed in the storyboard material display area, if the user clicks on the digital human in the storyboard material display area, the digital human will be used as the target element. Figure 9 , the digital person selection panel is displayed. The digital person selection panel includes multiple candidate digital persons. If the user further clicks on a candidate digital person in the digital person selection panel, the replacement of the digital person is completed. Figure 9 The digital human selection panel also includes "Customize Image" and "Filter" options. The "Customize Image" option allows you to collect conditions for customizing a digital human. You can then assign a value to the digital human based on these conditions and replace the digital human in the target storyboard with the assigned digital human. The "Filter" option allows you to set digital human filtering conditions. Based on these conditions, you can then filter out existing digital humans that meet these conditions. You can then use these filtered digital humans to replace the digital human in the target storyboard.

[0075] If a video or image material is displayed in the storyboard material display area, and a user clicks on the video or image material in the storyboard material display area, the video or image material in the storyboard material display area clicked by the user is used as the target element, and a video and image material selection panel is displayed. The video and image material selection panel includes multiple candidate video materials and / or candidate image materials. If the user further clicks on a candidate video material or candidate image material in the video and image material selection panel, the target element is replaced with the selected candidate video material or candidate image material.

[0076] The above technical solution is provided by setting up a target video playback page, the target video playback page including a first video playback area and an editing option; the first video playback area is used to play the target video; in response to the selection of the editing option, the target video is decomposed into multiple storyboards; a video editing page is displayed, the video editing page including a second video playback area and a storyboard material display area; the second video playback area includes an image of the target storyboard; the storyboard material display area includes a first element used to obtain the target storyboard; the image of the target storyboard includes a second element constituting the target storyboard; the target storyboard is any storyboard from the multiple storyboards; in response to a modification operation on the target element, the target element is modified; the target element is either the first element or the second element. Its essence is to decompose the target video into multiple storyboards, and further decompose each storyboard into its constituent elements (i.e., the first element and the second element), so that the user can freely modify one or more elements according to their own needs, thereby flexibly and finely editing the target video, effectively assisting the user in completing the task of re-editing the generated video, and making the re-edited video meet the user's needs.

[0077] Optionally, in response to a switching operation on a target storyboard segment, a new target storyboard segment is determined in the non-target storyboard segments; an image of the new target storyboard segment is displayed in the second video playback area; and a first element used to obtain the new target storyboard segment is displayed in the storyboard material display area.

[0078] The switching operation on the target storyboard segment may be, for example, an operation indicating that the user wishes to view the first element and the second element of other storyboard segments other than the currently displayed target storyboard segment. In practice, the switching operation on the target storyboard segment may be an operation of selecting the identification information of the storyboard segment in the storyboard identification display area; or a sliding operation along a preset direction or a preset track on the video editing page. If the selection operation of the identification information of the storyboard segment in the storyboard identification display area is used as the switching operation on the target storyboard segment, the storyboard segment indicated by the selected identification information is used as the new target storyboard segment. If the sliding operation along a preset direction or a preset track on the video editing page is used as the switching operation on the target storyboard segment, the next storyboard segment or the previous storyboard segment of the storyboard segment currently displayed on the video editing page is used as the new target storyboard segment.

[0079] For example, in Figure 3 In the example, take Storyboard 1 as the target storyboard segment. If the user Figure 3 On the basis of , swipe left, or Figure 3 Click the rectangular icon representing storyboard 2 to set storyboard 2 as the new target storyboard clip. Display the first element used to obtain storyboard 2 in the storyboard material display area; and display the image of storyboard 2 in the second video playback area.

[0080] By setting a response to a switching operation on a target storyboard segment, a new target storyboard segment is determined; an image of the new target storyboard segment is displayed in a second video playback area; and a first element used to obtain the new target storyboard segment is displayed in a storyboard material display area. The purpose is to allow the user to switch between different storyboard segments and then modify the first element or second element of different storyboard segments.

[0081] On the basis of the above technical solution, optionally, the method may further include: deleting the target storyboard segment in response to a deletion operation on the target storyboard segment.

[0082] For example, it is assumed that the target video includes five storyboard segments, namely, segment 1 to segment 5. Figure 3 In , storyboard 1 is the target storyboard segment. Figure 3In the video editing page, the "More" option is located in the upper right corner of the storyboard display area. Clicking "More" displays a Delete option. Clicking Delete deletes Storyboard 1. After deleting Storyboard 1, the target video will only include Storyboards 2 through 5.

[0083] Based on the above technical solution, optionally, if the target element is a subtitle, the target video includes a first dubbing corresponding to the subtitle; modifying the target element includes modifying the content of the subtitle; after modifying the content of the subtitle, the method may further include: determining a target duration of the target storyboard segment based on the modified subtitle; adjusting the screen playback duration of the target storyboard segment so that the adjusted screen playback duration of the target storyboard segment is equal to the target duration.

[0084] “The target video includes a first dubbing corresponding to the subtitles” may, for example, mean that the target video includes audio information corresponding to the subtitles. The audio information corresponding to the subtitles may, for example, be audio information of reading the subtitle content.

[0085] "Modifying the content of the subtitles" may, for example, modify the characters constituting the subtitles. After modifying the subtitle content, the number of characters in the subtitles after modification may be the same as or different from the number of characters in the subtitles before modification.

[0086] The target duration of the target storyboard segment can be, for example, an ideal duration for the target storyboard segment to be played based on the modified subtitles. If the target storyboard segment's screen playback duration is equal to its ideal playback duration (i.e., the target duration), it means that the undesirable situation where the target storyboard segment's screen has been played to completion but the audio information corresponding to the subtitles has not been played to completion, or the audio information corresponding to the subtitles has been played to completion but the target storyboard segment's screen has not been played to completion, will not occur.

[0087] The specific implementation method of "determining the target duration of the target storyboard segment based on the modified subtitles" may include: converting the modified subtitles into a second audio; and using the duration of the second audio as the target duration of the target storyboard segment.

[0088] Furthermore, the playback duration of the target storyboard segment is adjusted, including: if the target duration of the target storyboard segment is greater than the original playback duration of the target storyboard segment, reducing the playback speed of the target storyboard segment or adding an empty shot to the target storyboard segment; if the target duration of the target storyboard segment is less than the original playback duration of the target storyboard segment, increasing the playback speed of the target storyboard segment or deleting at least part of the image frames in the target storyboard segment.

[0089] The original playback duration of the target storyboard segment may be, for example, the display duration of the target storyboard segment in the target video.

[0090] It should be noted that after adding an empty shot to the target storyboard, optionally, a prompt message may be provided to prompt the user to configure corresponding materials for the empty shot.

[0091] In some scenarios, when the number of characters in the modified subtitles differs from the number of characters in the subtitles before the modification, the target duration of the target storyboard segment can be determined based on the modified subtitles. In some scenarios, when the number of characters in the modified subtitles is the same as the number of characters in the subtitles before the modification, it usually means that the screen playback duration of the target storyboard segment has not changed. Therefore, for such scenarios, the steps of "determining the target duration of the target storyboard segment based on the modified subtitles; adjusting the screen playback duration of the target storyboard segment so that the adjusted screen playback duration of the target storyboard segment is equal to the target duration" are not performed to reduce the consumption of computing resources.

[0092] On the basis of the above technical solution, optionally, if the target element is a video material or an image material, the original display duration of the target element is the first duration; modifying the target element includes replacing the target element; replacing the target element includes: displaying a video selection page, the video selection page includes identification information of at least one candidate material; in response to a selection operation of the first material in the at least one candidate material, adjusting the duration of the first material so that the display duration of the adjusted first material is equal to the first duration; replacing the target element with the adjusted first material

[0093] The original display duration of the target element is the first duration, which can be, for example, the display duration of the target element in the target video. The original display duration of the target element is the first duration, which means that the target element occupies a slot with the first duration. If other material is used to replace the target element, in order to maintain the structure of the target video, the material replacing the target element must completely occupy the slot with the first duration, that is, the duration of the material used to replace the target element must be equal to the first duration.

[0094] The video selection page may be, for example, a page for displaying identification information of candidate materials. The candidate materials may be, for example, video materials that have been stored locally or can be downloaded from the network.

[0095] The first material may be, for example, any one of the at least one candidate material, which is selected by the user. Subsequently, the first material will be used to replace the target element.

[0096] The selection operation of the first material from the at least one candidate material may be, for example, a selection operation of identification information of the first material on a video selection page.

[0097] There are many specific implementation methods for "adjusting the duration of the first material", and this application does not limit this. Exemplarily, "adjusting the duration of the first material" includes: adjusting the playback speed of the first material, or cropping the first material. Furthermore, it can be set that if the original duration of the first material is less than the duration of the target element, the multiple of the first material is adjusted so that the adjusted duration of the first material is equal to the first duration. If the original duration of the first material is greater than the duration of the target element, the first material is cropped. In some scenarios, the playback speed is also called the multiple speed.

[0098] The original duration of the first material may be, for example, the duration of the first material before the duration of the first material is adjusted.

[0099] Furthermore, the first material is cropped, including: displaying a video cropping page; including a third video display area and a timeline editing area on the video cropping page; the timeline editing area is used to display the timeline corresponding to the first material, and the third video display area is used to display the image of the first material; in response to the cropping operation and confirmation operation of the video material in the timeline editing area, the first material is cropped.

[0100] The video cropping page can be, for example, a page for cropping the first material. The third video display area and the timeline editing area are areas in the video cropping page, and the third video display area is used to preview the cropped first material. The timeline editing area can be, for example, an area for assisting the user in cropping the first material. The alignment relationship between the image of the first material and the timeline can be displayed in the timeline editing area. By observing the timeline editing area, the user can clearly know the key frame position of the first material, and then accurately determine the position to be cropped, thereby completing the cropping of the first material.

[0101] The cropping operation on the video material may be, for example, an operation of specifying a cropping position in the timeline editing area, and the confirmation operation may be, for example, an operation in which the user approves the currently specified cropping position and agrees to perform the cropping.

[0102] For example, see Figure 10 , assuming the user clicks on video 1, video 1 is used as the target element and the modification options corresponding to video 1 are displayed. The modification options corresponding to video 1 include the "Replace" option. If the user clicks on "Replace", see Figure 11 , display the video selection page, which includes identification information of multiple candidate video materials. If the user clicks the identification information of candidate video material 2, candidate video material 2 will be used as the first material and the duration of candidate video material 2 will be adjusted. Assume that the display duration of video 1 in the target video is 3s, that is, the first duration is 3s. Assume that the duration of candidate video material 2 is 5s. Since the duration of candidate video material 2 is longer than the first duration, see Figure 12, display the video cropping page; the video cropping page includes a third video display area and a timeline editing area. In the timeline editing area, image frames of candidate video material 2 and a cropping frame are displayed in chronological order. The cropping frame is a cropping tool, and the user can move the cropping frame to circle different image frames. After the user moves the cropping frame to the appropriate position, click the "OK" option in the video selection page to use the video clip represented by the image frame circled by the cropping frame as the adjusted first material, and use the adjusted first material to replace the target element.

[0103] By setting up a video selection page for display, the video selection page includes identification information of at least one candidate material; in response to a selection operation of a first material from the at least one candidate material, adjusting the duration of the first material so that the adjusted display duration of the first material is equal to the first duration; and replacing the target element with the adjusted first material. Essentially, when replacing a video material in a target video, the duration of the first material used to replace the video material is adjusted, so that the target video can be re-edited without changing its structure.

[0104] It should be noted that when the target element is a video material or an image material and the original display duration of the target element is the first duration, if the target element is replaced with a candidate image material, the display duration of the candidate image material can be set equal to the first duration.

[0105] Based on the above technical solution, if the target element is a video material or an image material, modifying the target element includes replacing the target element; replacing the target element includes: displaying a generation prompt information collection page; generating a second material based on the generation prompt information received on the generation prompt information collection page; and replacing the target element with the second material.

[0106] The generation prompt information collection page may be, for example, a page for collecting generation prompt information. The generation prompt information may be, for example, information for input into a generation model to control the generation model's process of generating images or videos. The generation prompt information may include text and / or images.

[0107] For example, see Figure 10 , assuming the user clicks on video 1, video 1 is used as the target element and the modification options corresponding to video 1 are displayed. The modification options corresponding to video 1 include the "Generate" option. If the user clicks on the "Generate" option, see Figure 13 , the page for collecting prompt information is displayed. This page includes a text input box and an "OK" option. After the user enters text in the text input box and clicks "OK," the text in the text input box is used as the prompt information to generate the second asset. The second asset can then be used to replace the target element.

[0108] Optionally, the generating the prompt information collection page further includes generating a generation record display area, which may be, for example, an area in the generating the prompt information collection page for centrally displaying the generation record of the image and / or video generated by the generation model. In some scenarios, the generation record of the image may be a thumbnail of the image, and the generation record of the video may be a cover of the video or a thumbnail of a frame image, etc. After the second material is generated, the generation record corresponding to the generated second material is displayed in the generation record display area.

[0109] Further, the method may further include: in response to a selection operation on the target generation record, replacing the target element with the material corresponding to the target generation record.

[0110] For example, continuing to refer to Figure 13 The generating the prompt information collection page further includes the generation record 1 and the generation record 2. Assuming that the generation record 1 is the record of generating the image a, the generation record 1 corresponds to the image a. If the user clicks the generation record 1, the generation record 1 is taken as the target generation record, and the image a is used to replace the target element.

[0111] On the basis of the above technical solutions, optionally, the video editing page further includes original background music identification information; the method may further include: in response to a selection operation on the original background music identification information, displaying a background music selection panel; the background music selection panel includes a plurality of candidate music identification information; in response to a selection operation on a target background music in the plurality of candidate music, replacing the original background music with the target background music, and displaying identification information of the target background music on the video editing page.

[0112] The original background music may be, for example, the background music of the target video before the target video is modified.

[0113] The music identification information may be, for example, information for distinguishing different music. The original background music identification information may be, for example, one or more of the name, version, performer, and number of the original background music.

[0114] The background music selection panel may be, for example, a panel for centrally displaying music that can be used as background music, and the plurality of candidate music identification information is included in the background music selection panel. The candidate music is music that can be selected by the user. The target background music is a certain candidate music in the plurality of candidate music, which is the background music selected by the user.

[0115] For example, referring to Figure 3 The video editing page further includes the original background music identification information (i.e., the identification information of music 1). If the user clicks the identification information of music 1, referring to Figure 14, showing the background music selection panel, which includes multiple candidate music identification information. Figure 14 The candidate music is Music 2 to Music 5. Figure 14 In the figure, since Music 2 has been downloaded locally, the option corresponding to Music 2 is the "Use" option. Music 3 to Music 5 have not been downloaded locally, and the options corresponding to Music 3, Music 4 and Music 5 are all "Download" options. If the user wants to use Music 2 as the new background music, the user can directly click on the "Use" option corresponding to Music 2 to trigger the electronic device to replace the original background music (i.e. Music 1) with Music 2 as the new background music. If the user wants to use Music 3 as the new background music, the user can directly click on the "Download" option corresponding to Music 3 to download Music 3. After Music 3 is downloaded, the "Use" option corresponding to Music 3 will be displayed. The user can further click on the "Use" option corresponding to Music 3 to trigger the electronic device to replace the original background music (i.e. Music 1) with Music 3 as the new background music.

[0116] By setting a background music selection panel that displays multiple candidate music identification information in response to selecting the original background music identification information, and then selecting the target background music from the multiple candidate music, the original background music is replaced with the target background music, and the identification information of the target background music is displayed on the video editing page. Essentially, this allows users to replace the background music of a target video, further satisfying the user's goal of flexible and precise editing of the target video, and assisting users in completing the task of re-editing the generated video.

[0117] It should be noted that in the technical solution provided in this application, the selection operation of a specific option or identification information can be achieved through direct physical contact of the user (such as touch screen operation), indirect physical input device (such as mouse, touchpad) or non-contact input means (such as gesture recognition, voice control), etc. If it is achieved through direct physical contact of the user (such as touch screen operation) or indirect physical input device (such as mouse, touchpad), it may include but is not limited to the following user interaction methods: click operation, slide operation, drag operation, or long press operation, etc. In addition, according to different application scenarios and technical implementation conditions, the selection operation can also be extended to the use of more advanced interaction technologies, such as eye tracking, brain-computer interface and other emerging human-computer interaction methods.

[0118] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0119] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0120] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0121] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0122] It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present disclosure is not limited by the order of the actions described, because according to the present disclosure, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

[0123] Figure 15 The diagram is a schematic diagram of the structure of an interactive device in an embodiment of the present disclosure. The interactive device provided in the embodiment of the present disclosure can be configured in the client or in the server. Figure 15 , the interactive device specifically includes:

[0124] The first display module 310 is used to display the target video playback page, which includes a first video playback area and editing options; the first video playback area is used to play the target video;

[0125] a decomposition module 320 for decomposing the target video into a plurality of storyboard segments in response to a selection operation of the editing option;

[0126] The second display module 330 is used to display a video editing page, wherein the video editing page includes a second video playback area and a storyboard material display area; the second video playback area includes an image of a target storyboard segment; the storyboard material display area includes a first element used to obtain the target storyboard segment; the image of the target storyboard segment includes a second element constituting the target storyboard segment; the target storyboard segment is any storyboard segment among the multiple storyboard segments;

[0127] The modification module 340 is configured to modify a target element in response to a modification operation on the target element; the target element is the first element or the second element.

[0128] Furthermore, the modules are decomposed into:

[0129] In response to a selection operation on the editing option, the target video is decomposed into a plurality of storyboard segments based on a storyboard script used to generate the target video.

[0130] Furthermore, the video editing page also includes a storyboard identification display area; the storyboard identification display area includes identification information of the multiple storyboard segments; the identification information of the target storyboard segment is in a first display state; and the identification information of the non-target storyboard segment is in a second display state.

[0131] Furthermore, the device also includes a deletion module, which is used to:

[0132] In response to a deletion operation on the target storyboard segment, the target storyboard segment is deleted.

[0133] Furthermore, the device also includes a switching module, which is used to:

[0134] In response to a switching operation on a target storyboard segment, a new target storyboard segment is determined among non-target storyboard segments; an image of the new target storyboard segment is displayed in the second video playback area; and a first element used to obtain the new target storyboard segment is displayed in the storyboard material display area.

[0135] Furthermore, the first element includes at least one of the following: subtitles, image materials, video materials, digital humans, and timbre; if the target element is the first element, modifying the target element includes at least one of the following: replacing the target element, modifying the content of the target element, and deleting the target element;

[0136] The second element includes a subtitle and / or a sticker; if the target element is a second element, modifying the target element includes at least one of the following: adjusting a position of the target element, adjusting a size of the target element, adjusting a rotation angle of the target element, replacing the target element, modifying content of the target element, and deleting the target element.

[0137] Further, if the target element is a subtitle, the target video includes a first dubbing corresponding to the subtitle; a modifying module is configured to:

[0138] modify content of the subtitle;

[0139] determine a target duration of the target shot based on the modified subtitle;

[0140] adjust a picture playing duration of the target shot so that the picture playing duration of the target shot after adjustment is equal to the target duration.

[0141] Further, the modifying module is configured to:

[0142] if the target duration of the target shot is greater than an original playing duration of the picture of the target shot, decrease a playing speed of the picture of the target shot, or add a blank shot in the target shot;

[0143] if the target duration of the target shot is less than the original playing duration of the picture of the target shot, increase the playing speed of the picture of the target shot, or delete at least part of image frames in the target shot.

[0144] Further, if the target element is a video material or an image material, an original display duration of the target element is a first duration; the modifying module is configured to:

[0145] display a video selection page, the video selection page including identification information of at least one candidate material;

[0146] in response to a selection operation on a first material in the at least one candidate material, adjust a duration of the first material so that a display duration of the first material after adjustment is equal to the first duration;

[0147] replace the target element with the first material after adjustment.

[0148] Further, if the target element is a video material or an image material, the modifying module is configured to:

[0149] display a generation prompt information collection page;

[0150] generating a second material based on the generation prompt information received on the generation prompt information collection page;

[0151] The target element is replaced with the second material.

[0152] Furthermore, the video editing page also includes original background music identification information; a modification module is used to:

[0153] In response to a selection operation on the original background music identification information, a background music selection panel is displayed; the background music selection panel includes a plurality of candidate music identification information;

[0154] In response to a selection operation of target background music from the plurality of candidate music, the original background music is replaced by the target background music, and identification information of the target background music is displayed on the target video playback page.

[0155] The interactive device provided in the embodiment of the present disclosure can execute the steps executed by the client or server in the interactive method provided in the embodiment of the method of the present disclosure, and has the execution steps and beneficial effects, which will not be repeated here.

[0156] The following specific reference Figure 16 , which shows a schematic structural diagram of an electronic device 1000 suitable for implementing the embodiments of the present disclosure. The electronic device 1000 in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), wearable electronic devices, and fixed terminals such as digital TVs, desktop computers, smart home devices, and the like. Figure 16 The electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0157] like Figure 16 As shown, the electronic device 1000 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 1001, which can perform various appropriate actions and processes to implement the interactive method of the embodiment described in the present disclosure according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage device 1008 to the random access memory (RAM) 1003. Various programs and information required for the operation of the electronic device 1000 are also stored in the RAM 1003. The processing device 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.

[0158] Typically, the following devices may be connected to the I / O interface 1005: an input device 1006 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 1007 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 1008 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 may allow the electronic device 1000 to communicate with other devices wirelessly or by wire to exchange information. Although Figure 16 The electronic device 1000 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.

[0159] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart, thereby implementing the interactive method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 1009, or installed from the storage device 1008, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0160] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include an information signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated information signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0161] In some embodiments, the client and server can communicate using any known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital information communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any known or future developed network.

[0162] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0163] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0164] The first device detects whether the application has performance problems;

[0165] When a performance problem occurs in the application, the first device obtains scheduling information of one or more first messages and / or scheduling information of second messages, where the one or more first messages are messages that have been scheduled when the performance problem occurs, and the second messages are messages that are being scheduled when the performance problem occurs;

[0166] The first device locates the performance problem according to the scheduling information of the one or more first messages and / or the scheduling information of the second message.

[0167] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0168] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0169] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0170] The units involved in the embodiments described in this disclosure may be implemented in software or hardware, wherein the name of a unit does not necessarily limit the unit itself.

[0171] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0172] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0173] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, including:

[0174] one or more processors;

[0175] a memory for storing one or more programs;

[0176] When the one or more programs are executed by the one or more processors, the one or more processors implement any of the interaction methods provided in the present disclosure.

[0177] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which implements any of the interaction methods provided by the present disclosure when the program is executed by a processor.

[0178] An embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the interaction method described above is implemented.

[0179] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0180] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. An interactive method, characterized in that: include: Displaying a target video playback page, wherein the target video playback page includes a first video playback area and an editing option; The first video playback area is used to play the target video; In response to a selection operation of the editing option, decomposing the target video into a plurality of storyboard segments; Displaying a video editing page, the video editing page including a second video playback area and a storyboard material display area; the second video playback area including an image of a target storyboard segment; the storyboard material display area including a first element used to obtain the target storyboard segment; the image of the target storyboard segment including a second element constituting the target storyboard segment; the target storyboard segment being any storyboard segment among the plurality of storyboard segments; In response to a modification operation on a target element, the target element is modified; the target element is the first element or the second element.

2. The method according to claim 1, characterized in that In response to the selection operation of the editing option, decomposing the target video into a plurality of storyboard segments comprises: In response to a selection operation on the editing option, the target video is decomposed into a plurality of storyboard segments based on a storyboard script used to generate the target video.

3. The method according to claim 1, characterized in that The video editing page also includes a storyboard identification display area; the storyboard identification display area includes identification information of the multiple storyboard segments; the identification information of the target storyboard segment is in a first display state; and the identification information of the non-target storyboard segment is in a second display state.

4. The method according to claim 1, wherein The method further comprises: In response to a deletion operation on the target storyboard segment, the target storyboard segment is deleted.

5. The method according to claim 1, wherein The method further comprises: In response to a switching operation on a target storyboard segment, a new target storyboard segment is determined among non-target storyboard segments; an image of the new target storyboard segment is displayed in the second video playback area; and a first element used to obtain the new target storyboard segment is displayed in the storyboard material display area.

6. The method according to claim 1, characterized in that The first element includes at least one of the following: subtitles, image materials, video materials, digital humans, and timbre; if the target element is the first element, modifying the target element includes at least one of the following: replacing the target element, modifying the content of the target element, and deleting the target element; The second element includes subtitles and / or stickers; if the target element is the second element, modifying the target element includes at least one of the following: adjusting the position of the target element, adjusting the size of the target element, adjusting the rotation angle of the target element, replacing the target element, modifying the content of the target element, and deleting the target element.

7. The method according to claim 1, characterized in that If the target element is a subtitle, the target video includes a first dubbing corresponding to the subtitle; and modifying the target element includes modifying the content of the subtitle; After modifying the content of the subtitles, the method further includes: Determining a target duration of the target storyboard segment based on the modified subtitles; Adjust the screen playback duration of the target storyboard segment so that the adjusted screen playback duration of the target storyboard segment is equal to the target duration.

8. The method according to claim 7, characterized in that The adjusting the playback duration of the target storyboard segment includes: If the target duration of the target storyboard segment is greater than the original playback duration of the target storyboard segment, reducing the playback speed of the target storyboard segment or adding an empty shot to the target storyboard segment; If the target duration of the target storyboard segment is less than the original playback duration of the target storyboard segment picture, the playback speed of the target storyboard segment picture is increased, or at least part of the image frames in the target storyboard segment are deleted.

9. The method according to claim 1, characterized in that If the target element is a video material or an image material, the original display duration of the target element is the first duration; and the modifying of the target element includes replacing the target element; The replacing the target element comprises: Displaying a video selection page, wherein the video selection page includes identification information of at least one candidate material; In response to a selection operation of a first material from the at least one candidate material, adjusting a duration of the first material so that a display duration of the adjusted first material is equal to the first duration; The target element is replaced by the adjusted first material.

10. The method according to claim 1, characterized in that If the target element is a video material or an image material, modifying the target element includes replacing the target element; The replacing the target element comprises: Display the generated prompt information collection page; generating a second material based on the generation prompt information received on the generation prompt information collection page; The target element is replaced with the second material.

11. The method according to claim 1, wherein The video editing page also includes original background music identification information; the method further includes: In response to a selection operation on the original background music identification information, a background music selection panel is displayed; the background music selection panel includes a plurality of candidate music identification information; In response to a selection operation of target background music from the plurality of candidate music, the original background music is replaced by the target background music, and identification information of the target background music is displayed on the target video playback page.

12. An interactive device, characterized in that: include: A first display module is used to display a target video playback page, wherein the target video playback page includes a first video playback area and an editing option; The first video playback area is used to play the target video; a decomposition module, configured to decompose the target video into a plurality of storyboard segments in response to a selection operation on the editing option; a second display module for displaying a video editing page, the video editing page including a second video playback area and a storyboard material display area; the second video playback area including an image of a target storyboard segment; the storyboard material display area including a first element used to obtain the target storyboard segment; the image of the target storyboard segment including a second element constituting the target storyboard segment; the target storyboard segment being any storyboard segment among the plurality of storyboard segments; A modification module, configured to modify the target element in response to a modification operation on the target element; The target element is the first element or the second element.

13. An electronic device, characterized in that: The electronic device comprises: one or more processors; a storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 11.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.

Images