Page interaction method and device, electronic equipment, storage medium and program product

Abstract

The present disclosure relates to a page interaction method and device, an electronic device, a storage medium and a program product. The method comprises displaying a content interaction area and a video generation control on a target page. The content interaction area is used to receive and display at least one type of media material. The at least one type of media material comprises text prompt information, which is used to describe the video to be generated as a whole. When the video generation control is triggered, a video generation result is displayed. The video generation result is consistent with the media material displayed in the content interaction area and comprises at least two shots corresponding to the text prompt information. The present disclosure can improve the efficiency of user creation of a video comprising multiple shots and reduce the difficulty of creation.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a page interaction method, apparatus, electronic device, storage medium, and program product. Background Technology

[0002] Applications in related technologies can provide video generation services to users, allowing them to input multiple storyboard instructions through interaction with the application. Each storyboard instruction can include professional guidance on how to set up the shot. The application automatically generates a video with multiple shots based on these instructions. However, in this approach, the interaction between the application and the user is linear and step-by-step, and it requires a high level of professional storyboarding skills from the user. This results in high difficulty and low efficiency for users to create videos with multiple shots, as well as low efficiency in interacting with the application. Summary of the Invention

[0003] This disclosure provides a page interaction method, apparatus, electronic device, storage medium, and program product to at least solve one of the aforementioned technical problems. The technical solution of this disclosure is as follows: According to a first aspect of the present disclosure, a page interaction method is provided, comprising: The target page displays a content interaction area and a video generation control. The content interaction area is used to receive and display at least one type of media material, which includes text prompt information. The text prompt information is used to describe the video to be generated. When the video generation control is triggered, the video generation result is displayed. The video generation result matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompt information.

[0004] In one exemplary embodiment, the method further includes: On the target page, a first storyboard control control is displayed, which is used to instruct the generation of at least two storyboards based on the text prompt information; When the video generation control is triggered, displaying the video generation result includes: When the first storyboard control control is enabled and the video generation control is triggered, the video generation result is displayed.

[0005] In one exemplary embodiment, the method further includes: On the target page, a second storyboard control control is displayed, which is used to indicate the storyboard editing process; When the first storyboard control control is enabled, if the second storyboard control control is triggered, a storyboard information sequence is displayed, which includes at least two storyboard information that match the text prompt information. The step of displaying the video generation result when the video generation control is triggered includes: displaying the video generation result when the video generation control is triggered, wherein the video generation result is consistent with the storyboard information sequence.

[0006] In one exemplary embodiment, when the first storyboard control control is in the enabled state, if the second storyboard control control is triggered, displaying the storyboard information sequence includes: When the text prompt information in the content interaction area is updated, the storyboard information sequence is updated, wherein updating the storyboard information sequence includes at least one operation of adding storyboard information, deleting storyboard information, and changing storyboard information.

[0007] In one exemplary embodiment, the display of the storyboard information sequence includes: Display the sequence of regions formed by the storyboard information display area; In any of the storyboard information display areas of the region sequence, the corresponding storyboard information is displayed, which includes storyboard text prompts, storyboard duration, and storyboard sequence number.

[0008] In one exemplary embodiment, the method further includes editing storyboard information, wherein editing the storyboard information includes at least one of the following operations: Upon receiving a drag operation on any storyboard information display area, the position of the dragged storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving a deletion operation for any storyboard information display area, the display of the deleted storyboard information display area is canceled, the position of the relevant storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving an editing operation on any storyboard information display area, the editing result of the content editing operation is displayed. The content editing operation includes editing at least one of the storyboard text prompts and the storyboard duration.

[0009] In one exemplary implementation, the display of the storyboard information sequence includes: If the text prompt is empty, display a sequence of regions formed by at least two storyboard information display areas, wherein the storyboard content in the storyboard information in the storyboard information display area is empty, and the storyboard content includes storyboard text prompts and storyboard duration; When any of the storyboard information display areas is triggered, an editing operation on the corresponding storyboard information is received; When the video generation control is triggered, the video generation result is displayed, and the video generation result matches the storyboard information sequence, including: When the video generation control is triggered, if the text prompt is empty, but there are at least two storyboards with non-empty content, the video generation result is displayed. The video generation result includes shots generated based on the at least two storyboards with non-empty content.

[0010] In one exemplary embodiment, the method further includes: On the target page, a main material recommendation area is displayed, which includes multiple main materials. When any of the aforementioned main materials is triggered, the triggered main material will be displayed as media material in the content interaction area.

[0011] In one exemplary implementation, the main content recommendation area includes: In the main material recommendation area, at least two target main materials are displayed, and the creation time, usage time, or usage frequency of the target main materials meet preset requirements.

[0012] In one exemplary implementation, the main content recommendation area includes: In the main material recommendation area, at least one material type recommendation control is displayed; When any of the aforementioned material type recommendation controls is triggered, at least two main materials corresponding to the material type are displayed in the main material recommendation area.

[0013] According to a second aspect of the present disclosure, a page interaction device is provided, comprising: The display module is configured to display an interactive content area and a video generation control on the target page. The interactive content area is used to receive and display at least one type of media material, which includes text prompts that describe the video to be generated. The interaction module is configured to display a video generation result when the video generation control is triggered. The video generation result matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompt information.

[0014] In one exemplary implementation, the interaction module is configured to execute: On the target page, a first storyboard control control is displayed, which is used to instruct the generation of at least two storyboards based on the text prompt information; When the first storyboard control control is enabled and the video generation control is triggered, the video generation result is displayed.

[0015] In one exemplary implementation, the interaction module is configured to execute: On the target page, a second storyboard control control is displayed, which is used to indicate the storyboard editing process; When the first storyboard control control is enabled, if the second storyboard control control is triggered, a storyboard information sequence is displayed, which includes at least two storyboard information that match the text prompt information. When the video generation control is triggered, the video generation result is displayed, and the video generation result matches the storyboard information sequence.

[0016] In one exemplary implementation, the interaction module is configured to execute: When the text prompt information in the content interaction area is updated, the storyboard information sequence is updated, wherein updating the storyboard information sequence includes at least one operation of adding storyboard information, deleting storyboard information, and changing storyboard information.

[0017] In one exemplary implementation, the interaction module is configured to execute: Display the sequence of regions formed by the storyboard information display area; In any of the storyboard information display areas of the region sequence, the corresponding storyboard information is displayed, which includes storyboard text prompts, storyboard duration, and storyboard sequence number.

[0018] In one exemplary implementation, the interaction module is configured to execute: Editing the storyboard information includes at least one of the following operations: Upon receiving a drag operation on any storyboard information display area, the position of the dragged storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving a deletion operation for any storyboard information display area, the display of the deleted storyboard information display area is canceled, the position of the relevant storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving an editing operation on any storyboard information display area, the editing result of the content editing operation is displayed. The content editing operation includes editing at least one of the storyboard text prompts and the storyboard duration.

[0019] In one exemplary implementation, the interaction module is configured to execute: If the text prompt is empty, display a sequence of regions formed by at least two storyboard information display areas, wherein the storyboard content in the storyboard information in the storyboard information display area is empty, and the storyboard content includes storyboard text prompts and storyboard duration; When any of the storyboard information display areas is triggered, an editing operation on the corresponding storyboard information is received; When the video generation control is triggered, if the text prompt is empty, but there are at least two storyboards with non-empty content, the video generation result is displayed. The video generation result includes shots generated based on the at least two storyboards with non-empty content.

[0020] In one exemplary implementation, the interaction module is configured to execute: On the target page, a main material recommendation area is displayed, which includes multiple main materials. When any of the aforementioned main materials is triggered, the triggered main material will be displayed as media material in the content interaction area.

[0021] In one exemplary implementation, the interaction module is configured to execute: In the main material recommendation area, at least two target main materials are displayed, and the creation time, usage time, or usage frequency of the target main materials meet preset requirements.

[0022] In one exemplary implementation, the interaction module is configured to execute: In the main material recommendation area, at least one material type recommendation control is displayed; When any of the aforementioned material type recommendation controls is triggered, at least two main materials corresponding to the material type are displayed in the main material recommendation area.

[0023] According to a third aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the page interaction method described above.

[0024] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided that, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the page interaction method as described above.

[0025] According to a fifth aspect of the present disclosure, a computer program product is provided, the computer program product including a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the device to perform the page interaction method described above.

[0026] The technical solutions provided by the embodiments of this disclosure have at least the following beneficial effects: The page interaction method, apparatus, electronic device, storage medium, and program product disclosed herein are applied to a target page, displaying a content interaction area and a video generation control on the target page. The content interaction area is used to receive and display at least one type of media material, including text prompts describing the video to be generated. When the video generation control is triggered, a video generation result is displayed, which matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompts.

[0027] In this disclosed page interaction method, users do not need professional storyboard knowledge. They only need to input text prompts describing the requirements for generating the video in the content interaction area, and the system will automatically generate a video with multiple shots. This avoids the complex process in related technologies where users need to input multiple professional storyboard instructions one by one. This allows non-professional users to easily create videos with multiple shots, effectively solving the problem of high requirements for users' professional storyboarding skills. This disclosure improves the linear, step-by-step interaction method in related technologies into an integrated interaction method that allows direct interaction in the content interaction area. Users do not need to switch repeatedly between multiple steps, improving user creation efficiency and interaction efficiency, ensuring that the user's creative flow is not interrupted, thereby improving user creation efficiency and reducing creation difficulty.

[0028] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0029] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0030] Figure 1This is a schematic diagram of an implementation environment according to an exemplary embodiment.

[0031] Figure 2 This is a flowchart illustrating a page interaction method according to an exemplary embodiment.

[0032] Figure 3 This is a schematic diagram of a content interaction area according to an exemplary embodiment.

[0033] Figure 4 This is a schematic diagram of a target page according to an exemplary embodiment.

[0034] Figure 5 This is another schematic diagram of a target page according to an exemplary embodiment.

[0035] Figure 6 This is a schematic diagram of the main material recommendation area according to an exemplary embodiment.

[0036] Figure 7 This is a block diagram of a page interaction device according to an exemplary embodiment.

[0037] Figure 8 This is a block diagram illustrating an electronic device for page interaction according to an exemplary embodiment.

[0038] Figure 9 This is another block diagram illustrating an electronic device for page interaction according to an exemplary embodiment. Detailed Implementation

[0039] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0040] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0041] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0042] This disclosure is primarily applied to media content creation applications. In related technologies, such applications, by default, can create single-shot videos based on user-input media materials. If the user needs to create videos including multiple shots, these applications can also support the user inputting multiple storyboard instructions through interaction with the application. Each storyboard instruction can include professional guidance information on how to set up the shot, and the application automatically generates a video with multiple shots based on the multiple storyboard instructions.

[0043] It is evident that related technologies either default to generating single-shot videos without multiple shots, or require users with high professional skills to create multi-shot videos only after linear, step-by-step interaction with the application and inputting multiple professional storyboard instructions. Clearly, these technologies lack a more intuitive, convenient, and non-linear interactive solution to assist users in efficiently creating multi-shot videos without requiring professional storyboarding skills. This often discourages users from creating multi-shot videos due to a lack of professional guidance or overly cumbersome interaction processes, hindering the full expression of their creative ideas and limiting the widespread adoption of video creation and user productivity.

[0044] In view of this, this disclosure proposes a page interaction method that does not require users to input professional storyboard instructions. Instead, it provides a unified content interaction area where users can directly input media materials and freely describe their requirements for the generated video through text prompts. The application can then generate a video with multiple shots, using the media materials and corresponding to the text prompts. With this page interaction method, users do not need complex storyboard expertise; they can freely express their creative needs for the video through natural language text prompts, and the application can automatically create storyboards and generate a video with multiple shots based on those needs. Furthermore, this interaction method transforms the traditional linear, step-by-step input of professional storyboard instructions into a non-linear interaction method where media materials and text prompts are directly input in a unified content interaction area. This simplifies the operation process, reduces user interaction steps, and allows users to interact with the application more intuitively and conveniently, improving the smoothness and efficiency of the creative process.

[0045] The technical solution provided in this disclosure will be described in detail below: Please see Figure 1The illustration shows an implementation environment provided by an embodiment of the present disclosure. The implementation environment may include at least one page interaction terminal 110 and an information acquisition server 120, wherein the page interaction terminal 110 and the information acquisition server 120 can communicate with each other via a network.

[0046] Specifically, the page interaction terminal 110 interacts with the user through interaction with the information acquisition server 120. Specifically, the page interaction terminal 110 can display a content interaction area and a video generation control on the target page. The content interaction area is used to receive and display at least one type of media material, including text prompts describing the video to be generated. When the video generation control is triggered, the video generation result is displayed, which matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompts.

[0047] The page interaction terminal 110 can communicate with the information acquisition server 120 based on a browser / server (B / S) mode or a client / server (C / S) mode. The page interaction terminal 110 may include physical devices such as smartphones, tablets, laptops, digital assistants, smart wearable devices, in-vehicle terminals, and servers, and may also include software running on the physical device, such as applications. The operating system running on the page interaction terminal 110 in this embodiment may include, but is not limited to, Android, iOS, Linux, and Windows.

[0048] The information acquisition server 120 and the page interaction terminal 110 can establish and display a communication connection through wired or wireless means. The information acquisition server 120 may include a stand-alone server, a distributed server, or a server cluster composed of multiple servers, wherein the server may be a cloud server.

[0049] Please refer to Figure 2 The diagram illustrates a page interaction method flowchart in an exemplary embodiment of this disclosure. The execution subject of this method can be the aforementioned page interaction terminal. Please refer to [link / reference] for details. Figure 2 The method may include: S210. Display a content interaction area and a video generation control on the target page, wherein the content interaction area is used to receive and display at least one type of media material, the at least one type of media material including text prompt information, the text prompt information being used to describe the video to be generated.

[0050] In this disclosure, the target page can be a page provided in an application for creating media content, which may refer to generating video. The target page displays an interactive content area, which serves as an entry point for users to input, edit, and view media materials. These media materials can be the materials used by the application to generate the video. These materials can cover single or multiple types of media content; this disclosure does not limit the type of media content, including text, audio, images, video, or other forms.

[0051] In one exemplary implementation, please refer to Figure 3 This diagram illustrates a content interaction area in an exemplary embodiment of the present disclosure. In one case, Figure 3 (a) The content interaction area 310 is an area that provides real-time multimodal input sensing, integrating the input of various media materials such as text, images, and videos into a single interaction area. The content interaction area 310 displays the preset prompt text "Upload image / video / voiceover and describe your imagination," where "image / video / voiceover" respectively indicates that the user can input image, video, and audio materials, and "describe your imagination" indicates that the user can input text materials. This disclosure does not limit the input method of these types of materials. For example, the user can select a local file by clicking the upload button or directly dragging and dropping the file into the content interaction area to complete the addition of materials. In addition, this area also supports direct input of descriptive content through voice input or text input boxes, further improving the flexibility of operation. In some embodiments, in order to optimize the user experience, the content interaction area 310 also displays a real-time preview effect after the user adds materials, such as image thumbnails, video covers, or audio waveforms, and provides simple editing functions, such as cropping, filter adjustment, or volume adjustment. This design not only simplifies the user's workflow but also helps users quickly edit materials to better meet their creative needs, thereby improving overall creative efficiency.

[0052] Figure 3 All types of media materials in (a) can be displayed visually in the content interaction area 310. For example, non-text materials can coexist with text materials (text) in the content interaction area 310 as thumbnails or cards. Users can perform management operations such as removing or replacing individual materials. The content interaction area 310 embodies an integrated layout of this disclosure, that is, the text input area and the display area for other types of non-text materials are logically and visually unified, together constituting the user's material management space. Users can complete the input and display of various types of materials in this single area without jumping to different pages or switching between separate modules.

[0053] In another case, Figure 3 (b) The content interaction area 320 uses separate but interconnected input boxes. It displays two areas: a text box and a resource area. The text box is used to input and display text-based materials, while the resource area is used to input and display non-text-based materials. When non-text-based materials are uploaded, the application can automatically generate previews and display them in the resource area as thumbnails, cover images, or other visual formats. Users can manage materials through simple clicks or drag-and-drop operations, such as adjusting their order, deleting, or replacing them. Simultaneously, the text box and resource area are interconnected. When a user enters content in the text box, the application can intelligently recommend relevant materials based on the context, or automatically generate descriptive text based on the material's theme. This separate but interconnected design not only improves the clarity of the interface but also enhances the user's operational flexibility, making the creation process more efficient and intuitive.

[0054] In another case, Figure 3 In the content interaction area 330 of (c), a conversational or step-by-step guided process is used instead of... Figure 3 The multimodal input box in (a) is displayed in the form of a dialog box for human-computer interaction within the interactive content area 330. This dialog box guides the user to input media materials through human-computer dialogue. For example, the robot representing the application can first ask, "What do you want to create?" After the user answers, the robot then asks, "Please upload your main materials," and then asks, "What characteristics do you want the video to have overall?" In this process, the user's input is broken down into multiple dialogue steps, and various media materials are collected step by step.

[0055] This disclosure does not limit the text prompts; they can provide a complete or partial description of the video to be generated, such as describing the characters, scenes, atmosphere, props, and plot involved in the video. The text prompts may or may not include specific storyboard guidance.

[0056] Specifically, text prompts are information carriers that users freely express to the application, providing direction and constraints for video generation. This disclosure does not strictly limit their form and content; users can express themselves flexibly according to their own needs. For example, a user could input, "Make a short video about a spring park scene, with flowers blooming and people strolling, with an overall warm and soothing style." This is a general description of the video, which does not include specific storyboard guidance for multiple shots, only clarifying the theme, key elements, and style tone. However, if a user inputs, "Make a product promotional video: Shot 1, slowly zooming in from a wide shot of the product to the logo; Shot 2, a model holding the product demonstrating its use, with a blurred background; Shot 3, a close-up of product details, highlighting the material texture; background music should be upbeat, technologically-inspired instrumental music," this includes specific storyboard guidance for multiple shots, clarifying the composition, content, and transitions of each shot.

[0057] When the text prompt does not include specific storyboard guidance, the application will perform intent parsing on the text prompt and perform intelligent storyboarding based on the intent parsing results. Intent parsing and intelligent storyboarding based on intent parsing can be achieved through open-source large models, related models trained based on open-source large models, or intelligent planning based on keyword extraction combined with rules. There are many such implementation methods in related technologies, so they do not constitute an implementation obstacle, nor are they limited to the content of this disclosure. For example, for the prompt "Make a short video about the scenery of a park in spring, with scenes of flowers blooming and people strolling, with an overall warm and soothing style," the application can extract the keywords "spring park," "flowers blooming," "people strolling," and "warm and soothing." Then, based on this information, the following storyboard is automatically planned: Storyboard 1 (long shot): The park entrance under bright sunshine, showcasing the overall environment and vibrant spring atmosphere of the park; Storyboard 2 (medium shot): A close-up of different kinds of flowers blooming in the flowerbeds, highlighting the "flowers in bloom" element, which can be complemented by soft lighting; Storyboard 3 (medium close-up): People stroll leisurely along the park paths, their faces beaming with relaxed smiles, capturing a natural moment of interaction; Storyboard 4 (wide shot to long shot): The camera slowly pulls back, showcasing the overall spring scenery of the park and the harmonious scene of people's activities, ending with a gradually increasing, warm and soothing background music. During this process, the application considers the logical order of the shots, the appropriate combination of shot sizes, the allocation of time, and how to convey a "warm and soothing" style through visual elements to complete the intelligent storyboarding.

[0058] When the text prompt includes specific storyboard guidance information, the application can generate storyboards and videos based on that guidance information; this disclosure will not elaborate further on this.

[0059] S220. When the video generation control is triggered, the video generation result is displayed, which matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompt information.

[0060] After the user triggers the video generation control on the interface, the application can automatically and intelligently perform scene splitting based on the media materials displayed in the content interaction area and guided by text prompts, and generate a video result including multiple shots, and then display the video result.

[0061] In this disclosed page interaction method, users do not need professional storyboard knowledge. They only need to input text prompts describing the requirements for generating the video in the content interaction area, and the system will automatically generate a video with multiple shots. This avoids the complex process in related technologies where users need to input multiple professional storyboard instructions one by one. This allows non-professional users to easily create videos with multiple shots, effectively solving the problem of high requirements for users' professional storyboarding skills. This disclosure improves the linear, step-by-step interaction method in related technologies into an integrated interaction method that allows direct interaction in the content interaction area. Users do not need to switch repeatedly between multiple steps, improving user creation efficiency and interaction efficiency, ensuring that the user's creative flow is not interrupted, thereby improving user creation efficiency and reducing creation difficulty.

[0062] In one exemplary embodiment, the method further includes: displaying a first storyboard control control on the target page, the first storyboard control control being used to instruct the generation of at least two storyboards based on the text prompt information.

[0063] In this embodiment, the first shot control control is used to enable or disable the "intelligent shot" function. If the first shot control control is disabled, the application can generate a single-shot video without performing intelligent shot creation before video generation. If the first shot control control is enabled, the application will automatically perform intelligent shot creation based on the text prompts entered by the user, planning and designing multiple shots for the video content. Specifically, the application can perform semantic understanding and content parsing of the text prompts, identifying key scenes, main objects, action sequences, timeline changes, and emotional atmosphere. Based on the identification results, the application will then divide the overall video content into at least two shots with logical coherence and visual expressiveness. Each shot will clearly define its shot type (e.g., wide shot, medium shot, close-up, extreme close-up), shooting angle, composition, camera movement (e.g., push, pull, pan, tilt, track), and the main visual elements and dynamic effects within the segment, thus forming a preliminary video script including multiple shots. Based on this video script, the application generates a video using media materials in the content interaction area.

[0064] Accordingly, displaying the video generation result when the video generation control is triggered includes: displaying the video generation result when the first storyboard control control is in the on state and the video generation control is triggered. That is, when the first storyboard control control is in the on state, the application automatically performs intelligent storyboarding and generates a video including multiple shots; if the first storyboard control control is in the off state, a single-shot video can be generated directly.

[0065] This implementation allows users to freely choose whether to enable the intelligent storyboard function through the settings of the first storyboard control. For simple content, single scenes, or when users want to quickly generate a basic video, disabling the first storyboard control and directly generating a single-shot video greatly simplifies the operation process, saves creation time, and meets users' pursuit of efficiency. However, when the text prompts are rich in content, include multiple scene transitions, complex main actions, or when users expect a more professional-level video with greater visual depth, enabling the first storyboard control allows the application to automatically perform intelligent storyboarding, undoubtedly providing users with more advanced and refined creative assistance. The existence of the first storyboard control gives users a clearer sense of control over the video generation process. Users can actively choose the generation mode according to their creative intentions, and the application provides corresponding services based on the user's selection. This "user-led, program-assisted" interaction mode reflects the intelligent and user-friendly design of the application and ensures the user's central role in the creative process, making the entire video generation process more transparent and controllable, further improving user satisfaction.

[0066] Please refer to Figure 4 This illustrates a target page diagram in an exemplary embodiment of the present disclosure. Figure 4 In (a), the target page 410 may include not only a content interaction area for allowing users to input at least one type of media material, but also a first storyboard control control 420 and a video generation control 430. The first storyboard control control 420 is labeled with the text information "intelligent storyboard," and can be set to the enabled state by default. If the first storyboard control control 420 is enabled and the video generation control 430 is triggered, intelligent storyboarding can be performed based on the media material (including text prompts) input by the user in the content interaction area, and a video including multiple shots can be generated.

[0067] In one exemplary embodiment, the method further includes: displaying a second storyboard control control on the target page, the second storyboard control control being used to indicate storyboard editing; and, if the second storyboard control control is triggered when the first storyboard control control is in an enabled state, displaying a storyboard information sequence, the storyboard information sequence including at least two storyboard information that correspond to the text prompt information.

[0068] The second storyboard control is used to trigger the display and editing of storyboard information, and it can only be used if the first storyboard control is enabled. That is, when the user has enabled the first storyboard control on the target page, the second storyboard control becomes interactive. At this time, if the user triggers the second storyboard control, for example by clicking, the application will display a sequence of storyboard information. This sequence of storyboard information can show a sequence of multiple storyboard information obtained by the application based on the user's input text prompts. By displaying the storyboard information sequence to the user before video generation, the transparency of multi-shot video generation can be improved, allowing the user to clearly understand the storyboard information and the expected presentation effect of the video, avoiding significant deviations between the generated video and the user's needs due to information opacity. Meanwhile, the storyboard information sequence supports user editing operations. Users can adjust the information of each storyboard in the storyboard information sequence according to their own creative ideas or actual needs. For example, they can modify the duration of the storyboard, adjust the order of the materials in the storyboard, replace the media materials used in the storyboard, or add or delete storyboards, thereby realizing personalized customization of the video storyboard and making the final generated video more in line with the user's specific creative intentions.

[0069] Accordingly, displaying the video generation result when the video generation control is triggered includes: displaying the video generation result, which matches the storyboard information sequence, when the video generation control is triggered. That is, after the user completes the editing operation on the storyboard information sequence, such as adjusting the duration of each storyboard, the order of materials, replacing media materials, or adding or deleting storyboards, once the video generation control is triggered, the application will generate a video based on the edited storyboard information sequence. The displayed video generation result, including the switching of each shot, the presentation of the scene content, the duration, and the connection between each shot, strictly follows the parameters and logical relationships set in the storyboard information sequence. For example, if the first shot in the storyboard information sequence is a 3-second landscape video clip, and the second shot is a 2-second close-up image of a character, then the generated video will first play the 3-second landscape video, and then seamlessly switch to the 2-second close-up image of the character, and so on, to ensure that the overall structure and details of the video are highly consistent with the storyboard information sequence finally determined by the user, thus faithfully reproducing the user's creative concept.

[0070] In this implementation, the second storyboard control allows users to edit the sequence of storyboard information based on the application's automatic intelligent storyboard generation. This human-computer collaboration model leverages the efficiency and professionalism of the application's intelligent storyboarding, providing users with a high-quality initial storyboard framework, while fully respecting the user's creative autonomy. It allows users to make in-depth adjustments based on their unique ideas and detailed requirements, avoiding the rigidity or incompatibility issues that can result from relying entirely on machine generation. This approach effectively bridges the gap between machine intelligence and human creativity, making the storyboard design process more efficient, transparent, and creative, ultimately helping users generate multi-shot video works that better meet their expectations and possess a high level of professionalism.

[0071] In one exemplary embodiment, the display of the storyboard information sequence includes: displaying a sequence of regions formed by displaying storyboard information display areas; and displaying corresponding storyboard information in any of the storyboard information display areas in the sequence of regions, wherein the storyboard information includes storyboard text prompts, storyboard duration, and storyboard sequence number.

[0072] The sequence of storyboard information can be displayed in a sequence of areas formed by the storyboard information display area. Each storyboard information display area displays one storyboard information in the storyboard information sequence. The storyboard information contains at least three core elements: storyboard text prompt, which describes the content or shooting requirements of the storyboard; storyboard duration, which is the length of time the storyboard lasts in the final video; and storyboard number, which indicates the position and order of the storyboard information in the entire storyboard information sequence.

[0073] This method of displaying storyboard information achieves a visual and structured presentation. Users can intuitively see the specific content, duration, and sequence of each storyboard, greatly reducing the difficulty for users to understand and grasp the overall video structure, making the originally abstract concept of storyboards concrete and tangible. Users can quickly locate the storyboards that need adjustment (through storyboard numbers and display areas) and make targeted modifications based on the displayed storyboard text prompts and duration information, such as adjusting the description of a storyboard, changing its duration, or adjusting its position in the sequence, thereby improving the accuracy and efficiency of editing. Furthermore, a unified standard for displaying storyboard information (including storyboard text prompts, storyboard duration, and sequence storyboard number) helps establish a standardized creative process and improves creative efficiency. Moreover, this display method allows the application to directly and systematically retrieve materials, control duration, and combine them in sequence based on the storyboard text prompts, storyboard duration, and storyboard number defined in the storyboard information display area, ensuring that the generated video is highly consistent with the user-designed storyboard information sequence, thus guaranteeing the accuracy and reliability of video generation.

[0074] exist Figure 4 In (a), the target page 410 also includes a second scene control control 440. When the first scene control control 420 is in the open state, if the second scene control control 440 is triggered, it can display... Figure 4 (b). Figure 4 (b) shows a sequence of areas, which includes multiple storyboard information display areas 450. Each storyboard information display area 450 displays the corresponding storyboard information, which includes storyboard text prompts 460, storyboard duration 470 and storyboard number 480.

[0075] In one exemplary embodiment, when the first storyboard control control is in the enabled state, if the second storyboard control control is triggered, displaying the storyboard information sequence includes: updating the storyboard information sequence when the text prompt information in the content interaction area is updated, wherein updating the storyboard information sequence includes at least one operation of adding storyboard information, deleting storyboard information, and changing storyboard information.

[0076] When the first scene control is active and the user triggers the second scene control to display the scene information sequence, if the user updates the text prompts in the content interaction area, the application will also update the currently displayed scene information sequence accordingly. This update can be manifested in at least one of three operations: adding scene information (e.g., the user adds a new scene description in the content interaction area, which can generate new scene information and display it in the scene information sequence); deleting scene information (e.g., the user deletes some descriptions in the content interaction area, and the application may identify and remove the corresponding scene information); and modifying scene information (e.g., the user modifies the description or duration of a scene in the content interaction area, and the application can correspondingly modify the scene text prompt 460, scene duration 470, etc. in the scene information sequence; or, for example, the user can directly edit the scene text prompt 460 or scene duration 470 independently).

[0077] This implementation achieves dynamic linkage and synchronous updates between text prompts and storyboard information sequences, ensuring real-time consistency between them in the content interaction area. Users do not need to manually modify the storyboard information sequence; when the original creative idea (text prompts) changes, the storyboard information sequence adjusts accordingly, reducing user steps. Users can directly modify the macro-level text prompts in the content interaction area, and the application reflects these modifications in the specific storyboard information sequence. This allows users to understand in real-time how their creative requirements affect the storyboard after intelligent storyboarding, facilitating timely adjustments and ensuring the storyboard results meet their expectations. Users can more intuitively see the specific impact of text prompt modifications on the storyboard structure, thus better grasping the overall direction of the video.

[0078] In one exemplary embodiment, the method further includes editing storyboard information, wherein editing the storyboard information includes at least one of the following operations: Upon receiving a drag operation on any storyboard information display area, the position of the dragged storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving a deletion operation for any storyboard information display area, the display of the deleted storyboard information display area is canceled, the position of the relevant storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving an editing operation on any storyboard information display area, the editing result of the content editing operation is displayed. The content editing operation includes editing at least one of the storyboard text prompts and the storyboard duration.

[0079] by Figure 4 (b) For example, if a user long-presses a storyboard information display area 450 and drags it forward, the storyboard information display area 450 will move in the area sequence as the user drags it. When the user drags it to the target position (e.g., from the third position to the first position) and releases it, the storyboard information display area 450 will be fixed in the new position. At the same time, related storyboard information display areas in the area sequence will move backward or forward to fill the empty space, and the storyboard numbers of the related storyboard information will be renumbered consecutively according to the new arrangement. This drag-and-drop operation allows users to flexibly adjust the storyboard order according to the video narrative logic or creative focus, quickly optimize the video rhythm and narrative structure, enhance the flexibility of the storyboard information sequence organization, and improve the user's control over the creative process.

[0080] If the user is Figure 4 In (b), a deletion operation is performed on a specific storyboard information display area 450. For example, by clicking the preset delete icon within the area or by long-pressing and selecting the delete option, the selected storyboard information display area 450 will disappear from the area sequence. At this time, all storyboard information display areas after this area 450 will automatically move forward to eliminate the gap, and the storyboard numbers of the remaining storyboard information will be rearranged consecutively. This operation allows users to easily remove unnecessary storyboards, simplifies the process of streamlining the storyboard sequence, avoids redundant storyboard information interfering with the overall creation, and automatically adjusts the numbers to ensure the logic and orderliness of the storyboard sequence.

[0081] When a user needs to modify specific content within the storyboard information display area 450, such as clicking on the storyboard text prompt 460, they can edit the storyboard text prompt. Similarly, clicking on the storyboard duration 470 may bring up a time selector or directly allow the user to input a number. After the user modifies the storyboard duration value, the storyboard duration 470 will also update accordingly. This direct editing of the specific content of the storyboard information allows users to precisely adjust the details of each storyboard without having to return to the content interaction area for indirect modifications. This improves the efficiency and accuracy of storyboard information editing, ensuring that the storyboard information accurately reflects the user's creative intent.

[0082] These editing operations together constitute a complete storyboard information interaction mechanism. Through intuitive dragging, deleting, and content editing, users can finely adjust and optimize the sequence of storyboard information, significantly improving the user experience and work efficiency of video storyboard creation.

[0083] In one exemplary embodiment, the step of displaying the storyboard information sequence includes: if the text prompt information is empty, displaying a sequence of regions formed by at least two storyboard information display areas, wherein the storyboard content in the storyboard information in the storyboard information display areas is empty, and the storyboard content includes storyboard text prompts and storyboard duration; when any of the storyboard information display areas is triggered, receiving an editing operation on the corresponding storyboard information; and when the video generation control is triggered, displaying a video generation result, the video generation result being consistent with the storyboard information sequence, including: when the video generation control is triggered, if the text prompt information is empty, but there are at least two storyboard information with non-empty storyboard content, displaying the video generation result, the video generation result including shots generated based on the at least two storyboard information with non-empty storyboard content.

[0084] In this implementation, even when the text prompts are empty, if the user triggers the second storyboard control while the first storyboard control is active, the application can still display a sequence of storyboard information through a display area sequence. However, the storyboard content within this sequence will be empty (both the storyboard text prompts and the storyboard duration are empty). Users can edit the storyboard information to add the text prompts and duration, resulting in storyboard information with non-empty content. The application then generates a video containing multiple shots based on this non-empty storyboard information. This implementation breaks the absolute dependence on initial text prompts by providing at least two storyboard information display areas corresponding to empty storyboard content. Users do not need to pre-conceive a complete text description but can directly edit within the storyboard information display area, building storyboard content from scratch or gradually. This lowers the barrier to entry and enhances the intuitiveness of operation for users who are not skilled at or unwilling to use complex descriptions via text prompts.

[0085] In one exemplary embodiment, the method further includes: displaying a main material recommendation area on the target page, the main material recommendation area including multiple main materials; and displaying the triggered main material as media material in the content interaction area when any of the main materials is triggered.

[0086] The main materials disclosed herein refer to various editable media objects that constitute the core elements of video content during the video generation process. Specifically, these can include character images (such as preset virtual scenes, user-uploaded character photos or video clips), animal images, still life objects (such as furniture, tools, and merchandise), scene elements (such as indoor scenes, outdoor scenery, and specific backgrounds), icons and symbols, and even abstract graphic elements. These main materials are the basic building blocks of video narrative, and users can construct the specific content and visuals of the video by selecting, adding, and editing these materials.

[0087] This disclosure does not limit the method of adding the main material to the content interaction area. For example, when a user clicks on a main material in the main material recommendation area, the main material will be automatically added to the content interaction area. Or, for example, a user can long-press on a main material, drag it to any position in the content interaction area, and then release it. At this time, the main material will be displayed as a media material in the content interaction area.

[0088] Please refer to Figure 5 This illustration shows another schematic diagram of a target page in an exemplary embodiment of the present disclosure. The target page includes a main material recommendation area 510 and a content interaction area 520. The main material recommendation area 510 can display multiple main materials 530, and any main material 530 can be dragged into the content interaction area 520 as media material.

[0089] This implementation significantly improves user convenience and content creation efficiency during video creation by displaying a main material recommendation area and supporting the triggering and addition of main materials to the content interaction area. The main material recommendation area provides users with a rich selection of main materials, avoiding the tedious process of searching for or creating basic theme materials from scratch, lowering the creative threshold. Especially for non-professional users, it allows for quick access to theme materials such as characters, scenes, and items that meet the needs of video narrative, shortening the pre-production preparation time for video content construction. By directly displaying triggered main materials as media materials in the main material recommendation area, the addition of main materials is made intuitive and instantaneous. Users can select main materials without going through complex menu paths or import processes, simplifying the operation steps and improving the smoothness of interaction.

[0090] This disclosure does not limit the main materials displayed in the main material recommendation area. In an exemplary embodiment, the main material recommendation area includes: displaying at least two target main materials in the main material recommendation area, wherein the creation time, usage time, or usage frequency of the target main materials meets preset requirements.

[0091] This disclosure does not limit the preset requirements. For example, it is defined as: the filtering conditions set by the application based on the user's historical operation behavior data (such as the creation record, usage record and usage frequency statistics of the material), which are used to select the main material with timeliness, frequent use or user preference characteristics from the material library. For example, the preset requirements can be specifically set as "created within the last 30 days, or used within the last 15 days, or ranked in the top 20% in terms of usage frequency".

[0092] Clearly, the target main material is the main material that users have recently paid attention to, created recently, or used frequently. This type of material has a high probability of being selected by users. By displaying this type of material, we can match users' creative habits, reduce the difficulty of selection for users, and improve users' creative efficiency.

[0093] In one exemplary embodiment, the main material recommendation area includes: displaying at least one material type recommendation control in the main material recommendation area; and when any of the material type recommendation controls is triggered, displaying at least two main materials corresponding to the corresponding material type in the main material recommendation area.

[0094] This disclosure allows for the categorization of main content materials, and then displays a corresponding material type recommendation control for each category. If a material type recommendation control is triggered, multiple main content materials belonging to that category can be displayed. This disclosure does not limit the categorization results; please refer to [reference needed]. Figure 6 This illustrates a schematic diagram of the main material recommendation area in an exemplary embodiment of this disclosure. Figure 6 In (a), the main material recommendation area includes three material type recommendation controls 610, which are labeled with the text information "Character", "Props", and "Scene". From the outside, the main material recommendation area also includes multiple target main materials 620, with the three material type recommendation controls 610 and the multiple target main materials 620 arranged in a row.

[0095] If the user clicks on the material type recommendation control 610 corresponding to "Character", then it can be referenced. Figure 6 (b) This displays multiple main assets 630 belonging to the "Character" category. Due to limited display space, the display of several target main assets 620 can be cancelled. If the user clicks on the asset type recommendation control 610 corresponding to "Props", then... Figure 6 (c) It displays multiple main materials 640 belonging to the "props" category. Due to limited display space, the main materials corresponding to the "characters" can be hidden.

[0096] In this implementation, users can quickly focus on the specific subject matter they need, and then trigger the corresponding subject matter recommendation control to view multiple subject matter materials under that type. Based on this, they can quickly select materials, improving the accuracy and efficiency of material search. Furthermore, the categorized display makes the layout of the subject matter recommendation area more orderly, the information presentation more systematic, optimizes the user's visual experience, reduces the user's cognitive load, and ultimately helps users complete creative tasks more efficiently.

[0097] Figure 7 This is a block diagram illustrating a page interaction device according to an exemplary embodiment. (Refer to...) Figure 7 The device includes: The display module 710 is configured to display an interactive content area and a video generation control on a target page. The interactive content area is used to receive and display at least one type of media material, which includes text prompt information and is used to describe the video to be generated. The interaction module 720 is configured to display a video generation result when the video generation control is triggered. The video generation result matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompt information.

[0098] In one exemplary implementation, the interaction module 720 is configured to perform: On the target page, a first storyboard control control is displayed, which is used to instruct the generation of at least two storyboards based on the text prompt information; When the first storyboard control control is enabled and the video generation control is triggered, the video generation result is displayed.

[0099] In one exemplary implementation, the interaction module 720 is configured to perform: On the target page, a second storyboard control control is displayed, which is used to indicate the storyboard editing process; When the first storyboard control control is enabled, if the second storyboard control control is triggered, a storyboard information sequence is displayed, which includes at least two storyboard information that match the text prompt information. When the video generation control is triggered, the video generation result is displayed, and the video generation result matches the storyboard information sequence.

[0100] In one exemplary implementation, the interaction module 720 is configured to perform: When the text prompt information in the content interaction area is updated, the storyboard information sequence is updated, wherein updating the storyboard information sequence includes at least one operation of adding storyboard information, deleting storyboard information, and changing storyboard information.

[0101] In one exemplary implementation, the interaction module 720 is configured to perform: Display the sequence of regions formed by the storyboard information display area; In any of the storyboard information display areas of the region sequence, the corresponding storyboard information is displayed, which includes storyboard text prompts, storyboard duration, and storyboard sequence number.

[0102] In one exemplary implementation, the interaction module 720 is configured to perform: Editing the storyboard information includes at least one of the following operations: Upon receiving a drag operation on any storyboard information display area, the position of the dragged storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving a deletion operation for any storyboard information display area, the display of the deleted storyboard information display area is canceled, the position of the relevant storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving an editing operation on any storyboard information display area, the editing result of the content editing operation is displayed. The content editing operation includes editing at least one of the storyboard text prompts and the storyboard duration.

[0103] In one exemplary implementation, the interaction module 720 is configured to perform: If the text prompt is empty, display a sequence of regions formed by at least two storyboard information display areas, wherein the storyboard content in the storyboard information in the storyboard information display area is empty, and the storyboard content includes storyboard text prompts and storyboard duration; When any of the storyboard information display areas is triggered, an editing operation on the corresponding storyboard information is received; When the video generation control is triggered, if the text prompt is empty, but there are at least two storyboards with non-empty content, the video generation result is displayed. The video generation result includes shots generated based on the at least two storyboards with non-empty content.

[0104] In one exemplary implementation, the interaction module 720 is configured to perform: On the target page, a main material recommendation area is displayed, which includes multiple main materials. When any of the aforementioned main materials is triggered, the triggered main material will be displayed as media material in the content interaction area.

[0105] In one exemplary implementation, the interaction module 720 is configured to perform: In the main material recommendation area, at least two target main materials are displayed, and the creation time, usage time, or usage frequency of the target main materials meet preset requirements.

[0106] In one exemplary implementation, the interaction module 720 is configured to perform: In the main material recommendation area, at least one material type recommendation control is displayed; When any of the aforementioned material type recommendation controls is triggered, at least two main materials corresponding to the material type are displayed in the main material recommendation area.

[0107] Regarding the pilot device in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0108] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided. Optionally, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc. When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is able to perform any of the methods described above.

[0109] In an exemplary embodiment, a computer program product is also provided, the computer program product including a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from the readable storage medium and executes the computer program, causing the device to perform any of the methods described above.

[0110] Figure 8 This is a block diagram illustrating an electronic device for page interaction according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as follows: Figure 8As shown, the device may include an RF (Radio Frequency) circuit 810, a memory 820 including one or more computer-readable storage media, an input unit 830, a display unit 840, a sensor 850, an audio circuit 860, a WiFi (Wireless Fidelity) module 870, a processor 880 including one or more processing cores, and a power supply 890, among other components. Those skilled in the art will understand that... Figure 8 The terminal structure shown does not constitute a limitation on the terminal and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The RF circuit 810 can be used for receiving and transmitting signals during information transmission or calls. Specifically, it receives downlink information from the base station and hands it over to one or more processors 880 for processing; additionally, it transmits uplink data to the base station. Typically, the RF circuit 810 includes, but is not limited to, an antenna, at least one amplifier, a tuner, one or more oscillators, a Subscriber Identity Module (SIM) card, a transceiver, a coupler, an LNA (Low Noise Amplifier), a duplexer, etc. Furthermore, the RF circuit 810 can also communicate wirelessly with networks and other terminals. Wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

[0111] The memory 820 can be used to store software programs and modules. The processor 880 executes various functional applications and data processing by running the software programs and modules stored in the memory 820. The memory 820 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for the functions, etc.; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 820 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 820 may also include a memory controller to provide access to the memory 820 for the processor 880 and the input unit 830.

[0112] The input unit 830 can be used to receive input digital or character information, and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control. Specifically, the input unit 830 may include a touch-sensitive surface 831 and other input devices 832. The touch-sensitive surface 831, also known as a touch display screen or touchpad, can collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch-sensitive surface 831), and drive the corresponding connected devices according to a pre-set program. Optionally, the touch-sensitive surface 831 may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch position and the signal generated by the touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 880, and can also receive and execute commands sent by the processor 880. In addition, the touch-sensitive surface 831 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 831, the input unit 830 may also include other input devices 832. Specifically, other input devices 832 may include, but are not limited to, one or more of the following: physical keyboard, function keys (such as volume control buttons, power buttons, etc.), trackball, mouse, joystick, etc. The display unit 840 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the terminal. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. The display unit 840 may include a display panel 841, which may optionally be configured as an LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), or similar display panel 841. Further, a touch-sensitive surface 831 may cover the display panel 841. When the touch-sensitive surface 831 detects a touch operation on or near it, it transmits the information to the processor 880 to determine the type of touch event. Subsequently, the processor 880 provides corresponding visual output on the display panel 841 according to the type of touch event. The touch-sensitive surface 831 and the display panel 841 can be two independent components to implement input and output functions. However, in some embodiments, the touch-sensitive surface 831 and the display panel 841 can be integrated to achieve input and output functions.

[0113] The terminal may also include at least one sensor 850, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 841 according to the ambient light level, and the proximity sensor can turn off the display panel 841 and / or the backlight when the terminal is moved to the ear. As a type of motion sensor, a gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity and can be used for applications that identify the terminal's posture (such as landscape / portrait switching, related games, magnetometer posture calibration), vibration recognition-related functions (such as pedometer, tapping), etc. Other sensors that may be configured on the terminal, such as gyroscopes, barometers, hygrometers, thermometers, and infrared sensors, will not be described in detail here.

[0114] Audio circuitry 860, speaker 861, and microphone 862 provide an audio interface between the user and the terminal. Audio circuitry 860 converts received audio data into electrical signals, which are then transmitted to speaker 861, where they are converted into sound signals for output. Conversely, microphone 862 collects sound signals, converts them into electrical signals, which are then received by audio circuitry 860, converted back into audio data, processed by processor 880, and transmitted via RF circuitry 810 to, for example, another terminal, or output to memory 820 for further processing. Audio circuitry 860 may also include an earphone jack to facilitate communication between a peripheral headset and the terminal.

[0115] WiFi is a short-range wireless transmission technology. This terminal, through the WiFi module 870, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access. Although Figure 8 WiFi module 870 is shown, but it is understood that it is not a necessary component of the terminal and can be omitted as needed without changing the nature of the invention.

[0116] The processor 880 is the control center of the terminal, connecting various parts of the terminal through various interfaces and lines. It executes software programs and / or modules stored in the memory 820, and calls data stored in the memory 820 to perform various functions and process data, thereby enabling overall monitoring of the terminal. Optionally, the processor 880 may include one or more processing cores; preferably, the processor 880 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interaction area, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 880.

[0117] The terminal also includes a power supply 890 (such as a battery) to power various components. Preferably, the power supply can be logically connected to the processor 880 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 890 may also include one or more DC or AC power supplies, a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0118] Although not shown, the terminal may also include a camera, Bluetooth module, etc., which will not be described in detail here. Specifically, in this embodiment, the display unit of the terminal is a touch screen display, and the terminal also includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors of the instructions in the method embodiment of the present invention.

[0119] Please refer to Figure 9 This illustration shows another block diagram of an electronic device for page interaction provided in another exemplary embodiment of this disclosure. The computer device may be a server for performing the page interaction method described above. Specifically: Computer device 900 includes a Central Processing Unit (CPU) 901, a system memory 904 including Random Access Memory (RAM) 902 and Read Only Memory (ROM) 903, and a system bus 905 connecting the system memory 904 and the CPU 901. Computer device 900 also includes a basic input / output system (I / O system) 906 that facilitates information transfer between various devices within the computer, and a mass storage device 907 for storing the operating system 913, application programs 914, and other program modules 911.

[0120] The basic input / output system 906 includes a display 908 for displaying information and an input device 909 for user input, such as a mouse or keyboard. Both the display 908 and the input device 909 are connected to the central processing unit 901 via an input / output controller 190 connected to the system bus 905. The basic input / output system 906 may also include the input / output controller 190 for receiving and processing input from multiple other devices such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 190 also provides output to a display screen, printer, or other types of output devices.

[0121] Mass storage device 907 is connected to central processing unit 901 via a mass storage controller (not shown) connected to system bus 905. Mass storage device 907 and its associated computer-readable media provide non-volatile storage for computer device 900. That is, mass storage device 907 may include computer-readable media (not shown) such as hard disk or CD-ROM (CompactDisc Read-Only Memory) drive.

[0122] Without loss of generality, computer-readable media can include computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented using any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes RAM, ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash memory or other solid-state storage technologies, CD-ROM, DVD (Digital Video Disc) or other optical storage, magnetic tape cassettes, magnetic tape, disk storage, or other magnetic storage devices. Of course, those skilled in the art will recognize that computer storage media are not limited to the above-mentioned types. The system memory 904 and mass storage device 907 described above can be collectively referred to as memory.

[0123] According to various embodiments of this disclosure, the computer device 900 can also be connected to a remote computer on a network, such as the Internet. That is, the computer device 900 can be connected to a network 912 via a network interface unit 911 connected to a system bus 905, or the network interface unit 911 can be used to connect to other types of networks or remote computer systems (not shown).

[0124] The aforementioned memory also includes a computer program stored in the memory and configured to be executed by one or more processors to implement the aforementioned page interaction method.

[0125] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, at least one program, code set, or instruction set is executed by a processor to implement the page interaction method.

[0126] Optionally, the computer-readable storage medium may include: ROM (Read Only Memory), RAM (Random Access Memory), SSD (Solid State Drives), or optical disc, etc. The random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0127] In an exemplary embodiment, a computer-readable storage medium including program code is also provided, such as a memory including program code, which can be executed by a processor to complete the page interaction method described above. Optionally, the computer-readable storage medium may be read-only memory (ROM), random access memory (RAM), compact-disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.

[0128] In an exemplary embodiment, a computer program product is also provided, including a computer program that, when executed by a processor, implements the page interaction method described above.

[0129] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0130] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A page interaction method, characterized in that, The method includes: The target page displays a content interaction area and a video generation control. The content interaction area is used to receive and display at least one type of media material, which includes text prompt information. The text prompt information is used to describe the video to be generated. When the video generation control is triggered, the video generation result is displayed. The video generation result matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompt information.

2. The page interaction method according to claim 1, characterized in that, The method further includes: On the target page, a first storyboard control control is displayed, which is used to instruct the generation of at least two storyboards based on the text prompt information; When the video generation control is triggered, displaying the video generation result includes: When the first storyboard control control is enabled and the video generation control is triggered, the video generation result is displayed.

3. The page interaction method according to claim 2, characterized in that, The method further includes: On the target page, a second storyboard control control is displayed, which is used to indicate the storyboard editing process; When the first storyboard control control is enabled, if the second storyboard control control is triggered, a storyboard information sequence is displayed, which includes at least two storyboard information that match the text prompt information. The step of displaying the video generation result when the video generation control is triggered includes: displaying the video generation result when the video generation control is triggered, wherein the video generation result is consistent with the storyboard information sequence.

4. The page interaction method according to claim 3, characterized in that, When the first storyboard control control is enabled, if the second storyboard control control is triggered, the storyboard information sequence is displayed, including: When the text prompt information in the content interaction area is updated, the storyboard information sequence is updated, wherein updating the storyboard information sequence includes at least one operation of adding storyboard information, deleting storyboard information, and changing storyboard information.

5. A page interaction method according to claim 3, characterized in that, The sequence of storyboard information shown includes: Display the sequence of regions formed by the storyboard information display area; In any of the storyboard information display areas of the region sequence, the corresponding storyboard information is displayed, which includes storyboard text prompts, storyboard duration, and storyboard sequence number.

6. A page interaction method according to claim 5, characterized in that, The method further includes editing storyboard information, wherein editing storyboard information includes at least one of the following operations: Upon receiving a drag operation on any storyboard information display area, the position of the dragged storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving a deletion operation for any storyboard information display area, the display of the deleted storyboard information display area is canceled, the position of the relevant storyboard information display area in the area sequence is adjusted, and the storyboard number of the relevant storyboard information is adjusted. Upon receiving an editing operation on any storyboard information display area, the editing result of the content editing operation is displayed. The content editing operation includes editing at least one of the storyboard text prompts and the storyboard duration.

7. A page interaction method according to claim 3, characterized in that, The sequence of storyboard information to be displayed includes: If the text prompt is empty, display a sequence of regions formed by at least two storyboard information display areas, wherein the storyboard content in the storyboard information in the storyboard information display area is empty, and the storyboard content includes storyboard text prompts and storyboard duration; When any of the storyboard information display areas is triggered, an editing operation on the corresponding storyboard information is received; When the video generation control is triggered, the video generation result is displayed, and the video generation result matches the storyboard information sequence, including: When the video generation control is triggered, if the text prompt is empty, but there are at least two storyboards with non-empty content, the video generation result is displayed. The video generation result includes shots generated based on the at least two storyboards with non-empty content.

8. The page interaction method according to claim 1, characterized in that, The method further includes: On the target page, a main material recommendation area is displayed, which includes multiple main materials. When any of the aforementioned main materials is triggered, the triggered main material will be displayed as media material in the content interaction area.

9. A page interaction method according to claim 8, characterized in that, The recommended area for displaying main materials includes: In the main material recommendation area, at least two target main materials are displayed, and the creation time, usage time, or usage frequency of the target main materials meet preset requirements.

10. A page interaction method according to claim 9, characterized in that, The recommended area for displaying main materials includes: In the main material recommendation area, at least one material type recommendation control is displayed; When any of the aforementioned material type recommendation controls is triggered, at least two main materials corresponding to the material type are displayed in the main material recommendation area.

11. A page interaction device, characterized in that, The device includes: The display module is configured to display an interactive content area and a video generation control on the target page. The interactive content area is used to receive and display at least one type of media material, which includes text prompts that describe the video to be generated. The interaction module is configured to display a video generation result when the video generation control is triggered. The video generation result matches the media material displayed in the content interaction area and includes at least two shots corresponding to the text prompt information.

12. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the page interaction method as described in any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the page interaction method as described in any one of claims 1 to 10.

14. A computer program product, characterized in that, The computer program product includes a computer program stored in a readable storage medium, wherein at least one processor of a computer device reads from and executes the computer program, causing the device to perform the page interaction method as described in any one of claims 1 to 10.

Images