Storyboard generation method and system

Abstract

An embodiment of the present application provides a storyboard generation method, the method comprising: obtaining a reference image for storyboard drawing; obtaining elements of the reference image and element vector information of the elements; obtaining vector elements that match the elements; and setting the vector elements on a specified canvas based on the element vector information to generate the storyboard. The storyboard generation method provided in an embodiment of the present application identifies elements in a reference image and sets the matching vector elements to a specified canvas to obtain a storyboard in vector format, making the production of storyboards more efficient and easier, and effectively improving the user experience.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of computer technology, and in particular to a storyboard generation method, system, computer device, and computer-readable storage medium. Background Art

[0002] As the barrier to entry for video shooting decreases, more and more users are becoming creators, shooting and creating videos. Shooting long or content-rich videos generally requires creators to plan and plan the content in advance, such as drawing a storyboard to record and organize their ideas. However, for ordinary users without professional filming skills, drawing storyboards is difficult and inefficient, which affects the user experience. Summary of the Invention

[0003] The purpose of the embodiments of the present application is to provide a storyboard script generation method, system, computer device and computer-readable storage medium to solve the following problem: drawing storyboard scripts is difficult and inefficient, affecting user experience.

[0004] One aspect of an embodiment of the present application provides a method for generating a storyboard, the method comprising:

[0005] Obtain reference images for storyboarding;

[0006] Acquiring elements of the reference image and element vector information of the elements;

[0007] Get the vector element that matches the element; and

[0008] According to the element vector information, the vector element is set on a specified canvas to generate the storyboard script.

[0009] Optionally, obtaining a vector element matching the element includes:

[0010] According to the element attribute of the element, the vector element associated with the element attribute is acquired from a vector element material library.

[0011] Optionally, the element vector information includes the size and posture of the element and the relative position of the element in the reference image; and setting the vector element on a designated canvas according to the element vector information to generate the storyboard includes:

[0012] The vector element is placed in the designated canvas according to the size, posture and relative position of the element.

[0013] Optionally, also include:

[0014] identifying scene attributes of the reference image; and

[0015] According to the scene attribute, the designated canvas associated with the scene attribute is acquired from a canvas material library.

[0016] Optionally, the storyboard includes an editable vector graphic; and the method further includes:

[0017] In response to the vectorization modification information, vectorization modification is performed on the storyboard.

[0018] Optionally, the method further includes:

[0019] According to the user preference information, the arrangement of the vector elements in the designated canvas is adjusted to obtain the storyboard script.

[0020] Optionally, the method further includes:

[0021] In response to the user's request, the corresponding storyboard is returned to the user's client according to the user's preference information.

[0022] Optionally, the reference image is a video key frame; and / or the reference image is an image uploaded by a user.

[0023] Optionally, the method further includes:

[0024] If the reference image is an image uploaded by a user, evaluating the quality of the storyboard; and

[0025] If the quality of the storyboard is greater than a preset value, the storyboard is stored in a vectorized script library.

[0026] Optionally, the method further includes:

[0027] Acquiring input information, wherein the input information includes keywords;

[0028] Obtaining a reference storyboard script associated with the keyword from the vectorized script library; and

[0029] In response to the vectorization modification information, the reference storyboard is vectorized modified to generate a storyboard.

[0030] One aspect of an embodiment of the present application further provides a storyboard script generation system, comprising:

[0031] A first acquisition module is used to acquire a reference image for drawing a storyboard script;

[0032] A second acquisition module, configured to acquire elements of the reference image and element vector information of the elements;

[0033] A third acquisition module is used to acquire a vector element matching the element; and

[0034] A generation module is used to set the vector elements on a specified canvas according to the element vector information to generate the storyboard script.

[0035] One aspect of an embodiment of the present application further provides a method for generating a storyboard script, the method comprising:

[0036] Acquiring input information, wherein the input information includes keywords; and

[0037] A reference storyboard script associated with the keyword is obtained from a vectorized script library, wherein the vectorized script library includes a plurality of candidate storyboard scripts, and the plurality of candidate storyboard scripts are generated according to the method according to any one of claims 1 to 9.

[0038] Optionally, the method further includes:

[0039] In response to the vectorization modification information, the reference storyboard is vectorized modified to generate a storyboard.

[0040] One aspect of an embodiment of the present application provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and is characterized in that when the processor executes the computer program, the steps of the storyboard generation method described above are implemented.

[0041] One aspect of an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program can be executed by at least one processor so that the at least one processor implements the steps of the above-mentioned storyboard script generation method when executing the computer program.

[0042] The storyboard generation method, system, device, and computer-readable storage medium provided in the embodiments of the present application identify elements in a reference image and set the matching vector elements to a specified canvas to obtain a storyboard in vector format, thereby making the production of storyboards more efficient and easier and effectively improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1 A diagram schematically illustrates an application environment of a storyboard generation method according to an embodiment of the present application;

[0044] Figure 2 The flowchart of the storyboard generation method according to the first embodiment of the present application is schematically shown;

[0045] Figure 3 for Figure 2 Flowchart of sub-steps of step S204;

[0046] Figure 4 for Figure 2 Flowchart of sub-steps of step S206;

[0047] Figures 5 to 9 A flowchart schematically illustrates the newly added steps of the storyboard generation method according to the first embodiment of the present application;

[0048] Figure 10 The drawing process of the storyboard script according to the first embodiment is schematically shown;

[0049] Figure 11 The flowchart of the storyboard generation method according to the second embodiment of the present application is schematically shown;

[0050] Figure 12 The drawing process of the storyboard script according to the second embodiment is schematically shown;

[0051] Figure 13 Schematically shows a block diagram of a storyboard script generation system according to the third embodiment of the present application;

[0052] Figure 14 A block diagram schematically shows a storyboard script generation system according to a fourth embodiment of the present application; and

[0053] Figure 15 The following schematically shows a hardware architecture diagram of a computer device suitable for implementing the storyboard script generation method according to the fifth embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solutions and advantages of this application more clear, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0055] It should be noted that the descriptions of "first", "second", etc. in the embodiments of the present application are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0056] In order to shoot a longer or more content-rich video, it is generally necessary to draw a storyboard script. The advantages are as follows: on the one hand, during the shooting process, the storyboard script can better grasp the content of the preliminary planning; on the other hand, with the development of multi-person assisted video creation, when script drawing, video shooting, and video editing require multiple people, a clear storyboard script is an important guarantee for smooth collaboration and completion of high-quality video shooting.

[0057] Storyboarding is currently primarily used by professional film and television teams with dedicated artists. Due to limitations such as the art barrier to entry and film and television creative foundations, ordinary creators are often reluctant to engage in storyboarding for their content, as the effort and barriers to entry for high-quality storyboards are too high. However, during the filming process, especially for longer or more content-rich videos, the final result often deviates significantly from the initial pre-conceived ideas. This is primarily due to the inability to accurately replicate the pre-planned video creation during filming. Therefore, the better the video, the higher the barrier to entry.

[0058] In view of this, this application aims to propose a storyboard generation solution based on a video analysis framework. It uses intelligent means to initialize storyboards for users and vectorize the script content, thereby reducing the user's usage difficulty and improving the storyboard drawing experience, thereby improving the efficiency of video creation and assisting in shooting high-quality videos. For example:

[0059] Through artificial intelligence, various contents in the image (such as objects, scenes, and characters) are detected, and relevant information (such as position, size, and posture) is vectorized, and editable vector graphics and canvases are generated. On the one hand, based on the scene and information entered by the user, the vector graphics that best matches the user's needs can be searched in the storyboard script library and provided to the user as an initialization storyboard script. The user can modify the vectorized content or add additional vectorized elements. On the other hand, users can be supported to upload real images, analyze their content, and search the script library for similar elements that appear in the real image, and generate personalized vector graphics that match the image content online. This solution can effectively lower the threshold for users to use storyboard scripts, making it more convenient and quick to draw manuscripts, thereby helping them better carry out the preliminary planning and story creation of video creation.

[0060] This application provides multiple embodiments to further introduce the storyboard script generation solution, please refer to the following for details.

[0061] In the description of this application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed. They are only used to facilitate the description of this application and to distinguish each step. Therefore, they cannot be understood as limitations on this application.

[0062] The following is an explanation of the terms used in this application:

[0063] A storyboard script, used for film, animation, television series, commercials, music videos, and other visual media, is a graphic illustration of the image's composition before actual filming. It breaks down the sequence into individual shots, annotating the shot movement, duration, dialogue, and special effects. This method provides a concise record of the filming content before filming begins, serving as a reminder for each shot during filming.

[0064] Figure 1 The following schematically shows an environmental application diagram according to an embodiment of the present application. Figure 1 As shown:

[0065] The computer device 10000 can be connected to the client 30000 through the network 20000.

[0066] The computer device 10000 can provide services, such as generating storyboards, or returning storyboards to the client 30000, etc.

[0067] Computer device 10000 may be located in a data center, such as a single location, or distributed across different geographical locations (e.g., across multiple locations). Computer device 10000 may provide services via one or more networks 20000. Network 20000 includes various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or the like. Network 20000 may include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, and the like. Network 20000 may include wireless links, such as cellular links, satellite links, Wi-Fi links, and the like.

[0068] Computer device 10000 can be implemented by one or more computing nodes. One or more computing nodes can include virtualized computing instances. Virtualized computing instances can include virtual machines, such as simulations of computer systems, operating systems, servers, etc. The computing nodes can load virtual machines based on virtual images and / or other data that defines specific software (e.g., operating systems, specialized applications, servers) for simulation. As the demand for different types of processing services changes, different virtual machines can be loaded and / or terminated on one or more computing nodes. A hypervisor can be implemented to manage the use of different virtual machines on the same computing node.

[0069] The client 30000 can be configured to access content and services of the computer device 10000. The client 30000 can include any type of electronic device, such as a mobile device, a tablet device, a laptop computer, a workstation, a virtual reality device, a gaming device, a set-top box, a digital streaming device, a vehicle terminal, a smart TV, a set-top box, etc.

[0070] The client 30000 may output (eg, display, render, present) storyboards and the like to the user.

[0071] The following describes a storyboard script generation solution through multiple embodiments. The solution can be implemented by a computer device 10000.

[0072] Example 1

[0073] Figure 2 The flowchart of the storyboard generation method according to the first embodiment of the present application is schematically shown.

[0074] like Figure 2 As shown, the storyboard generation method may include steps S200 to S206, wherein:

[0075] Step S200: Obtain a reference image for storyboard drawing.

[0076] The reference image may be a video key frame, an image uploaded by a user, or other images.

[0077] The video key frames may be wonderful video scenes from some excellent film or television works.

[0078] In this embodiment, whether a picture is a video key frame can be determined based on the number of barrages in the video key frame, through artificial intelligence (such as a trained neural network model), or through other methods.

[0079] Step S202: Acquire elements of the reference image and element vector information of the elements.

[0080] The elements may include characters, objects, and the like.

[0081] The element vector information includes the size and posture of the element and the relative position of the element in the reference image.

[0082] As an example, elements or their postures in the reference image can be recognized by artificial intelligence, such as:

[0083] (1) The person in the reference image can be detected, such as based on a trained joint head and body person recognition model;

[0084] (2) It can detect the posture of the human body, such as based on a trained distribution-aware coordinate representation model for human posture estimation;

[0085] (3) a convolutional network that can detect objects in the reference image, such as high-quality object detection and instance segmentation;

[0086] The above lists several elements such as people and objects. It should be noted that people can be further subdivided and identified, such as children and the elderly, and objects can also be further subdivided and identified, such as poplars, willows, carriages, cows, etc.

[0087] Step S204: Acquire a vector element that matches the element.

[0088] The vector elements may be matched based on relevant information of the elements, such as element attributes.

[0089] As an example, Figure 3 As shown, step S204 may include step S300: obtaining, from a vector element library, the vector element associated with the element attribute based on the element attribute. In this embodiment, matching vector elements can be efficiently found based on the element attribute. The element attribute may include an element category, etc. The vector element library is used to store and manage a large number of vector elements for use.

[0090] Step S206: Setting the vector elements on a designated canvas according to the element vector information to generate the storyboard script.

[0091] The vector elements are set on a specified canvas to obtain a vector image, which is the storyboard script.

[0092] The storyboard script generation method provided in the first embodiment of the present application has the following advantages:

[0093] By identifying elements in the reference image and setting the matching vector elements to the specified canvas, a storyboard script in vector format is obtained, making storyboard production more efficient and easy, effectively improving the user experience.

[0094] When the reference image is a video key frame, a corresponding storyboard script can be generated based on the composition of excellent film and television works.

[0095] When the reference image is an image uploaded by a user, a corresponding storyboard script can be efficiently generated based on the user's own ideas.

[0096] Several optional embodiments are provided below to optimize the storyboard script generation method, specifically as follows:

[0097] As an example, the element vector information includes the size, posture and relative position of the element in the reference image; Figure 4 As shown, step S206 may include step S400: placing the vector element in the designated canvas based on the size, posture, and relative position of the element. For example, the size of the vector element in the designated canvas is determined based on the size of the element; the posture of the vector element in the designated canvas is determined based on the posture of the element; and the relative position of the vector element in the designated canvas is determined based on the relative position of the element in the reference image. In this embodiment, the elements in the reference image can be efficiently and accurately mapped to the designated canvas.

[0098] As an example, Figure 5 As shown, the storyboard generation method may further include steps S500 to S502, wherein: step S500 identifies the scene attributes of the reference image; and step S502 retrieves the designated canvas associated with the scene attributes from a canvas library based on the scene attributes. The scene attributes may include scene categories, etc. The canvas library is used to store and manage a large number of canvases for use. In this embodiment, the scenes in the reference image can be efficiently arranged and mapped into the storyboard.

[0099] As an example, the storyboard includes editable vector graphics. Figure 6 As shown, the storyboard generation method may further include step S600: performing vectorized modification on the storyboard in response to the vectorized modification information; the vectorized modification may include at least one of the following: modifying the size of the vector element, modifying the posture of the vector element, modifying the relative position of the vector element in the specified canvas, deleting the vector element, or adding a new vector element. This embodiment allows the user to draw the storyboard in a personalized manner.

[0100] As an example, Figure 7 As shown, the storyboard generation method may further include step S700: automatically adjusting the arrangement of the vector elements in the designated canvas according to the user preference information to obtain the storyboard. In this embodiment, by analyzing the user's personalized drawing habits and user portrait, etc., a storyboard that conforms to the user's drawing habits can be generated more accurately, further improving the efficiency of script creation and user stickiness. It should be noted that the user preference information may include preference information obtained according to the user portrait. According to the user preference information, such as the user's camera movement preference, the position, size, etc. of the vector elements are automatically adjusted.

[0101] As an example, Figure 8As shown, the storyboard generation method may further include step S800: in response to a user request, returning a corresponding storyboard to the user's client based on the user's preference information. In this embodiment, by analyzing the user's personalized drawing habits and user profile, a storyboard that conforms to the user's drawing habits can be more accurately pushed, thereby further improving script creation efficiency and user stickiness.

[0102] For example, we analyze the user's drawing habits to identify the scenes, number of characters, poses, and positions they tend to create. After understanding the user's creative habits and content, we recommend storyboards for similar scenes and people or objects. For example, when filming a car review, the recommended storyboards may include storyboards for other cars, allowing users to easily understand how to complete the vehicle and provide coherent video content.

[0103] As an example, Figure 9 As shown, the storyboard generation method may further include steps S900 to S902, wherein, in step S900, if the reference image is an image uploaded by the user, the quality of the storyboard is evaluated; and in step S902, if the quality of the storyboard exceeds a preset value, the storyboard is stored in a vectorized script library. By screening excellent storyboards, the vectorized script library can be expanded and its reusability can be improved.

[0104] For excellent scripts, the quality can be assessed by measuring the similarity between the storyboard and the scripts of professional film and television productions in the cold start library. The higher the similarity, the higher the script quality.

[0105] As an example, the storyboard generation method may further include the following steps: obtaining input information, the input information including keywords; obtaining a reference storyboard associated with the keywords from the vectorized script library; and, in response to vectorized modification information, performing vectorized modification on the reference storyboard to generate a storyboard. In this embodiment, by using user-entered input information such as keywords and using a matching storyboard as a reference storyboard, vectorized modifications are performed based on the reference storyboard, making storyboard creation more efficient and easier, effectively improving the user experience.

[0106] For ease of understanding, the following Figure 10 Here is an example of how to do it:

[0107] S1000: Acquire a reference image, such as a video key frame or an image uploaded by a user;

[0108] S1002: performing object detection to identify objects (ie, elements);

[0109] S1004: performing person detection to identify people (ie, elements);

[0110] S1006: Perform scene detection to identify the scene;

[0111] S1008: Obtaining vector information such as the category, position, and size of each element;

[0112] S1010: Obtaining the scene category of the scene;

[0113] S1012: acquiring, according to the element type of each element, vector elements that match each element one by one from a vector element material library;

[0114] S1014: Acquire a designated canvas matching the scene from a canvas material library according to the scene category;

[0115] S1016: Based on the vector information of each element, such as the position and size, the vector elements that match each element are drawn into the designated canvas to generate an editable storyboard including multiple vector elements.

[0116] Drawing process: Figure 10 The drawing process of the storyboard script is shown. In this process, the content of the video keyframe (such as elements, element vector information) can be identified and estimated by an artificial intelligence algorithm. In this process, objects, characters, scenes, etc. can be identified, and the vectorized information of objects, characters, etc. can be estimated, such as relative position, size, posture, etc. Based on the above information, the following operations can be performed: based on the category of each element, matching vector elements (for example, vector elements of the same category) are searched from the vector element material library; based on the category of the scene, a matching canvas (for example, a canvas of an office background) is searched from the canvas material library, and the canvas is used as the designated canvas for the storyboard script; then, based on the vectorized information of each element, each vector element is automatically arranged accordingly on the designated canvas to generate a storyboard script. It should be noted that multiple storyboards can constitute the instruction content for indicating the entire video production.

[0117] Interact and iterate with the user:

[0118] (1) Users can create videos based on the storyboard script generated based on excellent video key frames provided by the cold start, and can also make vector modifications to the storyboard script on this basis, such as modifying the position and size of vector elements, adding and deleting vector elements, in this way to assist users in drawing personalized storyboard scripts. Users can also upload their own storyboard scripts, and the computer device 10000 will screen excellent storyboard scripts based on the received storyboard scripts to expand the vectorized script library. On the one hand, users can obtain more storyboard scripts in a better way, and on the other hand, after analyzing the user's personalized drawing habits, users can be recommended storyboard scripts that meet their drawing habits, further improving the efficiency of storyboard script production and user stickiness.

[0119] It should be noted that vectorized modifications to storyboards can be made through operations such as selection, dragging, or modification.

[0120] (2) Users can upload images that they personally believe better match their needs. The computer device 10000 can perform online analysis on the images uploaded by the user, and based on the analysis results, match vector elements in the vector element library and the canvas that meets the scene recognition results to generate a personalized storyboard for the user to use directly.

[0121] Example 2

[0122] This embodiment provides another method for generating storyboard scripts, and its technical details and effects can be found above.

[0123] Figure 11 The flowchart of the storyboard generation method according to the second embodiment of the present application is schematically shown.

[0124] like Figure 11 As shown, the storyboard generation method may include steps S1100 to S1104, wherein:

[0125] Step S1100: obtaining input information, wherein the input information includes keywords.

[0126] Step S1102: Obtain a reference storyboard script associated with the keyword from a vectorized script library.

[0127] The vectorized script library includes multiple candidate storyboards, and the multiple candidate storyboards are generated by the method described in Example 1.

[0128] Optionally, in step S1104, in response to the vectorization modification information, the reference storyboard is vectorized modified to generate a storyboard.

[0129] The storyboard generation method provided in the second embodiment of the present application includes the following advantages: input information such as keywords entered by the user, and using the matched storyboard as a reference storyboard, and performing vectorized modification based on the reference storyboard, making the production of storyboards more efficient and easy, and effectively improving the user experience.

[0130] The input information may include the entire storyboard, related content, etc.

[0131] As an example, the computer device 10000 can search for the most matching reference storyboard for the user based on similar tags, etc. The user can directly use the reference storyboard or adjust the content to meet the shooting content.

[0132] For example, the vectorized asset library pre-stores themes and content for each script. Users simply enter keywords and provide information about the desired subject and content to find similarly tagged content or scripts in the vectorized asset library. For example, using the keywords "home," "photography," "lipstick," and "review" will retrieve a home environment canvas and related scripts featuring lipstick and a review.

[0133] For ease of understanding, the following Figure 12 Here is an example of how to do it:

[0134] S1200: The user inputs the subject matter of the required script.

[0135] S1202, searching the vectorized deconstruction script library according to the subject matter.

[0136] The vectorized deconstruction script library is a complete story creation script. Each script contains multiple vectorized deconstructed images. For example, for a cosmetics review shoot, you might include multiple vectorized deconstructed images: a half-length deconstructed image of the host's explanation, a close-up of the host's mouth, a close-up of the cosmetics, and so on. The script includes multiple deconstructed images arranged in chronological order.

[0137] S1204: The user uploads a real image, wherein a corresponding vectorized deconstructed image can also be generated based on the real image.

[0138] S1206: Based on S1202 or S1204, a vectorized deconstructed image is obtained.

[0139] The vectorized deconstructed image may include vector elements, size, and position (the above information may be described by coordinates, number of pixels, object labels, etc.) The user can roughly reconstruct the image based on the vectorized deconstructed image.

[0140] S1208: The user modifies, adds, or deletes the vectorized elements in the vectorized deconstructed image.

[0141] S1210, based on S1208, obtain the final vectorized deconstructed image, that is, the storyboard.

[0142] S1212, the storyboard script obtained based on S1208 can be saved in the vectorized material library.

[0143] Example 3

[0144] Figure 13 A block diagram of a storyboard generation system according to Embodiment 3 of the present application is schematically shown. The storyboard generation system can be divided into one or more program modules, one or more of which are stored in a storage medium and executed by one or more processors to implement the embodiment of the present application. The program modules referred to in the embodiments of the present application are a series of computer program instruction segments that can perform specific functions. The following description will specifically introduce the functions of each program module in the embodiments of the present application.

[0145] like Figure 13 As shown, the storyboard generation system 1300 may include a first acquisition module 1310, a second acquisition module 1320, a third acquisition module 1330, and a generation module 1340, wherein:

[0146] A first acquisition module 1310 is used to acquire a reference image for storyboard drawing;

[0147] A second acquisition module 1320 is configured to acquire elements of the reference image and element vector information of the elements;

[0148] A third acquisition module 1330 is configured to acquire a vector element matching the element; and

[0149] The generating module 1340 is used to set the vector elements on a designated canvas according to the element vector information to generate the storyboard script.

[0150] As an example, the second obtaining module 1320 is further configured to:

[0151] According to the element attribute of the element, the vector element associated with the element attribute is acquired from a vector element material library.

[0152] As an example, the element vector information includes the size and posture of the element and the relative position of the element in the reference image; the generating module 1340 is further configured to:

[0153] The vector element is placed in the designated canvas according to the size, posture and relative position of the element.

[0154] As an example, the storyboard script generation system 1300 may further include a fourth acquisition module for:

[0155] identifying scene attributes of the reference image; and

[0156] According to the scene attribute, the designated canvas associated with the scene attribute is acquired from a canvas material library.

[0157] As an example, the storyboard includes an editable vector image; the storyboard generation system 1300 may further include a modification module for:

[0158] In response to the vectorization modification information, vectorization modification is performed on the storyboard.

[0159] As an example, the storyboard generation system 1300 may further include an adjustment module for:

[0160] According to the user preference information, the arrangement of the vector elements in the designated canvas is adjusted to obtain the storyboard script.

[0161] As an example, the storyboard generation system 1300 may further include a return module for:

[0162] In response to the user's request, the corresponding storyboard is returned to the user's client according to the user's preference information.

[0163] As an example, the reference image is a video key frame; or the reference image is an image uploaded by a user.

[0164] As an example, the storyboard generation system 1300 may further include a storage module for:

[0165] If the reference image is an image uploaded by a user, evaluating the quality of the storyboard; and

[0166] If the quality of the storyboard is greater than a preset value, the storyboard is stored in a vectorized script library.

[0167] As an example, the generating module 1340 is further configured to:

[0168] Acquiring input information, wherein the input information includes keywords;

[0169] Obtaining a reference storyboard script associated with the keyword from the vectorized script library; and

[0170] In response to the vectorization modification information, the reference storyboard is vectorized modified to generate a storyboard.

[0171] Example 4

[0172] Figure 14 A block diagram of a storyboard generation system according to a fourth embodiment of the present application is schematically shown. The storyboard generation system can be divided into one or more program modules, one or more of which are stored in a storage medium and executed by one or more processors to implement the embodiment of the present application. The program modules referred to in the embodiments of the present application are a series of computer program instruction segments that can perform specific functions. The following description will specifically introduce the functions of each program module in the embodiments of the present application.

[0173] like Figure 14 As shown, the storyboard generation system 1400 may include a first acquisition module 1410, a second acquisition module 1420, and a generation module 1440, wherein:

[0174] The first acquisition module 1410 is configured to acquire input information, where the input information includes keywords.

[0175] The second acquisition module 1420 is used to acquire a reference storyboard script associated with the keyword from a vectorized script library, wherein the vectorized script library includes a plurality of candidate storyboard scripts, and the plurality of candidate storyboard scripts are generated according to the method described in the first embodiment.

[0176] Optionally, the generating module 1430 is configured to: perform vectorized modification on the reference storyboard in response to the vectorized modification information to generate a storyboard.

[0177] Example 5

[0178] Figure 15 The hardware architecture diagram of a computer device 10000 suitable for implementing the storyboard script generation method according to the fifth embodiment of the present application is schematically shown. In this embodiment, the computer device 10000 is a device that can automatically perform numerical calculations and / or information processing according to pre-set or stored instructions. For example, it can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a rack server, a blade server, a tower server or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Figure 15 As shown, the computer device 10000 includes at least but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other via a system bus.

[0179] The memory 10010 includes at least one type of computer-readable storage medium, including flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, an optical disk, etc. In some embodiments, the memory 10010 may be an internal storage module of the computer device 10000, such as a hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 may also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. Of course, the memory 10010 may also include both the internal storage module of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed on the computer device 10000, such as the program code of the storyboard generation method, etc. In addition, the memory 10010 can also be used to temporarily store various data that has been output or is about to be output.

[0180] In some embodiments, processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chip. Processor 10020 is typically used to control the overall operation of computer device 10000, such as performing control and processing related to data exchange or communication with computer device 10000. In this embodiment, processor 10020 is used to execute program code stored in memory 10010 or process data.

[0181] The network interface 10030 may include a wireless network interface or a wired network interface. The network interface 10030 is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal via a network, and to establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile Communications (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth, or Wi-Fi.

[0182] It should be pointed out that Figure 15 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementation of all of the shown components is not a requirement, and greater or fewer components may alternatively be implemented.

[0183] In this embodiment, the storyboard script generation method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (processor 10020 in this embodiment) to complete the embodiment of the present application.

[0184] Example 6

[0185] An embodiment of the present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the storyboard script generation method in the embodiment are implemented.

[0186] In this embodiment, computer-readable storage media include flash memory, hard disks, multimedia cards, card-type memories (e.g., SD or DX memories), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disks, optical disks, and the like. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the computer device's hard disk or memory. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like. Of course, the computer-readable storage medium may also include both the internal storage unit and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is typically used to store the operating system and various application software installed on the computer device, such as the program code of the storyboard generation method described in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that has been output or is about to be output.

[0187] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, optionally, they can be implemented using program code executable by the computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be performed in a different order than herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0188] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A storyboard generation method, characterized in that: The method comprises: Obtain reference images for storyboarding; Acquiring elements of the reference image and element vector information of the elements; Get the vector element that matches the element; and According to the element vector information, the vector element is set on a specified canvas to generate the storyboard; The obtaining of a vector element matching the element includes: According to the element attribute of the element, the vector element associated with the element attribute is acquired from a vector element material library, where the element attribute includes an element category.

2. The storyboard generation method according to claim 1, wherein: The element vector information includes the size and posture of the element and the relative position of the element in the reference image; and setting the vector element on a designated canvas according to the element vector information to generate the storyboard includes: The vector element is placed in the designated canvas according to the size, posture and relative position of the element.

3. The storyboard generation method according to claim 1, wherein: Also includes: identifying scene attributes of the reference image; and According to the scene attribute, the designated canvas associated with the scene attribute is acquired from a canvas material library.

4. The storyboard generation method according to any one of claims 1 to 3, wherein: The storyboard script includes an editable vector graphic; the method further includes: In response to the vectorization modification information, vectorization modification is performed on the storyboard.

5. The storyboard generation method according to any one of claims 1 to 3, wherein: The method further comprises: According to the user preference information, the arrangement of the vector elements in the designated canvas is adjusted to obtain the storyboard script.

6. The storyboard generation method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to the user's request, the corresponding storyboard is returned to the user's client according to the user's preference information.

7. The storyboard generation method according to any one of claims 1 to 3, wherein: The reference image is a video key frame; and / or The reference image is an image uploaded by a user.

8. The storyboard generation method according to any one of claims 1 to 3, wherein: The method further comprises: If the reference image is an image uploaded by a user, evaluating the quality of the storyboard; and If the quality of the storyboard script is greater than a preset value, the storyboard script is stored in a vectorized script library.

9. The storyboard generation method according to claim 8, wherein: The method further comprises: Acquiring input information, wherein the input information includes keywords; Obtaining a reference storyboard script associated with the keyword from the vectorized script library; and In response to the vectorization modification information, the reference storyboard is vectorized modified to generate a storyboard.

10. A storyboard generation system, characterized in that: include: A first acquisition module is used to acquire a reference image for drawing a storyboard script; A second acquisition module, configured to acquire elements of the reference image and element vector information of the elements; A third acquisition module is used to acquire a vector element matching the element; and A generating module, configured to place the vector elements on a designated canvas according to the element vector information, so as to generate the storyboard script; Wherein, the third acquisition module is further used for: According to the element attribute of the element, the vector element associated with the element attribute is acquired from a vector element material library, where the element attribute includes an element category.

11. A method for generating a storyboard, characterized in that: The method comprises: Acquiring input information, wherein the input information includes keywords; and A reference storyboard script associated with the keyword is obtained from a vectorized script library, wherein the vectorized script library includes a plurality of candidate storyboard scripts, and the plurality of candidate storyboard scripts are generated according to the method according to any one of claims 1 to 8.

12. The storyboard generation method according to claim 11, wherein: The method further comprises: In response to the vectorization modification information, the reference storyboard is vectorized modified to generate a storyboard.

13. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, it is used to implement the steps of the storyboard script generation method described in any one of claims 1 to 9, 11-12.

14. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which can be executed by at least one processor to enable the at least one processor to perform the steps of the storyboard script generation method described in any one of claims 1 to 9 and 11-12.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the storyboard generation method described in any one of claims 1 to 9, 11-12 are implemented.

Images