Film and television creative file generation method and device, electronic equipment and storage medium
By generating pre-show animations and automatically generating film and television creative files based on their information, the problem of long generation cycles and low efficiency in film and television creative file generation is solved, achieving efficient creative file generation and shooting preparation.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BEIJING IQIYI TECH CO LTD
- Filing Date
- 2023-06-28
- Publication Date
- 2026-06-19
AI Technical Summary
In existing technologies, the generation cycle of film and television creative files is long and inefficient, which affects the shooting schedule, and there is duplicate content in the production of different creative files.
By merging and rendering the motion trajectories of virtual objects in each shot of the target script, a pre-visualization animation is generated. Based on the pre-visualization animation and shooting-related information, creative files including storyboards, shot charts, camera positions, and cost budgets are automatically generated.
It shortened the creative file generation cycle, improved generation efficiency, reduced the impact on shooting schedule, avoided repetitive work, and improved the efficiency of film and television production.
Smart Images

Figure CN116823933B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer application technology, and in particular to a method, apparatus, electronic device and storage medium for generating film and television creative files. Background Technology
[0002] An important part of pre-production work in film and television is creating creative documents, such as storyboards and shot charts, to assist in the actual shooting process.
[0003] Currently, most creative files are created separately for each item needed to generate the creative file, and different creative files are created and generated by different people.
[0004] Furthermore, the creation of different creative documents involves overlapping content. For example, when creating a storyboard, after the script is finalized, storyboard shots are drawn first, and then compiled into a storyboard. Similarly, when creating a storyboard, after the script is finalized, storyboard shots are drawn first, and then the storyboard is compiled based on shooting information. Both involve drawing storyboard shots, meaning that the people creating storyboards and storyboards are doing repetitive work. Therefore, generating creative documents in this current way easily leads to long creative document generation cycles, low efficiency, and impacts the shooting schedule. Summary of the Invention
[0005] The purpose of this application is to provide a method, apparatus, electronic device, and storage medium for generating film and television creative files, so as to shorten the creative file generation cycle, improve the creative file generation efficiency, and reduce the impact on the shooting schedule.
[0006] The specific technical solution is as follows:
[0007] Firstly, a method for generating film and television creative files is provided, including:
[0008] The motion trajectories of virtual objects in each shot of the target script are merged and rendered to obtain the pre-show animation corresponding to each shot of the target script;
[0009] Based on the pre-show animation of the target script and the shooting-related information carried by each pre-show animation, a target creative file is generated, which is used to assist in the actual shooting of the target script;
[0010] Among them, the shooting-related information carried by each pre-show animation is the representation information of the corresponding shot.
[0011] Optionally, the target creative file includes the storyboard of the target script. The generation of the target creative file based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation includes:
[0012] Determine the storyboard for each preview animation of the target script;
[0013] Based on the determined storyboards and the shooting-related information carried in the pre-visualization animations corresponding to each storyboard, a storyboard for the target script is generated.
[0014] Optionally, determining the storyboard frames for each pre-visualization animation of the target script includes:
[0015] In response to a selection instruction for a scene in each pre-show animation of the target script, determine the storyboard for each pre-show animation;
[0016] Alternatively, the set frame in each preview animation of the target script can be determined as the storyboard frame.
[0017] Optionally, determining the storyboard frames for each pre-visualization animation of the target script includes:
[0018] For each preview animation of the target script, determine the position of the virtual object in at least two frames of the current preview animation;
[0019] Generate the storyboard of the current pre-show animation, which includes position change markers for virtual objects.
[0020] Optionally, the target creative file includes the storyboard of the target script. The process of generating the target creative file based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation includes:
[0021] Select the pre-visualization animation used to generate the storyboard from the pre-visualization animation of the target script;
[0022] Based on the shooting-related information carried by the selected pre-show animation, a storyboard for the target script is generated.
[0023] Optionally, generating the storyboard for the target script based on the shooting-related information carried by the selected pre-visualization animation includes:
[0024] Determine the first piece of information from the shooting-related information carried by the selected pre-rehearsal animation;
[0025] According to the set table style, export the first information to obtain the storyboard of the target script.
[0026] Optionally, the target creative file includes camera positions from the target script. The process of generating the target creative file based on the pre-visualization animations of the target script and the shooting-related information carried in each pre-visualization animation includes:
[0027] Select the pre-visualization animation used to generate the camera position diagram from the pre-visualization animation of the target script;
[0028] Obtain a two-dimensional top view corresponding to the selected pre-show animation, wherein the two-dimensional top view is used to record the motion trajectory of the virtual object in the corresponding pre-show animation;
[0029] Determine the virtual object whose motion trajectory is to be displayed, and the second piece of information from the shooting-related information carried by the selected pre-show animation;
[0030] Based on the two-dimensional top view, the virtual object whose motion trajectory is to be displayed, and the second information, the camera position diagram of the target script is generated.
[0031] Optionally, the target creative file includes the cost budget of the target script. The generation of the target creative file based on the pre-show animations of the target script and the shooting-related information carried by each pre-show animation includes:
[0032] Select the pre-visualization animation for the cost budget from the pre-visualization animation of the target script;
[0033] Based on the shooting-related information carried by the selected pre-show animation and the estimated number of shooting time units, a cost budget table for the target script is generated.
[0034] Optionally, generating the cost budget table for the target script based on the shooting-related information carried by the selected pre-visualization animation and the estimated number of shooting time units includes:
[0035] Based on the shooting-related information carried by each selected pre-show animation, determine the cost items involved in each pre-show animation;
[0036] Query the database to obtain the unit price for each cost item;
[0037] A cost budget table for the target script is generated based on the quantity, unit price, and estimated number of shooting time units for each cost item.
[0038] Optionally, each pre-show animation may carry at least one of the following shooting-related information:
[0039] Shot number information, virtual object information, shot type information, and description information.
[0040] Secondly, a device for generating film and television creative files is provided, including:
[0041] The module is used to merge and render the motion trajectories of virtual objects in each shot of the target script to obtain the pre-show animation corresponding to each shot of the target script.
[0042] The generation module is used to generate a target creative file based on the pre-show animation of the target script and the shooting-related information carried by each pre-show animation. The target creative file is used to assist in the actual shooting of the target script.
[0043] Among them, the shooting-related information carried by each pre-show animation is the representation information of the corresponding shot.
[0044] Thirdly, an electronic device is provided, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;
[0045] Memory, used to store computer programs;
[0046] When a processor executes a program stored in memory, it implements the steps of the method for generating film and television creative files as described in the first aspect.
[0047] Fourthly, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that, when the program is executed by a processor, it implements the steps of the film and television creative file generation method as described in the first aspect.
[0048] Fifthly, a computer program product is provided, the computer program product including computer instructions stored in a computer-readable storage medium and adapted to be read and executed by a processor to cause an electronic device having the processor to perform the steps of the video creative file generation method as described in the first aspect.
[0049] Applying the technical solution provided in this application, the motion trajectories of virtual objects in each shot of the target script are first merged and rendered to obtain the pre-visualization animation corresponding to each shot of the target script. Then, based on the pre-visualization animation of the target script and the shooting-related information carried by each pre-visualization animation, a target creative file is generated. The target creative file can be used to assist in the actual shooting of the target script. That is, with the pre-visualization animation of the target script as the center, creative files can be quickly and automatically generated through the pre-visualization animation, which helps to shorten the creative file generation cycle, improve the creative file generation efficiency, and reduce the impact on the shooting schedule. Attached Figure Description
[0050] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below.
[0051] Figure 1 This is a flowchart illustrating the implementation of a method for generating film and television creative files in this application.
[0052] Figure 2 This is a schematic diagram of a pre-show animation in an embodiment of this application;
[0053] Figure 3 for Figure 2 A schematic diagram of the first storyboard of the pre-animation;
[0054] Figure 4 for Figure 2 A schematic diagram of the second type of storyboard in the pre-production animation;
[0055] Figure 5 for Figure 2 A schematic diagram of the third type of storyboard in the pre-production animation;
[0056] Figure 6 This is a schematic diagram of a storyboard in one embodiment of this application;
[0057] Figure 7 This is another schematic diagram of the storyboard in the embodiments of this application;
[0058] Figure 8 This is a schematic diagram of the camera position of a camera according to an embodiment of this application;
[0059] Figure 9 This is a schematic diagram of a machine position diagram export process in an embodiment of this application;
[0060] Figure 10 This is a schematic diagram of a machine position diagram derived from an embodiment of this application;
[0061] Figure 11 This is a schematic diagram illustrating the generation of a creative file in an embodiment of this application;
[0062] Figure 12 This is another schematic diagram illustrating the generation of the creative file in the embodiments of this application;
[0063] Figure 13 This is a schematic diagram of the structure of a film and television creative file generation device according to an embodiment of this application;
[0064] Figure 14 This is a schematic diagram of the structure of an electronic device according to an embodiment of this application. Detailed Implementation
[0065] The technical solutions in the embodiments of this application will now be described with reference to the accompanying drawings.
[0066] The core of this application is to provide a method for generating film and television creative files. This method can be applied in film and television production scenarios and can be executed through terminals such as mobile phones, tablets, and laptops that can display graphical user interfaces.
[0067] The terminal can run pre-production simulation software. In the early stages of film and television production, pre-production animations can be generated using this software. Then, based on these pre-production animations and the shooting information they contain, a target creative file is generated. This target creative file assists in the actual shooting of the target script and can include at least one of the following: storyboard, shot chart, camera positions, and cost budget. In other words, with the target script's pre-production animations as the core, creative files can be quickly and automatically generated, helping to shorten the creative file generation cycle, improve creative file generation efficiency, and reduce the impact on the shooting schedule.
[0068] See Figure 1 The diagram shown is an implementation flowchart of a method for generating film and television creative files according to an embodiment of this application. The method may include the following steps:
[0069] S110: Merge and render the motion trajectories of virtual objects in each shot of the target script to obtain the pre-show animation corresponding to each shot of the target script.
[0070] In this embodiment, the target script can be any script used for film and television production, and can be expressed through multiple shots. After determining the target script, a virtual pre-rehearsal scene can be constructed. The virtual pre-rehearsal scenes corresponding to different shots may be the same or different. The virtual pre-rehearsal scene can be a three-dimensional scene modeled to simulate a real performance scene, etc.
[0071] For each shot in the target script, a corresponding virtual object can be identified. This virtual object can include virtual image acquisition devices, virtual shooting targets, virtual lighting equipment, etc. By merging and rendering the motion trajectories of these virtual objects in the current shot, a pre-visualization animation corresponding to that shot can be obtained. Virtual shooting targets can include virtual people and / or virtual objects. The current shot refers to the shot being performed.
[0072] For example, virtual objects include virtual image acquisition devices and virtual shooting targets. By simulating real image acquisition devices and adjusting parameters such as aperture and focal plane, the movement of the virtual image acquisition device in the virtual pre-production scene corresponding to the current shot can be controlled, and the corresponding motion trajectory can be recorded. During this process, the motion trajectory of the virtual shooting target can be obtained based on the user's design of the virtual shooting target's trajectory. After merging and rendering the motion trajectory of the virtual image acquisition device and the virtual shooting target in the current shot, the pre-production animation corresponding to the current shot can be obtained. Pre-production is an important part of pre-production in film and television; pre-production animation can showcase the effect of a scene in video format.
[0073] Optionally, the motion trajectory of the virtual object can be continuously recorded through a two-dimensional top view.
[0074] Optionally, relevant information about the motion trajectory of a virtual object can be marked according to the user's marking instructions, such as marking the shot size and descriptive information on the motion trajectory.
[0075] S120: Generate target creative files based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation.
[0076] In this embodiment, the motion trajectories of virtual objects in each shot of the target script are merged and rendered to obtain the pre-visualization animation corresponding to each shot of the target script. Simultaneously, shooting-related information for each pre-visualization animation can be recorded. After obtaining the pre-visualization animation corresponding to each shot of the target script, a target creative file can be generated based on the pre-visualization animation and the shooting-related information carried by each pre-visualization animation. The target creative file can be used to assist in the actual shooting of the target script. The shooting-related information carried by each pre-visualization animation is the representation information of the corresponding shot, that is, information used to represent the corresponding shot.
[0077] Optionally, each pre-show animation may include at least one of the following shooting-related information: shot number information, virtual object information, shot type information, and description information. Of course, depending on the actual situation, it may also include other information.
[0078] The shot number information can be composed of scene number and shot number, uniquely identifying a shot in the target script. The scene number and shot number can be Arabic numerals or English letters, and must follow the naming rules for scene numbers and shot numbers in film and television shooting. For example, the scene number-shot number of one shot is Scene_1_Shot_2, and the scene number-shot number of another shot is Scene_1_Shot_3;
[0079] Virtual object information can include information about virtual image acquisition devices, virtual lighting equipment, and virtual shooting targets. Virtual image acquisition device information can include the model, quantity, and photographic parameters of the corresponding real image acquisition devices; virtual lighting equipment information can include the model, quantity, and lighting parameters of the corresponding real lighting equipment; virtual shooting target information can include the category and quantity of the corresponding real shooting targets.
[0080] Shot type information can include close-up, medium shot, long shot, etc.
[0081] The description information may include relevant descriptive information about the corresponding shots in the pre-show animation, such as the content of the scene.
[0082] The shooting-related information carried in each pre-show animation can be determined based on user input or obtained automatically through analysis. For example, the shot size can be determined based on the proportion of the virtual target in the frame.
[0083] Target creative files, generated based on the pre-visualization animations corresponding to each shot of the target script and the shooting information carried by each pre-visualization animation, are used to assist in the actual shooting of the target script. These files can include at least one of the following: storyboard, shot list, camera positions, and budget. They can also include other files used to assist in the actual shooting. In short, centered on the pre-visualization animations of the target script, one or more types of creative files can be quickly and automatically generated from the pre-visualization animations, avoiding tedious repetitive production and effectively improving the efficiency of creative file generation.
[0084] Applying the method provided in this application, the motion trajectories of virtual objects in each shot of the target script are first merged and rendered to obtain the pre-visualization animation corresponding to each shot of the target script. Then, based on the pre-visualization animation of the target script and the shooting-related information carried by each pre-visualization animation, a target creative file is generated. This target creative file can be used to assist in the actual shooting of the target script. That is, with the pre-visualization animation of the target script as the center, creative files can be quickly and automatically generated through the pre-visualization animation, which helps to shorten the creative file generation cycle, improve the efficiency of creative file generation, and reduce the impact on the shooting schedule.
[0085] In some embodiments of this application, the target creative file includes a storyboard of the target script. Generating the target creative file based on the pre-visualization animation of the target script and the shooting-related information carried by each pre-visualization animation may include the following steps:
[0086] Step 1: Determine the storyboard for each pre-screen animation of the target script;
[0087] Step 2: Based on the determined storyboards and the shooting information carried by the pre-visualization animations corresponding to each storyboard, generate the storyboard for the target script.
[0088] For ease of description, the two steps above will be explained together.
[0089] In this embodiment, the target creative document may include a storyboard for the target script. The storyboard may be presented in a graphical table format, including the shot number, shot size, shooting technique, storyboard, etc., for each shot, displaying most of the shots in the film / television in the form of still images. This embodiment does not limit the format of the storyboard; it may primarily consist of storyboard images, supplemented by other information.
[0090] After obtaining the pre-visualization animation corresponding to each shot of the target script, the storyboard of each pre-visualization animation can be determined.
[0091] Optionally, in response to a selection command for a frame in each preview animation of the target script, the storyboard for each preview animation can be determined. That is, for each shot in the target script, the preview animation corresponding to the current shot can be displayed to the user, who can manually select one or more frames to represent the current shot. The user-selected frame is then designated as the storyboard for the preview animation corresponding to the current shot. This process can be implemented using screenshots. The current shot refers to the shot targeted by the current operation.
[0092] Determining the storyboard based on the user's selection can improve the accuracy of the storyboard selection.
[0093] Optionally, the set frame in each pre-visualization animation of the target script can be designated as the storyboard frame. That is, it's possible to pre-determine which frame(s) in each pre-visualization animation will serve as the storyboard frame for that pre-visualization animation. For each shot in the target script, the set frame in the pre-visualization animation corresponding to that shot can be designated as the storyboard frame for that shot. The set frame can be one or more frames. For example, if the set frame is the first frame, then the first frame in the pre-visualization animation is designated as the storyboard frame for that pre-visualization animation. If there are multiple set frames, different storyboard frames of the same pre-visualization animation can be distinguished using symbols or other means. This process can be achieved through screenshots.
[0094] Automatically identifying the set frames in the pre-show animation as storyboard frames helps improve the efficiency of storyboard frame determination.
[0095] Optionally, for each preview animation of the target script, the position of the virtual object in at least two frames of the current preview animation is determined, and a storyboard of the current preview animation is generated, which includes a position change marker for the virtual object.
[0096] It is understandable that when it comes to the movement of complex virtual objects, it may be difficult to represent complex motion relationships using only a single frame in the pre-show animation. Therefore, in this embodiment, for each pre-show animation, the position of the virtual object in at least two frames of the current pre-show animation is first determined, and then the storyboard of the current pre-show animation is generated. The changes in the position of the virtual object are marked in the storyboard of the current pre-show animation, such as using rectangles and arrows to mark the movement of the virtual object from one position to another.
[0097] For example, based on frames N1 and N2 of the current preview animation, a storyboard for the current preview animation can be generated. N1 and N2 can be pre-defined, such as setting frame N1 as the first frame of the current preview animation and frame N2 as the last frame. The current preview animation is the preview animation targeted by the current operation. In the generated storyboard of the current preview animation, the virtual object's movement from its position in frame N1 to its position in frame N2 is marked.
[0098] Based on at least two frames of the pre-visualization animation, storyboards are generated. These storyboards include annotations showing the positional changes of virtual objects, which can demonstrate the movement relationships of these objects and better represent the cinematic language. Furthermore, by converting the pre-visualization animation into static images through image rendering, the gap in the reverse conversion from pre-visualization to storyboards is filled, and the generated storyboards are easier to express than those created using traditional methods, with a faster and more efficient generation process.
[0099] like Figure 2 The image shown is a multi-frame preview animation, in which both the virtual image acquisition device and the virtual shooting target are moving to the left. When determining the storyboard of this preview animation by taking screenshots, the first frame can be used as the default storyboard, or the frame obtained by the user at a specific time point can be used as the storyboard. Figure 3 The diagram illustrates how a scene at a specific point in the pre-show animation is used as a storyboard frame. When determining the storyboard frame for the pre-show animation using image drawing, the position of the virtual image acquisition device automatically changes, defaulting to include the positions of the first and last frames. A rectangle represents the position of the virtual image acquisition device within the first and last frames, as shown below. Figure 4 As shown. To demonstrate the positional changes of the virtual target, you can set key points for its location. The default is one key point at the beginning and one at the end, meaning the virtual target needs to be copied multiple times. Figure 5 The system simultaneously displays the state of the virtual shooting target at the beginning and end, and uses arrows to indicate changes between key points in the position.
[0100] It should be noted that one or more of the above methods can be used to determine the storyboard for each pre-show animation of the target script. For example, for each pre-show animation of the target script, the storyboard is determined according to the user's selection instructions. Alternatively, for a part of the pre-show animation of the target script, the storyboard is determined according to the user's selection instructions, and for another part of the pre-show animation of the target script, the storyboard is generated based on at least two frames.
[0101] In addition, once the storyboard for each preview animation of the target script is determined, it can be redrawn based on the storyboard to add more information.
[0102] After determining the storyboard for each pre-show animation of the target script, a storyboard for the target script can be generated based on the determined storyboard and the shooting information carried by the pre-show animation corresponding to each storyboard.
[0103] like Figure 6 The image shows a schematic diagram of the storyboard generated after integrating the storyboard frames of each pre-visualization animation of the target script. The storyboard includes storyboard frames corresponding to six shots from the pre-visualization animation. Each storyboard frame is labeled with a shot number using scene number-shot number representation, such as 3-1, 3-2, ..., 3-6, and also indicates the shot type, such as close-up, extreme close-up, and super extreme close-up, as well as descriptive information, such as character A moving forward or character A moving backward.
[0104] Figure 7 The image shown is another schematic diagram of a storyboard, which represents multiple shots of a scene, such as the storyboard for shots 7-12. Each storyboard has a shot size and descriptive information below it.
[0105] It should be noted that storyboards can be presented in a two-dimensional list format or in a three-dimensional format.
[0106] In the traditional film and television production process, after the target script is determined, the storyboard artist and director need to draw storyboards shot by shot according to the content of the target script, and then organize the storyboards into storyboards. In this embodiment, after the target script is determined, the pre-visualization animation corresponding to each shot of the target script is obtained first, and then the storyboards are determined based on the pre-visualization animation. The dynamic video is converted into static storyboards by adding annotations, and then the storyboards are automatically generated based on the storyboards, eliminating the need for manual drawing and effectively improving the efficiency of storyboard generation.
[0107] In some embodiments of this application, the target creative file includes a storyboard of the target script. Generating the target creative file based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation may include the following steps:
[0108] The first step: Select the pre-visualization animation to generate the storyboard in the target script's pre-visualization animation;
[0109] The second step: Based on the shooting-related information carried by the selected pre-visualization animation, generate the storyboard of the target script.
[0110] For ease of description, the two steps above will be explained together.
[0111] In this embodiment of the application, the target creative document may include a storyboard of the target script. The storyboard, also known as a shooting list, can be displayed in tabular form and includes information such as the shot number, shot size, shooting technique, and shooting parameters for each shot.
[0112] After obtaining the pre-visualization animations corresponding to each shot of the target script, you can select the pre-visualization animations to generate the storyboard from the target script's pre-visualization animations. Optionally, the pre-visualization animations used to generate the storyboard can be determined according to the user's selection instructions; that is, the user can choose which pre-visualization animations to use as the basis for generating the storyboard based on actual needs. Based on the shooting-related information carried by the selected pre-visualization animations, the storyboard of the target script can be generated. The pre-visualization animations used to generate the storyboard can be all or part of the target script's pre-visualization animations.
[0113] Optionally, the first piece of information in the shooting-related information carried by the selected pre-visualization animation can be determined first, and then the first piece of information can be exported according to the set table style to obtain the storyboard of the target script.
[0114] The pre-visualization animation can carry multiple pieces of shooting-related information. Depending on the actual needs, some or all of the shooting-related information can be selected as the first piece of information, or it can be determined as the first piece of information based on pre-defined information categories. After determining the first piece of information, it can be exported according to a pre-defined table format to obtain the storyboard of the target script.
[0115] For example, if a user selects the pre-visualization animation corresponding to "Scene 3 - Shot 1" and "Scene 3 - Shot 2", and selects shooting-related information such as "Scene Number - Shot Number", "Description Information", "Shot Size", and "Virtual Image Acquisition Device Information", the generated storyboard of the target script is shown in Table 1:
[0116] field number Mirror number Description information Shot type Virtual image acquisition device information 3 1 Character A moves forward Close-up ARRI ALEXA LF 3 2 Character A retreats Close-up ARRI ALEXA LF
[0117] Table 1
[0118] It should be noted that the table style shown in Table 1 is only a specific example, and other table styles can be set according to the actual situation.
[0119] In the traditional film and television production process, after the target script is determined, the storyboard artist and director need to draw storyboards according to the content of the target script, shot by shot. Then, based on the content of the scenes, they determine the equipment, shot sizes, camera movement methods, and shooting targets required for filming, and finally compile and create a storyboard. In this embodiment, after determining the target script, the pre-visualization animation corresponding to each shot of the target script is obtained first. Each pre-visualization animation carries corresponding shooting-related information. The storyboard is automatically generated based on the pre-visualization animation and the shooting-related information it carries, eliminating the need for manual drawing and effectively improving the efficiency of storyboard generation.
[0120] In some embodiments of this application, the target creative file includes camera positions of the target script. Generating the target creative file based on the pre-show animations of the target script and the shooting-related information carried by each pre-show animation may include the following steps:
[0121] Step 1: Select the pre-visualization animation to generate the camera position diagram in the target script's pre-visualization animation;
[0122] Step 2: Obtain the 2D top view corresponding to the selected pre-show animation. The 2D top view is used to record the motion trajectory of the virtual objects in the corresponding pre-show animation.
[0123] Step 3: Determine the virtual object whose motion trajectory is to be displayed, and the second piece of information from the shooting-related information carried by the selected pre-show animation;
[0124] Step 4: Based on the 2D top view, the virtual object whose motion trajectory is to be displayed, and the second information, generate the camera position diagram of the target script.
[0125] For ease of description, the above four steps will be explained together.
[0126] In this embodiment of the application, the target creative file includes camera positions of the target script. A camera position is a top view in three-dimensional space that shows the motion trajectory relationship of a virtual object under one or more shots within a certain range.
[0127] like Figure 8 The diagram shows a camera position diagram for a camera. Camera A can move back and forth to film actors A, B, C, and D, while camera B can move left and right to film actors A, B, C, and D.
[0128] During the pre-visualization of virtual objects, the pre-visualization software can record their motion trajectory in real time through a two-dimensional top view. The motion trajectory includes the direction of movement, point markings, etc.
[0129] After obtaining the pre-visualization animations for each shot of the target script, you can select the pre-visualization animation to generate the camera position diagram from the target script's pre-visualization animations. Optionally, the pre-visualization animation used to generate the camera position diagram can be determined according to the user's selection instructions. Simultaneously, a 2D top-view corresponding to the selected pre-visualization animation can be obtained. For each pre-visualization animation, the 2D top-view corresponding to the current pre-visualization animation records the motion trajectory of virtual objects in the current pre-visualization animation. The current pre-visualization animation is the pre-visualization animation targeted by the current operation. The pre-visualization animation used to generate the camera position diagram can be all or part of the pre-visualization animations of the target script.
[0130] Furthermore, the virtual objects whose motion trajectories are to be displayed can be determined. For example, the motion trajectories of which virtual objects should be displayed can be determined based on the user's selection instructions, or the virtual objects whose motion trajectories are to be displayed can be determined based on pre-set rules.
[0131] Simultaneously, the second piece of information can be identified from the shooting-related information carried by the selected pre-visualization animation. This second piece of information can be part or all of the shooting-related information.
[0132] Based on a two-dimensional top view, a virtual object representing the motion trajectory to be displayed, and second information, a camera position diagram for the target script can be generated. Optionally, the second information can be displayed at a set position on the motion trajectory, generating the camera position diagram in a single frame or a combined frame format.
[0133] The process of generating the aircraft stand layout is also the process of exporting the aircraft stand layout. For example, as follows: Figure 9 As shown, a specific process for exporting camera positions for the target script is as follows:
[0134] 1) Determine the pre-show animations used to generate the camera positions. This can be determined based on the user's selection instructions or based on default rules, such as generating camera positions based on every M pre-show animations of the target script, where M is a positive integer.
[0135] 2) Determine the export mode. This can be determined based on the user's selection instructions or based on default rules. The export mode can include field-mirror single image export mode or batch export mode.
[0136] 3) Determine the virtual image acquisition device and / or the virtual shooting target. Optionally, the camera location name and remarks can be displayed at a designated location on the virtual image acquisition device. Optionally, the virtual shooting target name can be displayed at a designated location on the virtual shooting target.
[0137] 4) Optionally, determine the basic information to be displayed, such as the scene number and shot number;
[0138] 5) Confirm the exported aircraft location diagram.
[0139] Optionally, a settings interface can be provided for users to select and / or input relevant information.
[0140] Based on the user's selection instructions, it can be determined which preview animations need to be used to generate camera positions. For example, if the user selects Scene_1_Shot_2 and Scene_1_Shot_3 from Scene_1, then it is determined that camera positions need to be generated based on Scene_1_Shot_2 and Scene_1_Shot_3.
[0141] Based on the user's selected instructions and input information, the export parameters can be determined. For example, if the user selects batch export between single-image export and batch export modes, the export mode is confirmed as batch export; if the user selects by scene between batch export units, the batch export unit is confirmed as by scene; if the user checks "Camera Movement Line" and "Virtual Person Movement Line," the camera movement line and virtual person movement line will be displayed; if the user checks "Show Camera Name" and "Show Camera Notes" in the camera markings and fills in the relevant information, the camera name and notes will be displayed, such as one camera named Camera_A with the note "Track on Actor_1," and the other camera named TripodCamera_A with the note "Fixed"; if the user checks "Show Virtual Person Name" in the virtual person markings and selects the name to be displayed, the virtual person name will be displayed, such as one virtual person named Actor_1 and the other virtual person named Sam. Kolder; If the user selects to add field-scope number information, then confirm that the field or scope number mark will be added to the exported camera position diagram; If the user selects a file name and save location, then confirm that the camera position diagram will be exported to the corresponding location and named.
[0142] Following the settings in the example above, the exported camera layout diagram will look like this: Figure 10 As shown.
[0143] It should be noted that the above example is based on image acquisition devices such as cameras. In practical applications, camera positions of devices such as lighting equipment can also be exported, and more annotations can be added.
[0144] Following the traditional film and television production process, after determining the target script, storyboards are drawn, a storyboard table is compiled based on shooting information, and then camera placement schemes are discussed and compiled based on several types of documents to guide the movement direction of image acquisition equipment. In this embodiment, after determining the target script, pre-visualization animations corresponding to each shot of the target script are obtained, and the movement trajectory of virtual objects is presented in real time through a two-dimensional top view. Movement trajectories can be filtered based on different pre-visualization animations, markers can be added, etc., and camera placement diagrams can be generated and exported according to settings, improving the efficiency of camera placement diagram generation.
[0145] In some embodiments of this application, the target creative document includes a cost budget sheet for the target script. Generating the target creative document based on the pre-show animations of the target script and the shooting-related information carried by each pre-show animation may include the following steps:
[0146] The first step: Select the pre-visualization animation for the budget from the target script's pre-visualization animations;
[0147] The second step: Based on the shooting information carried by the selected pre-show animation and the estimated number of shooting time units, generate a cost budget table for the target script.
[0148] For ease of description, the two steps above will be explained together.
[0149] In this embodiment of the application, the target creative document includes a cost budget sheet for the target script, used to control cost expenditures.
[0150] After obtaining the pre-visualization animations for each shot of the target script, you can select the pre-visualization animations for cost budgeting within the target script's pre-visualization animations. Optionally, you can select pre-visualization animations for cost budgeting based on user selection instructions. The selected pre-visualization animations can be all or part of the target script's pre-visualization animations.
[0151] Further steps can be taken to determine the estimated number of shooting time units. Optionally, the estimated number of shooting time units can be determined based on user input. Time units can be days, months, etc.
[0152] Based on the shooting information carried by the selected pre-show animations and the estimated number of shooting time units, a cost budget table for the target script can be generated. Optionally, based on the shooting information carried by each selected pre-show animation, the cost items involved in each pre-show animation can be determined, the unit price corresponding to each cost item can be obtained by querying the database, and a cost budget table for the target script can be generated based on the quantity, unit price, and estimated number of shooting time units for each cost item. Cost items may include equipment, actors, props, etc. Equipment includes image acquisition equipment, lighting equipment, etc. Different types and models of equipment may differ, and their corresponding unit prices may also vary.
[0153] For example, based on the shooting information carried by the selected pre-show animation, the cost items for the equipment involved in the pre-show animation are determined to include: M1 X-type cameras, M2 Y-type cameras, M3 Z-type camera lenses, and M4 other equipment, where M1, M2, M3, and M4 are all positive integers. Where:
[0154] Camera budget: Unit price of X model camera * M1 * estimated number of shooting time units + Unit price of Y model camera * M2 * estimated number of shooting time units;
[0155] Camera lens budget: Unit price of Z model camera lens * M3 * Estimated number of shooting time units;
[0156] Other equipment budget: Unit price of other equipment * M4 * Estimated shooting time and number of units;
[0157] Total budget = Camera budget + Camera lens budget + Other equipment budget.
[0158] Table 2 below is an example of a generated cost budget table:
[0159]
[0160] Table 2
[0161] By querying the database, the unit price of cost items can be accurately obtained. Combining this with the shooting information carried by the pre-show animation to generate a cost budget can improve the accuracy of the cost budget and generate the cost budget more efficiently, which helps the production team control cost expenditures.
[0162] Optionally, a settings interface can be provided for users to select and / or input relevant information.
[0163] Based on the user's selection instructions, the preview animations used for cost budgeting can be determined. For example, if the user selects Scene_1, Scene_2, etc., then the preview animations corresponding to Scene_1 and Scene_2 will be selected as the preview animations used for cost budgeting.
[0164] Based on the user's input, the estimated number of shooting time units can be determined. For example, if the time unit is days, and the user enters 1 in the estimated number of shooting time units, it means that 1 day of shooting is required.
[0165] Based on the filename and save location set by the user, the filename and save location of the generated cost budget sheet can be determined.
[0166] It should be noted that different estimated shooting time units can be set for different pre-show animations. The system automatically calculates the most efficient shooting combination based on the estimated number of shooting time units, required equipment, actor configuration, and location configuration. After calculating the combination, a daily rundown can be exported as a new creative file format to display the daily shooting plan.
[0167] Following the traditional film and television production process, after determining the target script, storyboards are drawn, and a storyboard table is compiled based on shooting information. Subsequently, costs are discussed and calculated based on several types of documents, with a rough estimate of the number of days and rental fees, resulting in a cost budget. In this embodiment, after determining the target script, pre-visualization animations corresponding to each shot of the target script are obtained. Based on the shooting-related information carried in the pre-visualization animations, a cost budget is calculated according to the estimated number of shooting time units, equipment rental prices, and other information, generating a cost budget table, thus improving the efficiency of cost budget table generation.
[0168] For example, the information that can be displayed for each type of creative file in the embodiments of this application is shown in Table 3. Of course, it is not limited to the information listed, but may also include other extended information or other custom information.
[0169]
[0170] Table 3
[0171] The technical solution provided in this application facilitates unified data management. After determining the target script and obtaining its preview animation, various types of creative files can be quickly and automatically generated, centered around the preview animation. Figure 11 , Figure 12 As shown. If shots are added, deleted, or modified, obtaining the preview animation again allows for rapid updates of all creative files, making it more efficient and convenient, helping to improve overall project efficiency and effectively control costs.
[0172] in, Figure 12 The top box shows the user's workflow for operating the pre-visualization production software. Through this software, users can configure camera parameters, perform animation pre-visualization, and customize information to obtain pre-visualized animation. Then, by selecting the pre-visualized animation and setting parameters, corresponding creative files can be generated, such as storyboards, storyboards, camera positions, and cost budgets. Figure 12 The box below contains data information included in the database, such as camera-related parameter information and cost item pricing information.
[0173] Corresponding to the above method embodiments, this application also provides a film and television creative file generation device. The film and television creative file generation device described below can be referred to in correspondence with the film and television creative file generation method described above.
[0174] See Figure 13 As shown, the film and television creative file generation device 1300 may include the following modules:
[0175] The module 1310 is used to merge and render the motion trajectories of virtual objects in each shot of the target script to obtain the pre-show animation corresponding to each shot of the target script.
[0176] The generation module 1320 is used to generate target creative files based on the pre-visualization animation of the target script and the shooting-related information carried by each pre-visualization animation. The target creative files are used to assist in the actual shooting of the target script.
[0177] Among them, the shooting-related information carried by each pre-show animation is the representation information of the corresponding shot.
[0178] Using the apparatus provided in this application embodiment, the motion trajectories of virtual objects in each shot of the target script are first merged and rendered to obtain the pre-visualization animation corresponding to each shot of the target script. Then, based on the pre-visualization animation of the target script and the shooting-related information carried by each pre-visualization animation, a target creative file is generated. This target creative file is used to assist in the actual shooting of the target script. That is, with the pre-visualization animation of the target script as the center, creative files can be quickly and automatically generated through the pre-visualization animation, which helps to shorten the creative file generation cycle, improve the creative file generation efficiency, and reduce the impact on the shooting schedule.
[0179] In some embodiments of this application, the target creative file includes a storyboard for the target script, and the generation module 1320 is used for:
[0180] Determine the storyboard for each preview animation of the target script;
[0181] Based on the determined storyboard shots and the shooting-related information carried by the pre-visualization animation corresponding to each storyboard shot, a storyboard for the target script is generated.
[0182] In some embodiments of this application, the generation module 1320 is used for:
[0183] Responding to the selection instructions for each frame in the target script's pre-visualization animation, determine the storyboard frames for each pre-visualization animation;
[0184] Alternatively, the setting frames in each preview animation of the target script can be used as storyboard frames.
[0185] In some embodiments of this application, the generation module 1320 is used for:
[0186] For each preview animation of the target script, determine the position of the virtual object in at least two frames of the current preview animation;
[0187] Generate the storyboard for the current preview animation. The storyboard for the current preview animation includes annotations showing the positional changes of virtual objects.
[0188] In some embodiments of this application, the target creative file includes a storyboard of the target script, and the generation module 1320 is used for:
[0189] Select the pre-visualization animation to generate the storyboard in the target script's pre-visualization animation;
[0190] Based on the shooting-related information carried by the selected pre-show animation, a storyboard for the target script is generated.
[0191] In some embodiments of this application, the generation module 1320 is used for:
[0192] Determine the first piece of information from the shooting-related information carried by the selected pre-rehearsal animation;
[0193] Export the first information according to the set table format to obtain the storyboard of the target script.
[0194] In some embodiments of this application, the target creative file includes camera angles of the target script, and the generation module 1320 is used for:
[0195] Select the pre-visualization animation to generate the camera position diagram in the target script's pre-visualization animation;
[0196] Obtain the two-dimensional top view corresponding to the selected pre-show animation. The two-dimensional top view is used to record the motion trajectory of the virtual objects in the corresponding pre-show animation.
[0197] Determine the virtual object whose motion trajectory is to be displayed, and the second piece of information from the shooting-related information carried by the selected pre-show animation;
[0198] Based on a two-dimensional top view, a virtual object whose motion trajectory is to be displayed, and second information, a camera position diagram of the target script is generated.
[0199] In some embodiments of this application, the target creative document includes a cost budget sheet for the target script, and the generation module 1320 is used for:
[0200] Select the pre-visualization animations for the cost budget within the target script's pre-visualization animations;
[0201] Based on the shooting-related information carried by the selected pre-show animation and the estimated number of shooting time units, a cost budget table for the target script is generated.
[0202] In some embodiments of this application, the generation module 1320 is used for:
[0203] Based on the shooting-related information carried by each selected pre-show animation, determine the cost items involved in each pre-show animation;
[0204] Query the database to obtain the unit price for each cost item;
[0205] A cost budget table for the target script is generated based on the quantity, unit price, and estimated number of shooting time units for each cost item.
[0206] In some embodiments of this application, the shooting-related information carried by each preview animation includes at least one of the following:
[0207] Shot number information, virtual object information, shot type information, and description information.
[0208] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0209] This application also provides an electronic device, such as... Figure 14 As shown, it includes a processor 1401, a communication interface 1402, a memory 1403, and a communication bus 1404, wherein the processor 1401, the communication interface 1402, and the memory 1403 communicate with each other through the communication bus 1404.
[0210] Memory 1403 is used to store computer programs;
[0211] When processor 1401 executes a program stored in memory 1403, it performs the following steps:
[0212] The motion trajectories of virtual objects in each shot of the target script are merged and rendered to obtain the pre-show animation corresponding to each shot of the target script;
[0213] Based on the pre-show animations of the target script and the shooting information carried by each pre-show animation, a target creative file is generated. The target creative file is used to assist in the actual shooting of the target script.
[0214] Among them, the shooting-related information carried by each pre-show animation is the representation information of the corresponding shot.
[0215] The communication bus 1404 in the aforementioned electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus 1404 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, it is represented by only one thick line in the figure, but this does not indicate that there is only one bus or one type of bus.
[0216] Communication interface 1402 is used for communication between the above-mentioned electronic device and other devices.
[0217] The memory 1403 may include random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Optionally, the memory 1403 may also be at least one storage device located remotely from the aforementioned processor.
[0218] The processor 1401 mentioned above can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.
[0219] In another embodiment provided in this application, a computer-readable storage medium is also provided, which stores instructions that, when executed on a computer, cause the computer to perform the steps of any of the video creative file generation methods described in the above embodiments.
[0220] In another embodiment provided in this application, a computer program product containing instructions is also provided, which, when run on a computer, causes the computer to perform the steps of any of the above-described methods for generating video creative files.
[0221] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).
[0222] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.
[0223] The various embodiments in this specification are described in a related manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, the system embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0224] The above are merely preferred embodiments of this application and are not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application are included within the scope of protection of this application.
Claims
1. A method for generating film and television creative files, characterized in that, include: The motion trajectory of the virtual image acquisition device and the motion trajectory of the virtual shooting target for each shot of the target script are merged and rendered to obtain the pre-show animation corresponding to each shot of the target script. Based on the pre-show animation of the target script and the shooting-related information carried by each pre-show animation, a target creative file is generated, which is used to assist in the actual shooting of the target script; The shooting-related information carried by each pre-show animation is the representation information of the corresponding shot; the representation information of the corresponding shot includes at least one of the following: shot number information, virtual object information, shot size information, and description information; the target creative file includes at least one of the following: storyboard of the target script, storyboard, camera position diagram, and cost budget table.
2. The method according to claim 1, characterized in that, The target creative file is generated based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation, including: Determine the storyboard for each preview animation of the target script; Based on the determined storyboards and the shooting-related information carried in the pre-visualization animation corresponding to each storyboard, a storyboard for the target script is generated.
3. The method according to claim 2, characterized in that, Determining the storyboard frames for each pre-show animation of the target script includes: In response to a selection instruction for a scene in each pre-show animation of the target script, determine the storyboard for each pre-show animation; Alternatively, the set frame in each preview animation of the target script can be determined as the storyboard frame.
4. The method according to claim 2, characterized in that, Determining the storyboard frames for each pre-show animation of the target script includes: For each preview animation of the target script, determine the position of the virtual object in at least two frames of the current preview animation; Generate the storyboard of the current pre-show animation, which includes position change markers for virtual objects.
5. The method according to claim 1, characterized in that, The target creative file is generated based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation, including: Select the pre-visualization animation used to generate the storyboard from the pre-visualization animation of the target script; Based on the shooting-related information carried by the selected pre-show animation, a storyboard for the target script is generated.
6. The method according to claim 5, characterized in that, The process of generating a storyboard for the target script based on the shooting-related information carried by the selected pre-visualization animation includes: Determine the first piece of information from the shooting-related information carried by the selected pre-rehearsal animation; According to the set table format, export the first information to obtain the storyboard of the target script.
7. The method according to claim 1, characterized in that, The target creative file is generated based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation, including: Select the pre-visualization animation used to generate the camera position diagram from the pre-visualization animation of the target script; Obtain a two-dimensional top view corresponding to the selected pre-show animation, wherein the two-dimensional top view is used to record the motion trajectory of the virtual object in the corresponding pre-show animation; Determine the virtual object whose motion trajectory is to be displayed, and the second piece of information from the shooting-related information carried by the selected pre-show animation; Based on the two-dimensional top view, the virtual object whose motion trajectory is to be displayed, and the second information, the camera position diagram of the target script is generated.
8. The method according to claim 1, characterized in that, The target creative file is generated based on the pre-visualization animations of the target script and the shooting-related information carried by each pre-visualization animation, including: Select the pre-visualization animation for the cost budget from the pre-visualization animation of the target script; Based on the shooting-related information carried by the selected pre-show animation and the estimated number of shooting time units, a cost budget table for the target script is generated.
9. The method according to claim 8, characterized in that, The step of generating a cost budget table for the target script based on the shooting-related information carried by the selected pre-visualization animation and the estimated number of shooting time units includes: Based on the shooting-related information carried by each selected pre-show animation, determine the cost items involved in each pre-show animation; Query the database to obtain the unit price for each cost item; A cost budget table for the target script is generated based on the quantity, unit price, and estimated number of shooting time units for each cost item.
10. A device for generating film and television creative files, characterized in that, include: The acquisition module is used to merge and render the motion trajectory of the virtual image acquisition device and the motion trajectory of the virtual shooting target for each shot of the target script to obtain the pre-show animation corresponding to each shot of the target script. The generation module is used to generate a target creative file based on the pre-show animation of the target script and the shooting-related information carried by each pre-show animation. The target creative file is used to assist in the actual shooting of the target script. The shooting-related information carried by each pre-show animation is the representation information of the corresponding shot; the representation information of the corresponding shot includes at least one of the following: shot number information, virtual object information, shot size information, and description information; the target creative file includes at least one of the following: storyboard of the target script, storyboard, camera position diagram, and cost budget table.
11. An electronic device, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; Memory, used to store computer programs; When a processor executes a program stored in memory, it implements the steps of the video creative file generation method as described in any one of claims 1 to 9.
12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the film and television creative file generation method as described in any one of claims 1 to 9.
Citation Information
Patent Citations
Display method and device of virtual camera position map, electronic equipment and medium
CN115967779A