Video generation method and device, storage medium and program product

Abstract

The embodiment of the invention provides a video generation method and device, a storage medium and a program product. In the method, a video editor can be used for analyzing multimedia elements of file pages with data formats supported by the video editor and original attribute information of the multimedia elements, and a time axis corresponding to each multimedia element can be edited on a canvas page corresponding to each file page. And adjusting the display time of each multimedia element to obtain target attribute information of each original material, and generating a video corresponding to any file page based on each original material corresponding to any file page and the target attribute information thereof. On one hand, the user makes the video through the video editor, and the efficiency of converting the PPT file into the video is improved; and on the other hand, the time editing operation is synchronized in the display area corresponding to the video editor more efficiently through the time axis, and the editing state of the edited original material is viewed more intuitively, so that the video editing efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of Internet technology, and in particular to a video generation method, device, storage medium and program product. Background Art

[0002] At present, the method of imparting information to everyone through PPT (Powerpoint) is widely used in various industries. The specific process is to demonstrate and play the PPT file while the narrator explains the content in the PPT; or to record the PPT file being played and the voice explaining the PPT content at the same time, and synthesize the recorded video and voice to obtain the PPT explanation video.

[0003] The above methods either require the use of third-party screen or voice recording software, or require the user to manually click on the PPT, play it page by page, and the speaker needs to speak during the playback, which is very cumbersome, time-consuming and energy-consuming. Summary of the invention

[0004] Multiple aspects of the present application provide a video generation method, device, storage medium and program product to enrich the display method of PPT files and improve the display and dissemination efficiency of PPT file content.

[0005] The embodiment of the present application provides a video generation method, which is applied to a video editor, and the video editor provides an editing interface. The method includes: importing a target PPT file, the target PPT file includes multiple file pages, and each file page includes at least one form of multimedia elements; parsing the multimedia elements contained in each file page and their original attribute information; converting the multimedia elements and their original attribute information parsed from each file page into original materials and their original attribute information corresponding to each file page, and the original materials have a target data format supported by the video editor; displaying the original materials corresponding to each file page in a first display area of ​​the editing interface; and in response to a loading operation on a first file page, displaying the original materials corresponding to the first file page in a canvas corresponding to the first file page, and the canvas is located in the first display area; in a second display area of ​​the editing interface, displaying timelines corresponding to each original material corresponding to the first file page, and each original material has its own timeline; and in response to an editing operation on any timeline, adjusting the original attribute information of the original material corresponding to any timeline to obtain target attribute information; generating a storyboard video corresponding to the first file page according to each original material corresponding to the first file page and its target attribute information.

[0006] An embodiment of the present application also provides an electronic device, comprising: a memory and a processor; wherein the memory is used to: store one or more computer instructions; the processor is used to execute one or more computer instructions to execute the steps in the above method.

[0007] An embodiment of the present application also provides a computer-readable storage medium, which enables the processor to implement the steps in the above method when the computer program is executed by the processor.

[0008] An embodiment of the present application also provides a computer program product, including a computer program / instruction. When the computer program / instruction is executed by a processor, the steps in the above method are executed.

[0009] In the embodiment of the present application, a video editor is used to generate a storyboard video corresponding to each file page of the target PPT file, which enriches the way of converting PPT files into videos and improves the efficiency of generating videos corresponding to PPT files. Further, the video editor can be used to parse the multimedia elements and their original attribute information of each file page in the data format supported by the video editor, and the timeline corresponding to each multimedia element can be edited on the canvas page corresponding to each file page, and the display time of each multimedia element can be adjusted to obtain the target attribute information of each original material, and based on the original materials corresponding to any file page and their target attribute information, the video corresponding to any file page is generated. On the one hand, by making videos through a video editor, the efficiency of converting PPT files into videos is improved, and the performance requirements for terminal devices are reduced; on the other hand, through the timeline, the editing operation can be synchronized in the display area corresponding to the video editor in a more efficient manner, and the editing status of the edited original material can be viewed more intuitively, which improves the efficiency of video editing. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0011] Figure 1 A schematic diagram of a flow chart of a video generation method provided by an exemplary embodiment of the present application;

[0012] Figure 2a A schematic diagram of an editing interface provided for an exemplary embodiment of the present application;

[0013] Figure 2b A schematic diagram of a drag effect corresponding to a drag operation provided by an exemplary embodiment of the present application;

[0014] Figure 2c A schematic diagram of another editing interface provided for an exemplary embodiment of the present application;

[0015] Figure 3 A schematic diagram of the structure of a video generating device provided by an exemplary embodiment of the present application;

[0016] Figure 4 A schematic diagram of an electronic device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0017] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0018] In view of the technical problems existing in the prior art, in some embodiments of the present application, a video editor is used to generate a storyboard video corresponding to each file page of the target PPT file, which enriches the way of converting PPT files into videos and improves the efficiency of generating videos corresponding to PPT files. Further, the video editor can be used to parse the multimedia elements and their original attribute information of each file page in the data format supported by the video editor, and the timeline corresponding to each multimedia element can be edited on the canvas page corresponding to each file page, and the display time of each multimedia element can be adjusted to obtain the target attribute information of each original material, and based on the original materials corresponding to any file page and their target attribute information, the video corresponding to any file page is generated. On the one hand, by making a video through a video editor, the efficiency of converting PPT files into videos is improved, and the performance requirements for terminal devices are reduced; on the other hand, through the timeline, the editing operation can be synchronized in the display area corresponding to the video editor in a more efficient manner, and the editing status of the edited original material can be viewed more intuitively, which improves the efficiency of video editing.

[0019] The technical solutions provided by various embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0020] Figure 1 FIG. 1 is a flow chart of a video generation method provided by an exemplary embodiment of the present application. Figure 1 , the method comprising:

[0021] 101. Import a target PPT file, where the target PPT file includes a plurality of file pages, and each file page includes at least one form of multimedia element;

[0022] 102. Parsing multimedia elements and original attribute information contained in each file page;

[0023] 103. Convert the multimedia elements parsed from each file page and its original attribute information into original materials corresponding to each file page and its original attribute information, wherein the original materials have a target data format supported by the video editor;

[0024] 104. Displaying the original material corresponding to each file page in the first display area of ​​the editing interface;

[0025] 105. In response to the loading operation on the first file page, the original material corresponding to the first file page is displayed in a canvas corresponding to the first file page, where the canvas is located in a first display area;

[0026] 106. In the second display area of ​​the editing interface, a time axis corresponding to each original material corresponding to the first file page is displayed, and each original material has its own time axis.

[0027] 107. In response to an editing operation on any time axis, original attribute information of the original material corresponding to any time axis is adjusted to obtain target attribute information;

[0028] 108. Generate a storyboard video corresponding to the first file page according to each original material corresponding to the first file page and its target attribute information.

[0029] In the embodiment of the present application, the type of video editor is not limited. The video editor can be Adobe Premiere Pro, Final Cut Pro X, DaVinci Resolve, Avid Media Composer, iMovie, Filmora (Wondershare Filmora), CyberLink PowerDirector, Lightworks, HitFilmExpress, OpenShot, Shotcut, Adobe Premiere Rush, KineMaster, Magico or WeVideo, etc. The data formats supported by different types of video editors are different. In the embodiment of the present application, the focus is on the video editor that supports the fabric data format. In addition, the present embodiment does not limit the implementation form of the video editor. The video editor can be implemented as a web page, an application, or a small program that depends on some applications to run, etc.

[0030] In the embodiment of the present application, the video editor provides an editing interface, and the editing interface includes at least one display area. For the convenience of description and distinction, the display area is referred to as the first display area. Figure 2a An implementation of the editing interface, such as Figure 2aAs shown, a PPT file loading control is included in the first display area, and in response to a trigger operation on the PPT loading control, a target PPT file can be selected from a PPT file library and imported. This embodiment does not limit the type of content contained in the target PPT file, and the type of content can be, for example, a company profile, a personal profile, an advertisement, a school course, and the like.

[0031] Among them, the PPT file library can be a local file library of the video editor; accordingly, in response to the triggering operation of the PPT loading control, the PPT file selection page will be directly displayed, and multiple selectable PPT files will be displayed on the selection page; in response to the selection operation of the target PPT file, the target PPT file is imported into the video editor. Alternatively, the PPT file library can be a file library provided by a third-party platform; accordingly, in response to the triggering operation of the PPT loading control, a PPT file library acquisition instruction is sent to the third-party platform and a selection page displaying multiple PPT files is received from the third-party platform in response to the PPT file library acquisition instruction; in response to the selection operation of the target PPT file, the target PPT file is acquired from the third-party PPT file library and imported into the video editor.

[0032] In an embodiment of the present application, the target PPT file includes multiple file pages, each file page includes at least one form of multimedia elements, and each multimedia element has original attribute information. Among them, the multimedia elements can be text, pictures, charts, audio, video or audio and video, etc. The original attribute information of the multimedia elements refers to at least one of the display time, display order, display style and display dynamic effect of each multimedia element in its corresponding PPT. Among them, the display time refers to the time point or time period when the multimedia element appears in its corresponding file page when the target PPT file is played; the display order refers to the order of appearance of multiple multimedia elements in the same file page when the target PPT file is played in the form of a slide show; the display style refers to the size, shape, color and other styles of each multimedia element visible to the naked eye when the target PPT file is played in the form of a slide show. For text, the display style also includes the font type of the text; the display dynamic effect refers to the dynamic visual effect of visual images and / or text combined with movement when the target PPT file is played in the form of a slide show. In order to facilitate the generation of the video corresponding to the target PPT file, after importing the target PPT file, the video editor can parse the multimedia elements and their original attribute information contained in each file page.

[0033] In an optional embodiment, file pages can be added / or deleted based on multiple file pages. Specifically, in response to a selection operation on any file page, a control list can be displayed, and the control list includes a delete control and / or an add control; when the control list includes a delete control, in response to a trigger operation on the delete control, any file page is deleted. Alternatively, when the control list includes an add control, in response to a trigger operation on the add control, a new file page is added after any file page.

[0034] In an optional embodiment, the video editor includes a parsing tool, which is used to extract the elements and attribute information contained in each file page. Accordingly, the parsing tool parses the multimedia elements and original attribute information contained in each file page, including: inputting each file page into the parsing tool, reading the multimedia element data in original data format such as text, pictures, charts, audio, video or audio and video in each file page and the original data structure between each multimedia element data, the original data structure contains the original attribute information of each multimedia element and the relationship between each attribute information; based on the original data structure, the original attribute information of each multimedia element is obtained.

[0035] Further, after parsing and obtaining the multiple multimedia elements and their original attribute information contained in each file page, the multimedia elements and their original attribute information parsed from each file page can be converted into the original material and its original attribute information corresponding to each file page, and the original material has a data format supported by the video editor. For the convenience of description and distinction, the data format supported by the video editor is called the target data format.

[0036] Optionally, converting the multimedia elements and their original attribute information parsed from each file page into the original materials and their original attribute information corresponding to each file page includes: recreating each multimedia element object in the target data format using a multimedia element creation tool based on each multimedia element data, and setting the attributes of each corresponding multimedia element object based on the original attribute information of each multimedia element to obtain each original material in the target data format. The target data format may be a fabric format, but is not limited thereto.

[0037] In this embodiment, the original materials corresponding to each file page may be displayed on the editing interface or not, but the editing interface has the function of loading each original material. Figure 2a As shown, after obtaining the original material corresponding to each file page, the original material corresponding to each file page can be displayed in the first display area of ​​the editing interface with each file page as a display unit, that is, the original material corresponding to the same file page is displayed in the same display unit.

[0038] In this embodiment, the video editor also has the function of re-editing the attribute information of the original material. Specifically, when the original material corresponding to any file page is in the canvas corresponding to the file page, the original material corresponding to the file page is in an editable state, wherein, Figure 2a As shown, the canvas is located in the first display area. In response to the loading operation for the first file page, the original material corresponding to the first file page is displayed in the canvas corresponding to the first file page.

[0039] In an optional embodiment, in response to a loading operation on a first file page, the original material corresponding to the first file page is displayed in a canvas corresponding to the first file page, including: in response to the loading operation on the first file page, determining the relative position relationship of each multimedia element in the first file page and the page margins of each multimedia element relative to the first file page; according to the relative position relationship and the page margins, displaying each original material corresponding to the first file page in the canvas corresponding to the first file page.

[0040] In this embodiment, after the original material corresponding to the first file page is displayed in the canvas corresponding to the first file page, first, the editing operation of the display time in the original attribute information of each original element is described in detail as follows.

[0041] In this embodiment, each original material corresponds to its own timeline, and the timeline has the property of editing the display time of each original material. The timeline can be generated in the following manner: First, a track line is generated according to the default timeline style, wherein Canvas can be called to draw the track line according to the default timeline style. Wherein, Canvas is a drawing tool that can execute drawing commands based on JavaScript (a programming language). Afterwards, the background color of the track line can be determined according to the type of the original material. Wherein, the background color of the track line can be determined according to the correspondence between the preset type and the background color of the track line and the type of the original material, and different types of original materials correspond to different background colors. Then, a background color can be added to the track line axis to obtain a timeline. In this way, the type of the original material is different, and the background color of the generated timeline is also different, so that the user can distinguish different types of timelines during video processing and reduce the risk of incorrect editing.

[0042] In this embodiment, the editing interface also includes another display area. For the convenience of description and distinction, the other display area is referred to as the second display area. Figure 2a As shown, after the timeline is generated, the timelines corresponding to the various original materials corresponding to the first file page may be displayed in the second display area of ​​the editing interface.

[0043] In some optional embodiments, in the second display area of ​​the editing interface, the time axis corresponding to each original material corresponding to the first file page may be displayed based on the following steps R1-R3:

[0044] Step R1: Determine the first position corresponding to the horizontal time base of the second display area according to the start time of the original material. The horizontal time base can be used as the time base of each time axis, such as Figure 2a As shown, the line between point A and point B is the horizontal time baseline. Since the start time of the horizontal time baseline is 00:00, the corresponding first position on the horizontal time baseline of the second display area can be determined according to the start time of the original material and the start time of the horizontal time baseline.

[0045] Step R2: Determine the second position corresponding to the time axis on the vertical position baseline of the second display area according to the hierarchical relationship of the original materials in the same file page. For example, the hierarchical relationship between the original materials A and B is: the level of the original material A is above the level of the original material B, then the second position corresponding to the time axis of the original material A on the vertical position baseline of the second display area is also above the time axis corresponding to the original material B.

[0046] In addition, the second position corresponding to the time axis on the vertical position baseline of the second display area can also be determined according to the positional relationship between the original material A and the original material B in the file page. For example, if the positional relationship between the original material A and the original material B in the target video is that the original material A is displayed below the original material B, then the second position corresponding to the time axis on the vertical position baseline of the second display area is also below the time axis corresponding to the original material B.

[0047] Step R3, taking the intersection of the first position and the second position as the starting position of the time axis, and displaying the time axis in the second display area; wherein the positional relationship of each time axis on the vertical position baseline in the second display area represents the hierarchical relationship or positional relationship of the corresponding original materials in the file.

[0048] Based on the above steps R1 to R3, the starting position of the time axis can be determined more accurately according to the starting time of the original material 1 and the hierarchical relationship or positional relationship between the original material 1 and the original material 2 in the file page. Based on this method, the arrangement logic between the various time axes presented in the second display area can correspond to the arrangement logic of the various original materials in the first display area in the file page, so that the user can more intuitively perceive the relationship between the various original materials in the first display area and the various time axes in the second display area.

[0049] Furthermore, after the timelines corresponding to the original materials corresponding to the first file page are displayed in the second display area of ​​the editing interface, the original attribute information of the original materials corresponding to any timeline can be adjusted in response to the editing operation of any timeline to obtain the target attribute information.

[0050] In an optional embodiment, in response to an editing operation on any timeline, original attribute information of the original material corresponding to any timeline is adjusted to obtain target attribute information, including: in response to each editing operation on any timeline, any timeline is highlighted, and type information and operation data of each editing operation are determined; original attribute information to be adjusted according to the type information of each editing operation, and attribute values ​​of the original attribute information to be adjusted according to the operation data of each editing operation to obtain target attribute information.

[0051] The editing operation includes one of a time dragging operation, a position dragging operation, a cropping operation, an original element adding operation or a scaling operation. The time dragging operation includes dragging the horizontal time base line, the position dragging operation includes dragging the position of each time axis vertically, the cropping operation is used to crop the length of the time axis, the original element adding operation is used to add the time axis of the original element at the corresponding position when adding the original object, and the scaling operation is used to adjust the size of each time axis display style; the type information of the editing operation is determined based on the editing action; the operation data represents the final attribute value, and the final attribute value can be, for example, the final display time corresponding to the original element, the final relative position of each time axis, and the size of each time axis display style.

[0052] In addition, the embodiments of the present application do not limit the implementation method of highlighting, for example, it can be a color change display, a flashing display, a bold border display, or a highlight mark added to the first timeline, etc. Specifically, the editing effect on the first timeline can be highlighted according to the type of editing operation, and different editing operations correspond to different editing effects. For example, if the type of editing operation is a selected type, the corresponding editing effect can be a bold border display; for another example, if the type of editing operation is a zoom type, the corresponding editing effect can be a flashing display.

[0053] In some optional embodiments, when the editing operation is a drag operation, it is possible to monitor whether the start time or end time of one time axis coincides with the end time or start time of another time axis based on the track information of the drag operation. Figure 2bAs shown, when overlap occurs, an adsorption effect can be displayed in the overlap position or related area of ​​the two overlapping timelines, and a prompt auxiliary line can be used for prompting. Among them, the prompt auxiliary line is used to show the overlap effect of the two timelines where the end time overlaps or the start time overlaps. Optionally, a drag control is also displayed at the starting position of a timeline, wherein the drag control can be linked to the timeline. The drag control can be implemented as a control for auxiliary dragging, and can also be implemented as other types of controls, which is not limited in this embodiment. When the editing operation is a drag operation, in response to the drag operation of the drag control, a drag operation is initiated on the first timeline. In this way, the first timeline can be dragged more efficiently by dragging the drag control.

[0054] Secondly, the editing operations of adding auxiliary materials and other original attribute information other than the display time in the original attribute information of each original material are described in detail as follows, that is, the editing operations of the display order, display style and display animation of the original materials are described in detail as follows.

[0055] In this embodiment, the editing operations on other original attribute information include at least: one of: a position dragging operation, a cropping operation, an object adding operation or a scaling operation; wherein the cropping operation is used to adjust the display content of each original material, the scaling operation is used to adjust the size of the display style of each original material, the position dragging operation is used to adjust the position of each original material, and the object adding operation is used to adjust or add display effects.

[0056] Furthermore, the editing interface also includes a third display area, the third display area includes at least one material adding control, and in response to a triggering operation on any material adding control, obtains the auxiliary material added to the first file page, and configures the original attribute information of the auxiliary material; displays the auxiliary material in the canvas corresponding to the first file page, and displays the timeline corresponding to the auxiliary material in the second display area; and in response to an editing operation on the timeline corresponding to the auxiliary material, adjusts the original attribute information of the auxiliary material to obtain the target attribute information. Figure 2c As shown, it is an example of the third display area, which includes digital human selection items, map selection items, background selection items, text selection items, and video selection items. Among them, the digital human selection item is used to select a target digital human template from multiple digital human templates, the map selection item is used to select a target map for each file page from multiple maps, the background selection item is used to select a target background image for each file page from multiple background images, the text selection item is used to select the target font for each word in the file page, and the video selection item is used to select the target video to be added to the file. In addition, when selecting items in the digital human selection item, map selection item, background selection item, text selection item, and video selection item, in addition to selecting from the provided materials, the user can also provide custom materials.

[0057] Furthermore, the editing interface further includes a fourth display area, which includes at least text configuration options, audio configuration options, etc. The text configuration options are used to configure the text in each file page, and the audio configuration options are used to configure the audio to be added to the file page.

[0058] In the embodiment of the present application, after completing the editing operations on the original materials, a storyboard video corresponding to the first file page can be generated according to the original materials corresponding to the first file page and their target attribute information.

[0059] In an optional embodiment, a storyboard video corresponding to the first file page is generated according to each original material corresponding to the first file page and its target attribute information, including: determining a script structure between each original material corresponding to the first file page according to the target attribute information of each original material corresponding to the first file page, the script structure including the association between each original material and its attribute information; generating script content based on each original material corresponding to the first file page and the script structure using an artificial intelligence big model, the script content including spoken text and storyboard description information; determining a digital human image corresponding to the first file page according to the screen content; converting the spoken text into spoken audio based on the digital human image; and synthesizing the storyboard description information, spoken audio and the digital human image to obtain the storyboard video corresponding to the first file page.

[0060] In an optional embodiment, the script content is generated based on the original materials and the script structure corresponding to the first file page using the artificial intelligence big model, including: using the first artificial big model based on the video content description information and the script structure to generate the oral copy of the storyboard corresponding to the first file page; using the second artificial intelligence big model based on the oral copy of each storyboard to generate the storyboard description information corresponding to the first file page. Among them, the oral copy can include the narration or dialogue text in the current storyboard, and the storyboard description information can be used to illustrate the visual content of each storyboard, for example, it can include scene layout, character action, original material attribute information, etc. The first artificial intelligence big model can understand the overall framework of the video and the order of each storyboard based on the script structure, and understand the basis of the script content based on the video content description information of the target object, so that the script content of each storyboard can be intelligently generated. The storyboard description information can make the picture of the generated storyboard video accurately convey the expected information and emotions, and can also maintain coordination and consistency with the oral copy. Among them, the first artificial intelligence model and the second artificial intelligence model are AI intelligent models. The first artificial intelligence large model can also integrate the video content description information into the script based on the provided video content description information and the script structure through understanding the video content description information, and generate a spoken copy that conforms to the script structure and storyboard. The second artificial intelligence large model can generate storyboard description information for describing the visual content corresponding to the spoken copy through understanding the spoken copy, so that the visual effects presented in the generated storyboard video match the spoken content. Thus, through the collaborative work of the first video generation model and the second video generation model, high-quality script content can be efficiently generated, and the copy in the script content is closely integrated with the visual effects.

[0061] In an optional embodiment, the first artificial intelligence model is used to generate a storyboard oral copy based on the video content description information and the script structure, including: obtaining a script template and script requirements corresponding to the script structure; generating a first prompt word according to the first prompt template based on the video content description information, the script template and the script requirements; inputting the first prompt word into the first artificial intelligence model, so as to use the first artificial intelligence model to generate a storyboard oral copy based on the video content description information, the script template and the script requirements according to the script requirements. Among them, the script template may refer to the script content pre-generated under the script structure. The first prompt template may be a predefined framework or structure for guiding and standardizing the content input into the first artificial intelligence model. In an embodiment of the present application, the first prompt template may include elements such as script structure, target audience, copy length, format requirements, language and tone, and specific requirements. The first prompt word can be generated by filling the video content description information, the script template and the script requirements into the corresponding elements of the first prompt template, and by inputting the first prompt word into the first artificial intelligence model, the first artificial intelligence model can generate a storyboard oral copy based on the video content description information, the script template and the script requirements according to the script requirements.

[0062] It should be noted that the first artificial intelligence model can also parse the images and video content contained in each file page to obtain the content information implied in the images or videos, and the video content description information can include the content information implied in the images or videos.

[0063] In an optional embodiment, according to the screen content, the digital human image corresponding to the first file page is determined, including: according to the screen content, the gender attribute and virtual job position of the digital human used for video explanation are determined, and the virtual job position corresponds to the real job position of the person explaining the target PPT file in real life; according to the virtual job position, the style of the digital human is determined; according to the style and gender attribute of the digital human, the final digital human image is determined. For example, the style of the confinement nanny is female, holding a child and wearing confinement nanny clothing, then the corresponding digital human image is a female image holding a child and wearing confinement nanny clothing.

[0064] In an optional embodiment, based on the digital human image, the spoken text is converted into spoken audio, including: obtaining the gender attribute of the digital human image; determining the timbre of the digital human according to the gender attribute; and converting the spoken text into spoken audio adapted to the timbre of the digital human.

[0065] Furthermore, each storyboard video has identification information, and the identification information is used to characterize the playback order of the storyboard video. Based on this, when generating the storyboard video corresponding to each file page, the storyboard videos are spliced ​​according to the identification information of the storyboard video corresponding to each file page to obtain the target video corresponding to the target PPT file.

[0066] It can be seen from some of the above-mentioned embodiments that auxiliary materials can be added on the basis of the original materials. After the auxiliary materials are added, accordingly, according to the original materials corresponding to the first file page and their target attribute information, a storyboard video corresponding to the first file page is generated, including: according to the original materials and auxiliary materials corresponding to the first file page and their target attribute information, a storyboard video corresponding to the first file page is generated.

[0067] Further optionally, the editing interface also includes a cover setting control. After obtaining the target video, it can respond to the triggering operation of the cover setting control to display multiple file pages; in response to the file page selection operation, select the second file page from the multiple file pages; add the second file page to the starting position of the target video as the cover of the target video.

[0068] In the above embodiments of the present application, a video editor is used to generate a storyboard video corresponding to each file page of the target PPT file, which enriches the way of converting PPT files into videos and improves the efficiency of generating videos corresponding to PPT files. Further, the video editor can be used to parse the multimedia elements and their original attribute information of each file page in a data format supported by the video editor, and the timeline corresponding to each multimedia element can be edited on the canvas page corresponding to each file page, and the display time of each multimedia element can be adjusted to obtain the target attribute information of each original material, and based on the original materials corresponding to any file page and their target attribute information, a video corresponding to any file page is generated. On the one hand, by making a video through a video editor, the efficiency of converting PPT files into videos is improved, and the performance requirements for terminal devices are reduced; on the other hand, through the timeline, the editing operation can be synchronized in the display area corresponding to the video editor in a more efficient manner, and the editing status of the edited original material can be viewed more intuitively, which improves the efficiency of video editing.

[0069] Figure 3 A video generation device is provided for an exemplary embodiment of the present application. Figure 3 As shown, the device comprises:

[0070] An import module 31 is used to import a target PPT file, where the target PPT file includes a plurality of file pages, and each file page includes at least one form of multimedia element;

[0071] A parsing module 32, used for parsing the multimedia elements and their original attribute information contained in each file page;

[0072] A conversion module 33, used for converting the multimedia elements and their original attribute information parsed from each file page into the original material and their original attribute information corresponding to each file page, the original material having a target data format supported by the video editor;

[0073] A display module 34, used to display the original material corresponding to each file page in the first display area of ​​the editing interface;

[0074] The loading module 35 is used to respond to the loading operation on the first file page and display the original material corresponding to the first file page in the canvas corresponding to the first file page, where the canvas is located in the first display area;

[0075] A display module 36, used to display the time axis corresponding to each original material corresponding to the first file page in the second display area of ​​the editing interface, each original material corresponding to its own time axis;

[0076] An adjustment module 37, for responding to an editing operation on any time axis, adjusting original attribute information of the original material corresponding to any time axis to obtain target attribute information;

[0077] The generating module 38 is used to generate the storyboard video corresponding to the first file page according to the original materials corresponding to the first file page and the target attribute information thereof.

[0078] Further optionally, each storyboard video has identification information, and the identification information is used to characterize the playback order of the storyboard video. Then the generating module 38 is further used to, when generating the storyboard video corresponding to each file page, splice the storyboard videos according to the identification information of the storyboard video corresponding to each file page to obtain the target video corresponding to the target PPT file.

[0079] In an optional embodiment, when the generation module 38 generates the storyboard video corresponding to the first file page according to the original materials corresponding to the first file page and their target attribute information, it is specifically used to: determine the script structure between the original materials corresponding to the first file page according to the target attribute information of the original materials corresponding to the first file page; generate script content based on the original materials corresponding to the first file page and the script structure using an artificial intelligence big model, the script content including spoken text and picture content; determine the digital human image corresponding to the first file page according to the picture content; convert the spoken text into spoken audio based on the digital human image; synthesize the picture content, spoken audio and the digital human image to obtain the storyboard video corresponding to the first file page.

[0080] In this embodiment, the original attribute information of the original material includes at least one of display time, display order, display style and display animation; when the adjustment module 37 responds to the editing operation on any timeline and adjusts the original attribute information of the original material corresponding to any timeline to obtain the target attribute information, it is specifically used to: respond to each editing operation on any timeline, highlight any timeline, and determine the type information and operation data of each editing operation, different types of editing operations are used to adjust different original attribute information; determine the original attribute information to be adjusted according to the type information of each editing operation, and adjust the attribute value of the original attribute information to be adjusted according to the operation data of each editing operation to obtain the target attribute information.

[0081] Further optionally, the editing operation includes at least one of: a time drag operation, a position drag operation, a cropping operation, an object adding operation or a zooming operation; wherein the time drag operation is used to adjust the display time, the cropping operation is used to adjust the display content, the zooming operation is used to adjust the size in the display style, the position drag operation is used to adjust the display order, and the object adding operation is used to adjust or add display animations.

[0082] Further optionally, the editing interface also includes a third display area, the third display area includes at least one material adding control; before generating the storyboard video corresponding to the first file page, the adjustment module 37 is also used to respond to the triggering operation of any material adding control, obtain the auxiliary material added for the first file page, and configure the original attribute information of the auxiliary material; display the auxiliary material in the canvas corresponding to the first file page, and display the timeline corresponding to the auxiliary material in the second display area; and in response to the editing operation of the timeline corresponding to the auxiliary material, adjust the original attribute information of the auxiliary material to obtain the target attribute information.

[0083] Correspondingly, when the generation module 38 generates the storyboard video corresponding to the first file page according to the original materials corresponding to the first file page and their target attribute information, it is specifically used to: generate the storyboard video corresponding to the first file page according to the original materials and auxiliary materials corresponding to the first file page and their target attribute information.

[0084] Further optionally, the editing interface also includes a cover setting control, and the device also includes a setting module; after obtaining the target video, the setting module is used to respond to the trigger operation of the cover setting control and display multiple file pages; in response to the file page selection operation, select the second file page from the multiple file pages; add the second file page to the starting position of the target video as the cover of the target video.

[0085] In an optional embodiment, when the loading module 35 responds to a loading operation on the first file page and displays the original material corresponding to the first file page in the canvas corresponding to the first file page, it is specifically used to: respond to the loading operation on the first file page, determine the relative position relationship of each multimedia element in the first file page and the page margins of each multimedia element relative to the first file page; display each original material corresponding to the first file page in the canvas corresponding to the first file page according to the relative position relationship and the page margins.

[0086] Further optionally, a modification module is also included, which is used to display a control list in response to a selection operation on any file page, and the control list includes a delete control and / or an add control; when the control list includes a delete control, in response to a trigger operation on the delete control, any file page is deleted; or, when the control list includes an add control, in response to a trigger operation on the add control, a new file page is added after any file page.

[0087] The detailed implementation and beneficial effects of each module provided in the embodiments of the present application have been described in detail in the aforementioned embodiments and will not be elaborated here.

[0088] Figure 4 The following is a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of the present application. Figure 4 As shown, the electronic device includes: a memory 40a and a processor 40b; wherein the memory 40a is used to: store one or more computer instructions; the processor 40b is used to execute one or more computer instructions to perform the following steps:

[0089] Import a target PPT file, the target PPT file includes multiple file pages, each file page includes at least one form of multimedia elements; parse the multimedia elements contained in each file page and their original attribute information; convert the multimedia elements and their original attribute information parsed from each file page into original materials and their original attribute information corresponding to each file page, the original materials have a target data format supported by the video editor; display the original materials corresponding to each file page in a first display area of ​​the editing interface; in response to a loading operation on the first file page, display the original materials corresponding to the first file page in a canvas corresponding to the first file page, the canvas is located in the first display area; in a second display area of ​​the editing interface, display the timelines corresponding to the various original materials corresponding to the first file page, each original material corresponding to its own timeline; in response to an editing operation on any timeline, adjust the original attribute information of the original materials corresponding to any timeline to obtain the target attribute information; generate a storyboard video corresponding to the first file page according to the various original materials corresponding to the first file page and their target attribute information.

[0090] Further optionally, each storyboard video has identification information, and the identification information is used to characterize the playback order of the storyboard video. Then the processor 40b is further used to, when generating the storyboard video corresponding to each file page, splice the storyboard videos according to the identification information of the storyboard video corresponding to each file page to obtain the target video corresponding to the target PPT file.

[0091] In an optional embodiment, when the processor 40b generates a storyboard video corresponding to the first file page based on the original materials corresponding to the first file page and their target attribute information, it is specifically used to: determine the script structure between the original materials corresponding to the first file page based on the target attribute information of the original materials corresponding to the first file page; generate script content based on the original materials corresponding to the first file page and the script structure using an artificial intelligence big model, the script content including spoken text and picture content; determine the digital human image corresponding to the first file page based on the picture content; convert the spoken text into spoken audio based on the digital human image; synthesize the picture content, spoken audio and the digital human image to obtain the storyboard video corresponding to the first file page.

[0092] In this embodiment, the original attribute information of the original material includes at least one of display time, display order, display style and display animation; when the processor 40b responds to an editing operation on any timeline and adjusts the original attribute information of the original material corresponding to any timeline to obtain target attribute information, it is specifically used to: respond to each editing operation on any timeline, highlight any timeline, and determine the type information and operation data of each editing operation, different types of editing operations are used to adjust different original attribute information; determine the original attribute information to be adjusted according to the type information of each editing operation, and adjust the attribute value of the original attribute information to be adjusted according to the operation data of each editing operation to obtain the target attribute information.

[0093] Further optionally, the editing operation includes at least one of: a time drag operation, a position drag operation, a cropping operation, an object adding operation or a zooming operation; wherein the time drag operation is used to adjust the display time, the cropping operation is used to adjust the display content, the zooming operation is used to adjust the size in the display style, the position drag operation is used to adjust the display order, and the object adding operation is used to adjust or add display animations.

[0094] Further optionally, the editing interface also includes a third display area, the third display area includes at least one material adding control; before generating the storyboard video corresponding to the first file page, the processor 40b is also used to respond to the triggering operation of any material adding control, obtain the auxiliary material added for the first file page, and configure the original attribute information of the auxiliary material; display the auxiliary material in the canvas corresponding to the first file page, and display the timeline corresponding to the auxiliary material in the second display area; and in response to the editing operation of the timeline corresponding to the auxiliary material, adjust the original attribute information of the auxiliary material to obtain the target attribute information.

[0095] Correspondingly, when the processor 40b generates the storyboard video corresponding to the first file page according to the original materials corresponding to the first file page and their target attribute information, it is specifically used to: generate the storyboard video corresponding to the first file page according to the original materials and auxiliary materials corresponding to the first file page and their target attribute information.

[0096] Further optionally, the editing interface also includes a cover setting control, and the device also includes a setting module; after obtaining the target video, the setting module is used to respond to the trigger operation of the cover setting control and display multiple file pages; in response to the file page selection operation, select the second file page from the multiple file pages; add the second file page to the starting position of the target video as the cover of the target video.

[0097] In an optional embodiment, when the processor 40b responds to a loading operation on the first file page and displays the original material corresponding to the first file page in the canvas corresponding to the first file page, it is specifically used to: respond to the loading operation on the first file page, determine the relative position relationship of each multimedia element in the first file page in the first file page and the page margins of each multimedia element relative to the first file page; display each original material corresponding to the first file page in the canvas corresponding to the first file page according to the relative position relationship and the page margins.

[0098] Further optionally, the processor 40b is also used to display a control list in response to a selection operation on any file page, the control list including a delete control and / or an add control; when the control list includes a delete control, in response to a trigger operation on the delete control, any file page is deleted; or, when the control list includes an add control, in response to a trigger operation on the add control, a new file page is added after any file page.

[0099] Furthermore, if Figure 4 As shown, the electronic device also includes: a communication component 40c, a display 40d, a power component 40e, an audio component 40f and other components. Figure 4 Only some components are shown schematically, which does not mean that the electronic device only includes Figure 4Components shown.

[0100] The detailed implementation and beneficial effects of each module provided in the embodiments of the present application have been described in detail in the aforementioned embodiments and will not be elaborated here.

[0101] An exemplary embodiment of the present application further provides a computer-readable storage medium, which enables the processor to implement the steps in the above method when the computer program is executed by the processor.

[0102] An exemplary embodiment of the present application provides a computer program product, which includes a computer program / instruction. When the computer program / instruction is executed by a processor, the steps in the above method are executed.

[0103] The above-mentioned memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0104] The above-mentioned communication component is configured to facilitate wired or wireless communication between the device where the communication component is located and other devices. The device where the communication component is located can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G / LTE, 5G and other mobile communication networks, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (Ultra Wide Band, UWB) technology, Bluetooth (BlueTooth, BT) technology and other technologies.

[0105] The above-mentioned display includes a screen, and the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

[0106] The power supply assembly provides power to various components of the device where the power supply assembly is located. The power supply assembly may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device where the power supply assembly is located.

[0107] The above-mentioned audio component can be configured to output and / or input audio signals. For example, the audio component includes a microphone (Microphone, MIC), and when the device where the audio component is located is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in a memory or sent via a communication component. In some embodiments, the audio component also includes a speaker for outputting an audio signal.

[0108] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, compact disk read-only memory (Compact Disk Read-Only Memory, CD-ROM), optical storage, etc.) that contain computer-usable program code.

[0109] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0110] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0111] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0112] In a typical configuration, a computing device includes one or more processors (Central Processing Unit, CPU), input / output interface, network interface and memory.

[0113] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash memory (flashRAM). The memory is an example of a computer-readable medium.

[0114] Computer-readable media include permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase-change random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory media such as modulated data signals and carrier waves.

[0115] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0116] The above are only embodiments of the present application and are not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included within the scope of the claims of the present application.

Claims

1. A video generation method, It is characterized in that Applied to a video editor, the video editor provides an editing interface, the method comprising: Importing a target PPT file, wherein the target PPT file includes a plurality of file pages, and each file page includes at least one form of multimedia element; Parse the multimedia elements and their original attribute information contained in each file page; Converting the multimedia elements and their original attribute information parsed from each file page into original materials and their original attribute information corresponding to each file page, wherein the original materials have a target data format supported by the video editor; Displaying the original material corresponding to each file page in the first display area of ​​the editing interface; and in response to a loading operation on a first file page, displaying the original material corresponding to the first file page in a canvas corresponding to the first file page, the canvas being located in the first display area; In the second display area of ​​the editing interface, the time axis corresponding to each original material corresponding to the first file page is displayed, each original material corresponds to its own time axis; and in response to an editing operation on any time axis, the original attribute information of the original material corresponding to the any time axis is adjusted to obtain target attribute information; A storyboard video corresponding to the first file page is generated according to each original material corresponding to the first file page and its target attribute information.

2. The method according to claim 1, It is characterized in that Each storyboard video has identification information, and the identification information is used to represent the playback order of the storyboard video. The method further includes: When generating the storyboard video corresponding to each file page, the storyboard videos are spliced ​​according to the identification information of the storyboard video corresponding to each file page to obtain the target video corresponding to the target PPT file.

3. The method according to claim 1, It is characterized in that Generating a storyboard video corresponding to the first file page according to each original material corresponding to the first file page and its target attribute information, including: Determining the script structure between the original materials corresponding to the first file page according to the target attribute information of the original materials corresponding to the first file page; Generate script content by using the artificial intelligence model based on the original materials and script structure corresponding to the first file page, wherein the script content includes oral text and screen content; Determining the digital human image corresponding to the first file page according to the screen content; Based on the digital human image, converting the spoken text into spoken audio; The screen content, the spoken audio and the digital human image are synthesized to obtain a storyboard video corresponding to the first file page.

4. The method according to claim 1, It is characterized in that The original attribute information of the original material includes at least one of display time, display order, display style and display animation; in response to an editing operation on any timeline, adjusting the original attribute information of the original material corresponding to any timeline to obtain target attribute information, including: In response to each editing operation on any time axis, highlighting the time axis and determining type information and operation data of each editing operation, where different types of editing operations are used to adjust different original attribute information; The original attribute information to be adjusted is determined according to the type information of each editing operation, and the attribute value of the original attribute information to be adjusted is adjusted according to the operation data of each editing operation to obtain the target attribute information.

5. The method according to claim 4, It is characterized in that The editing operation includes at least one of: a time dragging operation, a position dragging operation, a cropping operation, an object adding operation or a zooming operation; Among them, the time dragging operation is used to adjust the display time, the cropping operation is used to adjust the display content, the zooming operation is used to adjust the size in the display style, the position dragging operation is used to adjust the display order, and the object adding operation is used to adjust or add display animations.

6. The method according to claim 1, It is characterized in that The editing interface further includes a third display area, and the third display area includes at least one material adding control; Before generating the storyboard video corresponding to the first file page, the method further includes: In response to a triggering operation of adding any material control, the auxiliary material added to the first file page is acquired, and original attribute information of the auxiliary material is configured; Displaying the auxiliary material in a canvas corresponding to the first file page, and displaying a timeline corresponding to the auxiliary material in the second display area; and In response to an editing operation on a timeline corresponding to the auxiliary material, adjusting original attribute information of the auxiliary material to obtain target attribute information; Accordingly, generating a storyboard video corresponding to the first file page according to each original material corresponding to the first file page and its target attribute information includes: A storyboard video corresponding to the first file page is generated according to each original material and auxiliary material corresponding to the first file page and their target attribute information.

7. The method according to claim 2, It is characterized in that The editing interface also includes a cover setting control, and the method further includes: After obtaining the target video, responding to a triggering operation on the cover setting control, displaying the multiple file pages; In response to a file page selection operation, selecting a second file page from the plurality of file pages; The second file page is added to the beginning of the target video to serve as the cover of the target video.

8. The method according to any one of claims 1 to 7, It is characterized in that In response to the loading operation on the first file page, displaying the original material corresponding to the first file page in the canvas corresponding to the first file page includes: In response to a loading operation on a first file page, determining a relative position relationship of each multimedia element in the first file page and a page margin of each multimedia element relative to the first file page; According to the relative position relationship and the page margin, each original material corresponding to the first file page is displayed in the canvas corresponding to the first file page.

9. The method according to any one of claims 1 to 7, It is characterized in that Also includes: In response to a selection operation on any file page, a control list is displayed, wherein the control list includes a delete control and / or an add control; In the case where the control list includes the delete control, in response to a triggering operation on the delete control, deleting any one of the file pages; or In the case where the add control is included in the control list, in response to a triggering operation on the add control, a new file page is added after any file page.

10. An electronic device, It is characterized in that include: A memory and a processor; wherein the memory is used to: store one or more computer instructions; The processor is configured to execute the one or more computer instructions to perform the steps in the method according to any one of claims 1 to 9.

11. A computer-readable storage medium, It is characterized in that When the computer program is executed by a processor, the processor is enabled to implement the steps in the method according to any one of claims 1 to 9.

12. A computer program product, It is characterized in that The method comprises a computer program / instruction, and when the computer program / instruction is executed by a processor, the steps in the method according to any one of claims 1 to 9 are performed.

Images