Video generation method and device, and electronic equipment

By converting the text of mind maps into audio and generating intermediate videos, the problem of automatic video generation is solved, achieving an efficient and automated video generation process, which improves information transmission efficiency and video quality.

CN118945439APending Publication Date: 2024-11-12SHENZHEN EDRAW SOFTWARE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411018782.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing technologies lack tools for automatically generating mind map videos. Users need to manually record audio, which is cumbersome, and there is no automatic voice generation function.

Method used

The process involves converting the text content of the mind map into an audio file, generating intermediate video files based on the topic tree structure, and finally synthesizing the final video file. This includes hierarchical traversal of topics, automatic layout, motion trajectory calculation, and rendering.

Benefits of technology

It enables the rapid generation of high-quality mind map videos, simplifies the operation process, and improves the efficiency and appeal of information delivery.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945439A_ABST
    Figure CN118945439A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a video generation method. The video generation method comprises the following steps: converting text content of a mind map into an audio file; converting the mind map into an intermediate video file according to a topic tree structure of the mind map; and synthesizing the audio file and the intermediate video file to form a final version video file. According to the video generation method provided by the embodiment of the invention, the mind map can be quickly generated into the video file. The embodiment of the invention further provides a video generation device and electronic equipment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of image processing technology, and more specifically, to a video generation method, device, and electronic device. Background Art

[0002] As an effective way to organize and present information, mind mapping is widely used in various fields. Converting static mind mapping into dynamic video format can further improve the efficiency and attractiveness of information transmission.

[0003] There are no mind mapping products on the market that can automatically generate videos. However, in other drawing or document products, such as Microsoft's PowerPoint (presentation) software, the software provides a PPT export video function. When exporting videos, all recorded timings, narrations, ink strokes, and laser pen gestures can be included, and animations, transitions, and media can be retained, as well as the specified time for each slide to stay.

[0004] The PowerPoint video export function basically exports the effect of PPT playback in the form of a video. All materials for generating the video need to be created by the user, which is a cumbersome operation. In addition, there is no automatic voice generation function, so users need to record it themselves. Summary of the invention

[0005] In view of the problems existing in the above-mentioned prior art, the embodiments of the present application provide a video generation method, device, and electronic device, which can quickly generate a video file from a mind map.

[0006] In a first aspect, an embodiment of the present application provides a video generation method, comprising:

[0007] Convert the text content of the mind map into an audio file;

[0008] According to the subject tree structure of the mind map, converting the mind map into an intermediate video file; and

[0009] The audio file and the intermediate video file are synthesized to form a final version of the video file.

[0010] Furthermore, converting the mind map into an intermediate video file according to the subject tree structure of the mind map includes:

[0011] Traverse the topics of the mind map in layers;

[0012] Automatically layout the pages of the mind map according to the theme of the mind map;

[0013] According to the theme of the mind map, calculating the movement trajectory of the mind map when the theme is switched; and

[0014] The motion track is placed in a timeline to smoothly transition the topic switching of the mind map.

[0015] Furthermore, after automatically laying out the pages of the mind map according to the theme of the mind map, the method further includes:

[0016] The mind map page after automatic layout is rendered.

[0017] Furthermore, after rendering the mind map page after automatic layout, the method further includes:

[0018] A highlight layer overlay process is performed on the mind map page after the rendering operation.

[0019] Furthermore, before converting the text content of the mind map into an audio file, the method further includes:

[0020] Set the video generation parameters of the final version video file.

[0021] Furthermore, after synthesizing the audio file and the intermediate video file to form a final version of the video file, the method further includes:

[0022] The generated final version video file is stored in the cloud.

[0023] Furthermore, converting the text content of the mind map into an audio file includes:

[0024] The text content of the mind map is converted into an audio file through TTS technology.

[0025] In a second aspect, the embodiment of the present application further provides a video generating device, including:

[0026] Audio conversion module, used to convert the text content of the mind map into audio files;

[0027] a video conversion module, for converting the mind map into an intermediate video file according to the subject tree structure of the mind map; and

[0028] The video synthesis module is used to synthesize the audio file and the intermediate video file to form a final version video file.

[0029] In a third aspect, an embodiment of the present application further provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor is configured to implement the video generation method according to the first aspect when executing the program.

[0030] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored, wherein the computer program is used to implement the video generation method according to the first aspect above.

[0031] In a fifth aspect, an embodiment of the present application further provides a computer program product on which a computer program is stored, wherein the computer program is used to implement the video generation method according to the first aspect above.

[0032] The embodiments of the present application bring the following beneficial effects:

[0033] The video generation method provided in the embodiment of the present application first converts the text content of the mind map into an audio file, and converts the mind map into an intermediate video file according to the subject tree structure of the mind map, and finally synthesizes the audio file and the intermediate video file to form a final version of the video file, thereby being able to quickly convert the mind map into a video file, facilitating the demonstration and dissemination of the file content. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0035] Figure 1 A schematic diagram of a flow chart of a video generation method provided in an embodiment of the present application;

[0036] Figure 2 A schematic diagram of the structure of a mind map provided in an embodiment of the present application;

[0037] Figure 3 A structural block diagram of a video generation device provided in an embodiment of the present application;

[0038] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0039] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments described in the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0041] In the specification and claims of this application and the above-mentioned drawings, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "multiple" means two or more. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to the specific circumstances.

[0042] Figure 1 FIG. 1 is a flow chart of a video generation method according to an embodiment of the present application. Figure 1 As shown, the video generation method of the embodiment of the present application includes the following steps:

[0043] S101: Convert the text content of the mind map into an audio file;

[0044] Specifically, see Figure 2 The main structure of the mind map is a theme tree composed of multiple theme nodes, including central themes, first-level themes, second-level themes, and even N-level themes. The mind map includes text content. First, the text content of the mind map needs to be converted into an audio file, which will become part of the final video file.

[0045] S102: converting the mind map into an intermediate video file according to the subject tree structure of the mind map;

[0046] Specifically, as mentioned above, the main structure of the mind map is a theme tree composed of multiple theme nodes, including central themes, first-level themes, second-level themes, and even N-level themes. According to the theme tree structure of the mind map, by analyzing the internal relationships and connections of each theme, the mind map is converted into an intermediate video file, thereby preparing for subsequent operations.

[0047] S103: synthesizing the audio file and the intermediate video file to form a final version video file.

[0048] Specifically, after the text content of the mind map is converted into an audio file, and the mind map is converted into an intermediate video file according to the subject tree structure of the mind map, the audio file and the intermediate video file are synthesized to form a final version of the video file.

[0049] Therefore, the video generation method provided in the embodiment of the present application first converts the text content of the mind map into an audio file, and converts the mind map into an intermediate video file based on the subject tree structure of the mind map, and finally synthesizes the audio file and the intermediate video file to form a final version of the video file, thereby being able to quickly convert the mind map into a video file, facilitating the demonstration and dissemination of the file content.

[0050] Further, in some embodiments of the present application, converting the mind map into an intermediate video file according to the subject tree structure of the mind map includes:

[0051] Traverse the topics of the mind map in layers;

[0052] Automatically layout the pages of the mind map according to the theme of the mind map;

[0053] According to the theme of the mind map, calculating the movement trajectory of the mind map when the theme is switched; and

[0054] The motion track is placed in a timeline to smoothly transition the topic switching of the mind map.

[0055] Specifically, as mentioned above, the main structure of the mind map is a theme tree composed of multiple theme nodes, including a central theme, a primary theme, a secondary theme, and even an N-level theme. Based on the characteristics of this structure, the basic principle of constructing the mind map video screen is: hierarchically traverse the theme of the mind map, that is, traverse the mind map theme tree, obtain the themes of each level to be displayed, and traverse hierarchically from the central theme based on the theme node hierarchy and content relevance, so as to determine the order of the video content. Then, with the current theme node as the center, the page of the mind map is automatically laid out according to the attributes and mutual relationships of the theme nodes of the mind map. Then, based on the relationship and distance of adjacent themes during traversal, the motion trajectory when the theme switches (transitions) is calculated by a random algorithm. Finally, the motion trajectory is put into the timeline, the appropriate time points are marked, and then the image corresponding to each time point is generated, so as to obtain a smooth transition screen.

[0056] The video generation method provided in the embodiment of the present application converts the mind map into an intermediate video file through the above steps, thereby providing material for subsequent video synthesis operations, and can quickly convert the mind map into a video file, facilitating the demonstration and dissemination of the file content.

[0057] Furthermore, in some embodiments of the present application, after automatically laying out the pages of the mind map according to the theme of the mind map, the method further includes:

[0058] The mind map page after automatic layout is rendered.

[0059] Specifically, after the mind map pages are automatically laid out according to the theme of the mind map, the mind map pages need to be rendered, that is, based on the theme style of the mind map, the color, size, font and other visual elements are automatically adjusted, and the laid out pages are rendered into high-definition images, thereby improving the image quality of the generated video file.

[0060] Furthermore, in some embodiments of the present application, after rendering the page of the mind map after automatic layout, the method further includes:

[0061] A highlight layer overlay process is performed on the mind map page after the rendering operation.

[0062] Specifically, after rendering the page of the mind map after automatic layout, it also includes: performing highlight layer overlay processing on the page of the mind map after rendering, that is, taking the current theme node as the highlight area, and overlaying a semi-transparent mask on the page image, thereby improving the image quality of the generated video file.

[0063] Furthermore, in some embodiments of the present application, before converting the text content of the mind map into an audio file, the method further includes:

[0064] Set the video generation parameters of the final version video file.

[0065] Specifically, before converting the text content of the mind map into an audio file, it also includes: setting the video generation parameters of the final version of the video file, such as conversion rules, voice type, cover image, etc., so that the generated final version of the video file can meet user needs and meet work needs.

[0066] Furthermore, in some embodiments of the present application, after synthesizing the audio file and the intermediate video file to form a final version of the video file, the method further includes:

[0067] The generated final version video file is stored in the cloud.

[0068] That is, after the audio file and the intermediate video file are synthesized to form a final version of the video file, the generated final version of the video file will automatically store the video file in the cloud so that the user can download or share it at any time, thereby facilitating user operation.

[0069] Furthermore, in some embodiments of the present application, converting the text content of the mind map into an audio file includes:

[0070] The text content of the mind map is converted into an audio file through TTS technology.

[0071] Specifically, TTS (Text to Speech) technology is a technology that converts text into speech. It can convert text into natural speech so that it can be understood by humans. The video generation method provided in the embodiment of the present application converts the text content of the mind map into an audio file through TTS technology, which is highly accurate and can be completed automatically.

[0072] Figure 3 FIG. 2 is a structural block diagram of a video generating device 200 according to an embodiment of the present application. Figure 3 As shown, the video generation device 200 of the embodiment of the present application includes: an audio conversion module 210, a video conversion module 220 and a video synthesis module 230, wherein:

[0073] An audio conversion module 210, for converting the text content of the mind map into an audio file;

[0074] A video conversion module 220, configured to convert the mind map into an intermediate video file according to the subject tree structure of the mind map; and

[0075] The video synthesis module 230 is used to synthesize the audio file and the intermediate video file to form a final version of the video file.

[0076] The video generation device provided in the embodiment of the present application first converts the text content of the mind map into an audio file, and converts the mind map into an intermediate video file according to the subject tree structure of the mind map, and finally synthesizes the audio file and the intermediate video file to form a final version of the video file, thereby being able to quickly convert the mind map into a video file, facilitating the demonstration and dissemination of the file content.

[0077] It should be noted that the specific implementation of the video generating device of the embodiment of the present application is similar to the specific implementation of the video generating method of the embodiment of the present application. Please refer to the description of the method part for details, and no further details will be given here.

[0078] Figure 4 Schematic diagram of the structure of an electronic device 300 according to an embodiment of the present application.

[0079] like Figure 4As shown, the electronic device 300 includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 302 or a program loaded from the storage part 302 to a random access memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the electronic device 300 are also stored. The CPU 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0080] The following components are connected to the I / O interface 305: an input section 306 including a keyboard, a mouse, etc.; an output section 307 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 308 including a hard disk, etc.; and a communication section 309 including a network interface card such as a LAN card, a modem, etc. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. A removable medium 311, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 310 as needed, so that a computer program read therefrom is installed into the storage section 308 as needed.

[0081] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a machine-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 309, and / or installed from a removable medium 311. When the computer program is executed by a central processing unit (CPU) 301, the above-mentioned functions defined in the electronic device of the present application are executed.

[0082] It should be noted that the computer-readable medium shown in the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electronic device, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0083] In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction-executing electronic device, apparatus, or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction-executing electronic device, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0084] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the processing receiving device, method and computer program product according to various embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the aforementioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based electronic device that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0085] The units or modules involved in the embodiments of the present application may be implemented by software or hardware. The units or modules described may also be arranged in a processor, and the processor is used to implement the video generation method when executing the program:

[0086] Convert the text content of the mind map into an audio file;

[0087] According to the subject tree structure of the mind map, converting the mind map into an intermediate video file; and

[0088] The audio file and the intermediate video file are synthesized to form a final version of the video file.

[0089] As another aspect, the present application further provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiment; or may exist independently and not be assembled into the electronic device. The above computer-readable storage medium stores one or more programs, and when the above programs are used by one or more processors to execute the video generation method described in the present application:

[0090] Convert the text content of the mind map into an audio file;

[0091] According to the subject tree structure of the mind map, converting the mind map into an intermediate video file; and

[0092] The audio file and the intermediate video file are synthesized to form a final version of the video file.

[0093] As another aspect, the present application further provides a computer program product, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer program product stores one or more programs, and when the above programs are used by one or more processors to execute the video generation method described in the present application:

[0094] Convert the text content of the mind map into an audio file;

[0095] According to the subject tree structure of the mind map, converting the mind map into an intermediate video file; and

[0096] The audio file and the intermediate video file are synthesized to form a final version of the video file.

[0097] The above description is only a preferred embodiment of the present application, and does not limit the patent scope of the present application. All equivalent structural changes made by using the contents of the present application specification and drawings under the application concept of the present application, or directly / indirectly used in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A video generation method, characterized in that: include: Convert the text content of the mind map into an audio file; According to the subject tree structure of the mind map, converting the mind map into an intermediate video file; and The audio file and the intermediate video file are synthesized to form a final version of the video file.

2. The video generation method according to claim 1, characterized in that: The step of converting the mind map into an intermediate video file according to the subject tree structure of the mind map comprises: Traverse the topics of the mind map in layers; Automatically layout the pages of the mind map according to the theme of the mind map; According to the theme of the mind map, calculating the movement trajectory of the mind map when the theme is switched; and The motion track is placed in a timeline to smoothly transition the topic switching of the mind map.

3. The video generation method according to claim 2, characterized in that: After automatically laying out the pages of the mind map according to the theme of the mind map, the method further includes: The mind map page after automatic layout is rendered.

4. The video generation method according to claim 3, characterized in that: After rendering the mind map page after automatic layout, the method further includes: A highlight layer overlay process is performed on the mind map page after the rendering operation.

5. The video generation method according to claim 1, characterized in that: Before converting the text content of the mind map into an audio file, the method further includes: Set the video generation parameters of the final version video file.

6. The video generation method according to claim 1, characterized in that: After synthesizing the audio file and the intermediate video file to form a final version of the video file, the method further includes: The generated final version video file is stored in the cloud.

7. The video generation method according to claim 1, characterized in that: The step of converting the text content of the mind map into an audio file includes: The text content of the mind map is converted into an audio file through TTS technology.

8. A video generating device, characterized in that: include: Audio conversion module, used to convert the text content of the mind map into audio files; A video conversion module, used for converting the mind map into an intermediate video file according to the subject tree structure of the mind map; and The video synthesis module is used to synthesize the audio file and the intermediate video file to form a final version of the video file.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor is configured to implement the video generating method according to any one of claims 1 to 7 when executing the program.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and the computer program is used to implement the video generation method according to any one of claims 1-7.