Video generation method and device, electronic equipment and storage medium

Abstract

The invention provides a video generation method and device, electronic equipment and a storage medium, and relates to the technical field of computers, in particular to the technical field of artificial intelligence such as deep learning and large models. According to the specific scheme, the method comprises the steps of firstly receiving a video generation request, then determining a target type to which a target product belongs according to first description information, then obtaining first interaction information of a product video associated with the target type, and finally generating a target video corresponding to the target product according to the first description information and the first interaction information. Therefore, on the basis of shortening the video generation duration and reducing the video generation cost, the video generation efficiency and accuracy are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, in particular to the field of artificial intelligence technology such as deep learning and large models, and specifically to a video generation method, device, electronic device and storage medium. Background Art

[0002] Currently, most oral videos are generated by professionals manually writing scripts according to promotion needs and selecting suitable video materials for splicing. However, this method of video generation is time-consuming, has low video generation efficiency, and is costly. Summary of the invention

[0003] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0004] The first aspect of the present disclosure provides a video generation method, including:

[0005] Receiving a video generation request, wherein the generation request includes first description information of a target product;

[0006] Determining the target type to which the target product belongs according to the first description information;

[0007] Acquire first interaction information of a product video associated with the target type;

[0008] A target video corresponding to the target product is generated according to the first description information and the first interaction information.

[0009] A second aspect of the present disclosure provides a video generation device, including:

[0010] A receiving module, configured to receive a video generation request, wherein the generation request includes first description information of a target product;

[0011] A determination module, configured to determine the target type to which the target product belongs according to the first description information;

[0012] An acquisition module, used to acquire first interaction information of a product video associated with the target type;

[0013] A generation module is used to generate a target video corresponding to the target product according to the first description information and the first interaction information.

[0014] The third aspect of the present disclosure provides a computer device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the video generation method provided in the first aspect of the present disclosure is implemented.

[0015] The fourth aspect of the present disclosure provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the video generation method provided in the first aspect of the present disclosure is implemented.

[0016] The fifth aspect of the present disclosure provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the video generation method provided in the first aspect of the present disclosure.

[0017] The video generation method, device, electronic device and storage medium provided by the present disclosure have the following beneficial effects:

[0018] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and then the first interaction information of the product video associated with the target type is obtained, and finally the target video corresponding to the target product is generated based on the first description information and the first interaction information. Thus, after receiving the video generation request, the type of the target product is determined based on the product description information, and the video corresponding to the target product is generated based on the product description information and the interaction information of the product video associated with the type, thereby improving the efficiency and accuracy of video generation while shortening the video generation time and reducing the cost of video generation.

[0019] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0021] Figure 1 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0022] Figure 2 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0023] Figure 3 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0024] Figure 4 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0025] Figure 5 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0026] Figure 6 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0027] Figure 7 A schematic diagram of a flow chart of a video generation method provided by an embodiment of the present disclosure;

[0028] Figure 8 A schematic diagram of the structure of a video generating device provided by an embodiment of the present disclosure;

[0029] Fig. 9 A block diagram of an exemplary computer device suitable for implementing embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0030] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0031] The present disclosure relates to the fields of artificial intelligence technologies such as deep learning and large models.

[0032] Artificial Intelligence (AI) is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.

[0033] Deep Learning (DL) is the process of learning the inherent laws and representation levels of sample data. The information obtained in the learning process is very helpful for interpreting data such as text, images, and sounds. The ultimate goal of deep learning is to enable machines to have analytical learning capabilities like humans and to recognize data such as text, images, and sounds.

[0034] The large model can also be called the Foundation Model. The model extracts knowledge through billions of corpora or images, learns and then produces a large model with billions of parameters.

[0035] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0036] The video generation method, device, electronic device, and storage medium of the embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0037] Figure 1 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0038] like Figure 1 As shown, the video generation method may include the following steps:

[0039] Step 101: receiving a video generation request, wherein the generation request includes first description information of a target product.

[0040] It should be noted that the target product may be a product for which a video is to be generated, and may be any type of product. For example, the target product may be an electronic device product, a daily necessities product, etc., and the present disclosure does not limit this.

[0041] The first description information may include any information related to the target product. For example, when the target product is a mobile phone, the first description information may include the business point of the target product, i.e., the mobile phone, and selling points such as high cost performance, etc., which is not limited in the present disclosure.

[0042] In the present disclosure, after receiving a video generation request, a target product of the video to be generated and first description information of the target product can be determined, thereby providing conditions for improving the accuracy of generating the video of the target product.

[0043] Step 102: Determine the target type to which the target product belongs according to the first description information.

[0044] It should be noted that different target products may have different or identical target types. For example, when the target product is a mobile phone, the target type may be a mobile phone type or an electronic device type. When the target product is a tablet computer, the target type may be a tablet computer type or an electronic device type. This disclosure does not limit this.

[0045] In the present disclosure, in order to improve the accuracy and reliability of target product video generation, after receiving a video generation request, the target type to which the product belongs can be determined based on the first description information of the target product.

[0046] Step 103: Acquire first interaction information of product videos associated with the target type.

[0047] The first interactive information may be any interactive information. For example, the first interactive information may be displaying product information and links to the user when the user is watching a video, and the present disclosure does not limit this.

[0048] It should be noted that, if the product videos associated with the target types are different, the corresponding first interaction information may be different, and the present disclosure does not limit this.

[0049] Optionally, when determining the target type of the product based on the first description information, in order to improve the comprehensiveness and reliability of the obtained first interactive information, the first interactive information of the product video associated with the target type within a certain period of time before the current moment can be obtained. The present disclosure does not limit this.

[0050] The certain period of time may be preset or determined according to actual conditions, and the present disclosure does not limit this.

[0051] Optionally, when the target type to which the product belongs is determined according to the first description information, the first interaction information of each product video in the video information library associated with the target type may also be obtained, which is not limited in the present disclosure.

[0052] The video information library may be a database for storing product videos associated with target types, which may be pre-set and is not limited in the present disclosure.

[0053] In the present disclosure, when the target type to which the product belongs is determined based on the first description information, the first interaction information of the product videos associated with the target type within a certain period of time before the current moment can be obtained as needed, or the first interaction information of each product video in the video information library associated with the target type can be obtained, thereby improving the accuracy of the determined first interaction information and improving the reliability of video generation.

[0054] Step 104: Generate a target video corresponding to the target product according to the first description information and the first interaction information.

[0055] The target video may be a final product video corresponding to the target product.

[0056] In the present disclosure, after obtaining the first interaction information of the product video associated with the target type, a target video corresponding to the target product can be generated according to the first description information and the first interaction information of the target product, thereby shortening the time for generating the video and improving the efficiency and accuracy of video generation.

[0057] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and then the first interaction information of the product video associated with the target type is obtained, and finally the target video corresponding to the target product is generated based on the first description information and the first interaction information. Thus, after receiving the video generation request, the type of the target product is determined based on the product description information, and the video corresponding to the target product is generated based on the product description information and the interaction information of the product video associated with the type, thereby improving the efficiency and accuracy of video generation while shortening the video generation time and reducing the cost of video generation.

[0058] Figure 2 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0059] like Figure 2 As shown, the video generation method may include the following steps:

[0060] Step 201: receiving a video generation request, wherein the generation request includes first description information of a target product.

[0061] Step 202: Determine the target type to which the target product belongs according to the first description information.

[0062] Step 203: Acquire first interaction information of product videos associated with the target type.

[0063] The specific implementation forms of steps 201 to 203 can refer to the detailed descriptions in other embodiments of the present disclosure, and will not be described in detail here.

[0064] Step 204: Determine second description information of each product video according to the first interaction information corresponding to the product video, wherein the second description information includes at least one of the following: interaction frequency and conversion rate.

[0065] The interaction frequency may be the number of interactions of the product video.

[0066] The conversion rate is the ratio of users who watch videos and complete conversions (such as purchasing products).

[0067] In the present disclosure, after obtaining the first interaction information of the product video associated with the target type, the second description information of the product video can be determined according to the first interaction information corresponding to each product video, thereby providing conditions for improving the reliability of video generation.

[0068] Step 205: Determine at least one target reference video according to each second description information.

[0069] The target reference video may be a reference video used to generate a target video of a target product.

[0070] In the present disclosure, after determining the second description information of each product video according to the first interaction information corresponding to the product video, at least one target reference video can be determined based on the second description information of each product video. For example, when the second description information includes the interaction frequency and the conversion rate, the product video with a larger interaction frequency and / or conversion rate can be determined as the target reference video, and the present disclosure does not limit this.

[0071] Step 206: Determine reference video elements and reference text content according to at least one target reference video.

[0072] The reference video element may be a related element of the target reference video. For example, the reference video element may be a video screen of the target reference video, or a component in the video screen such as a subject type (such as a product, a person, etc.), a color element, etc., which is not limited in the present disclosure.

[0073] The reference text content may be the script content of the target reference video, or may be the spoken copy content, which is not limited in the present disclosure.

[0074] In the present disclosure, after determining at least one target reference video, in order to improve the accuracy of the generated video corresponding to the target product, reference video elements and reference text content may be determined based on the at least one target reference video.

[0075] Step 207, generating a target video according to the first description information, the reference video element and the reference text content.

[0076] In the present disclosure, after determining the reference video elements and reference text content corresponding to at least one target reference video, a target video can be generated based on the first description information of the target product, the reference video elements and the reference text content, thereby improving the accuracy and reliability of the generated target video.

[0077] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and the first interaction information of the product video associated with the target type is obtained. Then, the second description information of the product video is determined based on the first interaction information corresponding to each product video, and at least one target reference video is determined based on each second description information. Finally, the reference video element and the reference text content are determined based on the at least one target reference video, and the target video is generated based on the first description information, the reference video element and the reference text content. Thus, after receiving the video generation request, the interaction information of the product video associated with the type to which the target product belongs is obtained based on the description information of the target product, the description information of the product video is determined based on the interaction information, and then the reference video is determined based on the description information. The target video of the target product is generated based on the target product description information, the video elements of the reference video, and the text content, thereby improving the efficiency and reliability of video generation.

[0078] Figure 3 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0079] like Figure 3 As shown, the video generation method may include the following steps:

[0080] Step 301: receiving a video generation request, wherein the generation request includes first description information of a target product and video material.

[0081] The video material may be provided by the user, and its specific content may be determined by the user as needed. For example, when the target product is a mobile phone, the video material may be a video material about the performance of the mobile phone, etc., which is not limited in the present disclosure.

[0082] Step 302: Determine the target type to which the target product belongs according to the first description information.

[0083] Step 303: Acquire first interaction information of product videos associated with the target type.

[0084] The specific implementation forms of steps 301 to 303 can refer to the detailed descriptions in other embodiments of the present disclosure, and will not be described in detail here.

[0085] Step 304, segment the video material to obtain a plurality of material segments.

[0086] It should be noted that when the video material is segmented, the segmentation can be performed based on the video transitions (ie, video elements) in the video material, that is, segmentation is performed whenever the video subject in the video material changes, and the present disclosure does not limit this.

[0087] It should be noted that the video length corresponding to each obtained material clip may be different, and this disclosure does not limit this.

[0088] In the present disclosure, after obtaining the first interactive information of the product video associated with the target type, the video material can be segmented to obtain multiple material segments corresponding to the material video, thereby providing a data basis for generating a video of the target product.

[0089] Step 305: determine the third description information corresponding to each material segment.

[0090] The third description information may include any information related to the material clip, for example, the third description information may include content description and duration of the material clip, etc., which is not limited in the present disclosure.

[0091] In the present disclosure, after obtaining a plurality of material segments corresponding to the video material, the third description information corresponding to each material segment can be determined, thereby determining the relevant information of each material segment and improving the accuracy of video generation.

[0092] Step 306: Generate a target video corresponding to the target product according to the first description information, the first interaction information and the third description information.

[0093] In the present disclosure, after obtaining the third description information of each material segment corresponding to the video material, a target video corresponding to the target product can be generated based on the first description information, the first interaction information and the third description information, thereby improving the content accuracy and reliability of the generated target video.

[0094] The specific implementation of step 306 can refer to the detailed description in other embodiments of the present disclosure, and will not be described in detail here.

[0095] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and the first interaction information of the product video associated with the target type is obtained, and then the video material is segmented to obtain multiple material segments, and the third description information corresponding to each material segment is determined, and finally the target video corresponding to the target product is generated based on the first description information, the first interaction information and the third description information. Thus, after receiving the video generation request, the type of the target product is determined based on the description information of the target product, and the interaction information of the product video associated with the type is obtained, the video material is segmented, and the description information corresponding to each obtained material segment is determined, and the video of the target product is generated based on the target product description information, the interaction information and the description information of each material segment, thereby improving the efficiency of video generation.

[0096] Figure 4 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0097] like Figure 4 As shown, the video generation method may include the following steps:

[0098] Step 401: receiving a video generation request, wherein the generation request includes first description information of a target product and video material.

[0099] Step 402: Determine the target type to which the target product belongs according to the first description information.

[0100] Step 403: Acquire first interaction information of product videos associated with the target type.

[0101] Step 404, segment the video material to obtain a plurality of material segments.

[0102] Step 405: determine the third description information corresponding to each material segment.

[0103] The specific implementation forms of steps 401 to 405 can refer to the detailed descriptions in other embodiments of the present disclosure, and will not be described in detail here.

[0104] Step 406: Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information.

[0105] The text sequence may be a script sequence of a video corresponding to the target product, which may include any number of texts, and the present disclosure does not limit this.

[0106] In the present disclosure, after obtaining the third description information corresponding to each material clip, the first description information, the first interaction information and the third description information can be input into a preset large model, and the first description information, the first interaction information and the third description information can be feature fused to obtain a text sequence and a corresponding video sequence corresponding to the target product, thereby improving the efficiency of video generation. The present disclosure does not limit this.

[0107] The preset macro model may be a macro model of any type and structure. For example, the preset macro model may be a multi-modal macro model, which is not limited in the present disclosure.

[0108] Step 407, when the video segment corresponding to any text segment in the text sequence is empty, the length of the video segment to be generated is determined according to the correspondence between the lengths of other text segments and the corresponding video segment lengths, and the length of the any text segment.

[0109] In the present disclosure, after obtaining the text sequence and the corresponding video sequence corresponding to the target product, when the video segment corresponding to any text segment in the text sequence is empty, in order to accurately and reliably determine the video segment corresponding to any text segment, the correspondence between the length of other text segments and the corresponding video segment duration can be first determined, and based on the correspondence and the length of any text segment, the duration of the video segment to be generated can be determined.

[0110] It should be noted that the longer the text segment is, the longer the corresponding video segment may be, and the present disclosure does not limit this.

[0111] Step 408: Generate a video segment corresponding to any text segment according to any text segment and the duration of the video segment.

[0112] In the present disclosure, after determining the length of the video segment to be generated, any text segment and the length of the video segment can be input into a preset generation model to obtain the video segment corresponding to the any text segment, thereby improving the accuracy and efficiency of generating the video segment corresponding to the any text segment.

[0113] Step 409: fuse the video segments corresponding to each text segment to obtain a target video.

[0114] In the present disclosure, after the video segment of any text segment is generated, the video segments corresponding to each text segment may be fused and rendered to obtain a target video, thereby improving the efficiency of generating the target video.

[0115] In the disclosed embodiment, a video generation request is first received, and then a target type to which a target product belongs is determined based on first description information, and first interaction information of a product video associated with the target type is obtained. The video material is then segmented to obtain a plurality of material segments, and third description information corresponding to each material segment is determined. Based on the first description information, the first interaction information, and the third description information, a text sequence and a corresponding video sequence corresponding to the target product are generated. When a video segment corresponding to any text segment in the text sequence is empty, the duration of the video segment to be generated is determined based on the correspondence between the length of other text segments and the duration of the corresponding video segments, and the length of any text segment. Finally, a video segment corresponding to any text segment is generated based on the duration of any text segment and the video segment, and the video segments corresponding to each text segment are fused to obtain a target video. Therefore, based on the target product description information, the interactive information of product videos associated with the type of the target product and the description information of each video material segment, the text sequence and the corresponding video sequence corresponding to the target product are obtained. When the video segment corresponding to any text segment is empty, the length of the video segment corresponding to any text segment is determined according to the correspondence between the lengths of other text segments and the corresponding video segment markets, and the corresponding video segment is generated. The video segments corresponding to each text segment are fused to obtain the target video corresponding to the target product, thereby realizing the automatic generation of product videos, reducing the cost of video generation and improving the efficiency of video generation.

[0116] Figure 5 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0117] like Figure 5 As shown, the video generation method may include the following steps:

[0118] Step 501: receiving a video generation request, wherein the generation request includes first description information of a target product and video material.

[0119] Step 502: Determine the target type to which the target product belongs according to the first description information.

[0120] Step 503: Acquire first interaction information of product videos associated with the target type.

[0121] Step 504, segment the video material to obtain a plurality of material segments.

[0122] Step 505: determine the third description information corresponding to each material segment.

[0123] Step 506: Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information.

[0124] The specific implementation forms of steps 501 to 506 can refer to the detailed descriptions in other embodiments of the present disclosure, and will not be described in detail here.

[0125] Step 507 : when the video segment corresponding to any text segment in the text sequence is empty, obtain the reference text segment adjacent to the text segment in the text sequence and the reference video segments respectively corresponding to the reference text segments.

[0126] In the present disclosure, after obtaining the text sequence and the corresponding video sequence corresponding to the target product, when the video segment corresponding to any text segment in the text sequence is empty, in order to make the content of the video segment of the determined any text segment consistent with the video segments corresponding to other text segments, the reference text segments adjacent to the any text segment in the text sequence and the reference video segments corresponding to the reference text segments can be first obtained.

[0127] Step 508: Generate a video segment corresponding to any text segment according to any text segment, reference text segment and reference video segment.

[0128] In the present disclosure, after determining the reference text segment and reference video segment adjacent to any text segment, the any text segment, the reference text segment and the reference video segment can be input into the generation model, so that the model can generate a video segment corresponding to any text segment based on the contextual information of the any text segment and the upper and lower video segment information, thereby improving the accuracy and reliability of the generated video segment.

[0129] Step 509: fuse the video segments corresponding to each text segment to obtain a target video.

[0130] In the present disclosure, after generating a video segment corresponding to any text segment based on any text segment, a reference text segment and a reference video segment, the video segments corresponding to each text segment are fused to obtain a target video, thereby ensuring the content coherence and consistency of the target video and improving the reliability and efficiency of the generated target video.

[0131] The specific implementation of step 509 can refer to the detailed description in other embodiments of the present disclosure, and will not be described in detail here.

[0132] In the disclosed embodiment, a video generation request is first received, and then a target type to which a target product belongs is determined based on first description information, and first interaction information of a product video associated with the target type is obtained. The video material is then segmented to obtain a plurality of material segments, and third description information corresponding to each material segment is determined. A text sequence and a corresponding video sequence corresponding to the target product are generated based on the first description information, the first interaction information, and the third description information. When a video segment corresponding to any text segment in the text sequence is empty, a reference text segment adjacent to the any text segment in the text sequence and reference video segments corresponding to the reference text segments are obtained. A video segment corresponding to any text segment is generated based on any text segment, the reference text segment, and the reference video segment. Finally, the video segments corresponding to each text segment are fused to obtain a target video. Therefore, after obtaining the text sequence and video sequence corresponding to the target product based on the target product description information, the product video interaction information associated with the type of the target product, and the description information of each video material segment, when the video segment corresponding to any text segment is empty, the adjacent text segments and the corresponding video segments of any text segment are obtained, and based on the any text segment, the adjacent text segments and the corresponding video segments, the video segment corresponding to any text segment is generated, and the video segments corresponding to each text segment are fused to obtain the target video corresponding to the target product, thereby improving the efficiency and accuracy of video generation.

[0133] Figure 6 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0134] like Figure 6 As shown, the video generation method may include the following steps:

[0135] Step 601: Receive a video generation request, wherein the generation request includes first description information of a target product.

[0136] Step 602: Determine the target type to which the target product belongs according to the first description information.

[0137] Step 603: Acquire first interaction information of product videos associated with the target type.

[0138] Step 604: Generate a target video corresponding to the target product according to the first description information and the first interaction information.

[0139] The specific implementation forms of steps 601 to 604 can refer to the detailed descriptions in other embodiments of the present disclosure, and will not be described in detail here.

[0140] Step 605: play the target video, wherein the play interface of the target video includes a modification control.

[0141] In the present disclosure, after a target video corresponding to a target product is generated, the target video may be played so that the user can confirm the effect and content of the generated target video.

[0142] It should be noted that the modification control may be any type of control, for example, the modification control may be a button type control, which is not limited in the present disclosure.

[0143] Step 606, when it is detected that the modification control is triggered, display a modification page, wherein the modification page includes at least one of the following: a first control for triggering text content modification, and a second control for triggering modification of a video frame.

[0144] It should be noted that the type of the first control may be the same as the type of the second control, or may be different from the type of the second control, and the present disclosure does not limit this.

[0145] In the present disclosure, after playing the target video, when it is detected that the modification control in the playback interface of the target video is triggered, a modification page can be displayed to the user, so that the user can modify the text content and / or video frame of the target video to make the target video more in line with user needs.

[0146] Step 607: Update the target video according to the editing instruction received in the modification page.

[0147] In the present disclosure, after the modification page is displayed, the target video can be updated according to the editing instructions received in the modification page, so that the target video is more in line with user needs and the personalization of the target video is improved.

[0148] It should be noted that the editing instruction may include at least one of an editing instruction for the text content of the target video and an editing instruction for the video frame, which may also include the user's specific editing content, which is not limited in the present disclosure.

[0149] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and the first interaction information of the product video associated with the target type is obtained. Then, based on the first description information and the first interaction information, a target video corresponding to the target product is generated, and finally the target video is played. When the modification control is detected to be triggered, a modification page is displayed, and the target video is updated according to the editing instructions received in the modification page. Thus, after the target video of the target product is generated according to the target product description information and the product video interaction information associated with its type, the target video is played, and when the modification control in its playback interface is triggered, a modification page is displayed, the editing instructions in the modification page are received, and the target video is updated, thereby improving the personalization and accuracy of the generated video.

[0150] Figure 7 A flowchart of a video generation method provided by an embodiment of the present disclosure is provided.

[0151] like Figure 7 As shown, the video generation method may include the following steps:

[0152] Step 701: Receive a video generation request, wherein the generation request includes first description information of a target product.

[0153] Step 702: Determine the target type to which the target product belongs according to the first description information.

[0154] Step 703: Acquire first interaction information of product videos associated with the target type.

[0155] Step 704: Generate a target video corresponding to the target product according to the first description information and the first interaction information.

[0156] The specific implementation forms of steps 701 to 704 can refer to the detailed descriptions in other embodiments of the present disclosure, and will not be described in detail here.

[0157] Step 705: upon receiving a target video publishing instruction, publish the target video.

[0158] In the present disclosure, after generating a target video corresponding to a target product, the target video may be released upon receiving a target video release instruction, thereby achieving promotion of the target product.

[0159] Step 706: Acquire second interaction information of the target video.

[0160] The second interaction information may include at least one of the interaction frequency and conversion rate of the target video, which is not limited in the present disclosure.

[0161] In the present disclosure, after the target video is released, in order to determine the promotion effect of the target video on the target product, the second interaction information of the target video may be obtained, thereby determining the interaction feedback of the target video.

[0162] Step 707: When the second interaction information satisfies the first condition, the target video is updated.

[0163] The first condition may be an interactive information condition for determining whether to update the target video, which may be pre-set or determined according to actual conditions, and may include any condition. For example, the first condition may be that the target video is updated when the interactive frequency of the target video is less than or equal to the interactive frequency threshold, and / or the conversion rate is less than or equal to the conversion rate threshold, etc., and the present disclosure does not limit this.

[0164] In the present disclosure, after obtaining the second interaction information of the target video, when the second interaction information satisfies the first condition, it can be determined that the interaction information feedback of the target video is relatively poor, and the promotion effect of the target video on the target product is not very good. At this time, the target video needs to be updated to improve the accuracy and reliability of the target video pair.

[0165] Optionally, when the first condition includes a frequency threshold and a conversion rate threshold, when the interaction frequency in the second interaction information is less than or equal to the frequency threshold, and / or the conversion rate is less than or equal to the conversion rate threshold, it can be determined that the promotion effect of the target video on the target product during the release period is poor. At this time, the third interaction information of the product video associated with the target type during the release period of the target video can be first obtained, and then the target video can be updated according to the third interaction information, so as to improve the quality of the target video and enhance its promotion effect on the target product.

[0166] The frequency threshold may be a critical value of the interaction frequency used to determine whether to update the target video, which may be preset or determined according to actual conditions, and the present disclosure does not limit this.

[0167] The conversion rate threshold may be a critical value of the conversion rate used to determine whether to update the target video, which may be preset or determined according to actual conditions, and the present disclosure does not limit this.

[0168] It should be noted that the third interaction information may be different from the first interaction information, and this disclosure does not limit this.

[0169] Optionally, when the first condition includes a frequency threshold and a conversion rate threshold, when the interaction frequency in the second interaction information is greater than the frequency threshold, and / or the conversion rate is greater than the conversion rate threshold, it can be determined that the interaction information feedback of the target video is relatively good, and the target video has a good promotion effect on the target product during the release period. At this time, the target video and the second interaction information can be associated and stored in a video information library associated with the target type, so that the video information library associated with the target type stores product videos with good interaction information feedback, thereby ensuring the real-time and reliability of the data in the video information library associated with the target type.

[0170] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and the first interaction information of the product video associated with the target type is obtained. Then, based on the first description information and the first interaction information, a target video corresponding to the target product is generated, and when a target video publishing instruction is received, the target video is published, and finally, the second interaction information of the target video is obtained, and when the second interaction information satisfies the first condition, the target video is updated. Thus, after the target video corresponding to the target product is generated based on the target product description information and the product video interaction information associated with its type, the target video is published when a publishing instruction is received, and when the interaction information of the target video satisfies the condition, the target video is updated, thereby improving the quality of the generated target video and improving the reliability of video generation.

[0171] In order to implement the above embodiment, the present disclosure also proposes a video generating device.

[0172] Figure 8 A schematic diagram of the structure of a video generating device provided in an embodiment of the present disclosure.

[0173] like Figure 8 As shown, the video generating device 800 includes: a receiving module 801 , a determining module 802 , an acquiring module 803 , and a generating module 804 .

[0174] The receiving module 801 is used to receive a video generation request, wherein the generation request includes first description information of a target product;

[0175] A determination module 802 is used to determine the target type to which the target product belongs according to the first description information;

[0176] An acquisition module 803 is used to acquire first interaction information of a product video associated with a target type;

[0177] The generating module 804 is used to generate a target video corresponding to the target product according to the first description information and the first interaction information.

[0178] In a possible implementation of the present disclosure, the generating module 804 is specifically configured to:

[0179] Determine second description information of the product video according to the first interaction information corresponding to each product video, wherein the second description information includes at least one of the following: interaction frequency and conversion rate;

[0180] Determine at least one target reference video according to each second description information;

[0181] Determining reference video elements and reference text content according to at least one target reference video;

[0182] A target video is generated according to the first description information, the reference video element and the reference text content.

[0183] In a possible implementation of the present disclosure, the generation request further includes video material, and the generation module 804 is further configured to:

[0184] Split the video material into multiple material clips;

[0185] Determine the third description information corresponding to each material clip;

[0186] A target video corresponding to the target product is generated according to the first description information, the first interaction information and the third description information.

[0187] In a possible implementation of the present disclosure, the generating module 804 is further configured to:

[0188] Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information;

[0189] When the video segment corresponding to any text segment in the text sequence is empty, the length of the video segment to be generated is determined according to the corresponding relationship between the lengths of other text segments and the corresponding video segment lengths, and the length of any text segment;

[0190] Generate a video segment corresponding to any text segment according to any text segment and the duration of the video segment;

[0191] The video segments corresponding to each text segment are fused to obtain the target video.

[0192] In a possible implementation of the present disclosure, the generating module 804 is further configured to:

[0193] Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information;

[0194] When the video segment corresponding to any text segment in the text sequence is empty, obtain reference text segments adjacent to any text segment in the text sequence, and reference video segments respectively corresponding to the reference text segments;

[0195] Generate a video segment corresponding to any text segment according to any text segment, a reference text segment and a reference video segment;

[0196] The video segments corresponding to each text segment are fused to obtain the target video.

[0197] In a possible implementation of the present disclosure, the generating module 804 is further configured to:

[0198] Playing the target video, wherein the playback interface of the target video includes a modification control;

[0199] In the case where it is detected that the modification control is triggered, a modification page is displayed, wherein the modification page includes at least one of the following: a first control for triggering modification of text content, and a second control for triggering modification of a video frame;

[0200] The target video is updated according to the editing instructions received in the modification page.

[0201] In a possible implementation of the present disclosure, the generating module 804 is further configured to:

[0202] When receiving a target video publishing instruction, publishing the target video;

[0203] Acquire second interaction information of the target video;

[0204] When the second interaction information satisfies the first condition, the target video is updated.

[0205] In a possible implementation of the present disclosure, the generating module 804 is further configured to:

[0206] When the interaction frequency in the interaction information is less than or equal to the frequency threshold, and / or the conversion rate is less than or equal to the conversion rate threshold, obtaining third interaction information of product videos associated with the target type during the release of the target video;

[0207] The target video is updated according to the third interaction information.

[0208] In a possible implementation of the present disclosure, the generating module 804 is further configured to:

[0209] When the interaction frequency in the second interaction information is greater than the frequency threshold, and / or the conversion rate is greater than the conversion rate threshold, the target video and the second interaction information are associated and stored in a target type associated video information library.

[0210] In a possible implementation of the present disclosure, the generating module 804 is further used for any of the following:

[0211] Acquire the first interaction information of the product video associated with the target type within a certain period before the current moment;

[0212] The first interaction information of each product video in the video information library associated with the target type is obtained.

[0213] The functions and specific implementation principles of the above modules in the embodiments of the present disclosure can be referred to the above method embodiments, and will not be repeated here.

[0214] In the disclosed embodiment, a video generation request is first received, and then the target type to which the target product belongs is determined based on the first description information, and then the first interaction information of the product video associated with the target type is obtained, and finally the target video corresponding to the target product is generated based on the first description information and the first interaction information. Thus, after receiving the video generation request, the type of the target product is determined based on the product description information, and the video corresponding to the target product is generated based on the product description information and the interaction information of the product video associated with the type, thereby improving the efficiency and accuracy of video generation while shortening the video generation time and reducing the cost of video generation.

[0215] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0216] Fig. 9 A schematic block diagram of an example electronic device 900 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0217] like Fig. 9As shown, the device 900 includes a computing unit 901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded from a storage unit 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the device 900 can also be stored. The computing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0218] A number of components in the device 900 are connected to the I / O interface 905, including: an input unit 906, such as a keyboard, a mouse, etc.; an output unit 907, such as various types of displays, speakers, etc.; a storage unit 908, such as a disk, an optical disk, etc.; and a communication unit 909, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 909 allows the device 900 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0219] The computing unit 901 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 901 performs the various methods and processes described above, such as a video generation method. For example, in some embodiments, the video generation method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 908. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 900 via ROM 902 and / or a communication unit 909. When the computer program is loaded into RAM 903 and executed by the computing unit 901, one or more steps of the video generation method described above may be performed. Alternatively, in other embodiments, the computing unit 901 may be configured to perform the video generation method in any other appropriate manner (e.g., by means of firmware).

[0220] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0221] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable video generating device, so that the program code, when executed by the processor or controller, causes the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0222] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0223] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0224] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), the Internet, and a blockchain network.

[0225] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0226] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0227] In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "multiple" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined. In the description of the present disclosure, the words "if" and "if" used can be interpreted as "at the time of" or "when" or "in response to determination" or "under the circumstances of".

[0228] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A video generation method, comprising: Receiving a video generation request, wherein the generation request includes first description information of a target product; Determining the target type to which the target product belongs according to the first description information; Acquire first interaction information of a product video associated with the target type; A target video corresponding to the target product is generated according to the first description information and the first interaction information.

2. The method of claim 1, wherein: The step of generating a target video corresponding to the target product according to the first description information and the first interaction information includes: Determine second description information of the product video according to the first interaction information corresponding to each product video, wherein the second description information includes at least one of the following: interaction frequency and conversion rate; Determine at least one target reference video according to each of the second description information; Determining reference video elements and reference text content according to the at least one target reference video; The target video is generated according to the first description information, the reference video element and the reference text content.

3. The method according to claim 1 or 2, wherein: The generation request further includes video material, and the generating a target video corresponding to the target product according to the first description information and the first interaction information includes: Slicing the video material to obtain multiple material segments; Determining third description information corresponding to each of the material clips; A target video corresponding to the target product is generated according to the first description information, the first interaction information and the third description information.

4. The method of claim 3, wherein: The generating a target video corresponding to the target product according to the first description information, the first interaction information, and the third description information includes: Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information; When the video segment corresponding to any text segment in the text sequence is empty, determining the duration of the video segment to be generated according to the correspondence between the lengths of other text segments and the durations of the corresponding video segments and the length of any text segment; Generate a video segment corresponding to the any text segment according to the any text segment and the duration of the video segment; The video segments corresponding to each text segment are fused to obtain the target video.

5. The method of claim 3, wherein: The generating a target video corresponding to the target product according to the first description information, the first interaction information, and the third description information includes: Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information; When the video segment corresponding to any text segment in the text sequence is empty, obtaining reference text segments adjacent to the any text segment in the text sequence and reference video segments respectively corresponding to the reference text segments; Generate a video segment corresponding to any one of the text segments according to the any one of the text segments, the reference text segment and the reference video segment; The video segments corresponding to each text segment are fused to obtain the target video.

6. The method of claim 1, wherein: After generating the target video corresponding to the target product, the method further includes: Playing the target video, wherein the playback interface of the target video includes a modification control; In the case where it is detected that the modification control is triggered, a modification page is displayed, wherein the modification page includes at least one of the following: a first control for triggering text content modification, and a second control for triggering modification of a video frame; The target video is updated according to the editing instruction received in the modification page.

7. The method of claim 1, wherein: After generating the target video corresponding to the target product, the method further includes: Upon receiving a target video publishing instruction, publishing the target video; Acquire second interaction information of the target video; When the second interaction information satisfies the first condition, the target video is updated.

8. The method of claim 7, wherein: When the interaction information satisfies the first condition, updating the target video includes: When the interaction frequency in the second interaction information is less than or equal to the frequency threshold, and / or the conversion rate is less than or equal to the conversion rate threshold, obtaining third interaction information of the product video associated with the target type during the release of the target video; The target video is updated according to the third interaction information.

9. The method of claim 7, wherein: After acquiring the second interaction information of the target video, the method further includes: When the interaction frequency in the second interaction information is greater than a frequency threshold, and / or the conversion rate is greater than a conversion rate threshold, the target video and the second interaction information are associated and stored in a video information library associated with the target type.

10. The method of claim 9, wherein: The obtaining of the first interaction information of the product video associated with the target type includes any one of the following: Acquire first interaction information of product videos associated with the target type within a certain period of time before the current moment; The first interaction information of each product video in the video information library associated with the target type is obtained.

11. A video generating device, wherein: The device comprises: A receiving module, configured to receive a video generation request, wherein the generation request includes first description information of a target product; A determination module, configured to determine the target type to which the target product belongs according to the first description information; An acquisition module, used to acquire first interaction information of a product video associated with the target type; A generation module is used to generate a target video corresponding to the target product according to the first description information and the first interaction information.

12. The device of claim 11, wherein: The generation module is specifically used for: Determine second description information of the product video according to the first interaction information corresponding to each product video, wherein the second description information includes at least one of the following: interaction frequency and conversion rate; Determine at least one target reference video according to each of the second description information; Determining reference video elements and reference text content according to the at least one target reference video; The target video is generated according to the first description information, the reference video element and the reference text content.

13. The device according to claim 11 or 12, wherein: The generation request also includes video material, and the generation module is further used to: Slicing the video material to obtain multiple material segments; Determining third description information corresponding to each of the material clips; A target video corresponding to the target product is generated according to the first description information, the first interaction information and the third description information.

14. The device of claim 13, wherein: The generating module is further used for: Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information; When the video segment corresponding to any text segment in the text sequence is empty, determining the duration of the video segment to be generated according to the correspondence between the lengths of other text segments and the durations of the corresponding video segments and the length of any text segment; Generate a video segment corresponding to the any text segment according to the any text segment and the duration of the video segment; The video segments corresponding to each text segment are fused to obtain the target video.

15. The device of claim 13, wherein: The generating module is further used for: Generate a text sequence and a corresponding video sequence corresponding to the target product according to the first description information, the first interaction information and the third description information; When the video segment corresponding to any text segment in the text sequence is empty, obtaining reference text segments adjacent to the any text segment in the text sequence and reference video segments respectively corresponding to the reference text segments; Generate a video segment corresponding to any one of the text segments according to the any one of the text segments, the reference text segment and the reference video segment; The video segments corresponding to each text segment are fused to obtain the target video.

16. The device of claim 11, wherein: The generating module is further used for: Playing the target video, wherein the playback interface of the target video includes a modification control; In the case where it is detected that the modification control is triggered, a modification page is displayed, wherein the modification page includes at least one of the following: a first control for triggering text content modification, and a second control for triggering modification of a video frame; The target video is updated according to the editing instruction received in the modification page.

17. The device of claim 11, wherein: The generating module is further used for: Upon receiving a target video publishing instruction, publishing the target video; Acquire second interaction information of the target video; When the second interaction information satisfies the first condition, the target video is updated.

18. The device of claim 17, wherein: The generating module is further used for: When the interaction frequency in the interaction information is less than or equal to the frequency threshold, and / or the conversion rate is less than or equal to the conversion rate threshold, obtaining third interaction information of the product video associated with the target type during the release of the target video; The target video is updated according to the third interaction information.

19. The device of claim 17, wherein: The generating module is further used for: When the interaction frequency in the second interaction information is greater than a frequency threshold, and / or the conversion rate is greater than a conversion rate threshold, the target video and the second interaction information are associated and stored in the target type associated video information library.

20. The device of claim 19, wherein: The generation module is also used for any of the following: Acquire first interaction information of product videos associated with the target type within a certain period of time before the current moment; The first interaction information of each product video in the video information library associated with the target type is obtained.

21. An electronic device, characterized in that: include: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions that may be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1 to 10.

22. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-10.

23. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 10.

Images