Video processing method and device, electronic equipment and storage medium

By generating and sorting action videos with limited time, the problem of difficulty in generating high-quality long videos in the prior art is solved, and efficient video generation and quality improvement are achieved.

CN119071537AActive Publication Date: 2024-12-03SHANGHAI BILIBILI TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202411081328.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-07
Publication Date
2024-12-03
Estimated Expiration
2044-08-07

AI Technical Summary

Technical Problem

It is difficult to generate high-quality long videos in the prior art, and the improvement of video generation algorithms consumes computing resources, making it difficult to achieve continuity and quality improvement of long videos.

Method used

By obtaining input materials, determining multiple action templates, generating action videos whose duration of each action video is less than a predetermined time threshold, and sorting based on video quality, the user can choose to combine output high-quality action videos to generate a long video.

Benefits of technology

It realizes the generation of multiple high-quality action videos for the same input material. Users can choose combinations based on actual conditions to improve the quality of the output video, reduce computing resource consumption, and simplify the difficulty of model training.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119071537A_ABST
    Figure CN119071537A_ABST
Patent Text Reader

Abstract

The invention provides a video processing method and device, electronic equipment and a storage medium, and relates to the technical field of data processing. According to the implementation scheme, input materials used for generating a video are obtained; determining a plurality of action templates for processing the input material, wherein each action template corresponds to a different action executed by the virtual image; generating a plurality of action videos based on the input material and the plurality of action templates, wherein the virtual image in each action video executes the action in the corresponding action template, and the duration of the action video is less than a preset duration threshold; sorting the plurality of action videos based on video quality; and outputting at least one part of the plurality of action videos according to the sequence.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to a video processing method, a video processing device, an electronic device, a computer-readable storage medium, and a computer program product. Background Art

[0002] A video of a more natural virtual image can be generated based on the material actually shot by the user.

[0003] The methods described in this section are not necessarily methods that have been previously conceived or used. Unless otherwise indicated, it should not be assumed that any method described in this section is considered to be prior art simply because it is included in this section. Similarly, unless otherwise indicated, the issues mentioned in this section should not be considered to have been recognized in any prior art. Summary of the invention

[0004] The present disclosure provides a data processing method, a video processing device, an electronic device, a computer-readable storage medium, and a computer program product.

[0005] According to one aspect of the present disclosure, a video processing method is provided, comprising: acquiring input material for generating a video; determining a plurality of action templates for processing the input material, wherein each action template corresponds to a different action performed by a virtual image; generating a plurality of action videos based on the input material and the plurality of action templates, wherein the virtual image in each action video performs an action in the corresponding action template and the duration of the action video is less than a predetermined duration threshold; sorting the plurality of action videos based on video quality; and outputting at least a portion of the plurality of action videos according to the sorting.

[0006] According to another aspect of the present disclosure, a video processing device is also provided, including: an input unit, configured to obtain input material for generating a video; a template determination unit, configured to determine multiple action templates for processing the input material, wherein each action template corresponds to a different action performed by a virtual image; a generation unit, configured to generate multiple action videos based on the input material and the multiple action templates, wherein the virtual image in each action video performs the action in the corresponding action template and the duration of the action video is less than a predetermined duration threshold; a sorting unit, configured to sort the multiple action videos based on video quality; and an output unit, configured to output at least a portion of the multiple action videos according to the sorting.

[0007] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program, and the computer program implements the above method when executed by the at least one processor.

[0008] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program is also provided, wherein the computer program implements the above method when executed by a processor.

[0009] According to another aspect of the present disclosure, a computer program product is further provided, comprising a computer program, wherein the computer program implements the above method when executed by a processor.

[0010] By using the embodiments provided by the present disclosure, different action videos can be generated for the same input material, and can be output based on the order of video quality. In this way, the user can select one or more of the output action videos for combination according to actual conditions. In the case where the video quality of each action video is high, the quality of the output video obtained by combination will also be improved.

[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0013] Figure 1 An exemplary flow chart of a video processing method according to an embodiment of the present disclosure is shown;

[0014] Figure 2 An exemplary user interaction interface of a video processing method according to an embodiment of the present disclosure is shown;

[0015] Figure 3 An exemplary block diagram of a video processing device according to an embodiment of the present disclosure is shown;

[0016] Figure 4 A structural block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0017] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0018] In the present disclosure, unless otherwise specified, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of these elements, and such terms are only used to distinguish one element from another element. In some examples, the first element and the second element may refer to the same instance of the element, and in some cases, based on the description of the context, they may also refer to different instances.

[0019] The terms used in the description of various examples in this disclosure are only for the purpose of describing specific examples and are not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the element can be one or more. In addition, the term "and / or" used in this disclosure covers any one of the listed items and all possible combinations.

[0020] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0021] Based on the video material actually shot by the user as input, a video with a more natural virtual image can generally be generated. However, as the length of the video becomes longer, it is still difficult to generate a continuous long video. In the related art, it is difficult and consumes computing resources to improve the video quality of long videos by improving the video generation algorithm.

[0022] In order to improve the generation effect of long videos, the present disclosure provides a new video processing method.

[0023] Figure 1 An exemplary flow chart of a video processing method according to an embodiment of the present disclosure is shown.

[0024] In step S102, input material for generating a video is obtained.

[0025] In step S104, a plurality of action templates for processing the input material are determined, wherein each action template corresponds to a different action performed by the avatar.

[0026] In step S106, multiple action videos are generated based on the input material and multiple action templates, wherein the virtual image in each action video performs the action in the corresponding action template and the duration of the action video is less than a predetermined duration threshold.

[0027] In step S108 , the plurality of action videos are sorted based on video quality.

[0028] In step S110 , at least a portion of the plurality of action videos is output according to the order.

[0029] By using the video processing method provided by the embodiment of the present disclosure, different action videos can be generated for the same input material, and can be output based on the order of video quality. In this way, the user can select one or more of the output action videos for combination according to actual conditions. In the case where the video quality of each action video is high, the quality of the output video obtained by combination will also be improved.

[0030] The principles of the present disclosure will be described in detail below.

[0031] In step S102, input material for generating a video is obtained. The user can upload the material to the server via the network. The input material may include audio, text, or a combination of audio and text. The trained model may be used to extract features in the input material, such as text information and action information. The model here may be any suitable machine-implemented model for image processing or video processing.

[0032] In step S104, a plurality of action templates for processing the input material are determined, wherein each action template corresponds to a different action performed by the avatar.

[0033] The action template may be predetermined and used to define the action to be performed by the avatar. The action mentioned here may include gestures, expressions, etc.

[0034] In some embodiments, different action templates may be defined for different virtual images, so that personalized action habits can be customized for each virtual image. Step S104 may include: determining the user-specified virtual image in response to user input, and determining multiple action templates corresponding to the user-specified virtual image. The action template corresponding to the virtual image may be determined by receiving the user-specified virtual image input on the user interaction interface. In the example, the user can select which action templates to use.

[0035] In step S106, multiple action videos are generated based on the input material and multiple action templates, wherein the virtual image in each action video performs the action in the corresponding action template and the duration of the action video is less than a predetermined duration threshold.

[0036] The features extracted in step S102 can be combined with a plurality of predefined action templates to generate a corresponding action video. The trained machine learning model can be used to generate an action video based on the input material and the action template. The action video will include a virtual image that performs the action in the corresponding action template and contains the features extracted from the input material. For example, the virtual image in the action video will perform the gesture action defined in the action template and have a lip shape that matches the text information in the input material.

[0037] A single input material can be used to generate action videos corresponding to different action templates. Different input materials can also be selected for each action template. The predetermined duration threshold for the action video can be predetermined according to actual conditions. By limiting the duration of the action video to not exceed the predetermined threshold, the amount of computation for video generation can be reduced, thereby improving the generation effect of the model.

[0038] In step S108 , the plurality of action videos are sorted based on video quality.

[0039] In some embodiments, at least one qualified action video may be determined from a plurality of action videos based on predetermined image quality standards and duration standards, and the at least one qualified action video may be sorted based on predetermined sorting rules.

[0040] In an example, the duration standard may include a video length of less than 30 seconds and greater than 10 seconds. By defining the upper and lower limits of the video length, it is possible to ensure that sufficient output information is retained in the video, and to avoid quality degradation caused by generating long videos and to limit the amount of computation required to generate the video.

[0041] The predetermined image quality criteria may include one or more of the following:

[0042] - Check the proportion of the face in the picture, do not be too close to the camera or too far away from the camera

[0043] - Pay attention to the light changes on the face in the clip, and avoid obvious swallowing of saliva

[0044] -Avoid long-distance movement when adjusting standing or sitting posture, as well as large movements of the body and head.

[0045] - The character's eyes need to look directly at the camera. They can blink, but they cannot glance up, down, left, or right.

[0046] - Do not close your eyes, shake your body, or use hand gestures as the start and end moments of the template

[0047] - The character does not have frequent gestures, ensuring that the user's gesture frequency remains consistent

[0048] - High frequency editing or pauses in the video during the action sequence to avoid cuts.

[0049] -Avoid excessive noise in the video that is louder than the human voice, or problems with the sound reception throughout the video

[0050] Among them, the above-mentioned image quality standards may have the following priority order: head posture>expression problem>hand movement frequency.

[0051] When sorting the generated action videos, the sorting can be performed according to the number of videos that meet the image quality standard. The more videos that meet the above image quality standard, the higher the ranking. For videos that meet the same number of image quality standards, the sorting is performed according to the duration of the video. The longer the duration of the video, the higher the ranking.

[0052] In step S110, at least a portion of the plurality of action videos is output according to the order. The plurality of action videos outputted may be sequentially displayed on the user interface according to the order, so that the user can intuitively understand the image quality of the output action videos. In the example, a portion (e.g., the first 3) or all of the plurality of action videos may be outputted. The number of action videos outputted may be determined according to actual conditions.

[0053] In some embodiments, method 100 may further include displaying at least a portion of the plurality of action videos according to the order on a user interface, and in response to a user selecting at least one of the displayed action videos, generating an output video using the selected action video.

[0054] As mentioned above, using the video processing method described above, the user can obtain multiple high-quality action videos with limited duration based on the input material. By combining and editing the multiple videos generated, which are shorter in duration but higher in image quality, a high-quality long video can be quickly generated.

[0055] In some embodiments, the output video may include multiple action videos selected by the user and connecting segments between different action videos. It is understandable that the multiple action videos selected by the user are generated separately based on the materials uploaded by the user, so there is a lack of continuity between different action videos. In order to make the synthesized output video smooth, connecting segments can be inserted between different action videos as transitions, thereby improving the user's viewing experience. In some examples, the connecting segments can be generated by converting text to video, and the virtual image in the action video may not be included in the connecting segments. In this way, multiple different ones can be combined in a natural way to obtain an output video with a longer duration.

[0056] Using the above method, the task of generating a single long video can be decomposed into multiple shorter video generation tasks, thereby reducing the difficulty of model training, reducing the consumption of computing resources, and improving the quality of video generation. By providing users with multiple different action videos as candidate segments of the output video, users can easily use multiple shorter videos to combine to obtain a high-quality long video output result. In addition, by limiting the length of each action video, the quality requirements for the input materials uploaded by users are also reduced. Users only need to ensure that each input material has a high quality within a shorter duration, without having to prepare longer input materials.

[0057] Figure 2 An exemplary user interaction interface of the video processing method according to an embodiment of the present disclosure is shown.

[0058] like Figure 2 As shown, the video output result according to the embodiment of the present disclosure is shown in the user interface 200. The content of the video preview is shown in area 210. Three action videos are shown in areas 220-1 to 220-3. The three action videos shown can be combined with Figure 1 The video corresponding to different action templates is generated by the process described in the above description. The user can select from the three action videos shown in areas 220-1 to 220-3, and a preview of the selected video will be displayed in area 210. In the example, the user can modify the action name of the action video shown. A prompt "Multiple action clips have been intelligently generated for you~You can select a more matching action for digital avatar synthesis according to the scene of the appearance" can be displayed on the user interface.

[0059] Figure 3 An exemplary block diagram of a video processing device according to an embodiment of the present disclosure is shown.

[0060] like Figure 3 As shown, the video processing apparatus 300 may include an input unit 310 , a template determination unit 320 , a generation unit 330 , a sorting unit 340 , and an output unit 350 .

[0061] The input unit 310 may be configured to obtain input material for generating a video. The template determination unit 320 may be configured to determine a plurality of action templates for processing the input material, wherein each action template corresponds to a different action performed by a virtual image. The generation unit 330 may be configured to generate a plurality of action videos based on the input material and the plurality of action templates, wherein the virtual image in each action video performs an action in a corresponding action template. The sorting unit 340 may be configured to sort the plurality of action videos based on video quality. The output unit 350 may be configured to output at least a portion of the plurality of action videos according to the sorting.

[0062] In some embodiments, the input material includes at least one of audio and text.

[0063] In some embodiments, determining a plurality of action templates for processing the input material includes: determining a user-specified virtual image in response to a user input; and determining a plurality of action templates corresponding to the user-specified virtual image.

[0064] In some embodiments, sorting the multiple action videos based on video quality includes: determining at least one qualified action video from the multiple action videos based on predetermined image quality standards and duration standards; and sorting the at least one qualified action video based on predetermined sorting rules.

[0065] In some embodiments, the duration standard includes a video length of less than 30 seconds and greater than 10 seconds.

[0066] In some embodiments, the output unit is further configured to: display at least a portion of the multiple action videos according to the sorting on a user interface; and in response to a user selecting at least two of the displayed action videos, generate an output video using the selected action videos.

[0067] In some embodiments, the output video includes the selected at least two action videos and a connection segment between different action videos.

[0068] In some embodiments, the transition segment is generated by converting text to video and does not include the virtual image.

[0069] It should be understood that Figure 3 The various units of the device 300 shown in FIG. 3 can be used in conjunction with the reference Figure 1 The steps in the method 100 described above correspond to each other. Therefore, the operations, features and advantages described above for the method 100 are also applicable to the device 300 and the units included therein. For the sake of brevity, some operations, features and advantages are not repeated here.

[0070] It should also be understood that various techniques may be described herein in the general context of software hardware elements or program modules. Figure 3 The various units described can be implemented in hardware or in hardware in combination with software and / or firmware. For example, these units can be implemented as computer program codes / instructions, which are configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, these units can be implemented as hardware logic / circuits. For example, in some embodiments, one or more of the input unit 310, the template determination unit 320, the generation unit 330, the sorting unit 340, and the output unit 350 can be implemented together in a system on chip (System onChip, SoC). SoC may include an integrated circuit chip (which includes a processor (e.g., a central processing unit (CPU), a microcontroller, a microprocessor, a digital signal processor (DSP), etc.), a memory, one or more communication interfaces, and / or one or more components in other circuits), and may optionally execute the received program code and / or include embedded firmware to perform functions.

[0071] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a computer program, and the computer program implements the above method when executed by the at least one processor.

[0072] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program is also provided, wherein the computer program implements the above method when executed by a processor.

[0073] According to another aspect of the present disclosure, a computer program product is further provided, comprising a computer program, wherein the computer program implements the above method when executed by a processor.

[0074] See also Figure 4, a block diagram of an electronic device 400 that can be used as a server or client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device can be a computer device of different types, such as a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0075] like Figure 4 As shown, the electronic device 400 may include at least one processor 401 , a working memory 402 , an input unit 404 , a display unit 405 , a speaker 406 , a storage unit 407 , a communication unit 408 , and other output units 409 that can communicate with each other via a system bus 403 .

[0076] Processor 401 may be a single processing unit or multiple processing units, all of which may include a single or multiple computing units or multiple cores. Processor 401 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuits, and / or any device that manipulates signals based on operating instructions. Processor 401 may be configured to obtain and execute computer-readable instructions stored in working memory 402, storage unit 407, or other computer-readable media, such as program codes of operating system 402a, program codes of application programs 402b, and the like.

[0077] Working memory 402 and storage unit 407 are examples of computer-readable storage media for storing instructions that are executed by processor 401 to implement the various functions described above. Working memory 402 may include both volatile memory and non-volatile memory (e.g., RAM, ROM, etc.). In addition, storage unit 407 may include a hard disk drive, a solid-state drive, a removable medium, including external and removable drives, a memory card, a flash memory, a floppy disk, an optical disk (e.g., a CD, a DVD), a storage array, a network attached storage, a storage area network, etc. Working memory 402 and storage unit 407 may all be collectively referred to herein as memory or computer-readable storage media, and may be a non-transitory medium capable of storing computer-readable, processor-executable program instructions as computer program code, which may be executed by processor 401 as a specific machine configured to implement the operations and functions described in the examples herein.

[0078] The input unit 406 may be any type of device capable of inputting information to the electronic device 400. The input unit 406 may receive input digital or character information and generate key signal input related to user settings and / or function control of the electronic device, and may include but is not limited to a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone and / or a remote controller. The output unit may be any type of device capable of presenting information, and may include but is not limited to a display unit 405, a speaker 406, and other output units 409, which may include but are not limited to video / audio output terminals, vibrators and / or printers. The communication unit 408 allows the electronic device 400 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks, and may include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver and / or a chipset, such as a Bluetooth device, an 802.8 device, a WiFi device, a WiMax device, a cellular communication device and / or the like.

[0079] The application 402b in the working register 402 can be loaded to execute the various methods and processes described above, such as Figure 1 401. For example, in some embodiments, the method 100 described above may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 407. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 400 via the storage unit 407 and / or the communication unit 408. When the computer program is loaded and executed by the processor 401, one or more steps of the method 100 described above may be performed. Alternatively, in other embodiments, the processor 401 may be configured to execute the method 100 in any other appropriate manner (e.g., by means of firmware).

[0080] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0081] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0082] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0083] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0084] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0085] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.

[0086] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0087] Although the embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above-mentioned methods, systems and devices are merely exemplary embodiments or examples, and the scope of the present invention is not limited by these embodiments or examples, but only by the claims after authorization and their equivalent scope. Various elements in the embodiments or examples can be omitted or replaced by their equivalent elements. In addition, each step can be performed in an order different from that described in the present disclosure. Further, the various elements in the embodiments or examples can be combined in various ways. It is important that with the evolution of technology, many elements described herein can be replaced by equivalent elements that appear after the present disclosure.

Claims

1. A video processing method, comprising: Obtain input material for generating a video; determining a plurality of action templates for processing the input material, wherein each action template corresponds to a different action performed by the avatar; Generate multiple action videos based on the input material and the multiple action templates, wherein the virtual image in each action video performs the action in the corresponding action template and the duration of the action video is less than a predetermined duration threshold; sorting the multiple action videos based on video quality; At least a portion of the plurality of action videos is output according to the sorting.

2. The video processing method according to claim 1, wherein: The input material includes at least one of audio and text.

3. The video processing method according to claim 1, wherein: Determining a plurality of action templates for processing the input material comprises: determining a user-specified avatar in response to user input; and A plurality of action templates corresponding to the virtual image specified by the user are determined.

4. The video processing method according to claim 1, wherein: Sorting the plurality of action videos based on video quality includes: Determining at least one qualified action video from the plurality of action videos based on a predetermined image quality standard and a duration standard; The at least one qualified action video is sorted based on a predetermined sorting rule.

5. The video processing method according to claim 4, wherein: The duration standard includes that the video length is less than 30 seconds and greater than 10 seconds.

6. The video processing method according to claim 1, further comprising: Displaying at least a portion of the plurality of action videos on a user interface according to the order; In response to a user selecting at least two of the displayed action videos, an output video is generated using the selected action videos.

7. The video processing method according to claim 6, wherein: The output video includes the selected at least two action videos and a connection segment between different action videos.

8. The video processing method as claimed in claim 7, wherein the connection segment is generated by converting text to video and does not include the virtual image.

9. A video processing device, comprising: An input unit, configured to obtain input material for generating a video; a template determination unit configured to determine a plurality of action templates for processing the input material, wherein each action template corresponds to a different action performed by the avatar; A generating unit configured to generate a plurality of action videos based on the input material and the plurality of action templates, wherein the avatar in each action video performs an action in the corresponding action template and the duration of the action video is less than a predetermined duration threshold; A sorting unit, configured to sort the plurality of action videos based on video quality; An output unit is configured to output at least a part of the multiple action videos according to the sorting.

10. The video processing device according to claim 9, wherein: The input material includes at least one of audio and text.

11. The video processing device according to claim 10, wherein: Determining a plurality of action templates for processing the input material comprises: determining a user-specified avatar in response to user input; and A plurality of action templates corresponding to the virtual image specified by the user are determined.

12. The video processing device according to claim 9, wherein: Sorting the plurality of action videos based on video quality includes: Determining at least one qualified action video from the plurality of action videos based on a predetermined image quality standard and a duration standard; The at least one qualified action video is sorted based on a predetermined sorting rule.

13. The video processing device according to claim 12, wherein: The duration standard includes that the video length is less than 30 seconds and greater than 10 seconds.

14. The video processing device according to claim 9, wherein the output unit is further configured to: Displaying at least a portion of the plurality of action videos on a user interface according to the order; In response to a user selecting at least two of the displayed action videos, an output video is generated using the selected action videos.

15. The video processing device according to claim 14, wherein: The output video includes the selected at least two action videos and a connection segment between different action videos.

16. The video processing method according to claim 15, wherein the connection segment is generated by converting text to video and does not include the virtual image.

17. An electronic device comprising: at least one processor; as well as a memory communicatively coupled to the at least one processor; in The memory stores a computer program, which, when executed by the at least one processor, implements the method according to any one of claims 1 to 8.

18. A non-transitory computer-readable storage medium storing a computer program, wherein: The computer program implements the method according to any one of claims 1 to 8 when executed by a processor.

19. A computer program product comprising a computer program, wherein: The computer program implements the method according to any one of claims 1 to 8 when executed by a processor.

Citation Information

Patent Citations

  • Method and device for carrying out video communication in virtual scene

    CN107333086A

  • Method and equipment for synthesizing action sequence of virtual object

    CN111369687A

  • Video processing method and device, electronic equipment and storage medium

    CN111695505A

  • Video data generation method and device, electronic equipment and storage medium

    CN114615513A

  • Virtual image video generation method and device, electronic equipment and storage medium

    CN116645455A