Methods, systems, and processor-readable media for generating personalized video

By using processors to generate personalized videos in messaging applications, the problem of inability to edit videos in the prior art is solved, and the function of generating personalized videos in messaging applications is realized, which simplifies the video editing process and supports text content. dynamic changes.

CN118918219APending Publication Date: 2024-11-08SNAP INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410811702.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2019-10-23
Filing Date
2020-01-18
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing messaging applications cannot generate personalized videos with complex edits, such as replacing one face with another, requiring the use of third-party video editing software.

Method used

A system and method are designed to receive video templates and preset text parameters through the processor, generate configuration files to realize personalized video of text messages, including frame image sequences and animation text parameters, supporting various visual effects and text parameter adjustments , and can generate and send personalized videos in real time.

Benefits of technology

It realizes the generation of personalized videos with customized text messages in the messaging application, simplifying the video editing process, and users can dynamically change the text content before and after sending, and preview and send in full screen mode.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118918219A_ABST
    Figure CN118918219A_ABST
Patent Text Reader

Abstract

Methods, systems, and processor-readable media for generating personalized video are described. An example method may start from receiving a video template. The video template may include a sequence of frame images and preset text parameters defining an animation of the text. The method may continue to generate a configuration file based on the text and the preset text parameters. The profile may include text parameters defining a presentation of text for each frame image. The method may also include receiving the input text and presenting an output video including a sequence of frame images characterizing the input text presented according to the text parameters. Presentation may be performed based on the configuration file. The method may continue to chat the output video transmission to another computing device via the communication.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the Chinese national phase application of the PCT application with international application number PCT / US2020 / 014226, filing date January 18, 2020, and invention name “System and method for generating personalized videos with customized text messages”, the application number of which is 202080009460.4, and all contents of which are incorporated herein by reference. Technical Field

[0002] The present disclosure relates generally to digital image processing. In particular, the present disclosure relates to systems and methods for generating personalized videos with customized text messages. Background Art

[0003] Sharing media such as stickers and emojis has become a standard option in messaging applications (also referred to herein as messengers). Currently, some messengers provide users with the option to generate images and short videos and send them to other users via communication chats. Some existing messengers allow users to modify short videos before transmission. However, the modification of short videos provided by existing messengers is limited to visualization effects, filters and text. Users of current messengers cannot perform complex editing (e.g., replacing one face with another). Such video editing cannot be provided by current messengers and requires complex third-party video editing software. Summary of the invention

[0004] The purpose of this section is to introduce selected concepts in a simplified form, the details of which are described in the detailed description below. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

[0005] According to one embodiment of the present disclosure, a system for generating a personalized video with a customized text message is disclosed. The system may include at least one processor and a memory storing processor executable code. At least one processor may be configured to receive a video template. The video template may include a sequence of frame images and preset text parameters defining the animation of the text. The preset text parameters may describe the visual effects applied to the text and include the font of the text, the color of the text, and the position of the text in at least one frame image. The visual effects may include letter animation of the appearance, displaying text along a path, displaying a copy of the text, compression of the text, segmentation of the text, directional appearance of the text, randomized letter appearance, distortion and scaling of the text, gradient fill of the text, adding shadows and glows to the text, adding directional glows to the text, flashing appearance of the text, adding perspective shadows to the text, applying dynamic glows to the text, displaying distorted shadows or outlines of the text, outlining the text, and applying a color font library (asset) to the text, etc.

[0006] The processor may also be configured to generate a configuration file based on the text and preset text parameters. The configuration file may include text parameters that define the presentation of the text for each frame image. The text parameters may include the scale of the text, the position of the text in at least one of the frame images, the rotation of the text, the color of the text, the number of lines of the text, and the maximum length of the text, etc. The scale may be adjusted based on a global scale. The global scale may be determined to fit the input text to the boundaries of the frame images in the sequence. The processor may also be configured to receive the input text and present an output video, the output video including a sequence of frame images, the frame images representing the input text presented according to the text parameters. The presentation may be performed based on the configuration file. The processor may also be configured to send the output video to another computing device via a communication chat. The presentation may be performed by generating a glyph of the input text based on the configuration file and generating a layer including the glyph. The presentation may also include splitting the input text into multiple lines. At least one processor may also be configured to play the output video in full screen mode before sending the output video. While displaying the output video, the user is provided with an option to change the input text to another input text, and in the displayed output video, the input text is dynamically changed with the other input text.

[0007] According to an exemplary embodiment, a method for generating a personalized video with a customized text message is disclosed. The method may start with receiving a video template. The video template may include a sequence of frame images and preset text parameters that define the animation of the text. The preset text parameters may describe the visual effects applied to the text and include the font of the text, the color of the text, and the position of the text in at least one frame image. The visual effects may include letter animation of the appearance, displaying text along a path, displaying a copy of the text, compression of the text, segmentation of the text, directional appearance of the text, randomizing the appearance of letters, distortion and scaling of the text, gradient fill of the text, adding shadows and glows to the text, adding directional glows to the text, flashing appearance of the text, adding perspective shadows to the text, applying dynamic glows to the text, displaying distorted shadows or outlines of the text, outlining the text, and applying a color font library to the text, etc. The method may continue to generate a configuration file based on the text and the preset text parameters. The configuration file may include text parameters that define the presentation of the text for each frame image. The text parameters may include the scale of the text, the position of the text in at least one of the frame images, the rotation of the text, the color of the text, the number of lines of the text, and the maximum length of the text. The scale may be adjusted based on the global scale. The global scale may be determined to fit the input text to the boundaries of the frame images in the sequence. The method may also include receiving the input text and presenting an output video, the output video including a sequence of frame images, the frame images representing the input text presented according to the text parameters. The presentation may be performed based on a configuration file. The method may continue to send the output video to another computing device via a communication chat. The presentation may be performed by generating a glyph of the input text based on the configuration file and generating a layer including the glyph. The presentation may also include splitting the input text into multiple lines. The method may optionally include playing the output video in full screen mode before sending the output video. While displaying the output video, the user is provided with the option of changing the input text to another input text, and in the displayed output video, the input text is dynamically changed with the other input text.

[0008] According to another aspect of the present disclosure, a non-transitory processor-readable medium is provided, which stores processor-readable instructions. When the processor-readable instructions are executed by a processor, they cause the processor to implement the above-mentioned method for generating a personalized video with a customized text message.

[0009] Additional objects, advantages and novel features of the examples will be set forth in part in the following description, and in part will become apparent to those skilled in the art upon examination of the following description and the accompanying drawings, or may be learned by production or operation of the examples. The objects and advantages of the concepts may be realized and obtained by means of the methods, means and combinations particularly pointed out in the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings in which like references indicate similar elements.

[0011] Figure 1 is a block diagram illustrating an example environment in which systems and methods for generating personalized videos with customized text messages may be implemented.

[0012] Figure 2 is a block diagram illustrating an exemplary embodiment of a computing device for implementing a method for generating a personalized video with a customized text message.

[0013] Figure 3 is a flow chart illustrating a process for generating a personalized video with a customized text message according to some exemplary embodiments of the present disclosure.

[0014] Figure 4 is a flow chart illustrating the functionality of a system for generating a personalized video with a customized text message according to some exemplary embodiments of the present disclosure.

[0015] Figure 5 An example frame with text rendered based on preset text parameters is shown according to some example embodiments.

[0016] Figure 6 and Figure 7 An example screen of a communication chat is shown in which systems and methods for generating a personalized video with a customized text message may be implemented according to some example embodiments.

[0017] Figure 8 Example frames of a personalized video generated based on a user image according to an exemplary embodiment are shown.

[0018] Fig. 9 is a flowchart illustrating a method for generating a personalized video based on a template according to an exemplary embodiment of the present disclosure.

[0019] Fig.10 An example computer system is shown that can be used to implement systems and methods for generating personalized videos with customized text messages. DETAILED DESCRIPTION

[0020] The following detailed description of the embodiments includes reference to the accompanying drawings that form a part of the detailed description. The methods described in this section are not prior art to the claims and are not admitted to be prior art by inclusion in this section. The accompanying drawings show descriptions according to exemplary embodiments. These exemplary embodiments, which are also referred to as "examples" in this article, are described in sufficient detail to enable those skilled in the art to practice this subject matter. Without departing from the scope of the claimed protection, the embodiments may be combined, other embodiments may be utilized, or structural, logical and operational changes may be made. Therefore, the following detailed description should not be considered restrictive, and the scope is limited by the attached claims and their equivalents.

[0021] For the purposes of this patent document, the terms "or" and "and" shall mean "and / or" unless otherwise stated or clearly indicated otherwise in the context of their use. The terms "a" and "an" shall mean "one or more" unless otherwise stated or where the use of "one or more" is clearly inappropriate. The terms "comprise," "comprising," "include," and "including" are interchangeable and are not intended to be limiting. For example, the term "comprising" shall be interpreted to mean "including, but not limited to."

[0022] The present disclosure relates to methods and systems for generating personalized videos with customized text messages. The embodiments provided in the present disclosure solve at least some problems of the prior art. The present disclosure can be designed to work in real time on a mobile device such as a smart phone, tablet computer or phone, but the embodiments can be extended to methods involving network services or cloud-based resources. The methods described in this article can be implemented by software running on a computer system and / or by hardware utilizing a combination of microprocessors or other specially designed application-specific integrated circuits (ASICs), programmable logic devices or any combination thereof. Specifically, the methods described in this article can be implemented by a series of computer executable instructions residing on a non-transitory storage medium (e.g., a disk drive or a computer-readable medium).

[0023] Some embodiments of the present disclosure may allow for the generation of personalized videos in real time on a user computing device such as a smart phone. The personalized video may be generated based on a pre-generated video template. The video template may include a sequence of frame images and preset text parameters for animation of text. The video template may also include a sequence of facial region parameters for defining the position of facial regions in the frame images, and a sequence of facial landmark parameters for defining the position of facial landmarks in the frame images. Each facial landmark parameter may correspond to a facial expression. The frame images may be generated based on an animated video or a live-action video. The facial landmark parameters may be generated based on another live-action video (also referred to as Facesync as described in more detail below), an animated video, an audio file, text, or manually generated that characterizes the actor's face. The video template may include a sequence of animated object images. The video template may also include a soundtrack. As used herein, a face-sync actor is a person whose facial landmark parameters are being used, and an actor is another person whose body is being used in a video template and whose skin may be recolored, while a user is a person who takes an image of his face to generate a personalized video. Thus, in some embodiments, the personalized video includes the user's face modified to have the facial expressions of the face-synced actor, and includes the actor's body taken from the video template and recolored to match the user's facial color.

[0024] The pre-generated video templates may be stored remotely in a cloud-based computing resource and may be downloaded by a user of a computing device, such as a smart phone. The user of the computing device may capture an image of a face through the computing device or select an image of a face from a camera roll. The computing device may also generate a personalized video based on the image of the face and one of the pre-generated video templates. The personalized video may feature the face adopting facial expressions corresponding to facial landmark parameters associated with the face-sync actor in the pre-generated video template.

[0025] The computing device may also add text to the generated personalized video. The computing device may generate a configuration file based on preset text parameters. The configuration file may include text parameters that describe the scale, position, rotation, color, and number of lines of text on each frame in the personalized video. The computing device may receive input text to be added to the personalized video from the user. The computing device may present the input text on each frame according to the text parameters in the configuration file. As a result, the input text may appear as an animation in the personalized video. The user may check the personalized video with customized text in full screen mode. When checking the personalized video, the user may change the input text with new input text. The computing device may automatically replace the input text in the personalized video while displaying the personalized video in full screen mode. The user may send the personalized video to another user of another computing device via a communication chat. In some embodiments, generating a personalized video with a customized text message may be integrated in a messenger.

[0026] According to one embodiment of the present disclosure, an example method for generating personalized videos based on templates may include receiving a video template. The video template may include a sequence of frame images and preset text parameters that define the animation of text. The method may continue to generate a configuration file based on the text and the preset text parameters. The configuration file may include text parameters that define the presentation of text for each frame image. The method may also include receiving input text and presenting an output video based on the configuration file. The output video may have a sequence of frame images that characterize the input text presented according to the text parameters. The output video may be sent to another computing device via a communication chat.

[0027] With reference now to the accompanying drawings, exemplary embodiments are described. The accompanying drawings are schematic diagrams of idealized exemplary embodiments. Therefore, the exemplary embodiments discussed herein should not be construed as being limited to the specific descriptions presented herein; rather, as will be apparent to those skilled in the art, these exemplary embodiments may include deviations and differences from the descriptions presented herein.

[0028] Figure 1 1 is an example environment 100 in which a method for generating a personalized video with a customized text message may be implemented. Environment 100 may include computing device 105, user 102, computing device 110, user 104, network 120, and messenger service system 130. Computing device 105 and computing device 110 may refer to mobile devices such as phones, smart phones, or tablets. In other embodiments, however, computing device 110 may refer to a personal computer, a laptop, a netbook, a set-top box, a television device, a multimedia device, a personal digital assistant, a game console, an entertainment system, an infotainment system, a car computer, or any other computing device.

[0029] Computing device 105 and computing device 110 may be communicatively connected to messenger service system 130 via network 120. Messenger service system 130 may be implemented as a cloud-based computing resource. Messenger service system 130 may include computing resources (hardware and software) available at a remote location and accessible via a network (e.g., the Internet). Cloud-based computing resources may be shared by multiple users and may be dynamically reallocated based on demand. Cloud-based computing resources may include one or more server farms / clusters, which include a collection of computer servers that may be co-located with network switches and / or routers.

[0030] Network 120 may include any wired network, wireless network, or optical network (e.g., including the Internet, an intranet, a local area network (LAN), a personal area network (PAN), a wide area network (WAN), a virtual private network (VPN), a cellular telephone network (e.g., Global System for Mobile Communications (GSM)), etc.).

[0031] In some embodiments of the present disclosure, computing device 105 may be configured to initiate a communication chat between user 102 and user 104 of computing device 110. User 102 and user 104 may exchange text messages and videos during the communication chat. The video may include a personalized video. The personalized video may be generated based on a pre-generated video template stored in computing device 105 or computing device 110. In some embodiments, the pre-generated video template may be stored in messenger service system 130 and downloaded to computing device 105 or computing device 110 as needed.

[0032] The messenger service system 130 may include a system 140 for preprocessing videos. The system 140 may generate video templates based on animated videos or live action videos. The messenger service system 130 may include a video template database 145 for storing video templates. The video templates may be downloaded to the computing device 105 or the computing device 110.

[0033] The messenger service system 130 may also be configured to store user profiles. The user profile may include an image of the face of user 102, an image of the face of user 104, and an image of the face of other people. The image of the face may be downloaded to the computing device 105 or computing device 110 on demand and based on permission. In addition, the image of the face of user 102 may be generated using computing device 105 and stored in the local memory of computing device 105. The image of the face may be generated based on other images stored in computing device 105. The computing device 105 may also use the image of the face to generate a personalized video based on a pre-generated video template. Similarly, computing device 110 may be used to generate an image of the face of user 104. The image of the face of user 104 may be used to generate a personalized video on computing device 110. In other embodiments, the image of the face of user 102 and the image of the face of user 104 may be used to generate a personalized video on computing device 105 or computing device 110.

[0034] In some embodiments, the pre-generated video template may include a preset default text message. The pre-generated video template may also include preset text parameters, which are used to animate the preset default text message in the personalized video generated based on the pre-generated video template. The computer device may be configured to play a personalized video that characterizes the preset text message animated based on the preset text parameters. During the playback of the personalized video, the computing device 105 may provide options for changing the preset default text message and parameters for displaying the text message in the personalized video. The computing device 105 may dynamically change the preset default text message in the personalized video while playing the personalized video. The user 105 may also send the personalized video with the changed text message to the user 104 of the computing device 110 via the communication chat.

[0035] In an exemplary embodiment, if in the communication chat, user 104 uses a language different from the language of user 102, the text in the text message can be automatically translated. Therefore, in the communication chat, user 104 can see a personalized video with the text message displayed in the language used by user 104.

[0036] Figure 2 is a block diagram illustrating a computing device 105 (computing device 110) for implementing a method for generating a personalized video with a customized text message. Figure 2 In the example shown, computing device 110 includes both hardware components and software components. Specifically, computing device 110 includes a camera 205 or any other image capture device or scanner for acquiring digital images. Computing device 110 may also include a processor module 210 and a memory storage device 215 for storing software components and processor-readable (machine-readable) instructions or codes that, when executed by processor module 210, cause computing device 105 to perform at least some steps of the method for generating a personalized video with a customized text message as described herein. Computing device 105 may include a graphics display system 230 and a communications module 240. In other embodiments, computing device 105 may include additional or different components. Furthermore, computing device 105 may ... for executing the processing described herein. Figure 2 Fewer components having similar or equivalent functions as depicted.

[0037] The computing device 110 may also include a messenger 220 for initiating a communication chat with another computing device (eg, computing device 110) and a system 250 for generating a personalized video. Figure 4 The system 250 is described in more detail. The messenger 220 and the system 250 may be implemented as software components and processor-readable (machine-readable) instructions or codes stored in the memory storage device 215, which when executed by the processor module 210 causes the computing device 105 to perform at least some steps of the method for providing communication chat and generating personalized video as described herein.

[0038] In some embodiments, the system 250 for generating personalized videos can be integrated into the messenger 220. The user interface of the messenger 220 and the system 400 for personalized videos based on templates can be provided via the graphic display system 230. The communication chat can be initiated via the communication module 240 and the network 120. The communication module 240 may include a GSM module, a wifi module, a Bluetooth module, a TM Modules, etc.

[0039] Figure 33 is a flow chart showing the steps of a process 300 for generating a personalized video with a customized text message according to some exemplary embodiments of the present disclosure. The process 300 may include generating a video template 305, generating default preset text parameters 310, generating a configuration file 315, receiving user input 320, text rendering on a computing device 325, and integrating in a communication chat 330. The generation of the video template 305 and the generation of the default preset text parameters 310 may be performed by a pre-processing messenger service system 130 (in Figure 1 The generation of the configuration file 315, the receiving of the user input 320, and the presentation of the text on the computing device 325 may be performed on the computing device 105 ( Figure 1 The generation 315 of the configuration file may also be performed by the system 140.

[0040] The generation 305 of the video template may include creating a customized personalized video, which is described in more detail in U.S. Patent Application No. 16 / 661,086, entitled “SYSTEMS AND METHODS FOR TEMPLATE-BASED GENERATION OF PERSONALIZED VIDEOS,” filed on October 23, 2019. The customized personalized video may have facial reenactments suitable for any situation in which the personalized video may be used.

[0041] Configuration file 315 includes parameters associated with the positioning of input text on the video template. The default preset text parameters may employ various tools for artistic text animation, describing fonts (any existing fonts may be used or new fonts may be created), colors or animated textures, shadows and outlines, and other effects including but not limited to letter appearance animation, text on a path, identical text copies, text compression, text slicing, word appearance, directional appearance, randomized letter appearance, text box distortion / scaling, gradient fill, shadow and glow, directional glow, flash appearance, perspective shadow, dynamic glow, distorted shadow / outline, outline text, color font library, 3D stroke effect, dynamic outline, masking video or texture, masking effect on random letter parts, visual effects anchored to text box / letters, 3D text, blur, electronic pulse, etc. The preset text parameters may have some constant parameters fixed and some template parameters configured later for each personalized video.

[0042] The generation 315 of the configuration file may include creating a configuration file for each customized personalized video. The configuration file may describe the scale, position, rotation, and color of the text on each frame; the number of lines and maximum length; the preset text parameters and template parameters selected for all features used in the preset text parameters, etc. The configuration file may be generated on the computing device or alternatively in the cloud. The generation 315 of the configuration file may also be performed by the system 140.

[0043] In some exemplary embodiments, text rendering 325 on a computing device may include five steps. The first step is to split the text into multiple lines if necessary. The second step includes generating glyphs with predefined sizes and fonts. A global text scale may be selected in the third step so that the text fits the required boundaries in all frames. The fourth step may include a pre-rendered layer (which may be performed on a computing device) with glyphs, outlines, and shadows. In the fifth step, the prepared layer is rendered based on predetermined parameters. Rendering may be performed on a computing device using a graphics processing unit (GPU) with the help of a graphics library (such as OpenGL, Metal, or Vulkan). In some embodiments, the rendering of a customized personalized video with text may be performed remotely, i.e., on a server or in the cloud.

[0044] Integration 330 in communication chat may include integrating personalized video into communication chat by adding the entered text to the personalized video and sending the personalized video as an encoded video. When the user enters text, the sticker icon will become a user face icon, and when the user goes to the keyboard, the user can see a small preview of the generated personalized video with the given text. Then, the user can send the personalized video to the communication chat in full screen mode. The image of the user's face used in creating the personalized video can be bound to the account of the user who is the sender of the personalized video, and if the privacy settings of the user for the image of the user's face allow, it can be used by other users. When using communication chat, users can also create personalized videos with the faces of other users they are chatting with. Users can also be allowed to use any image with a face from a picture library uploaded from the Internet or stored on the user's computing device.

[0045] The user can view the preview of the generated personalized video with customized text in full screen mode before sending. In addition, a tool for changing text while viewing the personalized video in full screen mode can be provided. The user can also have the ability to change the text of the selected personalized video preview by tapping the text button in the tool bar. The user can choose to output the generated personalized video in the form of coded video or graphics interchange format (GIF) file.

[0046] In an exemplary embodiment, a user may access an interface that allows customization of a personalized video not only by adding text and changing parameters of the text, but also by selecting other parameters such as text color, position; adding effects and transitions, shots, music and sounds; changing backgrounds; changing gender / costumes of actors in the personalized video, selecting characters; changing art style, etc. The user may select parameters of the text from a previously created list or through the necessary information provided to the user in response to the user's search query. In some embodiments, links, tags, or geographic locations may additionally be added to the personalized video.

[0047] Figure 4 4 is a schematic diagram illustrating the functionality 400 of the system 250 for generating personalized videos according to some exemplary embodiments. The system 250 may receive a user facial image 405, a video template 410, and input text 407. The video template 410 may include a sequence of frame images. For each frame image, the video template 410 may also include facial region parameters, facial landmark parameters, skin mask, eye parameters, mouth region image, head parameters, animated object images, and preset text parameters. The video template 410 may also include a soundtrack.

[0048] A sequence of frame images may be generated based on a live-action video or an animated video. The facial region parameters may include coordinates of the location of the facial region within the frame image. The facial landmark parameters may be generated based on a live-action video characterizing the face of a face-sync actor. The facial landmark parameters may include coordinates of facial landmarks on the face of the face-sync actor (such as points around the oval of the face, points around the lips and nose, and points around the eyebrows and eyelids). The eye parameters may include coordinates of the location of the iris in the sclera of the face-sync actor. The mouth region image may include an image of the mouth region of the face of the face-sync actor. The skin mask may be generated based on a skin region of a live-action video characterizing the actor's body or a 2D / 3D animation of the body. The skin mask may define a skin region of the actor's body. In an exemplary embodiment, the skin mask and facial landmark parameters may be generated based on two different live-action videos capturing different actors (referred to herein as actors and face-sync actors, respectively). It should be noted that multiple actors are not required, and in some embodiments, only one actor may be used.

[0049] Preset text parameters can define the animation of text. Preset text parameters can describe the visual effects applied to text. Visual effects can include one or more of the following: letter animation of appearance, display text along a path, display a copy of text, compression of text, segmentation of text, directional appearance of text, randomization of letter appearance, distortion and scaling of text, gradient fill of text, adding shadow and glow to text, adding directional glow to text, flash appearance of text, adding perspective shadow to text, applying dynamic glow to text, displaying distorted shadow or outline of text, outlining text, and applying a color font library to text, etc. Preset text parameters can also include default text to be animated. In some embodiments, localization of executable text. Specifically, localization of text can be performed by adding a translation of default text for each personalized video in a configuration file.

[0050] The system 250 may determine user data 435 based on the user facial image 405. The user data may include facial landmarks of the user, a facial mask of the user, and color data of the user.

[0051] System 250 may generate frames 445 of personalized video 440 based on user data 435 and data sequence 420. Personalized video 440 may be generated in the form of an audiovisual medium (e.g., video, animation, or any other type of media) that represents the face of a user or the faces of multiple users. Personalized video 440 may be generated based on a pre-generated video template. The video template may include video configuration data. The video configuration data may include a sequence of frame images, a sequence of facial region parameters that define the location of facial regions in the frame images, and a sequence of facial landmark parameters that define the location of facial landmarks in the frame images. Each facial landmark parameter may correspond to a facial expression of a face-sync actor. The pre-generated video template may be stored remotely in a cloud-based computing resource and may be downloaded by a user of a computing device (e.g., a smart phone). The user of the computing device may capture an image of the face through the computing device or select an image of the face from a camera roll. The computing device may also generate a personalized video based on the image of the face and one of the pre-generated video templates. The generation of the personalized video may include modifying the frame images of the sequence of frame images. The modification of the frame image includes modifying the image of the source face to obtain another image, the other image representing the source face adopting the facial expression corresponding to the facial landmark parameters, and inserting the other image into the frame image at a position determined by the facial region parameters corresponding to the frame image. The image of the source face can be modified based on the facial landmark parameters corresponding to the frame image. The system 250 can also add a soundtrack to the personalized video 440.

[0052] System 250 may generate configuration file 460 based on preset text parameters. Configuration file generation 315 may also be performed by system 140. Configuration file 460 may include text parameters that define the presentation of text for each frame image. The text parameters may include the scale of the text, the position of the text in at least one of the frame images, the rotation of the text, the color of the text, the number of lines of the text, and the maximum length of the text, etc.

[0053] System 250 may render an output video based on the configuration file, the output video comprising a sequence of frame images 445 representing input text 407 rendered according to the text parameters. Rendering the input text may include generating a glyph of the input text based on the configuration file, and generating a layer including the glyph.

[0054] Figure 5 An example frame with text rendered based on preset text parameters is shown according to some example embodiments. Figure 5 A frame 505 with preset text is shown, wherein the text is 3D text 525 . Figure 5 Also shown is a frame 510 with preset text, wherein the text is surrounded by a glowing text outline 530 . Figure 5 Also shown is a frame 515 with preset text, wherein the text is surrounded by a plurality of colored outlines 535 . Figure 5 A frame 520 with preset text is shown, wherein the text is shown by metallic letters 540 .

[0055] Figure 6 and Figure 7 An example screen of a communication chat is shown in which systems and methods for generating personalized videos with customized text messages can be implemented. Figure 6 User interface 605 is shown with user input 640 and keyboard 645 . Figure 6 Also shown is a user interface 610 with a list 650 of personalized videos. The user interface 615 shows a toolbar 635, one selected personalized video 630, and a change text button 655. The user interface 620 shows that when the personalized video 630 is selected, the user can change the text 640 when the change text button 655 is pressed.

[0056] Figure 7 A user interface 705 is shown showing a personalized video 630 in full screen mode. The user interface 705 may have a change text button 720 to enable a user to change the text 640 in the personalized video 630. The user interface 710 shows a process of changing the text 640 via a keyboard 645 when the personalized video 630 is in full screen mode. The user interface 715 shows the personalized video 630 with the text 640 and sent to the communication chat 725.

[0057] Figure 8An example frame of a personalized video customized by changing the background according to an exemplary embodiment is shown. The user can select the background of the personalized video by selecting the user's image or any other photo or video material. For better visual presentation, the background of such a customized personalized video can be transparent. Figure 8 Frame 805 of a personalized video 820 is shown with a background created based on a user image 825. The user interface 810 is a gallery 830 of customized personalized videos. Figure 8 Also shown is frame 815 of a personalized video 835 having a background created based on the user image 840. The user can also add text to the personalized videos 820 and 835.

[0058] Fig. 9900 is a flowchart illustrating a method 900 for generating a personalized video with a customized text message according to some exemplary embodiments of the present disclosure. The method 900 may be performed by a computing device 105. The method 900 may start by receiving a video template at step 905. The video template may include a sequence of frame images and preset text parameters defining animation of text. The preset text parameters may describe a visual effect applied to the text and include the font of the text, the color of the text, and the position of the text in at least one frame image. The visual effect may include letter animation of appearance, displaying text along a path, displaying a copy of the text, compression of the text, segmentation of the text, directional appearance of the text, randomizing the appearance of letters, distortion and scaling of the text, gradient fill of the text, adding shadows and glows to the text, adding directional glows to the text, flashing appearance of the text, adding perspective shadows to the text, applying dynamic glows to the text, displaying distorted shadows or outlines of the text, outlining the text, and applying a color font library to the text, etc. At step 910, the method 900 may continue to generate a configuration file based on the text and the preset text parameters. The configuration file may include text parameters defining the presentation of the text for each frame image. The text parameters may include the scale of the text, the position of the text in at least one of the frame images, the rotation of the text, the color of the text, the number of lines of the text, and the maximum length of the text. The scale may be adjusted based on the global scale. The global scale may be determined to fit the input text to the boundaries of the frame images in the sequence. The method 900 may also include receiving the input text at step 915 and presenting the output video at step 920. The output video may include a sequence of frame images representing the input text presented according to the text parameters. The presentation may be performed based on a configuration file. The method 900 may continue at step 925, sending the output video to another computing device via a communication chat. The presentation may be performed by generating a glyph of the input text based on the configuration file and generating a layer including the glyph. The presentation may also include splitting the input text into multiple lines. The method may optionally include playing the output video in full screen mode before sending the output video. While displaying the output video, the user is provided with the option of changing the input text to another input text, and in the displayed output video, the input text is dynamically changed with the other input text.

[0059] Fig.10 An example computing system 1000 is shown that can be used to implement the methods described herein. The computing system 1000 can be implemented in the context of computing devices 105 and 110, messenger service system 130, messenger 220, and system 250 for generating personalized video.

[0060] like Fig.10As shown, the hardware components of the computing system 1000 may include one or more processors 1010 and a memory 1020. The memory 1020 stores, in part, instructions and data for execution by the processor 1010. The memory 1020 may store executable code when the system 1000 is running. The system 1000 may also include an optional mass storage device 1030, an optional portable storage medium drive 1040, one or more optional output devices 1050, one or more optional input devices 1060, an optional network interface 1070, and one or more optional peripheral devices 1080. The computing system 1000 may also include one or more software components 1095 (e.g., a software component that may implement the method for providing personalized video as described herein).

[0061] Fig.10 The components shown are depicted as being connected via a single bus 1090. The components may be connected via one or more data transfer devices or data networks. The processor 1010 and memory 1020 may be connected via a local microprocessor bus, and the mass storage device 1030, peripheral device 1080, portable storage device 1040, and network interface 1070 may be connected via one or more input / output (I / O) buses.

[0062] Mass storage 1030, which may be implemented with a magnetic disk drive, solid-state disk drive, or optical disk drive, is a non-volatile storage device for storing data and instructions for use by processor 1010. Mass storage 1030 may store system software (e.g., software component 1095) for implementing the embodiments described herein.

[0063] The portable storage media drive 1040 operates in conjunction with a portable non-volatile storage medium, such as a compact disk (CD) or digital video disk (DVD), to input and output data and code to and from the computing system 1000. System software (e.g., software component 1095) for implementing the embodiments described herein may be stored on such portable media and input to the computing system 1000 via the portable storage media drive 1040.

[0064] Optional input device 1060 provides a portion of the user interface. Input device 1060 may include an alphanumeric keypad (e.g., a keyboard) or a pointing device (e.g., a mouse, trackball, stylus, or cursor direction keys) for entering alphanumeric and other information. Input device 1060 may also include a camera or scanner. In addition, Fig.10 The illustrated system 1000 includes an optional output device 1050. Suitable output devices include speakers, printers, network interfaces, and monitors.

[0065] The network interface 1070 can be used to communicate with external devices, external computing devices, servers, and networking systems via one or more communication networks, such as one or more wired networks, wireless networks, or optical networks, including, for example, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), a cellular phone network, a Bluetooth radio, and a radio frequency network based on IEEE802.11, etc. The network interface 1070 can be a network interface card (such as an Ethernet card, an optical transceiver, a radio frequency transceiver), or any other type of device capable of sending and receiving information. The optional peripheral devices 1080 can include any type of computer support device to add additional functionality to the computer system.

[0066] The components included in computing system 1000 are intended to represent a large class of computer components. Thus, computing system 1000 may be a server, a personal computer, a handheld computing device, a phone, a mobile computing device, a workstation, a minicomputer, a mainframe computer, a network node, or any other computing device. Computing system 1000 may also include different bus configurations, networking platforms, multi-processor platforms, etc. Various operating systems (OS) may be used, including UNIX, Linux, Windows, Macintosh OS, Palm OS, and other suitable operating systems.

[0067] Some of the above functions may consist of instructions stored on a storage medium (e.g., a computer-readable medium or a processor-readable medium). The instructions may be retrieved and executed by a processor. Some examples of storage media are storage devices, tapes, disks, etc. The instructions are operable when executed by the processor to direct the processor to operate in accordance with the present invention. Those skilled in the art are familiar with instructions, processors, and storage media.

[0068] It is noteworthy that any hardware platform suitable for performing the processing described herein is suitable for the present invention. As used herein, the terms "computer-readable storage medium" and "computer-readable storage medium" refer to any medium that participates in providing instructions to a processor for execution. Such media can take many forms, including but not limited to non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, optical or magnetic disks (such as fixed disks). Volatile media include dynamic memory (such as system random access memory (RAM)).

[0069] Transmission media include coaxial cables, copper wires, and optical fibers, etc., including wires that comprise an embodiment of a bus. Transmission media may also take the form of sound waves or light waves (such as those generated during radio frequency (RF) and infrared (IR) data communications). Common forms of computer-readable media include, for example, floppy disks, flexible disks, hard disks, magnetic tapes, any other magnetic media, CD read-only memory (ROM) disks, DVDs, any other optical media, any other physical media with patterns of marks or holes, RAM, programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), any other memory chip or cassette, carrier waves, or any other medium from which a computer can read.

[0070] Various forms of computer readable media may be involved in carrying one or more sequences of one or more instructions to a processor for execution. The bus carries the data to a system RAM from which the processor retrieves and executes the instructions. The instructions received by the system processor may optionally be stored on a fixed disk before or after execution by the processor.

[0071] Thus, a system and method for generating a personalized video with a customized text message has been described. Although the embodiments have been described with reference to specific exemplary embodiments, it will be apparent that various modifications and changes may be made to these exemplary embodiments without departing from the broader spirit and scope of the present application. Accordingly, the description and drawings should be regarded as illustrative rather than restrictive.

Claims

1. A method for generating a personalized video, the method comprising: receiving, by at least one computing resource, input text and a video template, the video template comprising a sequence of frame images and text parameters defining an animation of the input text of the sequence of frame images; Rendering, by the at least one computing resource, an output video based on the video template, the output video comprising the sequence of the frame images, the frame images representing the input text rendered according to the text parameters; providing, by the at least one computing resource, an option to a user to change at least one of the text parameters; upon receiving an indication that the user has changed the at least one text parameter, dynamically changing, by the at least one computing resource, the input text in the output video according to the at least one text parameter; and The output video is provided by the at least one computing resource to at least one additional computing resource via a communication chat.

2. The method according to claim 1, wherein: The text parameters are pre-generated based on default text.

3. The method according to claim 1, wherein: The option to change the at least one text parameter is provided while the output video is playing in full screen mode.

4. The method according to claim 1, wherein: The at least one text parameter includes one or more of the following items: a font of the input text, a size of the input text, a color of the input text, and a position of the input text.

5. The method according to claim 1, further comprising: Prior to providing the output video to the at least one further computing resource, one or more of the following are added to the output video: geographic location information, tags, and links.

6. The method according to claim 1, wherein: Providing the user with the option to change at least one text parameter includes enabling the user to select the option from a list of options.

7. The method according to claim 1, further comprising: Prior to providing the output video to the at least one further computing resource, a user interface is provided to the user to change the input text to further input text.

8. The method according to claim 1, further comprising: Prior to providing the output video to the at least one further computing resource, a user interface is provided to the user for changing a background of the output video.

9. The method according to claim 1, further comprising: Prior to providing the output video to the at least one further computing resource, a user interface is provided to the user for changing at least one item of clothing of an actor featured in the output video.

10. The method according to claim 1, further comprising: Prior to providing the output video to the at least one additional computing resource, a user interface is provided to the user for adding sound to the output video.

11. A system for generating personalized videos, the system comprising: At least one processor and a memory storing processor executable code, wherein the at least one processor is configured to implement the following operations when executing the processor executable code: receiving, by at least one computing resource, input text and a video template, the video template comprising a sequence of frame images and text parameters defining an animation of the input text of the sequence of frame images; Rendering, by the at least one computing resource, an output video based on the video template, the output video comprising the sequence of the frame images, the frame images representing the input text rendered according to the text parameters; providing, by the at least one computing resource, an option to a user to change at least one of the text parameters; Upon receiving an indication that the user has changed the at least one text parameter, dynamically changing, by the at least one computing resource, the input text in the output video according to the at least one text parameter; and The output video is provided by the at least one computing resource to at least one additional computing resource via a communication chat.

12. The system according to claim 11, wherein: The text parameters are pre-generated based on default text.

13. The system according to claim 11, wherein: The option to change the at least one text parameter is provided while the output video is playing in full screen mode.

14. The system according to claim 11, wherein: The at least one text parameter includes one or more of the following items: a font of the input text, a size of the input text, a color of the input text, and a position of the input text.

15. The system according to claim 11, wherein: The processor is configured to add one or more of the following to the output video before providing the output video to the at least one further computing resource: geographic location information, tags, and links.

16. The system of claim 11, wherein: Providing the user with the option to change at least one text parameter includes enabling the user to select the option from a list of options.

17. The system of claim 11, wherein: The processor is configured to provide the user with a user interface to change the input text to another input text before providing the output video to the at least one other computing resource.

18. The system of claim 11, wherein: The processor is configured to provide the user with a user interface for changing a background of the output video before providing the output video to the at least one further computing resource.

19. The system of claim 11, wherein: The processor is configured to provide the user with a user interface for changing at least one item of clothing of an actor featured in the output video before providing the output video to the at least one further computing resource.

20. A non-transitory processor-readable medium having instructions stored thereon, which when executed by one or more processors cause the one or more processors to implement a method for generating a personalized video, the method comprising: receiving, by at least one computing resource, input text and a video template, the video template comprising a sequence of frame images and text parameters defining an animation of the input text of the sequence of frame images; Rendering, by the at least one computing resource, an output video based on the video template, the output video comprising the sequence of the frame images, the frame images representing the input text rendered according to the text parameters; providing, by the at least one computing resource, an option to a user to change at least one of the text parameters; upon receiving an indication that the user has changed the at least one text parameter, dynamically changing, by the at least one computing resource, the input text in the output video according to the at least one text parameter; and The output video is provided by the at least one computing resource to at least one additional computing resource via a communication chat.