Animation Generation Method, Device, Equipment and Storage Medium

Abstract

Embodiments of the present disclosure provide an animation generation method, apparatus, device, and storage medium. The method includes: obtaining an image drawn by a user; performing image recognition on the image to obtain an animation character and theme information corresponding to the animation character; and generating an animation file according to the animation character and the theme information corresponding to the animation character. In this way, an animation file can be generated based on the image drawn by the user, enabling the user to participate in animation creation and enhancing the user's interest.

Description

Technical Field

[0001] The present disclosure relates to the field of computers, and in particular, to an animation generation method, apparatus, device, and storage medium. Background Art

[0002] Currently, stories are generally shown to users, especially young children, in the form of videos of animations. However, traditional animation creation products all use ready-made and inherent content for one-way dissemination, and users passively receive it. Users cannot actively incorporate their own creativity into the animation or create their own exclusive animation at any time and place. Therefore, how to enable users to participate in animation creation has become an urgent technical problem to be solved currently. Summary of the Invention

[0003] The present disclosure provides an animation generation method, apparatus, device, and storage medium, which can enable users to participate in animation creation and improve the fun of users.

[0004] In a first aspect, embodiments of the present disclosure provide an animation generation method, which includes:

[0005] Obtain an image drawn by a user;

[0006] Perform image recognition on the image to obtain an animation image and theme information corresponding to the animation image;

[0007] Generate an animation file according to the animation image and the theme information corresponding to the animation image.

[0008] In some possible implementations of the first aspect, obtaining the image drawn by the user includes:

[0009] Receive a drawing instruction input by the user;

[0010] Generate an image according to the drawing instruction.

[0011] In some possible implementations of the first aspect, performing image recognition on the image to obtain the animation image includes:

[0012] Perform image recognition on the image to obtain an initial animation image;

[0013] Perform beautification adjustment on the initial animation image to obtain the animation image.

[0014] In some possible implementations of the first aspect, performing beautification adjustment on the initial animation image to obtain the animation image includes:

[0015] Perform beautification adjustment on the initial animation image to obtain a candidate animation image;

[0016] Fuse the features of the candidate animation image and the initial animation image to obtain the animation image.

[0017] In some implementations of the first aspect, an animation file is generated according to an animated image and the theme information corresponding to the animated image, including:

[0018] The animated image and the theme information corresponding to the animated image are processed by a pre-trained animation generation model to generate an animation file.

[0019] In some implementations of the first aspect, an animation file is generated according to an animated image and the theme information corresponding to the animated image, including:

[0020] Determine an animation template corresponding to the theme information;

[0021] Control the animated image to perform actions according to the animation template to generate an animation file.

[0022] In some implementations of the first aspect, the method further includes:

[0023] When playing the animation file, select one or more frames of images to form an image set.

[0024] In a second aspect, an embodiment of the present disclosure provides an animation generation device, which includes:

[0025] An acquisition module for acquiring an image drawn by a user;

[0026] An identification module for performing image recognition on the image to obtain an animated image and the theme information corresponding to the animated image;

[0027] A generation module for generating an animation file according to the animated image and the theme information corresponding to the animated image.

[0028] In a third aspect, an embodiment of the present disclosure provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0029] In a fourth aspect, an embodiment of the present disclosure provides a non-transitory computer-readable storage medium storing computer instructions, and the computer instructions are used to cause a computer to execute the method as described above.

[0030] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, which includes a computer program, and the computer program implements the method as described above when executed by a processor.

[0031] In the present disclosure, image recognition can be performed on an image drawn by a user to obtain an animated character and theme information corresponding to the animated character, and an animation file can be generated based on the animated character and the theme information corresponding to the animated character. In this way, an animation file can be generated based on the image drawn by the user, enabling the user to participate in animation creation and enhancing the user's interest.

[0032] It should be understood that the content described in the summary of the invention section is not intended to limit the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. Brief Description of the Drawings

[0033] In combination with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. The drawings are used to better understand the solution and do not constitute a limitation to the present disclosure. In the drawings, the same or similar reference numerals represent the same or similar elements, where:

[0034] Figure 1 shows a flowchart of an animation generation method provided by an embodiment of the present disclosure;

[0035] Figure 2 shows a structural diagram of an animation generation device provided by an embodiment of the present disclosure;

[0036] Figure 3 shows a structural diagram of an exemplary electronic device capable of implementing the embodiments of the present disclosure. Detailed Description of the Embodiments

[0037] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present disclosure. Obviously, the described embodiments are some, but not all, of the embodiments of the present disclosure. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present disclosure without creative efforts shall fall within the protection scope of the present disclosure.

[0038] In addition, the term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, both A and B exist simultaneously, and B exists alone. In addition, the character " / " in this article generally represents an "or" relationship between the associated objects before and after.

[0039] In view of the problems in the background art, embodiments of the present disclosure provide an animation generation method, apparatus, device, and storage medium. Specifically, image recognition can be performed on an image drawn by a user to obtain an animation image and theme information corresponding to the animation image, and an animation file can be generated based on the animation image and the theme information corresponding to the animation image. In this way, an animation file can be generated based on the image drawn by the user, enabling the user to participate in animation creation and enhancing the user's interest.

[0040] The following will, with reference to the accompanying drawings, elaborate on the animation generation method, apparatus, device, and storage medium provided by the embodiments of the present disclosure through specific embodiments.

[0041] Among them, the animation generation method can be applied to mobile electronic devices or non-mobile electronic devices. For example, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a handheld computer, a projection robot, or an Ultra-Mobile Personal Computer (UMPC), etc., and the non-mobile electronic device can be a Personal Computer (PC), a Television (TV), or an in-vehicle host, etc.

[0042] Figure 1 The flowchart of an animation generation method 100 provided by an embodiment of the present disclosure is shown. As shown in the figure, the animation generation method 100 may include the following steps:

[0043] S110, obtain an image drawn by a user.

[0044] Optionally, a drawing instruction input by the user can be received. For example, the drawing instruction input by the user can be obtained through an interactive interface (such as a painting interface or an AR interface, etc.) or camera recognition. Then, an image can be quickly generated according to the drawing instruction.

[0045] In addition, an image drawn by the user on a drawing board or paper can also be obtained by means of shooting or scanning, etc.

[0046] S120, perform image recognition on the image to obtain an animation image and theme information corresponding to the animation image.

[0047] In some embodiments, image recognition can be performed on the image to obtain an initial animation image and theme information corresponding to the initial animation image, that is, keywords. For example, image recognition can be performed on the image based on a pre-trained image recognition model to obtain the initial animation image and theme information corresponding to the initial animation image.

[0048] Then, beautify and adjust the initial animated image to obtain the animated image, and use the theme information corresponding to the initial animated image as the theme information corresponding to the animated image. In this way, the animated image can be made more beautiful and the user experience can be improved.

[0049] Among them, the beautification and adjustment can be similar to the rendering process, including adjusting unclosed lines to closed lines, optimizing the line curvature, optimizing the color scheme, optimizing the material, etc. In addition, the beautification and adjustment can also be to obtain a target animated image that matches the initial animated image from the animated image library and use the target animated image as the animated image. For example, if the initial animated image is a relatively rough tiger image, a more refined tiger image that matches the tiger image can be obtained from the animated image library and used as the animated image.

[0050] Furthermore, the initial animated image can be adjusted to obtain a candidate animated image, and then the candidate animated image and the initial animated image can be feature-fused to obtain the animated image. That is to say, the beautified animated image and the original animated image can be fused to obtain an animated image that is both beautiful and close to the original image, enhancing the user's immersive experience.

[0051] S130. Generate an animation file according to the animated image and the theme information corresponding to the animated image.

[0052] In some embodiments, the animated image and the theme information corresponding to the animated image can be processed by a pre-trained animation generation model to generate an animation file simply and quickly.

[0053] Among them, the animation generation model can be obtained by training a neural network model (such as a convolutional neural network or a generative adversarial network, etc.) according to fairy tales. The story main body of the animation file is the animated image recognized from the image, and the plot of the animation file is related to the theme information.

[0054] In other embodiments, an animation template, that is, a story template, corresponding to the theme information can be determined. For example, an animation template corresponding to the theme information is determined from the animation template library, where the animation template is used to specify the plot of the animation.

[0055] Then, control the animated image to perform actions according to the animation template to generate an animation file. Specifically, the animated image can be bound to the animation template, and the animated image bound to the animation template can be driven to control the animated image to perform the plot of the animation template, thus generating an animation file simply and quickly.

[0056] According to an embodiment of the present disclosure, image recognition can be performed on an image drawn by a user to obtain an animated image and theme information corresponding to the animated image, and an animation file can be generated based on the animated image and the theme information corresponding to the animated image. In this way, an animation file can be generated based on the image drawn by the user, enabling the user to actively participate in animation creation and create animations according to their own wishes, thereby enhancing the user's interest.

[0057] In some embodiments, the animation file can be played and the playback screen can be projected. Moreover, when playing the animation file, one or more frames of images can be selected to form an image set. The image set can be used to generate an electronic picture book, an electronic storybook, printed as a picture book or a storybook, etc., which is not limited herein. In this way, it is convenient for the user to retain wonderful moments.

[0058] Specifically, one or more frames of images can be selected according to a preset rule. For example, when playing the animation file, one frame of image is selected every ten frames of images.

[0059] It is also possible to receive an image selection instruction and select one or more frames of images indicated by the image selection instruction. For example, it is possible to receive instructions for the user to drag the timeline multiple times through touch screen operations. The frame image that stops at the end of each drag is selected as the image in the image set.

[0060] In some embodiments, a drawing instruction input by the user can be received. For example, the drawing instruction input by the user can be obtained through an interactive interface (such as a painting interface or an AR interface, etc.) or camera recognition. Then, according to the drawing instruction, an initial virtual image is generated, the initial virtual image is beautified and adjusted to obtain a virtual image, and the virtual image is feature-fused with the initial virtual image or the virtual image is displayed in the projection.

[0061] In some embodiments, multiple images drawn by the user can be sequentially obtained, image recognition is performed on the multiple images to obtain multiple animated images and theme information corresponding to the multiple animated images, the multiple animated images and the theme information corresponding to the multiple animated images are combined, and an animation file is generated based on the combined animated images and theme information.

[0062] Next, a specific embodiment is combined to illustrate the animation generation method provided by the present disclosure, which is as follows:

[0063] A drawing instruction input by the user can be obtained through an interactive interface, and an image is generated according to the drawing instruction.

[0064] Performing image recognition on an image based on an image recognition model to obtain an initial animated image and the theme information corresponding to the initial animated image, beautifying and adjusting the initial animated image to obtain a candidate animated image, and then performing feature fusion on the candidate animated image and the initial animated image to obtain an animated image. And using the theme information corresponding to the initial animated image as the theme information corresponding to the animated image.

[0065] Processing the animated image and the theme information corresponding to the animated image according to an animation generation model to generate an animation file, thereby generating an animation file based on the image drawn by the user and enabling the user to participate in the animation creation, improving the user's interest.

[0066] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present disclosure is not limited by the described action sequence, because according to the present disclosure, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to the present disclosure.

[0067] The above is the introduction of the method embodiments. The following further illustrates the solution of the present disclosure through device embodiments.

[0068] Figure 2 The structure diagram of an animation generation device 200 provided according to an embodiment of the present disclosure is shown, as Figure 2 shown, the animation generation device 200 may include:

[0069] An acquisition module 210, configured to acquire an image drawn by a user.

[0070] An identification module 220, configured to perform image recognition on the image to obtain an animated image and the theme information corresponding to the animated image.

[0071] A generation module 230, configured to generate an animation file according to the animated image and the theme information corresponding to the animated image.

[0072] In some embodiments, the acquisition module 210 includes:

[0073] A receiving unit, configured to receive a drawing instruction input by a user.

[0074] A generation unit, configured to generate an image according to the drawing instruction.

[0075] In some embodiments, the identification module 220 includes:

[0076] An identification unit, configured to perform image recognition on the image to obtain an initial animated image.

[0077] A beautification unit for beautifying and adjusting an initial animated image to obtain an animated image.

[0078] In some embodiments, the beautification unit is specifically configured to:

[0079] Beautify and adjust the initial animated image to obtain a candidate animated image.

[0080] Fuse the features of the candidate animated image and the initial animated image to obtain an animated image.

[0081] In some embodiments, according to the animated image and the theme information corresponding to the animated image, an animation file is generated, including:

[0082] Process the animated image and the theme information corresponding to the animated image according to a pre-trained animation generation model to generate an animation file.

[0083] In some embodiments, the generation module 230 includes:

[0084] A determination unit for determining an animation template corresponding to the theme information.

[0085] An action unit for controlling the animated image to perform actions according to the animation template to generate an animation file.

[0086] In some embodiments, the animation generation device 200 further includes:

[0087] A selection module for selecting one or more frames of images to form an image set when playing the animation file.

[0088] It can be understood that Figure 2 Each module / unit in the illustrated animation generation device 200 has the function of implementing each step in the animation generation method 100 provided by the embodiments of the present disclosure and can achieve its corresponding technical effects. For the sake of brevity, they will not be described in detail herein.

[0089] Figure 3 The structure diagram of an electronic device 300 that can be used to implement the embodiments of the present disclosure is shown. The electronic device 300 is intended to represent various forms of digital computers, such as, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device 300 can also represent various forms of mobile devices, such as, personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0090] As Figure 3As shown, the electronic device 300 may include a computing unit 301, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 302 or a computer program loaded from a storage unit 308 into a random access memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the electronic device 300 can also be stored. The computing unit 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input / output (I / O) interface 305 is also connected to the bus 304.

[0091] Multiple components in the electronic device 300 are connected to the I / O interface 305, including: an input unit 306, such as a keyboard, a mouse, etc.; an output unit 307, such as various types of displays, speakers, etc.; a storage unit 308, such as a magnetic disk, an optical disc, etc.; and a communication unit 309, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 309 allows the electronic device 300 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0092] The computing unit 301 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 301 include but are not limited to a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 301 executes the various methods and processes described above, such as method 100. For example, in some embodiments, method 100 can be implemented as a computer program product, including a computer program, which is tangibly contained in a computer-readable medium, such as the storage unit 308. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 300 via the ROM 302 and / or the communication unit 309. When the computer program is loaded into the RAM 303 and executed by the computing unit 301, one or more steps of method 100 described above can be executed. Alternatively, in other embodiments, the computing unit 301 can be configured to execute method 100 in any other appropriate way (e.g., by means of firmware).

[0093] The various embodiments described above in this specification can be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which may be a special-purpose or general-purpose programmable processor that receives data and instructions from, and transmits data and instructions to, a storage system, at least one input device, and at least one output device.

[0094] The program code for implementing the methods of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing device, such that the program codes, when executed by the processor or controller, cause the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0095] In the context of the present disclosure, a computer-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a computer-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0096] It should be noted that the present disclosure also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute method 100 and achieve the corresponding technical effects achieved by the method of the embodiments of the present disclosure. For the sake of concise description, details are not repeated herein.

[0097] In addition, the present disclosure also provides a computer program product, which includes a computer program that implements method 100 when executed by a processor.

[0098] To provide interaction with a user, the above-described embodiments can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and a pointing device (e.g., a mouse or a trackball), through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0099] The above-described embodiments can be implemented in a computing system including a back-end component (e.g., as a data server), or a computing system including a middleware component (e.g., an application server), or a computing system including a front-end component (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with the embodiments of the systems and techniques described herein), or a computing system including any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected to each other by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), and the Internet.

[0100] A computer system can include a client and a server. The client and the server are generally far from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, or a server of a distributed system, or a server combined with a blockchain.

[0101] It should be understood that the various forms of processes shown above can be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and no limitations are imposed herein.

[0102] The above specific embodiments do not constitute a limitation on the protection scope of the present disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principle of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

1. An animation generation method, characterized in that, The method includes: Obtaining an image drawn by a user; Performing image recognition on the image to obtain an animated image and theme information corresponding to the animated image; Generating an animation file according to the animated image and the theme information corresponding to the animated image; The generating an animation file according to the animated image and the theme information corresponding to the animated image includes: Processing the animated image and the theme information corresponding to the animated image according to a pre-trained animation generation model to generate an animation file; Wherein, the animation generation model is obtained by training a neural network model according to fairy tales; the plot of the animation file is related to the theme information; The performing image recognition on the image to obtain an animated image includes: Performing image recognition on the image to obtain an initial animated image; Performing beautification adjustment on the initial animated image to obtain a candidate animated image; Performing feature fusion on the candidate animated image and the initial animated image to obtain the animated image.

2. The method according to claim 1, characterized in that, The obtaining an image drawn by a user includes: Receiving a drawing instruction input by the user; Generating the image according to the drawing instruction.

3. The method according to claim 1, characterized in that, The method further includes: When playing the animation file, selecting one or more frames of images to form an image set.

4. An animation generation device, characterized in that, The device includes: An obtaining module, configured to obtain an image drawn by a user; A recognition module, configured to perform image recognition on the image to obtain an animated image and theme information corresponding to the animated image; A generating module, configured to generate an animation file according to the animated image and the theme information corresponding to the animated image; The generating an animation file according to the animated image and the theme information corresponding to the animated image includes: Processing the animated image and the theme information corresponding to the animated image according to a pre-trained animation generation model to generate an animation file; Wherein, the animation generation model is obtained by training a neural network model according to fairy tales; the plot of the animation file is related to the theme information; The recognition module is specifically configured to: Perform image recognition on the image to obtain an initial animated image; Perform beautification adjustment on the initial animated image to obtain a candidate animated image; Perform feature fusion on the candidate animated image and the initial animated image to obtain the animated image.

5. An electronic device, characterized in that, The electronic device includes: At least one processor; and A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method according to any one of claims 1-3.

6. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause a computer to execute the method according to any one of claims 1-3.

Images