Display animation generation method and device
By setting up storyboard models and animation models in the game, generating and storing display animations, the problems of monotonous content and waste of human resources in traditional animation production are solved, and the automatic generation and efficient display of animations are achieved.
Patent Information
- Application Number
- CN202411779115.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-04
- Publication Date
- 2025-02-25
AI Technical Summary
Traditional display animations are monotonous in the game character fashion display, and there are problems of waste of human resources and information differences in the animation production process.
A display animation generation method is proposed. By setting up a storyboard model to generate a storyboard image according to preset display needs, input it to the animation model to generate a display animation, and finally store the animation in the game client for automatic playback.
It realizes automatic generation of game character fashion display animations, reduces personnel workload, and improves the richness and user experience of animation content.
Smart Images

Figure CN119499644A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the technical field, and in particular to a method and device for generating a display animation. Background Art
[0002] This section is intended to provide a background or context to the embodiments of the disclosure that are recited in the claims. No description herein is admitted to be prior art by inclusion in this section.
[0003] As players' requirements for game graphics performance continue to increase, traditional display animations that are shot in one shot and simply display the fashion itself are relatively monotonous and no longer meet players' expectations. Therefore, in the recent game character display, we enriched the performance by connecting with the background story of the fashion and interacting with other characters in the same story background, as well as through prop shots and plot development, and then formed a rich performance with story logic through design to convey emotions, tell stories and express themes, providing more space for fashion display content.
[0004] Since the animation production process requires a lot of manpower and material resources to plan and produce the demonstration animation video, and during the demonstration animation production process, there is an information gap in the communication between different animation production departments within the company, which leads to waste and mismatch of human resources. Summary of the invention
[0005] In view of this, the purpose of the present disclosure is to provide a display animation generation method and device, which at least to a certain extent solves one of the technical problems in the related art.
[0006] Based on the above-mentioned purpose, the first aspect of the exemplary embodiment of the present disclosure provides a method for generating a display animation, characterized in that the display animation is applied to the display of game character fashion. The method comprises: generating a first command text according to a preset display requirement, inputting the first command text into a preset storyboard model, so that the storyboard model outputs a storyboard image. Generating a second command text according to the storyboard image, inputting the storyboard image and the second command text into a preset animation model, so that the animation model outputs a display animation. The display animation is stored in a game client, so that the game client loads and plays the display animation in response to a user's request to call a game character fashion display interface.
[0007] In some exemplary embodiments, the animation model includes an animation generation model and an animation recognition model. The storyboard image and the second command text are input into a preset animation model so that the animation model outputs a display animation, specifically including: inputting the storyboard image and the second command text into the animation generation model so that the animation generation model outputs a first animation clip. The first animation clip is input into the animation recognition model so that the animation recognition model outputs an animation description text. The animation description text is used to describe the screen content displayed by the first animation clip in text form. The animation description text and the display requirements are input into a preset first language model so that the first language model outputs animation similarity information. In response to the animation similarity information satisfying a preset animation similarity threshold, the first animation clip is output as a display animation.
[0008] In some exemplary embodiments, after the first animation clip is input into the animation recognition model so that the animation recognition model outputs the animation description text, the method further includes: generating a first evaluation text and a first evaluation standard according to the animation description text. The first evaluation standard is set according to the display requirements. The first evaluation text is input into a preset second language model so that the second language model outputs the first evaluation information associated with the animation description text. The first evaluation information is identified according to the first evaluation standard, and in response to the first evaluation information satisfying the first evaluation standard, the animation description text is input into the first language model.
[0009] In some exemplary embodiments, the first evaluation information includes: animation aesthetics score and animation age rating. The first evaluation criteria include: animation aesthetics score is not less than half of the total score, and the animation age rating meets the display requirements.
[0010] In some exemplary embodiments, the storyboard model includes a second language model and an image model. The first command text is input into a preset storyboard model so that the storyboard model outputs a storyboard image, and the method further includes: inputting the first command text into a second language model so that the second language model outputs a storyboard script. A second command text is generated according to the storyboard script, and the storyboard script and the second command text are input into a preset image model so that the image model generates a storyboard image.
[0011] In some exemplary embodiments, a second command text is generated according to a storyboard script, and the storyboard script and the second command text are input into a preset image model so that the image model generates a storyboard image, specifically including: inputting the storyboard image into an image recognition model so that the image recognition model outputs an image description text. The image description text is used to describe the content of the picture displayed by the storyboard image in text form. A second evaluation text and a second evaluation standard are generated according to the image description text. The second evaluation standard is set according to the display requirements. The second evaluation text is input into a preset third language model so that the third language model outputs second evaluation information associated with the image description text. The second evaluation information is identified according to the second evaluation standard, and in response to the second evaluation information satisfying the second evaluation standard, the storyboard image is input into the animation model.
[0012] In some exemplary embodiments, the second evaluation information includes: storyboard relevance score, storyboard aesthetics score and storyboard age rating. The second evaluation criteria include: storyboard relevance score and storyboard aesthetics score are not less than half of the total score, and the storyboard age rating meets the display requirements.
[0013] In some exemplary embodiments, after inputting the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation, the method further includes: inputting the display animation into a preset action model so that the action model outputs a corresponding action gesture. The action gesture is stored in the game client so that the game client loads and displays the action gesture in response to a user's request to call a game character action.
[0014] In some exemplary embodiments, the display animation includes at least one first plot, at least one second plot and a stop-motion animation. The method further includes: playing the first plot according to the user's operation instruction, and in response to the first plot being played, looping the stop-motion animation. According to the user's next operation instruction, the stop-motion animation is stopped and the second plot is started.
[0015] In some exemplary embodiments, the ending picture of the first plot is the same as the starting picture of the stop-motion animation, and the ending picture of the stop-motion animation is the same as the starting picture of the second plot.
[0016] Based on the same inventive concept, the second aspect of the exemplary embodiment of the present disclosure provides a display animation generation device, characterized in that the display animation is applied to the display of game character fashion. The device includes: a storyboard generation module, which is used to generate a first command text according to a preset display requirement, and input the first command text into a preset storyboard model so that the storyboard model outputs a storyboard image. An animation generation module, which is used to generate a second command text according to the storyboard image, and input the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation. An animation display module, which is used to store the display animation in the game client, so that the game client loads and plays the display animation in response to a user's request to call the game character fashion display interface.
[0017] Based on the same inventive concept, a third aspect of the exemplary embodiment of the present disclosure provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect is implemented.
[0018] Based on the same inventive concept, a fourth aspect of the exemplary embodiments of the present disclosure provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the method described in the first aspect.
[0019] Based on the same inventive concept, a fifth aspect of the exemplary embodiments of the present disclosure provides a computer program product, including computer program instructions. When the computer program instructions are executed on a computer, the computer executes the method described in the first aspect.
[0020] From the above description, it can be seen that a display animation generation method provided by an embodiment of the present disclosure generates a storyboard image according to preset display requirements by setting a storyboard model, and then inputs the storyboard image into the animation model, and generates a display animation according to the storyboard image, thereby realizing automatic generation of game character fashion display animation and reducing personnel workload; and then by storing the display animation to the game client, the user can load and play the display animation in time when calling the game character fashion display interface. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the technical solutions in the present disclosure or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0022] Figure 1A schematic diagram of an application scenario of a display animation generation method provided by an embodiment of the present disclosure;
[0023] Figure 2 A flowchart of a method for generating a display animation provided by an embodiment of the present disclosure;
[0024] Figure 3 A flowchart of another embodiment of a method for generating a display animation provided by an embodiment of the present disclosure;
[0025] Figure 4 A flowchart of a method for identifying animation content provided by an embodiment of the present disclosure;
[0026] Figure 5 A schematic diagram of a flow chart of a method for generating a storyboard image provided by an embodiment of the present disclosure;
[0027] Figure 6 A schematic diagram of a flow chart of a method for identifying content of a storyboard image provided by an embodiment of the present disclosure;
[0028] Figure 7 A flowchart of a method for identifying storyboard content provided by an embodiment of the present disclosure;
[0029] Figure 8 A schematic diagram of a flow chart of a method for generating a character action posture provided by an embodiment of the present disclosure;
[0030] Fig. 9 A flowchart of a method for displaying animation playback provided by an embodiment of the present disclosure;
[0031] Fig.10 A schematic diagram of the structure of a display animation generation device provided in an embodiment of the present disclosure;
[0032] Fig.11 A storyboard image generated by applying a storyboard image generation method provided by an embodiment of the present disclosure;
[0033] Fig.12 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment. DETAILED DESCRIPTION
[0034] It is understandable that before using the technical solutions disclosed in the embodiments of this application, the type, scope of use, usage scenarios, etc. of the personal information involved in this application should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0035] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present application according to the prompt message.
[0036] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0037] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation method of the present application. Other methods that meet the relevant laws and regulations may also be applied to the implementation method of the present application.
[0038] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0039] In order to make the purpose, technical solutions and advantages of the present disclosure more clear, the principles and spirit of the present disclosure will be described with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.
[0040] It should be understood herein that any number of elements in the drawings is for illustration rather than limitation, and any naming is only for distinction rather than having any limiting meaning.
[0041] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the embodiments of the present disclosure do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements or objects appearing in front of the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connecting" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly. The article "one" or "a" before an element does not exclude the existence of multiple such elements.
[0042] The principle and spirit of the present disclosure are explained in detail below with reference to several representative embodiments of the present disclosure.
[0043] refer to Figure 1 , which is a schematic diagram of an application scenario of a display animation generation method provided by an exemplary embodiment of the present disclosure.
[0044] This application scenario includes a terminal device 101, a server 102, and a data storage system 103. The terminal device 101, the server 102, and the data storage system 103 may be connected via a wired or wireless communication network to achieve data interaction.
[0045] The terminal device 101 may be an electronic device with data transmission and multimedia input / output functions close to the user side, including but not limited to a desktop computer, a mobile phone, a mobile computer, a tablet computer, a media player, a smart wearable device, a personal digital assistant (PDA) or other electronic devices capable of realizing the above functions. The electronic device may include a processor and a display screen with a touch input function, the display screen is used to present a graphical user interface, the graphical user interface can display an application interface, and the processor is used to process application data, generate a graphical user interface, and control the display of the graphical user interface on the display screen.
[0046] Server 102 and data storage system 103 can both be independent physical servers, or a server cluster or distributed system composed of multiple physical servers. They can also be cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), as well as big data and artificial intelligence platforms.
[0047] In some exemplary embodiments, a display animation generation method may be run on the terminal device 101 or the server 102 .
[0048] When a display animation generation method runs on the server 102, the server 102 is used to provide display animation generation services to users of the terminal device 101. The terminal device 101 is installed with a client that communicates with the server 102. The user can input a text to be detected through the client. After clicking the detection button, the client sends the text to be detected to the server 102. The server 102 inputs the text to be detected into the trained display animation generation model, obtains the corrected text corresponding to the text to be detected output by the display animation generation model, sends the corrected text to the client, and the client displays the corrected text to the user to help the user correct text errors.
[0049] When a display animation generation method is run on the server 102, the method can be implemented and executed based on the cloud interaction system.
[0050] Among them, the cloud interaction system includes client devices and cloud game servers.
[0051] In some exemplary embodiments, various cloud applications can be run under the cloud interaction system, such as cloud games. Taking cloud games as an example, cloud games refer to a game mode based on cloud computing. In the operation mode of cloud games, the operation subject of the game program and the game screen presentation subject are separated. The storage and operation of the control method of the mobile state in the game are completed on the cloud game server. The role of the client device is to receive and send data and present the game screen. For example, the client device can be a display device with data transmission function close to the user side, such as a mobile terminal, a TV, a computer, a handheld computer, etc.; but the cloud game server in the cloud is responsible for information processing. When playing the game, the player operates the client device to send an operation instruction to the cloud game server. The cloud game server runs the game according to the operation instruction, encodes and compresses the game screen and other data, and returns it to the client device through the network. Finally, the client device decodes and outputs the game screen.
[0052] In the above embodiment, a method for generating a display animation is described by taking the case where the method is run on the server 102 as an example. However, the present disclosure is not limited thereto. In some exemplary embodiments, the method for generating a display animation may also be run on the terminal device 101 .
[0053] When a display animation generation method is run on a terminal device 101, the terminal device 110 may include a display screen and a processor. A client is installed in the terminal device 110, and a user can specify a target program through the client. The processor obtains the display requirement and processes it. The processor can also send the display animation generation result to the client, and the client displays the display animation generation result to the user through the display screen.
[0054] When a display animation generation method is run on a terminal device 101, taking a game as an example, the terminal device stores a game program and is used to present a game screen. The terminal device is used to interact with the player through a graphical user interface, that is, the game program is downloaded and installed and run by a conventional electronic device. The terminal device may provide the graphical user interface to the player in a variety of ways, for example, it may be rendered and displayed on a display screen of the terminal, or provided to the player through a holographic projection. For example, the terminal device may include a display screen and a processor, the display screen is used to present a graphical user interface, the graphical user interface includes a game screen, and the processor is used to run the game, generate a graphical user interface, and control the display of the graphical user interface on the display screen.
[0055] The terminal device may provide a graphical user interface, which may include: a game scene with a virtual character. The method for dynamically generating a visual field provided by the embodiment of the present application is described in detail below with the terminal device as the execution subject.
[0056] The game scene is a virtual scene displayed (or provided) when the application is running on a terminal or server. Optionally, the virtual scene is a simulation environment of the real world, or a semi-simulation and semi-fictitious virtual environment, or a purely fictitious virtual environment. The virtual scene is any one of a two-dimensional virtual scene and a three-dimensional virtual scene, and the virtual environment can be the sky, land, ocean, etc., wherein the land includes environmental elements such as deserts and cities. Among them, the virtual scene is a scene with complete game logic of virtual objects such as user control. For example, for sandbox 3D shooting games, the virtual scene is a 3D game world for players to control virtual objects to fight. Example virtual scenes may include: at least one element of mountains, plains, rivers, lakes, oceans, deserts, skies, plants, buildings, and vehicles; for example, for 2D card games, the virtual scene is a scene for displaying released cards or displaying virtual objects corresponding to cards. Example virtual scenes may include: an arena, a decisive battlefield, or other "field" elements or other elements that can display the status of card battles; for 2D or 3D multiplayer online tactical competitive games, the virtual scene is a 2D or 3D terrain scene for virtual objects to fight. Example virtual scenes may include: canyon-style mountains, lines, rivers, classrooms, tables and chairs, podiums and other elements.
[0057] The graphical user interface is obtained by executing a software application on a processor of a mobile terminal or other terminal and rendering it on a display, and can be a display screen interface of a terminal device. The graphical user interface can present the entire game scene, or only a part of the game scene. The game scene includes multiple static virtual objects, specifically including the ground, mountains, rocks, vegetation, buildings, etc. When the game scene is relatively large, only the partial content of the game scene is displayed on the graphical user interface of the terminal device during the game. Optionally, the game scene contains game characters, which can be game characters controlled by players or NPCs (nonplayer characters), which are not limited in this exemplary embodiment.
[0058] First, the names involved in the embodiments of the present application are briefly introduced:
[0059] (1) Terminal equipment
[0060] The terminal device involved in the embodiments of the present application mainly refers to a terminal for providing a graphical user interface and capable of controlling a controlled virtual object. Among them, the terminal device may be a local terminal device mentioned below, or a client device in a cloud interaction system. The terminal device may include, but is not limited to, any of the following devices: a smart phone, a tablet computer, a PDA, a personal digital assistant (PDA), etc. An application that supports games is installed and running in the terminal device, such as an application that supports three-dimensional games or two-dimensional games. In the embodiments of the present application, the application is introduced as a game application. Optionally, the application may be a stand-alone application, such as a stand-alone 3D game program, or a network-connected application.
[0061] (2) Graphical User Interface
[0062] The graphical user interface includes a user interface (UI) and a game screen, wherein the UI interface is a medium for human-computer interaction and information exchange between the system and the user. The UI interface can present system information in a form acceptable to humans, so that users can conveniently and efficiently operate the computer to achieve two-way human-computer interaction. The user interface can be composed of visual elements such as controls, text, graphics, images, icons, input boxes, etc. In an optional embodiment, the user interface may include acquisition controls, research controls, expedition controls, etc. In an optional embodiment, the game screen is a display screen corresponding to the virtual scene displayed by the terminal device, and the game screen may include controlled virtual objects that execute game logic in the virtual scene, etc.
[0063] (3) Virtual Scene
[0064] A virtual scene is a virtual scene displayed (or provided) when an application is running on a terminal or server, that is, a scene used in a normal game process. In other words, a virtual scene refers to a virtual game control that carries a virtual object during the game process. The virtual object can be controlled by the user (i.e., the player) to the terminal device in the virtual scene to move, confront, and other actions. Optionally, the virtual scene can be a simulation environment of the real world, a semi-simulation and semi-fictitious virtual environment, or a purely fictitious virtual environment. The virtual scene can be any one of a two-dimensional virtual scene, a 2.5-dimensional virtual scene, and a three-dimensional virtual scene. Among them, the virtual scene is a scene in which the user controls the virtual object to execute the complete game logic. Optionally, the virtual scene can also be used for a virtual battle between at least two virtual objects, and there are virtual resources in the virtual scene that can be collected by multiple virtual objects. Exemplarily, the virtual scene can include any one or more of the following elements: game background elements, game character elements, game prop elements, and game material elements.
[0065] (4) Controlled virtual objects
[0066] A controlled virtual object refers to a dynamic object that can be controlled in a virtual scene. Optionally, the dynamic object can be a virtual character, a virtual object, etc. The controlled virtual object is an object controlled by a user through an input device, or an artificial intelligence (AI) set in a virtual environment through training. In a possible implementation, the user can control the controlled virtual object to move in the virtual scene, for example, control the controlled virtual object to navigate or collect virtual resources, etc., and can also control the controlled virtual object to upgrade and develop on the building object created by itself, and can also control the controlled virtual object to fight with virtual objects of other camps. Optionally, the controlled virtual object can have multiple functions, such as not only having the function of collecting virtual resources, but also having the function of fighting. Optionally, when the virtual environment is a three-dimensional virtual environment, the controlled virtual object can be a three-dimensional virtual model, each controlled virtual object has its own shape and volume in the three-dimensional virtual environment, and occupies a part of the space in the three-dimensional virtual environment. Optionally, the three-dimensional virtual object is a three-dimensional character built based on three-dimensional skeleton technology, and the controlled virtual object realizes different external images through wearable technology. In some implementations, the controlled virtual object may also be implemented using a 2.5-dimensional or 2-dimensional model, which is not limited in the embodiments of the present application.
[0067] (5) Resource Base
[0068] Resource points are map points used to provide virtual resources. For example, resource points can be map points such as virtual metal mines, virtual crystal mines, virtual heavy hydrogen mines, virtual special mines, etc. Optionally, several resource points are distributed in the virtual scene, and correspondingly, several identifiers corresponding to the several resource points distributed in the virtual scene are also provided in the virtual map (since the identifiers in the virtual map are reduced versions of the resource points, the whole text is uniformly described as resource points in the virtual map), so that users can collect virtual resources at the resource points to upgrade and develop the building objects they created. The resource points in the virtual scene can be refreshed, usually by refreshing each resource point in the virtual scene at predetermined time intervals, so that users can collect virtual resources at the resource points at regular intervals by dispatching controlled virtual objects on the building objects. Optionally, the building object is a map point used to manufacture, station and / or train controlled virtual objects, for example, the building object is a "base".
[0069] (6) Virtual Resources
[0070] The virtual resources of each resource base in the embodiment of the present application may include but are not limited to: metal, crystal, heavy hydrogen, special ore body, wood, stone, food, land, etc. For each virtual resource, it may include multiple resource levels. For example, taking metal as an example, the level of metal may include: primary metal, secondary metal, and tertiary metal, among which the level of primary metal is the highest, and its corresponding resistance is weaker, and the level of tertiary metal is the highest, and its corresponding resistance is stronger. In the actual game scene, the ship built with tertiary metal will have better stability and stronger resistance than the ship built with primary metal. Optionally, the virtual resources on each resource base correspond to one or more resource levels, and the resource levels of virtual resources on different resource bases may be the same or different, and the embodiment of the present application does not specifically limit this. Among them, the resource parameters of the virtual resources include at least one of the following: the category of virtual resources, the number of resources, and the resource level.
[0071] A large amount of training data is stored in the data storage system 103, each of which includes an error text and a correct text corresponding to the error text. The server 102 can train the display animation generation model based on a large amount of training data, so that the display animation generation model can correct the input error text, such as correcting text errors, grammatical errors, word errors, etc. in the error text. The source of the training data includes but is not limited to an existing database, data crawled from the Internet, or data uploaded by the user when using the client. When the accuracy of the display animation generation model output reaches a certain requirement, the server 102 can provide the user with a display animation generation service based on the display animation generation model. At the same time, the server 102 can also continuously optimize the display animation generation model based on the newly added training data.
[0072] The display animation generation model of the embodiment of the present disclosure can be applied to grammar correction, text correction, text error checking, automatic examination paper correction, etc. The display animation generation model can be trained based on training data of different languages to obtain display animation generation models applied to different languages.
[0073] Combine the following Figure 1 The training method of the display animation generation model and the text modification method according to the exemplary embodiment of the present disclosure are described by using the application scenario. It should be noted that the above application scenario is only shown to facilitate understanding of the spirit and principle of the present disclosure, and the embodiments of the present disclosure are not limited in this respect. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario.
[0074] In some embodiments, Figure 2 As shown, the present application provides a method for generating a display animation, characterized in that the display animation is applied to the display of game character fashion.
[0075] Methods include:
[0076] Step S1, generating a first command text according to a preset display requirement, and inputting the first command text into a preset storyboard model so that the storyboard model outputs a storyboard image.
[0077] Step S2, generating a second command text according to the storyboard image, and inputting the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation.
[0078] Step S3, storing the display animation in the game client, so that the game client responds to the user's request to call the game character fashion display interface, and loads and plays the display animation.
[0079] In this embodiment, the display animation can be applied to the game character fashion display scene, wherein the display scene is not limited and can be reasonably selected according to the actual application needs. For example, it can be one of the following: the mall interface game character fashion display, the game character unlocked fashion display, and the collection page game character fashion display. The display requirements are set according to the background story of the game character. According to an embodiment of the present application, as shown in Fig.11 As shown in the figure, the character in a game released by the applicant has the display requirements of showing fairness, power, protecting the queen, and destroying relatives for the sake of justice. Make reasonable use of what she has in her hands to show her sense of power. By inputting the first prompt text generated according to the display requirements into the storyboard model, the storyboard model outputs the corresponding storyboard image. Preferably, the storyboard model is an artificial intelligence model that generates images from text. The type of storyboard model is not limited and can be reasonably selected according to the actual application needs. For example, it can be one of DeepFloyd, AIP and DreamMaker-Pro.
[0080] By inputting the storyboard image and the second command text generated according to the storyboard image into the preset animation model, the animation model outputs a display animation matching the storyboard image. Preferably, the animation model is an artificial intelligence model that generates videos from images. The type of animation model is not limited and can be reasonably selected according to actual application needs. For example, it can be one of stable Diffusion, Runway-Gen-3 and Luma AI-Dream Machine.
[0081] By storing the display animation in the game client, the user can load and play the display animation generated by the method provided by the present application at any time when entering the game fashion display interface that needs to call the display animation.
[0082] In some embodiments, the animation model includes an animation generation model and an animation recognition model.
[0083] like Figure 3 As shown, step S2 specifically includes:
[0084] Step S21, inputting the storyboard image and the second command text into the animation generation model, so that the animation generation model outputs a first animation clip.
[0085] Step S22: input the first animation clip into the animation recognition model so that the animation recognition model outputs animation description text, wherein the animation description text is used to describe the screen content displayed by the first animation clip in text form.
[0086] Step S23: input the animation description text and the display requirement into a preset first language model, so that the first language model outputs animation similarity information.
[0087] Step S24: in response to the animation similarity information satisfying a preset animation similarity threshold, outputting the first animation clip as a display animation.
[0088] In this embodiment, since the existing AI large models on the market have low accuracy and deviation in the semantic understanding of the prompt words, in this application, an animation recognition model is set to perform content recognition on the first animation clip, so that the animation recognition model outputs the corresponding animation description text, and an independent first language model is used to compare the animation description text with the display requirements. The first language model is used to judge the similarity between the animation description text and the display requirements, thereby ensuring that the content displayed in the first animation clip is consistent with the display requirements. Among them, the type of the first language model is not limited, and can be reasonably selected according to actual application needs. For example, it can be one of ChatGPT, Claude, and Qwen.
[0089] In some embodiments, Figure 4 As shown, after step S22, it also includes:
[0090] Step S221, generating a first evaluation text and a first evaluation standard according to the animation description text, wherein the first evaluation standard is set according to the display requirement.
[0091] Step S222: inputting the first evaluation text into a preset second language model so that the second language model outputs first evaluation information associated with the animation description text.
[0092] Step S223: identifying the first evaluation information according to the first evaluation criterion, and in response to the first evaluation information satisfying the first evaluation criterion, inputting the animation description text into the first language model.
[0093] In this embodiment, the first evaluation criterion is formulated according to the display requirements. The type of the first evaluation criterion is not limited and can be reasonably selected according to actual application needs. For example, it can include one or more of legal and regulatory requirements, display angle requirements, and character action requirements.
[0094] In some embodiments, the first evaluation information includes: an animation aesthetics score and an animation age rating.
[0095] The first evaluation criteria include: the animation aesthetics score is not less than half of the total score, and the animation age rating meets the display requirements.
[0096] In this embodiment, the animation aesthetics score can score the animation description text according to the first evaluation standard based on the degree of character prominence, screen color matching, character fashion display frequency, etc. The animation age rating is divided according to the film and television age rating.
[0097] In some embodiments, the storyboard model includes a second language model and an image model.
[0098] like Figure 5 As shown, step S1 also includes:
[0099] Step S11, inputting the first command text into the second language model so that the second language model outputs a storyboard script.
[0100] Step S12, generating a second command text according to the storyboard script, and inputting the storyboard script and the second command text into a preset image model so that the image model generates a storyboard image.
[0101] In this embodiment, by setting a second language model, the second language model outputs a corresponding storyboard script according to the first command text, and then inputs the storyboard script into a preset image model, so that the image model outputs a storyboard image, thereby being able to reasonably expand the general display needs and generate richer storyboard images based on the expanded content.
[0102] Among them, the type of the second language model is not limited, and can be reasonably selected according to actual application needs. For example, it can be one of ChatGPT, Claude, and Qwen.
[0103] As an optional implementation of the present application, according to the aforementioned display requirements, the first command text input to the second language model may include:
[0104] Input to the second language model: Want some generation prompts: Design the actions of a female archon.
[0105] At this point, the second language model returns to the first design: The following is a female archon's action design:
[0106] 1. Smoothing the robe: The female consul walked slowly to the center of the podium with a smile on her face and a scepter in her hand. She then smoothed her robe with her hand, showing her calmness and confidence.
[0107] 2. The scepter in her hand shines: The female archon holds the scepter with both hands, and a powerful energy is released from the scepter. The scepter begins to shine, illuminating the entire scene, showing her power and majesty.
[0108] 3. Outlining the spell: The female archon outlines the spell in the air with her hands, and a powerful force is released from the spell, enveloping the entire scene, showing her mystery and charm.
[0109] 4. Activate the artifact: The female councilor touches the artifact with her finger, and the artifact begins to emit a faint light, then gradually becomes brighter and brighter, and finally forms a powerful beam of light, showing her control and influence.
[0110] The above-mentioned female archon’s movements are designed to make her appear calm, confident, powerful and majestic, while also showing her mystery, charm, control and influence.
[0111] Continue to input to the second language model: I want some generation prompts to describe the personality actions of the Archon. The props are the scepter and the scroll.
[0112] At this point, the second language model returns the second design:
[0113] 1. The consul holds the scepter, sometimes nodding and smiling, sometimes frowning, with rich expressions showing his courage and decisiveness.
[0114] 2. The consul held the scroll in his hand and read very quickly. Lines of text flashed quickly before his eyes, demonstrating his excellent reading ability.
[0115] 3. The consul holds a scepter and walks with steady and powerful steps, as if every step is hitting the ground, demonstrating his majesty and authority.
[0116] 4. The consul held the scroll in his hand, sometimes drawing circles and lines on it with his fingers, and sometimes smearing on it with a pen, showing his delicate and meticulous way of thinking.
[0117] 5. The consul held a scepter in his hand, sometimes slapping the table and sometimes hitting his own palm, demonstrating his passion and determination.
[0118] 6. The consul holds the scroll, sometimes tapping it with his fingers, and sometimes drawing some patterns on it with a pen, demonstrating his creativity and imagination.
[0119] 7. The consul held the scepter in his hand, sometimes beating his chest hard, sometimes patting his arm gently, demonstrating his confidence and courage.
[0120] 8. The consul holds the scroll, sometimes lowering his head in thought, sometimes looking up into the distance, demonstrating his thoughtfulness and foresight.
[0121] Continue to input into the second language model: Want some generation prompts: Design an entrance action for a female archon, holding a scepter and a scroll, mainly showing justice and power.
[0122] At this point, the second language model returns the third design:
[0123] The following is a female archon's entrance action design, holding a scepter and a scroll, mainly showing justice and power:
[0124] 1. Walking in slowly: The female consul walked into the venue slowly, with a smile on her face and a firm gaze, showing her calmness and confidence.
[0125] 2. Raising the scepter: The female archon holds the scepter in her hand, slowly raises it, and then knocks it hard on the ground. A powerful energy is released from the scepter, enveloping the entire scene, showing her authority and power.
[0126] 3. Unfolding the scroll: The female consul held the scroll in her hand, slowly unfolded it, and then began to read the contents of the scroll, demonstrating her fairness and decisiveness.
[0127] 4. Finger pointing forward: The female consul pointed her finger forward, then slowly turned around, signaling everyone to follow her leadership, showing her charm and influence.
[0128] The above entry action design of the female consul is intended to allow her to demonstrate her calmness, confidence, authority, strength, fairness, decisiveness, charm and influence, so that the audience and players can better feel her personal charm and leadership qualities.
[0129] Continue to input into the second language model: Please design an action for the female law enforcement officer to express her longing for the queen. The prop is the queen’s former mask.
[0130] At this point, the second language model returns to the fourth design:
[0131] The female law enforcer gently held up the mask that the queen had worn and examined it carefully. Her eyes revealed deep nostalgia and respect. She pondered for a while, then raised the scepter in her hand and held it tighter. She stared at the mask quietly, as if she was talking to the queen's soul. She closed her eyes and prayed silently for the queen's rest. After a while, she slowly put down the mask, then unfolded the scroll and began her work, as if the queen's spirit had always been with her.
[0132] Continue to input to the second language model: To optimize the description of a character's entrance, you need some different expressions: "The red carpet is rolled out from the left, and the fat woman walks out from the left with her head held high. She walks to the center and turns to the screen. She sticks her cane into the ground, opens the scroll, and announces loudly. Then she puts away the scroll and raises her cane to point in the direction of the screen. A black cage falls down, and then returns to standby."
[0133] At this point, the second language model returns to the fifth design:
[0134] The following is the optimized character entry description:
[0135] The red carpet was rolled out from the left, and a burly woman showed her face. She widened her eyes and looked around with confidence. She walked slowly from the left, each step full of power, until she reached the center, she suddenly stopped, raised the cane in her hand high, made a loud noise, and threw the scroll to the ground.
[0136] She took a deep breath and announced loudly: "I am the leader of this country, and I will lead this country to prosperity!" Then she unfolded her crutches and pointed in the direction of the screen.
[0137] Instantly, a black cage fell from above, covering the entire scene, demonstrating her authority and determination. Finally, she put away her crutches and returned to standby, waiting for the next move.
[0138] The first text is generated and optimized multiple times according to the above method, so that the second language model returns a storyboard script that meets the requirements, and then the corresponding storyboard image is generated according to the storyboard script.
[0139] In some embodiments, Figure 6 As shown, step S12 specifically includes:
[0140] Step S121, input the storyboard image into the image recognition model, so that the image recognition model outputs an image description text, wherein the image description text is used to describe the screen content displayed by the storyboard image in text form.
[0141] Step S122: Generate a second evaluation text and a second evaluation standard according to the image description text, wherein the second evaluation standard is set according to the display requirements.
[0142] Step S123: input the second evaluation text into the preset third language model, so that the third language model outputs second evaluation information associated with the image description text.
[0143] Step S124, identifying the second evaluation information according to the second evaluation criterion, and in response to the second evaluation information satisfying the second evaluation criterion, inputting the storyboard image into the animation model.
[0144] In this embodiment, similar to the above, due to the low accuracy of the existing text image model and the deviation in the semantic understanding of the prompt word, after generating the storyboard image, the content of the storyboard image is recognized to generate the image description text, and the image description text is recognized and the difference between the image description text and the display requirement is judged. Among them, the second evaluation standard is formulated according to the display requirement, and the type of the second evaluation standard is not limited, and can be reasonably selected according to the actual application needs, for example, it can include one or more of legal and regulatory requirements, display angle requirements, and character action requirements.
[0145] In some embodiments, the second evaluation information includes: a storyboard relevance score, a storyboard aesthetics score, and a storyboard age rating.
[0146] The second evaluation criteria include: the storyboard relevance score and the storyboard aesthetics score are not less than half of the total score, and the storyboard age classification meets the display requirements.
[0147] In this embodiment, the storyboard relevance score is determined based on the difference between the image description text and the display requirements; the storyboard aesthetics score may include the character display angle, character color matching, character facial expression, etc.; the storyboard age rating is divided according to the film and television age rating.
[0148] In some embodiments, Figure 7 As shown, step S11 specifically includes:
[0149] Step S111, generating a third evaluation text and a third evaluation standard according to the storyboard script, wherein the third evaluation standard is set according to the display requirements.
[0150] Step S112: input the third evaluation text into the preset fourth language model, so that the fourth language model outputs third evaluation information associated with the storyboard script.
[0151] Step S113, identifying the third evaluation information according to the third evaluation standard, and in response to the third evaluation information satisfying the third evaluation standard, inputting the storyboard script into the image model.
[0152] In this embodiment, similar to the above, due to the low accuracy of the existing large language model and the deviation in the semantic understanding of the prompt word, after the storyboard script is generated, the storyboard script is identified and the difference between the storyboard script and the display requirements is judged. Among them, the third evaluation standard is formulated according to the display requirements, and the type of the third evaluation standard is not limited, and can be reasonably selected according to the actual application needs, for example, it can include one or more of legal and regulatory requirements, display angle requirements, and character action requirements.
[0153] In some embodiments, the third evaluation information includes: a script logic score, a script relevance score, and a script age rating.
[0154] The first evaluation criteria include: the script logic score and the script relevance score are not less than half of the total score, and the script age rating meets the display requirements.
[0155] In this embodiment, the logic of the script is judged based on natural language logic, and the storyboard script is scored by identifying whether there are content fragments that are inconsistent with the story development logic; the script relevance score is judged based on the difference between the storyboard script and the display requirements; the script age rating is divided according to the film and television age rating.
[0156] In some embodiments, Figure 8 As shown, after step S2, it also includes:
[0157] Step S200, displaying the action model preset by the animation input value, so that the action model outputs the corresponding action posture.
[0158] Step S201, storing the action gestures in the game client, so that the game client loads and displays the action gestures in response to a user's request to invoke a game character action.
[0159] In this embodiment, the display animation is input into the action model, and part of the character's actions in the display animation are extracted using the action model, so as to display the character's specific action posture after the user calls or triggers the touch action.
[0160] In some embodiments, the presentation animation includes at least one first plot, at least one second plot, and stop-motion animation.
[0161] like Fig. 9 As shown, the method also includes:
[0162] Step S400, playing the first plot according to the user's operation instruction, and in response to the first plot being played to completion, playing the stop-motion animation in a loop.
[0163] Step S500, according to the user's next operation instruction, the playing of the stop-motion animation is stopped and the playing of the second plot is started.
[0164] In this embodiment, the display animation can display the character's fashion through multiple plot animations. Preferably, when the display needs to display the fashion of multiple characters, multiple corresponding second plots can be set for different characters, and the corresponding second plot is played in response to the user's touch operation on a specific character in the stop-motion animation, thereby realizing the display of the fashion of multiple characters.
[0165] In some embodiments, the ending picture of the first plot is the same as the starting picture of the stop-motion animation, and the ending picture of the stop-motion animation is the same as the starting picture of the second plot.
[0166] In this embodiment, the first plot, the stop-motion animation and the second plot are connected to ensure the continuity of the display animation during the playback and interaction process, thereby improving the fluency of the plot.
[0167] It can be seen from the above embodiments that a display animation generation method provided by the present application generates a storyboard image according to preset display requirements by setting a storyboard model, and then inputs the storyboard image into the animation model, and generates a display animation according to the storyboard image, thereby realizing the automatic generation of the game character fashion display animation and reducing the workload of personnel; and then by storing the display animation to the game client, the user can load and play the display animation in time when calling the game character fashion display interface.
[0168] According to an optional embodiment of the present application, the present application further divides the animation model into an animation generation model and an animation recognition model, generates a first animation clip through the animation generation model, inputs the first animation clip into a preset animation recognition model, performs content recognition on the first animation clip through the animation recognition model, and inputs the animation description text and display requirements output by the animation recognition model into the first language model, so that the first language model recognizes the difference between the animation description text and the display requirements, thereby avoiding the generated animation content deviating from the original display requirements.
[0169] It should be noted that the method of the embodiment of the present disclosure can be performed by a single device, such as a computer or a server. The method of the present embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present disclosure, and the multiple devices will interact with each other to complete the described method.
[0170] It should be noted that the above describes some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0171] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a display animation generation device.
[0172] refer to Fig.10 , the display animation generating device comprises:
[0173] The storyboard generation module 601 is used to generate a first command text according to a preset display requirement, and input the first command text into a preset storyboard model so that the storyboard model outputs a storyboard image.
[0174] The animation generation module 602 is used to generate a second command text according to the storyboard image, and input the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation.
[0175] The animation display module 603 is used to store the display animation in the game client, so that the game client loads and plays the display animation in response to the user's request to call the game character fashion display interface.
[0176] For the convenience of description, the above device is described by dividing it into various modules according to its functions. Of course, when implementing the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.
[0177] The device of the above embodiment is used to implement a corresponding display animation generation method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0178] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, a display animation generation method described in any of the above embodiments is implemented.
[0179] Fig.12A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.
[0180] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0181] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.
[0182] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0183] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0184] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).
[0185] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0186] The electronic device of the above embodiment is used to implement a corresponding display animation generation method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0187] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute a display animation generation method as described in any of the above embodiments.
[0188] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0189] The above-mentioned non-transitory computer-readable storage medium can be any available medium or data storage device that can be accessed by a computer, including but not limited to magnetic storage (such as floppy disks, hard disks, magnetic tapes, magneto-optical disks (MO), etc.), optical storage (such as CD, DVD, BD, HVD, etc.), and semiconductor storage (such as ROM, EPROM, EEPROM, non-volatile memory (NAND FLASH), solid-state drive (SSD)), etc.
[0190] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute a display animation generation method as described in any embodiment in the above exemplary method part, and have the beneficial effects of the corresponding method embodiment, which will not be repeated here.
[0191] Based on the same inventive concept, corresponding to the method for generating a display animation described in any of the above embodiments, the present disclosure further provides a computer program product, which includes computer program instructions. In some embodiments, the computer program instructions can be executed by one or more processors of a computer so that the computer and / or the processor execute the method for generating a display animation. Corresponding to the execution subject corresponding to each step in each embodiment of the method for generating a display animation, the processor that executes the corresponding step may belong to the corresponding execution subject.
[0192] The computer program product of the above embodiment is used to enable the computer and / or the processor to execute a display animation generation method as described in any of the above embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0193] Those skilled in the art will appreciate that the embodiments of the present disclosure may be implemented as a system, method, or computer program product. Therefore, the present disclosure may be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software, generally referred to herein as a "circuit," "module," or "system." In addition, in some embodiments, the present disclosure may also be implemented in the form of a computer program product in one or more computer-readable media, which contains computer-readable program code.
[0194] Any combination of one or more computer-readable media may be used. A computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive examples) of computer-readable storage media may include, for example: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device.
[0195] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, which carry computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.
[0196] The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0197] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0198] It should be understood that each box in the flowchart and / or block diagram and the combination of boxes in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine, and these computer program instructions are executed by a computer or other programmable data processing device to produce a device that implements the functions / operations specified in the boxes in the flowchart and / or block diagram.
[0199] These computer program instructions may also be stored in a computer-readable medium that enables a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable medium produce a product that includes an instruction device that implements the functions / operations specified in the blocks in the flowchart and / or block diagram.
[0200] Computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby enabling the instructions executed on the computer or other programmable device to provide a process for implementing the functions / operations specified in the blocks in the flowchart and / or block diagram.
[0201] In addition, although the operations of the disclosed method are described in a particular order in the accompanying drawings, this does not require or imply that the operations must be performed in this particular order, or that all the operations shown must be performed to achieve the desired results. On the contrary, the steps depicted in the flow chart can be performed in a different order. Additionally or alternatively, some steps can be omitted, multiple steps can be combined into one step, and / or one step can be decomposed into multiple steps.
[0202] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0203] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.
[0204] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.
[0205] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.
[0206] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0207] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.
[0208] Although the spirit and principle of the present disclosure have been described with reference to several specific embodiments, it should be understood that the present disclosure is not limited to the disclosed specific embodiments, and the division of various aspects does not mean that the features in these aspects cannot be combined to benefit, and such division is only for the convenience of expression. The present disclosure is intended to cover various modifications and equivalent arrangements included in the spirit and scope of the attached claims. The scope of the attached claims conforms to the broadest interpretation, thereby including all such modifications and equivalent structures and functions.
Claims
1. A method for generating a display animation, characterized in that: in, Display animation is used to display game character fashion; The method comprises: Generate a first command text according to a preset display requirement, and input the first command text into a preset storyboard model so that the storyboard model outputs a storyboard image; generating a second command text according to the storyboard image, and inputting the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation; The display animation is stored in the game client, so that the game client loads and plays the display animation in response to a user's request to call a game character fashion display interface.
2. The method for generating a display animation according to claim 1, characterized in that: The animation model includes an animation generation model and an animation recognition model; The step of inputting the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation specifically includes: Inputting the storyboard image and the second command text into the animation generation model so that the animation generation model outputs a first animation clip; Inputting the first animation clip into the animation recognition model so that the animation recognition model outputs an animation description text; wherein the animation description text is used to describe the screen content displayed by the first animation clip in text form; Inputting the animation description text and the display requirement into a preset first language model so that the first language model outputs animation similarity information; In response to the animation similarity information satisfying a preset animation similarity threshold, the first animation clip is output as the display animation.
3. The method for generating a display animation according to claim 2, characterized in that: After inputting the first animation clip into the animation recognition model so that the animation recognition model outputs animation description text, the method further includes: Generate a first evaluation text and a first evaluation standard according to the animation description text; wherein the first evaluation standard is set according to the display requirement; Inputting the first evaluation text into a preset second language model so that the second language model outputs first evaluation information associated with the animation description text; The first evaluation information is identified according to the first evaluation criterion, and in response to the first evaluation information satisfying the first evaluation criterion, the animation description text is input into the first language model.
4. The method for generating a display animation according to claim 3, characterized in that: The first evaluation information includes: animation aesthetics score and animation age rating; The first evaluation criteria include: the animation aesthetics score is not less than half of the total score, and the animation age rating meets the display requirements.
5. The method for generating a display animation according to claim 1, characterized in that: The storyboard model includes a second language model and an image model; The step of inputting the first command text into a preset storyboard model so that the storyboard model outputs a storyboard image further includes: Inputting the first command text into the second language model so that the second language model outputs a storyboard; A second command text is generated according to the storyboard script, and the storyboard script and the second command text are input into a preset image model so that the image model generates the storyboard image.
6. The method for generating a display animation according to claim 5, characterized in that: The step of generating a second command text according to the storyboard script and inputting the storyboard script and the second command text into a preset image model so that the image model generates the storyboard image specifically includes: Inputting the storyboard image into an image recognition model so that the image recognition model outputs an image description text; wherein the image description text is used to describe the screen content displayed by the storyboard image in text form; Generate a second evaluation text and a second evaluation standard according to the image description text; wherein the second evaluation standard is set according to the display requirement; Inputting the second evaluation text into a preset third language model so that the third language model outputs second evaluation information associated with the image description text; The second evaluation information is identified according to the second evaluation criterion, and in response to the second evaluation information satisfying the second evaluation criterion, the storyboard image is input into the animation model.
7. The method for generating a display animation according to claim 6, characterized in that: The second evaluation information includes: storyboard relevance score, storyboard aesthetics score and storyboard age rating; The second evaluation criteria include: the storyboard relevance score and the storyboard aesthetics score are not less than half of the total score, and the storyboard age classification meets the display requirements.
8. The method for generating a display animation according to claim 1, characterized in that: After inputting the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation, the method further includes: Input the display animation into a preset action model so that the action model outputs a corresponding action gesture; The action gesture is stored in the game client, so that the game client loads and displays the action gesture in response to a user's request to invoke a game character action.
9. The method for generating a display animation according to claim 1, characterized in that: The display animation includes at least one first plot, at least one second plot and a stop-motion animation; The method further comprises: Play the first plot according to the user's operation instruction, and in response to the first plot being played, loop the stop-motion animation; According to the user's next operation instruction, the playing of the stop-motion animation is stopped, and the playing of the second plot is started.
10. The method for generating a display animation according to claim 9, characterized in that: The ending picture of the first plot is the same as the starting picture of the stop-motion animation, and the ending picture of the stop-motion animation is the same as the starting picture of the second plot.
11. A display animation generating device, characterized in that: in, Display animation is used to display game character fashion; The device comprises: A storyboard generation module, used for generating a first command text according to a preset display requirement, and inputting the first command text into a preset storyboard model so that the storyboard model outputs a storyboard image; An animation generation module, used for generating a second command text according to the storyboard image, and inputting the storyboard image and the second command text into a preset animation model so that the animation model outputs a display animation; The animation display module is used to store the display animation in the game client, so that the game client responds to the user's request to call the game character fashion display interface to load and play the display animation.
12. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method according to any one of claims 1 to 10 is implemented.
13. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a computer to execute the method according to any one of claims 1 to 10.
14. A computer program product, characterized in that The method comprises computer program instructions, which, when executed on a computer, cause the computer to execute the method according to any one of claims 1 to 10.
Citation Information
Cited By
Method and system for generating stop motion animation and storage medium
CN120635257A