An Image Processing Method, Device, Medium and Electronic Device Based on Data Acquisition
By obtaining player action data to generate bone data and converting it into animation data, the problem that virtual characters cannot play undesigned actions in real time is solved, and the immersion is improved and cost reduction is achieved.
Patent Information
- Application Number
- CN202111551399.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-17
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2041-12-17
AI Technical Summary
In the prior art, virtual characters cannot realize real-time playback of undesigned actions in games or three-dimensional animations, resulting in insufficient immersion and high work costs for the artist.
By obtaining player action data, bone data is generated and converted into animation data, target video stream is formed, and shared through blockchain management database for players to use, and copyright protection is carried out in combination with NFT.
It enriches the player experience, enhances immersion, and reduces the work costs of the artist, which stimulates players' creative enthusiasm.
Smart Images

Figure CN114170357B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of computer graphics, and specifically provides an image processing method, device, medium and electronic device based on data acquisition. Background Art
[0002] In existing games or 3D animations, the production of character actions of virtual characters often requires a large amount of computing power. When a certain character needs to perform related actions that are not designed and produced by the painter, that is, no animation is made for the corresponding character bones, the corresponding character in the game cannot play the animation.
[0003] For the conversion of bone actions of different characters, generally, the animation information is converted through an intermediate medium. For example, the rig system in two types of engines. Through the rig system in the engine, a set of configurations with a unified naming rule is bound, and the animation information is mutually converted through this set of configurations. For example: the bone animation data of character A is bound to the Rig of character B in the engine, and using the existing technology of the engine, the animation data on the Rig of character A is transmitted to the Rig of character B, and the data on the Rig of character B is then reversely bound to the bones of B; however, when players encounter their favorite body movements, they cannot define their favorite body movements to their favorite characters and share them in real time, resulting in insufficient immersion and higher working costs for painters. Summary of the Invention
[0004] In view of the deficiencies of the prior art, the present invention provides an image processing method, device, medium and electronic device based on data acquisition, which effectively reduces the working costs of painters and improves the immersion of players.
[0005] To achieve the above objectives, the present invention is implemented through the following technical solutions:
[0006] In a first aspect, an embodiment of the present invention provides an image processing method based on data acquisition, and the method includes:
[0007] Obtain current first feature data and first basic action data, where the first feature data is a prefabricated animation image;
[0008] Perform standardization processing on the first feature data and the first basic action data to form first standard action data;
[0009] Form a target video stream output according to the first standard action data;
[0010] Store the target video stream to form a database, where each target video stream in the database is defined as a storage node.
[0011] Preferably, the formation method of the first basic action data includes,
[0012] When the target object enters the acquisition area, obtain the current facial expression actions and / or body expression actions of the target object;
[0013] Form first basic action data according to the facial expression actions and / or body expression actions.
[0014] Preferably, form a target video stream output according to first standard action data, specifically including, when the current target body matches the prefabricated target body, read the first standard action data;
[0015] Form first bound basic parameters according to the first standard action data;
[0016] Copy the first bound basic parameters to the current target body to form a target video stream output.
[0017] Preferably, copy the first bound basic parameters to the current target body to form a target video stream output; specifically including,
[0018] Form first dynamic basic parameters according to facial expression actions and / or body expression actions in the state of obtaining animation data;
[0019] Form an action supplement parameter according to two facial expression actions and / or body expression actions;
[0020] Form the first dynamic parameter according to the first dynamic basic parameter and the action supplement parameter;
[0021] Form a video stream output according to the first dynamic parameter.
[0022] Preferably, it further includes,
[0023] Obtain at least one target video stream from the database;
[0024] Process the at least one target video stream to form a custom video data;
[0025] Form an updated storage node according to the custom video data, and the updated storage node is saved in the database.
[0026] Preferably, store the target video stream to form a database, and before each target video stream in the database is defined as a storage node, it further includes,
[0027] The target video stream is provided with a corresponding flag recognition address.
[0028] In a second aspect, an embodiment of the present invention provides an image processing device based on data acquisition, and the device includes:
[0029] An acquisition unit for acquiring current first feature data and first basic action data, where the first feature data is a prefabricated animated image;
[0030] A processing unit for performing normalization processing on the first feature data and the first basic action data to form first standard action data;
[0031] An output unit for forming a target video stream output according to the first standard action data;
[0032] A storage unit for storing the target video stream to form a database, where each target video stream in the database is defined as a storage node.
[0033] Preferably, the acquisition unit includes,
[0034] A first basic action data formation module for, when the target object enters the acquisition area, acquiring the current facial expression actions and / or limb expression actions of the target object; and forming first basic action data according to the facial expression actions and / or limb expression actions.
[0035] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, it implements the image processing method based on data acquisition as described above.
[0036] In a fourth aspect, an embodiment of the present invention provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, it implements the image processing method based on data acquisition in the above-mentioned electronic device.
[0037] The present invention has the following beneficial effects:
[0038] The present invention reads the body trajectory feature data of the player himself / herself completing a predetermined action or expression through AI video, generates bone data and converts it into animation data. During the process of generating animation data, the animation data is stylized, that is, feature-processed, to form a target video stream output; the target video stream is shared through a blockchain management database for all players to use, enriching the player experience and enhancing the immersion;
[0039] When saving the target video stream as a target animation file, the target video stream can be ID-identified through NFT. Players can obtain copyright protection for the animation data they create and obtain a certain economic income, stimulating the enthusiasm of more players to create and reducing the work cost of painters. Description of the Drawings
[0040] Figure 1Flowchart of an image processing method based on data acquisition provided in the first embodiment of the present invention;
[0041] Figure 2 Flowchart of an image processing method based on data acquisition provided in the first embodiment of the present invention;
[0042] Figure 3 Schematic structural diagram of an electronic device provided in the fourth embodiment of the present invention. Detailed implementation manners
[0043] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
[0044] Embodiment 1
[0045] Please refer to Figure 1 , Figure 1 Flowchart of an image processing method based on data acquisition provided for this embodiment,
[0046] S110. Obtain current first feature data and first basic action data, where the first feature data is a prefabricated animated image;
[0047] In this embodiment, the current first feature data is the basic feature action data required for character B to complete. The formation of the first basic action data is as follows. When the target object enters the acquisition area, obtain the current facial expression action and / or limb expression action of the player; generate corresponding bone data according to the captured feature trajectory feature data of the action or expression, for example, after capturing the action and expression of the player himself / herself to complete drawing the sword, generate the corresponding bone data, which is the first basic action data.
[0048] S120. Perform standardization processing on the first feature data and the first basic action data to form first standard action data;
[0049] In this embodiment, in the state of obtaining the first feature data and the first basic action data corresponding to the bone data, the animation data can be standardized. For example, the animation data can be stylized. The processing method can be to adjust the bone parameters by AI or calibrate the bone adjustment data according to the mhy standard, so that the image of the animated character is more vivid. When character B imitates the prefabricated sword-drawing action of the player himself, the first standard action data is calculated in real time according to the first feature data corresponding to the basic action required for character B to complete the sword-drawing and the first basic action data (bone data) corresponding to the bones when the player performs the sword-drawing action; the first standard action data is the animation data generated by character B imitating the prefabricated sword-drawing action of the player.
[0050] S130. Generate a target video stream output according to the first standard action data;
[0051] In the state where the current target body matches the prefabricated target body, the first standard action data is read. For example, the animation data of character B imitating the player to complete the prefabricated sword-drawing action by himself is read. Through the Rig system, the bone animation data of character B imitating the player to complete the prefabricated sword-drawing action by himself is converted into the basic data of the bone animation of character B imitating the player to complete the prefabricated sword-drawing action by himself;
[0052] Through the Rig system, the basic data of the bone animation of character B imitating the player to complete the prefabricated sword-drawing action by himself is copied into the basic data of the sword-drawing bone animation corresponding to character B, and the basic data of the sword-drawing bone animation of character B is bound to the corresponding sword-drawing bone animation data of character B to form a target video stream output.
[0053] When the video effect is not continuous, a frame filling operation can be performed. Specifically, the first dynamic basic parameters are obtained from the facial expression actions and / or limb expression actions of character B in the animation. For example, the video action data when the player himself completes the sword-drawing action. An action supplement parameter can be formed according to the two facial expression actions and / or limb expression actions, that is, frame filling processing is performed; the first dynamic parameter is formed according to the first dynamic basic parameter and the action supplement parameter. The first dynamic parameter is the complete and smooth video action data when the player himself completes the sword-drawing action.
[0054] S140. Store the target video stream to form a database, where each target video stream in the database is defined as a storage node.
[0055] In this embodiment, the target video stream is embodied by a single action. For example, the sword-swinging action video stream and the sword-drawing action video stream of character B can be formed into a specific database, and at the same time, the sword-swinging action video stream and the sword-drawing action video stream in the database are defined as different storage nodes.
[0056] It may also include obtaining at least one target video stream from the database; for example, the database includes a sword-swinging action video stream and a sword-drawing action video stream, processing the at least one target video stream to form a custom video data; for example, processing the sword-swinging action video stream and the sword-drawing action video stream to form a new continuous action video stream, forming an updated storage node with the new continuous action video stream, and saving the updated storage node in the database; for example, saving the updated storage node formed by the new continuous action video stream in the database.
[0057] When a player uses the actions of their favorite character, they can select a new chain that matches the corresponding character actions. The new chain can be directly read by the game and rearranged to form an animation file database. The player can select multiple actions from the animation file database, and three or four actions can be played randomly or under specific conditions. For example, for character B, there is one action for going uphill, one or more actions for going downhill, and the actions after hitting someone are all different. Character B can walk with multiple gaits, enriching the player experience and enhancing the immersion.
[0058] When a player selects the actions of their favorite character, each behavior such as access, modification, etc. will have a timestamp record, making the time point of each behavior traceable.
[0059] Before S140, it also includes
[0060] S139, the target video stream is provided with a corresponding logo recognition address.
[0061] When saving the target video stream as a target animation file, the ID of the target video stream can be recognized through NFT. Players can obtain copyright protection for their created animation data and obtain a certain economic income, stimulating more players to invest more in creation.
[0062] Through AI video, the body trajectory feature data of the player's movement trajectory when drawing the sword is read, generating bone data and converting it into animation data. During the process of generating animation data, the animation data is stylized, that is, characterized, to form a target video stream. The target video stream is shared through the blockchain management database, allowing all players to use it, enriching the player experience and enhancing the immersion. When saving the target video stream as a target animation file, the ID of the target video stream can be recognized through NFT. Players can obtain copyright protection for their created animation data and obtain a certain economic income, stimulating more players to invest more in creation.
[0063] The body trajectory feature data of the player's movement trajectory when drawing the sword is read through AI video, the bone data is generated and converted into animation data. During the process of generating the animation data, the animation data is stylized, that is, feature-processed, to form a target video stream; the target video stream is shared through the blockchain management database for all players to use, enriching the player experience and enhancing the immersion.
[0064] As a preferred implementation, in step S120, the first feature data and the first basic action data are standardized to form the first standard action data. Among them, the formation of the first feature data includes
[0065] S1201. Obtain the first target feature data, the second target feature data of the current target body, and the second feature dynamic basic data matching the second target feature data;
[0066] Specifically, determine the first target feature data that the B character in the current game or 3D animation needs to complete, such as the sword-drawing action data, obtain the second target feature data of the B character's attachment, such as the cloak data, and obtain the second feature dynamic basic data of the attachment, such as the collision data of the cloak, while obtaining the second target feature data.
[0067] S1202. Calculate and form the second feature dynamic standard data according to the second feature dynamic basic data and the first target feature data;
[0068] Specifically, in a state of a predetermined action formed between the second feature dynamic basic data and the first feature data, such as a certain action state formed by the attachment collided with the B character during the sword-drawing action and during the sword-drawing process of the B character, calculate and form the second feature dynamic standard data in real time according to the second feature dynamic basic data and the first feature data, such as the data of the attachment collided during the sword-drawing process.
[0069] S1203. Form the first feature data output according to the second feature dynamic standard data and the first target feature data.
[0070] Specifically, based on the second feature dynamic standard data and the first target feature data, calculate the first feature data output, and the first feature parameter is used to make the B character match the attachment cloak more naturally when completing the sword-drawing action.
[0071] In this preferred embodiment, when the current character completes the predetermined action, the attachment is prevented from having an interpenetration omission, and the current character can coordinate and complete a new action that dynamically fits the attachment in an orderly manner; the coordination degree of the same action transition between different characters in the game or 3D animation is improved.
[0072] Embodiment 2
[0073] An image processing device based on data acquisition provided by an embodiment of the present invention specifically includes:
[0074] An acquisition unit, configured to acquire current first feature data and first basic action data, where the first feature data is a prefabricated animated image;
[0075] A processing unit, configured to perform standardization processing on the first feature data and the first basic action data to form first standard action data;
[0076] An output unit, configured to form a target video stream output according to the first standard action data;
[0077] A storage unit, configured to store the target video stream to form a database, where each target video stream in the database is defined as a storage node.
[0078] The acquisition unit includes
[0079] A first basic action data formation module, configured to, when the target object enters the acquisition area, acquire the current facial expression action and / or limb expression action of the target object; and form first basic action data according to the facial expression action and / or limb expression action.
[0080] The working principle of this embodiment is the same as that of Embodiment 1, so details are not repeated here.
[0081] Embodiment 3
[0082] An embodiment of the present application further provides a storage medium containing computer-executable instructions, and the computer-executable instructions are used to perform the following when executed by a computer processor:
[0083] Acquire current first feature data and first basic action data, where the first feature data is a prefabricated animated image;
[0084] Perform standardization processing on the first feature data and the first basic action data to form first standard action data;
[0085] Form a target video stream output according to the first standard action data;
[0086] Store the target video stream to form a database, where each target video stream in the database is defined as a storage node.
[0087] When the target object enters the acquisition area, acquire the current facial expression action and / or limb expression action of the target object; and form first basic action data according to the facial expression action and / or limb expression action.
[0088] Storage medium - Any of various types of memory devices or storage devices. The term "storage medium" is intended to include: installation media such as CD-ROMs, floppy disks or magnetic tape devices; computer system memory or random access memory such as DRAM, DDRRAM, SRAM, EDORAM, Rambus RAM, etc.; non-volatile memory such as flash memory, magnetic media (such as hard disks or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. Additionally, the storage medium may be located in the computer system in which the program is executed, or may be located in a different second computer system that is connected to the computer system via a network (such as the Internet). The second computer system may provide program instructions to the computer for execution. The term "storage medium" may include two or more storage media that may reside in different locations (such as in different computer systems connected via a network). The storage medium may store program instructions executable by one or more processors (such as embodied as a computer program).
[0089] Of course, for a storage medium containing computer-executable instructions provided by an embodiment of the present application, the computer-executable instructions are not limited to the image processing method based on data acquisition as described above, and may also execute related operations in the image processing method based on data acquisition provided by any embodiment of the present application.
[0090] Embodiment 4
[0091] An embodiment of the present application provides an electronic device, in which an image processing device based on data acquisition provided by an embodiment of the present application can be integrated. Figure 3 It is a schematic structural diagram of an electronic device provided by Embodiment 4 of the present application. As Figure 3 shown, this embodiment provides an electronic device 400, which includes: one or more processors 420; a storage device 410 for storing one or more programs, when the one or more programs are run by the one or more processors 420, enabling the one or more processors 420 to implement:
[0092] Obtain current first feature data and first basic action data, where the first feature data is a prefabricated animated image;
[0093] Perform normalization processing on the first feature data and the first basic action data to form first standard action data;
[0094] Form a target video stream output according to the first standard action data;
[0095] Store the target video stream to form a database, where each target video stream in the database is defined as a storage node.
[0096] When the target object enters the acquisition area, obtain the current facial expression actions and / or body expression actions of the target object; form first basic action data according to the facial expression actions and / or body expression actions.
[0097] As Figure 3 shown, the electronic device 400 includes a processor 420, a storage device 410, an input device 430, and an output device 440; the number of processors 420 in the electronic device can be one or more, Figure 3 taking one processor 420 as an example; the processor 420, the storage device 410, the input device 430, and the output device 440 in the electronic device can be connected through a bus or other means, Figure 3 taking the connection through the bus 450 as an example.
[0098] The storage device 410, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, and module units, such as the program instructions corresponding to the image processing method based on data acquisition in the embodiments of the present application.
[0099] The storage device 410 mainly includes a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data created according to the use of the terminal, etc. In addition, the storage device 410 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage devices. In some instances, the storage device 410 can further include a memory remotely set relative to the processor 420, and these remote memories can be connected through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and their combinations.
[0100] The input device 430 can be used to receive input digital, character information, or voice information, and generate key signal inputs related to the user settings and function controls of the electronic device. The output device 440 can include devices such as a display screen and a speaker.
[0101] Note that the above is only the preferred embodiment of the present invention and the applied technical principles. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described here, and various obvious changes, re-adjustments, and substitutions can be made by those skilled in the art without departing from the protection scope of the present invention. Therefore, although the present invention has been described in detail through the above embodiments, the present invention is not limited to the above embodiments. Without departing from the concept of the present invention, more other equivalent embodiments can be included, and the scope of the present invention is determined by the scope of the appended claims.
Claims
1. An image processing method based on data acquisition, characterized in that Including: Obtain current first feature data and first basic action data, where the first feature data is a prefabricated animated image; The formation method of the first basic action data includes: when the target object enters the acquisition area, obtain the current facial expression action and / or body expression action of the target object; form the first basic action data according to the facial expression action and / or body expression action; the target object is a player character; specifically, the body trajectory feature data of the player completing a predetermined action or expression is read through AI video to generate bone data; Perform standardization processing on the first feature data and the first basic action data to form first standard action data; Form a target video stream output according to the first standard action data; Store the target video stream to form a database, where each target video stream in the database is defined as a storage node.
2. The image processing method based on data acquisition according to claim 1, wherein, Forming a target video stream output according to the first standard action data specifically includes, When the current target body matches the prefabricated target body, read the first standard action data; Form a first binding basic parameter according to the first standard action data; Copy the first binding basic parameter to the current target body to form a target video stream output.
3. The image processing method based on data acquisition according to claim 2, characterized in that Copy the first binding basic parameter to the current target body to form a target video stream output; Specifically including, Form a first dynamic basic parameter according to the facial expression action and / or body expression action in the state of obtaining animation data; Form an action supplement parameter according to two facial expression actions and / or body expression actions; Form a first dynamic parameter according to the first dynamic basic parameter and the action supplement parameter; Form a video stream output according to the first dynamic parameter.
4. A data acquisition-based image processing method according to claim 1, characterized in that, It also includes, Obtain at least one target video stream from the database; Process the at least one target video stream to form a custom video data; Form an updated storage node according to the custom video data, and the updated storage node is saved in the database.
5. The image processing method based on data acquisition according to claim 1, wherein Before storing the target video stream to form a database, where each target video stream in the database is defined as a storage node, it also includes, The target video stream is equipped with a corresponding flag recognition address.
6. The image processing method based on data acquisition according to claim 1, characterized in that, The formation method of the first feature data includes: Obtain the first target feature data, the second target feature data of the current target body, and the second feature dynamic basic data matching the second target feature data; Calculate and form second feature dynamic standard data according to the second feature dynamic basic data and the first target feature data; Form a first feature data output according to the second feature dynamic standard data and the first target feature data.
7. A data acquisition-based image processing method according to claim 1, characterized in that The method also includes: The target video stream is shared through a blockchain management database for all players to use.
8. An image processing device based on data acquisition, characterized in that, Including, An acquisition unit for acquiring current first feature data and first basic action data, wherein the first feature data is a prefabricated animation image; the acquisition unit includes a first basic action data formation module for acquiring the current facial expression action and / or body expression action of a target object when the target object enters the acquisition area; forming first basic action data according to the facial expression action and / or body expression action; the target object is a player character; specifically, the body trajectory feature data of the player himself completing a predetermined action or expression is read through AI video to generate bone data; A processing unit for performing standardization processing on the first feature data and the first basic action data to form first standard action data; An output unit for forming a target video stream output according to the first standard action data; A storage unit for storing the target video stream to form a database, wherein each target video stream in the database is defined as a storage node.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by a processor, it implements the image processing method based on data acquisition according to any one of claims 1 to 7.
10. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the image processing method based on data acquisition according to any one of claims 1 to 7.
Citation Information
Patent Citations
Video data processing method, device and system and medium
CN110324672A
Virtual live broadcast method, device and system and storage medium
CN111970535A