Data processing method, device, electronic device and storage medium

By generating script videos for dynamic display, the problem of single user data display form in the prior art is solved, and diversity and dynamic display is achieved, enriching the user experience.

CN112734883BActive Publication Date: 2025-02-28TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110098243.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-25
Publication Date
2025-02-28
Estimated Expiration
2041-01-25

AI Technical Summary

Technical Problem

When the prior art displays user-specific content, the information presentation form is relatively single and lacks diversity and dynamic.

Method used

By obtaining the user's user data in the target application, displaying the script selection page, and generating script videos for dynamic display based on the scripts selected by the user and user data. The script video dynamically presents user data by integrating user data and referring to the script template screen.

Benefits of technology

It realizes the diversity and dynamic display of user data, enriches the display form of user data, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112734883B_ABST
    Figure CN112734883B_ABST
Patent Text Reader

Abstract

The present application discloses a data processing method, device, electronic device and storage medium; when the user data of the user in the target application is obtained, the embodiment of the present application can display a script selection page, the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, the target script is determined, and the target script includes a reference script template screen corresponding to the target plot; according to the target script, a script video for dynamically displaying the user data is generated, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script. The embodiment of the present application can generate a script video for dynamically displaying user data, enriching the display form of user data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a data processing method, device, electronic device and storage medium. Background Art

[0002] With the development of computer technology, multimedia applications are becoming more and more widespread. In the process of using the system platform, users will generate their own exclusive content, which may include text and images. For example, users will post some posts on social platforms, and the content of these posts is the user's exclusive content. The system platform can use the user's exclusive content as material and then use these materials for creation.

[0003] In the current related technologies, the text data and image data in the user-specific content are usually simply synthesized and processed, and the user-specific content is displayed in the form of picture media, and the information presentation form is relatively simple. Summary of the invention

[0004] The embodiments of the present application provide a data processing method, device, electronic device and storage medium, which can generate a script video for dynamically displaying user data, thereby enriching the display form of user data.

[0005] The present application provides a data processing method, including:

[0006] When user data of the user in the target application is obtained, a script selection page is displayed, wherein the script selection page includes at least one script corresponding to the plot;

[0007] In response to a selection operation of a script in the script selection page, determining a target script, the target script including a reference script template screen corresponding to a target plot;

[0008] According to the target script, a script video for dynamically displaying the user data is generated, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script.

[0009] Accordingly, an embodiment of the present application provides a data processing device, including:

[0010] A display unit, configured to display a script selection page when user data of the user in the target application is acquired, wherein the script selection page includes at least one script corresponding to a plot;

[0011] A determination unit, configured to determine a target script in response to a selection operation on a script in the script selection page, wherein the target script includes a reference script template screen corresponding to a target plot;

[0012] A generation unit is used to generate a script video for dynamically displaying the user data based on the target script, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script.

[0013] Optionally, in some embodiments of the present application, the user data includes user action data, the script content includes a virtual script character, and the virtual script character carries the user action data.

[0014] Optionally, in some embodiments of the present application, the user data includes user analysis data for the target application, and the script content includes data analysis tool graphics, and the data analysis tool graphics are used to dynamically display the user analysis data.

[0015] Optionally, in some embodiments of the present application, the generating unit may include an identifying subunit and a first generating subunit, as follows:

[0016] The recognition subunit is used to recognize the action in the action video and obtain user action data;

[0017] The first generating sub-unit is used to generate a script video for dynamically displaying the user data based on the user action data and the reference script template screen under the target script, wherein the script video includes at least one action image of the virtual script character, and the action in the action image corresponds to the recognized user action data.

[0018] Optionally, in some embodiments of the present application, the first generating subunit can be specifically used to generate at least one action image of the virtual script character based on the skeleton data of the virtual script character and the user action data; fuse the action image with the reference script template screen under the target script to obtain the script template screen corresponding to the target plot; synthesize the script template screen to generate a script video for dynamically displaying the user data.

[0019] Optionally, in some embodiments of the present application, the step of “merging the action image with the reference script template screen under the target script to obtain the script template screen corresponding to the target plot” may include:

[0020] Obtaining transparent channel parameters of the action image;

[0021] Based on the transparent channel parameters of the action image, the action image is overlaid on the reference script template screen under the target script to obtain the script template screen corresponding to the target plot.

[0022] Optionally, in some embodiments of the present application, the user data also includes user audio data; the step of “compositing the script template screen to generate a script video for dynamically displaying the user data” may include:

[0023] Performing synthesis processing on the script template screen to obtain a synthesized video;

[0024] The user audio data is added to a preset position of the synthesized video to obtain a script video for dynamically displaying the user data.

[0025] Optionally, in some embodiments of the present application, the script video also includes action images corresponding to the opposing virtual script character, and transition information;

[0026] The action image corresponding to the virtual script character and the action image corresponding to the opposing virtual script character are switched through the transition information.

[0027] Optionally, in some embodiments of the present application, the generation unit may include a second generation subunit, a fusion subunit and a third generation subunit, as follows:

[0028] The second generating subunit is used to generate at least one data analysis image of the user analysis data based on the data analysis tool graphic and the user analysis data;

[0029] A fusion subunit, used for fusing the data analysis image with the reference script template screen under the target script to obtain the script template screen corresponding to the target script;

[0030] The third generating sub-unit is used to synthesize the script template screen to generate a script video for dynamically displaying the user data.

[0031] Optionally, in some embodiments of the present application, the data processing device may further include an upload page display unit and an upload unit, as follows:

[0032] The upload page display unit is used to display the data upload page of the target application;

[0033] The uploading unit is used to upload the user data of the user in the target application when an operation on the upload control in the data upload page is detected.

[0034] An electronic device provided in an embodiment of the present application includes a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the steps in the data processing method provided in the embodiment of the present application.

[0035] In addition, an embodiment of the present application further provides a storage medium on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps in the data processing method provided in the embodiment of the present application.

[0036] The embodiments of the present application provide a data processing method, device, electronic device, and storage medium, which can display a script selection page when the user data of the user in the target application is obtained, and the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, determine the target script, and the target script includes a reference script template screen corresponding to the target plot; according to the target script, generate a script video for dynamically displaying the user data, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script. The embodiments of the present application can generate a script video for dynamically displaying user data, enriching the display form of user data. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0038] Figure 1a It is a scenario schematic diagram of the data processing method provided in the embodiment of the present application;

[0039] Figure 1b is a flow chart of a data processing method provided in an embodiment of the present application;

[0040] Figure 1c is an illustration of a data processing method provided in an embodiment of the present application;

[0041] Figure 1d It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0042] Figure 1e It is a page schematic diagram of the prior art;

[0043] Figure 1fIt is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0044] Figure 1g It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0045] Figure 1h It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0046] Figure 2a is a flow chart of a data processing method provided in an embodiment of the present application;

[0047] Figure 2b It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0048] Figure 2c It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0049] Figure 2d It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0050] Figure 2e It is a page schematic diagram of the data processing method provided in the embodiment of the present application;

[0051] Figure 2f is another flow chart of the data processing method provided in an embodiment of the present application;

[0052] Figure 2g It is an architecture diagram of the data processing method provided in the embodiment of the present application;

[0053] Figure 3a is a structural schematic diagram of a data processing device provided in an embodiment of the present application;

[0054] Figure 3b is another structural schematic diagram of a data processing device provided in an embodiment of the present application;

[0055] Figure 3c is another structural schematic diagram of a data processing device provided in an embodiment of the present application;

[0056] Figure 3d is another structural schematic diagram of a data processing device provided in an embodiment of the present application;

[0057] Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

[0059] The embodiments of the present application provide a data processing method, device, electronic device and storage medium. The data processing device can be integrated in an electronic device, which can be a terminal or a server.

[0060] It is understandable that the data processing method of this embodiment can be executed on a terminal, can be executed on a server, or can be executed by both a terminal and a server. The above examples should not be construed as limiting the present application.

[0061] like Figure 1a As shown, a terminal and a server jointly execute a data processing method as an example. The data processing system provided in the embodiment of the present application includes a terminal 10 and a server 11, etc. The terminal 10 and the server 11 are connected via a network, such as a wired or wireless network connection, etc., wherein the data processing device can be integrated in the terminal.

[0062] Among them, the terminal 10 can be used to: display the data upload page of the target application; when an operation on the upload control in the data upload page is detected, upload the user data of the user in the target application to the server 11. When the server receives the user data of the user in the target application, the terminal 10 displays the script selection page, and the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, determine the target script, and the target script includes a reference script template screen corresponding to the target plot; and send the target script to the server 11. Among them, the terminal 10 can include a mobile phone, a smart TV, a tablet computer, a laptop, or a personal computer (PC, Personal Computer), etc. A client can also be set on the terminal 10, and the client can be an application client or a browser client, etc.

[0063] The server 11 can receive the user data of the user in the target application and the target script sent by the terminal 10, and generate a script video for dynamically displaying the user data according to the target script, wherein the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes the script content for dynamically presenting the user data under the target script; the script video is sent to the terminal 10, and after receiving the script video sent by the server 11, the terminal 10 can dynamically display the user data through the target script of the script video. The server 11 can be a single server, or a server cluster or cloud server composed of multiple servers.

[0064] The step of generating a script video by the server 11 can also be executed by the terminal 10.

[0065] It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0066] This embodiment will be described from the perspective of a data processing device. The data processing device may be integrated into an electronic device, which may be a server, a terminal or other device.

[0067] The data processing method of the embodiment of the present application can be applied to various data display scenarios. For example, an e-sports platform needs to generate and display user analysis reports based on user data. The data processing method provided in this embodiment can be used to merge user data with the reference script template screen under the target script to obtain the script template screen corresponding to the target script, and then generate a script video, through which the user analysis report can be presented more richly.

[0068] like Figure 1b As shown, the specific process of the data processing method can be as follows:

[0069] 101. When user data of the user in the target application is obtained, a script selection page is displayed, wherein the script selection page includes at least one script corresponding to a plot.

[0070] During the use of the system platform, or in the marketing system, users will generate and accumulate user data with exclusive characteristics. This application can use these user data as materials, develop application scenarios for these materials, customize proprietary scripts, and dynamically display user data through the target script of the script video. Among them, the script video can specifically be a digital video, that is, a UGC multimedia video driven by data and containing user-specific content in the marketing system. The video content of the script video can include data accumulated by the user in the marketing system, such as text, pictures, audio and video, etc.

[0071] Among them, UGC, or user-generated content, is the full name of User Generated Content. The concept of UGC originated in the Internet field, that is, users display their original content through the Internet platform or provide it to other users.

[0072] The user data may include various types, such as video, image, audio, and text, etc., which are not limited in this embodiment. The target application may specifically be a system platform for generating user data.

[0073] Among them, the script selection page can be used to select the script to be merged with the user data. The script selection page includes at least one selection control corresponding to the script. The user can determine the target script based on the selection operation of the selection control. The selection operation can specifically be a sliding operation, a clicking operation, etc., which is not limited in this embodiment.

[0074] In this embodiment, there are many ways to obtain user data.

[0075] For example, user data can be obtained from a local database of the electronic device. For example, if the user data is stored in a local database of the electronic device, when an instruction to obtain user data is received, the user data can be directly obtained from the local database of the electronic device based on the user identifier included in the instruction, where local refers to the electronic device.

[0076] For example, the user data may also be acquired through other devices and then provided to the data processing apparatus, that is, the data processing apparatus may specifically receive the user data sent by other devices such as other terminals.

[0077] For a scenario where the electronic device is a server, obtaining user data may include: receiving user data sent by a terminal.

[0078] In a specific scenario, the user can select the user data to be displayed and upload it to the data processing device.

[0079] Optionally, in some embodiments, the data processing method may further include:

[0080] Displaying the data upload page of the target application;

[0081] When an operation on the upload control in the data upload page is detected, the user data of the user in the target application is uploaded.

[0082] The data upload page may include an upload control corresponding to the user data, and the operation on the upload control may be a click operation, a slide operation, etc., which is not limited in this embodiment. By operating the upload control, the local user data of the terminal may be transmitted to the server; when the server obtains the user data, the server may trigger the terminal to display the script selection page.

[0083] 102. In response to a selection operation on a script in the script selection page, a target script is determined, wherein the target script includes a reference script template screen corresponding to a target plot.

[0084] Among them, the script can be regarded as a carrier for integrating user data. It can contain certain plot logic. A script includes multiple reference script templates under its corresponding plot, that is, reference script template screens. By integrating the user data with the reference script template screens corresponding to the target script, a script video for dynamically displaying the user data can be generated.

[0085] 103. Generate a script video for dynamically displaying the user data based on the target script, wherein the script video includes at least one script template screen corresponding to the target plot, wherein the script template screen is obtained by fusing the user data and the reference script template screen, and wherein the script template screen includes script content for dynamically presenting the user data under the target script.

[0086] The script video may be a video with dynamic effects obtained by fusing user data and a reference script template screen, and the reference script template screen may be pre-set, and may specifically include scene screens, transition information, and other script elements, etc., which are not limited in this embodiment. The script template screen is fused with user data, and may include script content for dynamically presenting user data under the target script.

[0087] Specifically, the script video is a video that dynamically displays user data according to a preset target script. The target script includes multiple reference script template screens. User data can be integrated with the reference script template screens to obtain script template screens, which then constitute the script video.

[0088] The target script is for the entire script video, and it may contain a certain script flow, or script logic. The target script may specifically include at least one sub-script flow that presents a stage of dynamic data changes, and the script template screen set corresponding to the sub-script flow includes at least one script template screen, and the script template screen corresponding to the sub-script flow includes script elements for displaying the stage of dynamic data changes, and the changes in the script elements correspond to the changes in the data.

[0089] Among them, the script content may include script elements that present dynamic changes in user data, and the script elements are virtual objects that constitute the script.

[0090] Optionally, in some embodiments, the user data may include user action data, and the script content may include a virtual script character, and the virtual script character carries the user action data.

[0091] The user data may be obtained from a user action video. Specifically, the action in the action video may be identified to obtain the user action data.

[0092] Among them, the target script may include at least one sub-script process that presents the target action change stage in a script manner, and the script template screen corresponding to the sub-script process includes script content for displaying the target action change stage, and the script content may include a virtual script character, and the virtual script character carries the target action change corresponding to the sub-script process. The virtual script character can be regarded as a script element in the script video. For example, the sub-script process needs to present the corresponding action change of pulling, and the virtual script character needs to show the pulling action.

[0093] Among them, in the process of action change, multiple action change stages may be included. For example, for a dance, it can be decomposed into multiple dance movements, each dance movement corresponds to a movement change stage. Specifically, the dance movement of kicking includes the change process of kicking the leg out, and this change process is a movement change stage.

[0094] The virtual script character may be a three-dimensional virtual character model or a two-dimensional virtual character model, which is not limited in this embodiment. The actions of the virtual script character are associated with the actions in the action video. In this embodiment, the virtual script character may be pre-set or determined by the user from a plurality of candidate virtual script characters.

[0095] Optionally, in some embodiments, the step of “generating a script video for dynamically displaying the user data according to the target script” may include:

[0096] Recognize the actions in the action video and obtain user action data;

[0097] Based on the user action data and the reference script template screen under the target script, a script video for dynamically displaying the user data is generated, the script video includes at least one action image of the virtual script character, and the action in the action image corresponds to the identified user action data.

[0098] The actions may specifically be dance actions or martial arts actions.

[0099] In some embodiments, the actions in the action video can be identified based on a preset action template, which can be a body feature template. In other embodiments, the actions of the objects in the action video can also be identified by a neural network; the neural network can be a visual geometry group network (VGGNet, Visual Geometry Group Network), a residual network (ResNet, Residual Network) and a densely connected convolutional network (DenseNet, Dense Convolutional Network), etc., but it should be understood that the neural network of this embodiment is not limited to the types listed above.

[0100] Optionally, in some embodiments, the step of “generating a script video for dynamically displaying the user data based on the user action data and the reference script template screen under the target script” may include:

[0101] generating at least one action image of the virtual script character based on the skeleton data of the virtual script character and the user action data;

[0102] The action image is merged with a reference script template screen under the target script to obtain a script template screen corresponding to the target plot;

[0103] The script template screen is synthesized to generate a script video for dynamically displaying the user data.

[0104] In some embodiments, if the virtual script character is a character model, its joint point distribution can be as follows: Figure 1c As shown, Figure 1c It is a subdivision of the character's skeleton. The joint point distribution diagram shows the skeleton data of the virtual script character.

[0105] Among them, based on the user action data and the skeleton data of the virtual script character, the limbs of the virtual script character can be driven to perform corresponding actions in the user action data to obtain the action image of the virtual script character.

[0106] Among them, when the action image is merged with the reference script template screen under the target script, since there are multiple reference script template screens, it is necessary to first determine the reference script template screen to be merged with the action image, then determine the position where the action image needs to be presented in the reference script template screen, and then merge the action image and the reference script template screen based on the position. Specifically, the fusion method of the action image and the reference script template screen can be to overlay the action image on the reference script template screen.

[0107] In some embodiments, the fusion area in the reference script template screen to be fused can be first determined, the fusion area can be cut out from the reference script template screen, the action image can be fused with the fusion area to obtain a mixed image area, and the mixed image area can be synthesized with the cut out reference script template screen to obtain the script template screen.

[0108] Optionally, in some embodiments, the step of “merging the action image with the reference script template screen under the target script to obtain the script template screen corresponding to the target plot” may include:

[0109] Obtaining transparent channel parameters of the action image;

[0110] Based on the transparent channel parameters of the action image, the action image is overlaid on the reference script template screen under the target script to obtain the script template screen corresponding to the target plot.

[0111] Among them, the transparent channel is the alpha channel (αChannel or Alpha Channel). The alpha channel refers to the transparency and translucency of a picture. The alpha channel value can be used to set the transparency of the picture. In the process of video image processing, it is often necessary to use the alpha channel to produce various special effects. The alpha channel data can be represented by eight binary digits, storing additional information representing the transparency of each pixel in the image file. The transparent characteristics of the alpha channel can create very rich image effects, which are widely used not only in multimedia works, but also in movies, television, animation, etc. For example, the alpha transparent channel can be used to complete the superposition and synthesis of special pictures, making a part of the image transparent according to different principles, removing the selected color or brightness from the image, so that the image part without color removal can show the background, and the part without color removal still maintains the original image.

[0112] In some embodiments, if the action image does not have a transparent channel, a transparent channel of the action image can be established first, and the transparent channel parameters of each pixel can be determined. For each pixel, the transparency of the pixel can be changed by adjusting its transparent channel parameter. The larger the transparent channel parameter, the smaller the transparency, and vice versa.

[0113] Among them, the pixel color of the action image can be regarded as the foreground color, and the pixel color of the reference script template screen can be regarded as the background color. For the red, green and blue color channels with 256 levels of brightness, when the transparent channel parameter of the action image pixel is 255, it is opaque, that is, all foreground color; when the transparent channel parameter of the action image pixel is 0, it is fully transparent, that is, all background color. For the pixels of the action image that need to be presented, their transparent channel parameters can be set larger; for the pixels of the action image that do not need to be presented, their transparent channel parameters can be set smaller.

[0114] Among them, before the action image and the reference script template screen are merged, it is generally necessary to unify the image formats of the two before processing.

[0115] Optionally, in some embodiments, the user data also includes user audio data; the step of “compositing the script template screen to generate a script video for dynamically displaying the user data” may include:

[0116] Performing synthesis processing on the script template screen to obtain a synthesized video;

[0117] The user audio data is added to a preset position of the synthesized video to obtain a script video for dynamically displaying the user data.

[0118] Among them, the screen shots of each script template can be synthesized according to the time sequence of the actions in the action video to obtain a synthesized video.

[0119] The preset position can be set according to actual conditions, and this embodiment does not limit this. For example, it can be set based on the actions of the virtual script character.

[0120] In some embodiments, after the script template screen is synthesized to obtain the synthesized video, the synthesized video can also be post-processed, for example, adding audio tracks and images (such as QR codes, etc.) to the video, as well as adding material data to the models in the video. The models of virtual script characters and virtual scenes can also be modified, and the video obtained by post-processing can be used as the script video.

[0121] Optionally, in some embodiments, the script video also includes action images corresponding to the opposing virtual script character, and transition information;

[0122] The action image corresponding to the virtual script character and the action image corresponding to the opposing virtual script character are switched through the transition information.

[0123] Among them, the antagonistic virtual script character is the antagonist of the virtual script character.

[0124] Specifically, each action image corresponding to a virtual script character can be synthesized into a virtual character video, and each action image corresponding to an opposing virtual script character can be synthesized into an opposing virtual character video. By splicing the virtual character video and the opposing virtual character video through transition information, a script video can be obtained.

[0125] The action image corresponding to the virtual script character may be pre-set by the data processing device, or may be identified by the data processing device from another action video, which is not limited in this embodiment. The recognition and acquisition process of the action image of the virtual script character may refer to the recognition and acquisition process of the action image of the virtual script character, which will not be repeated here.

[0126] Optionally, in some embodiments, the script content may also include action evaluation parameters of action images corresponding to the virtual script character, and action evaluation parameters of action images corresponding to the antagonistic virtual script character.

[0127] Wherein, the action evaluation parameter of the action image corresponding to the virtual script character can be determined based on the similarity between the preset standard action and the action in the action image corresponding to the virtual script character;

[0128] Based on the preset standard action and the similarity of the action in the action image corresponding to the confrontation virtual script character, the action evaluation parameter of the action image corresponding to the confrontation virtual script character is determined.

[0129] Specifically, the first feature vector of the preset standard action and the second feature vector of the action in the action image can be obtained, and the vector distance between the first feature vector and the second feature vector can be calculated. According to the vector distance, the action evaluation parameter of the action image is determined. The smaller the vector distance, the greater the similarity, and the higher the action evaluation parameter; conversely, the larger the vector distance, the smaller the similarity, and the lower the action evaluation parameter.

[0130] The action evaluation parameters of the action image can also be determined by determining the action difficulty of the action image. The action difficulty of the action image can be determined based on reference actions of different action difficulties. The reference action with the highest similarity to the action image is determined by calculating the similarity between the action image and the reference actions of different action difficulties, and the action difficulty of the reference action with the highest similarity is determined as the action difficulty of the action image.

[0131] In some embodiments, the action evaluation parameters of the action image may also be obtained through a neural network. The neural network may be trained by sample action images with action evaluation parameters, and the action evaluation parameters of the sample action images may be obtained by manual scoring by operators. This embodiment does not limit the type of neural network.

[0132] Optionally, in some embodiments, the user data may include user analysis data for the target application, and the script content may include a data analysis tool graphic, wherein the data analysis tool graphic is used to dynamically display the user analysis data.

[0133] The user analysis data may be obtained by analyzing the initial user data, which is not limited in this embodiment. The initial user data may be data generated by the user in the target application. For example, the initial user data may include various test data of the user, and the user analysis data may include the comprehensive evaluation parameters of the user and the evaluation parameters of various test data.

[0134] Among them, the target script may include at least one sub-script process that presents the target user analysis data change stage in a script manner, and the script template screen corresponding to the sub-script process includes script content for displaying the target user analysis data change stage, and the script content may include a data analysis tool graphic, and the data analysis tool graphic carries the target user analysis data change corresponding to the sub-script process. The data analysis tool graphic can be regarded as a script element in the script video. The change of the data analysis tool graphic can be associated with the target user analysis data change.

[0135] In a specific embodiment, the target application is an e-sports platform, and users participate in e-sports project tests, wherein each project may include concentration, stress resistance, combat effectiveness, scheduling ability, achievement motivation, multi-line processing, and hand-eye coordination, etc. Then the user analysis data includes the test scores of each project and the comprehensive test score obtained by weighted calculation of the test scores of each project. In the target script, how to dynamically display the test score can be regarded as a sub-script process. The script template screen corresponding to the sub-script process includes a data analysis tool graphic for displaying the test score (i.e., user analysis data) change stage. The target user analysis data change stage can specifically be to display the change process from the comprehensive test score to the project test score. Specifically, the data analysis tool graphic can be as follows Figure 1dAs shown, it is a regular heptagon, and the data analysis tool graphic can be integrated with the test score. For example, the comprehensive test score can be displayed in the middle of the data analysis tool graphic, and the test scores of each item are displayed around the seven vertices of the data analysis tool graphic. The sub-script flow can be to first display the comprehensive test score in the test score, and then display the test scores of each item. Based on the sub-script flow, the data analysis tool graphic and the test score can be integrated to generate multiple data analysis images of the test score, wherein each data analysis image dynamically displays the test score, and different data analysis images have different transparent channel parameters. For example, some data analysis images have lower transparency in the middle and higher transparency around them (such as Figure 1d As shown, in order to highlight the comprehensive test score, some data analysis images have relatively low overall transparency, in order to display the user's test scores for each item and the comprehensive test score, and to reflect the target user's analysis data change stage through data analysis images. The display order of these data analysis images can be determined based on a preset display effect. The preset display effect can be to display the comprehensive test score first, and then display the test scores for each item. In the script video, it is manifested as a process in which the data analysis image of the script template screen corresponding to the sub-script flow is gradually displayed from the center to the edge.

[0136] Optionally, in some embodiments, the step of “generating a script video for dynamically displaying the user data according to the target script” may include:

[0137] generating at least one data analysis image of the user analysis data based on the data analysis tool graphic and the user analysis data;

[0138] The data analysis image is merged with a reference script template screen under the target script to obtain a script template screen corresponding to the target script;

[0139] The script template screen is synthesized to generate a script video for dynamically displaying the user data.

[0140] Among them, the user analysis data can be overlaid on the preset position of the data analysis tool graphic to obtain a reference data analysis image. The preset position can be set according to actual conditions, and this embodiment does not limit this. Then, based on the sub-script process, the transparent channel parameters of the reference data analysis image are adjusted to obtain a data analysis image.

[0141] Among them, the transparent channel parameters of each data analysis image can be different to present a dynamic change effect. Based on the transparent channel parameters of each data analysis image, each data analysis image is merged with the reference script template screen under the target script. Specifically, the data analysis image can be overlaid on the reference script template screen to obtain each script template screen of the target script. Through each script template screen, the user analysis data change process can be dynamically displayed.

[0142] Optionally, in some embodiments, the user data may include image data, the target script includes at least one sub-script process that presents the target image change stage in a script manner, the script template screen corresponding to the sub-script process includes script content for displaying the target image change stage, and the script content carries the target image change corresponding to the sub-script process.

[0143] The image data in the user data may also be obtained by extracting video frames from the video. The target image change stage may specifically be a process in which the transparency of the target image changes, which is not limited in this embodiment.

[0144] Among them, the image data is fused with the script template screen. Specifically, the script template screen to be fused with the image data is first determined, and the script template screen is used as the target script template screen. Then, the specific fusion position in the target script template screen is determined, and based on the transparent channel parameters of the image data, the image corresponding to the image data is overlaid on the fusion position on the target script template screen to obtain the target script template screen fused with the image data.

[0145] Optionally, the image data preset by the data processing device can also be integrated into the script video, and the integration can be performed according to the position where the image data needs to be presented in the script video. For example, the image data preset by the data processing device can be a QR code image for marketing.

[0146] In a specific embodiment, when a user participates in an e-sports project, a video of his or her instructor's evaluation of the user can be integrated into the script video. Specifically, video frames are extracted from the instructor's evaluation video to obtain at least one instructor's evaluation image, which is then integrated into the script video.

[0147] Optionally, in some embodiments, the user data includes user text data, the target script includes at least one sub-script process that presents the target text change stage in a script manner, the script template screen corresponding to the sub-script process includes script content for displaying the target text change stage, and the script content carries the target text changes corresponding to the sub-script process.

[0148] The target text change stage may specifically be a process of displaying the target text from nothing to something, which is not limited in this embodiment.

[0149] Among them, the user text data is integrated with the script template screen. Specifically, the script template screen to be integrated with the user text data can be first determined, and the script template screen is used as the target script template screen. Then, the specific fusion position in the target script template screen is determined, and based on the transparent channel parameters of the user text data, the user text data is overlaid on the fusion position on the target script template screen to obtain the target script template screen integrated with the user text data.

[0150] Optionally, in some embodiments, the data processing device may also add preset text to the script video, for example, may add marketing slogans and the like.

[0151] Optionally, in this embodiment, the above process of generating the script video can be rendered through WebGL. Based on the characteristics of WebGL, the video material of the transparent channel can be completely integrated during the video rendering generation process.

[0152] Among them, WebGL (full name Web Graphics Library) is a drawing protocol. This drawing technology standard can render high-performance interactive 3D and 2D graphics in any compatible web browser based on the openGL web-side graphics library. WebGL can realize the production of Web interactive 3D animation through HTML scripts themselves, without any browser plug-in support; secondly, it uses the underlying graphics hardware acceleration function to perform graphics rendering, which is implemented through a unified, standard, cross-platform OpenGL interface.

[0153] Among them, the web (World Wide Web) is the global wide area network, also known as the World Wide Web. It is a global, dynamically interactive, cross-platform distributed graphic information system based on hypertext and HTTP (HyperText Transfer Protocol).

[0154] Among them, openGL (Open Graphics Library) is an open graphics library, which is a cross-language, cross-platform application programming interface for rendering two-dimensional and three-dimensional vector graphics.

[0155] Among them, HTML (Hyper Text Markup Language) is Hypertext Markup Language. Hypertext is a way of organizing information. It associates text, graphics and other information media in the text through hyperlinks.

[0156] In the current related technologies, the user data generated by the user in the target application is generally displayed statically in the form of image media, that is, the user text, image data, etc. are spliced ​​and synthesized to obtain a traditional image format report, such as Figure 1e Compared with videos, pictures cannot express the diversity of video scripts, the content is relatively thin, the amount of information is small and the communication power is poor.

[0157] At present, the secondary creation and display of UGC content still relies on a specific system platform. Since the system is user-oriented, it is also necessary to consider the hardware levels of various users in the market, make corresponding adaptations, performance compatibility and effect degradation, which is a large workload and the effect cannot be guaranteed to be ideal. The animation effects achieved on the system platform are not universal and cannot be guaranteed to run perfectly on all user platforms. In addition, users can only browse on the corresponding platform. There are a lot of redundant elements in the interface during browsing, and it is impossible to obtain high-quality video media that is independent of the platform. The solution also does not have the ability to share across platforms. Among them, the system platform can refer to the web terminal, application (APP, Application), etc.

[0158] This application can provide customized script video generation for the user's personal data, and the script video has script effects and transition effects. Specifically, the script video can be generated on the server side, and a UGC script video with higher definition, more stability, and more secure and reliable content can be obtained from the server side. Since the video generation is completed on the server side, the quality of the video rendering is determined by the server, and the final video product effect can be ensured to the greatest extent without considering the compatibility of a large number of user clients. In addition, with the high compatibility of video playback, the cross-platform effect of the script video is greatly improved, and it can be placed on the current major mainstream Internet channels without platform restrictions, such as common chat applications.

[0159] In a specific embodiment, the target application is an e-sports application platform, and an e-sports script video report can be generated based on the method provided in this embodiment. After the user participates in the project score test and obtains the special ability score and the instructor's guidance comments (such as the instructor's explanation video), the system's webGL rendering pipeline will be activated, and a script video report that can analyze the user's test situation as a whole will be generated on the server side. The script video report can include a report introduction, user data display in various dimensions, transitions, instructor interactive guidance, and concluding remarks.

[0160] Among them, the tutor's explanation video stream can be processed into a mov video with a transparent channel. The tutor's explanation video can be Figure 1f As shown, at the same time, when the webGL rendering is running, the mov video file needs to be processed into a compatible webm format. Among them, mov is an audio and video file format used to store common digital media types.

[0161] On the server side, you can use canvas to develop script flow and transition animations. Under the web standard, the transparent channel of webm can be perfectly supported, and the alpha channel value of the transparent channel can be flexibly adjusted during the theater rendering process to achieve free editing of transparency. In canvas, the webm material video (i.e. the tutor material video) is disassembled frame by frame and converted into material data, which is then integrated and rendered into the existing theater canvas. Among them, Webm is an open and free media file format.

[0162] After completing the development of the theater rendering of canvas, the canvas rendering data can be processed based on the vp8 / vp9 multimedia format and Media StreamRecording API (application programming interface for media recording) to obtain the webm script video. The entire process of canvas theater rendering occurs in the puppeteer process on the server. When the server detects that puppeteer has completed the rendering and obtains the final webm result video, the process enters the video post-processing stage. In the post-processing stage, Fluent-ffmpeg is used to perform secondary processing on the video, including h264 format conversion, audio and video supplementation, etc. After the processing is completed, the resulting mp4 video can be uploaded to the cloud storage for users to access and download.

[0163] Among them, Canvas is the "canvas", which is the "container" of all UI (User Interface) components in the game. h264 is a digital video compression format. Puppeteer is a Node library that provides a high-level application programming interface to simulate the operation of a browser.

[0164] Among them, vp8 is an open image compression format, vp9 is an open format, no licensing fee video compression standard. mp4 (Moving Picture Experts Group 4) is a set of compression coding standards for audio and video information.

[0165] Specifically, the user data changes presented in the script video can be referred to Figure 1g and Figure 1h , the user data may include image data (such as character images) and text data (such as tutor's words), and the user data may be dynamically displayed in the form of a script video based on the target script. For example, the target script may display the tutor's words word by word and gradually display the character image through transparency; Figure 1gAs shown in FIG. 11 , when the video is played to the 11th second, the transparency of the character image in the video screen is high, and only a part of the text data is displayed. As the script video is played, the text data and the character image are gradually displayed (as shown in FIG. 11 ). Figure 1h shown).

[0166] This application can integrate transparent channels to perform multimedia fusion and video synthesis based on user-defined text, pictures, audio and video data, and obtain a script video that dynamically displays user data based on the target script.

[0167] As can be seen from the above, the electronic device of this embodiment can display a script selection page when acquiring the user data of the user in the target application, and the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, determine the target script, and the target script includes a reference script template screen corresponding to the target plot; according to the target script, generate a script video for dynamically displaying the user data, and the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script. The embodiment of the present application can dynamically display user data in the form of a script video, enriching the display form of user data.

[0168] According to the method described in the previous embodiment, the data processing device will be further described in detail below by taking the example of being specifically integrated in a server.

[0169] The present application embodiment provides a data processing method, such as Figure 2a As shown, the specific process of the data processing method can be as follows:

[0170] 201. The terminal displays a data upload page of the target application.

[0171] 202. When an operation on an upload control in the data upload page is detected, the terminal uploads the user data of the user in the target application to the server.

[0172] The data upload page may include an upload control corresponding to the user data, and the operation on the upload control may be a click operation, a slide operation, etc., which is not limited in this embodiment. By operating the upload control, the local user data of the terminal may be transmitted to the server; when the server obtains the user data, the server may trigger the terminal to display the script selection page.

[0173] The user data may be uploaded to the server by the user, or the server may send an instruction to the terminal to obtain the user data, and the terminal may send the user data to the server based on the instruction. Optionally, in some embodiments, the user data of the target application is stored in a database of the server, and the server may obtain the user data of the target application from the database and generate a script video based on the user data.

[0174] After submitting the user data, the user can also choose to adjust and filter the user data, and use the adjusted and filtered user data as the material for making the script video. The server can also further filter the submitted user data.

[0175] 203. When the server receives the user data of the user in the target application, the server triggers the terminal to display a script selection page, where the script selection page includes at least one script corresponding to a plot.

[0176] 204. The server determines a target script in response to a selection operation on the script in the script selection page, wherein the target script includes a reference script template screen corresponding to the target plot.

[0177] The reference script template picture may specifically be a scene template picture, which may be obtained by rendering a three-dimensional scene model.

[0178] Specifically, in one embodiment, the target application is a street dance application, such as Figure 2b As shown, the user can upload a new action video based on the trigger operation of the control for uploading a new action in the action upload page (i.e., the data upload page of the above embodiment). The data processing device can extract user action data from all uploaded action videos; the user can also select a target video from all uploaded action videos, and the data processing device extracts user action data from the target video. After determining the video from which the user action data is to be extracted, the server will identify and analyze the action video to obtain the user action data.

[0179] The server can use Tensorflow to process and analyze the action video and convert it into action data. TensorFlow is a symbolic mathematical system based on dataflow programming and is widely used in the programming implementation of various machine learning algorithms.

[0180] After uploading the action video, the user can choose to select a virtual script role from multiple candidate virtual script roles as the object that carries the user's action data; or, the server can also determine the virtual script role on its own.

[0181] Optionally, the script video in the street dance application has two different modes, namely, individual mode and battle mode. For the battle mode, the user can also select a battle object, that is, to fight against a virtual script character. The battle interaction page can be referred to Figure 2c In the dance battle interactive page, the user can select the virtual script character to fight against based on the operation of the selection control of the dance battle object (i.e., the icon corresponding to "here is the user name, zone information"). In other embodiments, the server can also determine the virtual script character to fight against on its own.

[0182] Optionally, the generation of script videos can be achieved through WebGL rendering technology. First, it is necessary to implement or set up the webGL reference script template screen and the target script on the web side, such as scene animation, transition information, and other script elements. In the webGL rendering pipeline, the program imports scene models, 3D model actions, and implements animation effects, integrates user data, and renders in the webGL environment. Finally, the rendering data can be converted into a video file according to the vp8 / vp9 protocol to synthesize a general mp4 video.

[0183] In this embodiment, the Three.js engine can be used to build the scene model. Three.js is a 3D engine running in a browser that can be used to create various 3D scenes, including various objects such as cameras, light and shadow, and materials. Specifically, based on the MMD Loader (mikumikudance loader, model loading) module of Three.js, the Web end can load the 3D model (i.e., the 3D character model corresponding to the virtual script character) and skeleton data, and can match the action frame data and drive the virtual script character to perform corresponding actions.

[0184] Among them, Three.js is a Javascript 3D library (three-dimensional library), which encapsulates WebGL, allowing front-end developers to easily carry out web 3D development without having to master a lot of mathematical and drawing knowledge, thus lowering the threshold and greatly improving efficiency.

[0185] Among them, see Figure 2d and Figure 2e , the actions of the virtual script character correspond to the actions in the action video. Figure 2d and Figure 2e As shown, the script template screen of the script video can also be integrated with the corresponding screen in the action video (specifically, it can be a real-life action screen). For the same script template screen, the actions of the virtual script character in the script template screen and the actions of the action video screen in the script template screen correspond to each other.

[0186] 205. The server generates a script video for dynamically displaying the user data based on the target script, wherein the script video includes at least one script template screen corresponding to the target plot, wherein the script template screen is obtained by fusing the user data and the reference script template screen, and wherein the script template screen includes script content for dynamically presenting the user data under the target script.

[0187] After generating the script video corresponding to the user data, the server can upload the script video to the cloud for storage. Users can directly access the script video, or download the script video by themselves and share it on other social platforms.

[0188] In a specific embodiment, the target application is a dance application, see Figure 2f , which is the process of generating a script video, is as follows:

[0189] 2001. The user enters the application interface of the target application;

[0190] 2002. When the user needs to generate a script video based on the user action data, it is detected whether the database corresponding to the target application has the user's personal action data. If not, the user is required to upload a dance video, and the action in the dance video is recognized to obtain the three-dimensional character action data; if so, step 2003 is executed;

[0191] 2003. When the user selects the battle dance mode, determine the battle dance object. If the user selects the individual mode, this step can be skipped.

[0192] 2004. Modify the data such as the 3D scene and character model (the model corresponding to the virtual script character) to be integrated;

[0193] 2005. After the modification is completed, all the data to be merged are submitted, that is, the multi-party dance battle data required for the script video (dance battle video) to be generated are submitted;

[0194] 2006. After submitting the data, enter the server rendering queue;

[0195] 2007. When the queue process reaches the dance battle video, the server can render the three-dimensional scene and the dance battle process through webGL based on the multi-party dance battle data to obtain the animation stream data;

[0196] 2008. Convert animation stream data into webm video;

[0197] 2009, Convert webm video to h264 mp4 video;

[0198] 20010. Process the audio and video through the Fluent-ffmpeg module to obtain the script video;

[0199] 20011. Share and disseminate script videos.

[0200] Among them, Webm is an open and free media file format. H264 is a digital video compression format. Ffmpeg (Fast Forward Mpeg) is a set of open source computer programs that can be used to record, convert digital audio and video, and convert them into streams. It provides a complete solution for recording, converting and streaming audio and video. mpeg (Moving Picture Experts Group) is a standard for moving image and voice compression.

[0201] The server can be mainly divided into two parts: http service and video rendering. The http service is connected to the client and provides functions such as user data submission and result feedback. A separate queue process is used for video rendering. It detects changes in the new queue generated by the http service and disassembles user data to drive video rendering. Specifically, puppeteer is started to complete webGL rendering and detect the generation of video files. After completion, secondary development of the video is carried out to add audio tracks, material data and video fusion. After completion, the file is uploaded to the cloud for user access or download, and the task is marked as completed, ready to start the next video rendering task.

[0202] The server can use PM2 for process management and detect and log the video rendering process. Each time the user initiates an interactive operation, the above video rendering process will be repeated. For the project architecture, see Figure 2g . Among them, pm2 is a process management tool, which can be used to manage node processes and view the status of node processes. Of course, it also supports performance detection, process daemon, load balancing and other functions. The process management tool can include the management of the server and webGL (network graphics library) pages. Among them, the server can include http interface service module, action data analysis module, rendering process module; webGL page can include 3D rendering / model loading engine module (Three.js / MMD Loader), animation driver module, webGL rendering module and streaming data to webm video module.

[0203] As can be seen from the above, this embodiment can display the data upload page of the target application through the terminal; when an operation on the upload control in the data upload page is detected, the terminal uploads the user data of the user in the target application to the server; when the server receives the user data of the user in the target application, the server triggers the terminal to display the script selection page, and the script selection page includes at least one script corresponding to the plot; the server responds to the selection operation of the script in the script selection page, and determines the target script, and the target script includes a reference script template screen corresponding to the target plot; according to the target script, a script video for dynamically displaying the user data is generated, and the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes the script content for dynamically presenting the user data under the target script. The embodiment of the present application can dynamically display user data in the form of a script video, enriching the display form of user data.

[0204] In order to better implement the above method, the embodiment of the present application also provides a data processing device, such as Figure 3a As shown, the data processing device may include a display unit 301, a determination unit 302 and a generation unit 303, as follows:

[0205] (1) Display unit 301;

[0206] The display unit 301 is used to display a script selection page when the user data of the user in the target application is obtained, and the script selection page includes at least one script corresponding to the plot.

[0207] (2) determining unit 302;

[0208] The determination unit 302 is used to determine a target script in response to a selection operation on a script in the script selection page, wherein the target script includes a reference script template screen corresponding to the target plot.

[0209] (3) generating unit 303;

[0210] The generation unit 303 is used to generate a script video for dynamically displaying the user data based on the target script, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script.

[0211] Optionally, in some embodiments of the present application, the user data includes user action data, the script content includes a virtual script character, and the virtual script character carries the user action data.

[0212] Optionally, in some embodiments of the present application, the user data includes user analysis data for the target application, and the script content includes data analysis tool graphics, and the data analysis tool graphics are used to dynamically display the user analysis data.

[0213] Optionally, in some embodiments of the present application, the generating unit 303 may include an identifying subunit 3031 and a first generating subunit 3032, see Figure 3b ,as follows:

[0214] The identification subunit 3031 is used to identify the action in the action video and obtain user action data;

[0215] The first generating sub-unit 3032 is used to generate a script video for dynamically displaying the user data based on the user action data and the reference script template screen under the target script, wherein the script video includes at least one action image of the virtual script character, and the action in the action image corresponds to the identified user action data.

[0216] Optionally, in some embodiments of the present application, the first generating subunit 3032 can be specifically used to generate at least one action image of the virtual script character based on the skeleton data of the virtual script character and the user action data; fuse the action image with the reference script template screen under the target script to obtain the script template screen corresponding to the target plot; synthesize the script template screen to generate a script video for dynamically displaying the user data.

[0217] Optionally, in some embodiments of the present application, the step of “merging the action image with the reference script template screen under the target script to obtain the script template screen corresponding to the target plot” may include:

[0218] Obtaining transparent channel parameters of the action image;

[0219] Based on the transparent channel parameters of the action image, the action image is overlaid on the reference script template screen under the target script to obtain the script template screen corresponding to the target plot.

[0220] Optionally, in some embodiments of the present application, the user data also includes user audio data; the step of “compositing the script template screen to generate a script video for dynamically displaying the user data” may include:

[0221] Performing synthesis processing on the script template screen to obtain a synthesized video;

[0222] The user audio data is added to a preset position of the synthesized video to obtain a script video for dynamically displaying the user data.

[0223] Optionally, in some embodiments of the present application, the script video also includes action images corresponding to the opposing virtual script character, and transition information;

[0224] The action image corresponding to the virtual script character and the action image corresponding to the opposing virtual script character are switched through the transition information.

[0225] Optionally, in some embodiments of the present application, the generating unit 303 may include a second generating subunit 3033, a fusion subunit 3034 and a third generating subunit 3035, see Figure 3c ,as follows:

[0226] The second generating subunit 3033 is used to generate at least one data analysis image of the user analysis data based on the data analysis tool graphic and the user analysis data;

[0227] A fusion subunit 3034 is used to fuse the data analysis image with the reference script template screen under the target script to obtain the script template screen corresponding to the target script;

[0228] The third generating sub-unit 3035 is used to synthesize the script template screen to generate a script video for dynamically displaying the user data.

[0229] Optionally, in some embodiments of the present application, the data processing device may further include an upload page display unit 304 and an upload unit 305, see Figure 3d ,as follows:

[0230] The upload page display unit 304 is used to display the data upload page of the target application;

[0231] The uploading unit 305 is configured to upload the user data of the user in the target application when an operation on the upload control in the data upload page is detected.

[0232] As can be seen from the above, in this embodiment, when the user data of the user in the target application is obtained, the display unit 301 displays the script selection page, and the script selection page includes at least one script corresponding to the plot; the determination unit 302 responds to the selection operation of the script in the script selection page to determine the target script, and the target script includes a reference script template screen corresponding to the target plot; the generation unit 303 generates a script video for dynamically displaying the user data according to the target script, and the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script. The embodiment of the present application can generate a script video for dynamically displaying user data, enriching the display form of user data.

[0233] The present application also provides an electronic device, such as Figure 4 As shown, it shows a schematic diagram of the structure of an electronic device involved in an embodiment of the present application, and the electronic device may be a terminal or a server, etc. Specifically:

[0234] The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that Figure 4 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0235] The processor 401 is the control center of the electronic device, and uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing software programs and / or modules stored in the memory 402, and calling data stored in the memory 402, the processor 401 performs various functions of the electronic device and processes data. Optionally, the processor 401 may include one or more processing cores; preferably, the processor 401 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 401.

[0236] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0237] The electronic device also includes a power supply 403 for supplying power to each component. Preferably, the power supply 403 can be logically connected to the processor 401 through a power management system, so as to manage charging, discharging, power consumption and other functions through the power management system. The power supply 403 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

[0238] The electronic device may further include an input unit 404, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0239] Although not shown, if the electronic device is a terminal, it may also include a display unit, etc., which will not be described in detail here. Specifically in this embodiment, the processor 401 in the electronic device will load the executable files corresponding to the processes of one or more applications into the memory 402 according to the following instructions, and the processor 401 will run the application stored in the memory 402 to implement various functions, as follows:

[0240] When the user data of the user in the target application is obtained, a script selection page is displayed, and the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, a target script is determined, and the target script includes a reference script template screen corresponding to the target plot; based on the target script, a script video for dynamically displaying the user data is generated, and the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script.

[0241] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0242] As can be seen from the above, this embodiment can display a script selection page when the user data of the user in the target application is obtained, and the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, the target script is determined, and the target script includes a reference script template screen corresponding to the target plot; according to the target script, a script video for dynamically displaying the user data is generated, and the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script. The embodiment of the present application can generate a script video for dynamically displaying user data, enriching the display form of user data.

[0243] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0244] To this end, an embodiment of the present application provides a storage medium in which a plurality of instructions are stored, and the instructions can be loaded by a processor to execute the steps in any data processing method provided in the embodiment of the present application. For example, the instructions can execute the following steps:

[0245] When the user data of the user in the target application is obtained, a script selection page is displayed, and the script selection page includes at least one script corresponding to the plot; in response to the selection operation of the script in the script selection page, a target script is determined, and the target script includes a reference script template screen corresponding to the target plot; based on the target script, a script video for dynamically displaying the user data is generated, and the script video includes at least one script template screen corresponding to the target plot, and the script template screen is obtained by fusing the user data and the reference script template screen, and the script template screen includes script content for dynamically presenting the user data under the target script.

[0246] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0247] The storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0248] Since the instructions stored in the storage medium can execute the steps in any data processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any data processing method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0249] According to one aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method provided in various optional implementations of the above-mentioned data processing aspects.

[0250] The above is a detailed introduction to a data processing method, device, electronic device and storage medium provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data processing method, characterized in that: include: When user data of the user in the target application is obtained, a script selection page is displayed, wherein the script selection page includes at least one script corresponding to the plot; In response to a selection operation of a script in the script selection page, determining a target script, the target script including a reference script template screen corresponding to a target plot; According to the target script, a script video for dynamically displaying the user data is generated, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, the script template screen includes script content for dynamically presenting the user data under the target script, the target script includes at least one sub-script flow for presenting a stage of dynamic data changes, the script template screen set corresponding to the sub-script flow includes at least one script template screen, the script template screen corresponding to the sub-script flow includes script elements for displaying a stage of dynamic data changes, and changes in the script elements correspond to changes in the data.

2. The method according to claim 1, characterized in that The user data includes user action data, the script content includes a virtual script character, and the virtual script character carries the user action data.

3. The method according to claim 1, characterized in that The user data includes user analysis data for the target application, and the script content includes a data analysis tool graphic, and the data analysis tool graphic is used to dynamically display the user analysis data.

4. The method according to claim 2, characterized in that: The step of generating a script video for dynamically displaying the user data according to the target script includes: Recognize the actions in the action video and obtain user action data; Based on the user action data and the reference script template screen under the target script, a script video for dynamically displaying the user data is generated, the script video includes at least one action image of the virtual script character, and the action in the action image corresponds to the identified user action data.

5. The method according to claim 4, characterized in that The step of generating a script video for dynamically displaying the user data based on the user action data and the reference script template screen under the target script includes: generating at least one action image of the virtual script character based on the skeleton data of the virtual script character and the user action data; The action image is merged with a reference script template screen under the target script to obtain a script template screen corresponding to the target plot; The script template screen is synthesized to generate a script video for dynamically displaying the user data.

6. The method according to claim 5, characterized in that The step of fusing the action image with a reference script template screen under the target script to obtain a script template screen corresponding to the target plot includes: Obtaining transparent channel parameters of the action image; Based on the transparent channel parameters of the action image, the action image is overlaid on the reference script template screen under the target script to obtain the script template screen corresponding to the target plot.

7. The method according to claim 5, characterized in that The user data also includes user audio data; the synthesizing process of the script template screen to generate a script video for dynamically displaying the user data includes: Performing synthesis processing on the script template screen to obtain a synthesized video; The user audio data is added to a preset position of the synthesized video to obtain a script video for dynamically displaying the user data.

8. The method according to claim 4, characterized in that The script video also includes action images corresponding to the opposing virtual script character and transition information; The action image corresponding to the virtual script character and the action image corresponding to the opposing virtual script character are switched through the transition information.

9. The method according to claim 3, characterized in that: The step of generating a script video for dynamically displaying the user data according to the target script includes: generating at least one data analysis image of the user analysis data based on the data analysis tool graphic and the user analysis data; The data analysis image is merged with a reference script template screen under the target script to obtain a script template screen corresponding to the target script; The script template screen is synthesized to generate a script video for dynamically displaying the user data.

10. The method according to claim 1, characterized in that The method further comprises: Displaying the data upload page of the target application; When an operation on the upload control in the data upload page is detected, the user data of the user in the target application is uploaded.

11. A data processing device, characterized in that: include: A display unit, configured to display a script selection page when user data of the user in the target application is acquired, wherein the script selection page includes at least one script corresponding to a plot; A determination unit, configured to determine a target script in response to a selection operation on a script in the script selection page, wherein the target script includes a reference script template screen corresponding to a target plot; A generating unit is used to generate a script video for dynamically displaying the user data according to the target script, the script video includes at least one script template screen corresponding to the target plot, the script template screen is obtained by fusing the user data and the reference script template screen, the script template screen includes script content for dynamically presenting the user data under the target script, the target script includes at least one sub-script flow for presenting a stage of dynamic data change, the script template screen set corresponding to the sub-script flow includes at least one script template screen, the script template screen corresponding to the sub-script flow includes script elements for displaying a stage of dynamic data change, and changes in the script elements correspond to changes in the data.

12. An electronic device, characterized in that: It comprises a memory and a processor; the memory stores an application program, and the processor is used to run the application program in the memory to execute the steps in the data processing method according to any one of claims 1 to 10.

13. A storage medium, characterized in that: The storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the data processing method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Bore hole 3D display system

    CN207603822U

  • Brokering of personalized rulesets for use in digital media character replacement

    US20070136745A1