Data processing method and electronic equipment

Abstract

The invention discloses a data processing method and electronic equipment. The method comprises the steps of obtaining operation data of a target user in a target application and application data of the target application; generating the operation data and the application data based on a target demand to obtain at least one type of multimedia data content; and performing integration processing corresponding to the target demand on the at least one type of multimedia data content to output a target file.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence applications, and in particular to a data processing method and electronic equipment. Background Art

[0002] With the development of Internet technology and mobile communication technology, users can now use social applications installed on their terminals to access and share information anytime and anywhere, such as sharing exciting content with friends or posting it to Moments, official accounts or other social platforms, thereby enhancing the user's social experience.

[0003] Among them, for the content that users want to share on social platforms, such as the player's highlights in the game, they can be obtained by taking screenshots or recording the screen. However, the content obtained by taking screenshots is single, lacking dynamism and interactivity, resulting in insufficient appeal to the audience; the screen recording file of the entire game process obtained by recording the screen is too large, making it difficult to share, and the content sharing effect will be reduced because the audience is not patient enough to watch all the shared content. Summary of the invention

[0004] In view of the above problems, this application provides the following solutions:

[0005] A data processing method, comprising:

[0006] Obtaining operation data of a target user in a target application and application data of the target application;

[0007] Generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content;

[0008] The at least one type of multimedia data content is integrated and processed corresponding to the target requirement to output a target file.

[0009] In the above method, preferably, generating and processing the operation data and the application data based on target requirements includes at least one of the following:

[0010] When the target requirement is a default requirement triggered when a target processing instruction of a target user is not obtained, performing video generation processing and / or image generation processing on the operation data and the application data;

[0011] In the case where the target requirement is a requirement generated based on a target processing instruction of a target user, performing a generation processing operation matching the target processing instruction on the operation data and the application data;

[0012] In a case where the target demand comes from a third-party content audience, video generation processing and / or text generation processing is performed on the operation data and the application data.

[0013] In the above method, preferably, performing a generation processing operation matching the target processing instruction on the operation data and the application data includes at least one of the following:

[0014] In response to obtaining a target trigger operation acting on the target application, generating the target processing instruction, and generating and processing the operation data and the application data using a target processing model matching the target processing instruction;

[0015] In response to obtaining a first trigger operation of a first type of control acting on a first type of application, generating the target processing instruction, and generating and processing the operation data and the application data using a target processing model matching the target processing instruction, wherein the first type of application is an application that can directly call the target processing model;

[0016] In response to obtaining the target interaction data in the second category application, the target processing instruction is generated, and the first category application calls the target processing model that matches the target processing instruction to generate and process the operation data and the application data. The second category application is an application that cannot directly call the target processing model.

[0017] The above method preferably comprises generating and processing the operation data and the application data using a target processing model that matches the target processing instruction, including at least one of the following:

[0018] In the case of obtaining the audio generation demand of the target user, inputting the operation data and the application data into an audio generation model that matches the audio generation instruction, so as to perform the audio generation operation using the audio generation model;

[0019] When the highlight moment generation requirement of the target user is obtained, identifying key image frames in the operation data and the application data to generate a highlight video using the key image frames;

[0020] In the case of obtaining the text generation demand of the target user, inputting the operation data and the application data into a text generation model that matches the text generation instruction, so as to perform a text generation operation using the text generation model;

[0021] When the image generation requirement of the target user is obtained, the operation data and the application data are input as prompt word data into an image generation model that matches the image generation instruction, so as to perform the image generation operation using the image generation model.

[0022] The above method preferably inputs the operation data and the application data into an audio generation model that matches the audio generation instruction, so as to perform the audio generation operation using the audio generation model, including at least one of the following:

[0023] determining a psychological state of a target user based on the operation data and the application data, and configuring audio parameters of audio content generated based on the audio generation model based on the psychological state;

[0024] Using a text generation model to generate the operation data and the application data to obtain an audio text file, and using an audio generation model to perform audio generation processing on the audio text file, the operation data and the application data to obtain target audio content;

[0025] Attribute information of a target application is obtained, and an audio generation model is used to perform audio generation processing corresponding to the attribute information on the operation data and the application data to obtain target audio content.

[0026] The above method preferably includes identifying key image frames in the operation data and the application data to generate a highlight video using the key image frames, including at least one of the following:

[0027] Identifying a target operation behavior in the operation data and a target object in the application data, and editing key image frames including the target operation behavior and / or the target object to obtain the highlight video;

[0028] The operation data and the application data are generated and processed by using a text generation model to obtain a text description file, and the text description file and the identified key image frame are edited to obtain the highlight video;

[0029] The operation data and the application data are generated and processed using a music generation model to obtain background music, and the background music and the identified key image frames are edited to obtain the highlight video.

[0030] The above method preferably inputs the operation data and the application data as prompt word data into an image generation model that matches the image generation instruction, so as to perform the image generation operation using the image generation model, including at least one of the following:

[0031] Determine the role data of the target user based on the operation data and the application data, input the role data as prompt word data into the image generation model for generation processing, and obtain the target image content;

[0032] Using a text generation model to generate the operation data and the application data to obtain a text description file, and using an image generation model to generate an image of the text description file, the operation data and the application data to obtain target image content;

[0033] Attribute information of a target application is obtained, and an image generation model is used to perform image generation processing corresponding to the attribute information on the operation data and the application data to obtain target image content.

[0034] In the above method, preferably, the integration processing of the at least one type of multimedia content corresponding to the target demand includes at least one of the following:

[0035] Based on the target requirement, at least one of the target audio content, the highlight video, the target image content or the target text content generated based on the operation data and the application data is integrated into a target interface to obtain the target file, wherein the interfaces corresponding to different requirements are the same or different;

[0036] Determining display layout information of each multimedia data content based on the type of the multimedia data content and the interface parameters of the display interface, and integrating and processing the at least one type of multimedia data content based on the display layout information to obtain the target file;

[0037] Acquire a target connection element based on the multimedia data content, and use the target connection element to create an association relationship between the multimedia data content to obtain the target file;

[0038] The user portrait information of the target user is obtained, and the multimedia data content is integrated and processed based on the user portrait information to obtain the target file.

[0039] The above method preferably further comprises at least one of the following:

[0040] Adding a target interactive control in the target file to perform an operation of displaying target multimedia data content in response to an interactive control operation acting on the target interactive control;

[0041] The usage information of the electronic device is obtained, and the target multimedia data content in the target file is output in a target output manner based on the usage information.

[0042] An electronic device includes at least one processor and at least one processing model capable of running on the processor, wherein the processing model can be called by a target application to perform at least one of the following:

[0043] Obtaining operation data of a target user in a target application and application data of the target application;

[0044] Generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content;

[0045] The at least one type of multimedia data content is integrated and processed corresponding to the target requirement to output a target file.

[0046] A data processing device, comprising:

[0047] A data acquisition unit, used to acquire operation data of a target user in a target application and application data of the target application;

[0048] A multimedia generating unit, configured to generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content;

[0049] The multimedia integration unit is used to perform integration processing on the at least one type of multimedia data content corresponding to the target demand to output a target file.

[0050] A computer program product includes computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any data processing method provided in the present application.

[0051] A computer-readable storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any data processing method provided in the present application.

[0052] It can be seen from the above scheme that in a data processing method and electronic device provided by the present application, based on the target demand, the target user's operation data in the target application and the application data of the target application are generated and processed, so that at least one type of multimedia data content can be obtained, and then these multimedia data contents are integrated according to the target demand, and the target file can be output. It can be seen that in this application, there will be no simple screenshots or screen recordings, but content generation based on the operation data and application data according to the target demand, so that after integration, a target file that better meets the demand can be obtained, thereby improving the integration of multimedia data content, and the target file obtained, so that when sharing these target files, a better sharing effect can be achieved, thereby achieving the purpose of improving the file sharing effect in this application. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0054] Figure 1 A flowchart of a data processing method proposed in Example 1 of the present application;

[0055] Figure 2 This is an example diagram of integrating multimedia data content in an embodiment of the present application;

[0056] Figure 3 Another example diagram of integrating multimedia data content in an embodiment of the present application;

[0057] Figure 4 This is an example diagram of the target file in the embodiment of this application;

[0058] Figure 5 A schematic diagram of the structure of a data processing device provided in Embodiment 2 of the present application;

[0059] Figure 6 A schematic diagram of the structure of an electronic device provided in Embodiment 3 of the present application;

[0060] Figure 7 This is a system architecture diagram of a mobile phone game application applicable to this application;

[0061] Figure 8 This is a flowchart of data processing for mobile phone game applications. DETAILED DESCRIPTION

[0062] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation mode of the present application are only used to explain the specific embodiments of the present application and are not intended to limit the present application. The embodiments of the present application are described below in conjunction with the drawings. It is known to those of ordinary skill in the art that with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0063] The term "first", "second" etc. that the full text of the application relates to is used to distinguish similar objects, and need not be used to describe a specific order or sequential order. It should be understood that the terms used in this way can be interchangeable in appropriate circumstances, and this is only to describe the distinction mode adopted by the objects of the same attributes when describing in the embodiments of the application. In addition, the terms "including" and "having" and any of their deformations are intended to cover non-exclusive inclusions, so that the process, method, system, product or equipment comprising a series of units need not be limited to those units, but may include other units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0064] It should be understood that before using the technical solutions disclosed in the embodiments of this application, the type, scope of use, usage scenarios, etc. of the personal information (such as the user's identity information) involved in this application should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0065] Reference Figure 1 , is a flow chart of a data processing method proposed in the first embodiment of the present application, which method can be applied to an electronic device with a data processing function, which can be a local terminal device or a cloud server, such as an application with a data processing function running on the terminal device or a cloud service provided by a cloud server. The technical solution in this embodiment is mainly used to improve the sharing effect of the acquired shared files.

[0066] Specifically, the method in this embodiment may include the following steps:

[0067] Step 101: Obtain operation data of a target user in a target application and application data of the target application.

[0068] The target application may be an application that can provide corresponding functions to users, such as a game application, a video playback application, a learning application, a conference application, or other social media applications, etc. Correspondingly, the target user may be a user who uses the target application, such as a game player, a video viewer, a student doing a test, a conference participant, or a sharer, etc.

[0069] In one implementation, the operation data may include at least one of operation behavior data, operation role data, operation environment data, etc. The operation data of the target user in the target application refers to the operation data belonging to the target user among all the operation data corresponding to the target application. For example, the target user's behavior data such as clicking and sliding in the target application, the target user's role data in the target application, the environment data of the target user using the target application, etc., specifically, the game player operates the game character to move, jump, shoot, release skills, or use game props during the game, etc.

[0070] The application data of the target application may include at least one of the following: application type, application context (environment or scenario presented by the application interface), application display content data, application operation data, etc. For example, the application data of a game application includes: game application type, game context, content displayed on the game interface, game operation data, etc.

[0071] For example, for a game application, in this embodiment, the target user's operation data in the game application and the application data of the game application can be obtained through the following data collection methods:

[0072] (1) Access to the game’s built-in application programming interface (API) or software development kit (SDK). The built-in API or SDK provided by the game application allows developers to access game data. These APIs or SDKs can provide real-time data access, including player status, actions, battle statistics, etc.

[0073] (2) How to read log files: Game applications will record log files during operation, including game events, combat data, etc. These files can usually be found in the game installation directory.

[0074] (3) Methods for reading and replaying video recordings: Game applications provide recording and replay functions that can be used to record data during the game. These recordings usually contain game status, player actions, and events.

[0075] Step 102: Generate and process the operation data and application data based on target requirements to obtain at least one type of multimedia data content.

[0076] The target requirement can be understood as the purpose of data processing. The target requirement can be understood as the requirements of what kind of processing operation the electronic device needs to perform, the task requirements issued by the user, or what kind of target file the user needs. For example, the target requirement can be at least one of: the user needs a poster image, the user needs a screen saver or wallpaper, the user needs to share content, etc.

[0077] It should be noted that the target requirement can be the default configuration requirement of the target application. For example, if a game application is configured with a sharing function, the user can click the control of the sharing function to generate a sharing requirement for the content to be shared. Alternatively, the target requirement can be a customized task requirement. For example, the user puts forward a raw image requirement of "I want a game poster aiming at the target" through a voice assistant.

[0078] In one implementation, the generation process in step 102 may include at least one of: audio generation process, video generation process, image (poster) generation process, and text generation process. Each type of generation process may generate a corresponding type of multimedia data content, based on which at least one type of multimedia data content may be obtained in step 102. For example, the multimedia data content may include at least one type of audio (including music), text, video, image (including animated images), user interface UI (User Interface) controls, etc.

[0079] Step 103: Perform integration processing on at least one type of multimedia data content corresponding to target requirements to output a target file.

[0080] In this embodiment, different methods are used to integrate and process multimedia data content according to different target requirements, so as to output different types of target files.

[0081] For example, if the target demand is a demand for content sharing, then the multimedia data content outputted in step 102 may include multiple poster images to be shared, and these dynamic poster images may be integrated in a corresponding manner to obtain a target file of video type, thereby sharing the poster images in the form of video;

[0082] For another example, if the target demand is a demand for display, the multimedia data content output in step 102 may be a web page including background music, highlight moments and poster content, and the background music, highlight moments and poster content are integrated in a corresponding manner to obtain a target file of a web page type including audio, video and images, and the target file is displayed on the web page;

[0083] For another example, if the target requirement is to produce a screen saver or wallpaper, the multimedia data content output in step 102 may include dynamic posters or static posters, and these poster images may be integrated in a corresponding manner to obtain a target file of an image type containing multiple frames of posters. The posters in the target file may be set as a screen saver or wallpaper.

[0084] It can be seen from the above scheme that in a data processing method provided in Example 1 of the present application, based on the target demand, the target user's operation data in the target application and the application data of the target application are generated and processed, so that at least one type of multimedia data content can be obtained, and then these multimedia data contents are integrated according to the target demand, and the target file can be output. It can be seen that in this application, there will be no simple screenshots or screen recordings, but content generation based on the operation data and application data according to the target demand, so that after integration, a target file that better meets the demand can be obtained, thereby improving the integration of multimedia data content, and the target file obtained, so that when sharing these target files, the sharing effect can be better, thereby achieving the purpose of improving the file sharing effect in this application.

[0085] Based on the above implementation, in step 102, when the operation data and application data are generated and processed based on the target requirements, at least one of the following implementation methods may be used:

[0086] In one implementation, when the target demand is a default demand triggered without obtaining a target processing instruction from a target user, video generation processing and / or image generation processing is performed on the operation data and application data to obtain multimedia data content of the corresponding type.

[0087] In this embodiment, when no user requirement is obtained based on the target processing instruction of the target user, a default requirement can be triggered, so that the video execution generation processing is performed on the operation data and the application data according to the default requirement.

[0088] For example, after a game application ends, the game application does not receive the sharing operation performed by the operating user in the game interface. At this time, this embodiment can generate a video clip of the highlight moment for the game character and / or generate a game poster image of the game character according to the default requirements.

[0089] In another implementation, when the target requirement is a requirement generated based on a target processing instruction of a target user, a generation processing operation matching the target processing instruction is performed on the operation data and the application data to obtain multimedia data content of a corresponding type.

[0090] Among them, the target processing instruction refers to at least one of: a user's sharing instruction, an instruction to display highlight moments, an instruction to generate a screen saver or wallpaper, an instruction to generate music, etc. Accordingly, in this embodiment, the target processing instruction can be generated based on the user's operation behavior on the application interface of the target application, or based on other sensors to trigger the target processing instruction, thereby generating the corresponding target demand. The generation processing operation matching the target processing instruction can include: at least one of audio (including music) generation processing, text generation processing, video generation processing, or image (including static and dynamic images) generation processing.

[0091] For example, there is a sharing control in the operation interface of a game application. After the user triggers the sharing control, the mobile phone responds to the instruction generated by the user triggering the sharing control. According to the needs triggered by the instruction, such as the need to share the highlight moments of the game, the video generation and processing is performed on the operation data of the game character in the game and the application data in the game application, thereby generating video clips of the highlight moments for the game character, and then integrating these video clips to obtain the target file, thereby sharing the target file.

[0092] In another implementation, when the target demand comes from a third-party content audience, video generation processing and / or text generation processing are performed on the operation data and application data to obtain multimedia data content of the corresponding type.

[0093] Among them, the third-party content audience can be understood as other interactive objects of the target application, such as other game players, other meeting participants or netizens, etc.

[0094] It should be noted that, when the target demand comes from a third-party content audience, the type of generation processing performed on the operation data and application data is related to the target demand of the third-party content audience. The type of generation processing performed may be customized by the third-party content audience in the target demand, or the type of generation processing performed is related to the audience type of the third-party content audience, and is not limited to processing types such as generating videos or text descriptions.

[0095] For example, in a game application, after a game is over, the user clicks the share control in the game interface and selects the audience, i.e., the sharing object, such as game friends or game fans. If the audience is a game friend, then the operation data and application data can be processed by video generation and audio generation to generate a video clip and background music of the highlight moment, so that the integrated video file of the game highlight moment can be shared with the game friends, so that the game friends can show off their skills; if the audience is a game fan, then the operation data and application data can be processed by image generation and text generation to generate a game poster image and promotional text, so that the integrated poster promotional image can be shared with the game fans, and the game application can be recommended to the game fans.

[0096] Based on the above implementation, when the target requirement is a requirement generated based on the target processing instruction of the target user, in step 102, when performing the generation processing operation of matching the target processing instruction on the operation data and the application data, it can be implemented in at least one of the following ways:

[0097] In one implementation, when performing a generation processing operation to match a target processing instruction on the operation data and application data in step 102, a target processing instruction can be generated in response to obtaining a target trigger operation acting on a target application, and the operation data and application data can be generated and processed using a target processing model that matches the target processing instruction.

[0098] The target trigger operation can be an operation of triggering an interface control in the application interface of the target application, such as clicking a sharing control, etc.; it can also be an operation of inputting a string instruction into the application interface of the target application, or it can be an operation of performing voice input into the application interface of the target application. Accordingly, in this embodiment, a target processing instruction can be generated in response to the target trigger operation, and in response to the target processing instruction, the operation data and application data are generated and processed using a target processing model that matches the target processing instruction to obtain multimedia data content, and after integrating these multimedia data contents, the target file can be obtained.

[0099] It should be noted that the target processing model may include: at least one of an artificial intelligence (AI) model capable of generating audio, an AI model capable of generating images, an AI model capable of generating text, and an AI model capable of generating video. Based on this, in this embodiment, based on the target processing instruction, the AI ​​model of the corresponding function is called, and the AI ​​model generates and processes the operation data and application data to obtain the corresponding type of multimedia data content. Of course, in other embodiments, the target processing model may also be a large model that integrates image generation function, text generation function, video generation function, and audio generation function, and a functional model in the target processing model may be called based on the target processing instruction to perform the corresponding generation processing operation.

[0100] It should be noted that the AI ​​big model can be a big model deployed locally or a big model deployed in the cloud.

[0101] For example, there is a sharing control in the operation interface of a game application. After the user triggers the sharing control, the mobile phone responds to the instruction generated by the user triggering the sharing control. According to the instruction, the AI ​​big model that can generate audio and the AI ​​big model that can generate video are called to generate and process the operation data and application data respectively, and then the background music and video clips of the highlight moments generated by each are integrated to obtain a video file.

[0102] In another implementation, when performing a generation processing operation to match a target processing instruction on the operation data and application data in step 102, a target processing instruction can be generated in response to obtaining a first trigger operation of a first type of control acting on a first type of application, and the operation data and application data can be generated and processed using a target processing model that matches the target processing instruction.

[0103] Among them, the first type of application is an application that can directly call the target processing model. For example, the first type of application can be an intelligent application such as a voice assistant in a mobile phone. Correspondingly, the first type of control can include: at least one of: a control for generating an image (image creation), a control for generating text, a control for generating a video, a control for generating music, a control for generating a UI, etc. The first trigger operation can be a click operation or a drag operation, etc.

[0104] For example, a user clicks on a control to generate a game highlight video through the voice assistant in the mobile phone, while the game application can be running in the background or not started. As a result, the voice assistant can directly call and access the game application, and use the user's operation data in the game application and the application data of the game application as the prompt input data of the voice assistant. The voice assistant calls the AI ​​big model that can generate videos to perform video generation processing, so as to obtain video clips of the game character's highlight moments, and integrate these video clips to obtain the game highlight video.

[0105] In another implementation, when performing the generation processing operation of matching the target processing instructions on the operation data and application data in step 102, the target processing instructions can be generated in response to obtaining the target interaction data in the second type of application, and the operation data and application data can be generated and processed by calling the target processing model that matches the target processing instructions through the first type of application.

[0106] Among them, the second category of applications is an application that cannot directly call the target processing model. For example, the second category of applications can be social applications or conference applications. The target interaction data represents the target demand, that is, the target interaction data represents the need to generate a target file for the target application, and based on the target demand represented by the target interaction data, the corresponding target processing instruction can be generated. The target processing instruction generated in response to the target interaction data also represents the target demand. Based on this, since the second category of applications cannot directly call the target processing model, in this embodiment, it can respond to the target processing instruction by starting the first category of applications, and then the first category of applications calls the target processing model to generate and process according to the target demand represented by the target processing instruction.

[0107] For example, social friends exchange information through social applications, and the interactive information between the two friends contains information indicating that the game highlights need to be shared. For example, the interactive information sent by the other friend includes "Show me your highlights". Based on this, in this embodiment, in response to the interactive information, a processing instruction indicating that a game highlight video needs to be generated can be generated. In response to the processing instruction, the interactive information is input into the voice assistant as a prompt word, and the voice assistant calls the AI ​​big model that can generate videos for video generation processing and calls the AI ​​big model that can generate audio for audio generation processing to obtain the video clips and background music of the game character's highlight moments, and then integrates the video clips with the background music to obtain the game highlight video. Finally, the game highlight video is shared with social friends through social applications.

[0108] Based on the above implementation, in step 102, when the target processing model matching the target processing instruction is used to generate and process the operation data and the application data, it can be implemented in at least one of the following ways:

[0109] In one implementation, when the audio generation requirements of the target user are obtained, the operation data and the application data are input into an audio generation model that matches the audio generation instruction, so as to perform the audio generation operation using the audio generation model to obtain audio-type multimedia data content.

[0110] For example, the audio generation requirement may be: the requirement to generate background music for a game highlight video, the requirement to generate teaching audio, or the requirement to generate speech audio, etc.

[0111] It should be noted that the target demand may include one or more demands, such as audio generation demand, video generation demand, text generation demand, image generation demand, UI generation demand, etc. In this embodiment, the input data of the target user can be parsed to obtain these target demands. Correspondingly, the target processing instructions generated based on the target demand may include: audio generation instructions, video generation instructions, text generation instructions, image generation instructions, UI generation instructions, etc. For example, the input data of the target user is "Give me a promotion, it must have highlights, it must also have large fonts, plus background music, the effect is better", after demand analysis, it can be determined that the target demand includes: the demand for generating video clips of highlights, the demand for generating background music, and the demand for generating promotional text.

[0112] Based on this, in this embodiment, in response to audio generation needs, the corresponding audio generation instructions can be responded to, and an audio generation model such as an AI large model that can generate audio can be called, and the operation data and application data can be input into the audio generation model. The audio generation operation is performed by the audio generation model to obtain audio-type multimedia data content.

[0113] Specifically, in this embodiment, the psychological state of the target user can be determined based on the operation data and the application data, and then, based on the psychological state, the audio parameters of the audio content generated by the audio generation model can be configured. In this way, the audio generation model can perform the audio generation operation according to the audio parameters configured based on the psychological state of the target user, thereby obtaining multimedia data content, namely audio data, that conforms to the psychological state of the target user.

[0114] For example, the psychological state of the target user may be the emotional state of the game character determined by sentiment analysis, the emotional state of the test taker, the emotional state of the conference speaker, and so on. Correspondingly, the audio parameters configured based on the psychological state may be: the style of the music generated based on the game character or the user's emotional state, the audio style, the audio pitch and other parameters. Based on this, in this embodiment, the operation data and application data may be processed by algorithms such as emotion recognition to identify that the game character is in a happy and excited psychological state. Thus, based on the happy and excited psychological state, the "cheerful" audio parameters are configured for the AI ​​big model that can generate audio. In this way, in this embodiment, the AI ​​big model that can generate audio may be used to process the operation data and application data to generate cheerful game background music.

[0115] In other embodiments, the text generation model can also be used in this embodiment to generate and process the operation data and application data to obtain an audio text file. For example, the audio text file here can be the lyrics of music, or the game highlight commentary for the game, or the commentary of the variety show video or the process of doing the questions, etc. Based on this, the audio generation model can be used in this embodiment to perform audio generation processing on the audio text file, the operation data and the application data, so that the audio generation model generates audio under the guidance of the audio text file, the operation data and the application data to obtain the target audio content.

[0116] For example, in this embodiment, the AI ​​big model capable of generating text is first used to perform text generation processing on the game's operation data and application data to obtain a text file containing the commentary of the game's highlight moments. The AI ​​big model capable of generating audio then combines the commentary, game operation data, and game application data to generate the final audio content. For example, the final audio content is the game's background music, and the commentary of the highlight moments is played in the game's background music.

[0117] In addition, in this embodiment, the attribute information of the target application can also be obtained, and the audio generation model is used to perform audio generation processing on the operation data and application data corresponding to the attribute information to obtain the target audio content. For example, the target application can be a game application, a conference application, a question-answering application, or a video application. Based on this, in this embodiment, different types of audio can be generated according to the attribute information of the target application, such as game attributes, conference attributes, question-answering attributes, or variety show video attributes.

[0118] For example, in this embodiment, game background music can be generated for game applications, learning white noise background music or question explanation audio can be generated for question-answering applications, and variety show video commentary content can be generated for variety show video applications, etc.

[0119] In another implementation, when the target user's highlight moment generation requirement is obtained, key image frames in the operation data and application data are identified to generate a highlight video using the key image frames.

[0120] Among them, the highlight moment generation requirement can be understood as the video generation requirement. Based on this, in this embodiment, in response to the highlight moment generation requirement, the corresponding video generation instruction can be responded to, and the image frames in the operation data and application data can be identified to extract the key image frames of the highlight moment, and then these key image frames are spliced ​​to generate a highlight video. Alternatively, in this embodiment, in response to the highlight moment generation requirement, the corresponding video generation instruction can be responded to, and the AI ​​large model capable of video and audio can be called to extract and splice the video frames related to the highlight moment in the operation data and application data to achieve video editing, thereby obtaining a highlight video.

[0121] Specifically, in this embodiment, the target operation behavior in the operation data and the target object in the application data can be identified, and the key image frames including the target operation behavior and / or the target object can be edited to obtain a highlight video. The target operation behavior can be the operation behavior of the target user in the target application, such as the release of key skills in the game, the killing of monsters, the spawning of specific game props, the game character standing on the podium, holding up a trophy, etc.; and the target object can be the object being operated in the target application, such as the released key skills, monsters, game props, trophies, etc. Based on this, in this embodiment, key image frames can be edited from the video data of the target application according to the target operation behavior and the target object. These key image frames may contain the target operation behavior or the target object, or these key image frames are related to the target operation behavior or the target object, such as image frames of the moment of killing or task completion; then these key image frames are divided according to the target operation behavior or the target object, and the divided image frames are spliced ​​together according to time, for example, the key image frames containing the same target object or target operation behavior are spliced ​​together in chronological order to obtain the essence of the game operation, that is, the highlight video, so that the highlight video can show the most exciting operations or achievements of the game character.

[0122] Alternatively, in this embodiment, the text generation model can also be used to generate and process the operation data and application data to obtain a text description file; then, the text description file and the identified key image frames are edited to obtain a highlight video. The text description file can be a commentary for a game, meeting, or problem-solving process. In this embodiment, an AI large model that can generate text can be used to generate and process the operation data and application data, so that a text description file can be obtained, such as the operation commentary of the highlight moment of the game, so that the identified key image frames can be edited according to the text description file to obtain a highlight video.

[0123] For example, a descriptive explanation is given for the process of playing a game, and then these explanations are combined with video clips of highlight moments generated by a large AI model that can generate videos, to obtain a video file of game highlights with explanations or text descriptions, i.e., a highlight video. Another example is a descriptive explanation is given for the process of doing a question, and then these explanations are combined with video clips of the question explanation generated by a large AI model that can generate videos, to obtain a question explanation video with a question description, i.e., a highlight video.

[0124] Alternatively, in this embodiment, the music generation model can also be used to generate and process the operation data and application data to obtain background music, and then the background music and the identified key image frames are edited to obtain a highlight video.

[0125] For example, in this embodiment, an AI big model capable of generating audio is used to perform audio generation processing on the operation data and application data of the game application, so that background music can be obtained. These background music are combined with the video clips of highlight moments generated by the AI ​​big model capable of generating videos, and highlight videos with background music can be obtained.

[0126] In another implementation, when the text generation requirement of the target user is obtained, the operation data and the application data are input into a text generation model that matches the text generation instruction, so as to perform the text generation operation using the text generation model.

[0127] Specifically, in this embodiment, in response to text generation needs, a text generation model such as an AI large model capable of generating text can be called in response to corresponding text generation instructions, and the operation data and application data are input into the text generation model. The text generation operation is performed by the text generation model to obtain text-type multimedia data content, such as game commentary text, poster promotion text, meeting summary text, or scene description text.

[0128] In another implementation, when the image generation requirement of the target user is obtained, the operation data and the application data are input as prompt word data into an image generation model that matches the image generation instruction, so as to perform the image generation operation using the image generation model.

[0129] Specifically, in this embodiment, in response to the image generation requirements, the image generation model, such as an AI large model capable of generating images, can be called in response to the corresponding image generation instruction, and the operation data and application data can be input into the image generation model, and the image generation model can perform the image generation operation to obtain the multimedia data content of the image type. The multimedia data of the image type can be a static image or a dynamic image, such as an animated game poster image, a static meeting minutes image, etc.

[0130] Specifically, in this embodiment, the role data of the target user, such as a game role or a meeting role, can be determined based on the operation data and application data, and the role data can be input as prompt word data into an image generation model, such as an AI large model capable of generating images, for generation processing to obtain the target image content.

[0131] For example, taking a game application as an example, in this embodiment, the character data of the game player can be provided as a prompt word to the AI ​​big model that can generate an image. The AI ​​big model that can generate an image can generate and process according to the game player's operation data and application data of the game application, so that the AI ​​big model can output a personalized game poster for the game player. The content of the game poster may include the dynamic image of the game player, battle scenes, and game background, and can display the game player's achievements and operation statistics.

[0132] Alternatively, in this embodiment, a text generation model can be used to generate and process the operation data and application data to obtain a text description file. For example, the text description file can be a commentary for a game, meeting, or problem-solving process; then, an image generation model is used to perform image generation processing on the text description file, the operation data, and the application data to obtain the target image content.

[0133] For instance, taking a game application as an example, in this embodiment, an AI big model capable of generating text can be used to generate and process operation data and application data, so that a text description file can be obtained, such as the operation commentary of the highlight moments of the game. In this way, an AI big model capable of generating images can be used to perform image generation processing on the text description file, operation data and application data to obtain a game poster image, which can include the game screen and the commentary of the game screen.

[0134] Alternatively, in this embodiment, the attribute information of the target application may be obtained, and the image generation model may be used to perform image generation processing corresponding to the attribute information on the operation data and the application data to obtain the target image content.

[0135] For example, the target application may be a game application, a conference application, a question-answering application, or a video application, and the corresponding attribute information may include game attributes, conference attributes, question-answering attributes, or video attributes, etc. Among them, the target image content may include at least one type or style of image content, such as a poster type, a photo style, anime style, a static type, or a dynamic type, etc. Based on this, in this embodiment, according to the attribute information of the target application, an AI large model capable of generating images can be used to perform image generation processing on the operation data and application data of the game application according to the attribute information to obtain the target image content, such as generating a dynamic poster image or a static poster image for the game, generating a static image or anime-style image for the question-answering application, and generating a photo image for the video application.

[0136] Based on the above implementation, in step 103, the multimedia content may be integrated and processed corresponding to the target demand in at least one of the following ways:

[0137] In one implementation, the multimedia data content may include at least one of target audio content, highlight video, target image content, and target text content. Based on this, in this embodiment, at least one of the target audio content, highlight video, target image content, or target text content generated and processed based on the operation data and application data may be integrated into the target interface based on the target requirements to obtain the target file. For example, in this embodiment, the generated game background music, the game video clips of the highlight moments, the commentary of the killing behavior, etc. may be integrated into a unified dynamic sharing interface to obtain the target file.

[0138] In this embodiment, the target interface can be presented by front-end technologies such as HTML5, CSS3 or JavaScript, so as to integrate and obtain the target file through dynamic display. The target interface can be a web page interface, a game window interface, a conference window interface or a window interface of other applications, or the target interface can also be a sharing interface of a social sharing application.

[0139] In specific implementations, different requirements may correspond to the same or different interfaces. For example, the target requirement of sharing game posters corresponds to the game window interface; the target requirement of sharing video files of game highlights corresponds to the game window interface; the target requirement of generating meeting minutes images corresponds to the meeting window interface; and so on.

[0140] In another implementation, in this embodiment, the display layout information of each multimedia data content can be determined based on the type of multimedia data content and the interface parameters of the display interface, and then at least one type of multimedia data content can be integrated and processed based on the display layout information to obtain the target file.

[0141] The display interface refers to an interface for displaying multimedia data content, and the interface parameters of the display interface may include at least one parameter of size, aspect ratio, material, style, etc.

[0142] The display layout information can be understood as the layout position between various multimedia data contents. For example, in the display interface, the background music plays the player's personalized music in a floating window, the center of the display interface is used to display the automatically edited highlight moment video, and the right side of the display interface uses a poster to display the player's character with corresponding visual effects.

[0143] For example, in this embodiment, for the target demand of sharing game competition content, based on the generated multimedia data content such as game highlight video, game commentary, game background music, etc. and parameters such as the size and aspect ratio of the game window interface, the display layout information of each multimedia data content is determined, and then according to the display layout information, the game highlight video, game commentary, game promotional poster, etc. are integrated into the display interface to obtain the target file, such as Figure 2 As shown in , in the display interface of the target file, the game highlight video fills the game window interface, the game commentary floats and displays above the interface of the game highlight video, and the game background music plays in the background.

[0144] In one implementation, in this embodiment, the target connection element can be obtained based on the multimedia data content, and the association relationship between the multimedia data content can be created using the target connection element to obtain the target file.

[0145] The target connection element can be understood as a transition element between different multimedia data contents, such as a transition animation, etc. Based on this, in this embodiment, adjacent multimedia data contents spliced ​​together are connected through the target connection element, so as to establish an association relationship between the multimedia data contents, thereby obtaining a target file.

[0146] For example, in this embodiment, the connecting elements between adjacent game highlight videos, game commentary and game posters can be obtained, such as the transition animation between the game poster and the game highlight video. In this way, the game poster and the game highlight video are associated through the transition animation, and the game commentary is displayed floating on the interface of the game highlight video, such as Figure 3 As shown in , the target file is obtained.

[0147] In one implementation, user portrait information of a target user is obtained, and multimedia data content is integrated and processed based on the user portrait information to obtain the target file.

[0148] Among them, the user portrait information can characterize the personality, habits or preferences of the target user. In this embodiment, the target user can be identified based on the operation data and application data, such as a cold personality or a fancy preference, to obtain the user portrait information. Based on this, in this embodiment, these multimedia data contents can be integrated based on the user portrait information, so that the target file obtained meets the preferences of the target user and improves the user experience.

[0149] For example, in this embodiment, when integrating game highlight videos, game commentary and game posters, the game highlight video can be spliced ​​in front of the game poster according to the user's fancy preferences, and the game commentary can be displayed in a dynamic and shining font type floating above the interface of the game highlight video. The resulting target file is more in line with the user's preferences.

[0150] In one implementation, in this embodiment, target interactive controls may also be added to the target file, such as a "view character" button, a "battle record", a "game achievement" or a "share to" button. Figure 4 As shown in , an operation of displaying target multimedia data content is performed in response to an interactive control operation acting on a target interactive control.

[0151] The interactive control operation refers to a triggering operation on a target interactive control. For example, in this embodiment, interactive controls such as "character", "game achievement", "battle data" or "share to" can be added to the target file, and the user can click on the interactive control, thereby executing display operations such as viewing character information, viewing battle records, viewing game achievements, viewing battle statistics, etc. in response to the click operation, or executing a display operation of sharing the target file to a corresponding location.

[0152] In another implementation, in this embodiment, usage information of the electronic device may also be obtained, and the multimedia data content in the target file may be output in a target output manner based on the usage information.

[0153] Among them, the usage information of the electronic device may include: the user of the electronic device, the operating status of the electronic device, the device form of the electronic device and other information. In this embodiment, the corresponding multimedia data content in the target file can be output based on this usage information. For example, in this embodiment, a poster or highlight video in the target file can be displayed when the electronic device is in a dormant state or a locked screen state. For example, a game poster is displayed on the mobile phone desktop when the mobile phone is locked.

[0154] refer to Figure 5, is a structural diagram of a data processing device provided in the second embodiment of the present application, which can be deployed in an electronic device with data processing function, which can be a local terminal device or a cloud server, such as an application with data processing function running on the terminal device or a cloud service provided by a cloud server. The technical solution in this embodiment is mainly used to improve the sharing effect of the acquired shared files.

[0155] Specifically, the device in this embodiment may include the following units:

[0156] A data obtaining unit 501 is used to obtain operation data of a target user in a target application and application data of the target application;

[0157] A multimedia generating unit 502, configured to generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content;

[0158] The multimedia integration unit 503 is used to perform integration processing on the at least one type of multimedia data content corresponding to the target requirement to output a target file.

[0159] It can be seen from the above scheme that in a data processing device provided in Example 2 of the present application, based on the target demand, the target user's operation data in the target application and the application data of the target application are generated and processed, so that at least one type of multimedia data content can be obtained, and then these multimedia data contents are integrated according to the target demand, and the target file can be output. It can be seen that in this application, there will be no simple screenshots or screen recordings, but content generation based on the operation data and application data according to the target demand, so that after integration, a target file that better meets the demand can be obtained, thereby improving the integration of multimedia data content, and the target file obtained, so that when sharing these target files, the sharing effect can be better, thereby achieving the purpose of improving the file sharing effect in this application.

[0160] In one implementation, when the multimedia generation unit 502 generates and processes the operation data and the application data based on the target requirements, the steps include:

[0161] When the target requirement is a default requirement triggered when a target processing instruction of a target user is not obtained, performing video generation processing and / or image generation processing on the operation data and the application data;

[0162] In the case where the target requirement is a requirement generated based on a target processing instruction of a target user, performing a generation processing operation matching the target processing instruction on the operation data and the application data;

[0163] In a case where the target demand comes from a third-party content audience, video generation processing and / or text generation processing is performed on the operation data and the application data.

[0164] In one implementation, when the multimedia generation unit 502 performs the generation processing operation matching the target processing instruction on the operation data and the application data, it includes at least one of the following:

[0165] In response to obtaining a target trigger operation acting on the target application, generating the target processing instruction, and generating and processing the operation data and the application data using a target processing model matching the target processing instruction;

[0166] In response to obtaining a first trigger operation of a first type of control acting on a first type of application, generating the target processing instruction, and generating and processing the operation data and the application data using a target processing model matching the target processing instruction, wherein the first type of application is an application that can directly call the target processing model;

[0167] In response to obtaining the target interaction data in the second category application, the target processing instruction is generated, and the first category application calls the target processing model that matches the target processing instruction to generate and process the operation data and the application data. The second category application is an application that cannot directly call the target processing model.

[0168] In one implementation, when the multimedia generation unit 502 generates and processes the operation data and the application data using the target processing model matching the target processing instruction, the steps include:

[0169] In the case of obtaining the audio generation demand of the target user, inputting the operation data and the application data into an audio generation model that matches the audio generation instruction, so as to perform the audio generation operation using the audio generation model;

[0170] When the highlight moment generation requirement of the target user is obtained, identifying key image frames in the operation data and the application data to generate a highlight video using the key image frames;

[0171] In the case of obtaining the text generation demand of the target user, inputting the operation data and the application data into a text generation model that matches the text generation instruction, so as to perform a text generation operation using the text generation model;

[0172] When the image generation requirement of the target user is obtained, the operation data and the application data are input as prompt word data into an image generation model that matches the image generation instruction, so as to perform the image generation operation using the image generation model.

[0173] In one implementation, when the multimedia generation unit 502 inputs the operation data and the application data into an audio generation model that matches the audio generation instruction to perform the audio generation operation using the audio generation model, the multimedia generation unit 502 includes at least one of the following:

[0174] determining a psychological state of a target user based on the operation data and the application data, and configuring audio parameters of audio content generated based on the audio generation model based on the psychological state;

[0175] Using a text generation model to generate the operation data and the application data to obtain an audio text file, and using an audio generation model to perform audio generation processing on the audio text file, the operation data and the application data to obtain target audio content;

[0176] Attribute information of a target application is obtained, and an audio generation model is used to perform audio generation processing corresponding to the attribute information on the operation data and the application data to obtain target audio content.

[0177] In one implementation, when the multimedia generation unit 502 identifies the key image frames in the operation data and the application data to generate a highlight video using the key image frames, the steps include:

[0178] Identifying a target operation behavior in the operation data and a target object in the application data, and editing key image frames including the target operation behavior and / or the target object to obtain the highlight video;

[0179] The operation data and the application data are generated and processed by using a text generation model to obtain a text description file, and the text description file and the identified key image frame are edited to obtain the highlight video;

[0180] The operation data and the application data are generated and processed using a music generation model to obtain background music, and the background music and the identified key image frames are edited to obtain the highlight video.

[0181] In one implementation, when the multimedia generation unit 502 inputs the operation data and the application data as prompt word data into an image generation model that matches the image generation instruction to perform the image generation operation using the image generation model, the steps include at least one of the following:

[0182] Determine the role data of the target user based on the operation data and the application data, input the role data as prompt word data into the image generation model for generation processing, and obtain the target image content;

[0183] Using a text generation model to generate the operation data and the application data to obtain a text description file, and using an image generation model to generate an image of the text description file, the operation data and the application data to obtain target image content;

[0184] Attribute information of a target application is obtained, and an image generation model is used to perform image generation processing corresponding to the attribute information on the operation data and the application data to obtain target image content.

[0185] In one implementation, when the multimedia integration unit 503 performs integration processing on the at least one type of multimedia content corresponding to the target demand, at least one of the following is included:

[0186] Based on the target requirement, at least one of the target audio content, the highlight video, the target image content or the target text content generated based on the operation data and the application data is integrated into a target interface to obtain the target file, wherein the interfaces corresponding to different requirements are the same or different;

[0187] Determining display layout information of each multimedia data content based on the type of the multimedia data content and the interface parameters of the display interface, and integrating and processing the at least one type of multimedia data content based on the display layout information to obtain the target file;

[0188] Acquire a target connection element based on the multimedia data content, and use the target connection element to create an association relationship between the multimedia data content to obtain the target file;

[0189] The user portrait information of the target user is obtained, and the multimedia data content is integrated and processed based on the user portrait information to obtain the target file.

[0190] In one implementation, the multimedia integration unit 503 is further configured to add a target interactive control to the target file, so as to perform an operation of displaying target multimedia data content in response to an interactive control operation acting on the target interactive control;

[0191] In one implementation, the multimedia integration unit 503 is further configured to obtain usage information of the electronic device, and output the target multimedia data content in the target file in a target output manner based on the usage information.

[0192] It should be noted that the specific implementation of each unit in this embodiment can refer to the corresponding content in the previous text and will not be described in detail here.

[0193] refer to Figure 6, is a schematic diagram of the structure of an electronic device provided in Embodiment 3 of the present application, the electronic device may include at least one processor 601 and at least one processing model 602 capable of running on the processor 601, the processing model 602 can be called by a target application to execute at least one of the following:

[0194] Obtaining operation data of a target user in a target application and application data of the target application;

[0195] Generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content;

[0196] The at least one type of multimedia data content is integrated and processed corresponding to the target requirement to output a target file.

[0197] It can be seen from the above scheme that in an electronic device provided in Example 3 of the present application, based on the target demand, the target user's operation data in the target application and the application data of the target application are generated and processed, so that at least one type of multimedia data content can be obtained, and then these multimedia data contents are integrated according to the target demand, and the target file can be output. It can be seen that in this application, there will be no simple screenshots or screen recordings, but content generation based on operation data and application data according to target needs, so that after integration, a target file that better meets the needs can be obtained, thereby improving the integration of multimedia data content, and the target file obtained, so that when sharing these target files, a better sharing effect can be achieved, thereby achieving the purpose of improving the file sharing effect in this application.

[0198] Taking the game application in a mobile phone as an example, the technical solution of this application is illustrated as follows:

[0199] First, this application introduces AI technologies such as generative music, images, and video editing, combined with game data, to propose a new personalized game dynamic sharing interface. It solves the current problems of insufficient personalization, cumbersome generation, and weak interactivity, and proposes the following technical points:

[0200] 1. Generative music and lyrics: Generate personalized music through AI, and automatically generate relevant lyrics based on the player's game performance to enhance the theme and emotional expression of the music.

[0201] 2. Multimodal fusion: The generated personalized music, automatically edited highlight moment videos, dynamically generated game character posters and backgrounds are combined to form multimodal and dynamic display content. Compared with a single content sharing form, it greatly enriches the sharing effect.

[0202] 3. Enhanced interactivity: Users can not only display videos in the sharing interface, but also provide click and interactive functions, allowing other players to view game details, character information, player achievements and skills, etc., to enhance social interaction.

[0203] 4. Automated process and high customization: This application automatically generates music, videos and posters based on the player’s username, character, and game data, which reduces the user’s burden, achieves high customization, and users do not need to perform complex manual editing.

[0204] 5. Emotion-driven generation: This application can analyze players’ emotional expressions (such as victory, failure, fierce battles, etc.) and generate matching music styles and poster elements to make the shared content more appealing and immersive.

[0205] The advantages of this application are as follows:

[0206] (1) Highly personalized sharing content:

[0207] Differentiated experience: Generative AI technology is used to customize music, videos, posters and other sharing content for each player, avoiding the stereotyped sharing format. Whether it is generated music, automatically edited highlight videos, or character posters, they are all dynamically generated based on the player's game data and performance, showing a unique personality.

[0208] Enhance players' sense of achievement: Players can showcase their achievements and personalities in the game through unique music, videos, and posters. The generation of this exclusive content makes players more engaged and creates a sense of pride.

[0209] (2) Automation and intelligence:

[0210] Reduce operational burden: Traditional sharing methods usually require players to manually select video clips, add background music or edit pictures, while the technical solution of this application simplifies the operation through an automated process. This application can automatically identify exciting moments in the game and generate highly customized content, reducing the time investment and technical difficulty of players.

[0211] Intelligent analysis and recommendation: Through AI's in-depth analysis of player behavior and game data, this application can automatically extract players' highlights and best operations in the game, and automatically generate short videos and posters. There is no need for players to manually intervene, and the shared content is more accurate and enjoyable.

[0212] (3) Multimodal display enhances sharing effect:

[0213] Rich and colorful display forms: This application integrates multiple display forms such as music, video, pictures, text, etc. to form a multi-modal dynamic sharing interface. Compared with a single screenshot or short video, the comprehensive display form is easier to attract the audience's attention and improve the dissemination effect of the shared content.

[0214] Dynamic visual effects: By generating dynamic posters and character displays, the shared content is made more visually lively and attractive, enhancing the sense of interaction between users and viewers.

[0215] (4) Improved social interaction and communication:

[0216] Enhanced interactivity: Interactive elements are added to the shared content, such as clicking to view character details, combat data, game achievements, etc., so that other players can interact with the shared content at a deeper level. This interactive design greatly enhances the spread of shared content.

[0217] Improve social platform engagement: Highly personalized and visually rich shared content is more likely to attract attention and interaction on social platforms, such as likes, comments, and reposts. When other players see this content, they may also become interested in the game, promoting players' social interaction and the expansion of the game community.

[0218] (5) Emotionally driven immersive experience:

[0219] Emotional resonance and enhanced immersion: Through emotional analysis, the system can generate background music and lyrics that match the player's emotional state and game performance, enhancing the appeal and sense of immersion of the content. For example, the background music when a fierce battle is won will be passionate, while the music when a strategy game or puzzle game is completed will be more relaxing and soothing. This kind of emotion-driven content generation helps the audience resonate and stimulates their curiosity and desire to participate in the game content.

[0220] Show players’ emotions and game atmosphere: Emotional content not only shows the atmosphere of the game, but also reflects the emotional state of the players, making the shared content more vivid and story-telling.

[0221] like Figure 7 As shown in , it is a system architecture diagram of the technical solution of this application, in which:

[0222] The system architecture of this patent is based on user devices (front-end, such as PC, mobile phone, tablet browser, etc.) and game servers / clients (i.e. data sources, such as video operations and combat data), and can be divided into multiple modules. Each module operates independently and cooperates with each other to ultimately achieve the generation and display of personalized game dynamic sharing interfaces. The system architecture is divided into the following six main modules from the bottom-level data collection to the high-level user interaction, as follows:

[0223] (1) Data collection and analysis module:

[0224] Input: Real-time data during the game, including player actions, combat data, game events, game recordings, etc.

[0225] Function: Obtain the player's game data from the game server, client or local storage and perform preliminary analysis, such as the player's game operation, win-loss record, achievements, game recordings, etc.

[0226] Output: Structured and cleaned game data for use by subsequent modules.

[0227] (2) Generative AI Music Module:

[0228] Input: Player’s game data, including operation data (such as attack, skill release frequency), game character information, game situation data, etc.

[0229] Function: Generate personalized background music using generative AI, and adjust the music style, rhythm and theme according to the player's performance in the game.

[0230] Output: A personalized music file, i.e., a song, that matches the player's gaming process, and lyrics are generated to match the player's game character and situation.

[0231] (3) AI video editing module:

[0232] Input: Player's game recording data or replay data.

[0233] Function: Based on deep learning image processing and motion recognition technology, it analyzes video data, automatically identifies highlight moments (such as key kills, winning moments, use of special skills, etc.), and performs automatic editing.

[0234] Output: Automatically edited short video clips showing the player's wonderful moments, which are the highlight videos mentioned above.

[0235] (4) AI image generation module:

[0236] Input: Player's character data, game scene information, achievements and operation records.

[0237] Function: Based on generative image AI, a personalized poster showing the player's game character is generated, combining the player's character image, achievements and combat data to give the poster a unique personalized feature.

[0238] Output: Generated personalized poster showing player character, achievements, highlights, etc.

[0239] (5) Interface generation and integration module:

[0240] Input: Generated personalized music, clip videos, and posters.

[0241] Function: Integrate all generated content into a dynamic display interface, and design an interface with visual impact and interactivity. Through front-end technology, the interface supports dynamic element display.

[0242] Output: An integrated game sharing interface showing music, videos, and posters.

[0243] (6) Interactive function module:

[0244] Input: Player-generated shared content.

[0245] Function: Provide interactive functions for other users, such as viewing detailed game data, character information, battle records, likes and comments, etc. It also provides a sharing button so that users can share to social media with one click.

[0246] Output: Interactive interface, where users can click to view more game information, like, comment or share through social platforms or sharing channels.

[0247] like Figure 8 As shown in Figure 7 The schematic diagram of the process implemented by the system architecture shown in the figure shows that the implementation steps of this application cover everything from data collection to dynamic display of generated content. Each step has a clear process to ensure efficient operation. The details are as follows:

[0248] Step 801: Data collection and analysis:

[0249] Among them, data collection: the game server provides players' game data in real time through the application programming interface API (Application Programming Interface), including character information (name, image, equipment), combat data (skill usage, damage output, win and loss records) and game recordings.

[0250] The local client can also capture game data in real time and upload the data to the server or directly transmit it to the system's analysis module.

[0251] Data analysis: This application performs preliminary structured processing and analysis based on the acquired raw data. For example, key game nodes (such as victory, kill count, task completion) and emotional features (such as intense confrontation, emotional fluctuations of victory or failure) are extracted.

[0252] In addition, the present application can also analyze the emotional state of the player through a sentiment analysis model (such as BERT, etc.) to generate personalized sentiment data for subsequent music style adjustment.

[0253] Step 802: Generate personalized music:

[0254] Music generation input preparation: Use the player operation data obtained from the data acquisition module (such as player attacks, skill release frequency, and battle duration) as the input of the generative music AI. The system analyzes the player's game style (such as fast-paced, strategic, etc.) and generates background music of the corresponding style.

[0255] Music generation process: Generative AI technology is used to combine the player's data and game context to generate personalized music that matches the player's game context. At the same time, the generated lyrics or music themes are associated with the player's game plot, such as the player's character's name, achievements, etc.

[0256] Output music file: The generated background music file will be stored as part of the final shared content and used for interface display.

[0257] Step 803: Highlight moment video editing:

[0258] Video data preprocessing: This application obtains the player's game video or playback data and identifies key moments in the video based on the deep learning model. For example, this application can identify the player's key skill release, kill moment, task completion and other moments.

[0259] Highlight Moment Automatic Editing: This application automatically generates short videos based on the identified highlight moments. The editing process can use the timeline to crop the video and automatically add transition effects or subtitles (such as "The player completed a triple combo").

[0260] Output video clip: The final generated video is a 1-2 minute highlight clip that showcases the player's most exciting operations or achievements.

[0261] Step 804: Generate a personalized poster:

[0262] Image generation input preparation: Obtain the player's character information (such as character image, equipment, skills) from the data acquisition module, and combine the player's game achievements and combat performance to prepare input data for poster generation.

[0263] Personalized poster generation: Using a generative image model, this application generates a personalized poster based on the input player character data. The poster content can include the player character's dynamic image, battle scenes, and game background, and can display the player's achievements and operation statistics.

[0264] Output poster image: After the poster is generated, it will be used as part of the sharing interface to showcase the player's unique character image and achievements.

[0265] Step 805: Integrate dynamic sharing interface:

[0266] Interface design and integration: The system integrates the generated background music, video clips and posters into a unified dynamic sharing interface. Use modern front-end technology to dynamically display content.

[0267] Dynamic interface display: The interface can include the following elements: personalized music played in the background, automatically edited highlight moment videos displayed in the center, and posters showing the player's role with visual effects. The interface can also use animation or transition effects to enhance the visual impact.

[0268] Interaction design: The dynamic interface provides interactive functions, and users can click to view detailed game data, such as player character information, equipment, achievements, etc.

[0269] Step 806: Implement interactive functions:

[0270] Data display interaction: In the sharing interface, other users can view the player's detailed information (such as character attributes, game data, etc.) by clicking a button. These data are obtained in real time through the game API and displayed on the interface.

[0271] Like, comment and share functions: The interface has built-in like and comment buttons, and other players can evaluate the shared content. At the same time, it provides social media sharing functions, and shares the dynamics to mainstream platforms with one click.

[0272] An embodiment of the present application also provides a computer program product including computer-readable instructions. When the computer-readable instructions are executed on an electronic device, the electronic device implements any data processing method provided in the embodiment of the present application.

[0273] A computer-readable storage medium is also provided in an embodiment of the present application. The storage medium carries one or more computer programs. When the one or more computer programs are executed by an electronic device, the electronic device can implement any data processing method provided in the embodiment of the present application.

[0274] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the drawings of the device embodiments provided by the present application, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines.

[0275] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present application can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present application, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a ROM, a RAM, a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a training device, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0276] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product.

[0277] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website site, a computer, a training device, or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, training device, or data center. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device, a data center, etc. that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

Claims

1. A data processing method, comprising: Obtaining operation data of a target user in a target application and application data of the target application; Generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content; The at least one type of multimedia data content is integrated and processed corresponding to the target requirement to output a target file.

2. The method according to claim 1, wherein: Generating and processing the operation data and the application data based on target requirements includes at least one of the following: When the target requirement is a default requirement triggered when a target processing instruction of a target user is not obtained, performing video generation processing and / or image generation processing on the operation data and the application data; In the case where the target requirement is a requirement generated based on a target processing instruction of a target user, performing a generation processing operation matching the target processing instruction on the operation data and the application data; In a case where the target demand comes from a third-party content audience, video generation processing and / or text generation processing is performed on the operation data and the application data.

3. The method according to claim 2, wherein: Performing a generation processing operation matching the target processing instruction on the operation data and the application data includes at least one of the following: In response to obtaining a target trigger operation acting on the target application, generating the target processing instruction, and generating and processing the operation data and the application data using a target processing model matching the target processing instruction; In response to obtaining a first trigger operation of a first type of control acting on a first type of application, generating the target processing instruction, and generating and processing the operation data and the application data using a target processing model matching the target processing instruction, wherein the first type of application is an application that can directly call the target processing model; In response to obtaining the target interaction data in the second category application, the target processing instruction is generated, and the first category application calls the target processing model that matches the target processing instruction to generate and process the operation data and the application data. The second category application is an application that cannot directly call the target processing model.

4. The method according to claim 3, wherein: Generating and processing the operation data and the application data using a target processing model that matches the target processing instruction includes at least one of the following: In the case of obtaining the audio generation demand of the target user, inputting the operation data and the application data into an audio generation model that matches the audio generation instruction, so as to perform the audio generation operation using the audio generation model; When the highlight moment generation requirement of the target user is obtained, identifying key image frames in the operation data and the application data to generate a highlight video using the key image frames; In the case of obtaining the text generation demand of the target user, inputting the operation data and the application data into a text generation model that matches the text generation instruction, so as to perform a text generation operation using the text generation model; When the image generation requirement of the target user is obtained, the operation data and the application data are input as prompt word data into an image generation model that matches the image generation instruction, so as to perform the image generation operation using the image generation model.

5. The method according to claim 4, wherein: Inputting the operation data and the application data into an audio generation model that matches the audio generation instruction to perform an audio generation operation using the audio generation model includes at least one of the following: determining a psychological state of a target user based on the operation data and the application data, and configuring audio parameters of audio content generated based on the audio generation model based on the psychological state; Using a text generation model to generate the operation data and the application data to obtain an audio text file, and using an audio generation model to perform audio generation processing on the audio text file, the operation data and the application data to obtain target audio content; Attribute information of a target application is obtained, and an audio generation model is used to perform audio generation processing corresponding to the attribute information on the operation data and the application data to obtain target audio content.

6. The method according to claim 4, wherein: Identifying key image frames in the operation data and the application data to generate a highlight video using the key image frames includes at least one of the following: Identifying a target operation behavior in the operation data and a target object in the application data, and editing key image frames including the target operation behavior and / or the target object to obtain the highlight video; The operation data and the application data are generated and processed by using a text generation model to obtain a text description file, and the text description file and the identified key image frame are edited to obtain the highlight video; The operation data and the application data are generated and processed using a music generation model to obtain background music, and the background music and the identified key image frames are edited to obtain the highlight video.

7. The method according to claim 4, wherein: Inputting the operation data and the application data as prompt word data into an image generation model that matches the image generation instruction, so as to perform an image generation operation using the image generation model, includes at least one of the following: Determine the role data of the target user based on the operation data and the application data, input the role data as prompt word data into the image generation model for generation processing, and obtain the target image content; Using a text generation model to generate the operation data and the application data to obtain a text description file, and using an image generation model to generate an image of the text description file, the operation data and the application data to obtain target image content; Attribute information of a target application is obtained, and an image generation model is used to perform image generation processing corresponding to the attribute information on the operation data and the application data to obtain target image content.

8. The method according to claim 1, wherein: The at least one type of multimedia content is integrated and processed corresponding to the target demand, including at least one of the following: Based on the target requirement, at least one of the target audio content, the highlight video, the target image content or the target text content generated based on the operation data and the application data is integrated into a target interface to obtain the target file, wherein the interfaces corresponding to different requirements are the same or different; Determining display layout information of each multimedia data content based on the type of the multimedia data content and the interface parameters of the display interface, and integrating and processing the at least one type of multimedia data content based on the display layout information to obtain the target file; Acquire a target connection element based on the multimedia data content, and use the target connection element to create an association relationship between the multimedia data content to obtain the target file; The user portrait information of the target user is obtained, and the multimedia data content is integrated and processed based on the user portrait information to obtain the target file.

9. The method according to claim 1, further comprising at least one of the following: Adding a target interactive control in the target file to perform an operation of displaying target multimedia data content in response to an interactive control operation acting on the target interactive control; The usage information of the electronic device is obtained, and the target multimedia data content in the target file is output in a target output manner based on the usage information.

10. An electronic device comprising at least one processor and at least one processing model capable of running on the processor, wherein the processing model can be called by a target application to perform at least one of the following: Obtaining operation data of a target user in a target application and application data of the target application; Generate and process the operation data and the application data based on target requirements to obtain at least one type of multimedia data content; The at least one type of multimedia data content is integrated and processed corresponding to the target requirement to output a target file.

Images