Data processing method and device and computer program product

Abstract

The invention provides a data processing method and device, electronic equipment, a storage medium and a computer program product, relates to the technical field of artificial intelligence, in particular to the technical fields of large models, image processing, natural language understanding and the like, and can be applied to a data fusion scene. According to the specific implementation scheme, a plurality of target images are obtained based on a data uploading control in a first display interface; in response to the identified multiple main body objects in the multiple target images, displaying the multiple main body objects through multiple object display controls in one-to-one correspondence with the multiple main body objects in the second display interface; and in response to the obtained fused data corresponding to the main body objects, displaying the fused data. The data processing mode is enriched, and the data processing requirement of the user is met to a certain degree.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, specifically to technical fields such as large models, image processing, and natural language understanding, and in particular to a data processing method, device, electronic device, storage medium, and computer program product, which can be applied in data fusion scenarios. Background Art

[0002] With the popularity of smart phones, people have higher and higher demands for personalized processing of image and other data. At present, the image processing method cannot meet the needs of users. Summary of the invention

[0003] The present disclosure provides a data processing method, apparatus, electronic device, storage medium, and computer program product.

[0004] According to a first aspect, a data processing method is provided, including: acquiring multiple target images based on a data upload control in a first display interface; in response to identifying multiple subject objects in the multiple target images, displaying the multiple subject objects through multiple object display controls in a second display interface that correspond one-to-one to the multiple subject objects; in response to obtaining fused data corresponding to the multiple subject objects, displaying the fused data.

[0005] According to a second aspect, a data processing method is provided, including: identifying multiple main objects in multiple target images, wherein the multiple target images are obtained based on a data upload control in a first display interface of a terminal device, and the multiple main objects are displayed based on multiple object display controls in a second display interface of the terminal device; and fusing the multiple main objects to obtain fused data.

[0006] According to a third aspect, a data processing device is provided, including: a data acquisition unit, configured to acquire multiple target images based on a data upload control in a first display interface; an object display unit, configured to display the multiple subject objects in response to identifying multiple subject objects in the multiple target images through multiple object display controls in a second display interface that correspond one-to-one to the multiple subject objects; and a data display unit, configured to display the fused data in response to obtaining fused data corresponding to the multiple subject objects.

[0007] According to a fourth aspect, a data processing device is provided, including: an object recognition unit, configured to recognize multiple main objects in multiple target images, wherein the multiple target images are obtained based on a data upload control in a first display interface of a terminal device, and the multiple main objects are displayed based on multiple object display controls in a second display interface of the terminal device; and a data fusion unit, configured to fuse the multiple main objects to obtain fused data.

[0008] According to the fifth aspect, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in any implementation of the first aspect or the second aspect.

[0009] According to a sixth aspect, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause a computer to execute the method described in any implementation of the first aspect or the second aspect.

[0010] According to a seventh aspect, a computer program product is provided, comprising: a computer program, which implements the method described in any implementation of the first aspect or the second aspect when executed by a processor.

[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0013] Figure 1 is an exemplary system architecture diagram in which an embodiment of the present disclosure may be applied;

[0014] Figure 2 is a flow chart of an embodiment of a data processing method according to the present disclosure;

[0015] Figure 3 A schematic diagram showing generation of fused data in image form according to this embodiment. ;

[0016] Figure 4 is a schematic diagram of an application scenario of the data processing method according to this embodiment;

[0017] Figure 5 is a schematic diagram of a fifth display interface according to this embodiment;

[0018] Figure 6 is a schematic diagram of a fourth display interface according to this embodiment;

[0019] Figure 7 is a schematic diagram of a sixth display interface according to this embodiment;

[0020] Figure 8 is another interface schematic diagram of the second display interface according to this embodiment;

[0021] Fig. 9 is a schematic diagram of the first display interface according to this embodiment.

[0022] Fig.10 is a flow chart of another embodiment of a data processing method according to the present disclosure;

[0023] Fig.11 is a flow chart of another embodiment of a data processing method according to the present disclosure;

[0024] Fig.12 is a flow chart of another embodiment of a data processing method according to the present disclosure;

[0025] Fig.13 is a structural diagram of an embodiment of a data processing device according to the present disclosure;

[0026] Fig.14 is a structural diagram of an embodiment of a data processing device according to the present disclosure;

[0027] Fig.15 It is a schematic diagram of the structure of a computer system suitable for implementing the embodiments of the present disclosure. DETAILED DESCRIPTION

[0028] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0029] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0030] Figure 1 An exemplary architecture 100 to which the data processing method and apparatus of the present disclosure can be applied is shown.

[0031] like Figure 1 As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The communication connection between the terminal devices 101, 102, 103 constitutes a topological network, and the network 104 is used to provide a medium for the communication link between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0032] Terminal devices 101, 102, 103 may be hardware devices or software that support network connection for data interaction and data processing. When terminal devices 101, 102, 103 are hardware, they may be various electronic devices that support network connection, information acquisition, interaction, display, processing and other functions, including but not limited to smart phones, tablet computers, e-book readers, laptop computers and desktop computers, etc. When terminal devices 101, 102, 103 are software, they may be installed in the electronic devices listed above. They may be implemented as multiple software or software modules for providing distributed services, or they may be implemented as a single software or software module. No specific limitation is made here.

[0033] The server 105 may be a server that provides various services, for example, a background processing server that obtains multiple target images uploaded by the terminal devices 101, 102, and 103, identifies multiple subject objects in the multiple target images, and fuses the multiple subject objects to obtain fused data. As an example, the server 105 may be a cloud server.

[0034] It should be noted that the server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server is software, it can be implemented as multiple software or software modules (for example, software or software modules used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0035] It should also be noted that the data processing method provided in the embodiments of the present disclosure includes a data processing method on the terminal device side, which is generally executed by the terminal device, and also includes a data processing method on the server side, which is generally executed by the server. Accordingly, the various parts (such as various units) included in the data processing device on the terminal device side can all be set in the terminal device, and the various parts (such as various units) included in the data processing device on the server side can all be set in the server.

[0036] It should be understood that Figure 1 The number of terminal devices, networks, and servers in the system architecture is only illustrative. Depending on the implementation requirements, there may be any number of terminal devices, networks, and servers. When the electronic device on which the data processing method is running does not need to transmit data with other electronic devices, the system architecture may only include the electronic device (e.g., terminal device or server) on which the data processing method is running.

[0037] Please refer to Figure 2 , Figure 2 A flowchart of a data processing method provided by an embodiment of the present disclosure. In process 200, the following steps are included:

[0038] Step 201: Acquire multiple target images based on the data upload control in the first display interface.

[0039] In this embodiment, the execution subject of the data processing method (for example, Figure 1 The terminal device in the first display interface can obtain multiple target images based on the data upload control in the first display interface.

[0040] The first display interface is an interface that can be used to obtain data in a data processing application. The first display interface includes a data upload control. A control is an element in a graphical user interface that is used to implement user interaction and display information. In software development, controls are typically used to build an application's user interface, enabling users to input data, view information, or perform specific operations. In this embodiment, depending on the different functions of the control, the control can be presented in different forms such as a button, a text box, a multi-line text box, a drop-down list, a picture box, a progress bar, etc. The data processing application can be various types of applications with data processing requirements, such as image processing applications, e-commerce applications, and data recommendation applications.

[0041] Based on the user's triggering operation on the data upload control, multiple target images specified by the user can be obtained.

[0042] As an example, in response to receiving a trigger operation of a data upload control by a user, images in the local image library of the above-mentioned execution subject can be displayed to the user, and multiple images in the image library are displayed in the display interface through multiple image display controls, and the user can select multiple target images from the image library based on selection methods such as clicking and circling. At the same time, the above-mentioned execution subject can also display a search portal for network images to the user, and the user enters the search interface for network images through the search portal. In the search interface, the user can use image search methods such as keyword search and image search to retrieve images from the Internet and select multiple target images from them.

[0043] The triggering operation on the data upload control, as well as the triggering operations on other controls in subsequent embodiments, can be any operation that represents the user's selection of the data upload control, such as an action instruction such as clicking or touching the data upload control or a voice instruction.

[0044] After acquiring the multiple target images, the execution subject may upload the multiple target images to the server.

[0045] Step 202 : in response to identifying a plurality of subject objects in a plurality of target images, displaying the plurality of subject objects through a plurality of object display controls corresponding one-to-one to the plurality of subject objects in a second display interface.

[0046] In this embodiment, in response to identifying multiple subject objects in multiple target images, the execution subject displays the multiple subject objects through multiple object display controls corresponding to the multiple subject objects in the second display interface.

[0047] When the execution subject has object recognition function and corresponding computing power, multiple subject objects in multiple target images can be recognized locally by the execution subject; otherwise, the server recognizes the subject object in each of the multiple target images in turn, thereby obtaining multiple subject objects. The subject object is generally the most dominant and eye-catching part of the image, and is also the main content and focus of the image. The subject object can be diverse, including but not limited to people, animals, plants, buildings, objects, natural landscapes, environments, etc.

[0048] As an example, the main object in the target image can be determined based on the following factors:

[0049] Size and position: The main subject often takes up a large space in the image or is located in the center or prominent position of the image.

[0050] Color and contrast: The main object may contrast in color with the rest of the design, or have a brighter, more eye-catching color.

[0051] Shape and texture: A subject object may have a unique shape or texture that distinguishes it from other parts.

[0052] Composition and focus: The way an image is composed (such as the rule of thirds, symmetrical composition, etc.) and the focus setting (such as shallow depth of field effect) will also affect the recognition of the main object.

[0053] Content and background: The difference in content between the subject and the background is also an important factor in judging the subject. The background usually serves to set off the subject, while the subject is the core content of the image.

[0054] As another example, a pre-trained subject object recognition model is set in the above-mentioned execution subject or server, and each target image in multiple target images is input into the subject object recognition model in the server to determine the subject object in each target image. The subject object recognition model can be a one-stage target detection model, such as an SSD (Single Shot multibox-Detector) model or a YOLO (You Only Look Once) model; or a two-stage target detection model, such as an R-CNN (Region-based Convolutional Neural Networks) model or an SPPNet (Spatial Pyramid Pooling Convolutional Networks) model.

[0055] After the execution subject or the server identifies multiple subject objects, the execution subject displays a second display interface to the user. The second display interface is used to display multiple subject objects, including multiple object display controls, and there is a one-to-one correspondence between the multiple object display controls and the multiple subject objects, and each object display control in the multiple object display controls displays the corresponding subject object. The object display control can be overlaid on the image display control, and the subject object can be displayed by highlighting or other highlighting methods, and its display effect is to highlight the subject object on the target image; it can also be independent of (not overlaid on) the image display control, and its display effect is to display the segmented subject object.

[0056] Each object display control occupies a portion of the display area of ​​the second display interface. The sizes of the areas corresponding to different object display controls can be the same or different. For example, for different main objects, the size of the corresponding object display control is set specifically according to the size of the main object to clearly display the main object.

[0057] Step 203: in response to obtaining the fused data corresponding to the plurality of subject objects, displaying the fused data.

[0058] In this embodiment, the execution subject may display the fused data in response to obtaining the fused data corresponding to the multiple subject objects. The fused data is obtained by fusion of the multiple subject objects and may be data in various forms, such as images, videos, etc.

[0059] When the execution subject has the object fusion function and the corresponding computing power, multiple subject objects can be fused locally on the execution subject to obtain fused data; otherwise, multiple subject objects can be fused through the server to obtain fused data.

[0060] Taking the fused data in the form of images as an example, first, the AI ​​(Artificial Intelligence) text generation model is called to generate guide text related to multiple subject objects according to multiple subject objects, which is used to guide the generation process of the fused data. The AI ​​text generation model is, for example, the BLIP (Bootstrapping Language-Image Pre-training) model, which realizes efficient image-to-text function by fusing ViT (Vision Transformer) and LLM (Large Language Model). BLIP can generate accurate and vivid descriptive text directly from pictures through zero-sample learning without relying on additional labeled data.

[0061] The object images and guide texts corresponding to the multiple subject objects are used as the input of the Control Net model to generate a fused image. Specifically, the Control Net model extracts features from the object image and the guide text respectively to generate the corresponding feature vectors; then, the extracted image features and text features are fused to generate a joint feature vector containing the information of the multiple object images and the guide text; then, the joint feature vector is used as input to generate the fused data through the decoder of the Control Net model.

[0062] Continue to refer Figure 3 , which shows a schematic diagram of generating fused data in image form.

[0063] In the scene of generating advertisement images of items, the multiple main objects in the multiple target images are Barcelona chairs, indoor environments, and green plants. The three main objects are fused to obtain a fused image representing the indoor environment including Barcelona chairs and the outdoor environment including green plants. The fused image is used as the advertisement image of the Barcelona chair.

[0064] Taking the fused data in the form of video as an example, first, the AI ​​text generation model is called to generate multiple guide texts related to multiple subject objects according to multiple subject objects, which are used to guide the generation process of the fused data. Each of the multiple guide texts is used to guide the Control Net model to generate a video frame. Then, the object images corresponding to each of the multiple target objects and each of the multiple guide texts are used as the input of the Control Net model to generate a video frame; finally, multiple video frames corresponding to the multiple guide texts are combined to generate the fused data.

[0065] For example, the fused data in video form includes live video, explanation video, etc.

[0066] Taking live video as an example, multiple subject objects include people, clothing, and scenic spots, and a live video is generated in which the above-mentioned people are wearing the above-mentioned clothing, with the above-mentioned scenic spots as the background of the live broadcast room. For another example, the subject objects also include beauty products. In the generated live video, the above-mentioned people are wearing the above-mentioned clothing, using the makeup effect of the above-mentioned beauty products, and the above-mentioned scenic spots are used as the background of the live broadcast room.

[0067] For another example, the plurality of subject objects include an IP (Intellectual Property) image, clothing, and a scenic spot, and a video is generated in which the IP image explains the scenic spot while wearing the clothing.

[0068] In order to further improve the accuracy of the generated fused data, the execution entity may obtain a user guidance text, which may also guide the generation process of the fused data, and may be, for example, a description text of layout, display effect, etc. During the data fusion process, the execution entity or the server may perform fusion according to the layout in the user guidance text to achieve the display effect desired by the user.

[0069] In this embodiment, the server can determine whether to generate fused data in the form of an image or fused data in the form of a video based on factors such as the number and type of multiple target objects. For example, the corresponding relationship between the type set composed of the object types of multiple target objects and the data type (image, video) of the fused data can be preset. After determining the type set composed of the object types of multiple target objects, the data type of the fused data to be generated corresponding to the type set is determined based on the corresponding relationship, and then the multiple target objects are fused to obtain fused data of the above data types.

[0070] In this embodiment, the second display interface may also include a video indication control for indicating the generation of fused data in video form and an image indication control for indicating the generation of fused data in image form, and then generate fused data of the corresponding data type based on the user's triggering operation on the video indication control or the image indication control.

[0071] In this embodiment, the execution subject or server may fuse multiple subject objects to obtain one or more fused data. After obtaining the fused data, the execution subject may display the fused data.

[0072] As an example, in response to obtaining the fused data, the execution subject displays a data display interface to the target user, and displays the fused data through a data display control in the data display interface.

[0073] In some examples, data display controls may also be provided in the first and second display interfaces to display the fused data. For example, the first display interface includes not only a data upload control but also a data display control, and the data display control is used to display the fused data.

[0074] After obtaining the fused data, the execution host may execute the above steps 201-203 again based on the received operation to obtain another fused data or multiple fused data. The data types of the fused data generated in different rounds may be the same or different.

[0075] Continue to see Figure 4 , Figure 4 4 is a schematic diagram of an application scenario 400 of the data processing method according to the present embodiment. First, the terminal device 401 obtains multiple target images based on the data upload control in the first display interface, and uploads the multiple target images to the server 402; the server identifies multiple main objects in the multiple target images, specifically Barcelona chairs, indoor environments and green plants, and feeds back the results to the terminal device; the terminal device displays the multiple main objects through multiple object display controls corresponding to the multiple main objects in the second display interface; the server fuses the multiple main objects to obtain fused data, which represents that the indoor environment includes Barcelona chairs and the outdoor environment is green plants, and feeds back the fused data to the terminal device; the terminal device displays the fused data through the data display control in the first display interface.

[0076] In this embodiment, a data processing method is provided to identify and display multiple main objects in multiple target images uploaded by users, and then fuse the multiple objects to obtain and display fused data, which enriches the data processing method, improves the display effect and information volume of the fused data, and meets the user's data processing needs to a certain extent.

[0077] In some optional implementations of this embodiment, the execution subject may perform step 201 in the following manner:

[0078] First, based on the triggering operation on the data upload control, the third display interface is displayed.

[0079] The third display interface includes an image display area and an audio display area, wherein the plurality of first image display controls in the image display area display respective corresponding images, and the plurality of audio display controls in the audio area display respective corresponding audio. Generally, the displayed images and audio are local data.

[0080] The third display interface is divided into an image display area and an audio display area distributed vertically or horizontally. In the image display area and the audio display area, the user can display different data through sliding operations.

[0081] At the same time, in the image display area, the above-mentioned execution entity can also display the search entrance of network images to the user, and the network image search interface can be entered through the search entrance. In the search interface, the user can use image search methods such as keyword search and image search to retrieve images from the Internet. In the audio display area, the above-mentioned execution entity can also display the search entrance of network audio to the user, and the network audio search interface can be entered through the search entrance. In the search interface, the user can use audio search methods such as keyword search to retrieve audio from the Internet.

[0082] Then, based on the triggering operation on the plurality of target image display controls in the plurality of first image display controls, a plurality of target images are determined.

[0083] In this implementation, the above-mentioned execution subject can also determine multiple target objects according to the triggering operation of the user in the search interface.

[0084] Finally, based on the trigger operation on the target audio display control among the multiple audio display controls, the target audio is determined.

[0085] In this implementation, the above-mentioned execution entity can also determine the target audio according to the trigger operation of the user in the search interface.

[0086] In this implementation, a specific method for obtaining the data to be fused is provided. Based on the data upload control, data of different modes can be uploaded, which can provide rich data to be fused and help improve the content richness and display effect of the generated data to be fused.

[0087] In some implementations, the third display interface may include multiple data upload controls, such as an image upload control and an audio upload control, and different data upload controls are used to upload data in different modes. After the image upload control is triggered, the execution subject displays the image display interface; after the audio upload control is triggered, the execution subject displays the audio display interface.

[0088] In some optional implementations of this embodiment, the execution subject may perform step 203 in the following manner: in response to obtaining fused data corresponding to the fused video and the target audio, display the fused data.

[0089] The fused video is generated based on the fusion of multiple main objects.

[0090] In this implementation, the execution subject may refer to the above-mentioned example of generating fused data in video form, fuse multiple subject objects, and generate a fused video, which will not be described in detail here.

[0091] After obtaining the fused video, the execution entity or server may further combine the fused video and the target audio to obtain fused data in the form of audio and video.

[0092] As an example, first, parse the fused video and the target video. Read the video file and extract the video frame. Video frames are usually stored in the form of image sequences, and each frame contains timestamp information. Read the audio file and extract the audio sample. Audio samples are usually stored in the form of time series, and each sample has timestamp information. Then, perform time synchronization of audio and video. Align the time axis of the video frame and audio sample. Make sure that the timestamp of the video frame matches the timestamp of the audio sample so that they can be synchronized during synthesis. Mark key synchronization points in the video frame and audio sample, such as the key frame of the video and the beat point of the audio, to ensure accurate synchronization. Then, perform video encoding. Select an appropriate video codec (such as H.264, H.265, etc.) to re-encode the video frame. The balance between video quality and file size needs to be considered during the encoding process. Select a suitable multimedia container format (such as MP4, AVI, MKV, etc.) to encapsulate the video stream and audio stream together. Finally, generate the fused data. Multiplex the encoded video stream and audio stream (Muxing) to generate a complete multimedia file containing video and audio.

[0093] In this implementation, the fused data is audio and video data, and the fused video and target audio formed by the fusion of multiple main objects are combined to further improve the information richness and display effect of the fused data.

[0094] In some optional implementations of this embodiment, the above execution subject may also perform the following operations:

[0095] First, a video frame sequence corresponding to the fused video is displayed through a sequence display control in the fifth display interface; then, a video frame adjustment operation for the sequence display control is obtained.

[0096] Continue to refer Figure 5 , showing an interface schematic diagram of the fifth display interface.

[0097] In the fusion process of the data to be fused in the form of audio and video, in response to generating the fused video, the execution subject displays the fifth display interface. The fifth display interface is a display interface of the fused video, which includes a video display control 501. After the user triggers the video display control, the execution subject can play the fused video in the video display control. The user can flexibly view the fused video based on operations such as pausing, fast forwarding, and rewinding the video display control.

[0098] The fifth display interface also includes a sequence display control 502. The user can display different parts of the video frame sequence based on the sliding operation of the sequence display control; for the target part currently displayed in the sequence display control, the above-mentioned execution subject can issue a video frame adjustment operation to it. The video frame adjustment operation includes but is not limited to a video frame deletion operation, a video frame supplementation operation, and a video frame exchange operation.

[0099] In a convenient implementation, the user can delete and supplement video frames based on a pinch operation. Specifically, multiple video frames between the video frames touched by the user's two fingers are used as the video segment to be operated. In response to the decrease in the distance between the user's two fingers, at least part of the video frames in the video segment are reduced, for example, all the video frames in the video segment are deleted, or one video frame is reduced every preset number of frames; in response to the increase in the distance between the user's two fingers, the video frames in the video segment are increased, for example, one or more video frames are added between adjacent video frames in the video segment. Specifically, in order to improve the clarity and continuity of the fused video, an intermediate video frame can be added between adjacent video frames.

[0100] In some examples, the sequence display control may also be provided in a separate display interface to display the video frame sequence through a larger display area, so as to flexibly and conveniently adjust the video frame sequence.

[0101] In this implementation, the execution subject may perform step 203 in the following manner: in response to obtaining the fused data corresponding to the adjusted video and the target audio, display the fused data. The adjusted video is obtained by adjusting the video frame sequence according to the video frame adjustment operation.

[0102] In this implementation, the above-mentioned execution entity or server can refer to the above-mentioned specific implementation method of "combining the fused video and the target audio to obtain fused data" to combine the adjusted video and the target audio, which will not be repeated here.

[0103] In this implementation, in the process of generating fused data in audio and video form, the user can process the fused video, which helps to further improve the accuracy of the fused data and meet the user's data processing needs.

[0104] In some optional implementations of this embodiment, the above-mentioned execution entity may also perform the following operations: first, display the audio properties of the target audio through the audio property display control in the fourth display interface; then, obtain the property adjustment operation for the audio property display control, and / or, based on the user audio collected by the recording control in the fourth display interface; then, in response to obtaining the adjusted audio, display the audio properties of the adjusted audio through the audio property display control.

[0105] The adjusted audio is obtained by adjusting the audio attributes of the target audio according to the attribute adjustment operation and / or the audio attributes of the user audio.

[0106] Continue to refer Figure 6 , showing an interface schematic diagram of the fourth display interface.

[0107] After the target audio is obtained based on the third display interface, the fourth display interface may be displayed. The fourth display interface includes an audio attribute display control 601 and a recording control 602. The audio attribute display control 601 is used to display audio attributes such as timbre, pitch, and duration of the target audio.

[0108] The user can perform a property adjustment operation on the audio property display control, and the property adjustment operation can adjust at least one audio property of the target audio, such as a swipe up operation to increase the pitch and a swipe down operation to decrease the pitch.

[0109] The user can also trigger the recording control, and the above-mentioned execution subject can collect the user's voice, obtain the user's recording, and analyze the user's recording to determine its audio properties; then, the audio properties of the target audio are adjusted to be consistent or similar to the audio data of the user's audio. Among them, the above-mentioned execution subject can instruct the user to read aloud the specified text content to obtain the target audio, or it can obtain the user audio based on the user's random pronunciation.

[0110] In some implementations, the execution subject may also process the target audio in combination with the above two methods. For example, first, the user recording of the user is collected and analyzed to determine its audio attributes; then, the audio attributes of the target audio are adjusted to be consistent or similar to the audio data of the user audio; finally, the user further adjusts the target audio based on the attribute adjustment operation to obtain the adjusted audio.

[0111] In this implementation, the execution subject may perform step 203 in the following manner: in response to obtaining the fused data corresponding to the fused video and the adjusted audio, display the fused data.

[0112] In this implementation, the above-mentioned execution entity or server can refer to the above-mentioned specific implementation method of "combining the fused video and the target audio to obtain fused data" to combine the adjusted video and the target audio, which will not be repeated here.

[0113] In this implementation, during the process of generating fused data in audio and video form, the user can process the target audio, which helps to further improve the accuracy of the fused data and meet the user's data processing needs.

[0114] In some optional implementations of this embodiment, the execution subject may perform step 203 in the following manner:

[0115] In response to obtaining fused data corresponding to the adjusted video and the adjusted audio, the fused data is displayed, wherein the adjusted video is obtained by adjusting the video frame sequence according to the video frame adjustment operation, and the adjusted audio is obtained by adjusting the audio attributes of the target audio according to the attribute adjustment operation and / or the audio attributes of the user audio.

[0116] As an example, first, after the above-mentioned execution subject determines the target image and the target audio based on the image display control and the audio display control in the third display interface, the fourth display interface is displayed. The audio attribute display control in the fourth display interface displays the audio attributes of the target audio. At the same time, multiple target images are uploaded to the server to identify and fuse multiple subject objects to obtain a fused video. Then, the above-mentioned execution subject obtains the attribute adjustment operation for the audio attribute display control and / or collects the user audio of the target user based on the recording control, and then adjusts the audio attributes of the target audio according to the attribute adjustment operation and / or the audio attributes of the user audio through the server to obtain the adjusted audio. The adjusted audio can display its attribute information through the audio attribute display control. Then, in response to the user's approval (for example, the user clicks the "Finish" button on the fourth display interface that represents the completion of the adjustment process of the target audio) of the adjusted audio, the above-mentioned execution subject displays the fifth display interface to the user, and displays the fused video based on the video display control in the fifth reality interface, and displays the video frame sequence of the fused video based on the sequence display control. Then, based on the video frame adjustment operation of the sequence display control, the server obtains the adjusted video and displays the adjusted video through the video display control. The server combines the adjusted video and the adjusted audio to obtain fused data. Finally, the above-mentioned execution subject displays the fused data. For example, the fused data is displayed through other display interfaces other than the first to fifth display interfaces; for another example, a data display control is set in one of the first to fifth display interfaces, and the fused data is displayed through the data display control.

[0117] In this implementation, before generating the fused data in audio and video form, the user can process the target audio and the fused video to meet the user's needs, which helps to further improve the accuracy of the fused data and meet the user's data processing needs.

[0118] In some optional implementations of the present embodiment, the above-mentioned execution subject may also perform the following operations: first, display the fused image through at least one second image display control in the sixth display interface that corresponds one-to-one to at least one fused image, wherein the at least one fused image is obtained by fusing multiple main objects based on at least one layout method; and then, obtain an object adjustment operation for a target display control in at least one second image display control.

[0119] As an example, the server may determine multiple layout methods between multiple target subject objects, and then use multiple layout methods to fuse the multiple subject objects respectively to obtain multiple fused images. Among them, in different layout methods, the spatial distribution, interactive relationship, and overall composition of the multiple target subject objects are different. Specifically, the layout methods include but are not limited to the following layout methods, as well as new layout methods obtained by combining different layout methods:

[0120] Balanced distribution layout: In a balanced distribution layout, multiple main objects are evenly distributed in the image.

[0121] Center-focus layout: Center-focus layout means taking one or some of the multiple main objects as the focus and placing them in the center of the image, while other main objects are distributed around the focus.

[0122] Hierarchical distribution layout: Hierarchical distribution layout means arranging multiple main objects according to different levels to form an image with a sense of hierarchy.

[0123] Diagonal layout: Diagonal layout means arranging multiple main objects along the diagonal line of the image.

[0124] Free distribution layout: Free distribution layout means that multiple main objects are arranged freely in the image without following any fixed rules or patterns.

[0125] Interaction relationship layout: Interaction relationship layout refers to the layout design based on the interaction relationship between the main objects.

[0126] Overall composition layout: Overall composition layout refers to the composition design of multiple main objects as a whole.

[0127] As an example, first, multiple fused images are displayed through multiple second image display controls in the sixth display interface that correspond one-to-one to the multiple initial fused images; then, an object adjustment operation for a target display control among the multiple second image display controls is obtained; finally, through the server, according to the object adjustment operation, the position, attributes and other information of the main object in the fused image in the target display control are adjusted to obtain the adjusted fused image.

[0128] Continue to refer Figure 7 , showing an interface schematic diagram of the sixth display interface.

[0129] The sixth display interface includes a plurality of second image display controls 701, each of which is used to display a fused image. The user can perform an object adjustment operation on any of the second image display controls, thereby adjusting the fused image therein to obtain fused data.

[0130] The object adjustment operation includes, for example, an object position adjustment operation, an object replacement operation, an object style adjustment operation, and an object attribute adjustment operation. For example, a user can select and replace an object by clicking, circling, dragging, etc., and adjust the attributes of an object by graffiti, marking, etc.

[0131] In this implementation, the execution subject may perform step 203 in the following manner: using the adjusted fused image as fused data and displaying the fused data.

[0132] In this implementation, the user can make object adjustments to the initial fused image generated by fusion, which improves the operational convenience of the data processing process and helps to further meet the user's data processing needs.

[0133] In some optional implementations of this embodiment, the execution subject may perform step 202 in the following manner:

[0134] First, in response to identifying multiple candidate subject objects in multiple target images, multiple subject objects are displayed through multiple object display controls corresponding to the multiple candidate subject objects in the second display interface. Then, based on triggering operations on multiple target object display controls in the multiple object display controls, multiple subject objects are determined from the multiple candidate subject objects.

[0135] Continue to refer Figure 8 , showing an interface schematic diagram of the second display interface.

[0136] In this implementation, each target image may include at least one candidate subject object. Based on a trigger operation on multiple target object display controls in the multiple object display controls, the user can determine multiple subject objects corresponding to the multiple target object display controls from the multiple candidate subject objects.

[0137] It should be noted that, no matter the fused data is in the form of images or in the form of audio or video, the user can perform the selection operation on the candidate subject objects in the above manner before data fusion.

[0138] In this implementation, fused data can be generated based on the main object selected by the user, which further improves the flexibility of the data processing process, helps to further improve the accuracy of the fused data, and meets the user's data processing needs.

[0139] In some optional implementations of this embodiment, the execution subject may further perform the following operation: in response to obtaining the target geographic location, display the target geographic location through a location display control.

[0140] The method for determining the target geographic location includes at least one of the following:

[0141] 1. Determine the target geographic location based on the location subject object representing the geographic location among multiple subject objects.

[0142] As an example, the server can extract feature data of each subject object and compare the object feature data of each subject object with the image feature data of the environmental image of each geographic location; in response to the feature distance between the object feature data and the image feature data being less than a preset threshold, the object feature data is determined as the location subject object, and the geographic location corresponding to the image feature data is determined as the target geographic location.

[0143] 2. Determine the geographic location specified by the target user as the target geographic location.

[0144] As an example, a user can specify a target geographic location in an electronic map, and can enter the target geographic location through a text input box. In some scenarios, for tourist attractions that the user has not visited, the attraction object representing the tourist attraction and the person object corresponding to the user can be fused to generate fused data. In this case, the target geographic location can be the geographic location corresponding to the tourist attraction.

[0145] 3. Determine the geographic location of the target user as the target address location.

[0146] In this implementation, the current geographical location of the target user may be detected and used as the target geographical location.

[0147] The location display control can be independent of the above display interface and be in other display interfaces, or can be set in any of the above display interfaces. As an example, the location display control is set in the display interface of the fused data, so that the user can conveniently view the fused data to be published and the target geographic location. Taking the display of the fused data through the data display control set in the first display interface as an example, the location display control can be set in the first display interface.

[0148] In this implementation, the target geographical location corresponding to the target user can be determined, thereby improving the richness of the information to be published.

[0149] In some optional implementations of this embodiment, the execution subject may perform the following operations: in response to obtaining the target text, display the target text through a text display control.

[0150] The target text may be determined by at least one of the following methods:

[0151] 1. Based on the trigger operation of the text auxiliary control, the target text is generated according to the fused data.

[0152] As an example, in response to receiving a trigger operation for a text auxiliary control, a target text is generated according to the fused data through an intelligent text generation model in the server, such as a content introduction text, a summary text, etc. of the fused video.

[0153] 2. Based on the trigger operation for the text assist control, the initial text provided by the user is expanded to obtain the target text.

[0154] As an example, the target user can input a subject text, and the subject text is expanded by the intelligent text generation model in the server to obtain the target text.

[0155] 3. Determine the text provided by the user as the target text.

[0156] As an example, based on the user's text input operation and text copy operation, the target text provided by the user can be obtained.

[0157] The text auxiliary control and the text display control can be independent of the above display interface and be located in other display interfaces, or can be set in any of the above display interfaces.

[0158] As an example, a text auxiliary control and a text display control are set in the display interface of the fused data, so that the user can conveniently view the fused data to be published, the target geographic location and the target text. Taking the display of the fused data through the data display control set in the first display interface as an example, the text auxiliary control and the text display control can be set in the first display interface.

[0159] In this implementation, the corresponding target text can be determined for the fused data, further improving the richness of the information to be published.

[0160] In some optional implementations of this embodiment, the execution subject may perform the following operations: obtaining a trigger operation for a data publishing control.

[0161] Among them, the data publishing control is used to publish the fused data, target geographic location and target text.

[0162] As an example, in response to receiving a trigger operation of a target user on a data publishing control, the fused data, target geographic location, and target text are published to a preset platform such as a social platform or a short video platform through a server.

[0163] The data publishing control may be independent of the above display interface and located in other display interfaces, or may be set in any of the above display interfaces, for example, in the first display interface.

[0164] In this implementation, data can be published based on the fused data, target geographic location, and target text data, which improves the convenience and efficiency of the data publishing process.

[0165] It should be noted that the above display interfaces can be independent of each other or combined with each other. In the case of combination, some or all of the above display interfaces can be flexibly combined according to factors such as user operation habits and interface design requirements.

[0166] As an example, the fourth display interface and the fifth display interface may be combined into one display interface to implement adjustment of the fused video and the target audio in one display interface.

[0167] Continue to refer Fig. 9 , shows a schematic diagram of the first display interface. The first display interface includes a data upload control 901, a data display control 902, a position display control 903, a text auxiliary control 904, a text display control 905, and a data publishing control 906. Setting multiple controls in the same display interface helps to improve the user's operation convenience and viewing experience of the operation process.

[0168] Continue to refer Fig.10 , shows a schematic process 1000 of another embodiment of the data processing method according to the present disclosure. In the process 1000, the following steps are included:

[0169] Step 1001: display a third display interface based on a trigger operation on a data upload control in a first display interface.

[0170] The third display interface includes an image display area, and a plurality of first image display controls in the image display area display respective corresponding images.

[0171] Step 1002 : determining a plurality of target images based on a triggering operation on a plurality of target image display controls in a plurality of first image display controls.

[0172] Step 1003 : in response to identifying a plurality of candidate subject objects in a plurality of target images, displaying the plurality of candidate subject objects through a plurality of object display controls corresponding one-to-one to the plurality of candidate subject objects in a second display interface.

[0173] Step 1004 : determining a plurality of subject objects from a plurality of candidate subject objects based on triggering operations on a plurality of target object display controls in a plurality of object display controls.

[0174] Step 1005: Display the fused image through at least one second image display control in the sixth display interface that corresponds one-to-one to at least one fused image.

[0175] Among them, at least one fused image is obtained by fusing multiple main objects based on at least one layout method.

[0176] Step 1006: Obtain an object adjustment operation for a target display control in at least one second image display control.

[0177] Step 1007: Use the adjusted fused image as fused data and display the fused data.

[0178] Step 1008: In response to obtaining the target geographic location, display the target geographic location through a location display control.

[0179] The method for determining the target geographic location includes at least one of the following:

[0180] Based on the location subject object representing the geographical location among the multiple subject objects, a target geographical location is determined; the geographical location specified by the target user is determined as the target geographical location; and the geographical location where the target user is located is determined as the target address location.

[0181] Step 1009: in response to obtaining the target text, display the target text through a text display control.

[0182] The target text may be determined by at least one of the following methods:

[0183] Based on the trigger operation for the text auxiliary control, the target text is generated according to the fused data; based on the trigger operation for the text auxiliary control, the initial text provided by the target user is expanded to obtain the target text; and the text provided by the target user is determined as the target text.

[0184] This embodiment does not limit the execution order of step 1008 and step 1009, that is, step 1008 can be executed before step 1009, step 1008 can also be executed after step 1009, and even step 1008 can be executed simultaneously with step 1009.

[0185] Step 1010: Obtain a trigger operation for the data publishing control.

[0186] Among them, the data publishing control is used to publish the fused data, target geographic location and target text.

[0187] Compared with process 200, process 1000 of the data processing method in this embodiment specifically describes the generation process and publishing process of fused data in image form, enriches the data processing method, and meets the data processing needs of users to a certain extent.

[0188] Continue to refer Fig.11 , shows a schematic process 1100 of another embodiment of the data processing method according to the present disclosure. In the process 1100, the following steps are included:

[0189] Step 1101: display a third display interface based on a trigger operation on a data upload control in a first display interface.

[0190] Among them, the third display interface includes an image display area and an audio display area, the multiple first image display controls in the image display area display their respective corresponding images, and the multiple audio display controls in the audio area display their respective corresponding audios.

[0191] Step 1102 : determining a plurality of target images based on triggering operations on a plurality of target image display controls in a plurality of first image display controls.

[0192] Step 1103: determine the target audio based on the triggering operation on the target audio display control among the multiple audio display controls.

[0193] This embodiment does not limit the execution order of step 1102 and step 1103, that is, step 1102 can be executed before step 1103, step 1102 can also be executed after step 1103, and even step 1102 can be executed simultaneously with step 1103.

[0194] Step 1104 , in response to identifying a plurality of candidate subject objects in a plurality of target images, displaying the plurality of candidate subject objects through a plurality of object display controls in a second display interface that correspond one-to-one to the plurality of candidate subject objects.

[0195] Step 1105 : determining a plurality of subject objects from a plurality of candidate subject objects based on triggering operations on a plurality of target object display controls in a plurality of object display controls.

[0196] Step 1106: Display the audio properties of the target audio through the audio property display control in the fourth display interface.

[0197] Step 1107, obtaining a property adjustment operation for the audio property display control, and / or, based on the user audio collected by the recording control in the fourth display interface.

[0198] Step 1108: Display the video frame sequence corresponding to the fused video through the sequence display control in the fifth display interface.

[0199] Step 1109, obtaining a video frame adjustment operation for the sequence display control.

[0200] This embodiment does not limit the execution order of steps 1106, 1107 and steps 1108, 1109, that is, steps 1106, 1107 can be executed before steps 1108, 1109, steps 1106, 1107 can also be executed after steps 1108, 1109, and even steps 1106, 1107 can be executed simultaneously with steps 1108, 1109.

[0201] Step 1110 , in response to obtaining the fused data corresponding to the adjusted video and the adjusted audio, display the fused data.

[0202] The adjusted video is obtained by adjusting the video frame sequence according to the video frame adjustment operation, and the adjusted audio is obtained by adjusting the audio properties of the target audio according to the property adjustment operation and / or the audio properties of the user audio.

[0203] Step 1111 , in response to obtaining the target geographic location, displaying the target geographic location through a location display control.

[0204] The method for determining the target geographic location includes at least one of the following:

[0205] Based on the location subject object representing the geographical location among the multiple subject objects, a target geographical location is determined; the geographical location specified by the target user is determined as the target geographical location; and the geographical location where the target user is located is determined as the target address location.

[0206] Step 1112, in response to obtaining the target text, displaying the target text through a text display control.

[0207] The target text may be determined by at least one of the following methods:

[0208] Based on the trigger operation for the text auxiliary control, the target text is generated according to the fused data; based on the trigger operation for the text auxiliary control, the initial text provided by the target user is expanded to obtain the target text; and the text provided by the target user is determined as the target text.

[0209] This embodiment does not limit the execution order of step 1111 and step 1112, that is, step 1111 can be executed before step 1112, step 1111 can also be executed after step 1112, and even step 1111 can be executed simultaneously with step 1112.

[0210] Step 1113, obtaining a trigger operation for the data publishing control.

[0211] Among them, the data publishing control is used to publish the fused data, target geographic location and target text.

[0212] Compared with process 200, process 1100 of the data processing method in this embodiment specifically describes the generation process and publishing process of the fused data in audio and video form, enriches the data processing method, and meets the user's data processing needs to a certain extent.

[0213] Continue to refer to 12, Fig.12 A flowchart of a data processing method provided by an embodiment of the present disclosure. In the process 1200, the following steps are included:

[0214] Step 1201, identifying multiple subject objects in multiple target images.

[0215] In this embodiment, the execution subject of the data processing method (for example Figure 1 The server in the embodiment can obtain multiple target images from the terminal device through a wired network connection mode to a wireless network connection mode, and identify multiple subject objects in the multiple target images.

[0216] Among them, multiple target images are obtained based on the data upload control in the first display interface of the terminal device, and multiple main objects are displayed based on multiple object display controls in the second display interface of the terminal device.

[0217] The subject is generally the most dominant and eye-catching part of the image, and is also the main content and focus of the image. The subject can be diverse, including but not limited to people, animals, plants, buildings, objects, natural landscapes, environments, etc.

[0218] As an example, the main object in the target image can be determined based on the following factors:

[0219] Size and position: The main subject often takes up a large space in the image or is located in the center or prominent position of the image.

[0220] Color and contrast: The main object may contrast in color with the rest of the design, or have a brighter, more eye-catching color.

[0221] Shape and texture: A subject object may have a unique shape or texture that distinguishes it from other parts.

[0222] Composition and focus: The way an image is composed (such as the rule of thirds, symmetrical composition, etc.) and the focus setting (such as shallow depth of field effect) will also affect the recognition of the main object.

[0223] Content and background: The difference in content between the subject and the background is also an important factor in judging the subject. The background usually serves to set off the subject, while the subject is the core content of the image.

[0224] As another example, a pre-trained subject object recognition model is set in the above-mentioned execution subject, and each target image in multiple target images is input into the subject object recognition model in the server to determine the subject object in each target image. The subject object recognition model can be a one-stage target detection model, such as the SSD (Single Shot multibox-Detector) model and the YOLO (You Only Look Once) model; it can also be a two-stage target detection model, such as the R-CNN (Region-based Convolutional Neural Networks) model and the SPPNet (Spatial Pyramid Pooling Convolutional Networks) model.

[0225] After identifying multiple subject objects, the above-mentioned execution subject can feed back the identification results to the terminal device.

[0226] Step 1202: fuse multiple main objects to obtain fused data.

[0227] In this implementation, the execution subject may fuse multiple subject objects to obtain fused data. The fused data is obtained by fusing multiple subject objects and may be data in various forms, such as images, videos, and the like.

[0228] Taking the fused data in the form of images as an example, first, the AI ​​(Artificial Intelligence) text generation model is called to generate guide text related to multiple subject objects according to multiple subject objects, which is used to guide the generation process of the fused data. The AI ​​text generation model is, for example, the BLIP (Bootstrapping Language-Image Pre-training) model, which realizes efficient image-to-text function by fusing ViT (Vision Transformer) and LLM (Large Language Model). BLIP can generate accurate and vivid descriptive text directly from pictures through zero-sample learning without relying on additional labeled data.

[0229] The object images and guide texts corresponding to the multiple subject objects are used as the input of the Control Net model to generate a fused image. Specifically, the Control Net model extracts features from the object image and the guide text respectively to generate the corresponding feature vectors; then, the extracted image features and text features are fused to generate a joint feature vector containing the information of the multiple object images and the guide text; then, the joint feature vector is used as input to generate the fused data through the decoder of the Control Net model.

[0230] In some optional implementations of the present embodiment, the execution subject may perform step 1202 as follows: first, fuse multiple subject objects to obtain a fused video; then, adjust the audio properties of the target audio according to the attribute adjustment operation and / or the audio properties of the user audio of the target user to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is obtained based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; finally, combine the fused video and the adjusted audio to obtain the fused data.

[0231] As an example, first, parse the fused video and the target video. Read the video file and extract the video frame. Video frames are usually stored in the form of image sequences, and each frame contains timestamp information. Read the audio file and extract the audio sample. Audio samples are usually stored in the form of time series, and each sample has timestamp information. Then, perform time synchronization of audio and video. Align the time axis of the video frame and audio sample. Make sure that the timestamp of the video frame matches the timestamp of the audio sample so that they can be synchronized during synthesis. Mark key synchronization points in the video frame and audio sample, such as the key frame of the video and the beat point of the audio, to ensure accurate synchronization. Then, perform video encoding. Select an appropriate video codec (such as H.264, H.265, etc.) to re-encode the video frame. The balance between video quality and file size needs to be considered during the encoding process. Select a suitable multimedia container format (such as MP4, AVI, MKV, etc.) to encapsulate the video stream and audio stream together. Finally, generate the fused data. Multiplex the encoded video stream and audio stream (Muxing) to generate a complete multimedia file containing video and audio.

[0232] In some optional implementations of the present embodiment, the execution subject may perform step 1202 as follows: first, fuse multiple subject objects to obtain a fused video; then, according to a video frame adjustment operation, adjust the video frame sequence corresponding to the fused video to obtain an adjusted video, wherein the video frame adjustment operation is obtained based on a sequence display control in a fifth display interface of the terminal device; finally, combine the adjusted video and the target audio to obtain fused data.

[0233] The video frame adjustment operation includes, but is not limited to, a video frame deletion operation, a video frame supplementation operation, and a video frame exchange operation.

[0234] In a convenient implementation, the user can delete and supplement video frames based on a pinch operation. Specifically, multiple video frames between the video frames touched by the user's two fingers are used as the video segment to be operated. In response to the decrease in the distance between the user's two fingers, at least part of the video frames in the video segment are reduced, for example, all the video frames in the video segment are deleted, or one video frame is reduced every preset number of frames; in response to the increase in the distance between the user's two fingers, the video frames in the video segment are increased, for example, one or more video frames are added between adjacent video frames in the video segment. Specifically, in order to improve the clarity and continuity of the fused video, an intermediate video frame can be added between adjacent video frames.

[0235] In some optional implementations of the present embodiment, the execution subject may perform step 1202 as follows: first, according to the attribute adjustment operation and / or the audio attributes of the user audio of the target user, adjust the audio attributes of the target audio to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is obtained based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; then, fuse multiple subject objects to obtain a fused video, and according to the video frame adjustment operation, adjust the video frame sequence corresponding to the fused video to obtain the adjusted video, wherein the video frame adjustment operation is obtained based on the sequence display control in the fifth display interface of the terminal device; finally, combine the adjusted video and the adjusted audio to obtain the fused data.

[0236] The user can perform a property adjustment operation on the audio property display control, and the property adjustment operation can adjust at least one audio property of the target audio, such as a swipe up operation to increase the pitch and a swipe down operation to decrease the pitch.

[0237] The user can also trigger the recording control, and the above-mentioned execution entity can collect the user's voice, obtain the user recording, and analyze the user recording to determine its audio properties; then, the audio properties of the target audio are adjusted to be consistent or similar to the audio data of the user audio.

[0238] In some implementations, the execution subject may also process the target audio in combination with the above two methods. For example, first, the user recording of the user is collected and analyzed to determine its audio attributes; then, the audio attributes of the target audio are adjusted to be consistent or similar to the audio data of the user audio; finally, the user further adjusts the target audio based on the attribute adjustment operation to obtain the adjusted audio.

[0239] In some optional implementations of this embodiment, the execution subject may also perform the following operations: first, determine a location subject object representing a geographic location from multiple subject objects; then, determine a target geographic location corresponding to the location subject object, wherein the target geographic location is displayed based on a location display control of the terminal device.

[0240] As an example, the above-mentioned execution entity can extract the feature data of each subject object, and compare the object feature data of each subject object with the image feature data of the environmental image of each geographical location; in response to the feature distance between the object feature data and the image feature data being less than a preset threshold, the object feature data is determined as the location subject object, and the geographical location corresponding to the image feature data is determined as the target geographical location.

[0241] In some optional implementations of this embodiment, the execution subject may further perform the following operations: generating a target text corresponding to the fused data, wherein the target text is displayed through a text display control of a terminal device; and / or expanding an initial text provided by a target user to obtain the target text.

[0242] As an example, in response to a trigger operation on a text auxiliary control, the intelligent text generation model in the execution subject generates a target text according to the fused data, such as an introduction text or a summary text of the fused video.

[0243] As an example, the target user may input a subject text, and the intelligent text generation model in the above execution body expands the subject text to obtain the target text.

[0244] In some optional implementations of this embodiment, the execution subject may further perform the following operations: based on the data publishing instruction, publish the fused data, the target geographic location and the target text. The data publishing instruction is obtained based on the data publishing control of the terminal device. When the user issues a trigger operation for the data publishing control, the data publishing instruction is generated.

[0245] As an example, the above-mentioned execution entity can publish the fused data, target geographic location and target text to designated platforms such as social platforms and short video platforms.

[0246] In this embodiment, a data processing method is provided to identify and display multiple main objects in multiple target images uploaded by users, and then fuse the multiple objects to obtain and display fused data, which enriches the data processing method, improves the display effect and information volume of the fused data, and meets the user's data processing needs to a certain extent.

[0247] Continue to refer Fig.13 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a data processing device, and the system embodiment is Figure 2 Corresponding to the method embodiment shown, the system can be specifically applied to various electronic devices.

[0248] like Fig.13 As shown, the data processing device 1300 includes: a data acquisition unit 1301, configured to acquire multiple target images based on the data upload control in the first display interface; an object display unit 1302, configured to display the multiple subject objects in response to identifying multiple subject objects in the multiple target images through multiple object display controls in the second display interface corresponding to the multiple subject objects one by one; a data display unit 1303, configured to display the fused data in response to obtaining the fused data corresponding to the multiple subject objects.

[0249] In some optional implementations of the present embodiment, the data acquisition unit 1301 is further configured to: display a third display interface based on a trigger operation on a data upload control, wherein the third display interface includes an image display area and an audio display area, a plurality of first image display controls in the image display area display respectively corresponding images, and a plurality of audio display controls in the audio area display respectively corresponding audios; determine a plurality of target images based on a trigger operation on a plurality of target image display controls in the plurality of first image display controls; and determine a target audio based on a trigger operation on a target audio display control in the plurality of audio display controls.

[0250] In some optional implementations of this embodiment, the data display unit 1303 is further configured to: in response to obtaining fused data corresponding to the fused video and the target audio, display the fused data, wherein the fused video is generated based on the fusion of multiple main objects.

[0251] In some optional implementations of the present embodiment, the above-mentioned device also includes: an audio display unit (not shown in the figure), configured to: display the audio properties of the target audio through the audio property display control in the fourth display interface; obtain the property adjustment operation for the audio property display control, and / or, based on the user audio collected by the recording control in the fourth display interface; in response to obtaining the adjusted audio, display the audio properties of the adjusted audio through the audio property display control, wherein the adjusted audio is obtained by adjusting the audio properties of the target audio according to the property adjustment operation and / or the audio properties of the user audio; and the data display unit 1303 is further configured to: in response to obtaining the fused data corresponding to the fused video and the adjusted audio, display the fused data.

[0252] In some optional implementations of this embodiment, the above-mentioned device also includes: an audio display unit (not shown in the figure), configured to: display the video frame sequence corresponding to the fused video through the sequence display control in the fifth display interface; obtain the video frame adjustment operation for the sequence display control; and the data display unit 1303 is further configured to: in response to obtaining the fused data corresponding to the adjusted video and the target audio, display the fused data, wherein the adjusted video is obtained by adjusting the video frame sequence according to the video frame adjustment operation.

[0253] In some optional implementations of this embodiment, the data display unit 1303 is further configured to: in response to obtaining the fused data corresponding to the adjusted video and the adjusted audio, display the fused data, wherein the adjusted video is obtained by adjusting the video frame sequence corresponding to the fused video according to a video frame adjustment operation, and the adjusted audio is obtained by adjusting the audio properties of the target audio according to a property adjustment operation and / or audio properties of the user audio.

[0254] In some optional implementations of this embodiment, the above-mentioned device also includes: an image display unit (not shown in the figure), configured to: display the fused image through at least one second image display control in the sixth display interface that corresponds one-to-one to at least one fused image, wherein the at least one fused image is obtained by fusing multiple main objects based on at least one layout method; obtain an object adjustment operation for a target display control in at least one second image display control; and the data display unit 1303 is further configured to: use the adjusted fused image as the fused data and display the fused data.

[0255] In some optional implementations of the present embodiment, the object display unit 1302 is further configured to: in response to identifying multiple candidate subject objects in multiple target images, display the multiple candidate subject objects through multiple object display controls in the second display interface that correspond one-to-one to the multiple candidate subject objects; and determine multiple subject objects from the multiple candidate subject objects based on a trigger operation on multiple target object display controls in the multiple object display controls.

[0256] In some optional implementations of this embodiment, the above-mentioned device also includes: a position display unit (not shown in the figure), which is configured to: in response to obtaining the target geographical location, display the target geographical location through a position display control, wherein the method for determining the target geographical location includes at least one of the following: determining the target geographical location based on a position subject object representing the geographical location among multiple subject objects; determining the geographical location specified by the user as the target geographical location; determining the geographical location where the user is located as the target address location.

[0257] In some optional implementations of this embodiment, the above-mentioned device also includes: a text display unit (not shown in the figure), which is configured to: in response to obtaining the target text, display the target text through a text display control, wherein the method for determining the target text includes at least one of the following: based on a trigger operation on a text auxiliary control, generating the target text according to the fused data; based on a trigger operation on a text auxiliary control, expanding the initial text provided by the target user to obtain the target text; determining the text provided by the target user as the target text.

[0258] In some optional implementations of this embodiment, the above-mentioned device also includes: a publishing operation acquisition unit (not shown in the figure), which is configured to obtain a trigger operation for a data publishing control, wherein the data publishing control is used to publish fused data, target geographic location and target text.

[0259] In this embodiment, a data processing device is provided to identify and display multiple main objects in multiple target images uploaded by users, and then fuse the multiple objects to obtain and display the fused data, which enriches the data processing method and meets the user's data processing needs to a certain extent.

[0260] Continue to refer Fig.14 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a data processing device, and the system embodiment is Fig.12 Corresponding to the method embodiment shown, the system can be specifically applied to various electronic devices.

[0261] like Fig.14 As shown, the data processing device 1400 includes: an object recognition unit 1401, configured to recognize multiple main objects in multiple target images, wherein the multiple target images are obtained based on a data upload control in a first display interface of the terminal device, and the multiple main objects are displayed based on multiple object display controls in a second display interface of the terminal device; a data fusion unit 1402, configured to fuse the multiple main objects to obtain fused data.

[0262] In some optional implementations of this embodiment, the data fusion unit 1402 is further configured to: fuse multiple main objects to obtain a fused video; adjust the audio properties of the target audio according to the attribute adjustment operation and / or the audio properties of the user audio of the target user to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is collected based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; and combine the fused video and the adjusted audio to obtain fused data.

[0263] In some optional implementations of this embodiment, the data fusion unit 1402 is further configured to: fuse multiple main objects to obtain a fused video; adjust the video frame sequence corresponding to the fused video according to the video frame adjustment operation to obtain the adjusted video, wherein the video frame adjustment operation is obtained based on the sequence display control in the fifth display interface of the terminal device; combine the adjusted video and the target audio to obtain the fused data.

[0264] In some optional implementations of the present embodiment, the data fusion unit 1402 is further configured to: adjust the audio properties of the target audio according to the attribute adjustment operation and / or the audio properties of the user audio of the target user to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio property display control in the fourth display interface of the terminal device, the user audio is obtained based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; fuse multiple subject objects to obtain a fused video, and adjust the video frame sequence corresponding to the fused video according to the video frame adjustment operation to obtain the adjusted video, wherein the video frame adjustment operation is obtained based on the sequence display control in the fifth display interface of the terminal device; and combine the adjusted video and the adjusted audio to obtain fused data.

[0265] In some optional implementations of this embodiment, the above-mentioned device also includes: a position determination unit (not shown in the figure), which is configured to: determine a position subject object representing a geographical location from multiple subject objects; determine a target geographical location corresponding to the position subject object, wherein the target geographical location is displayed based on a position display control of the terminal device.

[0266] In some optional implementations of this embodiment, the above-mentioned device also includes: a text generation unit (not shown in the figure), which is configured to: generate a target text corresponding to the fused data, wherein the target text is displayed through a text display control of the terminal device; and / or expand the initial text provided by the target user to obtain the target text.

[0267] In some optional implementations of this embodiment, the above-mentioned device includes: a data publishing unit (not shown in the figure), which is configured to publish the fused data, target geographic location and target text based on the data publishing instruction, wherein the data publishing instruction is obtained based on the data publishing control of the terminal device.

[0268] In this embodiment, a data processing device is provided to identify and display multiple main objects in multiple target images uploaded by users, and then fuse the multiple objects to obtain and display the fused data, which enriches the data processing method and meets the user's data processing needs to a certain extent.

[0269] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can implement the data processing method described in any of the above embodiments when executing.

[0270] According to an embodiment of the present disclosure, the present disclosure further provides a readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to implement the data processing method described in any of the above embodiments when executed.

[0271] An embodiment of the present disclosure provides a computer program product. When the computer program is executed by a processor, the data processing method described in any of the above embodiments can be implemented.

[0272] Fig.15 A schematic block diagram of an example electronic device 1500 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0273] like Fig.15 As shown, the device 1500 includes a computing unit 1501, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1502 or a computer program loaded from a storage unit 1508 into a random access memory (RAM) 1503. In the RAM 1503, various programs and data required for the operation of the device 1500 can also be stored. The computing unit 1501, the ROM 1502, and the RAM 1503 are connected to each other via a bus 1504. An input / output (I / O) interface 1505 is also connected to the bus 1504.

[0274] A number of components in the device 1500 are connected to the I / O interface 1505, including: an input unit 1506, such as a keyboard, a mouse, etc.; an output unit 1507, such as various types of displays, speakers, etc.; a storage unit 1508, such as a disk, an optical disk, etc.; and a communication unit 1509, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1509 allows the device 1500 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0275] The computing unit 1501 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1501 performs the various methods and processes described above, such as data processing methods. For example, in some embodiments, the data processing method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 1508. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1500 via ROM 1502 and / or communication unit 1509. When the computer program is loaded into RAM 1503 and executed by the computing unit 1501, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the computing unit 1501 may be configured to perform the data processing method in any other appropriate manner (e.g., by means of firmware).

[0276] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0277] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing system, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0278] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0279] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0280] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0281] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and virtual private servers (VPS) services; it may also be a server for a distributed system, or a server combined with a blockchain.

[0282] According to the technical solution of the embodiment of the present disclosure, a data processing method and device are provided to identify and display multiple main objects in multiple target images uploaded by users, and then fuse the multiple objects to obtain and display the fused data, which enriches the data processing method and meets the user's data processing needs to a certain extent.

[0283] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution provided by this disclosure can be achieved, and this document does not limit this.

[0284] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A data processing method, comprising: Based on the data upload control in the first display interface, acquiring multiple target images; In response to identifying a plurality of subject objects in the plurality of target images, displaying the plurality of subject objects through a plurality of object display controls corresponding one-to-one to the plurality of subject objects in the second display interface; In response to obtaining the fused data corresponding to the plurality of subject objects, the fused data is displayed.

2. The method according to claim 1, wherein: The acquiring of multiple target images based on the data upload control in the first display interface includes: Based on the trigger operation for the data upload control, a third display interface is displayed, wherein the third display interface includes an image display area and an audio display area, a plurality of first image display controls in the image display area display respective corresponding images, and a plurality of audio display controls in the audio area display respective corresponding audios; Determining the plurality of target images based on triggering operations on a plurality of target image display controls among the plurality of first image display controls; Based on a trigger operation on a target audio display control among the multiple audio display controls, a target audio is determined.

3. The method according to claim 2, wherein: In response to obtaining the fused data corresponding to the plurality of subject objects, displaying the fused data includes: In response to obtaining the fused data corresponding to the fused video and the target audio, the fused data is displayed, wherein the fused video is generated based on the fusion of the multiple main objects.

4. The method according to claim 3, wherein: Also includes: Displaying the audio properties of the target audio through the audio property display control in the fourth display interface; Acquire a property adjustment operation for the audio property display control, and / or obtain user audio collected based on the recording control in the fourth display interface; In response to obtaining the adjusted audio, displaying the audio properties of the adjusted audio through the audio property display control, wherein the adjusted audio is obtained by adjusting the audio properties of the target audio according to the property adjustment operation and / or the audio properties of the user audio; and In response to obtaining the fused data corresponding to the fused video and the target audio, displaying the fused data includes: In response to obtaining the fused data corresponding to the fused video and the adjusted audio, the fused data is displayed.

5. The method according to claim 3, wherein: Also includes: Displaying the video frame sequence corresponding to the fused video through the sequence display control in the fifth display interface; Obtaining a video frame adjustment operation for the sequence display control; as well as In response to obtaining the fused data corresponding to the fused video and the target audio, displaying the fused data includes: In response to obtaining fused data corresponding to the adjusted video and the target audio, the fused data is displayed, wherein the adjusted video is obtained by adjusting the video frame sequence according to the video frame adjustment operation.

6. The method according to claim 3, wherein: In response to obtaining the fused data corresponding to the fused video and the target audio, displaying the fused data includes: In response to obtaining fused data corresponding to the adjusted video and the adjusted audio, the fused data is displayed, wherein the adjusted video is obtained by adjusting the video frame sequence corresponding to the fused video according to a video frame adjustment operation, and the adjusted audio is obtained by adjusting the audio properties of the target audio according to a property adjustment operation and / or audio properties of the user audio.

7. The method according to claim 1, wherein: Also includes: Displaying the fused image through at least one second image display control corresponding to at least one fused image in a sixth display interface, wherein at least one fused image is obtained by fusing the multiple subject objects based on at least one layout mode; Acquire an object adjustment operation for at least one target display control in the second image display control; and In response to obtaining the fused data corresponding to the plurality of subject objects, displaying the fused data includes: The adjusted fused image is used as the fused data, and the fused data is displayed.

8. The method according to any one of claims 1 to 7, wherein: In response to identifying a plurality of subject objects in the plurality of target images, displaying the plurality of subject objects through a plurality of object display controls corresponding one-to-one to the plurality of subject objects in the second display interface comprises: In response to identifying a plurality of candidate subject objects in the plurality of target images, displaying the plurality of candidate subject objects through a plurality of object display controls in the second display interface corresponding one-to-one to the plurality of candidate subject objects; The plurality of subject objects are determined from the plurality of candidate subject objects based on trigger operations on a plurality of target object display controls among the plurality of object display controls.

9. The method according to claim 8, wherein: Also includes: In response to obtaining the target geographic location, the target geographic location is displayed through a location display control, wherein the target geographic location is determined in a manner including at least one of the following: Determine the target geographical location based on the location subject object representing the geographical location among the multiple subject objects; Determining a geographic location specified by a target user as the target geographic location; The geographical location of the target user is determined as the target address location.

10. The method according to claim 9, wherein: Also includes: In response to obtaining the target text, the target text is displayed through a text display control, wherein the target text is determined in a manner including at least one of the following: Based on a trigger operation on a text auxiliary control, generating the target text according to the fused data; Based on the triggering operation on the text auxiliary control, the initial text provided by the target user is expanded to obtain the target text; The text provided by the target user is determined as the target text.

11. The method according to claim 10, wherein: Also includes: A trigger operation for a data publishing control is obtained, wherein the data publishing control is used to publish the fused data, the target geographic location, and the target text.

12. A data processing method, comprising: Identifying a plurality of subject objects in a plurality of target images, wherein the plurality of target images are obtained based on a data upload control in a first display interface of a terminal device, and the plurality of subject objects are displayed based on a plurality of object display controls in a second display interface of the terminal device; The multiple subject objects are fused to obtain fused data.

13. The method according to claim 12, wherein: The fusing the multiple subject objects to obtain fused data includes: Fusion of the multiple subject objects to obtain a fused video; According to the attribute adjustment operation and / or the audio attribute of the user audio of the target user, the audio attribute of the target audio is adjusted to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is collected based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; The fused video and the adjusted audio are combined to obtain the fused data.

14. The method according to claim 12, wherein: The fusing the multiple subject objects to obtain fused data includes: Fusion of the multiple subject objects to obtain a fused video; According to the video frame adjustment operation, adjusting the video frame sequence corresponding to the fused video to obtain the adjusted video, wherein the video frame adjustment operation is obtained based on the sequence display control in the fifth display interface of the terminal device; The adjusted video and the target audio are combined to obtain the fused data.

15. The method according to claim 12, wherein: The fusing the multiple subject objects to obtain fused data includes: According to the attribute adjustment operation and / or the audio attribute of the user audio of the target user, the audio attribute of the target audio is adjusted to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is collected based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; Fusing the multiple subject objects to obtain a fused video, and adjusting a video frame sequence corresponding to the fused video according to a video frame adjustment operation to obtain an adjusted video, wherein the video frame adjustment operation is obtained based on a sequence display control in a fifth display interface of the terminal device; The adjusted video and the adjusted audio are combined to obtain the fused data.

16. The method according to any one of claims 12 to 15, wherein: Also includes: Determine a location subject object representing a geographical location from the multiple subject objects; A target geographic location corresponding to the location subject object is determined, wherein the target geographic location is displayed based on a location display control of the terminal device.

17. The method according to claim 16, wherein: Also includes: Generating a target text corresponding to the fused data, wherein the target text is displayed through a text display control of the terminal device; and / or The initial text provided by the target user is expanded to obtain the target text.

18. The method according to claim 17, wherein: Also includes: Based on a data publishing instruction, the fused data, the target geographic location and the target text are published, wherein the data publishing instruction is obtained based on a data publishing control of the terminal device.

19. A data processing device, comprising: A data acquisition unit, configured to acquire a plurality of target images based on a data upload control in the first display interface; an object display unit configured to, in response to identifying a plurality of subject objects in the plurality of target images, display the plurality of subject objects through a plurality of object display controls corresponding one-to-one to the plurality of subject objects in the second display interface; The data display unit is configured to display the fused data in response to obtaining the fused data corresponding to the plurality of subject objects.

20. The device according to claim 19, wherein The data acquisition unit is further configured to: Based on the trigger operation on the data upload control, a third display interface is displayed, wherein the third display interface includes an image display area and an audio display area, the multiple first image display controls in the image display area display their respective corresponding images, and the multiple audio display controls in the audio area display their respective corresponding audios; based on the trigger operation on the multiple target image display controls among the multiple first image display controls, the multiple target images are determined; based on the trigger operation on the target audio display control among the multiple audio display controls, the target audio is determined.

21. The device according to claim 20, wherein: The data display unit is further configured to: In response to obtaining the fused data corresponding to the fused video and the target audio, the fused data is displayed, wherein the fused video is generated based on the fusion of the multiple main objects.

22. The device according to claim 21, wherein Also includes: An audio display unit is configured to: Displaying the audio properties of the target audio through the audio property display control in the fourth display interface; acquiring a property adjustment operation for the audio property display control, and / or, based on the user audio collected by the recording control in the fourth display interface; in response to obtaining the adjusted audio, displaying the audio properties of the adjusted audio through the audio property display control, wherein the adjusted audio is obtained by adjusting the audio properties of the target audio according to the property adjustment operation and / or the audio properties of the user audio; and The data display unit is further configured to: In response to obtaining the fused data corresponding to the fused video and the adjusted audio, the fused data is displayed.

23. The device according to claim 21, wherein Also includes: An audio display unit is configured to: Displaying the video frame sequence corresponding to the fused video through the sequence display control in the fifth display interface; obtaining a video frame adjustment operation for the sequence display control; and The data display unit is further configured to: In response to obtaining fused data corresponding to the adjusted video and the target audio, the fused data is displayed, wherein the adjusted video is obtained by adjusting the video frame sequence according to the video frame adjustment operation.

24. The device according to claim 21, wherein The data display unit is further configured to: In response to obtaining fused data corresponding to the adjusted video and the adjusted audio, the fused data is displayed, wherein the adjusted video is obtained by adjusting the video frame sequence corresponding to the fused video according to a video frame adjustment operation, and the adjusted audio is obtained by adjusting the audio properties of the target audio according to a property adjustment operation and / or audio properties of the user audio.

25. The device according to claim 19, wherein Also includes: The image display unit is configured to: Displaying the fused image through at least one second image display control corresponding to at least one fused image in a sixth display interface, wherein at least one fused image is obtained by fusing the plurality of subject objects based on at least one layout mode; acquiring an object adjustment operation for a target display control in at least one second image display control; and The data display unit is further configured to: The adjusted fused image is used as the fused data, and the fused data is displayed.

26. The device according to any one of claims 19 to 25, wherein: The object display unit is further configured to: In response to identifying a plurality of candidate subject objects in the plurality of target images, displaying the plurality of candidate subject objects through a plurality of object display controls in the second display interface corresponding one-to-one to the plurality of candidate subject objects; The plurality of subject objects are determined from the plurality of candidate subject objects based on trigger operations on a plurality of target object display controls among the plurality of object display controls.

27. The device according to claim 26, wherein: Also includes: The position display unit is configured to: In response to obtaining the target geographic location, the target geographic location is displayed through a location display control, wherein the target geographic location is determined in a manner including at least one of the following: Determine the target geographical location based on the location subject object representing the geographical location among the multiple subject objects; Determining the geographical location specified by the user as the target geographical location; The geographical location of the user is determined as the target address location.

28. The device according to claim 27, wherein Also includes: The text display unit is configured as follows: In response to obtaining the target text, the target text is displayed through a text display control, wherein the target text is determined in a manner including at least one of the following: Based on a trigger operation on a text auxiliary control, generating the target text according to the fused data; Based on the triggering operation on the text auxiliary control, the initial text provided by the target user is expanded to obtain the target text; The text provided by the target user is determined as the target text.

29. The device according to claim 28, wherein Also includes: The publishing operation acquisition unit is configured to acquire a trigger operation for a data publishing control, wherein the data publishing control is used to publish the fused data, the target geographic location, and the target text.

30. A data processing device, comprising: an object recognition unit, configured to recognize a plurality of subject objects in a plurality of target images, wherein the plurality of target images are obtained based on a data upload control in a first display interface of a terminal device, and the plurality of subject objects are displayed based on a plurality of object display controls in a second display interface of the terminal device; The data fusion unit is configured to fuse the multiple subject objects to obtain fused data.

31. The device according to claim 30, wherein The data fusion unit is further configured to: Fuse the multiple subject objects to obtain a fused video; adjust the audio properties of the target audio according to the attribute adjustment operation and / or the audio properties of the user audio of the target user to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is obtained based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; combine the fused video and the adjusted audio to obtain the fused data.

32. The device according to claim 30, wherein: The data fusion unit is further configured to: Fusing the multiple main objects to obtain a fused video; adjusting the video frame sequence corresponding to the fused video according to a video frame adjustment operation to obtain an adjusted video, wherein the video frame adjustment operation is obtained based on a sequence display control in a fifth display interface of the terminal device; combining the adjusted video and the target audio to obtain the fused data.

33. The device according to claim 30, wherein: The data fusion unit is further configured to: According to the attribute adjustment operation and / or the audio attributes of the user audio of the target user, the audio attributes of the target audio are adjusted to obtain the adjusted audio, wherein the attribute adjustment operation is obtained based on the audio attribute display control in the fourth display interface of the terminal device, the user audio is collected based on the recording control in the fourth display interface, and the target audio is determined based on the audio display control in the third display interface of the terminal device; the multiple main objects are fused to obtain a fused video, and according to the video frame adjustment operation, the video frame sequence corresponding to the fused video is adjusted to obtain the adjusted video, wherein the video frame adjustment operation is obtained based on the sequence display control in the fifth display interface of the terminal device; the adjusted video and the adjusted audio are combined to obtain the fused data.

34. The device according to any one of claims 30 to 33, wherein: Also includes: The position determination unit is configured to: Determine a location subject object representing a geographical location from the multiple subject objects; A target geographic location corresponding to the location subject object is determined, wherein the target geographic location is displayed based on a location display control of the terminal device.

35. The device according to claim 34, wherein Also includes: The text generation unit is configured to: generate a target text corresponding to the fused data, wherein the target text is displayed through a text display control of the terminal device; and / or expand an initial text provided by a target user to obtain the target text.

36. The device according to claim 35, wherein Also includes: The data publishing unit is configured to publish the fused data, the target geographic location and the target text based on a data publishing instruction, wherein the data publishing instruction is obtained based on a data publishing control of the terminal device.

37. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 18.

38. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-18.

39. A computer program product comprising: A computer program which, when executed by a processor, implements the method according to any one of claims 1 to 18.

Images