Interaction processing method and apparatus, electronic device, computer-readable storage medium, and computer program product

Abstract

The present application provides an interaction processing method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product. The method comprises: displaying multimedia information to be edited; displaying a virtual avatar of at least one object; in response to the at least one virtual avatar being selected, displaying synthesized multimedia information, wherein the synthesized multimedia information is obtained by incorporating the selected virtual avatar on said multimedia information; and in response to a sending operation for the synthesized multimedia information, sending the synthesized multimedia information, and sending a reminding message to a target object, wherein the target object is an object to which the virtual avatar incorporated in the synthesized multimedia information belongs, and the reminding message is used for reminding the target object to check the synthesized multimedia information.

Description

Interactive processing method, device, electronic device, computer-readable storage medium, and computer program product

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application is based on the Chinese patent application with application number 202310724118.8 and application date June 16, 2023, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby introduced into this application as a reference. Technical Field

[0003] The present application relates to human-computer interaction technology, and in particular to an interactive processing method, device, electronic device, computer-readable storage medium, and computer program product. Background Art

[0004] In related social information flow products and instant messaging products, if a user wants to post an image on a social network or send it to a group chat, they can edit a reminder text (@someone) while posting or sending the image to let the other party know what they have posted, or select friends to remind from a list of options, thereby implementing a strong reminder function. However, the reminder process in related technologies is long and tedious, and the final result is only a reminder text. This leads to problems such as low human-computer interaction efficiency due to redundant human-computer interaction processes and low display resource utilization due to redundant reminder text.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide an interactive processing method, device, electronic device, computer-readable storage medium and computer program product, which can use virtual images to realize reminder functions, thereby improving human-computer interaction efficiency and display resource utilization.

[0007] The technical solution of the embodiment of the present application is implemented as follows:

[0008] An embodiment of the present application provides an interactive processing method, which is executed by an electronic device and includes:

[0009] Display multimedia information to be edited;

[0010] displaying an avatar of at least one subject;

[0011] In response to at least one of the virtual images being in a selected state, displaying synthesized multimedia information, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited;

[0012] In response to a sending operation for the synthesized multimedia information, the synthesized multimedia information is sent, and a reminder message is sent to a target object, wherein the target object is the object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.

[0013] The present invention provides an interactive processing device, including:

[0014] A display module configured to display multimedia information to be edited and display a virtual image of at least one object;

[0015] an editing module configured to display synthesized multimedia information in response to at least one of the virtual images being in a selected state, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited;

[0016] A sending module is configured to send the synthesized multimedia information in response to a sending operation for the synthesized multimedia information, and to send a reminder message to a target object, wherein the target object is the object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.

[0017] An embodiment of the present application provides an interactive processing method, which is executed by an electronic device and includes:

[0018] Receive reminder messages through the target object’s client;

[0019] In response to a triggering operation on the reminder message, displaying a composite multimedia message, wherein the composite multimedia message includes a virtual image of the target object;

[0020] In response to the target object's comment operation on the composite multimedia information, comment information corresponding to the target object's virtual image is displayed on the composite multimedia information.

[0021] The present invention provides an interactive processing device, including:

[0022] a receiving module configured to receive a reminder message;

[0023] a viewing module configured to display the synthesized multimedia information in response to a triggering operation on the reminder message, wherein the synthesized multimedia information includes a virtual image of the target object;

[0024] The comment module is configured to display comment information corresponding to the virtual image of the target object on the composite multimedia information in response to the comment operation of the target object on the composite multimedia information.

[0025] An embodiment of the present application provides an electronic device, including:

[0026] a memory for storing computer-executable instructions;

[0027] The processor is used to implement the interactive processing method provided in the embodiment of the present application when executing the computer executable instructions stored in the memory.

[0028] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions for causing a processor to execute and implement the interactive processing method provided in the embodiment of the present application.

[0029] An embodiment of the present application provides a computer program product, including computer-executable instructions. When the computer-executable instructions are executed by a processor, the interactive processing method provided in the embodiment of the present application is implemented.

[0030] The embodiments of the present application have the following beneficial effects:

[0031] Through the embodiment of the present application, multimedia information to be edited and a virtual image of at least one object are displayed. In response to at least one virtual image being in a selected state, synthetic multimedia information obtained by adding the selected virtual image to the multimedia information to be edited is displayed. This is equivalent to achieving a visual effect of being in the same frame with the virtual image of the object by editing the multimedia information. Subsequently, when sending the synthetic multimedia information, a reminder message will also be sent to the object to which the virtual image included in the synthetic multimedia information belongs, so as to remind the target object to view the synthetic multimedia information. That is, adding a virtual image can replace the reminder operation, thereby effectively improving the efficiency of human-computer interaction while enriching the visual effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] 1A and 1B are schematic diagrams of interfaces of an interactive processing method provided by related art;

[0033] FIG2 is a schematic diagram of the structure of an interactive processing system provided in an embodiment of the present application;

[0034] FIG3 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

[0035] 4A-4D are flowcharts of an interactive processing method according to an embodiment of the present application;

[0036] FIG5 is a flow chart of an interactive processing method provided in an embodiment of the present application;

[0037] 6A-6E are schematic diagrams of interfaces of the interactive processing method provided in the application embodiment;

[0038] FIG7 is a logic diagram of the interactive processing method provided in the embodiment of the application;

[0039] FIG8 is a schematic diagram of an interface of an interactive processing method provided in an embodiment of the application;

[0040] 9A-9B are schematic diagrams of interfaces for implementing a virtual same-frame interaction processing method according to an embodiment of the application;

[0041] FIG10 is a corresponding relationship diagram of the interactive processing method provided in the application embodiment;

[0042] 11A-11B are schematic diagrams of interfaces for implementing the reminder function of the interactive processing method provided in the embodiment of the application;

[0043] FIG12 is a logic diagram of an interactive processing method provided in an embodiment of the application;

[0044] 13A-13B are schematic diagrams of interfaces for implementing the comment function of the interactive processing method provided in the embodiment of the application;

[0045] 14A-14B are schematic diagrams of interfaces for implementing the chat function of the interactive processing method provided in the embodiment of the application;

[0046] FIG15 is a logical diagram of the interactive processing method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solutions and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limiting this application. All other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0048] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0049] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0050] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

[0051] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0052] 1) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed can be real-time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.

[0053] 2) Multimedia information. The multimedia information involved in the embodiments of the present application refers to media information in the form of images, videos, animations, etc. Its meaning is generally considered to refer to relevant information obtained using storage and retrieval technology, especially digital information in a computer.

[0054] Referring to Figures 1A and 1B, in the social information flow APP and instant messaging APP of the related art, if the user wants the content he or she publishes to be perceived by relevant people, the user needs to @ the other party in the published information or select the friends to be notified in the corresponding options. In the stage where the object publishes information, in response to the trigger operation for the reminder entrance 301A, the object list is displayed, so that the target object can be selected in the object list to notify the target object to view the information published by the object. In response to the trigger operation for the reminder entrance 301B, the object list is displayed, so that the target object can be selected in the object list, and the published information will be added with a reminder text to notify the target object to view the information published by the object. When publishing image content, the related art allows users to add virtual image stickers of friends on the image to create a virtual frame effect.

[0055] In the prior art, if users want their posted content to be visible to relevant people, they must enter @ in the message and then select people from their friend list, or use features like "Remind Viewers" to select friends. This entire process is redundant and tedious, and the final presentation is simply the @ text. In the prior art, users may also need to add avatar stickers of themselves and their friends to the images they are sending to indicate that the content is relevant to their friends, but they still have to use the aforementioned reminder function to notify their friends, resulting in a redundant process.

[0056] In response to the above technical problems, the embodiments of the present application provide an interactive processing method, device, electronic device, computer-readable storage medium and computer program product, which can use virtual images to realize reminder functions, thereby improving the efficiency of human-computer interaction.

[0057] The following describes exemplary applications of electronic devices provided by embodiments of the present application. The electronic devices provided by embodiments of the present application can be implemented as various types of user terminals, such as laptop computers, tablet computers, desktop computers, set-top boxes, mobile devices (e.g., mobile phones, portable music players, personal digital assistants, dedicated information devices, portable gaming devices), intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. The following describes exemplary applications of electronic devices provided by embodiments of the present application. The electronic devices provided by embodiments of the present application can be implemented as terminals or servers.

[0058] Refer to Figure 2, which is a structural diagram of the interactive processing system provided in an embodiment of the present application. In order to support a social application, the terminal (terminal 400-1 and terminal 400-2 are shown as examples) is connected to the server 200 through the network 300. The network 300 can be a wide area network or a local area network, or a combination of the two.

[0059] In some embodiments, the multimedia information to be edited is displayed on the terminal 400-1 logged in by the first account. In response to the trigger operation for the selection entry, the terminal 400-1 sends a virtual image acquisition request to the server 200 to obtain the virtual image of the second account. The terminal 400-1 displays the virtual image of the second account. In response to the virtual image selection operation, the virtual image is added to the multimedia information to be edited to display the synthesized multimedia information. In response to the sending operation for the synthesized multimedia information, the terminal 400-1 sends the synthesized multimedia information and the reminder message to the server 200, so that the server 200 sends the multimedia information and the reminder message to the terminal 400-2. In response to the terminal 400-2 receiving the comment operation, the terminal 400-2 sends the comment information to the server 200. The server 200 adds the comment information to the position of the virtual image of the second account in the synthesized multimedia information, and returns the synthesized multimedia information with the added comment information to the terminal 400-1 and the terminal 400-2 for display.

[0060] In some embodiments, the terminal or server can implement the interactive processing method provided in the embodiments of the present application by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a local (Native) application (APP, Application), that is, a program that needs to be installed in the operating system to run, an instant messaging client, a video conferencing client, a social networking client; it can also be a small program, that is, a program that can be run only by downloading it into a browser environment; it can also be a small program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module or plug-in.

[0061] The embodiments of the present application can be implemented with the help of cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or a local area network to realize data calculation, storage, processing, and sharing.

[0062] Cloud technology is a general term for network, information, integration, management platform, and application technologies used in the cloud computing business model. It can form a resource pool that can be used flexibly and conveniently on demand. Cloud computing technology will become a key support. The backend services of technical network systems require a large amount of computing and storage resources.

[0063] As an example, the server 200 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. The terminal 400-1 can be a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, car terminal, etc., but is not limited to this. The terminal 400-1 and the server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present application.

[0064] Referring to FIG. 3 , FIG. 3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The terminal shown in FIG. 3 includes: at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. The various components in terminal 400-1 are coupled together via a bus system 440. It will be understood that bus system 440 is used to implement connection and communication between these components. In addition to including a data bus, bus system 440 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, in FIG. 3 , various buses are labeled as bus system 440.

[0065] The processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.

[0066] The user interface 430 includes one or more output devices 431 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

[0067] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard drives, optical drives, etc. The memory 450 may optionally include one or more storage devices that are physically remote from the processor 410.

[0068] The memory 450 includes volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 450 described in the embodiments of the present application is intended to include any suitable type of memory.

[0069] In some embodiments, the memory 450 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplified below.

[0070] Operating system 451, including system programs for processing various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, and driver layer, which are used to implement various basic services and process hardware-based tasks;

[0071] A network communication module 452 for reaching other computing devices via one or more (wired or wireless) network interfaces 420 , exemplary network interfaces 420 including Bluetooth, WiFi, and USB;

[0072] a presentation module 453 for enabling presentation of information via one or more output devices 431 (e.g., a display screen, a speaker, etc.) associated with the user interface 430 (e.g., a user interface for operating peripheral devices and displaying content and information);

[0073] The input processing module 454 is configured to detect one or more user inputs or interactions from one of the one or more input devices 432 and to translate the detected inputs or interactions.

[0074] In some embodiments, the interactive processing device provided in the embodiments of the present application can be implemented in software. FIG3 shows an interactive processing device 455-1 stored in the memory 450, which can be software in the form of a program and a plug-in, including the following software modules: a display module 4551, an editing module 4552, and a sending module 4553. FIG3 also shows an interactive processing device 455-2 stored in the memory 450, which can be software in the form of a program and a plug-in, including the following software modules: a receiving module 4554, a viewing module 4555, and a comment module 4556. These modules are logical and can be arbitrarily combined or further split according to the functions implemented. The functions of each module will be explained below.

[0075] The interactive processing method provided in the embodiment of the present application will be described in conjunction with the exemplary application and implementation of the terminal provided in the embodiment of the present application.

[0076] Refer to Figure 4A, which is a flow chart of the interactive processing method provided in an embodiment of the present application, and will be explained in conjunction with the steps shown in Figure 4A.

[0077] In step 101, multimedia information to be edited is displayed.

[0078] In step 102 , a virtual image of at least one object is displayed.

[0079] As an example, when the multimedia information to be edited is displayed in the human-computer interaction interface, the virtual image of at least one object can be displayed synchronously in the human-computer interaction interface; or after the multimedia information to be edited is displayed in the human-computer interaction interface, the virtual image of at least one object is displayed through a triggering operation, and when the virtual image of at least one object is displayed, the multimedia information to be edited can remain displayed in the human-computer interaction interface.

[0080] As an example, the multimedia information to be edited may be an image or a video, and the avatar may be displayed in the form of an avatar sticker of the object (user).

[0081] As an example, there is an image selection portal in both the social dynamics publishing scenario and the instant messaging scenario, and in response to the image selection portal, multiple candidate images can be displayed. In response to the selection operation for the candidate image, the selected candidate image is used as the image to be edited. The image to be edited here is the image that the user is preparing to publish as a social dynamic or the image that is ready to be carried in a message and sent to a group chat. The image to be edited can be edited before it is sent. The embodiment of the present application provides an editing method for the image to be edited, that is, adding a virtual image sticker of an object to the image to be edited. The object here can refer to the user himself or a user who has a social relationship with the user. The social relationship here is not limited to the social relationship between the two parties. For example, if user A follows user B, but user B does not follow user A, it can also be considered that user A and user B have a social relationship.

[0082] In some embodiments, referring to FIG. 4B , displaying a virtual image of at least one object in step 102 may be implemented through steps 1021 to 1022 shown in FIG. 4B .

[0083] In step 1021, when the multimedia information to be edited is displayed, a selection entry is displayed.

[0084] In step 1022 , in response to a triggering operation for selecting a portal, a virtual image of at least one object is displayed.

[0085] Through the embodiment of the present application, a selection entry can be presented when presenting multimedia information to be edited to trigger the subsequent display of a virtual image of the object, thereby improving the efficiency of human-computer interaction.

[0086] As an example, referring to FIG6A , an image selection entry 601A is displayed in the human-computer interaction interface. In response to a trigger operation on the image selection entry 601A, candidate images are displayed. In response to a selection operation on any candidate image, the selected candidate image is used as the image to be edited, and the image to be edited 602A is displayed. In response to a trigger operation on the virtual image selection entry 603A (the selection entry involved in step 1021), a virtual image 604A of at least one object is displayed, including the user's own virtual image and the virtual images of other users.

[0087] In some embodiments, when displaying the virtual image of at least one object, the account identification of the object to which each virtual image belongs may also be displayed.

[0088] As an example, referring to FIG6B , virtual images 603B of multiple objects and account identifiers 604B of the objects to which the virtual images belong are displayed in the virtual image candidate area 602B. The account identifiers here can be nicknames, avatars, etc. of the objects in the social network.

[0089] By displaying the account ID of the object to which the virtual image belongs at the same time as the virtual image, the embodiment of the present application can present a one-to-one correspondence between the object and the virtual image, thereby helping the user to select a virtual image of the object that meets the user's expectations, avoiding the wrong selection of the virtual image, and improving the efficiency of human-computer interaction.

[0090] In some embodiments, when there are multiple virtual images, displaying the virtual image of at least one object in step 102 can be achieved through the following technical solutions: displaying the virtual images in at least one of the following orders: the order of the time when the virtual image was last added to the multimedia information to be edited, from recent to recent; the order of the frequency of the virtual image being added to the multimedia information to be edited, from high to low; the order of the frequency of interaction between the object corresponding to the virtual image and the editing object, from high to low, where the editing object is the object that triggers the send operation; and the order of the time when the object corresponding to the virtual image last interacted with the editing object, from recent to recent. Through the embodiments of the present application, virtual images can be recommended by display, thereby improving the efficiency of human-computer interaction.

[0091] As an example, virtual images can be displayed in order, for example, giving priority to displaying virtual images that have been recently added to the multimedia information to be edited, for example, giving priority to displaying virtual images that are frequently added to the multimedia information to be edited, for example, giving priority to displaying virtual images of other users who frequently interact with the user himself (the editing object), for example, giving priority to displaying virtual images of other users who have recently interacted with the user himself.

[0092] In some embodiments, displaying a virtual image of at least one object in step 102 can be achieved through the following technical solution: when the multimedia information to be edited includes any object, performing at least one of the following processes: displaying a virtual image of the object; displaying virtual images of other objects that have social relationships with the object. This embodiment of the present application allows displaying virtual images related to the content of the multimedia information, thereby enriching the visual effect and enhancing the editing experience.

[0093] As an example, the multimedia information to be edited can be an image or a video, and image recognition processing can be performed on the multimedia information using image processing technology. When the multimedia information to be edited is image A, it is recognized that image A includes object A, and at least one of the virtual image of object A and the virtual image of object B that has a social relationship with object A can be displayed; when the multimedia information to be edited is video C, key frames of video C are extracted, and image recognition processing is performed on each key frame to obtain the objects included in each key frame. For example, for key frame D, objects D1 and D2 can be recognized, and for key frame E, objects E1 and E2 can be recognized. Then, for key frame D, at least one of the virtual images of object D1, object D2, and object D3 that has a social relationship with objects D1 and D2 can be displayed, and for key frame E, at least one of the virtual images of object E1, object E2, and object E3 that has a social relationship with objects E1 and E2 can be displayed.

[0094] In some embodiments, before displaying the virtual image of at least one object, an object set is obtained; wherein the object set includes an edit object and an object having a social relationship with the edit object, the edit object is an object that triggers a send operation, each object in the object set has a corresponding virtual image, and based on the object set, a virtual image of each object in the object set is obtained. Specifically, an object set with virtual images is obtained from a server; wherein the object set includes an edit object and an object having a social relationship with the edit object, the edit object is an object that triggers a send operation; and based on the object set, a virtual image of each object in the object set is obtained from the server. Through the embodiments of the present application, an object set with virtual images can be first screened out, and then the virtual images corresponding to the objects in the object set can be obtained based on the object set, thereby improving the efficiency of obtaining virtual images and avoiding the need to obtain objects associated with the virtual images after directly obtaining the virtual images.

[0095] As an example, see Figure 7. In the application scenario of publishing social dynamics to the social network, an entrance to the friend's virtual image is added to the image editing interface, which is convenient for users to select the friend's virtual image when editing the image. After selection, the friend's virtual image can be quickly pasted on the image. Interaction between friends can be achieved through the virtual image. The client conducts logical interaction with the relationship chain background and the virtual image background to provide users with the ability to add the friend's virtual image to the image. After the user selects the friend's image, the client must first obtain the friend list with virtual images from the relationship chain background, and then request the friend's virtual image resource from the virtual image background through the pulled link list. The downloaded virtual image will be displayed on the corresponding list.

[0096] In step 103 , in response to at least one avatar being in a selected state, the synthesized multimedia information is displayed.

[0097] As an example, the synthesized multimedia information is obtained by adding a selected virtual image to the multimedia information to be edited.

[0098] In some embodiments, referring to FIG. 4C , before executing step 103 , step 105 or step 106 shown in FIG. 4C may also be executed.

[0099] In step 105 , in response to a selection operation on at least one virtual image, the at least one virtual image is displayed in a selected state.

[0100] As an example, referring to FIG. 6B , in response to a selection operation on any avatar, the avatar selected in the avatar candidate area 602B is displayed as selected, and the avatar 603B is added to the image 601B (multimedia information to be edited).

[0101] In step 106 , in response to at least one virtual image satisfying the adding condition, the at least one virtual image is displayed in a selected state.

[0102] In the embodiment of the present application, a virtual image can also be selected by automatic selection, and the automatically selected virtual image can be displayed as a selected state. The virtual image that meets the adding conditions can be automatically selected and displayed as a selected state.

[0103] In some embodiments, the adding condition includes at least one of the following: the avatar is the avatar that was most recently added to the multimedia information to be edited; the avatar is the avatar that is most frequently added to the multimedia information to be edited; the object corresponding to the avatar is the object that interacts most frequently with the editing object, wherein the editing object is the object that triggers the send operation; and the object corresponding to the avatar is the object that most recently interacted with the editing object. By automatically selecting the avatar in the embodiments of the present application, the user selection process is avoided, thereby improving the efficiency of human-computer interaction.

[0104] As an example, for the editing object A, the editing object A here is the object that is ready to send or publish the multimedia information to be edited. The virtual image of the editing object A that was most recently added can be used as the automatically selected virtual image, the virtual image of the editing object A that is most frequently added can be used as the automatically selected virtual image, the virtual image of the object B that interacts with the editing object A most frequently can be used as the automatically selected virtual image, and the virtual image of the object B that interacted with the editing object A most recently can be used as the automatically selected virtual image.

[0105] In step 104 , in response to a sending operation on the synthesized multimedia information, the synthesized multimedia information is sent, and a reminder message is sent to a target object.

[0106] As an example, the target object is the object to which the virtual image included in the synthetic multimedia information belongs, and the reminder message is used to remind the target object to view the synthetic multimedia information. There are two application scenarios for sending the synthetic multimedia information. It can be sending the synthetic multimedia information to a social network or sending the synthetic multimedia information to a certain group chat.

[0107] In some embodiments, referring to FIG. 4D, the sending of the synthetic multimedia information in step 104 can be implemented through step 1041 or step 1042 shown in FIG. 4D.

[0108] In step 1041, the synthetic multimedia information is carried in a first session message to be sent to a target group, where the target group includes at least one target object.

[0109] In some embodiments, after carrying the synthetic multimedia information in the first session message to be sent to the target group, any one of the following processes is performed: displaying the first session message carrying the synthetic multimedia information in the session interface of the target group; displaying the first session message carrying the synthetic multimedia information in the session interface of the target group and displaying a second session message in the session interface of the target group, where the second session message includes the account identifier of the target object and a reminder symbol for each account identifier. Through the embodiments of the present application, the display or hiding of the display text prompt can be achieved, thereby improving the utilization rate of display resources.

[0110] As an example, the embodiments of the present application can also be applied in an instant messaging APP. When an image is selected to be sent in an instant chat window, the virtual image of a friend is added to the image. After the image is sent, a message for reminding the corresponding friend will be automatically generated. Referring to FIG. 6E, an image selection entry 601E is displayed in the session interface. In response to a trigger operation on the image selection entry 601E, candidate images are displayed. In response to a selection operation on any one of the candidate images, the selected candidate image is used as the image to be edited, and the image to be edited 602E is displayed. In response to a trigger operation on the virtual image selection entry, virtual images 603E of multiple friends are displayed. The virtual image 603E in the selected state is added to the image to be edited 602E. In response to a trigger operation on the completion control 604E, a synthetic image including the virtual image (the synthetic multimedia information in the first session message) is displayed in the session interface, and a message including a reminder text 605E (the second session message) is displayed in the session interface. Here, the reminder text includes the account identifier and a reminder symbol. For example, in the reminder text "@Wenwen", the account identifier is "Wenwen" and the reminder symbol is "@".

[0111] In some embodiments, after the composite multimedia information is carried in a first conversation message and sent to a target group, in response to the target subject's comment operation on the composite multimedia information, the comment information is displayed in the position corresponding to the target virtual image in the composite multimedia information included in the first conversation message; or in response to the target subject's comment operation on the composite multimedia information, a third conversation message sent by the target subject is displayed, wherein the third conversation message includes the composite multimedia information, and the comment information is displayed in the position corresponding to the target virtual image in the composite multimedia information of the third conversation message; wherein the target virtual image is the virtual image corresponding to the target subject in the composite multimedia information, and the comment information is information entered through the comment operation. Through embodiments of the present application, comment information can be updated and displayed directly in the first conversation message, thereby improving display resource utilization, or comment information can be displayed in a separate third conversation message, thereby displaying the commented information and the comment information separately, thereby optimizing the display effect.

[0112] As an example, a first conversation message will be displayed in the conversation interface. The first conversation message is a message sent by the editing object and carries synthetic multimedia information. The synthetic multimedia message includes a virtual image of the target object A. The target object A triggers a comment operation on the synthetic multimedia information. The comment operation here can be an operation of long pressing the first conversation message and clicking the reply control. The comment information is entered through the comment operation. The entered comment information can be directly displayed at the virtual image of the target object A in the synthetic multimedia information of the first conversation message, that is, the first conversation message is a message that can be updated, or the target object can also directly send a third conversation message. The third conversation message also carries synthetic multimedia information, and the comment information is displayed at the position corresponding to the virtual image on the synthetic multimedia information of the third conversation message.

[0113] In step 1042 , the synthesized multimedia information is published to a social network, wherein at least one target object has a social account of the social network.

[0114] In some embodiments, when the synthesized multimedia information is sent to a social network, before responding to the sending operation for the synthesized multimedia information, in response to the completion of the editing operation for the synthesized multimedia information, a social dynamic editing interface is displayed; the synthesized multimedia information to be sent is displayed in the multimedia area of the social dynamic editing interface; in response to the triggering operation for the sending control, the triggering operation is recognized as the sending operation for the synthesized multimedia information; when the synthesized multimedia information to be sent is displayed in the multimedia area of the social dynamic editing interface, the account identifier of the target object and a reminder symbol for each account identifier are displayed in the text area of the social dynamic editing interface. Through the embodiments of the present application, when the synthesized multimedia information to be sent is displayed, the account identifier of the target object and the reminder symbol for each account identifier can be displayed simultaneously, so as to visually present the reminder of the virtual image in the form of text, thereby improving the utilization rate of display resources.

[0115] As an example, when the user adds the virtual image of a friend to an image, the corresponding friend is automatically @ in the text of the social dynamic that the user is about to post, that is, there is no need for manual input. After the social dynamic including the image is posted, the corresponding friend will be reminded to view. The friend will receive a message notification, and clicking on this message can view this social dynamic. Referring to FIG. 6C, the text 602C edited by the user is displayed in the editing area 601C (social dynamic editing interface), and the virtual image 604C is included in the image 603C (synthesized multimedia information to be sent). Therefore, the reminder text 605C for the friend to whom the virtual image 604C belongs can be automatically displayed after the text 602C. Whether the reminder text is displayed or not, a reminder message can be sent to the friend to whom the virtual image 604C belongs. The reminder text here includes the account identifier and the reminder symbol. For example, the reminder text "@Wenwen" includes the account identifier "Wenwen" and the reminder symbol "@".

[0116] In some embodiments, when the synthesized multimedia information is sent to a social network, in response to the comment operation of the target object on the synthesized multimedia information, the comment information on the synthesized multimedia information is displayed at the position corresponding to the virtual image of the target object on the synthesized multimedia information. Through the embodiments of the present application, the comment information, the object, and the virtual image can be presented in an associated manner, so that the associated relationship can be reflected while the comment information is displayed, thereby improving the utilization rate of display resources.

[0117] As an example, when the reminded user comments on this social dynamic, the latest message he comments on will be displayed at the corresponding virtual image on the image (synthesized multimedia information). Referring to FIG. 6D, a social dynamic 601D is displayed in the social network. The social dynamic 601D includes an image 602D. The comment information 603D posted by friend A will be displayed in the comment area and also at the corresponding virtual image of friend A on the image 602D.

[0118] In some embodiments, referring to FIG5 , FIG5 is a flow chart of the interactive processing method provided in an embodiment of the present application, which will be described in conjunction with the steps shown in FIG5 .

[0119] In step 501, a reminder message is received through a client of a target object.

[0120] In step 502 , in response to a triggering operation on a reminder message, synthesized multimedia information is displayed, where the synthesized multimedia information includes a virtual image of a target object.

[0121] In step 503 , in response to the target object's comment operation on the synthesized multimedia information, comment information corresponding to the target object's virtual image is displayed on the synthesized multimedia information.

[0122] The specific implementation of step 503 may refer to the specific implementation of comment interaction in the above embodiment.

[0123] In some embodiments, when the composite multimedia information is sent to a social network, in response to a comment operation of a target object on the composite multimedia information, comment information on the composite multimedia information is displayed at a position corresponding to the target object's virtual image on the composite multimedia information.

[0124] In some embodiments, when the target object receives a reminder message through a target group, the synthesized multimedia information is carried in a first conversation message received by the target group, and in response to the target object's comment operation on the synthesized multimedia information, the comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information included in the first conversation message; or in response to the target object's comment operation on the synthesized multimedia information, a second conversation message sent by the target object is displayed, wherein the second conversation message includes the synthesized multimedia information, and the comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information of the second conversation message; wherein the target virtual image is the virtual image corresponding to the target object in the synthesized multimedia information, and the comment information is information input through the comment operation.

[0125] Through the embodiment of the present application, multimedia information to be edited and a virtual image of at least one object are displayed. In response to at least one virtual image being in a selected state, a synthetic multimedia information obtained by adding the selected virtual image to the multimedia information to be edited is displayed. This is equivalent to achieving a visual effect of being in the same frame with the virtual image of the object by editing the multimedia information. Subsequently, when sending the synthetic multimedia information, a reminder message will also be sent to the object to which the virtual image included in the synthetic multimedia information belongs, so as to remind the target object to view the synthetic multimedia information. That is, adding a virtual image can replace the reminder operation, thereby effectively improving the efficiency of human-computer interaction while enriching the visual effect.

[0126] The following describes an exemplary application of the embodiments of the present application in a practical application scenario.

[0127] In some embodiments, the multimedia information to be edited is displayed on a first terminal logged in by a first account. In response to a trigger operation for selecting an entry, the first terminal sends a virtual image acquisition request to the server to obtain the virtual image of the second account. The first terminal displays the virtual image of the second account. In response to the virtual image selection operation, the virtual image is added to the multimedia information to be edited to display the synthesized multimedia information. In response to the sending operation for the synthesized multimedia information, the first terminal sends the synthesized multimedia information and a reminder message to the server so that the server sends the multimedia information and the reminder message to the second terminal. In response to the second terminal receiving a comment operation, the second terminal sends the comment information to the server. The server adds the comment information to the position of the virtual image of the second account in the synthesized multimedia information, and returns the synthesized multimedia information with the added comment information to the first terminal and the second terminal for display.

[0128] The embodiment of the present application provides a method of using virtual image stickers to remind friends. When a user posts an image, he or she can add a friend's virtual image sticker to the image to decorate the image, achieving the effect of being in the same frame with the friend virtually. When such an image with a virtual image sticker is posted, the friend with the corresponding virtual image sticker will be automatically reminded, and the friend will receive a message reminder to view the image. In addition, the corresponding friend's comments under this content will also be displayed on the virtual image of the image. During the process of the user editing the image, no additional operations are required and friends can be directly reminded. This way of reminding friends is more natural and interesting. The embodiment of the present application can be applied to information flow apps and instant messaging apps.

[0129] In some embodiments, when a user posts an image on a social network, they can open a friend avatar portal in the image editor, displaying the avatars of all their friends. Referring to FIG6A , the human-computer interaction interface displays an image selection portal 601A. In response to a triggering operation on image selection portal 601A, candidate images are displayed. In response to a selection operation on any candidate image, the selected candidate image is selected as the image to be edited, and the image to be edited 602A is displayed. In response to a triggering operation on avatar selection portal 603A, multiple avatars 604A of friends are displayed.

[0130] In some embodiments, after a user clicks on a friend's avatar, they can add the friend's avatar to the image, creating a virtual co-frame effect. Referring to FIG6B , the human-computer interaction interface displays an image 601B, and displays multiple friend avatars 603B and the account identifiers 604B of the entities to which the avatars belong in an avatar candidate area 602B. In response to a selection operation on any avatar, avatar 603B is added to image 601B, and the selected avatar in avatar candidate area 602B is displayed as selected.

[0131] In some embodiments, after a user adds a friend's avatar to an image, the user automatically @s the corresponding friend in the text of the social update they are about to post. This means that no manual input is required. After the social update including the image is posted, the corresponding friend will be reminded to view it. The friend will receive a message notification and can click on it to view the social update. Referring to Figure 6C, the user-edited text 602C is displayed in the editing area 601C. Because the image 603C includes an avatar 604C, a reminder text 605C for the friend to whom the avatar 604C belongs automatically appears after the text 602C. Since the reminder text is included in the social update, a reminder message can be sent to the friend. After the social update is posted, the social update 606C is displayed on the social network's homepage, and a reminder message 607C is displayed on the friend's client.

[0132] In some embodiments, when the alerted user comments on the social dynamic, the latest message they commented on is displayed on the corresponding avatar in the image. Referring to Figure 6D, a social dynamic 601D is displayed on the social network, including an image 602D. A comment 603D posted by friend A is displayed in the comment area and also displayed on the avatar corresponding to friend A in image 602D.

[0133] In some embodiments, embodiments of the present application can also be applied to instant messaging apps. In an instant chat window, selecting to send an image adds a friend's avatar to the image, and automatically generating a message to remind the corresponding friend after the image is sent. Referring to FIG6E , an image selection entry 601E is displayed in the conversation interface. In response to a triggering operation on the image selection entry 601E, candidate images are displayed. In response to a selection operation on any candidate image, the selected candidate image is selected as the image to be edited, and the image to be edited 602E is displayed. In response to a triggering operation on the avatar selection entry, multiple friend's avatars 603E are displayed, and the selected avatar 603E is added to the image to be edited 602E. In response to a triggering operation on the completion control 604E, a composite image including the avatar is displayed in the conversation interface, and a message including reminder text 605E is displayed in the conversation interface.

[0134] In some embodiments, as shown in FIG7 , in the application scenario of posting social updates to a social network, a friend avatar entry is added to the image editing interface. This allows users to select a friend's avatar when editing an image. After selecting a friend, the avatar can be quickly attached to the image. Avatars enable interaction between friends. The client logically interacts with the relationship chain backend and the avatar backend, providing the user with the ability to add a friend's avatar to an image. After the user selects a friend's avatar, the client first retrieves a list of friends with avatars from the relationship chain backend. Then, using the retrieved list, the avatar backend requests the friend's avatar resource. The downloaded avatar is then displayed in the corresponding list. Specifically, the avatar backend performs a download permission check to verify the legitimacy of the token included in the user's request. The token included in the user's request is also a token generated by the relationship chain backend for easy verification. The token included in the user's request serves as proof of the user's legal identity. Whether a user has an avatar is marked in the relationship chain, and avatar-related data is maintained by the avatar backend. In this embodiment of the application, this avatar-related data is stored in the avatar backend. 8 , each virtual image is an image set by a user's friend, and the friend's name will be displayed on the virtual image, making it easier for the user to identify the image of each friend.

[0135] In some embodiments, the following describes the implementation of virtual co-framing. See Figure 9A . When posting a social update, users can add an image and interactively edit the image. They can also combine a friend's avatar with the image. See Figure 9B . Users can select a friend's avatar from the friend avatar list to blend with the image. In the image editing interface, the image serves as the background, and the selected friend's avatar appears side by side on the image. Each avatar previewed during the editing phase is a separate avatar image resource, each independent entity allowing the user to preview the editing effect. See Figure 10 . Once the user has finished editing and publishes the image, the corresponding image and the selected avatar image are blended into a single image and published. When the image is published, the image's related information includes the coordinates of each avatar, making it easier to attach comments to the corresponding avatar when responding to friends. A single image corresponds to multiple avatar information, including the avatar's corresponding friend's social account information and coordinates.

[0136] In some embodiments, the technical implementation of the reminder function after adding an avatar to an image is introduced below. Referring to FIG. 11A, after the user edits the image and publishes the image, in order to increase the interaction between users, the friends added with avatars will be notified. To facilitate notifying the friends added with avatars in a timely manner and reminding them to view the published image, referring to FIG. 11B, when the user finishes editing the image, a reminder text will be automatically added to the social dynamic. The reminder text includes the information of the friends added with avatars. Through the reminder ability of the reminder text (@someone), the published image can be conveyed to the friends in a timely manner, and the friends can also view the image in a timely manner through the reminder message (space message). Through the reminder ability of the reminder text (@someone), the space message is used as the reminder message to convey the published image. The friends can click on the published image in the space message. Referring to FIG. 12, in step 1201, the edited image is displayed. In step 1202, it is judged whether there is an avatar. When there is no avatar, step 1203 is executed. In step 1203, the image is displayed. When there is an avatar, step 1204 is executed. In step 1204, the avatar list is traversed. In step 1205, a reminder text is added to the social dynamic. The corresponding reminder text "@someone" is added to the content of the social dynamic. The friend source is the friend corresponding to the avatar selected in the image editing. The timing of adding the content of the social dynamic is when returning to the waiting-to-send interface after editing the image. The client can automatically add the reminder text to the content of the social dynamic according to the avatar selected by the user, so that the friends to be reminded can be quickly added, and the friends can be notified by sending the reminder text.

[0137] In some embodiments, the function implementation of attaching friend comment information to an image is introduced below. Referring to FIG. 13A, in order to highlight the interaction between virtual image friends in the social dynamic, when there is a comment from a corresponding friend for the virtual image added to the image, the comment information will be attached to the image, facilitating the timely perception of the interaction information between friends. Referring to FIG. 13B, when the image is published, the edited friend virtual image and the image to be edited will be mixed into one image. The synthesized image will carry the information of the virtual image friend, including the account of the corresponding virtual image friend. At the same time, the coordinates of the virtual image in the image will also exist. The function of the coordinates is to locate the comment when attaching it to the image of the status update. When displaying the social dynamic, if there is image information, the image will be used as the background when displayed, and at the same time, the friend comment information will be superimposed on the image background. The position of the comment information in the image display area is determined according to the virtual image information. If there is a corresponding virtual image added by the author of the comment in the image, the comment information needs to be superimposed on the image.

[0138] In some embodiments, the following describes a solution that supports image stickers with reminder functions in chat and message sending scenarios. See Figure 14A. The ability to add friend avatars to images is not limited to social dynamics posting on social networks, but can also be used to send image messages to group chats. When sending, an image editing interface will appear after selecting an image. Implementing reminder functions by adding friend avatars to images is a universal component that can be directly reused by various services. See Figure 14B. For this universal component, after the service call is completed, the synthesized image will be returned to the service. It will also return a list of selected friend avatars, including the friend's account number and the avatar's coordinate information in the image. Similar to the images in social dynamics, the logical processing flow of sending messages can be seen in Figure 15. In step 1501, the image selection interface is displayed. In step 1502, the image editing process is performed. In step 1503, the image information and image data information are obtained. In step 1504, the composite image is sent. In step 1505, it is determined whether there is a virtual image. If so, step 1506 is executed. In step 1506, the virtual image list is traversed. In step 1507, a reminder text for friends is added to the chat. In step 1508, a message including the reminder text is sent.

[0139] The embodiments of the present application are not limited to realizing the ability to add a virtual image to an image when posting social updates. The function of editing and selecting a friend's virtual image when selecting an image to realize a reminder function for friends is encapsulated into a universal component. Various businesses can realize their demands through this universal component. The component can provide the business party with the synthesized image and information related to the friend's virtual image.

[0140] The embodiment of the present application provides a function of using a friend's virtual image sticker to remind a friend. When a user posts image content, he or she can add a friend's virtual image sticker to the image to decorate the image, achieving the effect of being in the same frame with the friend virtually. In the embodiment of the present application, when such image content with a virtual image sticker is posted, the friend corresponding to the virtual image attached to the image will be automatically reminded, and the friend will receive a message reminding him or her to view this content. And the corresponding friend's comments under this content will also be displayed on the virtual image of the image. In the process of the user editing the image, additional operations are eliminated and the other party can be reminded directly. This way of prompting friends to view is more natural and interesting. The embodiment of the present application can be applied to information flow APPs and instant messaging APPs, reducing the operating cost of users reminding friends to view content and increasing the interaction rate between friends.

[0141] It is understandable that in the embodiments of the present application, when user information and other related data are involved, when the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.

[0142] In this application, the implementation of the data acquisition technical solution involved, when the above embodiments of this application are applied to specific products or technologies, the relevant data collection, use and processing processes should comply with the requirements of national laws and regulations, comply with the principles of legality, legitimacy and necessity, do not involve the acquisition of data types prohibited or restricted by laws and regulations, and will not hinder the normal operation of the target website.

[0143] The following continues to describe an exemplary structure of the interactive processing device 455-1 provided in an embodiment of the present application implemented as a software module. In some embodiments, as shown in Figure 2, the software modules stored in the interactive processing device 455-1 in the memory 450 may include: a display module 4551, configured to display multimedia information to be edited; display a virtual image of at least one object; an editing module 4552, configured to display synthetic multimedia information in response to at least one of the virtual images being in a selected state, wherein the synthetic multimedia information is obtained by adding a selected virtual image to the multimedia information to be edited; a sending module 4553, configured to send the synthetic multimedia information in response to a sending operation for the synthetic multimedia information, and send a reminder message to the target object, wherein the target object is the object to which the virtual image included in the synthetic multimedia information belongs, and the reminder message is used to remind the target object to view the synthetic multimedia information.

[0144] In some embodiments, the display module 4551 is further configured to: display a selection entry when displaying the multimedia information to be edited; display a virtual image of at least one object in response to a triggering operation on the selection entry; and display the account identification of the object to which each virtual image belongs.

[0145] In some embodiments, the display module 4551 is further configured to: display the virtual image in at least one of the following orders: the time when the virtual image was last added to the multimedia information to be edited, from near to far; the frequency of the virtual image being added to the multimedia information to be edited, from high to low; the frequency of interaction between the object corresponding to the virtual image and the editing object, from high to low, wherein the editing object is the object that triggers the sending operation; the time when the object corresponding to the virtual image last interacted with the editing object, from near to far.

[0146] In some embodiments, the display module 4551 is further configured to: when the multimedia information to be edited includes any object, perform at least one of the following processes: display a virtual image of any object; display virtual images of other objects that have a social relationship with any object.

[0147] In some embodiments, the display module 4551 is further configured to: obtain an object set before displaying a virtual image of at least one object; wherein the object set includes an editing object and an object having a social relationship with the editing object, the editing object is the object that triggers the sending operation, and each object in the object set has a corresponding virtual image; obtain the virtual image of each object in the object set based on the object set.

[0148] In some embodiments, before responding to at least one of the virtual images being in the selected state, the editing module 4552 is further configured to: display at least one of the virtual images in the selected state in response to a selection operation on at least one of the virtual images; or display at least one of the virtual images in the selected state in response to at least one of the virtual images satisfying an adding condition.

[0149] In some embodiments, the adding condition includes at least one of the following: the virtual image is the virtual image that was most recently added to the multimedia information to be edited; the virtual image is the virtual image that is most frequently added to the multimedia information to be edited; the object corresponding to the virtual image is the object that interacts most frequently with the editing object, wherein the editing object is the object that triggers the sending operation; the object corresponding to the virtual image is the object that most recently interacted with the editing object.

[0150] In some embodiments, the sending module 4553 is configured to: carry the synthesized multimedia information in a first conversation message to send it to a target group, wherein the target group includes at least one of the target objects; or publish the synthesized multimedia information to a social network, wherein at least one of the target objects has a social account of the social network.

[0151] In some embodiments, after the synthesized multimedia information is carried in a first conversation message and sent to the target group, the sending module 4553 is configured to: perform any one of the following processes: display the first conversation message carrying the synthesized multimedia information in the conversation interface of the target group; display the first conversation message carrying the synthesized multimedia information in the conversation interface of the target group, and display a second conversation message in the conversation interface of the target group, wherein the second conversation message includes the account identifier of the target object and a reminder symbol for each of the account identifiers.

[0152] In some embodiments, after the synthesized multimedia information is carried in a first conversation message and sent to a target group, the device further includes a comment module configured to: display comment information at a position corresponding to a target virtual image in the synthesized multimedia information included in the first conversation message in response to a comment operation by the target object on the synthesized multimedia information; or display a third conversation message sent by the target object in response to a comment operation by the target object on the synthesized multimedia information, wherein the second conversation message includes the synthesized multimedia information, and comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information of the third conversation message; wherein the target virtual image is a virtual image corresponding to the target object in the synthesized multimedia information, and the comment information is information input through the comment operation.

[0153] In some embodiments, when the synthesized multimedia information is sent to a social network, before responding to a sending operation on the synthesized multimedia information, the sending module 4553 is configured to: display a social dynamic editing interface in response to a completed editing operation on the synthesized multimedia information; display the synthesized multimedia information to be sent in the multimedia area of ​​the social dynamic editing interface; in response to a trigger operation on a send control, identify the trigger operation as a sending operation on the synthesized multimedia information; and display the account identification of the target object and a reminder symbol for each account identification in the text area of ​​the social dynamic editing interface.

[0154] In some embodiments, when the synthetic multimedia information is sent to a social network, the comment module is further configured to display comment information on the synthetic multimedia information at a position corresponding to the virtual image of the target object on the synthetic multimedia information in response to the comment operation of the target object on the synthetic multimedia information.

[0155] The following continues to describe an exemplary structure of the interactive processing device 455-2 provided in an embodiment of the present application implemented as a software module. In some embodiments, as shown in Figure 2, the software module stored in the interactive processing device 455-2 of the memory 450 may include: a receiving module 4554, configured to receive a reminder message; a viewing module 4555, configured to display synthetic multimedia information in response to a trigger operation on the reminder message, wherein the synthetic multimedia information includes a virtual image of the target object; a comment module 4556, configured to display comment information corresponding to the virtual image of the target object on the synthetic multimedia information in response to a comment operation of the target object on the synthetic multimedia information.

[0156] The present invention provides a computer program product comprising computer-executable instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer-executable instructions from the computer-readable storage medium and executes the computer-executable instructions, causing the electronic device to perform the interactive processing method described above in the present invention.

[0157] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, the processor will execute the interactive processing method provided in the embodiment of the present application, for example, the interactive processing method shown in Figures 4A-4D.

[0158] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or various devices including one or any combination of the above memories.

[0159] In some embodiments, computer-executable instructions may be in the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0160] As an example, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file that stores other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinating files (e.g., files storing one or more modules, subroutines, or code portions).

[0161] By way of example, computer-executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed across multiple sites and interconnected by a communication network.

[0162] To sum up, the embodiments of the present application display multimedia information to be edited and a virtual image of at least one object. In response to at least one virtual image being in a selected state, the synthesized multimedia information obtained by adding the selected virtual image to the multimedia information to be edited is displayed. This is equivalent to achieving a visual effect of being in the same frame with the virtual image of the object by editing the multimedia information. Subsequently, when sending the synthesized multimedia information, a reminder message will also be sent to the object to which the virtual image included in the synthesized multimedia information belongs, so as to remind the target object to view the synthesized multimedia information. That is, adding a virtual image can replace the reminder operation, thereby enriching the visual effect while effectively improving the efficiency of human-computer interaction.

[0163] The above description is merely an embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, and improvements made within the spirit and scope of the present application are included in the scope of protection of the present application.

Claims

1. An interactive processing method, the method being executed by an electronic device, the method comprising: Display multimedia information to be edited; displaying an avatar of at least one object; In response to at least one of the virtual images being in a selected state, displaying synthesized multimedia information, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited; In response to a sending operation for the synthesized multimedia information, the synthesized multimedia information is sent, and a reminder message is sent to a target object, wherein the target object is an object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.

2. The method according to claim 1, wherein: The displaying of a virtual image of at least one object comprises: When displaying the multimedia information to be edited, displaying a selection entry; In response to a trigger operation on the selection entry, displaying a virtual image of the at least one object; The method further comprises: The account identification of the object to which each virtual image belongs is displayed.

3. The method according to claim 1 or 2, wherein: When there are multiple virtual images, displaying the virtual image of at least one object includes: The virtual image is displayed in at least one of the following sequences: The order of the time when the virtual image was last added to the multimedia information to be edited from recent to distant; The order of the frequencies of adding the virtual images to the multimedia information to be edited from high to low; the order of interaction frequency between the object corresponding to the avatar and the editing object from high to low, wherein the editing object is the object that triggers the sending operation; The order of the time when the object corresponding to the virtual image last interacted with the editing object from near to far.

4. The method according to any one of claims 1 to 3, wherein: The displaying of a virtual image of at least one object comprises: When the multimedia information to be edited includes any object, at least one of the following processes is performed: displaying a virtual image of any one of the objects; Display virtual images of other objects having social relationships with any of the objects.

5. The method according to any one of claims 1 to 4, wherein: Before displaying the virtual image of at least one object, the method further includes: Get a collection of objects; The object set includes an editing object and an object having a social relationship with the editing object, the editing object is an object that triggers the sending operation, and each object in the object set has a corresponding virtual image; A virtual image of each object in the object set is obtained based on the object set.

6. The method according to any one of claims 1 to 5, wherein: Before responding to at least one of the virtual images being in a selected state, the method further includes: In response to a selection operation on at least one of the virtual images, displaying at least one of the virtual images in the selected state; or In response to at least one of the virtual images satisfying the adding condition, displaying at least one of the virtual images in the selected state.

7. The method according to claim 6, wherein: The adding condition includes at least one of the following: The virtual image is the virtual image that was most recently added to the multimedia information to be edited; The virtual image is the virtual image most frequently added to the multimedia information to be edited; The object corresponding to the virtual image is the object with the highest interaction frequency with the editing object, wherein the editing object is the object that triggers the sending operation; The object corresponding to the virtual image is the object that most recently interacted with the editing object.

8. The method according to any one of claims 1 to 7, wherein: The sending of the synthesized multimedia information comprises: carrying the synthesized multimedia information in a first session message to send the message to a target group, wherein the target group includes at least one target object; or The synthesized multimedia information is published to a social network, wherein at least one of the target objects has a social account of the social network.

9. The method according to claim 8, wherein: After the synthesized multimedia information is carried in the first session message to be sent to the target group, the method further includes: Perform any of the following: Displaying a first conversation message carrying the synthesized multimedia information in a conversation interface of the target group; A first conversation message carrying the synthesized multimedia information is displayed in the conversation interface of the target group, and a second conversation message is displayed in the conversation interface of the target group, wherein the second conversation message includes the account identifier of the target object and a reminder symbol for each of the account identifiers.

10. The method according to claim 8, wherein: After the synthesized multimedia information is carried in the first session message to be sent to the target group, the method further includes: In response to the target object's comment operation on the composite multimedia information, displaying the comment information at a position corresponding to the target virtual image in the composite multimedia information included in the first conversation message; or In response to the target object's comment operation on the synthesized multimedia information, displaying a third conversation message sent by the target object, wherein the third conversation message includes the synthesized multimedia information, and the comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information of the third conversation message; The target virtual image is a virtual image corresponding to the target object in the synthesized multimedia information, and the comment information is information input through the comment operation.

11. The method according to any one of claims 1 to 10, wherein: When the synthesized multimedia information is sent to a social network, before responding to a sending operation for the synthesized multimedia information, the method further includes: In response to completing the editing operation on the synthesized multimedia information, displaying a social dynamics editing interface; Displaying the synthesized multimedia information to be sent in the multimedia area of ​​the social dynamics editing interface; In response to a trigger operation on a sending control, identifying the trigger operation as a sending operation on the synthesized multimedia information; The method further comprises: When the synthesized multimedia information to be sent is displayed in the multimedia area of ​​the social dynamics editing interface, the account identification of the target object and a reminder symbol for each of the account identifications are displayed in the text area of ​​the social dynamics editing interface.

12. The method according to any one of claims 1 to 11, wherein: When the synthesized multimedia information is sent to a social network, the method further comprises: In response to the comment operation of the target object on the composite multimedia information, the comment information on the composite multimedia information is displayed at a position on the composite multimedia information corresponding to the virtual image of the target object.

13. An interactive processing method, characterized in that: The method comprises: Receive reminder messages through the client of the target object; In response to a triggering operation on the reminder message, displaying synthesized multimedia information, wherein the synthesized multimedia information includes a virtual image of the target object; In response to the target object's comment operation on the composite multimedia information, comment information corresponding to the target object's virtual image is displayed on the composite multimedia information.

14. An interactive processing device, characterized in that: The device comprises: A display module configured to display the multimedia information to be edited; and display a virtual image of at least one object; an editing module, configured to display synthesized multimedia information in response to at least one of the virtual images being in a selected state, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited; A sending module is configured to send the synthesized multimedia information in response to a sending operation for the synthesized multimedia information, and to send a reminder message to a target object, wherein the target object is an object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.

15. An interactive processing device, characterized in that: The device comprises: A receiving module configured to receive a reminder message; A viewing module configured to display the synthesized multimedia information in response to a triggering operation on the reminder message, wherein the synthesized multimedia information includes a virtual image of the target object; The comment module is configured to display comment information corresponding to the virtual image of the target object on the synthetic multimedia information in response to the comment operation of the target object on the synthetic multimedia information.

16. An electronic device, comprising: A memory for storing computer executable instructions; A processor, used to implement the interactive processing method described in any one of claims 1 to 12 or 13 when executing the computer executable instructions stored in the memory.

17. A computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the interactive processing method according to any one of claims 1 to 12 or 13.

18. A computer program product, comprising computer executable instructions, which, when executed by a processor, implement the interactive processing method according to any one of claims 1 to 12 or 13.

Images