Interaction processing method and device, electronic equipment, storage medium and program product
By adding virtual images to images in social information flow and instant messaging products, generating synthetic multimedia information and sending reminder messages, the problem of cumbersome reminder process in the existing technology is solved, and more efficient human-computer interaction and visual effect improvement is achieved. .
Patent Information
- Application Number
- CN202310724118.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-06-16
- Publication Date
- 2024-12-17
AI Technical Summary
In existing social information flow and instant messaging products, when users publish or send images, the process of reminding each other is cumbersome and the visual effect is not outstanding enough, resulting in low human-computer interaction efficiency.
By displaying and adding virtual images on the multimedia information to be edited, synthesized multimedia information is generated and accompanied by reminder messages when sent, the virtual image reminder function is realized, replacing traditional reminder operations, enriching visual effects and improving interaction efficiency.
It effectively improves the efficiency of human-computer interaction, simplifies the reminder process, enhances the visual effect, and allows users to remind friends to view content without additional operations.
Smart Images

Figure CN119155518A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to human-computer interaction technology, and in particular to an interactive processing method, device, electronic device, computer-readable storage medium and computer program product. Background Art
[0002] In social information flow products and instant messaging products of related technologies, if users want to post images on social networks or send images to group chats, they can edit text to remind the other party (@someone) while posting or sending images so that the other party can know the content they posted, or select friends to be reminded in the list options, thereby realizing a strong reminder function. However, the reminder method in related technologies has a long and boring process, and the final presentation effect is only a reminder text, which has the problem of redundant human-computer interaction process and insufficient visual effect. Summary of the invention
[0003] The embodiments of the present application provide an interactive processing method, device, electronic device, computer-readable storage medium and computer program product, which can use virtual images to realize reminder functions, thereby improving the efficiency of human-computer interaction.
[0004] The technical solution of the embodiment of the present application is implemented as follows:
[0005] The present application embodiment provides an interactive processing method, including:
[0006] Display multimedia information to be edited;
[0007] displaying an avatar of at least one object;
[0008] In response to at least one of the virtual images being in a selected state, displaying synthesized multimedia information, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited;
[0009] In response to a sending operation for the synthesized multimedia information, the synthesized multimedia information is sent, and a reminder message is sent to a target object, wherein the target object is an object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.
[0010] The present application embodiment provides an interactive processing device, including:
[0011] A display module, used for displaying the multimedia information to be edited; and displaying a virtual image of at least one object;
[0012] An editing module, configured to display synthesized multimedia information in response to at least one of the virtual images being in a selected state, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited;
[0013] A sending module is used to send the synthesized multimedia information in response to a sending operation for the synthesized multimedia information, and to send a reminder message to a target object, wherein the target object is the object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.
[0014] The present application provides an interactive processing method, the method comprising:
[0015] Receive reminder messages through the client of the target object;
[0016] In response to a triggering operation on the reminder message, displaying synthesized multimedia information, wherein the synthesized multimedia information includes a virtual image of the target object;
[0017] In response to the target object's comment operation on the composite multimedia information, comment information corresponding to the target object's virtual image is displayed on the composite multimedia information.
[0018] The present application embodiment provides an interactive processing device, including:
[0019] A receiving module, used for receiving a reminder message;
[0020] A viewing module, configured to display the synthesized multimedia information in response to a triggering operation on the reminder message, wherein the synthesized multimedia information includes a virtual image of the target object;
[0021] The comment module is used for displaying comment information corresponding to the virtual image of the target object on the synthetic multimedia information in response to the comment operation of the target object on the synthetic multimedia information.
[0022] An embodiment of the present application provides an electronic device, including:
[0023] A memory for storing computer executable instructions;
[0024] The processor is used to implement the interactive processing method provided in the embodiment of the present application when executing the computer executable instructions stored in the memory.
[0025] An embodiment of the present application provides a computer-readable storage medium storing computer-executable instructions for causing a processor to execute and implement the interactive processing method provided in the embodiment of the present application.
[0026] An embodiment of the present application provides a computer program product, including computer executable instructions, which, when executed by a processor, implement the interactive processing method provided in the embodiment of the present application.
[0027] The embodiments of the present application have the following beneficial effects:
[0028] Through the embodiment of the present application, multimedia information to be edited and a virtual image of at least one object are displayed. In response to at least one virtual image being in a selected state, synthetic multimedia information obtained by adding the selected virtual image to the multimedia information to be edited is displayed. This is equivalent to achieving a visual effect of being in the same frame with the virtual image of the object by editing the multimedia information. Subsequently, when the synthetic multimedia information is sent, a reminder message will also be sent to the object to which the virtual image included in the synthetic multimedia information belongs, so as to remind the target object to view the synthetic multimedia information. That is, adding a virtual image can replace the reminder operation, thereby effectively improving the efficiency of human-computer interaction while enriching the visual effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1A and Figure 1B It is a schematic diagram of an interface of an interactive processing method provided by related technologies;
[0030] Figure 2 is a structural diagram of an interactive processing system provided in an embodiment of the present application;
[0031] Figure 3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0032] Figure 4A-4D It is a flowchart of the interactive processing method provided in the embodiment of the present application;
[0033] Figure 5 It is a flowchart of the interactive processing method provided in the embodiment of the present application;
[0034] Figure 6A-6E It is a schematic diagram of the interface of the interactive processing method provided in the application embodiment;
[0035] Figure 7 It is a logical schematic diagram of the interactive processing method provided by the application embodiment;
[0036] Figure 8 It is a schematic diagram of the interface of the interactive processing method provided in the application embodiment;
[0037] Figure 9A-9B It is a schematic diagram of an interface for realizing a virtual same-frame interaction processing method provided in an embodiment of the application;
[0038] Fig.10It is a corresponding relationship diagram of the interactive processing method provided in the application embodiment;
[0039] Figure 11A-11B It is a schematic diagram of an interface for realizing a reminder function of an interactive processing method provided in an embodiment of the application;
[0040] Fig.12 It is a logical schematic diagram of the interactive processing method provided by the application embodiment;
[0041] Figure 13A-13B It is a schematic diagram of an interface for realizing the comment function of the interactive processing method provided in the embodiment of the application;
[0042] Figure 14A-14B It is a schematic diagram of an interface for realizing a chat function of an interactive processing method provided in an embodiment of the application;
[0043] Fig.15 It is a logical schematic diagram of the interactive processing method provided in the embodiment of the present application. DETAILED DESCRIPTION
[0044] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. The described embodiments should not be regarded as limiting the present application. All other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of this application.
[0045] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0046] In the following description, the terms "first\second\third" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
[0047] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0048] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.
[0049] 1) In response, it is used to indicate the conditions or states on which the executed operations depend. When the dependent conditions or states are met, one or more operations executed may be in real time or have a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations executed are executed.
[0050] 2) Multimedia information: The multimedia information involved in the embodiments of the present application refers to media information in the form of images, videos, animations, etc. Its meaning is generally considered to refer to related information obtained using storage and retrieval technology, especially digital information in a computer.
[0051] See also Figure 1A and Figure 1B In the social information flow APP and instant messaging APP of the related technology, if the user wants the content he or she publishes to be perceived by relevant people, the user needs to @ the other party in the published information or select the friends to be notified in the corresponding options. In the stage of the object publishing information, in response to the trigger operation for the reminder entrance 301A, the object list is displayed, so that the target object can be selected in the object list to notify the target object to view the information published by the object. In response to the trigger operation for the reminder entrance 301B, the object list is displayed, so that the target object can be selected in the object list, and the published information will be added with reminder text to notify the target object to view the information published by the object. When publishing image content, the related technology allows users to add virtual image stickers of friends on the image to create a virtual frame effect.
[0052] In the related art, if a user wants to have relevant people perceive the content they publish, they need to enter @ in the message and then select people from the friend list, or select friends in functions such as "remind who to see". The whole process is redundant and boring, and the final presentation is just @ copy. In the related art, users themselves may need to add virtual image stickers of themselves and their friends on the image to be sent to indicate that the content is related to their friends, but they still need to notify their friends through the above reminder function, resulting in redundant processes.
[0053] In response to the above technical problems, the embodiments of the present application provide an interactive processing method, device, electronic device, computer-readable storage medium and computer program product, which can use virtual images to realize reminder functions, thereby improving the efficiency of human-computer interaction.
[0054] The following describes exemplary applications of the electronic device provided in the embodiments of the present application. The electronic device provided in the embodiments of the present application can be implemented as various types of user terminals such as laptop computers, tablet computers, desktop computers, set-top boxes, mobile devices (for example, mobile phones, portable music players, personal digital assistants, dedicated information devices, portable gaming devices), intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc.
[0055] See also Figure 2 , Figure 2 It is a structural diagram of the interactive processing system provided in an embodiment of the present application. To support a social application, a terminal (terminal 400-1 and terminal 400-2 are shown as examples) is connected to a server 200 via a network 300. The network 300 may be a wide area network or a local area network, or a combination of the two.
[0056] In some embodiments, the multimedia information to be edited is displayed on the terminal 400-1 logged in by the first account. In response to the trigger operation for selecting the entry, the terminal 400-1 sends a virtual image acquisition request to the server 200 to obtain the virtual image of the second account. The terminal 400-1 displays the virtual image of the second account. In response to the virtual image selection operation, the virtual image is added to the multimedia information to be edited to display the synthesized multimedia information. In response to the sending operation for the synthesized multimedia information, the terminal 400-1 sends the synthesized multimedia information and the reminder message to the server 200, so that the server 200 sends the multimedia information and the reminder message to the terminal 400-2. In response to the terminal 400-2 receiving the comment operation, the terminal 400-2 sends the comment information to the server 200. The server 200 adds the comment information to the position of the virtual image of the second account in the synthesized multimedia information, and returns the synthesized multimedia information with the comment information added to the terminal 400-1 and the terminal 400-2 for display.
[0057] In some embodiments, the terminal or server can implement the interactive processing method provided in the embodiments of the present application by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a native application (APP, Application), that is, a program that needs to be installed in the operating system to run, an instant messaging client, a video conferencing client, a social network client; it can also be a small program, that is, a program that can be run only by downloading it to a browser environment; it can also be a small program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module or plug-in.
[0058] The embodiments of the present application can be implemented with the help of cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or a local area network to achieve data calculation, storage, processing, and sharing.
[0059] Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the cloud computing business model. It can form a resource pool that can be used on demand and is flexible and convenient. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources.
[0060] As an example, server 200 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Terminal 400-1 can be a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, car terminal, etc., but is not limited to this. Terminal 400-1 and server 200 can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present application.
[0061] See also Figure 3 , Figure 3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, Figure 3 The terminal shown includes: at least one processor 410, a memory 450, at least one network interface 420 and a user interface 430. The various components in the terminal 400-1 are coupled together via a bus system 440. It is understood that the bus system 440 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 440 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 440 is not shown in FIG. Figure 3 Various buses are labeled as bus system 440 .
[0062] Processor 410 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where the general-purpose processor can be a microprocessor or any conventional processor, etc.
[0063] The user interface 430 includes one or more output devices 431 that enable presentation of media content, including one or more speakers and / or one or more visual display screens. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.
[0064] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid-state memory, hard disk drives, optical disk drives, etc. The memory 450 may optionally include one or more storage devices that are physically remote from the processor 410.
[0065] The memory 450 includes a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memories. The non-volatile memory may be a read-only memory (ROM), and the volatile memory may be a random access memory (RAM). The memory 450 described in the embodiments of the present application is intended to include any suitable type of memory.
[0066] In some embodiments, memory 450 can store data to support various operations, examples of which include programs, modules, and data structures, or a subset or superset thereof, as exemplarily described below.
[0067] Operating system 451, including system programs for processing various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks;
[0068] A network communication module 452, for reaching other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 include: Bluetooth, Wireless Compatibility Authentication (WiFi), and Universal Serial Bus (USB);
[0069] a presentation module 453 for enabling presentation of information via one or more output devices 431 (e.g., display screen, speaker, etc.) associated with the user interface 430 (e.g., a user interface for operating peripherals and displaying content and information);
[0070] The input processing module 454 is used to detect one or more user inputs or interactions from one of the one or more input devices 432 and translate the detected inputs or interactions.
[0071] In some embodiments, the interactive processing device provided in the embodiments of the present application can be implemented in a software manner. Figure 3 The interactive processing device 455-1 stored in the memory 450 is shown, which can be software in the form of a program and a plug-in, etc., including the following software modules: a display module 4551, an editing module 4552 and a sending module 4553, Figure 3 Also shown is an interactive processing device 455-2 stored in the memory 450, which can be software in the form of a program and a plug-in, etc., including the following software modules: a receiving module 4554, a viewing module 4555, and a commenting module 4556. These modules are logical, and therefore can be arbitrarily combined or further split according to the functions implemented. The functions of each module will be described below.
[0072] The interactive processing method provided in the embodiment of the present application will be described in conjunction with the exemplary application and implementation of the terminal provided in the embodiment of the present application.
[0073] See also Figure 4A , Figure 4A is a flowchart of the interactive processing method provided in the embodiment of the present application, which will be combined with Figure 4A The steps shown are explained.
[0074] In step 101, multimedia information to be edited is displayed.
[0075] In step 102, a virtual image of at least one object is displayed.
[0076] As an example, when the multimedia information to be edited is displayed in the human-computer interaction interface, the virtual image of at least one object can be displayed in the human-computer interaction interface simultaneously; or after the multimedia information to be edited is displayed in the human-computer interaction interface, the virtual image of at least one object is displayed through a trigger operation, and when the virtual image of at least one object is displayed, the multimedia information to be edited can remain displayed in the human-computer interaction interface.
[0077] As an example, the multimedia information to be edited may be an image or a video, and the avatar may be displayed in the form of a avatar sticker of the object (user).
[0078] As an example, there is an image selection portal in both the social dynamics publishing scenario and the instant messaging scenario, and in response to the image selection portal, multiple candidate images can be displayed. In response to the selection operation on the candidate image, the selected candidate image is used as the image to be edited. The image to be edited here is the image that the user is going to publish as a social dynamic or the image that is going to be carried in a message and sent to a group chat. The image to be edited can be edited before it is sent. The embodiment of the present application provides an editing method for the image to be edited, that is, adding a virtual image sticker of an object to the image to be edited. The object here can refer to the user himself or a user who has a social relationship with the user. The social relationship here is not limited to the social relationship between the two parties. For example, if user A follows user B, but user B does not follow user A, it can also be considered that user A and user B have a social relationship.
[0079] In some embodiments, see Figure 4B In step 102, at least one virtual image of an object is displayed, which can be achieved by Figure 4B Steps 1021 to 1022 are implemented as shown.
[0080] In step 1021, when the multimedia information to be edited is displayed, a selection entry is displayed.
[0081] In step 1022, in response to a trigger operation for selecting a portal, a virtual image of at least one object is displayed.
[0082] Through the embodiment of the present application, a selection entry can be presented when presenting multimedia information to be edited to trigger the virtual image of the object to be displayed later, thereby improving the efficiency of human-computer interaction.
[0083] As an example, see Fig. 6A An image selection entrance 601A is displayed in the human-computer interaction interface. In response to a trigger operation on the image selection entrance 601A, a candidate image is displayed. In response to a selection operation on any candidate image, the selected candidate image is used as an image to be edited, and the image to be edited 602A is displayed. In response to a trigger operation on a virtual image selection entrance 603A (the selection entrance involved in step 1021), a virtual image 604A of at least one object is displayed, including a virtual image of the user himself and virtual images of other users.
[0084] In some embodiments, when displaying a virtual image of at least one object, the account identification of the object to which each virtual image belongs may also be displayed.
[0085] As an example, see Figure 6BIn the virtual image candidate area 602B, virtual images 603B of multiple objects and account identifiers 604B of the objects to which the virtual images belong are displayed. The account identifiers here can be nicknames, avatars, etc. of the objects in the social network.
[0086] In some embodiments, when there are multiple virtual images, displaying the virtual image of at least one object in step 102 can be achieved by the following technical solution: displaying the virtual image in at least one of the following sequences: the time when the virtual image was last added to the multimedia information to be edited, from recent to distant; the frequency of adding the virtual image to the multimedia information to be edited, from high to low; the frequency of interaction between the object corresponding to the virtual image and the editing object, from high to low, where the editing object is the object that triggers the sending operation; the time when the object corresponding to the virtual image last interacted with the editing object, from recent to distant. Through the embodiments of the present application, the virtual image can be recommended by display, thereby improving the efficiency of human-computer interaction.
[0087] As an example, virtual images may be displayed in order, for example, giving priority to displaying virtual images that have been recently added to the multimedia information to be edited, for example, giving priority to displaying virtual images that are frequently added to the multimedia information to be edited, for example, giving priority to displaying virtual images of other users who frequently interact with the user himself (the editing object), for example, giving priority to displaying virtual images of other users who have recently interacted with the user himself.
[0088] In some embodiments, displaying the virtual image of at least one object in step 102 can be implemented by the following technical solution: when the multimedia information to be edited includes any object, performing at least one of the following processes: displaying the virtual image of any object; displaying the virtual images of other objects that have a social relationship with any object. Through the embodiments of the present application, virtual images related to the content of the multimedia information can be displayed, thereby enriching the visual effect and improving the interest of editing.
[0089] As an example, the multimedia information to be edited may be an image or a video, and the multimedia information may be subjected to image recognition processing by image processing technology. When the multimedia information to be edited is image A, it is recognized that image A includes object A, and at least one of the virtual image of object A and the virtual image of object B having a social relationship with object A may be displayed; when the multimedia information to be edited is video C, the key frames of video C are extracted, and image recognition processing is performed for each key frame to obtain the objects included in each key frame, for example, for key frame D, objects D1 and D2 may be recognized, and for key frame E, objects E1 and E2 may be recognized, and at least one of the virtual images of object D1, object D2, and object D3 having a social relationship with objects D1 and D2 may be displayed for key frame D, and at least one of the virtual images of object E1, object E2, and object E3 having a social relationship with objects E1 and E2 may be displayed for key frame E.
[0090] In some embodiments, before displaying a virtual image of at least one object, a set of objects with virtual images is obtained from a server; wherein the object set includes an editing object and an object having a social relationship with the editing object, and the editing object is an object that triggers a sending operation; based on the object set, a virtual image of each object in the object set is obtained from the server.
[0091] As an example, see Figure 7 In the application scenario of publishing social dynamics to social networks, an entrance to a friend's virtual image is added to the image editing interface, which is convenient for users to select a friend's virtual image when editing an image. After selection, the friend's virtual image can be quickly pasted on the image, and interaction between friends can be achieved through the virtual image. The client interacts logically with the relationship chain background and the virtual image background to provide users with the ability to add a friend's virtual image to the image. After the user selects a friend's image, the client must first obtain a list of friends with virtual images from the relationship chain background, and then request the friend's virtual image resource from the virtual image background through the pulled link list. The downloaded virtual image will be displayed on the corresponding list.
[0092] In step 103, in response to at least one avatar being in a selected state, the synthesized multimedia information is displayed.
[0093] As an example, the synthesized multimedia information is obtained by adding a virtual image in a selected state to the multimedia information to be edited.
[0094] In some embodiments, see Figure 4C Before executing step 103, you can also execute Figure 4C Step 105 or step 106 shown in .
[0095] In step 105 , in response to a selection operation on at least one virtual image, at least one virtual image is displayed in a selected state.
[0096] As an example, see Figure 6B In response to a selection operation for any virtual image, the virtual image selected in the virtual image candidate area 602B is displayed as a selected state, and the virtual image 603B is added to the image 601B (multimedia information to be edited).
[0097] In step 106 , in response to at least one virtual image satisfying the adding condition, at least one virtual image is displayed in a selected state.
[0098] In the embodiment of the present application, a virtual image can be selected by automatic selection, and the automatically selected virtual image can be displayed as a selected state. A virtual image that meets the adding conditions can be automatically selected and displayed as a selected state.
[0099] In some embodiments, the adding condition includes at least one of the following: the avatar is the avatar that was most recently added to the multimedia information to be edited; the avatar is the avatar that is most frequently added to the multimedia information to be edited; the object corresponding to the avatar is the object that interacts most frequently with the editing object, wherein the editing object is the object that triggers the sending operation; the object corresponding to the avatar is the object that interacted with the editing object most recently. By automatically selecting the avatar in the embodiments of the present application, the user selection process is avoided, thereby improving the efficiency of human-computer interaction.
[0100] As an example, for the editing object A, which is the object that is ready to send or publish the multimedia information to be edited, the virtual image that was most recently added by the editing object A can be used as the automatically selected virtual image, the virtual image that is most frequently added by the editing object A can be used as the automatically selected virtual image, the virtual image of the object B that interacts most frequently with the editing object A can be used as the automatically selected virtual image, and the virtual image of the object B that most recently interacted with the editing object A can be used as the automatically selected virtual image.
[0101] In step 104, in response to a sending operation for the synthesized multimedia information, the synthesized multimedia information is sent, and a reminder message is sent to a target object.
[0102] As an example, the target object is the object to which the virtual image included in the composite multimedia information belongs, and the reminder message is used to remind the target object to view the composite multimedia information. There are two application scenarios for sending the composite multimedia information, which can be sending the composite multimedia information to a social network or to a group chat.
[0103] In some embodiments, see Figure 4D , in step 104, the synthetic multimedia information can be sent through Figure 4D the steps 1041 or 1042 shown.
[0104] In step 1041, the synthetic multimedia information is carried in the first session message and sent to the target group, where the target group includes at least one target object.
[0105] In some embodiments, after the synthetic multimedia information is carried in the first session message and sent to the target group, any one of the following processes is performed: displaying the first session message carrying the synthetic multimedia information in the session interface of the target group; displaying the first session message carrying the synthetic multimedia information in the session interface of the target group and displaying a second session message in the session interface of the target group, where the second session message includes the account identifier of the target object and a reminder symbol for each account identifier. Through the embodiments of the present application, the display or hiding of text prompts can be achieved, thereby improving the utilization rate of display resources.
[0106] As an example, the embodiments of the present application can also be applied to an instant messaging APP. When an image is selected and sent in an instant chat window, a virtual image of a friend is added to the image. After the image is sent, a message for reminding the corresponding friend will be automatically generated. Refer to Fig. 6E , an image selection entry 601E is displayed in the session interface. In response to a trigger operation on the image selection entry 601E, candidate images are displayed. In response to a selection operation on any one of the candidate images, the selected candidate image is used as the image to be edited, and the image to be edited 602E is displayed. In response to a trigger operation on the virtual image selection entry, virtual images 603E of multiple friends are displayed. The virtual image 603E in the selected state is added to the image to be edited 602E. In response to a trigger operation on the completion control 604E, a synthetic image including the virtual image (the synthetic multimedia information in the first session message) is displayed in the session interface, and a message including a reminder text 605E (the second session message) is displayed in the session interface. Here, the reminder text includes the account identifier and a reminder symbol. For example, the reminder text "@Wenwen" includes the account identifier "Wenwen" and the reminder symbol "@".
[0107] In some embodiments, after the synthesized multimedia information is carried in a first conversation message to be sent to a target group, in response to a comment operation of the target object on the synthesized multimedia information, comment information is displayed at a position corresponding to a target virtual image in the synthesized multimedia information included in the first conversation message; or in response to a comment operation of the target object on the synthesized multimedia information, a second conversation message sent by the target object is displayed, wherein the second conversation message includes the synthesized multimedia information, and comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information of the second conversation message; wherein the target virtual image is a virtual image corresponding to the target object in the synthesized multimedia information, and the comment information is information input through the comment operation.
[0108] As an example, a first conversation message will be displayed in the conversation interface. The first conversation message is a message sent by the editing object and carries synthetic multimedia information. The synthetic multimedia message includes a virtual image of the target object A. The target object A triggers a comment operation on the synthetic multimedia information. The comment operation here can be an operation of long pressing the first conversation message and clicking the reply control. The comment information is input through the comment operation, and the input comment information can be directly displayed at the virtual image of the target object A in the synthetic multimedia information of the first conversation message, that is, the first conversation message is a message that can be updated, or the target object can directly send a second conversation message, and the second conversation message also carries synthetic multimedia information. The comment information is displayed at the position corresponding to the virtual image on the synthetic multimedia information of the second conversation message.
[0109] In step 1042 , the synthesized multimedia is interacted with a social network, wherein at least one target object has a social account of the social network.
[0110] In some embodiments, when the synthesized multimedia information is sent to a social network, before responding to the sending operation on the synthesized multimedia information, in response to the completion of the editing operation on the synthesized multimedia information, a social dynamics editing interface is displayed; the synthesized multimedia information to be sent is displayed in the multimedia area of the social dynamics editing interface; in response to the trigger operation on the send control, the trigger operation is identified as a sending operation for the synthesized multimedia information; when the synthesized multimedia information to be sent is displayed in the multimedia area of the social dynamics editing interface, the account identification of the target object and a reminder symbol for each account identification are displayed in the text area of the social dynamics editing interface.
[0111] As an example, after the user adds the virtual avatar of a friend to an image, the corresponding friend will be automatically @ mentioned in the text of the social post that the user is about to publish, that is, there is no need for manual input. After the social post including the image is published, the corresponding friend will be reminded to view it. The friend will receive a message notification, and clicking on this message can view this social post. Refer to Figure 6C , in the editing area 601C (social post editing interface), the text 602C edited by the user is displayed, and the image 603C (synthetic multimedia information to be sent) includes the virtual avatar 604C. Therefore, the reminder text 605C for the friend to whom the virtual avatar 604C belongs can be automatically displayed after the text 602C. Whether the reminder text is displayed or not, a reminder message can be sent to the friend to whom the virtual avatar 604C belongs. The reminder text here includes the account identifier and the reminder symbol. For example, in the reminder text "@Wenwen", it includes the account identifier "Wenwen" and the reminder symbol "@".
[0112] In some embodiments, when the synthetic multimedia information is sent to a social network, in response to a comment operation by a target object on the synthetic multimedia information, comment information on the synthetic multimedia information is displayed at the position corresponding to the virtual avatar of the target object.
[0113] As an example, when the reminded user comments on this social post, the latest message of his comment will be displayed at the corresponding virtual avatar on the image (synthetic multimedia information). Refer to Fig.6D , in the social network, the social post 601D is displayed. The social post 601D includes the image 602D. The comment information 603D posted by friend A will be displayed in the comment area and also at the position of the virtual avatar corresponding to friend A on the image 602D.
[0114] In some embodiments, refer to Figure 5 , Figure 5 is a schematic flowchart of the interaction processing method provided by the embodiments of the present application, which will be described in combination with Figure 5 the steps shown.
[0115] In step 501, a reminder message is received through the client of the target object.
[0116] In step 502, in response to a trigger operation on the reminder message, the synthetic multimedia information is displayed, and the synthetic multimedia information includes the virtual avatar of the target object.
[0117] In step 503, in response to a comment operation by the target object on the synthetic multimedia information, comment information corresponding to the virtual avatar of the target object is displayed on the synthetic multimedia information.
[0118] The specific implementation manner of step 503 can refer to the specific implementation manner of comment interaction in the above embodiments.
[0119] In some embodiments, when the composite multimedia information is sent to a social network, in response to a comment operation of the target object on the composite multimedia information, comment information on the composite multimedia information is displayed at a position corresponding to the target object's virtual image on the composite multimedia information.
[0120] In some embodiments, when the target object receives a reminder message through a target group, the synthesized multimedia information is carried in a first conversation message received by the target group, and in response to the target object's comment operation on the synthesized multimedia information, the comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information included in the first conversation message; or in response to the target object's comment operation on the synthesized multimedia information, a second conversation message sent by the target object is displayed, wherein the second conversation message includes the synthesized multimedia information, and the comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information of the second conversation message; wherein the target virtual image is a virtual image corresponding to the target object in the synthesized multimedia information, and the comment information is information input through the comment operation.
[0121] Through the embodiment of the present application, multimedia information to be edited and a virtual image of at least one object are displayed. In response to at least one virtual image being in a selected state, synthetic multimedia information obtained by adding the selected virtual image to the multimedia information to be edited is displayed. This is equivalent to achieving a visual effect of being in the same frame with the virtual image of the object by editing the multimedia information. Subsequently, when the synthetic multimedia information is sent, a reminder message will also be sent to the object to which the virtual image included in the synthetic multimedia information belongs, so as to remind the target object to view the synthetic multimedia information. That is, adding a virtual image can replace the reminder operation, thereby effectively improving the efficiency of human-computer interaction while enriching the visual effect.
[0122] The following is an explanation of an exemplary application of the embodiments of the present application in a practical application scenario.
[0123] In some embodiments, the multimedia information to be edited is displayed on the terminal 400-1 logged in by the first account. In response to the trigger operation for selecting the entry, the terminal 400-1 sends a virtual image acquisition request to the server 200 to obtain the virtual image of the second account. The terminal 400-1 displays the virtual image of the second account. In response to the virtual image selection operation, the virtual image is added to the multimedia information to be edited to display the synthesized multimedia information. In response to the sending operation for the synthesized multimedia information, the terminal 400-1 sends the synthesized multimedia information and the reminder message to the server 200, so that the server 200 sends the multimedia information and the reminder message to the terminal 400-2. In response to the terminal 400-2 receiving the comment operation, the terminal 400-2 sends the comment information to the server 200. The server 200 adds the comment information to the position of the virtual image of the second account in the synthesized multimedia information, and returns the synthesized multimedia information with the comment information added to the terminal 400-1 and the terminal 400-2 for display.
[0124] The embodiment of the present application provides a method of using virtual image stickers to remind friends. When a user publishes an image, a friend's virtual image sticker can be added to the image to decorate the image, achieving the effect of being in the same frame with the friend virtually. When such an image with a virtual image sticker is published, the friends with the corresponding virtual image sticker will be automatically reminded, and the friends will receive a message reminder to view the image. And the corresponding friend's comments under this content will also be displayed on the virtual image of the image. During the process of the user editing the image, no additional operations are required, and friends can be directly reminded. This way of reminding friends is more natural and interesting. The embodiment of the present application can be applied to information flow apps and instant messaging apps.
[0125] In some embodiments, when a user posts an image in a social network, the user can open a friend image portal in the image editor to display the virtual images of all friends. Fig. 6A An image selection entrance 601A is displayed in the human-computer interaction interface. In response to a trigger operation on the image selection entrance 601A, candidate images are displayed. In response to a selection operation on any candidate image, the selected candidate image is used as an image to be edited, and an image to be edited 602A is displayed. In response to a trigger operation on a virtual image selection entrance 603A, virtual images 604A of multiple friends are displayed.
[0126] In some embodiments, after the user clicks on a friend's image, the friend's image can be added to the image to achieve a virtual same-frame effect. Figure 6BAn image 601B is displayed in the human-computer interaction interface, and virtual images 603B of multiple friends and account identifiers 604B of the objects to which the virtual images belong are displayed in the virtual image candidate area 602B. In response to a selection operation on any virtual image, the virtual image 603B is added to the image 601B, and the virtual image selected in the virtual image candidate area 602B is displayed as a selected state.
[0127] In some embodiments, after the user adds a friend's avatar to the image, the corresponding friend will be automatically @ed in the text of the social dynamic that the user is about to publish, that is, no manual input is required. After the social dynamic including the image is published, the corresponding friend will be reminded to view it. The friend will receive a message notification and can click on this message to view this social dynamic. Figure 6C , the editing area 601C displays the text 602C edited by the user. Since the image 603C includes the avatar 604C, a reminder text 605C for the friend to whom the avatar 604C belongs is automatically displayed after the text 602C. Since the reminder text is included in the social dynamics, a reminder message can be sent to the friend. After the social dynamics are published, the social dynamics 606C is displayed on the homepage of the social network, and a reminder message 607C is displayed in the friend's client.
[0128] In some embodiments, when the user being reminded comments on this social dynamic, the latest message he commented on will be displayed on the corresponding avatar on the image. Fig.6D , a social dynamic 601D is displayed in the social network, and the social dynamic 601D includes an image 602D. The comment information 603D posted by friend A will be displayed in the comment area and will also be displayed at the virtual image corresponding to friend A on the image 602D.
[0129] In some embodiments, the embodiments of the present application can also be applied in an instant messaging APP. In the instant chat window, select to send an image, add a friend's virtual image to the image, and a message to remind the corresponding friend will be automatically generated after the image is sent. Fig. 6E , an image selection entrance 601E is displayed in the conversation interface, in response to a trigger operation on the image selection entrance 601E, candidate images are displayed, in response to a selection operation on any candidate image, the selected candidate image is used as an image to be edited, and the image to be edited 602E is displayed, in response to a trigger operation on a virtual image selection entrance, virtual images 603E of multiple friends are displayed, and the virtual images 603E in a selected state are added to the image to be edited 602E, in response to a trigger operation on a completion control 604E, a composite image including the virtual image is displayed in the conversation interface, and a message including a reminder text 605E is displayed in the conversation interface.
[0130] In some embodiments, see Figure 7 In the application scenario of publishing social dynamics to social networks, an entrance to a friend's virtual image is added to the image editing interface, so that users can select a friend's virtual image when editing an image. After selection, the friend's virtual image can be quickly pasted onto the image, and interaction between friends can be achieved through the virtual image. The client performs logical interaction with the relationship chain background and the virtual image background to provide users with the ability to add a friend's virtual image to the image. After the user selects a friend's image, the client must first obtain a list of friends with virtual images from the relationship chain background, and then request the friend's virtual image resource from the virtual image background through the pulled link list. The downloaded virtual image will be displayed on the corresponding list. Specifically, the virtual image background will perform a download permission check, and it is necessary to verify whether the token carried by the user's request is legal. The token carried by the user's request is also a token generated by the relationship chain background, which is convenient for verification. The token carried by the user's request is the credential of the user's legal identity. Whether the user has a virtual image will be marked in the relationship chain, and the virtual image-related data is maintained by the virtual image background. The embodiment of the present application will save the virtual image-related data to the virtual image background. See. Figure 8 Each virtual image is the image set by the user’s friends, and the friend’s name will be displayed on the virtual image, making it easier for users to identify the image of each friend.
[0131] In some embodiments, the virtual same frame implementation is described below, see Fig. 9A , users can add images when posting social updates, and can interactively edit images, and can combine friends' virtual images with images, see Fig. 9B , users can select friend avatars in the friend avatar list to mix with the image. In the image editing interface, the image is used as the background, and the selected friend avatars are displayed side by side on the image. Each avatar previewed in the editing stage is an avatar image resource. They are independent individuals for users to preview the editing effect. Fig.10 When the user finishes editing and publishing the image, the corresponding image and the selected virtual image will be mixed into one image and published. At the same time, when publishing the image, the relevant information of the image will carry the coordinate information of each virtual image, so that when the corresponding friend comments later, the comment can be attached to the corresponding virtual image. One image corresponds to multiple virtual image information, including the social account information and coordinate information of the friend corresponding to the virtual image.
[0132] In some embodiments, the following describes the technical implementation of adding a virtual image to an image to provide a reminder function. Fig.11A, after the user edits an image and publishes the image, in order to increase interaction among users, the friends added with virtual avatars will be notified. To facilitate notifying the friends added with virtual avatars in a timely manner and reminding them to view the published image, see Fig. 11B , when the user finishes editing the image, a reminder text will be automatically added to the social dynamics. The reminder text includes the information of the friends added with virtual avatars. Through the reminder ability of the reminder text (@someone), the published image can be conveyed to friends in a timely manner, and friends can also view the image in a timely manner through the reminder message (space message). Through the reminder ability of the reminder text (@someone), the space message is used as the reminder message to convey the published image. Friends can click on the published image in the space message. See Fig.12 , in step 1201, the edited image is displayed. In step 1202, it is determined whether there is a virtual avatar. When there is no virtual avatar, step 1203 is executed. In step 1203, the image is displayed. When there is a virtual avatar, step 1204 is executed. In step 1204, the virtual avatar list is traversed. In step 1205, a reminder text is added to the social dynamics. The corresponding reminder text "@someone" is added to the content of the social dynamics. The friend source is the friend corresponding to the virtual avatar selected during image editing. The timing of adding the content of the social dynamics is when returning to the待发送界面 (to-be-sent interface) after editing the image. The client can automatically add the reminder text to the content of the social dynamics according to the virtual avatar selected by the user, so that the friends to be reminded can be quickly added, and the friends can be notified by sending the reminder text.
[0133] In some embodiments, the implementation of the function of attaching friend comment information to an image is introduced below. See Fig.13A , in order to highlight the interaction among virtual avatar friends in the social dynamics, when there is a comment from the corresponding friend for the virtual avatar added to the image, the comment information will be attached to the image, facilitating the timely perception of the interaction information among friends. See Fig. 13B , when the image is published, the edited friend virtual avatar and the image to be edited will be mixed into one image. The synthesized image will carry the information of the virtual avatar friend, including the account of the corresponding virtual avatar friend. At the same time, the coordinates of the virtual avatar in the image will also exist. The role of the coordinates is to position the comment when attaching it to the image of the status update when the corresponding friend comments. When displaying the social dynamics, if there is image information, the image will be used as the background when displayed, and at the same time, the friend comment information will be superimposed on the image background. The position of the comment information in the image display area is determined according to the virtual avatar information. If the author of the comment has added a corresponding virtual avatar to the image, the comment information needs to be superimposed on the image.
[0134] In some embodiments, the solution for supporting the reminder function of image stickers in the scenario of sending messages in a chat is introduced below. See Fig.14AThe ability to add a friend's virtual image to an image is not limited to social dynamics publishing in social networks, but can also be used to send image messages to group chats. When sending, the image editing interface will appear after selecting an image. The reminder function is realized by adding a friend's virtual image to the image. It is a common component and can be directly reused by various businesses. Fig. 14B For this general component, when the business call is completed, the synthesized image will be returned to the business. At the same time, the list of selected friend virtual images will also be returned, including the friend's account and the coordinate information of the virtual image in the image. Similar to the image in social dynamics, the logical processing flow of sending messages can be seen in Fig.15 In step 1501, an image selection interface is displayed. In step 1502, image editing is performed. In step 1503, image information and image data information are obtained. In step 1504, a composite image is sent. In step 1505, it is determined whether a virtual image exists. If so, step 1506 is executed. In step 1506, a list of virtual images is traversed. In step 1507, a reminder text is added to the chat for friends. In step 1508, a message including the reminder text is sent.
[0135] The embodiments of the present application are not limited to realizing the ability to add a virtual image to an image when posting social updates, but also encapsulate the ability to select a friend's virtual image when selecting an image to realize a reminder function for friends as a universal component. Various businesses can realize their demands through this universal component, and the component can provide the business party with information related to the synthesized image and the friend's virtual image.
[0136] The embodiment of the present application provides a function of using a friend's virtual image sticker to remind a friend. When a user publishes image content, he can add a friend's virtual image sticker to the image to decorate the image, so as to achieve the effect of being in the same frame with the friend virtually. In the embodiment of the present application, when such image content with a virtual image sticker is published, the friend corresponding to the virtual image attached to the image will be automatically reminded, and the friend will receive a message reminder to view the content. And the corresponding friend's comments under this content will also be displayed on the virtual image of the image. In the process of editing the image by the user, additional operations are eliminated and the other party can be reminded directly. This way of prompting friends to view is more natural and interesting. The embodiment of the present application can be applied to information flow APPs and instant messaging APPs, reducing the operating cost of users reminding friends to view content and increasing the interaction rate between friends.
[0137] It is understandable that in the embodiments of the present application, related data such as user information is involved. When the embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data need to comply with relevant laws, regulations and standards of relevant countries and regions.
[0138] The following is a description of an exemplary structure of the interactive processing device 455-1 provided in the embodiment of the present application implemented as a software module. In some embodiments, Figure 2 As shown, the software modules stored in the interactive processing device 455-1 of the memory 450 may include: a display module 4551, used to display the multimedia information to be edited; display a virtual image of at least one object; an editing module 4552, used to display the synthesized multimedia information in response to at least one of the virtual images being in a selected state, wherein the synthesized multimedia information is obtained by adding the virtual image in a selected state to the multimedia information to be edited; a sending module 4553, used to send the synthesized multimedia information in response to a sending operation for the synthesized multimedia information, and send a reminder message to the target object, wherein the target object is the object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.
[0139] In some embodiments, the display module 4551 is also used to: display a selection entry when displaying the multimedia information to be edited; display a virtual image of at least one object in response to a trigger operation on the selection entry; and display the account identification of the object to which each virtual image belongs.
[0140] In some embodiments, the display module 4551 is also used to: display the virtual image in at least one of the following orders: the order of the time when the virtual image was last added to the multimedia information to be edited from recent to distant; the order of the frequency of the virtual image being added to the multimedia information to be edited from high to low; the order of the frequency of interaction between the object corresponding to the virtual image and the editing object from high to low, wherein the editing object is the object that triggers the sending operation; the order of the time when the object corresponding to the virtual image last interacted with the editing object from recent to distant.
[0141] In some embodiments, the display module 4551 is further used to: when the multimedia information to be edited includes any object, perform at least one of the following processes: display a virtual image of any object; display virtual images of other objects that have a social relationship with any object.
[0142] In some embodiments, the display module 4551 is also used to: before displaying the virtual image of at least one object, obtain a set of objects with the virtual image from the server; wherein the object set includes an editing object and an object having a social relationship with the editing object, and the editing object is the object that triggers the sending operation; based on the object set, obtain the virtual image of each object in the object set from the server.
[0143] In some embodiments, before responding to at least one of the virtual images being in a selected state, the editing module is also used to: in response to a selection operation on at least one of the virtual images, display at least one of the virtual images in the selected state; or in response to at least one of the virtual images satisfying an adding condition, display at least one of the virtual images in the selected state.
[0144] In some embodiments, the adding condition includes at least one of the following: the virtual image is the virtual image that was most recently added to the multimedia information to be edited; the virtual image is the virtual image that is most frequently added to the multimedia information to be edited; the object corresponding to the virtual image is the object that interacts most frequently with the editing object, wherein the editing object is the object that triggers the sending operation; the object corresponding to the virtual image is the object that most recently interacted with the editing object.
[0145] In some embodiments, the sending module 4553 is used to: carry the synthesized multimedia information in a first conversation message to send it to a target group, wherein the target group includes at least one of the target objects; or interact the synthesized multimedia with a social network, wherein at least one of the target objects has a social account of the social network.
[0146] In some embodiments, after the synthesized multimedia information is carried in a first conversation message to be sent to a target group, the sending module 4553 is used to: perform any one of the following processes: display the first conversation message carrying the synthesized multimedia information in the conversation interface of the target group; display the first conversation message carrying the synthesized multimedia information in the conversation interface of the target group, and display a second conversation message in the conversation interface of the target group, wherein the second conversation message includes the account identifier of the target object and a reminder symbol for each of the account identifiers.
[0147] In some embodiments, when the synthesized multimedia information is sent to a social network, before responding to a sending operation on the synthesized multimedia information, the sending module 4553 is used to: display a social dynamics editing interface in response to a completed editing operation on the synthesized multimedia information; display the synthesized multimedia information to be sent in the multimedia area of the social dynamics editing interface; in response to a trigger operation on a send control, identify the trigger operation as a sending operation on the synthesized multimedia information; and display the account identification of the target object and a reminder symbol for each account identification in the text area of the social dynamics editing interface.
[0148] The following is a description of an exemplary structure of the interactive processing device 455-2 provided in the embodiment of the present application implemented as a software module. In some embodiments, Figure 2 As shown, the software modules stored in the interactive processing device 455-2 of the memory 450 may include: a receiving module 4554, used to receive a reminder message; a viewing module 4555, used to display synthetic multimedia information in response to a trigger operation on the reminder message, wherein the synthetic multimedia information includes a virtual image of the target object; and a comment module 4556, used to display comment information corresponding to the virtual image of the target object on the synthetic multimedia information in response to a comment operation of the target object on the synthetic multimedia information.
[0149] The embodiment of the present application provides a computer program product, which includes computer executable instructions, and the computer executable instructions are stored in a computer readable storage medium. The processor of the computer device reads the computer executable instructions from the computer readable storage medium, and the processor executes the computer executable instructions, so that the electronic device executes the above-mentioned interactive processing method of the embodiment of the present application.
[0150] The present application embodiment provides a computer-readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the interactive processing method provided by the present application embodiment, for example, Figure 4A-4D The interactive processing method is shown.
[0151] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface storage, optical disk, or CD-ROM; or it may be various devices including one or any combination of the above memories.
[0152] In some embodiments, computer executable instructions may be in the form of a program, software, software module, script or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine or other unit suitable for use in a computing environment.
[0153] As an example, computer-executable instructions may, but need not, correspond to a file in a file system, may be stored as part of a file storing other programs or data, such as in one or more scripts in a HyperText Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or code portions).
[0154] As an example, computer executable instructions may be deployed to be executed on one electronic device, or on multiple electronic devices located at one site, or on multiple electronic devices distributed at multiple sites and interconnected by a communication network.
[0155] To summarize, multimedia information to be edited and a virtual image of at least one object are displayed through the embodiment of the present application. In response to at least one virtual image being in a selected state, the synthesized multimedia information obtained by adding the virtual image in a selected state to the multimedia information to be edited is displayed. This is equivalent to achieving a visual effect of being in the same frame with the virtual image of the object by editing the multimedia information. Subsequently, when the synthesized multimedia information is sent, a reminder message will also be sent to the object to which the virtual image included in the synthesized multimedia information belongs, so as to remind the target object to view the synthesized multimedia information. That is, adding a virtual image can replace the reminder operation, thereby effectively improving the efficiency of human-computer interaction while enriching the visual effect.
[0156] The above is only an embodiment of the present application and is not intended to limit the protection scope of the present application. Any modifications, equivalent substitutions and improvements made within the spirit and scope of the present application are included in the protection scope of the present application.
Claims
1. An interactive processing method, characterized in that: The method comprises: Display multimedia information to be edited; displaying an avatar of at least one object; In response to at least one of the virtual images being in a selected state, displaying synthesized multimedia information, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited; In response to a sending operation for the synthesized multimedia information, the synthesized multimedia information is sent, and a reminder message is sent to a target object, wherein the target object is an object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.
2. The method according to claim 1, characterized in that The displaying of a virtual image of at least one object comprises: When displaying the multimedia information to be edited, displaying a selection entry; In response to a trigger operation on the selection entry, displaying a virtual image of the at least one object; The method further comprises: The account identification of the object to which each virtual image belongs is displayed.
3. The method according to claim 1, characterized in that When there are multiple virtual images, displaying the virtual image of at least one object includes: The virtual image is displayed in at least one of the following sequences: The order of the time when the virtual image was last added to the multimedia information to be edited from recent to distant; The order of the frequencies of adding the virtual images to the multimedia information to be edited from high to low; the order of interaction frequency between the object corresponding to the avatar and the editing object from high to low, wherein the editing object is the object that triggers the sending operation; The order of the time when the object corresponding to the virtual image last interacted with the editing object from near to far.
4. The method according to claim 1, characterized in that: The displaying of a virtual image of at least one object comprises: When the multimedia information to be edited includes any object, at least one of the following processes is performed: displaying a virtual image of any one of the objects; Display virtual images of other objects having social relationships with any of the objects.
5. The method according to claim 1, characterized in that Before displaying the virtual image of at least one object, the method further includes: Acquire a set of objects having the virtual image from a server; The object set includes an editing object and an object having a social relationship with the editing object, and the editing object is an object that triggers the sending operation; A virtual image of each object in the object set is obtained from the server based on the object set.
6. The method according to claim 1, characterized in that Before responding to at least one of the virtual images being in a selected state, the method further includes: In response to a selection operation on at least one of the virtual images, displaying at least one of the virtual images in the selected state; or In response to at least one of the virtual images satisfying the adding condition, displaying at least one of the virtual images in the selected state.
7. The method according to claim 6, characterized in that The adding condition includes at least one of the following: The virtual image is the virtual image that was most recently added to the multimedia information to be edited; The virtual image is the virtual image most frequently added to the multimedia information to be edited; The object corresponding to the virtual image is the object with the highest interaction frequency with the editing object, wherein the editing object is the object that triggers the sending operation; The object corresponding to the virtual image is the object that most recently interacted with the editing object.
8. The method according to claim 1, characterized in that The sending of the synthesized multimedia information comprises: carrying the synthesized multimedia information in a first session message to send the message to a target group, wherein the target group includes at least one target object; or The synthesized multimedia is interacted with a social network, wherein at least one of the target objects has a social account of the social network.
9. The method according to claim 8, characterized in that After the synthesized multimedia information is carried in the first session message to be sent to the target group, the method further includes: Perform any of the following: Displaying a first conversation message carrying the synthesized multimedia information in a conversation interface of the target group; A first conversation message carrying the synthesized multimedia information is displayed in the conversation interface of the target group, and a second conversation message is displayed in the conversation interface of the target group, wherein the second conversation message includes the account identifier of the target object and a reminder symbol for each of the account identifiers.
10. The method according to claim 8, characterized in that After the synthesized multimedia information is carried in the first session message to be sent to the target group, the method further includes: In response to the target object's comment operation on the composite multimedia information, displaying the comment information at a position corresponding to the target virtual image in the composite multimedia information included in the first conversation message; or In response to the target object's comment operation on the synthesized multimedia information, displaying a second conversation message sent by the target object, wherein the second conversation message includes the synthesized multimedia information, and the comment information is displayed at a position corresponding to the target virtual image in the synthesized multimedia information of the second conversation message; The target virtual image is a virtual image corresponding to the target object in the synthesized multimedia information, and the comment information is information input through the comment operation.
11. The method according to claim 8, characterized in that When the synthesized multimedia information is sent to a social network, before responding to a sending operation for the synthesized multimedia information, the method further includes: In response to completing the editing operation on the synthesized multimedia information, displaying a social dynamics editing interface; Displaying the synthesized multimedia information to be sent in the multimedia area of the social dynamics editing interface; In response to a trigger operation on a sending control, identifying the trigger operation as a sending operation on the synthesized multimedia information; The method further comprises: When the synthesized multimedia information to be sent is displayed in the multimedia area of the social dynamics editing interface, the account identification of the target object and a reminder symbol for each of the account identifications are displayed in the text area of the social dynamics editing interface.
12. The method according to claim 8, characterized in that When the synthesized multimedia information is sent to a social network, the method further comprises: In response to the comment operation of the target object on the composite multimedia information, the comment information on the composite multimedia information is displayed at a position on the composite multimedia information corresponding to the virtual image of the target object.
13. An interactive processing method, characterized in that: The method comprises: Receive reminder messages through the client of the target object; In response to a triggering operation on the reminder message, displaying synthesized multimedia information, wherein the synthesized multimedia information includes a virtual image of the target object; In response to the target object's comment operation on the composite multimedia information, comment information corresponding to the target object's virtual image is displayed on the composite multimedia information.
14. An interactive processing device, characterized in that: The device comprises: A display module, used for displaying the multimedia information to be edited; and displaying a virtual image of at least one object; An editing module, configured to display synthesized multimedia information in response to at least one of the virtual images being in a selected state, wherein the synthesized multimedia information is obtained by adding the selected virtual image to the multimedia information to be edited; A sending module is used to send the synthesized multimedia information in response to a sending operation for the synthesized multimedia information, and to send a reminder message to a target object, wherein the target object is an object to which the virtual image included in the synthesized multimedia information belongs, and the reminder message is used to remind the target object to view the synthesized multimedia information.
15. An interactive processing device, characterized in that: The device comprises: A receiving module, used for receiving a reminder message; A viewing module, configured to display the synthesized multimedia information in response to a triggering operation on the reminder message, wherein the synthesized multimedia information includes a virtual image of the target object; The comment module is used for displaying comment information corresponding to the virtual image of the target object on the synthetic multimedia information in response to the comment operation of the target object on the synthetic multimedia information.
16. An electronic device, characterized in that: The electronic device comprises: A memory for storing computer executable instructions; A processor, used to implement the interactive processing method described in any one of claims 1 to 12 or 13 when executing the computer executable instructions stored in the memory.
17. A computer-readable storage medium storing computer-executable instructions, characterized in that: When the computer executable instructions are executed by a processor, the interactive processing method described in any one of claims 1 to 12 or 13 is implemented.
18. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the interactive processing method described in any one of claims 1 to 12 or 13 is implemented.
