Interaction method and apparatus, and device and storage medium

Abstract

The embodiments of the present disclosure relate to an interaction method and apparatus, and a device and a storage medium. The method provided herein comprises: displaying in an input field a plurality of interactive elements that are input by a user; providing at least one candidate interactive element, wherein the at least one candidate interactive element is determined on the basis of a group of interactive elements among the plurality of interactive elements, the group of interactive elements at least comprising an emoji element; and on the basis of the selection of a target interactive element among the at least one candidate interactive element, replacing the group of interactive elements among the plurality of interactive elements with the target interactive element. In this way, the embodiments of the present disclosure can support users in acquiring a fused interactive element by means of combining a plurality of interactive elements, thereby enriching the interactive elements available to the users.

Description

Interaction method, device, equipment and storage medium

[0001] This application claims priority to the Chinese invention patent application entitled “Interactive Method, Apparatus, Device and Storage Medium” and application number 202410031127.3 filed on January 8, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and more particularly, to interactive methods, apparatuses, devices, and computer-readable storage media. Background Art

[0003] With the development of computer technology, the internet has become a vital platform for information exchange. In this process, various interactive elements (e.g., emoticons) have become crucial media for social expression and information exchange. People expect to use a wider variety of interactive elements during these interactions. Summary of the Invention

[0004] In a first aspect of the present disclosure, an interaction method is provided. The method includes: displaying multiple interactive elements input by a user in an input field; providing at least one candidate interactive element, the at least one candidate interactive element being determined based on a group of interactive elements from the multiple interactive elements, the group of interactive elements including at least an emoticon element; and, based on selecting a target interactive element from the at least one candidate interactive element, replacing the group of interactive elements from the multiple interactive elements with the target interactive element.

[0005] In a second aspect of the present disclosure, an interaction method is provided. The method includes: presenting an editing window based on a first selection of a first interactive element; presenting the selected first interactive element in the editing window; and presenting a fused interactive element in the editing window based on a second selection of at least one second interactive element, the fused interactive element being determined based on the first interactive element and the at least one second interactive element.

[0006] In a third aspect of the present disclosure, an interactive device is provided. The device includes: a display module configured to display multiple interactive elements input by a user in an input field; a providing module configured to provide at least one candidate interactive element, the at least one candidate interactive element being determined based on a group of interactive elements from the multiple interactive elements; and a replacing module configured to replace the group of interactive elements from the multiple interactive elements with a target interactive element based on a selection of a target interactive element from the at least one candidate interactive element.

[0007] In a fourth aspect of the present disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect or the second aspect.

[0008] In a fifth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to implement the method of the first aspect or the second aspect.

[0009] It should be understood that the content described in this summary section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0011] FIG1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure may be implemented;

[0012] 2A to 2D illustrate example interfaces according to some embodiments of the present disclosure;

[0013] 3A-3B illustrate example interfaces according to some embodiments of the present disclosure;

[0014] 4A to 4D illustrate example interfaces according to some embodiments of the present disclosure;

[0015] FIG5 shows a flowchart of an example interaction process according to some embodiments of the present disclosure;

[0016] FIG6 shows a flowchart of an example interaction process according to some embodiments of the present disclosure;

[0017] FIG7 shows a schematic structural block diagram of an example interaction device according to some embodiments of the present disclosure; and

[0018] FIG8 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION

[0019] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0020] It should be noted that the titles of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and any type of embodiment may be included under any section / subsection. Furthermore, the embodiments described in any section / subsection may be combined in any manner with any other embodiments described in the same section / subsection and / or in different sections / subsections.

[0021] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may be included below. The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may be included below.

[0022] The embodiments of the present disclosure may involve user data, data acquisition and / or use, etc. These aspects shall comply with the corresponding laws, regulations and relevant provisions. In the embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are carried out on the premise that the user is aware of and confirms them. Accordingly, when implementing the various embodiments of the present disclosure, the types, scope of use, and usage scenarios of the data or information that may be involved should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with the relevant laws and regulations. The specific notification and / or authorization method may vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this respect.

[0023] If this specification and the solutions in the examples involve the processing of personal information, such processing will be done only with a legitimate basis (such as with the consent of the subject of personal information or as necessary for the performance of a contract) and only within the prescribed or agreed scope. A user's refusal to process personal information other than that required for basic functions will not affect the user's use of basic functions.

[0024] When people interact with each other online, interactive elements such as emoticons are important vehicles for exchanging information. However, in traditional interactions, it's difficult for people to participate in the production of these elements, resulting in a relatively limited range of available interactive elements.

[0025] Embodiments of the present disclosure propose an interaction solution. According to this solution, multiple interactive elements input by a user can be displayed in an input field. Furthermore, at least one candidate interactive element can be provided, where the at least one candidate interactive element is determined based on a group of interactive elements from a plurality of interactive elements, where the group of interactive elements includes at least an expression element. Accordingly, based on the selection of a target interactive element from the at least one candidate interactive element, a group of interactive elements from the plurality of interactive elements can be replaced with the target interactive element.

[0026] In this way, the embodiments of the present disclosure can support users to obtain fused interactive elements by combining multiple interactive elements, thereby enriching the interactive elements available to users.

[0027] Various example implementations of this solution are described in detail below in conjunction with the accompanying drawings.

[0028] Sample Environment

[0029] FIG1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG1 , the example environment 100 may include an electronic device 110 .

[0030] In this example environment 100, electronic device 110 may run an application 120 that supports interface interaction. Application 120 may be any suitable type of application for interface interaction, examples of which may include, but are not limited to, video applications, social applications, or other suitable applications. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0031] In the environment 100 of FIG. 1 , if the application 120 is in an active state, the electronic device 110 may present an interface 150 for supporting interface interaction through the application 120 .

[0032] In some embodiments, the electronic device 110 communicates with the server 130 to enable the provision of services for the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a handheld computer, a portable game terminal, a VR / AR device, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as a "wearable" circuit, etc.).

[0033] The server 130 may be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and big data and artificial intelligence platforms. For example, the server 130 may include a computing system / server such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 may provide background services for the application 120 that supports virtual scenes in the electronic device 110.

[0034] A communication connection may be established between the server 130 and the electronic device 110. The communication connection may be established in a wired or wireless manner. The communication connection may include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, etc., and the embodiments of the present disclosure are not limited in this respect. In the embodiments of the present disclosure, the server 130 and the electronic device 110 may implement signaling interaction through the communication connection between the two.

[0035] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure.

[0036] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0037] Example Interaction

[0038] An example interaction process according to an embodiment of the present disclosure will be described below with reference to the accompanying drawings.

[0039] 2A to 2D illustrate example interfaces 200A to 200D according to some embodiments of the present disclosure. The interfaces 200A to 200D may be provided by the electronic device 110 shown in FIG. 1 .

[0040] The following specific embodiments will use emoticons as an example of interactive elements to describe the exemplary processes of this disclosure. Such emoticons may include, but are not limited to, image emoticons, voice emoticons, and emojis. In addition to emoticons, such interactive elements may also include text elements, audio elements, and image elements.

[0041] As shown in FIG2A , in interface 200 , electronic device 110 may provide an input field 206. In some examples, input field 206 may be, for example, any suitable type of control for inputting information. Input field 206 may be, for example, provided by a suitable application, such as an input method or a currently activated application.

[0042] As shown, the electronic device 110 may display an expression panel 202. The expression panel 202 may provide an expression set 204 available to the current user. As an example, the expression set 204 may include expressions added by the user or default expressions of the application, such as emoji expressions.

[0043] 2A , electronic device 110 may receive a user's selection of an emoticon from emoticon set 204 and may accordingly display the corresponding emoticon in input field 206. For example, electronic device 110 may display multiple emoticons input by the user via emoticon set 204, namely, emoticon 208, emoticon 210, and emoticon 212.

[0044] In some embodiments, electronic device 110 may display at least one candidate expression. In some examples, a candidate expression is also referred to as a "fused expression," which may be determined by combining multiple corresponding expressions, such as fused expression 214, fused expression 216, and fused expression 218. As an example, such fused expressions 214 to 218 may be determined based on multiple expressions (e.g., expression 210 and expression 212) in the expression input by the user.

[0045] In some embodiments, a model may be used to generate a fused expression corresponding to multiple expressions. For example, electronic device 110 and / or server 130 may provide the model with expressions to be combined, such as expression 210 and expression 212.

[0046] Furthermore, the electronic device 110 and / or the server 130 may obtain a new fused expression generated by the model based on the expression 210 and the expression 212 , for example, the fused expression 214 .

[0047] In some embodiments, electronic device 110 and / or server 130 may further instruct the model to fuse multiple expressions to be combined according to a specific pattern. For example, the model may be instructed to generate a new fused expression by combining the visual information of multiple expressions. For example, the model may be instructed to generate a new fused expression by combining the visual content of expression 210 and expression 212.

[0048] As an example, the model can be instructed to generate a new fused expression by fusing the semantic information of the expressions. For example, the model can be instructed to adjust the visual content of expression 210 based on the phonetic information of expression 212 so that the new fused expression can simultaneously reflect the semantic information of expression 210 and expression 212.

[0049] In some embodiments, the electronic device 110 and / or the server 130 may generate one or more fused expressions for a specific expression combination. For example, fused expressions 214 to 218 may be generated based on the same expression combination (eg, expression 210 and expression 212).

[0050] In some embodiments, fused expressions 214 to 218 may be generated in real time based on expression 210 and expression 212. Alternatively, electronic device 110 and / or server 130 may pre-build a fused expression library corresponding to a variety of expression combinations, and may determine one or more fused expressions corresponding to the current expression combination from the fused expression library, for example, fused expressions 214 to 218.

[0051] In some examples, expression combination may take into account the order in which the expressions were entered. For example, the fused expression resulting from "expression 210 and expression 212" may be different from the fused expression resulting from "expression 212 and expression 210." Alternatively, only the type of expressions to be combined may be considered, regardless of the order in which they were entered.

[0052] In some embodiments, the fused expressions 214 to 218 may also be expressions created by a designer, for example.

[0053] In some embodiments, the electronic device 110 may determine the expressions 210 and 212 to be combined based on the input content in the input field 206. In some embodiments, if the last input content is an expression, the electronic device 110 may determine the expressions 210 and 212 to be combined based on the order in which the expressions were entered in the input content. For example, the electronic device 110 may determine the last two or three consecutive expressions in the input content as the expressions to be combined.

[0054] In some embodiments, electronic device 110 may also detect consecutive expressions that can be combined from the input content, regardless of whether such expressions are at the end of the input content. Taking FIG2A as an example, electronic device 110, for example, if it is determined that expressions 208 and 210 can be combined, provides a set of fused expressions determined based on expressions 208 and 210.

[0055] In some embodiments, the electronic device 110 may further determine the expressions to be combined based on user operations. For example, the electronic device 110 may receive user selections of expression 210 and expression 212, thereby determining that the expressions to be combined include expression 210 and expression 212.

[0056] In some embodiments, the electronic device 110 may also update the provided fused expressions in real time based on changes in the input content in the input field 206. For example, if the newly input content is a character, the electronic device 110 may stop providing the fused expressions. As another example, if a new expression is input, the electronic device 110 may also provide a fused expression corresponding to the new expression combination.

[0057] For example, when the user inputs expression 208 and expression 210, electronic device 110 may provide a set of fused expressions determined based on expression 208 and expression 210. Furthermore, when the user further inputs expression 212, electronic device 110 may provide a set of fused expressions determined based on expression 210 and expression 212.

[0058] As another example, when the user deletes the expression 212 , for example, by deleting the control 220 , the electronic device 110 may, for example, re-provide a set of fused expressions determined based on the expression 208 and the expression 210 .

[0059] In some embodiments, to improve the user's efficiency in using fused expressions, the electronic device 110 may further display prompt information based on the user's already entered expressions to help the user understand which expressions can be combined with the entered expressions to obtain a fused expression. For example, if the user enters expression 210, the electronic device 110 may prompt that expression 212 can be combined with expression 210 to obtain the corresponding fused expression.

[0060] In some embodiments, the electronic device 110 may also receive a user's selection of a provided fused expression and, based on the fused expression selected by the user, replace the corresponding multiple expressions in the input field 206. For example, using Figures 2A and 2B as an example, if the user selects fused expression 214, the electronic device 110 may replace expressions 210 and 212 in the input field 206 with fused expression 214.

[0061] Based on this approach, the embodiments of the present disclosure can support users to combine existing expressions to obtain new expressions, thereby enriching the expressions available to users and improving the experience of expression interaction.

[0062] In some embodiments, the electronic device 110 may further support further combinations of the fused expression 214. For example, if the electronic device 110 determines that the expression 208 can be further combined with the fused expression 214, the electronic device 110 may further provide a set of new fused expressions determined based on the expression 208 and the fused expression 214.

[0063] In some embodiments, electronic device 110 may also transmit the acquired fused expression 214. For example, upon receiving a selection of a transmission entry 222, electronic device 110 may transmit a message generated based on fused expression 214. Using FIG. 2B as an example, the message may include expression 208 and fused expression 214.

[0064] In some embodiments, such a message can be sent to any appropriate application or service.For example, such a message can be input into any appropriate application or service such as a local document, an online document, an instant messaging service, a comment service, a private message service, etc.

[0065] In some embodiments, taking FIG. 2C as an example, such a message 224 may be sent to the live broadcast interface as a comment message.

[0066] 2D , the electronic device 110 may also update a historical expression list 226 based on the user's selection of the fused expression 214. Such a historical expression list 226 may display a set of historical fused expressions used by the user, each of which may be determined based on a corresponding plurality of expressions.

[0067] For example, after the fused expression 214 is selected, the fused expression 214 may be added to the historical expression list 226. In some embodiments, the historical expression list 226 may maintain a predetermined number of fused expressions. When the number of historical fused expressions used by the user exceeds the predetermined number, the electronic device 110 may, for example, replace the earliest used fused expression in the list with the newly used fused expression.

[0068] In some embodiments, the historical expression list 226 may be displayed in an expression panel, for example, and may be arranged according to the order in which the fused expressions were used, for example.

[0069] Based on this approach, the embodiments of the present disclosure can facilitate users to quickly and easily input fusion expressions.

[0070] Although the above reference is made to obtaining a fused expression based on multiple expressions, it should be understood that embodiments of the present disclosure may also support the fusion of other types of interactive elements. Such interactive elements may also include character elements, audio elements, image elements, etc., thereby supporting the fusion of expression elements with other types of interactive elements.

[0071] For example, electronic device 110 can obtain corresponding fused interactive elements based on the input characters and expressions, such as expression elements, character elements, audio elements, image elements, etc. For example, a user can input the character "cry" and further input a laughing expression. For example, fusion can be performed based on the semantic information of the characters and the semantic information and / or visual information of the expression, and, for example, a fused expression of "not knowing whether to laugh or cry" can be obtained.

[0072] The following further describes an example interaction process with reference to Figures 3A and 3B. Figures 3A and 3B illustrate example interfaces 300A and 300B according to some embodiments of the present disclosure. Interfaces 300A and 300B may be provided by the electronic device 110 shown in Figure 1.

[0073] 3A , interface 300A may correspond to, for example, the interface to which the message discussed above is sent, such as a live broadcast interface. It should be understood that interface 300A may correspond to the client of the user who sent message 310 (e.g., user A), or may correspond to the client of another user, such as another user in the live broadcast room.

[0074] As shown in Figure 3A, a message 310 may be generated and sent based on the process discussed above, and the message 310 may include a fused expression 320. Furthermore, upon receiving a selection of the fused expression 320, the electronic device 110 may display a window 330 as shown in Figure 3B.

[0075] As shown in FIG3B , the electronic device 110 may display target information 340 in a window 330 to indicate that the fused expression 320 is determined based on the two expressions shown. Furthermore, the electronic device 110 may also provide a sending entry 350 for sending the fused expression 320, and based on the selection of the sending entry 350, the fused expression 340 may be input into a corresponding input component (e.g., a comment input component in a live broadcast room).

[0076] Additionally, as shown in FIG3B , electronic device 110 may also display one or more other fused expressions in window 330, such as fused expression 360-1 and fused expression 360-2. Such fused expressions 360-1 and fused expression 360-2 may be generated or shared by other users. For example, electronic device 110 may also present corresponding user information in association with fused expression 360-1 or fused expression 360-2.

[0077] Furthermore, the electronic device 110 can also quickly input by, for example, selecting the fused expression 360 - 1 or the fused expression 360 - 2 .

[0078] Based on this approach, the embodiments of the present disclosure can also allow other users to view and use such fused expressions, thereby improving the efficiency of expression interaction.

[0079] Similarly, other types of fusion interactive elements may also support similar interaction processes, so as to enable users to view the fusion process of such fusion interactive elements and to quickly share such fusion interactive elements.

[0080] In some embodiments, embodiments of the present disclosure may also support users accessing fused interactive elements through other appropriate methods. Figures 4A through 4D illustrate example interfaces 400A through 400D according to some embodiments of the present disclosure. Interfaces 400A through 400D may be provided by electronic device 110 shown in Figure 1 . The example interaction process will be described using emoticons as an example of interactive elements.

[0081] As shown in FIG. 4A , the electronic device 110 may present an expression panel 405 on an interface 400A. Such an expression panel 405 may include an expression set 410 available to the user.

[0082] 4B , the electronic device 110 may receive a user operation on the emoticon 420 and may present an emoticon editing window 415. For example, the electronic device 110 may receive a user long press operation on the emoticon 420 and display the emoticon editing window 415 accordingly.

[0083] Furthermore, the electronic device 110 may move the emoticon 420 from the initial position to the emoticon editing window 415 based on the user's dragging operation on the emoticon 420. Accordingly, the electronic device 110 may display the selected emoticon 420 in the emoticon editing window.

[0084] Furthermore, the electronic device 110 may also receive a user selection of one or more emoticons. For example, the electronic device 110 may receive an operation in which the user drags emoticon 425 to the emoticon editing window 415 and may display emoticon 425 in the emoticon editing window 415 accordingly, thereby simultaneously displaying emoticon 420 and emoticon 425.

[0085] In some embodiments, as shown in FIG. 4D , the electronic device 110 may display a fused expression 430 determined based on the expression 420 and the expression 425 in the expression editing window 415 .

[0086] In some embodiments, the electronic device 110 may, for example, automatically display the fused expression 430 after a predetermined period of time without receiving further user input. As another example, the electronic device 110 may also, based on a user request, provide a fused expression 430 determined based on multiple expressions added to the expression editing window 415.

[0087] In some examples, before the fused expression 430 is provided, the electronic device 110 may also receive user operations on other expressions, and further add them to the expression editing window 415 to obtain the corresponding fused expression.

[0088] In some examples, the electronic device 110 may further support combining the fused expression 430 with other expressions. For example, the electronic device 110 may support the user combining other expressions to obtain a new fused expression corresponding to the fused expression 430 and the selected other expressions.

[0089] In some embodiments, as shown in FIG4D , the electronic device 110 may also provide a sending entry associated with the fused expression 430. Furthermore, upon receiving a selection of the sending entry, the electronic device 110 may input the fused expression 430 into an associated target component, such as a comment input component. Alternatively, the electronic device 110 may directly send the fused expression, for example, by sending the fused expression as a comment message to the live broadcast interface.

[0090] Accordingly, the electronic device 110 may stop displaying the emoticon editing window 415 based on the selection of the send entry or the cancel entry.

[0091] In some embodiments, the interactive elements used for fusion may also include, for example, image elements, audio elements, character elements, etc. The electronic device 110 may support the fusion of interactive elements of the same type, or may also support the fusion of interactive elements of different types. For example, a user may drag an emoticon and one or more characters to fuse them to obtain a new emoticon or new character.

[0092] Based on this approach, the embodiments of the present disclosure can support more free exploration of the integration between interactive elements, thereby enhancing the fun of interaction.

[0093] Example Process

[0094] FIG5 shows a flow chart of an example process 500 of interaction according to some embodiments of the present disclosure. Process 500 may be implemented at electronic device 110. Process 500 is described below with reference to FIG1.

[0095] As shown in the figure, in box 510, the electronic device 110 displays multiple interactive elements input by the user in the input field.

[0096] In block 520 , the electronic device 110 provides at least one candidate interactive element, where the at least one candidate interactive element is determined based on a group of interactive elements among the plurality of interactive elements, where the group of interactive elements includes at least an expression element.

[0097] In block 530 , the electronic device 110 replaces a group of interactive elements from among the plurality of interactive elements with the target interactive element based on the selection of the target interactive element from among the at least one candidate interactive element.

[0098] In some embodiments, a group of interactive elements includes at least one of the following: a first group of interactive elements determined based on the display order of multiple interactive elements; a second group of interactive elements among the multiple interactive elements determined to be capable of being combined to generate a fused interactive element; and a third group of interactive elements indicated by user operation.

[0099] In some embodiments, at least one candidate interactive element is generated based on the following process: providing a set of interactive elements to the model; and obtaining a combined interactive element generated by the model based on the set of interactive elements as the candidate interactive element.

[0100] In some embodiments, the model generates a combined interactive element based on visual information and / or semantic information of a group of interactive elements.

[0101] In some embodiments, at least one candidate interactive element is a first group of candidate interactive elements, and process 500 also includes: in response to the target interactive element being able to be combined with at least one other interactive element among the replaced multiple interactive elements, providing a second group of candidate interactive elements, the second group of candidate interactive elements being determined based on the target interactive element and at least one other interactive element.

[0102] In some embodiments, process 500 further includes sending a message generated based on the target interactive element.

[0103] In some embodiments, sending a message generated based on the target interactive element includes: sending a comment message generated based on the target interactive element in the live broadcast interface.

[0104] In some embodiments, the message is displayed at the target user's client, and the client is configured to: present target information based on the target user's preset operation on the target interactive element in the message, and the target information target interactive element is determined based on a set of interactive elements.

[0105] In some embodiments, the client is further configured to: present a first sending portal; and input a target interactive element into an input component of the client based on a selection of the first sending portal.

[0106] In some embodiments, process 500 also includes: based on the selection of the target interactive element, updating the historical interactive element list, the historical interactive element list includes at least one historical fused interactive element used by the current user, wherein the at least one historical fused interactive element is determined based on the corresponding multiple interactive elements.

[0107] In some embodiments, process 500 further includes displaying a list of historical interactive elements in the interactive elements panel.

[0108] In some embodiments, the process 500 further includes: inputting a target fused interactive element into an input field based on a selection of a target fused interactive element in the at least one historical fused interactive element.

[0109] FIG6 shows a flow chart of an example process 600 of interaction according to some embodiments of the present disclosure. Process 600 may be implemented at electronic device 110. Process 600 is described below with reference to FIG1.

[0110] As shown in FIG. 6 , in block 610 , the electronic device 110 presents an editing window based on a first selection of a first interactive element.

[0111] In block 620 , the electronic device 110 presents the selected first interactive element in the editing window.

[0112] In block 630 , the electronic device 110 presents a fused interactive element in the editing window based on the second selection of the at least one second interactive element, where the fused interactive element is determined based on the first interactive element and the at least one second interactive element.

[0113] In some embodiments, the process 600 further includes: inputting the fused interactive element into the target component or sending the fused interactive element based on a selection of a second sending entry in the editing window.

[0114] In some embodiments, presenting the selected first interactive element in the editing window includes: presenting the selected first interactive element in the editing window in response to the first interactive element being moved from the first position into the editing window.

[0115] In some embodiments, the second selection includes moving the at least one second interactive element from the second position into the editing window such that the editing window displays the first interactive element and the at least one second interactive element.

[0116] In some embodiments, the first interactive element, the second interactive element, or the fused interactive element includes at least one of the following: an expression element, a character element, an image element, or an audio element.

[0117] Example devices and equipment

[0118] Embodiments of the present disclosure also provide corresponding apparatuses for implementing the above-described methods or processes. FIG7 shows a schematic structural block diagram of an example interactive apparatus 700 according to certain embodiments of the present disclosure. Apparatus 700 may be implemented as or included in electronic device 110. Each module / component in apparatus 700 may be implemented by hardware, software, firmware, or any combination thereof.

[0119] As shown in Figure 7, the device 700 includes a display module 710, which is configured to display multiple interactive elements input by the user in an input bar; a providing module, which is configured to provide at least one candidate interactive element, and the at least one candidate interactive element is determined based on a group of interactive elements among multiple interactive elements, and the group of interactive elements includes at least an expression element; and a replacement module 720, which is configured to replace a group of interactive elements among multiple interactive elements with a target interactive element based on the selection of a target interactive element among the at least one candidate interactive element.

[0120] In some embodiments, a group of interactive elements includes at least one of the following: a first group of interactive elements determined based on the display order of multiple interactive elements; a second group of interactive elements among the multiple interactive elements determined to be capable of being combined to generate a fused interactive element; and a third group of interactive elements indicated by user operation.

[0121] In some embodiments, at least one candidate interactive element is generated based on the following process: providing a set of interactive elements to the model; and obtaining a combined interactive element generated by the model based on the set of interactive elements as the candidate interactive element.

[0122] In some embodiments, the model generates a combined interactive element based on visual information and / or semantic information of a group of interactive elements.

[0123] In some embodiments, at least one candidate interactive element is a first group of candidate interactive elements, and the providing module 720 is further configured to: in response to the target interactive element being able to be combined with at least one other interactive element among the replaced multiple interactive elements, provide a second group of candidate interactive elements, the second group of candidate interactive elements being generated based on the target interactive element and at least one other interactive element.

[0124] In some embodiments, the apparatus 700 further includes a sending module configured to send a message generated based on the target interactive element.

[0125] In some embodiments, the sending module is further configured to: send a comment message generated based on the target interactive element in the live broadcast interface.

[0126] In some embodiments, the message is displayed at the target user's client, and the client is configured to: present target information based on the target user's preset operation on the target interactive element in the message, and the target information target interactive element is determined based on a set of interactive elements.

[0127] In some embodiments, the client is further configured to: present a first sending portal; and input a target interactive element into an input component of the client based on a selection of the first sending portal.

[0128] In some embodiments, the device 700 also includes an update module configured to: update the historical interactive element list based on the selection of the target interactive element, the historical interactive element list including at least one historical fused interactive element used by the current user, wherein the at least one historical fused interactive element is determined based on the corresponding multiple interactive elements.

[0129] In some embodiments, the device 700 further includes an interactive element viewing module configured to: display a list of historical interactive elements in the interactive element panel.

[0130] In some embodiments, the apparatus 700 further includes an interactive element input module configured to input a target fused interactive element into the input field based on a selection of a target fused interactive element in at least one historical fused interactive element.

[0131] FIG8 shows a block diagram of an electronic device 800 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 800 shown in FIG8 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 800 shown in FIG8 can be used to implement the electronic device 110 of FIG1 .

[0132] As shown in FIG8 , electronic device 800 is a general-purpose electronic device. Components of electronic device 800 may include, but are not limited to, one or more processors or processing units 810, memory 820, storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. Processing unit 810 may be a real or virtual processor and is capable of performing various processes according to programs stored in memory 820. In a multi-processor system, multiple processing units execute computer-executable instructions in parallel to enhance the parallel processing capabilities of electronic device 800.

[0133] The electronic device 800 typically includes a plurality of computer storage media. Such media can be any accessible media that can be obtained by the electronic device 800, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 820 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 can be a removable or non-removable medium and can include a machine-readable medium, such as a flash drive, a disk, or any other medium that can be used to store information and / or data and can be accessed within the electronic device 800.

[0134] The electronic device 800 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG8 , a disk drive for reading from or writing to a removable, non-volatile disk (e.g., a “floppy disk”) and an optical drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a bus (not shown) by one or more data media interfaces. The memory 820 may include a computer program product 825 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0135] The communication unit 840 enables communication with other electronic devices via a communication medium. Additionally, the functions of the components of the electronic device 800 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Thus, the electronic device 800 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0136] The input device 850 may be one or more input devices, such as a mouse, keyboard, or trackball. The output device 860 may be one or more output devices, such as a display, a speaker, or a printer. The electronic device 800 may also communicate with one or more external devices (not shown) via the communication unit 840 as needed, such as a storage device, a display device, or the like, with one or more devices that allow a user to interact with the electronic device 800, or with any device that allows the electronic device 800 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0137] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0138] Various aspects of the present disclosure are described herein with reference to flowcharts and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0139] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, such that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0140] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0141] The flow charts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple implementations of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a part for a module, program segment or instruction, and a part for a module, program segment or instruction comprises one or more executable instructions for realizing the logical function of the specification. In some alternative implementations, the functions marked in the box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0142] While various implementations of the present disclosure have been described above, the foregoing description is intended to be illustrative, not exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is selected to best explain the principles of the implementations, their practical applications, or improvements to existing technologies, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. An interaction method, comprising: Displaying multiple interaction elements input by a user in an input field; Providing at least one candidate interaction element, where the at least one candidate interaction element is determined based on a set of interaction elements among the multiple interaction elements, and the set of interaction elements includes at least expression elements; And Based on the selection of a target interaction element among the at least one candidate interaction element, using the target interaction element to replace the set of interaction elements among the multiple interaction elements.

2. The method according to claim 1, wherein the set of interaction elements includes at least one of the following: A first set of interaction elements determined based on the display order of the multiple interaction elements; A second set of interaction elements among the multiple interaction elements that are determined to be combinable to generate a fused interaction element; A third set of interaction elements indicated by a user operation.

3. The method according to claim 1, wherein the at least one candidate interaction element is generated based on the following process: Providing the set of interaction elements to a model; and Obtaining a combined interaction element generated by the model based on the set of interaction elements as the candidate interaction element.

4. The method according to claim 3, wherein the model generates the combined interaction element based on the visual information and / or semantic information of the set of interaction elements.

5. The method according to claim 1, wherein the at least one candidate interaction element is a first set of candidate interaction elements, and the method further comprises: In response to the target interaction element being combinable with at least one other interaction element among the replaced multiple interaction elements, providing a second set of candidate interaction elements, where the second set of candidate interaction elements is generated based on the target interaction element and the at least one other interaction element.

6. The method according to claim 1, further comprising: Sending a message generated based on the target interaction element.

7. The method according to claim 6, wherein sending a message generated based on the target interaction element includes: Sending a comment message generated based on the target interaction element in a live broadcast interface.

8. The method according to claim 7, wherein the message is displayed at a client of a target user, and the client is configured to: Based on a preset operation of the target user on the target interaction element in the message, presenting target information, where the target information is determined based on the set of interaction elements for the target interaction element.

9. The method according to claim 8, wherein the client is further configured to: Presenting a first sending entry; and Based on the selection of the first sending entry, inputting the target interaction element in an input component of the client.

10. The method according to claim 1, further comprising: Based on the selection of the target interaction element, updating a historical interaction element list, where the historical interaction element list includes at least one historical fused interaction element used by the current user, and the at least one historical fused interaction element is determined based on corresponding multiple interaction elements.

11. The method according to claim 10, further comprising: Display the list of historical interactive elements in the interactive element panel.

12. The method according to claim 10, further comprising: Based on the selection of a target integrated interactive element among the at least one historical integrated interactive element, input the target integrated interactive element into the input field.

13. An interaction method, comprising: Present an editing window based on a first selection of a first interactive element; Present the selected first interactive element in the editing window; And Based on a second selection of at least one second interactive element, present an integrated interactive element in the editing window, the integrated interactive element being determined based on the first interactive element and the at least one second interactive element.

14. The method according to claim 13, further comprising: Based on the selection of a second sending entry in the editing window, input the integrated interactive element into a target component or send the integrated interactive element.

15. The method according to claim 13, wherein presenting the selected first interactive element in the editing window comprises: In response to the first interactive element being moved from a first position to the editing window, present the selected first interactive element in the editing window.

16. The method according to claim 13, wherein the second selection comprises: Move the at least one second interactive element from a second position to the editing window, such that the editing window displays the first interactive element and the at least one second interactive element.

17. The method according to claim 13, wherein the first interactive element, the second interactive element or the integrated interactive element comprises at least one of the following: Emoticon element, character element, image element, audio element.

18. An interaction device, comprising: A display module configured to display a plurality of interactive elements input by a user in an input field; A providing module configured to provide at least one candidate interactive element, the at least one candidate interactive element being determined based on a group of interactive elements among the plurality of interactive elements, the group of interactive elements including at least an emoticon element; And A replacement module configured to, based on the selection of a target interactive element among the at least one candidate interactive element, replace the group of interactive elements among the plurality of interactive elements with the target interactive element.

19. An electronic device, comprising: At least one processing unit; And At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, cause the electronic device to execute the method according to any one of claims 1 to 12 or 13 to 17.

20. A computer-readable storage medium, having stored thereon a computer program, the computer program being executable by a processor to implement the method according to any one of claims 1 to 12 or 13 to 17.

Images