Session processing method and apparatus, electronic device, storage medium, and program product

Abstract

The application provides a conversation processing method and device, electronic equipment, computer readable storage medium and computer program product; the method comprises the following steps: in response to the message input operation of the man-machine interaction interface, display the conversation message, wherein the conversation message comprises a conversation text and at least one emoticon; in response to the sending operation of the conversation message, send the conversation message, and splice and display the target text with the at least one emoticon as the basic display element in the man-machine interaction interface, wherein the target text is associated with the conversation text. Through the application, the conversation message can be effectively and fully displayed, and the conversation efficiency is improved.

Description

Technical Field

[0001] This application relates to Internet technology, and more particularly to a session processing method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Technology

[0002] With the development of internet technology, instant messaging applications are becoming increasingly widespread. Instant messaging applications provide users with internet-based instant messaging services, allowing two or more people to instantly exchange text, voice, and video messages over the network. As instant messaging applications have developed, they have permeated people's lives, and more and more people are using them for communication.

[0003] During conversations via instant messaging applications, when a user's message contains keywords that trigger emojis, the emojis associated with those keywords are dynamically displayed in the human-computer interaction interface (HCI). For example, if a user enters the message "Happy Birthday," a "cake" emoji appears as an emoji rain in the HCI. However, this display method has limited information capacity and struggles to convey effective information about the conversation, leading to low conversation efficiency. Summary of the Invention

[0004] This application provides a session processing method, apparatus, electronic device, computer-readable storage medium, and computer program product, which can fully and effectively display session messages and improve session efficiency.

[0005] The technical solution of this application embodiment is implemented as follows: This application provides a session processing method, including: In response to a message input operation on the human-computer interaction interface, a conversation message is displayed, wherein the conversation message includes conversation text and at least one emoji; In response to the sending operation of the conversation message, the conversation message is sent, and the target text is displayed in the human-computer interaction interface by concatenating the at least one emoji as a basic display element, wherein the target text is associated with the conversation text.

[0006] This application provides a session processing method, including: Receive a session message, wherein the session message includes session text and at least one emoji; In the human-computer interaction interface, at least one emoji is used as a basic display element to concatenate and display target text, wherein the target text is associated with the conversation text.

[0007] This application provides a session processing apparatus, including: The first display module is used to display a conversation message in response to a message input operation on the human-computer interaction interface, wherein the conversation message includes conversation text and at least one emoticon; The second display module is used to send the conversation message in response to the sending operation of the conversation message, and to display the target text in the human-computer interaction interface by using at least one emoji as a basic display element, wherein the target text is associated with the conversation text.

[0008] In the above technical solution, the target text includes multiple consecutive characters in the conversation text, and the consecutive characters are located at the beginning, middle or end of the conversation text; the second display module is further configured to, when the at least one emoticon is a set emoticon, use the at least one emoticon as a basic display element to splice the multiple consecutive characters, and display the spliced ​​multiple consecutive characters in the human-computer interaction interface.

[0009] In the above technical solution, the target text includes the account in the conversation text; the second display module is further configured to use the at least one emoji as a basic display element when the at least one emoji is a set emoji and the conversation text includes a pointer, to concatenate the at least one emoji into the account pointed to by the pointer, and to display the concatenated account in the human-computer interaction interface.

[0010] In the above technical solution, the target text includes keywords in the conversation text, and the keywords are preset; the second display module is further configured to, when the at least one emoticon is a preset emoticon and the conversation text includes the keywords, use the at least one emoticon as a basic display element to concatenate the keywords, and display the concatenated keywords in the human-computer interaction interface.

[0011] In the above technical solution, the target text is the semantically extracted text obtained by reading comprehension of the conversation text; the second display module is also used to call a reading comprehension model based on the conversation text to perform reading comprehension processing and obtain the semantically extracted text; The at least one emoji is used as a basic display element to be concatenated into the semantically extracted text, and the concatenated semantically extracted text is displayed in the human-computer interaction interface. The reading comprehension model is trained using historical conversation text and corresponding semantically extracted text annotations.

[0012] In the above technical solution, the second display module is further configured to invoke the reading comprehension model based on the conversation text and historical conversation text to perform the following processing: The conversation text and the historical conversation text are subjected to information fusion processing to obtain fused information; The fused information is subjected to feature extraction processing to obtain session features; The conversation features are processed by text mapping to obtain the semantically refined text.

[0013] In the above technical solution, before displaying the target text by splicing at least one emoji as a basic display element in the human-computer interaction interface, the second display module is further used to display multiple candidate types of the target text in the human-computer interaction interface; wherein, the multiple candidate types include: multiple consecutive characters in the conversation text, account, keywords, and semantically extracted text obtained by reading and understanding the conversation text; In response to a selection operation for the plurality of candidate types, the text of the selected candidate type is used as the target text to be concatenated and displayed.

[0014] In the above technical solution, before the target text is concatenated and displayed in the human-computer interaction interface using at least one emoji as a basic display element, the second display module is further configured to respond to a selection operation for the characters included in the conversation text and use the selected character in the conversation text as the target text. When the conversation message includes multiple emojis, in response to a selection operation for the multiple emojis, the selected emoji is used as the basic display element.

[0015] In the above technical solution, the at least one emoji includes an emoji associated with the conversation message; in the human-computer interaction interface, before using the at least one emoji as a basic display element to splice and display the target text, the second display module is also used to call a reading comprehension model based on the conversation text to perform reading comprehension processing and obtain semantically refined text; The emojis associated with the semantically extracted text in the conversation message are used as the basic display elements; The reading comprehension model is trained using historical conversation text and corresponding semantically extracted text annotations.

[0016] In the above technical solution, before using the at least one emoji as a basic display element to splice and display the target text in the human-computer interaction interface, the second display module is further used to display multiple candidate sources of the at least one emoji in the human-computer interaction interface; wherein, the multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text; In response to the selection operation for the plurality of candidate sources, the emoji of the selected candidate source is used as the basic display element.

[0017] In the above technical solution, before the target text is spliced ​​and displayed in the human-computer interaction interface using the at least one emoji as a basic display element, the second display module is further configured to obtain at least one emoji as the basic display element from at least one of the candidate sources according to the priority order of multiple candidate sources from high to low. The multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text.

[0018] In the above technical solution, the second display module is further used to use the at least one emoji as a basic display element to splice the target text, and to display the spliced ​​target text in the form of bullet comments starting from one side of the human-computer interaction interface, until the spliced ​​target text moves to the other side of the human-computer interaction interface and disappears. When the conversation text includes a set keyword, the human-computer interaction interface displays the movement process of multiple emoji copies of the at least one emoji.

[0019] In the above technical solution, the second display module is further used to use the at least one emoji as a basic display element to splice together the target text, and statically display the spliced ​​target text in the human-computer interaction interface; When the static display trigger operation is received, or when the static display meets the trigger conditions, the spliced ​​target text is dynamically displayed in the human-computer interaction interface.

[0020] In the above technical solution, the triggering condition includes at least one of the following: The importance of the conversation message is greater than the importance threshold, and the importance index parameters include the degree of relevance to the conversation topic; The display mode of the concatenated target text is configured as dynamic display.

[0021] In the above technical solution, the second display module is further configured to replace the target text with the text corresponding to the first modification operation in response to the first modification operation; In response to a second modification operation on an emoji that serves as the basic display element, the emoji corresponding to the second modification operation is used as the basic display element.

[0022] In the above technical solution, the second display module is further configured to respond to a first size adjustment operation for the basic display element, adjust the size of the emoticons used as the basic display element based on the target size set by the first size adjustment operation, and simultaneously adjust the number of emoticons used as the basic display element so that the adjusted number can be exactly spliced ​​into the displayed target text; In response to a second size adjustment operation on the target text, the size of the target text is adjusted based on the target size set by the second size adjustment operation, and the size of the emoticons, which are the basic display elements, is adjusted simultaneously so that the adjusted emoticons can be perfectly joined to form the adjusted target text.

[0023] This application provides a session processing apparatus, including: A receiving module is used to receive conversation messages, wherein the conversation messages include conversation text and at least one emoji; The third display module is used to concatenate and display target text in the human-computer interaction interface using at least one emoji as a basic display element, wherein the target text is associated with the conversation text.

[0024] This application provides an electronic device for session processing, the electronic device comprising: Memory, used to store executable instructions; The processor, when executing executable instructions stored in the memory, implements the session processing method provided in the embodiments of this application.

[0025] This application provides a computer-readable storage medium storing executable instructions for inducing a processor to execute and implement the session processing method provided in this application.

[0026] This application provides a computer program product, including a computer program or instructions, characterized in that the computer program or instructions, when executed by a processor, implement the session processing method provided in this application.

[0027] The embodiments of this application have the following beneficial effects: By using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface, the conversation text is highlighted, thereby fully and effectively displaying conversation messages and conveying effective information about the conversation scenario. Compared with displaying emojis associated with keywords, this improves the interaction efficiency and conversation effect, thereby saving related communication and computing resources. Attached Figure Description

[0028] Figure 1This is a schematic diagram of the architecture of the session system provided in the embodiments of this application; Figure 2 This is a schematic diagram of the structure of an electronic device for session processing provided in an embodiment of this application; Figures 3A-3C This is a flowchart illustrating the session processing method provided in an embodiment of this application; Figure 4A This is a schematic diagram of the session interface provided in an embodiment of this application; Figure 4B This is a schematic diagram of the input messages provided in an embodiment of this application; Figure 4C This is a schematic diagram of the target text provided in the embodiments of this application; Figure 4D This is a schematic diagram of the target text provided in the embodiments of this application; Figure 5A This is a schematic diagram of a special facial expression provided in an embodiment of this application; Figure 5B This is a schematic diagram of the input messages provided in an embodiment of this application; Figure 5C This is a schematic diagram of the emoji text bullet screen provided in the embodiments of this application; Figure 5D This is a schematic diagram illustrating the adjustment of basic display elements provided in the embodiments of this application; Figure 6 This is a flowchart illustrating the session processing method provided in an embodiment of this application; Figure 7 This is a schematic diagram of a white-background, black-text image provided in an embodiment of this application; Figure 8A This is a schematic diagram of the input messages provided in an embodiment of this application; Figure 8B This is a schematic diagram of the emoji text bullet screen provided in the embodiments of this application; Figure 9 This is a flowchart illustrating the session processing method provided in an embodiment of this application; Figure 10A This is a schematic diagram of the input messages provided in an embodiment of this application; Figure 10B This is a schematic diagram of the Easter egg emoji rain provided in the embodiments of this application; Figure 11A This is a schematic diagram of the input messages provided in an embodiment of this application; Figure 11B This is a schematic diagram of the Easter egg emoji rain provided in the embodiments of this application; Figure 12 This is a flowchart illustrating the session processing method provided in an embodiment of this application; Figure 13AThis is a schematic diagram of the input messages provided in an embodiment of this application; Figure 13B This is a schematic diagram of the Easter egg emoji rain provided in the embodiments of this application. Detailed Implementation

[0029] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. The described embodiments should not be regarded as limitations on this application. All other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0030] In the following description, the terms "first" and "second" are used merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first" and "second" may be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0031] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0032] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.

[0033] 1) Responding to: used to indicate the conditions or states on which the operation is performed depends. When the conditions or states on which it depends are met, one or more operations can be performed in real time or with a set delay. Unless otherwise specified, there is no restriction on the order in which the multiple operations are performed.

[0034] 2) Emojis: A popular culture that emerged after the rise of social media applications, used to express specific emotions, such as the emotions displayed on a user's face or in their posture. In practical applications, emojis can be divided into symbol emojis, static image emojis, dynamic image emojis, video emojis, etc. For example, emojis can use faces that express various user emotions as material, or use currently popular celebrities, anime, movie screenshots, etc. as material, and then add a series of matching text.

[0035] 3) Easter Egg Emoji Rain: When a user's conversation message contains certain keywords, rain-like emojis are triggered in the human-computer interaction interface.

[0036] 4) Common chat window component (AIO, All In One): Users participate in many different types of conversations such as friends, groups, and public accounts. In order to provide users with a unified interactive experience, the software provides a chat window component that is shared by different conversations. The user's input, click and other behavior habits in the component are consistent.

[0037] In instant messaging applications, emoji interaction is relatively simple. An emoji rain appears when a message contains keywords or when keywords are entered in a text input box. Message content is displayed via message bubbles and arranged chronologically on the page, without any other enhancements.

[0038] To address the aforementioned issues, embodiments of this application provide a session processing method, apparatus, electronic device, and computer-readable storage medium, which can effectively display session messages and improve session efficiency.

[0039] The session processing method provided in this application embodiment can be implemented by the terminal alone; or it can be implemented by the terminal and the server in collaboration. For example, the terminal can undertake the session processing method described below alone, or the terminal of the session sender can send a session message to the server, and the server can generate target text based on the session message, which is concatenated and displayed using at least one emoji as a basic display element, and send the generated target text to the terminal of the session sender and the terminal of the session receiver, making the session more vivid and interesting and increasing the stickiness of the session.

[0040] The following describes exemplary applications of the electronic devices provided in the embodiments of this application. These electronic devices can be implemented as various types of user terminals, such as laptops, tablets, desktop computers, set-top boxes, and mobile devices (e.g., mobile phones, portable music players, personal digital assistants, dedicated messaging devices, portable gaming devices, and in-vehicle devices). Exemplary applications of the electronic devices as terminals will be described below.

[0041] See Figure 1 , Figure 1 This is a schematic diagram of the architecture of the session system 100 provided in the embodiments of this application. The terminal (terminal 200-1 and terminal 200-2 are shown as examples) connects to the server 100 through the network 300, wherein the network 300 can be a wide area network or a local area network, or a combination of the two.

[0042] In some embodiments, taking the electronic device as a terminal as an example, the session processing method provided in this application embodiment can be implemented by the terminal. For example, terminal 200-1 presents a human-computer interaction interface, and in response to a message input operation on the human-computer interaction interface, obtains a session message. In response to a sending operation for the session message, it sends the session message to terminal 200-2, and displays the target text in the human-computer interaction interface using at least one emoticon as a basic display element. Terminal 200-2 receives the session message, displays the session message in the human-computer interaction interface of terminal 200-2, and displays the target text in the human-computer interaction interface using at least one emoticon as a basic display element, so as to conveniently transmit information, make the session more vivid and interesting, and improve the stickiness of the session.

[0043] In some embodiments, the session processing method provided in this application can also be implemented collaboratively by a server and a terminal. For example, terminal 200-1 presents a human-computer interaction interface. In response to a message input operation on the human-computer interaction interface, it obtains a session message. In response to a sending operation for the session message, it sends the session message to server 100. After receiving the session message, server 100 generates target text that is concatenated and displayed using at least one emoticon as a basic display element, and sends the generated target text to terminal 200-1. It also sends the generated target text and the session message to terminal 200-2, so that the generated target text can be displayed on the human-computer interaction interfaces of terminal 200-1 and terminal 200-2, thereby facilitating information transmission, making the session more vivid and interesting, and increasing the stickiness of the session.

[0044] In some embodiments, the terminal can implement the session processing method provided in this application by running a computer program. For example, the computer program can be a native program or software module in the operating system; it can be a native application (APP), that is, a program that needs to be installed in the operating system to run, such as an instant messaging APP (i.e., a client); it can also be a mini-program, that is, a program that only needs to be downloaded into the browser environment to run; or it can be a game mini-program that can be embedded in any APP. In short, the above-mentioned computer program can be any form of application, module or plugin.

[0045] In some embodiments, server 100 may be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms. Among these, cloud services may be live streaming processing services that can be invoked by terminals.

[0046] In some embodiments, multiple servers can form a blockchain, and server 100 is a node on the blockchain. Information connections can exist between each node in the blockchain, and information can be transmitted between nodes through these connections. Data related to the session processing method provided in this application embodiment (e.g., session processing logic, target text) can be stored on the blockchain.

[0047] The structure of the electronic device for session processing provided in the embodiments of this application is described below. See also... Figure 2 , Figure 2 This is a schematic diagram of the structure of an electronic device 500 for session processing provided in an embodiment of this application. The explanation is based on the example of the electronic device 500 being a terminal (the electronic device 500 can be used as...). Figure 1 Terminal 200-1 in the middle can also be used as Figure 1 Terminal 200-2 in the middle). Figure 2 The illustrated electronic device 500 for session processing includes at least one processor 510, a memory 550, at least one network interface 520, and a user interface 530. The various components in the electronic device 500 are coupled together via a bus system 540. It is understood that the bus system 540 is used to implement communication between these components. In addition to a data bus, the bus system 540 also includes a power bus, a control bus, and a status signal bus. However, for clarity, ... Figure 2 The general labeled all buses as Bus System 540.

[0048] The processor 510 can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.

[0049] Memory 550 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 550 described in this application embodiment is intended to include any suitable type of memory. Memory 550 may optionally include one or more storage devices physically located away from processor 510.

[0050] In some embodiments, memory 550 is capable of storing data to support various operations, examples of which include programs, modules, and data structures or subsets or supersets thereof, as illustrated below.

[0051] Operating system 551 includes system programs for handling various basic system services and performing hardware-related tasks, such as the framework layer, core library layer, driver layer, etc., for implementing various basic business functions and handling hardware-based tasks; The network communication module 552 is used to reach other computing devices via one or more (wired or wireless) network interfaces 520, exemplary network interfaces 520 including: Bluetooth, WiFi, and Universal Serial Bus (USB), etc. In some embodiments, the session processing apparatus provided in this application can be implemented in software. The session processing apparatus provided in this application can be provided in various software embodiments, including various forms such as applications, software, software modules, scripts or code.

[0052] Figure 2 A session processing device 555 stored in memory 550 is shown. It may be software in the form of programs and plug-ins, and includes a series of modules, including a first display module 5551, a second display module 5552, or a receiving module 5553 and a third display module 5554. These modules are logically related and can therefore be arbitrarily combined or further divided according to the functions they implement. The functions of each module will be described below.

[0053] As mentioned above, the session processing method provided in this application embodiment can be implemented by various types of electronic devices. See also Figure 3A , Figure 3A This is a flowchart illustrating the session processing method provided in the embodiments of this application, combined with... Figure 3A The steps shown are explained.

[0054] It should be noted that, Figure 3A The method shown can be executed by various forms of computer programs running on the terminal (sending side), and is not limited to the client described above. It can also be the operating system 551, software modules and scripts mentioned above. Therefore, the client should not be regarded as a limitation on the embodiments of this application.

[0055] In step 101, in response to a message input operation on the human-computer interaction interface, a conversation message is displayed, wherein the conversation message includes conversation text and at least one emoticon. In step 102, in response to the sending operation of the conversation message, the conversation message is sent, and the target text is displayed in the human-computer interaction interface by concatenating at least one emoji as the basic display element, wherein the target text is associated with the conversation text.

[0056] As mentioned above, the session processing method provided in this application embodiment can be implemented by various types of electronic devices. See also Figure 3B , Figure 3B This is a flowchart illustrating the session processing method provided in the embodiments of this application, combined with... Figure 3B The steps shown are explained. It should be noted that, Figure 3B The method shown can be executed by various forms of computer programs running on the terminal (receiving side), and is not limited to the client described above. It can also be the operating system 551, software modules and scripts mentioned above. Therefore, the client should not be regarded as a limitation on the embodiments of this application.

[0057] In step 201, a session message is received, wherein the session message includes session text and at least one emoji.

[0058] In step 202, in the human-computer interaction interface, at least one emoji is used as a basic display element to concatenate and display the target text, wherein the target text is associated with the conversation text.

[0059] As mentioned above, the session processing method provided in this application embodiment can be implemented by various types of electronic devices. See also Figure 3C , Figure 3C This is a flowchart illustrating the session processing method provided in the embodiments of this application, combined with... Figure 3C The steps shown are explained.

[0060] In step 301, the sending side responds to the message input operation on the human-computer interaction interface by displaying a conversation message, wherein the conversation message includes conversation text and at least one emoji.

[0061] like Figure 4A As shown in Figure 4, during conversational interaction, a conversation editing area 401 is presented in the human-computer interaction interface. This conversation editing area 401 is used to input conversational messages to be sent. The conversation editing area 401 includes a text input box for displaying the input text, a virtual keyboard, etc. As shown in Figure 4, the user (i.e., the conversation sender) can input text messages such as text, characters, and emoticons in the text input box. After inputting, the user can obtain the input conversational message.

[0062] It should be noted that when a user enters only conversational text in the text input box, the conversational message only includes the conversational text. The emojis are not manually entered by the user. The emojis can also be generated by real-time parsing of the input conversational text to obtain the emotions expressed in the conversational text and automatically filling the corresponding conversational text with the corresponding emojis to form a conversational message that includes conversational text and at least one emoji. Alternatively, a selection box of multiple emojis corresponding to the emotions can be automatically popped up for the user to select and enter, forming a conversational message that includes conversational text and at least one emoji.

[0063] In step 302, the sending side responds to the sending operation for the conversation message by sending the conversation message and displays the target text in the human-computer interaction interface by using at least one emoji as the basic display element, wherein the target text is associated with the conversation text.

[0064] like Figure 4A As shown, after the message input is completed, the send button 402 is clicked to send the conversation message to the conversation recipient. The conversation message is displayed in the conversation area of ​​the human-computer interaction interface, and the target text is displayed by splicing together at least one emoticon as a basic display element. The display order of the conversation message and the target text is not limited in this embodiment.

[0065] It should be noted that after the session sender (i.e., the sending side) obtains the session message, it generates target text that is concatenated and displayed using at least one emoji as a basic display element, and can send the target text to the session receiver (i.e., the receiving side). Alternatively, after obtaining the session message, the session sender can send the session message to the server. After receiving the session message, the server generates target text that is concatenated and displayed using at least one emoji as a basic display element, and sends the generated target text to the session sender. The generated target text and the session message are then sent to the session receiver.

[0066] In some embodiments, the target text includes multiple consecutive characters in the conversation text, the consecutive characters being located at the beginning, middle or end of the conversation text; in the human-computer interaction interface, the target text is concatenated and displayed using at least one emoticon as a basic display element, including: when at least one emoticon is a set emoticon, concatenating at least one emoticon as a basic display element into multiple consecutive characters, and displaying the concatenated multiple consecutive characters in the human-computer interaction interface.

[0067] like Figure 5A As shown, a special emoticon 501 is pre-defined. This special emoticon 501 can trigger processing logic that uses emoticons as basic display elements to concatenate and display target text (i.e., emoticon text bullet screen logic), such as... Figure 5BAs shown, when the emoticon included in the input session message 502 is a set special emoticon, the processing logic of splicing and displaying the target text by using emoticons as basic display elements is triggered, as Figure 5C shown, the special emoticons are spliced into the first N consecutive characters 503 in the session message, for example, "hahaha". Of course, the special emoticons can also be spliced into the last N consecutive characters or the middle N consecutive characters in the session message, where N is a natural number greater than 1, and N can be set according to actual requirements.

[0068] In some embodiments, the target text includes an account in the session text; splicing and displaying the target text with at least one emoticon as a basic display element in a human-computer interaction interface includes: when the at least one emoticon is a set emoticon and the session text includes a pointing character, using the at least one emoticon as a basic display element to splice into the account pointed to by the pointing character, and displaying the spliced account in the human-computer interaction interface.

[0069] As Figure 5A shown, a special emoticon 501 is preset, and the special emoticon 501 can trigger the processing logic of splicing and displaying the target text by using emoticons as basic display elements, as Figure 8A shown, when the emoticon included in the input session message 801 is a set special emoticon and the session message includes the pointing character @, the processing logic of splicing and displaying the target text by using emoticons as basic display elements is triggered, as Figure 8B shown, the special emoticons are spliced into the account pointed to by the pointing character, for example, "Xiaohaha". Of course, the special emoticons can also be spliced into the last N consecutive characters or the middle N consecutive characters in the account, where N is a natural number greater than 1, and N can be set according to actual requirements.

[0070] In some embodiments, the target text includes a keyword in the session text, and the keyword is preset; splicing and displaying the target text with at least one emoticon as a basic display element in a human-computer interaction interface includes: when the at least one emoticon is a set emoticon and the session text includes the keyword, splicing the keyword with the at least one emoticon as a basic display element, and displaying the spliced keyword in the human-computer interaction interface.

[0071] As Figure 5A shown, a special emoticon 501 is preset, and the special emoticon 501 can trigger the processing logic of splicing and displaying the target text by using emoticons as basic display elements, as Figure 11AAs shown, when the input conversation message includes a special emoji 1102 and the conversation message includes the keyword 1101, the processing logic of using emojis as basic display elements to concatenate and display the target text is triggered, such as... Figure 11B As shown, special emoticons are combined to form keywords, such as "haha".

[0072] It should be noted that the target text can also be associated text bound to keywords included in the conversation text. For example, if the conversation text is "This XX watch is good" and the keyword is "XX watch", then the associated text is the advertising information "widely loved by young people". This will trigger the processing logic that uses emojis as the basic display element to splice and display the target text, splicing the emojis of "watch" into the associated text "widely loved by young people".

[0073] In some embodiments, the target text is semantically extracted text obtained by reading comprehension of the conversation text; in the human-computer interaction interface, the target text is concatenated and displayed using at least one emoji as a basic display element, including: calling a reading comprehension model to perform reading comprehension processing based on the conversation text to obtain semantically extracted text; concatenating at least one emoji as a basic display element into semantically extracted text, and displaying the concatenated semantically extracted text in the human-computer interaction interface; wherein, the reading comprehension model is trained by annotating historical conversation text and corresponding semantically extracted text.

[0074] For example, when the number of characters in a conversation message exceeds a threshold, a reading comprehension model is invoked based on the conversation text to perform reading comprehension processing, thereby simplifying and refining the conversation text to obtain semantically refined text. At least one emoji is used as a basic display element to concatenate the semantically refined text, which is then displayed on the human-computer interaction interface. This embodiment does not limit the model structure of the reading comprehension model; for example, the reading comprehension model can be a convolutional neural network, a deep neural network, etc.

[0075] As an example, such as Figure 4B As shown, when the number of characters in the input conversation message 403 exceeds the threshold, the processing logic of using emojis as basic display elements to concatenate and display the target text is triggered, such as... Figure 4C As shown, the semantic extraction of the conversation text "The weather is particularly nice today, perfect for a picnic. I went on a picnic to XXX today and I'm in a great mood" yields the semantically extracted text "haha". Then, the emoticons in the conversation message are concatenated to form the semantically extracted text "haha" 404.

[0076] In some embodiments, reading comprehension processing is performed on a reading comprehension model based on conversational text to obtain semantically refined text, including: performing the following processing on a reading comprehension model based on conversational text and historical conversational text: performing information fusion processing on conversational text and historical conversational text to obtain fused information; performing feature extraction processing on the fused information to obtain conversational features; and performing text mapping processing on the conversational features to obtain semantically refined text.

[0077] For example, to extract textual information more accurately, semantic extraction can be performed by combining conversational text and historical conversational text. This requires information fusion processing of the conversational text and historical conversational text, such as concatenating or weighting the conversational text and historical conversational text to obtain fused information. Then, the fused information is processed by feature extraction through cascaded convolutional layers in the reading comprehension model to extract accurate conversational features. Finally, the conversational features are processed by text mapping through cascaded fully connected layers in the reading comprehension model to obtain semantically refined text.

[0078] In some embodiments, before concatenating and displaying target text using at least one emoji as a basic display element in the human-computer interaction interface, multiple candidate types of the target text are displayed in the human-computer interaction interface; wherein, the multiple candidate types include: multiple consecutive characters in the conversation text, account, keywords, and semantically extracted text obtained by reading and understanding the conversation text; in response to the selection operation for the multiple candidate types, the text of the selected candidate type is used as the target text to be concatenated and displayed.

[0079] For example, users can pre-set the type of target text, display a setting entry for the type in the human-computer interaction interface, respond to the trigger operation of the setting entry, display multiple candidate types of target text in the human-computer interaction interface, and respond to the selection operation of multiple candidate types, use the text of the selected candidate type as the target text to be concatenated and displayed, thereby realizing the user's manual selection of the type of target text.

[0080] For example, when the emojis included in the conversation message are special emojis that are set, the processing logic of using emojis as the basic display element to concatenate and display the target text is triggered, and multiple candidate types of the target text are displayed on the human-computer interaction interface. In response to the selection operation of multiple candidate types, the text of the selected candidate type is used as the target text to be concatenated and displayed, and the target text is concatenated and displayed using emojis as the basic display element.

[0081] In some embodiments, in the human-computer interaction interface, before concatenating and displaying target text using at least one emoji as a basic display element, in response to a selection operation of characters included in the conversation text, the selected character in the conversation text is used as the target text; when the conversation message includes multiple emojis, in response to a selection operation of multiple emojis, the selected emoji is used as the basic display element.

[0082] For example, when the emojis included in the conversation message are special emojis that are set, the processing logic of using emojis as the basic display elements to concatenate and display the target text is triggered. If the conversation text in the conversation message supports selection operations, then in response to the selection operation of the characters included in the conversation text, the selected characters in the conversation text are used as the target text, and the emojis are used as the basic display elements to concatenate and display the target text, so as to realize the manual selection of the target text to be displayed.

[0083] For example, when a set keyword is included in a conversation message, the processing logic of using emojis as the basic display element to concatenate and display the target text is triggered. If the emojis in the conversation message support selection operations, then in response to the selection operation of characters included in the conversation text, or in response to the selection operation of multiple emojis, the selected emojis are used as the basic display element to realize the manual selection of the emojis to be concatenated.

[0084] In some embodiments, at least one emoji includes an emoji associated with a conversation message; in the human-computer interaction interface, before using at least one emoji as a basic display element to concatenate and display the target text, a reading comprehension model is invoked based on the conversation text to perform reading comprehension processing to obtain semantically extracted text; the emoji associated with the semantically extracted text in the conversation message is used as the basic display element; wherein, the reading comprehension model is trained through historical conversation text and corresponding associated text annotations.

[0085] For example, when the emojis included in the conversation message are emojis associated with the conversation message, processing logic is triggered to concatenate and display the target text using emojis as basic display elements. Based on the conversation text, a reading comprehension model is invoked to perform reading comprehension processing, simplifying and refining the conversation text to obtain semantically refined text. The emojis associated with the semantically refined text in the conversation message are used as basic display elements, and these emojis are concatenated to form the semantically refined text, which is then displayed on the human-computer interaction interface. This embodiment of the application does not limit the model structure of the reading comprehension model; for example, the reading comprehension model can be a convolutional neural network, a deep neural network, etc.

[0086] To extract textual information more accurately, semantic extraction can be performed by combining conversational text and historical conversational text. This requires information fusion processing of the conversational text and historical conversational text, such as concatenating or weighting the conversational text and historical conversational text to obtain fused information. Then, the fused information is processed by feature extraction through cascaded convolutional layers in the reading comprehension model to extract accurate conversational features. Finally, the conversational features are processed by text mapping through cascaded fully connected layers in the reading comprehension model to obtain semantically refined text.

[0087] In some embodiments, before displaying target text by concatenating at least one emoji as a basic display element in the human-computer interaction interface, multiple candidate sources of at least one emoji are displayed in the human-computer interaction interface; wherein, the multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text; in response to a selection operation for multiple candidate sources, the emoji of the selected candidate source is used as the basic display element.

[0088] In this context, the emoticons in the conversation message can be the first M emoticons, the last M emoticons, and the middle M emoticons, where M is a natural number.

[0089] For example, users can pre-set the source of basic display elements, display a setting entry for the type in the human-computer interaction interface, and in response to the trigger operation of the setting entry, display multiple candidate sources of at least one emoji in the human-computer interaction interface. In response to the selection operation of multiple candidate sources, the emoji of the selected candidate source is used as the basic display element, thereby enabling users to manually select the type of basic display elements.

[0090] For example, when the emojis included in the conversation message are special emojis set, or when the conversation message includes set keywords, the processing logic of using emojis as basic display elements to concatenate and display the target text is triggered, and multiple candidate sources of at least one emoji are displayed on the human-computer interaction interface. In response to the selection operation of multiple candidate sources, the emoji of the selected candidate source is used as the basic display element, thereby enabling the user to manually select the type of basic display element.

[0091] In some embodiments, before displaying target text by concatenating at least one emoji as a basic display element in a human-computer interaction interface, at least one emoji is obtained from at least one candidate source as a basic display element according to the high to low priority order of multiple candidate sources; wherein, the multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text.

[0092] For example, embodiments of this application can use one emoticon as a basic display element, or multiple emoticons as basic display elements. When using one emoticon as a basic display element, emoticons from the highest-priority candidate sources can be selected as basic display elements according to the descending priority order of multiple candidate sources. When using multiple emoticons as basic display elements, one emoticon can be selected from each of the highest-priority candidate sources according to the descending priority order of multiple candidate sources, to ensure the diversity of basic display elements. For example, one emoticon can be selected from the highest-priority candidate source, and one emoticon from the second-highest-priority candidate source, and the two selected emoticons can be used as basic display elements. Alternatively, multiple emoticons can be selected from each of the highest-priority candidate sources according to the descending priority order of multiple candidate sources, saving data reading complexity. For example, two emoticons can be selected from the highest-priority candidate source, and one emoticon from the second-highest-priority candidate source, and the three selected emoticons can be used as basic display elements.

[0093] In some embodiments, in a human-computer interaction interface, displaying target text by splicing at least one emoji as a basic display element includes: splicing at least one emoji as a basic display element to form target text, and displaying the spliced ​​target text in the form of bullet comments starting from one side of the human-computer interaction interface until the spliced ​​target text moves to the other side of the human-computer interaction interface and disappears; when the conversation text includes a set keyword, displaying the movement process of multiple emoji copies of at least one emoji in the human-computer interaction interface.

[0094] like Figure 5C As shown, at least one emoji is used as a basic display element to be concatenated into the target text "hahaha". Starting from the right side of the human-computer interaction interface, the concatenated target text "hahaha" is displayed as a bullet screen until it moves to the left side of the interface and disappears. Figure 11B As shown, at least one emoji is used as a basic display element to be concatenated into the target text "hahaha". The concatenated target text "hahaha" is displayed as a bullet screen at the top of the human-computer interaction interface until the concatenated target text moves to the bottom of the human-computer interaction interface and disappears.

[0095] like Figure 11B As shown, when the conversation text includes the set keyword "haha", the emoticon "haha" is displayed in the human-computer interaction interface. The process of moving multiple copies of the emoticon “”, wherein the embodiments of this application do not limit the specific form of the movement process, such as movement in the form of rain or movement in the form of bouncing.

[0096] In some embodiments, in a human-computer interaction interface, displaying target text by concatenating at least one emoji as a basic display element includes: concatenating at least one emoji as a basic display element to form target text, statically displaying the concatenated target text in the human-computer interaction interface; and dynamically displaying the concatenated target text in the human-computer interaction interface when a static display trigger operation is received, or when the static display meets the trigger conditions.

[0097] like Figure 4D As shown, in this embodiment of the application, the concatenated target text "hahaha" 405 is statically displayed in the conversation area of ​​the human-computer interaction interface by default, and a playback control 406 is displayed in the conversation area of ​​the human-computer interaction interface. In response to a trigger operation on the playback control, the concatenated target text is dynamically displayed in the human-computer interaction interface, such as... Figure 5C As shown, the enlarged target text is dynamically displayed in the conversation area of ​​the human-computer interaction interface, thereby realizing the function of manual playback. This embodiment of the application can also dynamically display the concatenated target text in the human-computer interaction interface when the static display meets the triggering conditions, thereby realizing the function of automatic playback.

[0098] The triggering conditions include at least one of the following: the importance of the conversation message is greater than an importance threshold, and the importance index parameters include the degree of relevance to the conversation topic; the display mode of the concatenated target text is configured for dynamic display. The higher the degree of relevance of the conversation message to the conversation topic, the more important the conversation message is, and it needs to be displayed dynamically to highlight its importance.

[0099] In some embodiments, in response to a first modification operation on target text, the target text is replaced with the text corresponding to the first modification operation; in response to a second modification operation on an emoji that serves as a basic display element, the emoji corresponding to the second modification operation is used as a basic display element.

[0100] For example, in a human-computer interaction interface, after the target text is concatenated and displayed using at least one emoji as a basic display element, the target text and the basic display element can be modified. When the target text and the basic display element do not meet the user's needs, the user can manually modify the target text and the basic display element.

[0101] In some embodiments, in response to a first size adjustment operation for a basic display element, the size of the emoticons serving as the basic display element is adjusted based on a target size set by the first size adjustment operation, and the number of emoticons serving as the basic display element is adjusted synchronously so that the adjusted number can be precisely pieced together to form the displayed target text; in response to a second size adjustment operation for the target text, the size of the target text is adjusted based on a target size set by the second size adjustment operation, and the size of the emoticons serving as the basic display element is adjusted synchronously so that the adjusted emoticons can be precisely pieced together to form the adjusted target text.

[0102] For example, the basic display elements in this application embodiment support size modification, such as... Figure 5C As shown, in response to the basic display element " The first size adjustment operation, such as Figure 5D As shown, when the size of the emoji 504 of the basic display element is enlarged, the number of emojis used as the basic display element is reduced simultaneously so that the reduced number can be precisely pieced together to form the target text to be displayed.

[0103] For example, the target text in this application embodiment supports size modification. In response to a second size adjustment operation for the target text, the size of the target text is adjusted based on the target size set by the second size adjustment operation, and the size of the emoticons, which are basic display elements, is adjusted simultaneously so that the adjusted emoticons can be perfectly spliced ​​into the adjusted target text.

[0104] In step 303, the receiving side receives a session message, wherein the session message includes session text and at least one emoji.

[0105] It should be noted that the receiving side can not only structure conversation messages, but also receive target text concatenated with at least one emoji as the basic display element.

[0106] In step 304, the receiving side uses at least one emoji as a basic display element to concatenate and display the target text in the human-computer interaction interface, wherein the target text is associated with the conversation text.

[0107] It should be noted that the logic of the receiving side in using at least one emoji as a basic display element to concatenate and display the target text is similar to that of the sending side, and will not be elaborated here.

[0108] The following will describe an exemplary application of the embodiments of this application in a real-world application scenario.

[0109] In instant messaging applications, emoji interaction is relatively simple. An emoji rain appears when a message contains keywords or when keywords are entered in a text input box. Message content is displayed via message bubbles and arranged chronologically on the page, without any other enhancements.

[0110] To address the aforementioned issues, this application proposes a conversation processing method. In conversation applications, a special emoticon (a pre-defined emoji) exists. When a user sends a conversation message containing this emoticon, the conversation message, composed of the emoticon, will appear in the human-computer interaction interface. If the conversation message contains an "@friend" tag, the friend's nickname, composed of emoticons, will appear first in the human-computer interaction interface. Secondly, in the "Easter Egg Emoticon Rain" mode, when a conversation message contains a keyword, an "Easter Egg Emoticon" will fall from the sky. When a conversation message contains both keywords and "Easter Egg Emoticons," the triggered "Easter Egg Emoticon Rain" will include both the falling emoticons and the keywords composed of emoticons. By displaying emoticons combined to form message text on the chat page, the importance of the message is emphasized, making the expression of messages in the chat richer.

[0111] In terms of technical implementation, by assigning special functions to special emoticons, it is possible to trigger emoticon text bullet comments (i.e., displaying emoticons combined into message text in the form of bullet comments). As long as the corresponding special emoticon is triggered, emoticon text images can be generated from the text associated with the emoticon. The emoticon text images are displayed in the form of bullet comments. The emoticon text images are generated by converting the text into a white background black text image, and then replacing the black characters in the white background black text image with emoticon characters (i.e. special emoticons) to dynamically display the emoticon text images, which are used as emoticon resources in the Easter egg emoticon rain.

[0112] The following describes in detail the session scenarios provided in the embodiments of this application: The first scenario, such as Figure 5A As shown, there is a special type of emoticon 501 in the emoticon panel. (Example:...) Figure 5B As shown, if the user-input conversation message 502 contains such a special emoticon, after sending the conversation message, as follows: Figure 5C As shown, the first six characters of the conversation message spelled out by this special emoji, "503," will appear in the human-computer interaction interface. These six characters will be displayed horizontally on the human-computer interaction interface.

[0113] It's important to note that emoticons are represented by two fields: an emoticon identifier (indicating the emoticon type) and an emoticon code (used to identify the emoticon within a specific type). The identifier is a string (bytes) and the code is an integer (uint32). Both the client and the server use these two fields to identify an emoticon, and the client also uses these fields to download the corresponding emoticon resource. These two fields are used to uniquely identify emoticons. Some special emoticons can trigger emoticon text comments. This is mainly determined by these two fields; if an emoticon is special, the emoticon text comment is triggered. The operations platform is used to configure whether an emoticon is a special emoticon; if it is, the emoticon text comment logic is executed. The process is as follows... Figure 6 As shown: Step 11: The client sends a message.

[0114] Step 12: After receiving the message, the backend performs message preprocessing.

[0115] It should be noted that message preprocessing includes parsing the message and extracting its content. To enable special emoticons to trigger text-based emoji comments, a conditional logic needs to be added to the preprocessing logic. This conditional judgment is made on the operations platform, which stores the special emoticons used to trigger text-based emoji comments.

[0116] Step 13: The backend determines whether the message contains an emoji. If the message contains an emoji, proceed to step 14; if the message does not contain an emoji, proceed to step 19.

[0117] Step 14: The operating platform processes the expressions based on the expressions identified by the backend.

[0118] For example, facial expression processing involves parsing two fields of an expression to locate the expression.

[0119] Step 15: The operating platform searches for special emojis based on the emojis and sends the search results back to the backend.

[0120] Step 16: The backend determines whether the emoticon in the message is a special emoticon based on the search results. If the emoticon in the message is a special emoticon, proceed to step 17; if the emoticon in the message is not a special emoticon, proceed to step 19.

[0121] Step 17: Generate emoji text images in the background.

[0122] The backend determines that the emoticon in the message is a special emoticon and generates a corresponding emoticon text bullet screen. The server generates the emoticon text bullet screen based on the text preceding the emoticon in the message. When the client receives the emoticon text bullet screen, it can download the corresponding emoticon resource based on the emoticon icon and code in the emoticon text bullet screen.

[0123] Images can be directly generated from the text in the message, and emoticons can be used to represent the text. The main method is to first generate a white-background black text image corresponding to the text, and then map the grayscale values ​​in the white-background black text image to different characters. Finally, the mapped emoticon text image is generated.

[0124] First, convert the text into a white-background, black-text image. For example, convert "hahaha" into an image like this: Figure 7 The image shown is a white background with black text. This image is then mapped to different characters (emoticons) based on grayscale values. The mapping process involves a simple mapping relationship, which maps the grayscale values ​​of pixels in a white-background black-text image to a certain character. For white-background black-text images, there are only two mapping relationships: the pixels in the black text are replaced with the corresponding emoji characters, and the pixels in the white background are replaced with blank spaces.

[0125] Step 18: The backend assembles the emoji text images into emoji text bullet comments for processing on the client side.

[0126] It should be noted that after receiving the push notification of emoji text comments, the client can directly reuse the logic of the emoji rain (i.e., emoji text comments). The server has already dynamically generated emoji text images, and the client only needs to download the resources in the corresponding emoji text comments and implement the emoji rain effect (i.e., play emoji text images in the set order).

[0127] Step 19: Forward the message in the background.

[0128] The second scenario, such as Figure 8A As shown, if a user's message contains a special emoticon and mentions another user (@801) in the message, such as... Figure 8B As shown, the user nickname 802, composed of emoticons, will be displayed in the human-computer interaction interface. If the nickname is too long, only the first 6 characters will be displayed.

[0129] The text in the emoji text comment changes according to the message content, usually consisting of the first 6 characters. However, when the message includes an "@" tag, the text will change accordingly, displaying the name of the person being mentioned, also up to a maximum of 6 characters. The logic for generating emoji text is as follows: Figure 9 As shown: Step 21: The backend confirms that there is a special emoticon in the message.

[0130] Step 22: The backend checks if there is an "@" symbol in the message. If there is an "@" symbol, proceed to step 23a; if there is no "@" symbol, proceed to step 23b.

[0131] Step 23a: Extract the first 6 characters of the @person's name from the backend.

[0132] Step 23b: The first 6 characters of the message are extracted in the background.

[0133] Step 24: The background generates a white background image with black text based on the text.

[0134] Step 25: The background process replaces the pixels in the black text with emoji characters.

[0135] Step 26: Generate resources for emoji text images in the background.

[0136] In summary, before generating emoticon text images, the message content is searched to see if there are any @mentions. If so, the text is replaced with the @mention's name.

[0137] In the third scenario, sending a keyword will trigger an Easter egg, which includes a certain emoji. For example... Figure 10A As shown, when the input message contains the keyword "hahaha" (1001) and a message is sent, the following event is triggered: Figure 10B The Easter egg shown is number 1002, and the emoticon in the Easter egg is a laughing expression.

[0138] If the user's input message contains keywords and includes an emoji from the Easter egg. For example... Figure 11A As shown, when the input message contains the keyword "hahaha" 1101 and includes the emoji 1102 from the Easter egg, and the message is sent, the following event is triggered: Figure 11B The Easter egg shown is 1103. When triggered, the keyword "hahaha" formed by this emoji will appear in the Easter egg.

[0139] When sending messages, there are usually hidden easter eggs. Matching a keyword triggers a rain of corresponding emoji easter eggs. This application upgrades the emoji easter egg rain. If the message content contains a corresponding easter egg emoji, the emoji easter egg rain is no longer displayed as a simple emoji rain, but rather as an emoji text image. The corresponding text is the keyword that triggers the emoji easter egg rain, enriching the display method of the emoji easter egg rain. The process is as follows: Figure 12 As shown: Step 31: The client sends a message.

[0140] Step 32: After receiving the message, the backend performs message preprocessing.

[0141] It should be noted that message preprocessing includes parsing the message and extracting its content.

[0142] Step 33: The backend determines whether the message matches the keyword.

[0143] Step 34: When a keyword is hit, it confirms that the emoji easter egg rain has been hit.

[0144] Step 35: The backend checks whether there is an Easter egg emoji in the message. If there is an Easter egg emoji, proceed to step 36; if there is no Easter egg emoji, proceed to step 38.

[0145] Step 36: Generate emoji text images in the background.

[0146] Step 37: The backend assembles the emoji text images into emoji text bullet comments for processing on the client side.

[0147] Step 38: The background assembles the emoji rain data for processing on the client side.

[0148] In summary, before triggering the Easter egg emoji rain, it checks whether the message content contains a corresponding Easter egg emoji. If it does, it replaces it with an emoji text barrage, thus enriching the presentation of the Easter egg emoji rain.

[0149] The fourth scenario supports combining multiple emojis with text. If the emoji rain supports multiple emojis, the keyword will be extracted from these emojis, with a maximum of four emojis supported. For example... Figure 13A As shown, when the input message contains the keyword "hahaha" 1301, and includes the Easter egg emojis 1302 and 1303, and the message is sent, the following event is triggered: Figure 13B The Easter egg 1304 shown will trigger an Easter egg where the keyword "hahaha" will be formed by combining emoticons 1302 and 1303.

[0150] It's worth noting that the third scenario's Easter egg emoji rain supports emoji text comments, but it only processes one type of emoji. This allows the Easter egg emoji rain to support multiple emojis. When detecting multiple emojis in the message content, this processing can be done when generating the emoji text image. When replacing black text characters, it doesn't just use a single emoji character; multiple emojis can be randomly selected from the message for replacement, thus achieving the goal of supporting multiple emojis to express a single emoji text image. The display of the Easter egg emoji rain is not limited to emoji text comments composed of a single emoji, but rather uses multiple emojis randomly to form emoji text comments, making the Easter egg emoji rain more diverse.

[0151] In summary, this application proposes a conversation processing method. A special emoticon exists in conversation applications. When a user sends a conversation message containing this emoticon, the conversation message composed of the emoticon will appear in the human-computer interaction interface. If the conversation message contains an @friend tag, the friend's nickname composed of emoticons will appear first in the human-computer interaction interface. Secondly, in the "Easter Egg Emoticon Rain" mode, when a conversation message contains keywords, an Easter egg emoticon will fall from the sky. When a conversation message contains both keywords and Easter egg emoticons, the triggered Easter egg emoticon rain will include both the falling Easter egg emoticons and the keywords composed of Easter egg emoticons. By displaying emoticons combined to form message text on the chat page, the importance of the message is emphasized, making the expression of messages in the chat richer.

[0152] The exemplary application and implementation of the electronic device provided in the embodiments of this application have been used to describe the session processing method provided in the embodiments of this application. The following will continue to describe the scheme for the various modules (first display module 5551, second display module 5552, or receiving module 5553, third display module 5554) in the session processing device 555 provided in the embodiments of this application to cooperate in implementing session processing.

[0153] The first display module 5551 is used to display a conversation message in response to a message input operation on the human-computer interaction interface, wherein the conversation message includes conversation text and at least one emoticon; the second display module 5552 is used to send the conversation message in response to a sending operation on the conversation message, and to display target text in the human-computer interaction interface by using the at least one emoticon as a basic display element, wherein the target text is associated with the conversation text.

[0154] The receiving module 5553 is used to receive a conversation message, wherein the conversation message includes conversation text and at least one emoticon; the third display module 5554 is used to concatenate and display target text in the human-computer interaction interface using the at least one emoticon as a basic display element, wherein the target text is associated with the conversation text.

[0155] In some embodiments, the target text includes multiple consecutive characters in the conversation text, the consecutive characters being located at the beginning, middle or end of the conversation text; the second display module 5552 is further configured to, when the at least one emoticon is a set emoticon, use the at least one emoticon as a basic display element to concatenate the multiple consecutive characters, and display the concatenated multiple consecutive characters in the human-computer interaction interface.

[0156] In some embodiments, the target text includes the account in the conversation text; the second display module 5552 is further configured to, when the at least one emoji is a set emoji and the conversation text includes a pointer, use the at least one emoji as a basic display element to concatenate the account pointed to by the pointer, and display the concatenated account in the human-computer interaction interface.

[0157] In some embodiments, the target text includes keywords in the conversation text, and the keywords are preset; the second display module 5552 is further configured to, when the at least one emoticon is a preset emoticon and the conversation text includes the keywords, use the at least one emoticon as a basic display element to concatenate the keywords and display the concatenated keywords in the human-computer interaction interface.

[0158] In some embodiments, the target text is semantically extracted text obtained by reading comprehension of the conversation text; the second display module 5552 is further configured to call a reading comprehension model based on the conversation text to perform reading comprehension processing to obtain the semantically extracted text; to concatenate the at least one emoji as a basic display element to form the semantically extracted text, and to display the concatenated semantically extracted text in the human-computer interaction interface; wherein, the reading comprehension model is trained by annotating historical conversation text and corresponding semantically extracted text.

[0159] In some embodiments, the second display module 5552 is further configured to invoke a reading comprehension model based on the conversation text and the historical conversation text to perform the following processing: perform information fusion processing on the conversation text and the historical conversation text to obtain fused information; perform feature extraction processing on the fused information to obtain conversation features; and perform text mapping processing on the conversation features to obtain the semantically refined text.

[0160] In some embodiments, before displaying the target text in the human-computer interaction interface using at least one emoji as a basic display element, the second display module 5552 is further configured to display multiple candidate types of the target text in the human-computer interaction interface; wherein, the multiple candidate types include: multiple consecutive characters in the conversation text, account, keywords, and semantically extracted text obtained by reading and understanding the conversation text; in response to a selection operation for the multiple candidate types, the text of the selected candidate type is used as the target text to be concatenated and displayed.

[0161] In some embodiments, before displaying the target text by concatenating the at least one emoji as a basic display element in the human-computer interaction interface, the second display module 5552 is further configured to, in response to a selection operation for characters included in the conversation text, use the selected character in the conversation text as the target text; when the conversation message includes multiple emojis, in response to a selection operation for multiple emojis, use the selected emoji as the basic display element.

[0162] In some embodiments, the at least one emoji includes an emoji associated with the conversation message; in the human-computer interaction interface, before using the at least one emoji as a basic display element to concatenate and display the target text, the second display module 5552 is further configured to call a reading comprehension model based on the conversation text to perform reading comprehension processing to obtain semantically refined text; and to use the emoji in the conversation message associated with the semantically refined text as the basic display element; wherein, the reading comprehension model is trained by historical conversation text and corresponding semantically refined text annotations.

[0163] In some embodiments, before displaying the target text in the human-computer interaction interface using the at least one emoji as a basic display element, the second display module 5552 is further configured to display multiple candidate sources of the at least one emoji in the human-computer interaction interface; wherein, the multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text; in response to a selection operation for the multiple candidate sources, the emoji of the selected candidate source is used as the basic display element.

[0164] In some embodiments, before displaying the target text in the human-computer interaction interface using the at least one emoji as a basic display element, the second display module 5552 is further configured to obtain at least one emoji as the basic display element from at least one of the candidate sources according to the high-to-low priority order of multiple candidate sources; wherein, the multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text.

[0165] In some embodiments, the second display module 5552 is further configured to use the at least one emoji as a basic display element to splice together the target text, and start displaying the spliced ​​target text in the form of bullet comments on one side of the human-computer interaction interface until the spliced ​​target text moves to the other side of the human-computer interaction interface and disappears; when the conversation text includes a set keyword, the movement process of multiple emoji copies of the at least one emoji is displayed in the human-computer interaction interface.

[0166] In some embodiments, the second display module 5552 is further configured to use the at least one emoji as a basic display element to splice the target text, and statically display the spliced ​​target text in the human-computer interaction interface; when a trigger operation for the static display is received, or when the static display meets the trigger condition, the spliced ​​target text is dynamically displayed in the human-computer interaction interface.

[0167] In some embodiments, the triggering condition includes at least one of the following: the importance of the session message is greater than an importance threshold, and the importance index parameter includes the degree of relevance to the session topic; the display mode of the concatenated target text is configured as the dynamic display.

[0168] In some embodiments, the second display module 5552 is further configured to, in response to a first modification operation on the target text, replace the target text with the text corresponding to the first modification operation; and in response to a second modification operation on an emoticon that serves as the basic display element, use the emoticon corresponding to the second modification operation as the basic display element.

[0169] In some embodiments, the second display module 5552 is further configured to, in response to a first size adjustment operation for the basic display element, adjust the size of the emoticons serving as the basic display element based on a target size set by the first size adjustment operation, and simultaneously adjust the number of emoticons serving as the basic display element so that the adjusted number can be precisely pieced together to form the displayed target text; and in response to a second size adjustment operation for the target text, adjust the size of the target text based on a target size set by the second size adjustment operation, and simultaneously adjust the size of the emoticons serving as the basic display element so that the adjusted emoticons can be precisely pieced together to form the adjusted target text.

[0170] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of an electronic device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the electronic device to perform the session processing method described in this application.

[0171] This application provides a computer-readable storage medium storing executable instructions. When these executable instructions are executed by a processor, they cause the processor to execute the session processing method provided in this application, for example... Figures 3A-3C The session handling method is shown.

[0172] In some embodiments, the computer-readable storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or it may be a variety of devices including one or any combination of the above-mentioned memories.

[0173] In some embodiments, executable instructions may take the form of a program, software, software module, script, or code, written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

[0174] As an example, executable instructions may, but do not necessarily, correspond to files in a file system. They may be stored as part of a file that holds other programs or data, for example, in one or more scripts in a Hyper Text Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple collaborating files (e.g., a file that stores one or more modules, subroutines, or code sections).

[0175] As an example, executable instructions can be deployed to execute on a single computing device, or on multiple computing devices located in one location, or on multiple computing devices distributed across multiple locations and interconnected via a communication network.

[0176] It is understood that in the embodiments of this application, data such as user information are involved. When the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0177] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, and improvements made within the spirit and scope of this application are included within the scope of protection of this application.

Claims

1. A session processing method, characterized in that, The method includes: In response to a message input operation on the human-computer interaction interface, a conversation message is displayed, wherein the conversation message includes conversation text and at least one emoji; In response to the sending operation of the conversation message, the conversation message is sent, and the target text is displayed in the human-computer interaction interface by concatenating the at least one emoji as a basic display element, wherein the target text is associated with the conversation text.

2. The method according to claim 1, characterized in that, The target text includes multiple consecutive characters in the conversation text, and the consecutive characters are located at the beginning, middle or end of the conversation text; The step of using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface includes: When the at least one emoji is a set emoji, the at least one emoji is used as a basic display element to be concatenated into the plurality of consecutive characters, and the concatenated plurality of consecutive characters are displayed in the human-computer interaction interface.

3. The method according to claim 1, characterized in that, The target text includes the account in the conversation text; The step of using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface includes: When the at least one emoji is a set emoji and the conversation text includes a pointer, the at least one emoji is used as a basic display element to be concatenated to form the account pointed to by the pointer, and the concatenated account is displayed in the human-computer interaction interface.

4. The method according to claim 1, characterized in that, The target text includes keywords from the conversation text, and these keywords are pre-defined. The step of using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface includes: When the at least one emoji is a set emoji and the conversation text includes the keyword, the at least one emoji is used as a basic display element to be concatenated into the keyword, and the concatenated keyword is displayed in the human-computer interaction interface.

5. The method according to claim 1, characterized in that, The target text is the semantically extracted text obtained by reading and understanding the conversation text; The step of using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface includes: Based on the conversational text, a reading comprehension model is invoked to perform reading comprehension processing, resulting in the semantically extracted text; The at least one emoji is used as a basic display element to be concatenated into the semantically extracted text, and the concatenated semantically extracted text is displayed in the human-computer interaction interface. The reading comprehension model is trained using historical conversation text and corresponding semantically extracted text annotations.

6. The method according to claim 5, characterized in that, The process of calling a reading comprehension model based on the conversational text to obtain the semantically extracted text includes: Based on the aforementioned conversation text and historical conversation text, the reading comprehension model is invoked to perform the following processing: The conversation text and the historical conversation text are subjected to information fusion processing to obtain fused information; The fused information is subjected to feature extraction processing to obtain session features; The conversation features are processed by text mapping to obtain the semantically refined text.

7. The method according to claim 1, characterized in that, Before using at least one emoji as a basic display element to concatenate and display the target text in the human-computer interaction interface, the method further includes: The human-computer interaction interface displays multiple candidate types of the target text; wherein, the multiple candidate types include: multiple consecutive characters in the conversation text, account, keywords, and semantically extracted text obtained by reading and understanding the conversation text; In response to a selection operation for the plurality of candidate types, the text of the selected candidate type is used as the target text to be concatenated and displayed.

8. The method according to claim 1, characterized in that, Before using at least one emoji as a basic display element to concatenate and display the target text in the human-computer interaction interface, the method further includes: In response to a selection operation for characters included in the session text, the selected characters in the session text are used as the target text; When the conversation message includes multiple emojis, in response to a selection operation for the multiple emojis, the selected emoji is used as the basic display element.

9. The method according to claim 1, characterized in that, The at least one emoji includes an emoji associated with the conversation message; In the human-computer interaction interface, before using at least one emoji as a basic display element to concatenate and display the target text, the method further includes: Based on the aforementioned conversational text, a reading comprehension model is invoked to perform reading comprehension processing, resulting in semantically extracted text. The emojis associated with the semantically extracted text in the conversation message are used as the basic display elements; The reading comprehension model is trained using historical conversation text and corresponding semantically extracted text annotations.

10. The method according to claim 1, characterized in that, Before using at least one emoji as a basic display element to concatenate and display the target text in the human-computer interaction interface, the method further includes: The human-computer interaction interface displays multiple candidate sources for the at least one emoji; wherein, the multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text; In response to the selection operation for the plurality of candidate sources, the emoji of the selected candidate source is used as the basic display element.

11. The method according to claim 1, characterized in that, Before using at least one emoji as a basic display element to concatenate and display the target text in the human-computer interaction interface, the method further includes: According to the priority order of multiple candidate sources from high to low, at least one emoji is obtained from at least one of the candidate sources as the basic display element; The multiple candidate sources include: emojis at a set position in the conversation message, emojis associated with the conversation message, and emojis adjacent to keywords contained in the conversation text.

12. The method according to claim 1, characterized in that, The step of using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface includes: The at least one emoji is used as a basic display element to be concatenated into the target text, and the concatenated target text is displayed in the form of bullet comments starting from one side of the human-computer interaction interface until the concatenated target text moves to the other side of the human-computer interaction interface and disappears. When the conversation text includes a set keyword, the human-computer interaction interface displays the movement process of multiple emoji copies of the at least one emoji.

13. The method according to claim 1, characterized in that, The step of using at least one emoji as a basic display element to concatenate and display target text in the human-computer interaction interface includes: The at least one emoji is used as a basic display element to be concatenated into the target text, and the concatenated target text is statically displayed in the human-computer interaction interface; When the static display trigger operation is received, or when the static display meets the trigger condition for switching to dynamic display, the spliced ​​target text is dynamically displayed in the human-computer interaction interface.

14. The method according to claim 13, characterized in that, The triggering condition includes at least one of the following: The importance of the conversation message is greater than the importance threshold, and the importance index parameters include the degree of relevance to the conversation topic; The display mode of the concatenated target text is configured as dynamic display.

15. The method according to claim 1, characterized in that, The method further includes: In response to a first modification operation on the target text, the target text is replaced with the text corresponding to the first modification operation; In response to a second modification operation on an emoji that serves as the basic display element, the emoji corresponding to the second modification operation is used as the basic display element.

16. The method according to claim 1, characterized in that, The method further includes: In response to a first size adjustment operation for the basic display element, the size of the emoticons used as the basic display element is adjusted based on the target size set by the first size adjustment operation, and the number of emoticons used as the basic display element is adjusted simultaneously so that the adjusted number can be exactly spliced ​​into the displayed target text; In response to a second size adjustment operation on the target text, the size of the target text is adjusted based on the target size set by the second size adjustment operation, and the size of the emoticons, which are the basic display elements, is adjusted simultaneously so that the adjusted emoticons can be perfectly joined to form the adjusted target text.

17. A session processing method, characterized in that, The method includes: Receive a session message, wherein the session message includes session text and at least one emoji; In the human-computer interaction interface, at least one emoji is used as a basic display element to concatenate and display target text, wherein the target text is associated with the conversation text.

18. A session processing apparatus, characterized in that, The device includes: The first display module is used to display a conversation message in response to a message input operation on the human-computer interaction interface, wherein the conversation message includes conversation text and at least one emoticon; The second display module is used to send the conversation message in response to the sending operation of the conversation message, and to display the target text in the human-computer interaction interface by using at least one emoji as a basic display element, wherein the target text is associated with the conversation text.

19. A session processing apparatus, characterized in that, The device includes: A receiving module is used to receive conversation messages, wherein the conversation messages include conversation text and at least one emoji; The third display module is used to concatenate and display target text in the human-computer interaction interface using at least one emoji as a basic display element, wherein the target text is associated with the conversation text.

20. An electronic device, characterized in that, The electronic device includes: Memory, used to store executable instructions; A processor, when executing executable instructions stored in the memory, implements the session processing method according to any one of claims 1 to 17.

21. A computer-readable storage medium, characterized in that, It stores executable instructions for implementing the session processing method according to any one of claims 1 to 17 when executed by a processor.

22. A computer program product, comprising a computer program or instructions, characterized in that, When the computer program or instructions are executed by a processor, they implement the session processing method according to any one of claims 1 to 17.

Images