Information display method and device, terminal and storage medium
By displaying information follow-up entry points and providing candidate information in the information interaction interface, the problem of monotonous information interface is solved, and the richness, variety and fun of information interaction are enhanced.
Patent Information
- Application Number
- CN202110262690.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-10
- Publication Date
- 2025-11-18
- Estimated Expiration
- 2041-03-10
AI Technical Summary
The repetitive +1 operation in existing information interaction interfaces makes the interfaces monotonous and boring, reducing user engagement and interest.
The information follow-up entry is displayed in the information interaction interface, and the output information selection window provides related candidate information. After the user selects, follow-up interactive information is generated.
Enhance the richness, variety, and fun of information interaction to increase user engagement.
Smart Images

Figure CN115079875B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of Internet, in particular to the technical field of communication, and especially to an information display method, an information display device, a terminal and a computer storage medium. BACKGROUND
[0002] With the development of Internet technology, after a terminal establishes communication between multiple users, the terminal provides an information interaction interface for each user, so that each user can interact information through the information interaction interface. In the process of information interaction of multiple users, any user can perform a +1 operation on the last repeated interaction information in the information interaction interface; the so-called "+1" is a characteristic network language of Internet netizens, and the +1 operation can express the attitude of "agreeing with a certain point of view" or "wanting to express the same content" with a low operation threshold and a very high efficiency.
[0003] At present, when detecting that a user performs a +1 operation on the last repeated interaction information (assuming that the interaction information is A), the terminal usually directly displays a following interaction information with the same information content as the interaction information A in the information interaction interface; such a processing manner can cause a large amount of repeated information in the information interaction interface after responding to a large number of +1 operations, greatly weaken the rich variety of information interaction, and further reduce the interest and surprise of user information interaction. In the long run, the information interaction experience tends to be monotonous and boring, which is not conducive to the creation of an interesting social atmosphere and causes low user stickiness. SUMMARY
[0004] The embodiments of the present application provide an information display method, device, terminal and storage medium, which can better display information, improve the rich variety of information interaction, and further improve user stickiness while ensuring information interaction efficiency.
[0005] In one aspect, the embodiments of the present application provide an information display method, which comprises:
[0006] displaying N pieces of interaction information in an information interaction interface, N being a positive integer greater than 1;
[0007] if there are multiple pieces of repeated interaction information in the N pieces of interaction information, displaying an information following entry of a target interaction information in the multiple pieces of interaction information in the information interaction interface;
[0008] in response to a trigger operation on the information following entry, outputting an information selection window; the information selection window includes one or more candidate information associated with the target interaction information;
[0009] When any candidate information in the information selection window is selected, follow-up interaction information is displayed in the information interaction interface, the follow-up interaction information being generated according to the selected candidate information.
[0010] In another aspect, an embodiment of the present application provides an information display device, the device comprising:
[0011] a display unit configured to display N pieces of interaction information in an information interaction interface, N being a positive integer greater than 1;
[0012] The display unit is further configured to display, if there are multiple pieces of interaction information that are continuously repeated in the N pieces of interaction information, an information follow-up entry of target interaction information in the multiple pieces of interaction information in the information interaction interface.
[0013] a processing unit configured to output an information selection window in response to a triggering operation on the information follow-up entry, the information selection window comprising one or more pieces of candidate information associated with the target interaction information.
[0014] The display unit is further configured to display, when any candidate information in the information selection window is selected, follow-up interaction information in the information interaction interface, the follow-up interaction information being generated according to the selected candidate information.
[0015] In yet another aspect, an embodiment of the present application provides a terminal, the terminal comprising an input interface and an output interface, the terminal further comprising:
[0016] a processor adapted to implement one or more instructions; and
[0017] a computer storage medium storing one or more instructions, the one or more instructions being adapted to be loaded and executed by the processor to perform the following steps:
[0018] display N pieces of interaction information in an information interaction interface, N being a positive integer greater than 1;
[0019] if there are multiple pieces of interaction information that are continuously repeated in the N pieces of interaction information, display an information follow-up entry of target interaction information in the multiple pieces of interaction information in the information interaction interface.
[0020] output an information selection window in response to a triggering operation on the information follow-up entry, the information selection window comprising one or more pieces of candidate information associated with the target interaction information.
[0021] when any candidate information in the information selection window is selected, display follow-up interaction information in the information interaction interface, the follow-up interaction information being generated according to the selected candidate information.
[0022] In still another aspect, the embodiments of the present application provide a computer storage medium, which stores one or more instructions, and the one or more instructions are adapted to be loaded by a processor and perform the following steps:
[0023] displaying N pieces of interactive information in the information interaction interface, N being a positive integer greater than 1;
[0024] if there are multiple pieces of interactive information that are continuously repeated in the N pieces of interactive information, displaying an information following entry of target interactive information in the information interaction interface;
[0025] in response to a triggering operation on the information following entry, outputting an information selection window, the information selection window including one or more candidate information associated with the target interactive information;
[0026] when any candidate information in the information selection window is selected, displaying following interactive information in the information interaction interface, the following interactive information being generated according to the selected candidate information.
[0027] In the embodiments of the present application, if there are multiple pieces of interactive information that are continuously repeated in the information interaction interface, an information following entry of target interactive information can be displayed. If a triggering operation of the information following entry is detected, one or more candidate information can be provided to the user through the information selection window, so that the user can send interactive information by selecting any candidate information, and the efficiency and convenience of information interaction can be effectively improved. When any candidate information in the information selection window is selected, following interactive information generated according to the selected candidate information can be displayed in the information interaction interface. Since each candidate information in the information selection window is associated with the target interactive information, the following interactive information generated according to the selected candidate information is related to the target interactive information. By displaying the following interactive information, the user's following attitude towards the target interactive information can be expressed to some extent, the display content of the information interaction interface can be enriched, the richness of information interaction can be improved, the interest and surprise of the user in information interaction can be improved, and the user's stickiness can be improved. BRIEF DESCRIPTION OF DRAWINGS
[0028] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.
[0029] Figure 1 a is a system architecture diagram of an information interaction system provided by the embodiments of the present application;
[0030] Figure 1 b is a system architecture diagram of another information interaction system provided by an embodiment of the present application;
[0031] Figure 2 is a flowchart of an information display method provided by an embodiment of the present application;
[0032] Figure 3a is a schematic diagram of an information display window provided by an embodiment of the present application;
[0033] Figure 3b is a schematic diagram of an output information display window provided by an embodiment of the present application;
[0034] Figure 3c is a schematic diagram of display of following interactive information provided by an embodiment of the present application;
[0035] Figure 3d is a schematic diagram of display of information identification of target interactive information provided by an embodiment of the present application;
[0036] Figure 3e is a schematic diagram of display of following interactive information provided by an embodiment of the present application;
[0037] Figure 4 is a flowchart of an information display method provided by another embodiment of the present application;
[0038] Figure 5a is a schematic diagram of a display style of an information following entry provided by an embodiment of the present application;
[0039] Figure 5b is a schematic diagram of an output information selection window provided by an embodiment of the present application;
[0040] Figure 5c is a schematic diagram of another output information selection window provided by an embodiment of the present application;
[0041] Figure 5d is a schematic diagram of display of following interactive information provided by an embodiment of the present application;
[0042] Figure 5e is a schematic diagram of a display information refreshing component provided by an embodiment of the present application;
[0043] Figure 5f is a schematic diagram of an updated display information selection window provided by an embodiment of the present application;
[0044] Figure 5g is a schematic diagram of an updated selected candidate information provided by an embodiment of the present application;
[0045] Figure 5h is another schematic diagram of updating selected candidate information provided by an embodiment of the present application;
[0046] Figure 5i is another schematic diagram of updating selected candidate information provided by an embodiment of the present application;
[0047] Figure 5j is a schematic diagram of performing different display logic according to different selection operations for candidate information provided by an embodiment of the present application;
[0048] Figure 5k is another schematic diagram of displaying follow-up interaction information provided by an embodiment of the present application;
[0049] Figure 5l is a schematic diagram of outputting a new information selection window provided by an embodiment of the present application;
[0050] Figure 6 is an application scenario diagram of an information display method provided by an embodiment of the present application;
[0051] Figure 7a is a timing diagram related to an information display framework provided by an embodiment of the present application;
[0052] Figure 7b is a flowchart related to an information display framework provided by an embodiment of the present application;
[0053] Figure 7c is a training result line chart of a model provided by an embodiment of the present application;
[0054] Figure 8 is a structural schematic diagram of an information display device provided by an embodiment of the present application;
[0055] Figure 9 is a structural schematic diagram of a terminal provided by an embodiment of the present application. DETAILED DESCRIPTION
[0056] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application.
[0057] In the embodiments of the present application, an information interaction system is involved; refer to Figure 1 aAs shown, the information interaction system can include at least two terminals 11 and a server 12. The terminal 11 can be any device with communication function and display screen, such as a smart phone, a laptop computer, a tablet computer, a desktop computer, a smart television, and the like. The terminal 11 can install and run various information interaction clients. The information interaction client is a client that can support a user to send / view interactive information. The interactive information is information used for interactive communication, such as a conversation message in a communication session scenario, a comment information in a live broadcast scenario, a comment information in a video playing scenario, a scroll information (an information that is displayed floatingly during video watching), and the like. Accordingly, the information interaction client can include, but is not limited to, a social client that supports sending / viewing conversation messages, a live broadcast client that supports sending / viewing comment information, a video playing client that supports sending / viewing scroll information and comment information, and the like. The social client can specifically include an instant messaging client (such as WeChat, QQ, and the like), an information exchange client (such as Weibo, a blog, and the like), and the like, without limitation. The instant messaging is a terminal service that allows two or more people to use a network to instantly transmit text, voice, and the like, and to exchange audio and video.
[0058] The server 12 refers to a device that can establish communication between at least two terminals 11 and provide various services such as data storage and information push for each terminal 11. Specifically, the server 12 can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, a cloud server providing basic cloud computing services such as cloud service, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, domain name service, security service, CDN (Content Delivery Network), and big data and artificial intelligence platform, etc. The embodiments of the present application do not limit this. Specifically, the server 12 establishes communication between at least two terminals by communicating with each of the at least two terminals 11 to perform information forwarding operations between the at least two terminals 11. It should be understood that the server 12 and any terminal 11 can communicate through any communication mode. For example, 4G (the 4th generation mobile communication technology), 5G (5th generation mobile networks), Beyond 5G technology, mobile communication of Worldwide Interoperability for Microwave Access (WiMAX), or computer network communication based on TCP / IP Protocol Suite (TCP / IP) and User Datagram Protocol (UDP), etc.
[0059] It should be understood that Figure 1 a The system architecture of the information interaction system is only exemplary and is not limited thereto. For example, in other embodiments, if any two terminals 11 can establish communication and interact information through other ways, such as establishing communication through close-range communication, establishing communication through a base station directly, etc., the information interaction system proposed in the embodiments of the present application can not include the server 12. For another example, the server 12 can be deployed as a node in a block chain network (as shown in FIG. 1C), or the server 12 can be connected to the block chain network, so that the server 12 can upload internal data to the block chain network for storage to prevent internal data from being tampered with, thereby ensuring the data security of the server 12. Figure 1 b
[0060] Based on the information interaction system, the embodiment of the present application proposes an information display scheme to enrich the variability of information interaction and improve user stickiness. In a specific implementation, the information display scheme can be executed by a target terminal (any terminal) in the information interaction system or any information interaction client running in the target terminal; for ease of description, the embodiment of the present application takes the target terminal as an example to illustrate the information display scheme. Specifically, the general principle of the information display scheme is as follows:
[0061] In the process of information interaction between user A and other users using the target terminal, the target terminal can obtain one or more pieces of interaction information from the server; and display the obtained pieces of interaction information in the information interaction interface for user A to view. When there are multiple pieces of continuous and repetitive interaction information in the information interaction interface, an information following entry of a piece of interaction information (assuming interaction information a) in the multiple pieces of interaction information can be displayed, so that if user A wants to express the attitude of "agreeing with the views reflected by the multiple pieces of interaction information" or "expressing the same information content as the multiple pieces of interaction information", user A can perform a trigger operation on the information following entry. Correspondingly, after detecting the trigger operation of user A on the information following entry, the target terminal can provide one or more pieces of candidate information for user A according to the interaction information a, and any candidate information satisfies at least one of the following conditions: the view reflected by the candidate information matches the view reflected by the interaction information a, and the information content in the candidate information matches the information content of the interaction information a. At this time, user A can select a piece of candidate information according to his own needs; when any candidate information is selected, the terminal can generate a new piece of interaction information according to the selected candidate information and display the new piece of interaction information in the information interaction interface.
[0062] As can be seen, the information display scheme proposed by the embodiment of the present application can have the following beneficial effects: by providing one or more pieces of candidate information for the user, the user can select any candidate information to send the interaction information, which can effectively improve the efficiency and convenience of information interaction. Moreover, by displaying the new interaction information according to the candidate information related to the followed interaction information a, the display content of the information interaction interface can be enriched while ensuring the information following effect, and the variability of information interaction can be improved; in this way, the interest and surprise of user information interaction can be improved, a good interactive communication atmosphere can be provided for the user, and thus the user stickiness can be effectively improved.
[0063] Based on the above description, the embodiment of the present application proposes an information display method, which can be executed by the target terminal mentioned above or any information interaction client running in the target terminal; for ease of description, the embodiment of the present application takes the target terminal as an example to illustrate the information display method.
[0064] See Figure 2The information display method can include the following steps S201-S204:
[0065] S201, display N pieces of interactive information in an information interaction interface, N being a positive integer greater than 1.
[0066] The information interaction interface can include any one of the following: a session interface of a target session, a live broadcast interface about a target anchor user, a video playback interface of a target video, etc. The target session can be a one-on-one session composed of two users, or a group session composed of at least three users, without limitation. In addition, the users in the target session can be divided into a host user and a guest user. The host user refers to a target user who logs in a social account of a target client, and the guest user refers to other users in the target session except the host user.
[0067] When the information interaction interface is the session interface of the target session, the N pieces of interactive information can include N pieces of session messages, and any one of the N pieces of session messages can be sent by the host user in the target session or by the guest user in the target session, without limitation. When the information interaction interface is the live broadcast interface about the target anchor user, the N pieces of interactive information can include N pieces of comment information, and any one of the N pieces of comment information can be sent by the target anchor user or by any audience user watching the target anchor user, without limitation. When the information interaction interface is the video playback interface of the target video, the N pieces of interactive information can include N pieces of comment information or N pieces of scroll information, and any one of the N pieces of comment information (or any one of the N pieces of scroll information) can be sent by the target user watching the target video using the target terminal or by other users watching the target video using other terminals, without limitation.
[0068] It should be noted that the interactive information mentioned in the embodiments of the present application can be any type of information, such as image information and text information. The image information refers to information containing images, and the text information refers to information composed of one or more characters, which can include but is not limited to numbers, letters, emoticons, punctuation marks, etc. For ease of description, the N pieces of interactive information displayed in the information interaction interface are taken as text information in the following description.
[0069] S202, if there are multiple pieces of interactive information that are continuously repeated in the N pieces of interactive information, display an information following entry of target interactive information in the information interaction interface.
[0070] S203, in response to a following operation on the information following entry, output an information selection window.
[0071] In steps S202-S203, if there are multiple pieces of interaction information that are continuously repeated in the N pieces of interaction information, the target terminal can support providing an information following entry for the target user in the information interaction interface to support the target user to implement information following by performing a trigger operation (such as a click operation, a press operation, etc.) on the information following entry. The target interaction information can be any piece of interaction information in the multiple pieces of interaction information that are continuously repeated, such as the last piece of interaction information in the multiple pieces of interaction information, the first piece of interaction information in the multiple pieces of interaction information, the second piece of interaction information in the multiple pieces of interaction information, etc. For ease of description, the target interaction information is taken as the last piece of interaction information in the multiple pieces of interaction information in the following description.
[0072] After the target terminal detects the trigger operation of the target user on the information following entry, the target terminal can output an information selection window in response to the trigger operation. The information selection window includes one or more pieces of candidate information associated with the target interaction information. The “candidate information is associated with the target interaction information” includes at least one of the following meanings: the viewpoint reflected by the candidate information matches the viewpoint reflected by the target interaction information (i.e., the information semantics match), and the information content in the candidate information matches the information content of the target interaction information (i.e., the information content is the same or the information content is similar). Specifically, the information selection window can include at least one or more reference candidate information. The reference candidate information refers to the candidate information whose information semantics match the information semantics of the target interaction information. Optionally, the information selection window can also include reference candidate information. The reference candidate information refers to the candidate information whose information content is the same as the information content of the target interaction information.
[0073] It should be noted that the information type of each piece of reference candidate information in the information selection window can be the same as the information type of the target interaction information, or can be different from the information type of the target interaction information. Even part of the reference candidate information in the information selection window can have the same information type as the target interaction information, and part of the reference candidate information can have a different information type from the target interaction information, which is not limited in the present application. For example, if the information type of the target interaction information is a text information type, the information selection window can include at least one of the following: one or more pieces of reference candidate information in an image information type, and one or more pieces of reference candidate information in a text information type, etc. The reference candidate information in each information type is explained as follows:
[0074] 1) Any reference candidate information under the image information type includes: a descriptive image reflecting the semantic information of the first text information, an image obtained by fusing the descriptive image with the first text information, or an image obtained by fusing the descriptive image with approximate text information of the first text information. The descriptive image here can be a local image found in the target terminal's local space, a network heatmap found in internet data, or an emoji image found in the target user's favorite emoji collection; there are no restrictions on this. For example, assuming the first text information is "×× is really awesome", the reference candidate information under the image information type may include: Figure 3a The information selection window shown contains reference candidate information 11, reference candidate information 12, and reference candidate information 13. Reference candidate information 11 is generated by fusing the first text information with a local image found in the local space that reflects the semantic meaning of the first text information. Reference candidate information 12 is generated by fusing the approximate text information "××666" with a network heatmap found in internet data that reflects the semantic meaning of the first text information. Reference candidate information 13 is generated by fusing the approximate text information "very good" with an emoji image found in an emoji collection that reflects the semantic meaning of the first text information. It should be understood that... Figure 3a This is merely an example presentation of three reference candidate information items under the image information type, and is not an exhaustive list.
[0075] 2) Any reference candidate information under the text information type includes: the second text information obtained by replacing the first string in the first text information with the second string. The first string includes one or more characters from the first text information; the second string refers to a string whose semantic similarity to the first string is greater than a threshold. It should be noted that: ① The second string can be a string obtained from the target terminal's local space, a trending internet term obtained from internet data, or a string randomly generated based on the semantic information of the first string; there are no restrictions on this. ② The character types of the first string and the second string can be the same or different; there are no restrictions on this. For example, the first string is a text type, and the second string can be a text type, an emoticon type, an emoticon type, etc. ③ The number of characters in the first string and the second string can be equal or unequal; there are no restrictions on this. For example, assuming the first text information is "×× is really awesome", the reference candidate information under the text information type can include: Figure 3aThe reference candidate information 14 and the reference candidate information 15 in the information selection window are shown. The reference candidate information 14 is obtained by replacing the first string "really awesome" in the first text information with the second string "race high [ox] [beer] ~~". Here, [ox] refers to the expression symbol "ox", and [beer] represents the beer expression symbol "beer". The reference candidate information 15 is obtained by replacing the first string "really awesome" in the first text information with the network hot word "666 ~~", which matches the information semantics of the first string in the Internet data.
[0076] In a specific implementation process, one specific implementation of the target terminal outputting the information selection window can be: directly outputting the information selection window in the information interaction interface. In this implementation, the conversation interface is the information interaction interface as the target conversation, and the information selection window is output in the information interaction interface. Figure 3a Taking the information selection window shown as an example, if the trigger operation of the information following entry 33 on the target interactive information 32 is detected in the information interaction interface 31, the schematic diagram of the information selection window 34 output in the information interaction interface 31 can be as shown. Figure 3b Alternatively, another specific implementation of outputting the information selection window can be: switching from the information interaction interface 31 to a new interface, and outputting the information selection window 34 in the new interface. It should be understood that the embodiments of the present application only exemplarily list several output modes of the information selection window, and are not exhaustive; and for the convenience of description, the information selection window 34 is directly output in the information interaction interface 31 in the subsequent description.
[0077] S204, when any candidate information in the information selection window is selected, the following interactive information is displayed in the information interaction interface, and the following interactive information is generated according to the selected candidate information (i.e. the selected candidate information in the information selection window).
[0078] After the output of the information selection window, the target user can select a candidate information in the information selection window according to the user's own needs; correspondingly, when the target terminal detects that any candidate information in the information selection window is selected, the following interactive information generated according to the selected candidate information can be displayed in the information interaction interface. The display form of the following interactive information in the information interaction interface is the same as the display form of the target interactive information in the information interaction interface. For example, if the target interactive information is displayed in the form of a conversation message in the information interaction interface, that is, the target interactive information is a conversation message, the following interactive information is also displayed in the form of a conversation message in the information interaction interface, and the target interactive information and the following interactive information are displayed in different message bubbles, that is, the target interactive information is a new conversation message. For another example, if the target interactive information is displayed in the form of a barrage in the information interaction interface, that is, the target interactive information is barrage information, the following interactive information is also displayed in the form of a barrage in the information interaction interface, that is, the following interactive information is a new barrage information.
[0079] In a specific implementation, when any candidate information in the information selection window is selected, the target terminal can directly take the selected candidate information as the following interactive information 35, and display the following interactive information 35 in the information interaction interface 31, as shown in FIG. 3B. Figure 3c In another specific implementation, considering that after the target user selects any candidate information, the target user may need to edit and create the selected candidate information again, so that the edited and updated selected candidate information is more suitable for the scene or more suitable for the target user's own expression habits. Based on this, when any candidate information in the information selection window is selected, the target terminal can first output an information editing panel about the selected candidate information, so that the target user can edit and update the selected candidate information through the information editing panel; in this case, the target terminal can display the following interactive information in the information interaction interface according to the updated selected candidate information.
[0080] Optionally, after displaying the following interactive information, the target terminal can also display an information identifier of the target interactive information at the second display position where the following interactive information is located; wherein the information identifier includes at least one of the following: a user identifier of an information sender of the target interactive information, and an information digest of the target interactive information. Taking the information identifier including the user identifier of the information sender of the target interactive information as an example, a schematic diagram of displaying the information identifier 36 can be referred to FIG. 3C. Figure 3d By associating the display of the following interactive information and the information identifier of the target interactive information, it can be intuitively prompted that the following interactive information is obtained following the target interactive information.
[0081] Optionally, if the selected candidate information is the reference candidate information, since the reference candidate information is not the same as the target interactive information, when the follow-up interactive information is displayed according to the selected candidate information, some users may not be able to clearly know that the follow-up interactive information is obtained by following the first interaction. Therefore, a prompt information of the follow-up interactive information can be displayed to prompt that the follow-up interactive information is obtained by following the target interactive information. Further, in order to avoid affecting the user to view other contents in the information interaction interface due to the display of the prompt information, a time threshold can be set for the prompt information, so that when the display time of the prompt information is greater than the time threshold, the display of the prompt information can be automatically cancelled.
[0082] Optionally, after any candidate information in the information selection window is selected, the target terminal can also play a follow-up animation about the target interactive information in the information interaction interface; and after the follow-up animation is played, the step of displaying the follow-up interactive information in the information interaction interface is executed. Wherein, the follow-up animation can be set according to business requirements; for example, the follow-up animation can be a fireworks animation, a character running animation, etc. For another example, the follow-up animation can be an animation of moving a follow-up identifier of the target interactive information from a first display position of the target interactive information to a second display position, which is a position for displaying the follow-up interactive information. Then, the specific implementation of playing the follow-up animation about the target interactive information in the information interaction interface can be: displaying the follow-up identifier of the target interactive information at the first display position of the target interactive information in the information interaction interface; and controlling the follow-up identifier of the target interactive information to move from the first display position to the second display position. Wherein, when the follow-up identifier is moved to the second display position, it indicates that the follow-up animation is played. The follow-up identifier here can include at least one of the following: a preset follow-up anchor point (such as a smiley face, a small flower, a runner icon, etc.), an information abstract of the target interactive information, a user identifier of an information sender of the target interactive information, etc. Taking the follow-up identifier 37 as a follow-up anchor point "a smiley face" for example, the target terminal plays the follow-up animation, and the schematic diagram of displaying the follow-up interactive information 35 after the follow-up animation is played can be seen in FIG. 37. Figure 3e
[0083] It should be noted that if the target terminal supports the target user to edit and create the selected candidate information again, when any candidate information in the information selection window is selected, the target terminal can first output an information editing panel, and after the target user edits and updates the selected candidate information through the information editing panel and performs a confirmation operation on the updated selected candidate information, the follow-up animation about the target interactive information is played in the information interaction interface.
[0084] In the case that there are continuous repeated multiple pieces of interaction information in the information interaction interface, the information following entry of the target interaction information in the multiple pieces of interaction information can be displayed. If a triggering operation of the information following entry is detected, one or more candidate information can be provided for the user through the information selection window, so that the user can send the interaction information by selecting any candidate information, and the efficiency and convenience of information interaction can be effectively improved. When any candidate information in the information selection window is selected, the following interaction information generated according to the selected candidate information can be displayed in the information interaction interface. Since each piece of candidate information in the information selection window is associated with the target interaction information, the following interaction information generated according to the selected candidate information is related to the target interaction information. By displaying the following interaction information, the user's following attitude towards the target interaction information can be expressed to some extent, the display content of the information interaction interface can be enriched, the richness of information interaction can be improved, the interest and surprise of user information interaction can be improved, and the user stickiness can be improved.
[0085] Please refer to Figure 4 is a flowchart of another information display method provided by the embodiments of the present application. The information display method can be executed by the target terminal mentioned above or a social client running in the target terminal. For ease of description, the embodiments of the present application take the target terminal as an example to execute the information display method, and the following operation includes a triggering operation of the information following entry. Please refer to Figure 4 The information display method can include the following steps S401-S406:
[0086] S401, display N pieces of interaction information in the information interaction interface, N is a positive integer greater than 1.
[0087] S402, if there are continuous repeated multiple pieces of interaction information in the N pieces of interaction information, display the information following entry of the target interaction information in the multiple pieces of interaction information in the information interaction interface.
[0088] In the embodiments of the present application, the target interaction information is mainly taken as the last piece of information in the continuous repeated multiple pieces of interaction information. The specific way of displaying the information following entry of the target interaction information can include any one of the following:
[0089] The first implementation: the target terminal can directly display the information following entry in the system default style, that is, the information following entry can be a default following entry displayed in the system default style. For example, the system default style can be a circular icon style containing "+1", as shown in Figure 5a .
[0090] The second implementation manner is: the target terminal can identify the interaction scene to which the target interaction information belongs, and in the case that it is determined according to the identification result that the target interaction information belongs to a specified scene, the information following entry is displayed in a dissimilation style; if it is determined according to the identification result that the target interaction information belongs to a non-specified scene, the information following entry is displayed in a system default style. In this way, the display diversity of the information following entry can be effectively improved, so as to improve the interest and attraction. That is, if the interaction scene to which the target interaction information belongs is a non-specified scene, the information following entry can be a default following entry displayed in a system default style. If the interaction scene to which the target interaction information belongs is a specified scene, the information following entry can be a dissimilation following entry displayed in a dissimilation style; or the information following entry can include a dissimilation following entry and a default following entry. For the second implementation manner, it should be noted that:
[0091] ①The interaction scene to which the target interaction information belongs can be identified by the target terminal using an AI (Artificial Intelligence) technology. The so-called AI technology refers to the theory, method, technology and application system for using a digital computer or a machine controlled by a digital computer to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use the knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology of computer science; it mainly simulates the essence of intelligence, produces a new intelligent machine that can react in a similar way to human intelligence, so that the intelligent machine has the functions of perception, reasoning and decision making. Correspondingly, AI technology is a comprehensive discipline, which mainly includes computer vision technology (CV), speech processing technology, natural language processing technology and machine learning (ML) / deep learning. Specifically, the target terminal can train a scene identification model based on the machine learning technology / deep learning technology in the AI technology, so as to call the scene identification model to identify the scene of the target interaction information, and obtain the interaction scene to which the target interaction information belongs.
[0092] ②The specified scene mentioned above can be set according to business needs, such as setting the specified scene to include a blessing scene (a scene for expressing blessings to one or more users), an approval scene (a scene for expressing approval attitude to an object (a user or a thing)), a praise scene (a scene for praising an object), a celebration scene (a scene for celebrating something by sending a celebration information), an object promotion scene (a scene for promoting an object by sending a promotion information), etc.
[0093] ③The dissimilation style mentioned above can be determined according to the information content of the target interaction information; still referring to Figure 5aThe target interaction information is, for example, "Happy Birthday to X" in a blessing scenario, and the alienated style can be a cake style; for another example, the target interaction information is "X is really amazing" in a praise scenario, and the alienated style can be a thumbs-up style; for another example, the target interaction information is "Hamburger, you deserve it" in an object promotion scenario, and the alienated style can be a hamburger style, and so on.
[0094] When the information following entry includes both the alienated following entry and the default following entry, the default following entry is an entry for triggering direct sending of the same following interaction information as the target interaction information, and the alienated following entry is an entry for triggering output of the information selection window. That is, if the target user performs a trigger operation on the default following entry, the target terminal displays a following interaction information in the information interaction interface, which is the same as the target interaction information; if the target user performs a trigger operation on the alienated following entry, the target terminal outputs the information selection window.
[0095] S403, in response to the trigger operation on the information following entry, outputting an information selection window.
[0096] It should be understood that if the information following entry is a default following entry displayed in a system default style or an alienated following entry displayed in an alienated style, the trigger operation on the information following entry includes a trigger operation on the default following entry or the alienated following entry; if the information following entry includes both the alienated following entry and the default following entry, the trigger operation on the information following entry includes a trigger operation on the alienated following entry.
[0097] The information selection window output by the target terminal in response to the trigger operation can include one or more candidate information associated with the target interaction information. Specifically, if the information following entry is an alienated following entry or a default following entry, considering that the target user can have the need to copy and send the target interaction information, the information selection window can include a reference candidate information and one or more reference candidate information. If the information following entry includes both the alienated following entry and the default following entry, since the target user can copy and send the target interaction information by triggering the default following entry, the reference candidate information can not be provided in the information selection window to save the display space of the information selection window; therefore, the information selection window includes one or more reference candidate information.
[0098] It should be noted that: ① the definitions of the reference candidate information and the reference candidate information can be referred to the related description of step S202 in the foregoing embodiments, which will not be repeated here. ② In other embodiments, if the information following entry is the alien following entry or the default following entry, the target user can also be provided with two trigger operations for the information following entry; so that when the target user performs the first trigger operation (such as double-click operation) on the information following entry, it indicates that the target user does not input the following operation, at this time a following interactive information same as the target interactive information can be directly sent, and when the target user performs the second trigger operation (such as long press operation) on the information following entry, it indicates that the target user inputs the following operation, at this time the information display window can be output; then in this embodiment, the information selection window can also only include one or more reference candidate information.
[0099] In combination with the description of steps S402-S403, the following will take the information interaction interface as an example of the conversation interface of the target conversation, and illustrate the specific way of how to display the information following entry and trigger the output of the information selection window according to different situations of the information following entry:
[0100] Example 1: If there are multiple interactive information that are continuously repeated in the N interactive information, and each of the continuously repeated interactive information is “×× is really amazing”; it can be determined through scene recognition that the target interactive information in the multiple interactive information belongs to the praise scene in the specified scene. Therefore, an alien following entry 53 in the form of a big thumb like (i.e. an alienized form) can be displayed at the display position of the target interactive information 52 in the information interaction interface 51; that is, in this case, the information following entry of the target interactive information is the alien following entry. When the target user performs a trigger operation on the alien following entry 53, it can be considered that the following operation for the target interactive information is detected, at this time the information selection window 54 including the reference candidate information and one or more reference candidate information can be output, as shown in FIG. 5B. Figure 5b Alternatively, when the target user performs a trigger operation on the alien following entry 53, it can be further identified whether the trigger operation performed by the target user is the first trigger operation (such as double-click operation) or the second trigger operation (such as long press operation); if the target user performs the first trigger operation, a following interactive information 55 same as the target interactive information is directly displayed in the information interaction interface; if the trigger operation performed by the target user is the second trigger operation, the information selection window 54 including only one or more reference candidate information is output, as shown in FIG. 5C. Figure 5c
[0101] Example 2: If there are multiple pieces of continuous repeated interaction information in the N pieces of interaction information, and each of the continuous repeated pieces of interaction information is "XX is really awesome"; then the target interaction information in the multiple pieces of interaction information is determined to belong to the praise scene in the specified scene through scene recognition. Therefore, at the display position of the target interaction information 52 in the information interaction interface 51, a dissimilation follow entry 53 in the form of a big thumb like (i.e., dissimilation form) and a default follow entry 56 in the form of a "+1" round icon (i.e., system default form) are displayed; that is, in this case, the information follow entry of the target interaction information includes the dissimilation follow entry and the default follow entry. When the target user performs a trigger operation on the dissimilation follow entry 53, it is considered that a follow operation on the target interaction information is detected, and at this time, an information selection window 54 including one or more pieces of reference candidate information is output; when the target user performs a trigger operation on the default follow entry 56, a follow interaction information 55 identical to the target interaction information is directly displayed in the information interaction interface, as shown in Figure 5d .
[0102] Optionally, when the target terminal outputs the information selection window, it can also synchronously display an information refreshing component of the information selection window, so that the target user can update the candidate information in the information selection window by triggering the information refreshing component. In an embodiment, the target terminal can synchronously display the information refreshing component of the information selection window at any blank area in the information interaction interface. In another embodiment, if the information interaction interface also includes an information follow entry of the target interaction information, the target terminal can synchronously replace the display of the information follow entry with the information refreshing component of the information selection window at the display position of the information follow entry; or, synchronously cover the information follow entry with the information refreshing component at the display position of the information follow entry. For example, referring to the output mode of the information selection window as shown in Figure 5b , a schematic view of synchronously displaying the information refreshing component 57 can be seen in Figure 5e . Through this embodiment, the number of display elements in the information interaction interface can be effectively reduced, and the interface neatness of the information interaction interface can be improved; and by displaying the information refreshing component at the position of the information follow entry, after the target user performs a trigger operation on the information follow entry, the target user can directly perform a trigger operation on the information refreshing component without moving the operation object such as a finger or a mouse, and the operation convenience of the target user on the information refreshing component can be effectively improved.
[0103] After the display of the information refreshing component, the target user can perform a triggering operation on the information refreshing component; accordingly, if the information refreshing component is triggered, all or part of the candidate information in the information selection window is updated. Specifically, if the information selection window only includes reference candidate information, one or more new reference candidate information related to the target interactive information can be obtained, and the obtained new reference candidate information is used to replace all or part of the reference candidate information in the information selection window. If the information selection window includes not only one or more reference candidate information, but also reference candidate information, one or more new reference candidate information related to the target interactive information is used to replace all or part of the reference candidate information, and the reference candidate is kept unchanged; such an updating method can retain the original words while giving the user more information selection space, effectively improving user stickiness. For example, the information selection window shown in Figure 5e Figure 5f When the information refreshing component is triggered, the new reference candidate information "×× Monkey Race Lightning" related to the target interactive information is used to replace the reference candidate information "×× Race High [Cattle] [Beer] ~ ~" in the information selection window, and so on.
[0104] It should be understood that the embodiments of the present application are only used as an example of the information refreshing component to explain how to trigger the update of the information selection window, and do not limit the triggering method of the update of the information selection window. For example, in other embodiments, the target user can also perform a triggering operation (such as a long-press operation, a click operation, etc.) on the information selection window, or input a user voice for indicating the update of the information selection window, to trigger the target terminal to update all or part of the candidate information in the information selection window; in this case, the information refreshing component can be included in the information interaction interface, or can not be included, which is not limited.
[0105] S404, when any candidate information in the information selection window is selected, a follow-up interactive information is displayed in the information interaction interface, which is generated according to the selected candidate information.
[0106] In the specific implementation process, if the selected candidate information includes at least an editable target element, the specific implementation of step S404 can include the following steps s11-s13:
[0107] s11, when any candidate information in the information selection window is selected, an information editing panel 58 about the selected candidate information is output, so that the target user can edit and update the selected candidate information through the information editing panel 58. Specifically, the information editing panel 58 can include an element input area 581 and a target element 582 in the selected information; the target user can perform an element editing operation in the element input area 581, triggering the target terminal to perform step s12.
[0108] s12, according to the element editing operation detected in the element input area 581, updates the target element 582 in the selected candidate information.
[0109] In one embodiment, the target element 582 can refer to text information including one or more characters, and the element editing operation can include a character input operation. In this embodiment, the target terminal can display one or more candidate characters according to the character input operation detected in the element input area, select a target character from the one or more candidate characters according to a character selection operation, and update the text information in the selected candidate information with the target character. For example, referring to the information selection window shown in Figure 5e Figure 5g The element input area 581 can include a character input panel, through which the target user can perform a character input operation. In this case, the target terminal can display multiple candidate characters such as "a", "I", and "we" according to the character input operation. If the target user selects the candidate character "a", the target terminal can add "a" as the target character to the text information in the selected candidate information, to update the selected candidate information. It should be understood that the element editing operation can also include a character deletion operation. In this embodiment, the target terminal can delete at least one character in the text information in the selected candidate information according to the character deletion operation, to update the text information in the selected candidate information.
[0110] In another embodiment, the target element 582 can refer to an object image including a first object, and the element editing operation can include an image input operation. In this embodiment, the target terminal can acquire a new object image including a second object according to the image input operation detected in the element input area, and replace the first object in the target element in the selected candidate information with the second object in the new object image, to update the object image in the selected candidate information. The first object and the second object can be a person, an animal, or a static object, and the like. When the first object and the second object are persons, the entire second object can be used to replace the first object, or only a part of the second object (e.g., a face image of the second object) can be used to replace a part of the first object (e.g., a face image of the first object), without limitation.
[0111] For example, referring to the information selection window shown in Figure 5e Figure 5h As shown, one or more candidate images can be included in the element input area 581, any of the candidate images can be acquired from a local space of the target terminal, Internet data, or a plurality of data sources, and any of the candidate images can include one or more objects; in this implementation, the target terminal can replace the entire first object with the entire second object in the new object image selected by the target user according to an image input operation (i.e., an image selection operation). For example, the target terminal can also first display an image uploading component in the element input area 581; when the image uploading component is triggered, one or more candidate images are displayed, so that the target user can select a candidate image as a new object image. For another example, referring to FIG. 5, as shown, an image shooting component 5010 is displayed in the element input area 501; when the image shooting component 5010 is triggered, the target terminal displays an image capturing window 5011; and calls a camera component of the target terminal to capture an image, and displays the captured object image in the image capturing window 5011; when a confirmation operation of the target user on the object image in the image capturing window is detected, the object image in the image capturing window is acquired as a new object image, and a face image of the second object in the new object image replaces a face image of the first object. Figure 5i As shown, an image shooting component 5810 is displayed in the element input area 581; when the image shooting component 5810 is triggered, the target terminal displays an image capturing window 5811; and calls a camera component of the target terminal to capture an image, and displays the captured object image in the image capturing window 5811; when a confirmation operation of the target user on the object image in the image capturing window is detected, the object image in the image capturing window is acquired as a new object image, and a face image of the second object in the new object image replaces a face image of the first object.
[0112] It should be understood that, Figures 5h-5i The above-mentioned element input area 581 is only an example of a product form of the information editing panel, and does not limit the same; for example, in other embodiments, the element input area 581 in the information editing panel can simultaneously include one or more candidate images and an image shooting component; or the element input area can simultaneously include an image uploading component and an image shooting component, etc. Moreover, Figures 5h-5iBoth indicate that when any candidate information in the information selection window is selected, the target terminal can directly output the information editing panel 58. Furthermore, the target terminal can provide two selection operations for any candidate information in the information selection window, allowing the target user to flexibly select a candidate information according to their needs, thereby triggering different display logics on the target terminal. Specifically, when any candidate information in the information selection window is selected, if the selected candidate information is selected through a first selection operation, the information editing panel of the selected candidate information can be output; that is, the information editing panel is output when the selected candidate information is selected through the first selection operation. If the selected candidate information is selected through a second selection operation, the selected candidate information can be used as follow-up interactive information and displayed in the information interaction interface. The first and second selection operations can be set according to business needs; for example, the first selection operation can be a long press operation for any candidate information, and the second selection operation can be a double-click operation for any candidate information. For example, an editing component 59 can be displayed in the display area where each candidate information is located; then the first selection operation can be a trigger operation on the editing component 59, and the second selection operation can be a trigger operation on any position in the display area where the candidate information is located other than the editing component 59; thus, with Figure 5g Taking the information editing panel shown as an example, a diagram illustrating the different display logic executed based on different selection operations can be found here. Figure 5j As shown.
[0113] s13, if a confirmation operation for the updated selected candidate information is detected, the updated selected candidate information is used as follow-up interaction information and displayed in the information interaction interface.
[0114] The confirmation operation mentioned here may include: a touch operation on the updated selected candidate information, or a trigger operation on the confirmation component of the updated selected candidate information, etc. The confirmation component may be directly displayed in the information editing panel when outputting the information; for example, it may be displayed directly in the upper left corner of the information editing panel, or as an attachment to the "Cancel" component in the information editing panel, etc. Alternatively, the confirmation component may be hidden or displayed in the information editing panel when outputting the information; for example, using... Figure 5g Taking the information editing panel shown as an example, after updating the selected candidate information, the target user can close the element input area in the information editing panel, thereby triggering the target terminal to display a confirmation component. After detecting the target user's trigger operation on the confirmation component 591, the updated selected candidate information is displayed as follow-up interactive information 55 in the information interaction interface, such as... Figure 5k As shown. See alsoFigure 5k As shown, when the follow-up interaction information is displayed, the information selection window can be closed synchronously, and the information refreshing component can be hidden, so as to effectively reduce the number of display elements in the information interaction interface, and improve the interface neatness of the information interaction interface. Of course, it can be understood that in other embodiments, the information selection window can still be displayed when the follow-up interaction information is displayed.
[0115] S405, if it is detected that the follow-up interaction information is followed, a new information selection window is output.
[0116] In a specific implementation, the follow-up operation on the follow-up interaction information can be detected; if it is detected that the follow-up operation on the follow-up interaction information is detected, it can be determined that the follow-up interaction information is followed. In an embodiment, an interaction follow-up entry 592 about the follow-up interaction information can be displayed in the information interaction interface; if it is detected that the interaction follow-up entry is triggered, it is determined that the follow-up interaction information is followed. It should be understood that, similar to the information follow-up entry of the target interaction information, the display style of the interaction follow-up entry of the follow-up interaction information can also be a system default style or a dissimilation style. And similar to the target interaction information, in addition to inputting the follow-up operation on the follow-up interaction information by triggering the interaction follow-up entry, the follow-up operation on the follow-up interaction information can also be inputted by triggering a follow-up gesture, specifying a physical key, or other manners.
[0117] After it is detected that the follow-up interaction information is followed, the target terminal can output a new information selection window 593. In an embodiment, the new information selection window can include one or more candidate information associated with the target interaction information, as shown in the first drawing in FIG. 6; that is, in this embodiment, even if the follow-up interaction information is followed, the message follow-up is still implemented based on the target interaction information. In another embodiment, the new information selection window can include one or more candidate information associated with the follow-up interaction information, as shown in the second drawing in FIG. 6; that is, in this embodiment, the message follow-up is implemented based on the follow-up interaction information. Figure 5l Figure 5l
[0118] S406, when any candidate information in the new information selection window is selected, a new follow-up interaction information is displayed in the information interaction interface, and the new follow-up interaction information is generated according to the selected candidate information in the new information selection window.
[0119] In a specific implementation, similar to the display mode of the follow-up interaction information mentioned in step S404; when any candidate information in the new information selection window is selected, the target terminal can directly display the selected candidate information in the new information selection window as the new follow-up interaction information in the information interaction interface. Alternatively, the target terminal can play a follow-up animation of the new follow-up interaction information, and after the playing is completed, display the selected candidate information in the new information selection window as the new follow-up interaction information in the information interaction interface. Alternatively, when any candidate information in the new information selection window is selected, output an information editing panel of the new follow-up interaction information, and after the updated selected candidate information is obtained through the information editing panel of the new follow-up interaction information, display the obtained updated selected candidate information as the new follow-up interaction information in the information interaction interface, and the like.
[0120] In the case where there are multiple pieces of interaction information that are continuously repeated in the information interaction interface, the embodiments of the present application can provide one or more candidate information for the user through the information selection window, so that the user can realize the sending of the interaction information by selecting any candidate information, and the efficiency and convenience of information interaction can be effectively improved. When any candidate information in the information selection window is selected, the follow-up interaction information generated according to the selected candidate information can be displayed in the information interaction interface, so as to express the follow-up attitude of the user for the target interaction information to a certain extent, enrich the display content of the information interaction interface, improve the richness of information interaction, and thus improve the interest and surprise of the user in information interaction, and further improve the user stickiness. In addition, after detecting that the follow-up interaction information is followed, the embodiments of the present application can also support the user to perform information following on the follow-up interaction information, or continue to perform information following on the target interaction information, and the richness of information interaction can be further improved, so as to further improve the user stickiness.
[0121] It should be noted that, although the above Figure 2 The method embodiments shown in Figures 3a-3c The method embodiments shown in Figure 4 The various interface diagrams involved in the method embodiments shown in Figures 5a-5k involve the message following scenario of the communication session. However, these drawings do not limit the application scenarios of the information display method proposed by the embodiments of the present application. That is, the information display method proposed by the embodiments of the present application is not limited to being only applicable in the message following scenario of the communication session, but can also be applied in the comment following scenario when watching live broadcast, the bullet screen following scenario when watching video, and the like. For example, referring to Figure 6As shown in the following, when the information display method proposed in the embodiments of the present application is applied in the bullet screen following scene when watching a video, the target terminal displays N pieces of bullet information (i.e. interactive information) in the video playing interface (i.e. information interactive interface). When there are multiple pieces of continuously repeated bullet information in the N pieces of bullet information, an information following entry 62 of a target bullet information 61 (i.e. target interactive information) in the multiple pieces of bullet information can be displayed; if the information following entry 62 is triggered, an information selection window 63 is output, and when any candidate bullet information in the information selection window 63 is selected, the following bullet information 64 is displayed in the video playing interface according to the selected bullet information.
[0122] In addition, for the message following scene of the communication session, the embodiments of the present application further propose an information display framework to better display information; the information display framework can include four layers of a social client, an IM (Instant Messaging, instant messaging) message service module, a scene analysis service module and a recommendation model. The social client can be understood as a chat room program, which can be responsible for providing a session interface (or chat page) on the front end. The IM message service module (the background server of the message service) can be responsible for bearing the background function of the message service, and has the ability to identify repeated messages, cache context messages of the session scene, cache scene tags of the session scene, and issue scene tags for specific clients. The context message mentioned here can be understood as a message array containing one or more session messages, and each session message can be composed of a message id (identifier), a session id (identifier), a sending timestamp of the session message, a user identifier (uin) of the message sending user of the session message, and a message content of the session message. The scene tag can be an enumeration type, which can include but is not limited to: blessing, agreement, praise, celebration, and miss, etc. The scene recognition service can be responsible for providing an algorithm background service, which can return a scene recognition result after using a trained scene recognition model to analyze the input information (session context). The recommendation model can be responsible for returning recommended candidate information according to the scene tag and combining user historical data to personalize the recommended candidate information, which can be a sentence or an expression package. The recommendation model can be integrated in the server or in the social client, which is not limited; when the recommendation model is integrated into the social client, it can use the user data in the local space, and also can ensure the privacy of the user data through offline analysis. For convenience of description, the recommendation model integrated in the social client is taken as an example for description hereinafter.
[0123] The running principle of the information display framework will be described below in combination with the timing diagram shown in Figure 7a the flow chart shown in Figure 7b
[0124] 1、User A uses social client A to enter the conversation interface of the target conversation and inputs conversation message A; at this time, social client A can send conversation message A to the IM message service module, so that the IM message service module can send the conversation message A to the social clients of each user in the target conversation for display.
[0125] 2、User B uses social client B to enter the conversation interface of the target conversation and inputs conversation message B; at this time, social client B can send conversation message B to the IM message service module, so that the IM message service module can send the conversation message B to the social clients of each online user in the target conversation for display. If the conversation message B is a conversation message that is the same as the conversation message A, that is, user B inputs the same conversation message, at this time, the repeated conversation message condition is hit; at this time, the IM message service module can forward the repeated message (i.e., the conversation message A and the conversation message B) and the context message of the target conversation to the scene recognition service module.
[0126] 3、The scene recognition service module can recognize whether the current context (i.e., the interactive scene to which the repeated message belongs) hits the specified scene according to at least one of the context message of the target conversation and the repeated message. If the recognition result is a hit, the scene recognition success flag and the scene label of the specified scene can be returned to the IM message service module.
[0127] 4、The IM message service module can send the scene label to the social clients (i.e., including social client A and social client B) used by each online user in the target conversation after receiving the return value (i.e., the scene label).
[0128] 5、Social client A can call the personalized recommendation model by taking at least one of the scene label and the target conversation message in the multiple conversation messages that are continuously repeated as an input parameter after obtaining the scene label and detecting the following operation of user A on the target conversation message, so that the recommendation model returns customized candidate messages, such as customized conversation sentences, expression packs, and other candidate messages.
[0129] 6、After the social client A obtains the customized candidate messages, the social client A can recommend the candidate messages to the user A and send the follow-up conversation messages according to the recommendation result. Specifically, an information selection window can be output in the conversation interface, and the one or more candidate messages can be displayed in the information selection window. If the user A selects any candidate message, the follow-up conversation message generated according to the selected candidate message can be displayed in the conversation interface. Optionally, if the user A selects and sends a candidate message, it can be considered that the recommendation model successfully recommends the message to the user A, indicating that the user A accepts the recommendation result of the recommendation model. Therefore, the social client A can also update the recommendation record of the recommendation model to deposit data, so as to subsequently calibrate the algorithm accuracy of the recommendation model according to the latest recommendation record, so that the updated recommendation model is more in line with the needs of the user A, achieving the effect of model customization. In addition, if the recommendation model refers to the scene label when outputting the candidate message, the IM message service module can consider that the identification result of the scene recognition service module is accurate after receiving the follow-up conversation message. Therefore, the IM message service module can also update the identification service record of the scene recognition service module. By updating the identification service record to deposit data, it is convenient to subsequently calibrate the accuracy of the scene recognition model according to the identification service record, thereby improving the accuracy of subsequent scene recognition.
[0130] Based on the above description, the specific principles of the scene recognition service module and the recommendation model in the information display framework are specifically introduced as follows:
[0131] (I) The core function of the scene recognition service module is to determine to which scene the current context belongs according to the input information.
[0132] In an embodiment, one or more specified scenes can be pre-set, and one or more corresponding keywords can be set for each specified scene. In this embodiment, the scene recognition service module can obtain any conversation message in the plurality of continuously repeated conversation messages, and perform keyword recognition on the any conversation message. Then, the target keyword recognized is used to perform hit matching processing on the keywords corresponding to each specified scene. If the target keyword successfully hits the keyword corresponding to a specified scene, it can be considered that the interactive scene (i.e., the current context of the target conversation) to which the any conversation message belongs successfully hits the specified scene, and the scene label of the hit specified scene can be returned.
[0133] In another implementation, a scene recognition model can be constructed, and scene labels of several specified scenes are predetermined in the scene recognition model, so that the scene recognition is essentially a classification problem, i.e., multiple binary classifications are performed on the input information to obtain the scene label corresponding to the input information. In this implementation, the input information of the scene recognition model can include at least one of the following: all or part of the plurality of session messages repeatedly in succession, and the context message; when the input information includes the context message, the scene recognition model can perform scene recognition in combination with the features contained in the context message, thereby improving the accuracy of the scene recognition result. Moreover, in order to better extract the features in the context message, for NLP (Natural Language Processing) with context, the embodiment of the present application can use an LSTM model (Long short-term memory) as the scene recognition model; because compared with a general RNN (Recurrent Neural Network), the LSTM has four layers of interactive neural network layers, which has better performance in long sequence processing and can more accurately extract the features in the context message.
[0134] Because the LSTM model is generally used to process a binary classification problem, and the scene recognition is a multi-class classification problem; therefore, the embodiment of the present application can use a one-versus-rest method (One vs Rest, OvR) or a one-versus-one method (One vs One, OvO) to analyze the multi-class classification problem encountered by the LSTM model. The principle of OvR is: for k classes, the samples of a certain class are classified into one class alone, and the other samples are classified into another class, so as to train the LSTM model to obtain a trained LSTM model; in this way, one class corresponds to one LSTM model, i.e., k classes need to design k LSTM models, and finally the input sample is classified into the class with the largest classification function value. The principle of OvO is: an LSTM is designed and trained between any two classes of samples, so that k classes of samples need to design C(k, 2) LSTM models; C(k, 2) here is a permutation combination, which means the combination number of selecting 2 from k numbers, for example, when k=5, C(5, 2)=P(5, 2) / 2=10. The calculation formula is C(k, 2)=P(k, 2) / P(2, 2), where P(k, 2)=k! / (k-2)!. When classifying an input information, C(k, 2) LSTM models can be called respectively to perform classification voting, so that the class with the most votes is finally obtained as the class (i.e., the scene label) of the input information.
[0135] Suppose there are five categories (i.e., five scene labels) A, B, C, D, and E, and during the training of the model, the sample vectors corresponding to A-B, A-C, A-D, A-E, B-C, B-D, B-E, C-D, C-E, and D-E are selected as the training set, thereby obtaining ten trained LSTM models. In actual application, the input information can be classified (i.e., scene label recognition) in the ten LSTM models, and the result is obtained by voting. The specific steps are as follows:
[0136] Initially, the votes of each category in the five categories ABCDE are initialized to zero.
[0137] (A, B)-classifier (i.e., the LSTM model trained by using the sample vector corresponding to A-B) is called to predict the category of the input information, thereby obtaining the probability that the input information belongs to A and the probability that the input information belongs to B. If A wins (the probability of A is greater than the probability of B), A gets one vote, i.e., a = a + 1; otherwise, b = b + 1.
[0138] (A, C)-classifier (i.e., the LSTM model trained by using the sample vector corresponding to A-B) is called to predict the category of the input information, thereby obtaining the probability that the input information belongs to A and the probability that the input information belongs to C. If A wins (the probability of A is greater than the probability of C), a = a + 1; otherwise, c = c + 1.
[0139] …
[0140] (D, E)-classifier (i.e., the LSTM model trained by using the sample vector corresponding to D-E) is called to predict the category of the input information, thereby obtaining the probability that the input information belongs to D and the probability that the input information belongs to E. If D wins, d = d + 1; otherwise, e = e + 1.
[0141] After the ten LSTM models are called to predict the category of the input information, the final votes of each category in the five categories ABCDE are obtained; and the final category corresponding to the input information is obtained according to the final votes of each category, and the final category has the highest votes in the five categories, i.e., Max(a, b, c, d, e).
[0142] Based on the above description of the LSTM model, it should be noted that: (1) In the process of training the model using the sample vectors corresponding to A-B, A-C, A-D, A-E, B-C, B-D, B-E, C-D, C-E, D-E respectively to obtain 10 LSTM models, the training result line chart of each LSTM model can be obtained respectively; among them, part of the training result line chart of the LSTM model can be seen from Figure 7c As can be seen from the training result line chart shown in Figure 7c As can be seen from the training result line chart shown in (2) In order to improve the accuracy of model prediction, the training set can be manually labeled by the annotator; a single training can run 4 epochs (an epoch refers to the process of training all training samples once), so that the LSTM model performs best, thereby ensuring the score, precision and recall rate, and also avoiding overfitting.
[0143] (II) The core function of the recommendation model is to recommend candidate messages (sentences or emoticons) to the user based on at least one of the target conversation message followed by the user and the input scene label.
[0144] When the recommendation model only recommends candidate messages according to the target conversation message, the source of the candidate message can include: the local space of the target terminal, Internet data, the user's favorite emoticon folder, etc.; it should be noted that the specific implementation of obtaining the candidate message according to the target conversation message can refer to the specific implementation of obtaining the candidate information according to the target interaction information mentioned in the foregoing method embodiment, which will not be repeated here.
[0145] When the recommendation model refers to the input scene label to recommend candidate messages, the source of the candidate message (i.e. sentence and emoticon) can include at least one of the following: one is the user's historical data that best fits the current scene, and the other is the sentence or emoticon crawled from the network according to the scene label. The latter is relatively simple, and the social client can directly call the pre-set business interface of the background server after receiving the scene label, so that the background server helps to crawl and return the candidate message; for the former, a collaborative filtering algorithm (Collaborative filtering) can be used to obtain the candidate message, which is as follows:
[0146] For example, it is assumed that 4 specified scenes are preset: a blessing scene, an approval scene, a praise scene, and a celebration scene; and the behaviors made by the user in the past in the 4 specified scenes can be seen from Table 1 (a-e are user abstract behaviors, which can be specifically understood as 5 different expression packages sent by the user):
[0147] Table 1
[0148] Designated scenarios User abstract behaviour Blessing scenarios a, b, d Agreement scenarios a, c Praise scenarios c, b, e Celebration scenarios c, d, e
[0149] In the first step, the behavior co-occurrence matrix can be constructed according to Table 1, and the construction principle of the behavior co-occurrence matrix is as follows: when two expression packages appear in a specified scene at the same time, the element value corresponding to the two user abstract behaviors in the behavior co-occurrence matrix is 1; otherwise, the element value is equal to 0. Based on this construction principle, the behavior co-occurrence matrix shown in Table 2 can be obtained:
[0150] Table 2
[0151] a b c d e a - 1 1 1 0 b 1 - 1 1 1 c 1 1 - 1 2 d 1 1 1 - 1 e 0 1 2 1 -
[0152] In the second step, the cosine similarity formula for calculating the similarity between expression packages is obtained, as shown in the following formula 1.1:
[0153] Formula 1.1
[0154]
[0155] In formula 1.1, the denominator is the number of scenes in which expression package i is sent, and the numerator is the number of scenes in which expression package i and expression package j are sent at the same time. According to formula 1.1, the element values in the behavior co-occurrence matrix are normalized to obtain a normalized matrix; any element value in the normalized matrix can be used to represent the similarity of the two expression packages corresponding to the element value. The normalized matrix can be as shown in Table 3:
[0156] Table 3
[0157] a b c d e a - 0.5 0.5 0.5 0 b 0.5 - 0.5 0.5 0.5 c 0.33 0.33 - 0.33 0.66 d 0.5 0.5 0.5 - 0.5 e 0 0.5 1 0.5 -
[0158] In the third step, the score of each expression package is determined according to the frequency of use of each expression package by the user.
[0159] In the fourth step, according to the item-based collaborative filtering algorithm shown in the following formula 1.2, the love degree of user u to each expression package is calculated according to the score of each expression package and the similarity of each expression package.
[0160] p(u,j)=∑ j∈N(u)∩S(j,K) w ji r ui Formula 1.2
[0161] wherein, N(u) in formula 1.2 is a set of sticker packs sent by the user, S(j, K) is a set of sticker packs with high similarity (or relevance) to sticker pack j, w ji is the similarity of sticker pack j and sticker pack i, r ui is the frequency of use of sticker pack i by the user (i.e., the use score of sticker pack i).
[0162] In the fifth step, the sticker pack with the largest score is selected and recommended to the user, or the sticker pack with a score greater than a threshold value is selected and recommended to the user. Optionally, after selecting the sticker pack with the largest score or the sticker pack with a score greater than the threshold value, the selected sticker pack can be adjusted and modified to be closer to the user's expression habit according to the user's usual chatting mood habit and the message content of the target conversation message being followed, so as to recommend the adjusted sticker pack.
[0163] Based on the above description, it can be known that the information display framework proposed in the embodiments of the present application not only can reduce the operation threshold of organizing language and writing in the user expression process to a certain extent; in addition, the candidate messages generated according to the rich and interesting network words can make the expression more “trendy” and more humorous, which can not only improve the interestingness of the chat expression, but also can seamlessly embed the network context for the user who is not used to using network words, reduce the social pressure, and facilitate the creation of a colorful social atmosphere.
[0164] Based on the description of the above information display method embodiments, the embodiments of the present application also disclose an information display device, which can be a computer program (including program code) running in the above-mentioned target audience terminal. The information display device can perform the method shown in Figure 2 or Figure 4 .
[0165] Please refer to Figure 8 , the information display device can run the following units:
[0166] The display unit 801 is configured to display N pieces of interactive information in an information interaction interface, N being a positive integer greater than 1.
[0167] The display unit 801 can also be configured to display, in the information interaction interface, an information following entry of target interactive information in the plurality of pieces of interactive information that are continuously repeated.
[0168] The processing unit 802 is configured to output an information selection window in response to a triggering operation on the information following entry; the information selection window includes one or more pieces of candidate information associated with the target interactive information.
[0169] The display unit 801 is further configured to display follow-up interactive information in the information interaction interface when any candidate information in the information selection window is selected, the follow-up interactive information being generated according to the selected candidate information.
[0170] In an embodiment, the selected candidate information at least includes an editable target element; and the display unit 801, when displaying the follow-up interactive information in the information interaction interface when any candidate information in the information selection window is selected, can be specifically configured to:
[0171] output an information editing panel about the selected candidate information when any candidate information in the information selection window is selected, the information editing panel including an element input area and the target element in the selected candidate information;
[0172] update the display of the target element in the selected candidate information according to an element editing operation detected in the element input area;
[0173] if a confirmation operation for the updated selected candidate information is detected, the updated selected candidate information is taken as the follow-up interactive information, and the follow-up interactive information is displayed in the information interaction interface.
[0174] In another embodiment, the target element refers to text information including one or more characters, and the element editing operation includes a character input operation; and the display unit 801, when updating the display of the target element in the selected candidate information according to the element input operation detected in the element input area, can be specifically configured to:
[0175] display one or more candidate characters according to the character input operation detected in the element input area;
[0176] select a target character from the one or more candidate characters according to a character selection operation, and update the display of the text information in the selected candidate information with the target character.
[0177] In another embodiment, the target element refers to an object image including a first object, and the element editing operation includes an image input operation; and the display unit 801, when updating the display of the target element in the selected candidate information according to the element input operation detected in the element input area, can be specifically configured to:
[0178] obtain a new object image containing a second object according to the image input operation detected in the element input area;
[0179] The second object in the new object image is used to replace the first object in the target element of the selected candidate information, so as to update the object image in the selected candidate information.
[0180] In another implementation, the information editing panel is output when the selected candidate information is selected by the first selection operation; correspondingly, the display unit 801 can be further configured to:
[0181] When any candidate information in the information selection window is selected, if the selected candidate information is selected by the second selection operation, the selected candidate information is taken as the following interactive information, and the following interactive information is displayed in the information interactive interface.
[0182] In another implementation, the processing unit 802 can be further configured to:
[0183] When the information selection window is output, the information refreshing component about the information selection window is synchronously displayed;
[0184] If the information refreshing component is triggered, all or part of the candidate information in the information selection window is updated.
[0185] In another implementation, when the processing unit 802 is configured to synchronously display the information refreshing component about the information selection window, the processing unit 802 can be specifically configured to:
[0186] At the display position of the information following entry, the information refreshing component about the information selection window is synchronously used to replace the display of the information following entry;
[0187] Or, at the display position of the information following entry, the information refreshing component is synchronously used to cover the information following entry.
[0188] In another implementation, the processing unit 802 can be further configured to: when the following interactive information is displayed, the information selection window is synchronously closed, and the information refreshing component is not displayed.
[0189] In another implementation, the processing unit 802 can be further configured to: if it is detected that the following interactive information is followed, a new information selection window is output, the new information selection window includes one or more candidate information associated with the target interactive information, or one or more candidate information associated with the following interactive information.
[0190] The display unit 801 can be further configured to: when any candidate information in the new information selection window is selected, a third interactive information is displayed in the information interactive interface, the third interactive information is generated according to the selected candidate information in the new information selection window.
[0191] In another implementation, the display unit 801 can be further configured to:
[0192] display, in the information interaction interface, an interaction following entry about the following interaction information;
[0193] if it is detected that the interaction following entry is triggered, determine that the following interaction information is followed.
[0194] In another implementation, the display form of the following interaction information in the information interaction interface is the same as the display form of the target interaction information in the information interaction interface.
[0195] if the interaction scenario to which the target interaction information belongs is a non-designated scenario, the information following entry is a default following entry displayed in a system default style, and the following operation includes a triggering operation for the default following entry;
[0196] if the interaction scenario to which the target interaction information belongs is a designated scenario, the information following entry is an alienated following entry displayed in an alienated style, the alienated style being determined according to the information content of the target interaction information; or the information following entry includes the alienated following entry and the default following entry; and the triggering operation for the information following entry includes a triggering operation for the alienated following entry.
[0197] In another implementation, if the information following entry is the alienated following entry or the default following entry, the information selection window includes a reference candidate information and one or more reference candidate information.
[0198] if the information following entry includes the alienated following entry and the default following entry, the information selection window includes the one or more reference candidate information.
[0199] The reference candidate information refers to candidate information with information semantics matching the information semantics of the target interaction information.
[0200] In another implementation, the information selection window includes the reference candidate information and the one or more reference candidate information; correspondingly, the display unit 801 can be further configured to:
[0201] if the selected candidate information is the reference candidate information, display prompt information of the following interaction information to prompt that the following interaction information is obtained by following the target interaction information;
[0202] When the display time length of the prompt information is greater than the time length threshold, the display of the prompt information is cancelled.
[0203] In another implementation, the display unit 801 can be further configured to:
[0204] After any candidate information in the information selection window is selected, a following animation about the target interactive information is played in the information interaction interface.
[0205] After the following animation is played, the step of displaying the following interactive information in the information interaction interface is executed.
[0206] In another implementation, when the display unit 801 is configured to play the following animation about the target interactive information in the information interaction interface, the display unit 801 can be specifically configured to:
[0207] Display a following identifier of the target interactive information at a first display position of the target interactive information in the information interaction interface.
[0208] Control the following identifier of the target interactive information to move from the first display position to a second display position, the second display position being a position for displaying the following interactive information; and when the following identifier is moved to the second display position, it indicates that the following animation is played.
[0209] In another implementation, the display unit 801 can be further configured to:
[0210] Display an information identifier of the target interactive information at the second display position where the following interactive information is located.
[0211] The information identifier includes at least one of the following: a user identifier of an information sender of the target interactive information, and an information abstract of the target interactive information.
[0212] In another implementation, the target interactive information includes first text information; and the information selection window includes at least one of the following: one or more reference candidate information of an image information type, and one or more reference candidate information of a text information type.
[0213] Any reference candidate information of the image information type includes: a description image for reflecting an information semantic of the first text information, an image obtained by fusing the description image and the first text information, or an image obtained by fusing the description image and approximate text information of the first text information.
[0214] Any reference candidate information under the text information type includes: second text information obtained by replacing the first string in the first text information with the second string; the first string includes one or more characters in the first text information, and the second string refers to: a string whose semantic similarity with the first string is greater than a threshold.
[0215] According to one embodiment of this application, Figure 2 or Figure 4 Each step involved in the method shown can be performed by... Figure 8 This is performed by the various units within the information display device shown. For example, Figure 2 Both steps S201 and S203 shown can be performed by Figure 8 The display unit 801 shown is used to execute step S202, which can be performed by... Figure 8 The processing unit 802 shown is used to execute this. For example, Figure 4 Steps S401-S402, S404, and S406 shown can all be generated by... Figure 8 The display unit 801 shown is used to execute steps S403 and S405, which can both be performed by... Figure 8 The processing unit 802 shown here performs the operations, etc.
[0216] According to another embodiment of this application, Figure 8 The various units in the information display device shown can be individually or entirely combined into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above-mentioned units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the information display device may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.
[0217] According to another embodiment of this application, the following can be achieved by running on a general-purpose computing device, such as a computer, which includes processing elements and storage elements such as a central processing unit (CPU), random access memory (RAM), and read-only memory (ROM), a device capable of performing operations such as... Figure 2 or Figure 4 The computer program (including program code) for each step involved in the corresponding method shown, to construct such... Figure 8The information display device and the information display method according to the embodiments of the present application are realized by the computer program. The computer program can be recorded on a computer readable recording medium, for example, and loaded into the above-mentioned computer device through the computer readable recording medium, and run in the computer device.
[0218] In the case that there are continuous repeated pieces of interactive information in the information interaction interface, the embodiments of the present application can display an information following entry of target interactive information in the pieces of interactive information; if a triggering operation of the user on the information following entry is detected, one or more pieces of candidate information can be provided for the user through an information selection window, so that the user can select any piece of candidate information to realize sending of the interactive information, and the efficiency and convenience of information interaction can be effectively improved. When any piece of candidate information in the information selection window is selected, a following interactive information generated according to the selected piece of candidate information can be displayed in the information interaction interface. Since each piece of candidate information in the information selection window is associated with the target interactive information, the following interactive information generated according to the selected piece of candidate information is related to the target interactive information; by displaying the following interactive information, the following attitude of the user to the target interactive information can be expressed to a certain extent, the display content of the information interaction interface can be enriched, the variability of information interaction can be improved, the interest and surprise of the user in information interaction can be improved, and the user stickiness can be improved.
[0219] Based on the description of the above method embodiments and device embodiments, the embodiments of the present application further provide a terminal (i.e., the target audience terminal mentioned above). Please refer to Figure 9 The terminal can at least include a processor 901, an input device 902, an output device 903 and a computer storage medium 904. The processor 901, the input device 902, the output device 903 and the computer storage medium 904 in the terminal can be connected through a bus or other means.
[0220] The computer storage medium 904 can be stored in the memory of the terminal, and is used to store a computer program including program instructions. The processor 901 is used to execute the program instructions stored in the computer storage medium 904. The processor 901 (or CPU (Central Processing Unit, central processor)) is the computing core and control core of the terminal, and is adapted to implement one or more instructions, and is specifically adapted to load and execute one or more instructions to implement a corresponding method process or a corresponding function. In one embodiment, the processor 901 of the embodiment of the present application can be used to perform a series of information display, specifically including: displaying N pieces of interactive information in an information interaction interface, N being a positive integer greater than 1; if there are multiple pieces of interactive information that are continuously repeated in the N pieces of interactive information, displaying an information following entry of target interactive information in the multiple pieces of interactive information in the information interaction interface; in response to a triggering operation on the information following entry, outputting an information selection window; the information selection window includes one or more candidate information associated with the target interactive information; when any candidate information in the information selection window is selected, displaying following interactive information in the information interaction interface, the following interactive information being generated according to the selected candidate information, and the like.
[0221] The embodiment of the present application further provides a computer storage medium (Memory), which is a memory device in the terminal and is used to store programs and data. It can be understood that the computer storage medium herein can include a built-in storage medium in the terminal, and of course can include an extended storage medium supported by the terminal. The computer storage medium provides a storage space, and the storage space stores an operating system of the terminal. Furthermore, one or more instructions adapted to be loaded and executed by the processor 901 are stored in the storage space, and the instructions can be one or more computer programs (including program codes). It should be noted that the computer storage medium herein can be a high-speed RAM memory, or a non-volatile memory such as at least one disk memory; and optionally can be at least one computer storage medium located away from the aforementioned processor.
[0222] In one embodiment, one or more instructions stored in the computer storage medium can be loaded and executed by the processor 901 to implement the corresponding steps of the method in the above-mentioned information display method embodiment. In a specific implementation, the one or more instructions in the computer storage medium are loaded and executed by the processor 901 as follows:
[0223] Display N pieces of interactive information in an information interaction interface, N being a positive integer greater than 1;
[0224] If there are multiple consecutively repeated interactive messages among the N interactive messages, then the information follow-up entry of the target interactive message among the multiple interactive messages will be displayed in the information interaction interface;
[0225] In response to a trigger operation on the information following entry, an information selection window is output; the information selection window includes one or more candidate information items associated with the target interactive information;
[0226] When any candidate information in the information selection window is selected, follow-up interactive information is displayed in the information interaction interface. The follow-up interactive information is generated based on the selected candidate information.
[0227] In one implementation, the selected candidate information includes at least: an editable target element; correspondingly, when any candidate information in the information selection window is selected, and when follow-up interactive information is displayed in the information interaction interface, the one or more instructions can be loaded and specifically executed by the processor 901:
[0228] When any candidate information in the information selection window is selected, an information editing panel for the selected candidate information is output. The information editing panel includes an element input area and the target element in the selected candidate information.
[0229] Based on the element editing operation detected in the element input area, update the target element displayed in the selected candidate information;
[0230] If a confirmation operation is detected for the updated selected candidate information, the updated selected candidate information is used as follow-up interaction information and displayed in the information interaction interface.
[0231] In another embodiment, the target element refers to text information comprising one or more characters, and the element editing operation includes a character input operation; correspondingly, when updating the display of the target element in the selected candidate information based on the element input operation detected in the element input area, the one or more instructions can be loaded and specifically executed by the processor 901:
[0232] Based on the character input operation detected in the element input area, display one or more candidate characters;
[0233] The target character is selected from one or more candidate characters according to the character selection operation, and the text information in the selected candidate information is updated using the target character.
[0234] In another embodiment, the target element refers to: an object image including the first object, and the element editing operation includes: an image input operation; correspondingly, when updating the target element in the selected candidate information based on the element input operation detected in the element input area, the one or more instructions can be loaded and specifically executed by the processor 901:
[0235] Based on the image input operation detected in the element input area, obtain a new object image containing the second object;
[0236] The first object in the target elements of the selected candidate information is replaced by the second object in the new object image to update the object image in the selected candidate information.
[0237] In another embodiment, the information editing panel is output when the selected candidate information is selected through the first selection operation; correspondingly, the one or more instructions can also be loaded and executed by the processor 901:
[0238] When any candidate information in the information selection window is selected, if the selected candidate information was selected through the second selection operation, then the selected candidate information is used as follow-up interaction information and is displayed in the information interaction interface.
[0239] In another embodiment, the one or more instructions may also be loaded and executed by the processor 901:
[0240] When the information selection window is output, an information refresh component related to the information selection window is displayed synchronously.
[0241] If the information refresh component is triggered, all or part of the candidate information in the information selection window will be updated.
[0242] In another embodiment, when the information refresh component for the information selection window is displayed synchronously, the one or more instructions can be loaded and executed by the processor 901:
[0243] At the display position of the information follow entry, an information refresh component related to the information selection window is used synchronously to replace the display of the information follow entry;
[0244] Alternatively, at the display position of the information follow entry, the information refresh component can be used to simultaneously cover the information follow entry.
[0245] In another embodiment, the one or more instructions may also be loaded and executed by the processor 901: when displaying the follow-up interactive information, the information selection window is closed simultaneously, and the information refresh component is canceled from display.
[0246] In another embodiment, the one or more instructions may also be loaded and executed by the processor 901:
[0247] If the follow interaction information is detected to be followed, a new information selection window is output. The new information selection window includes one or more candidate information associated with the target interaction information, or one or more candidate information associated with the follow interaction information.
[0248] When any candidate information in the new information selection window is selected, a third interactive information is displayed in the information interaction interface. The third interactive information is generated based on the candidate information selected in the new information selection window.
[0249] In another embodiment, the one or more instructions may also be loaded and executed by the processor 901:
[0250] The interactive follow-up entry point for the follow-up interactive information is displayed in the information interaction interface;
[0251] If the interactive follow entry is detected to be triggered, it is determined that the follow interaction information is being followed.
[0252] In another embodiment, the display format of the follow-up interactive information in the information interaction interface is the same as the display format of the target interactive information in the information interaction interface;
[0253] If the interactive scenario to which the target interactive information belongs is a non-specified scenario, then the information following entry is: the default following entry displayed using the system default style, and the following operation includes: a trigger operation for the default following entry;
[0254] If the interactive scenario to which the target interactive information belongs is a specified scenario, then the information following entry is: a differentiated following entry displayed in a differentiated style, wherein the differentiated style is determined according to the information content of the target interactive information; or, the information following entry includes: the differentiated following entry and the default following entry; and the triggering operation for the information following entry includes: the triggering operation for the differentiated following entry.
[0255] In another embodiment, if the information following entry is the alienated following entry or the default following entry, then the information selection window includes: baseline candidate information and one or more reference candidate information;
[0256] If the information following entry includes: the alienated following entry and the default following entry, then the information selection window includes: one or more reference candidate information;
[0257] The baseline candidate information refers to candidate information whose information content is the same as that of the target interaction information; the reference candidate information refers to candidate information whose information semantics match those of the target interaction information.
[0258] In another embodiment, the information selection window includes: the baseline candidate information and the one or more reference candidate information; correspondingly, the one or more instructions can also be loaded and executed by the processor 901:
[0259] If the selected candidate information is the reference candidate information, then a prompt message for the follow-up interaction information is displayed to indicate that the follow-up interaction information is obtained by following the target interaction information;
[0260] When the display duration of the prompt message exceeds the duration threshold, the prompt message will be canceled.
[0261] In another embodiment, the one or more instructions may also be loaded and executed by the processor 901:
[0262] After any candidate information is selected in the information selection window, a follow-up animation about the target interactive information is played in the information interaction interface;
[0263] After the follow animation finishes playing, the step of displaying follow interaction information in the information interaction interface is executed.
[0264] In another embodiment, when playing a follow-up animation about the target interactive information in the information interaction interface, the one or more instructions can be loaded and specifically executed by the processor 901:
[0265] At the first display position where the target interactive information is displayed in the information interaction interface, a follow icon for the target interactive information is displayed.
[0266] The follow icon of the target interactive information is controlled to move from the first display position to the second display position, where the second display position is the position used to display the follow interactive information; wherein, when the follow icon is moved to the second display position, it indicates that the follow animation playback has ended.
[0267] In another embodiment, the one or more instructions may also be loaded and executed by the processor 901:
[0268] At the second display position where the follow-up interactive information is located, the information identifier of the target interactive information is displayed;
[0269] The information identifier includes at least one of the following: the user identifier of the information sender of the target interactive information, and the information digest of the target interactive information.
[0270] In another embodiment, the target interactive information includes first text information; the information selection window includes at least one of the following: one or more reference candidate information under image information type, and one or more reference candidate information under text information type;
[0271] Any reference candidate information under the image information type includes: a descriptive image that reflects the information semantics of the first text information, an image obtained by fusing the descriptive image with the first text information, or an image obtained by fusing the descriptive image with approximate text information of the first text information;
[0272] Any reference candidate information under the text information type includes: second text information obtained by replacing the first string in the first text information with the second string; the first string includes one or more characters in the first text information, and the second string refers to: a string whose semantic similarity with the first string is greater than a threshold.
[0273] In this embodiment, when multiple consecutive interactive messages exist in the information interaction interface, an entry point for following the target interactive message can be displayed. If a user's triggering operation on this entry point is detected, one or more candidate messages can be provided to the user through an information selection window. The user can then select any candidate message to send the interactive message, effectively improving the efficiency and convenience of information interaction. When any candidate message in the information selection window is selected, follow-up interactive information generated based on the selected candidate message can be displayed in the information interaction interface. Since each candidate message in the information selection window is associated with the target interactive message, the follow-up interactive information generated based on the selected candidate message is related to the target interactive message. Displaying follow-up interactive information not only expresses the user's attitude towards following the target interactive message to a certain extent, but also enriches the display content of the information interaction interface, enhances the richness and variability of information interaction, thereby increasing the fun and surprise of user information interaction and ultimately increasing user stickiness.
[0274] It should be noted that, according to one aspect of this application, a computer program product or computer program is also provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and executes the computer instructions, causing the computer device to perform the aforementioned... Figure 2 or Figure 4The methods provided in various alternative ways in the embodiments of the information display method shown are as follows.
[0275] Furthermore, it should be understood that the above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application are still within the scope of this application.
Claims
1. An information display method, characterized in that, include: Display N interactive messages in the information interaction interface, where N is a positive integer greater than 1; If there are multiple consecutively repeated interactive messages among the N interactive messages, then the information follow-up entry of the target interactive message among the multiple interactive messages will be displayed in the information interaction interface; In response to a trigger operation on the information following entry, an information selection window is output; The information selection window includes one or more candidate information items associated with the target interactive information; When any candidate information in the information selection window is selected, follow-up interaction information and an interactive follow-up entry for the follow-up interaction information are displayed in the information interaction interface. The follow-up interaction information is generated based on the selected candidate information. The interactive follow-up entry is used to trigger the output of a new information selection window. The new information selection window includes one or more candidate information associated with the target interaction information, and / or one or more candidate information associated with the follow-up interaction information.
2. The method as described in claim 1, characterized in that, The selected candidate information includes at least: an editable target element; when any candidate information in the information selection window is selected, displaying follow-up interactive information in the information interaction interface includes: When any candidate information in the information selection window is selected, an information editing panel for the selected candidate information is output. The information editing panel includes an element input area and the target element in the selected candidate information. Based on the element editing operation detected in the element input area, update the target element displayed in the selected candidate information; If a confirmation operation is detected for the updated selected candidate information, the updated selected candidate information is used as follow-up interaction information and displayed in the information interaction interface.
3. The method as described in claim 2, characterized in that, The target element refers to text information including one or more characters, and the element editing operation includes: character input operation; The step of updating and displaying the target element in the selected candidate information based on the element input operation detected in the element input area includes: Based on the character input operation detected in the element input area, display one or more candidate characters; The target character is selected from one or more candidate characters according to the character selection operation, and the text information in the selected candidate information is updated using the target character.
4. The method as described in claim 2, characterized in that, The target element refers to: an object image including the first object; the element editing operation includes: an image input operation. The step of updating and displaying the target element in the selected candidate information based on the element input operation detected in the element input area includes: Based on the image input operation detected in the element input area, obtain a new object image containing the second object; The first object in the target elements of the selected candidate information is replaced by the second object in the new object image to update the object image in the selected candidate information.
5. The method according to any one of claims 2-4, characterized in that, The information editing panel is output when the selected candidate information is selected through the first selection operation; the method further includes: When any candidate information in the information selection window is selected, if the selected candidate information is selected through the second selection operation, the selected candidate information is used as follow-up interaction information and is displayed in the information interaction interface; the first selection operation and the second selection operation are different triggering operations for the selected candidate information.
6. The method as described in claim 1, characterized in that, The method further includes: When the information selection window is output, an information refresh component related to the information selection window is displayed synchronously. If the information refresh component is triggered, all or part of the candidate information in the information selection window will be updated.
7. The method as described in claim 6, characterized in that, The synchronous display component for refreshing information about the information selection window includes: At the display position of the information follow entry, an information refresh component related to the information selection window is used synchronously to replace the display of the information follow entry; Alternatively, at the display position of the information follow entry, the information refresh component can be used to simultaneously cover the information follow entry.
8. The method as described in claim 6 or 7, characterized in that, The method further includes: When displaying the follow-up interactive information, the information selection window is closed simultaneously, and the information refresh component is de-displayed.
9. The method according to any one of claims 1-4, characterized in that, The method further includes: If the follow interaction information is detected to be followed, the new information selection window is output. When any candidate information in the new information selection window is selected, new follow-up interaction information is displayed in the information interaction interface. The new follow-up interaction information is generated based on the candidate information selected in the new information selection window.
10. The method as described in claim 9, characterized in that, The method further includes: If the interactive follow entry is detected to be triggered, it is determined that the follow interaction information is being followed.
11. The method according to any one of claims 1-4, characterized in that, The display format of the follow-up interactive information in the information interaction interface is the same as the display format of the target interactive information in the information interaction interface; If the interactive scenario to which the target interactive information belongs is not a specified scenario, then the information following entry is: the default following entry displayed using the system default style; If the interactive scenario to which the target interactive information belongs is a specified scenario, then the information following entry is: a differentiated following entry displayed in a differentiated style, wherein the differentiated style is determined according to the information content of the target interactive information; Alternatively, the information following entry includes: the alienated following entry and the default following entry; and the triggering operation for the information following entry includes: the triggering operation for the alienated following entry.
12. The method as described in claim 11, characterized in that, If the information following entry is the alienated following entry or the default following entry, then the information selection window includes: baseline candidate information and one or more reference candidate information; If the information following entry includes: the alienated following entry and the default following entry, then the information selection window includes: one or more reference candidate information; The baseline candidate information refers to candidate information whose information content is the same as that of the target interaction information; the reference candidate information refers to candidate information whose information semantics match those of the target interaction information.
13. The method as described in claim 12, characterized in that, The information selection window includes: the baseline candidate information and the one or more reference candidate information; the method further includes: If the selected candidate information is the reference candidate information, then a prompt message for the follow-up interaction information is displayed to indicate that the follow-up interaction information is obtained by following the target interaction information; When the display duration of the prompt message exceeds the duration threshold, the prompt message will be canceled.
14. The method as described in claim 1, characterized in that, The method further includes: After any candidate information is selected in the information selection window, a follow-up animation about the target interactive information is played in the information interaction interface; After the follow animation finishes playing, the step of displaying follow interaction information in the information interaction interface is executed.
15. The method as described in claim 14, characterized in that, Playing a follow-up animation about the target interactive information in the information interaction interface includes: At the first display position where the target interactive information is displayed in the information interaction interface, a follow icon for the target interactive information is displayed. The follow icon of the target interactive information is controlled to move from the first display position to the second display position, where the second display position is the position used to display the follow interactive information; wherein, when the follow icon is moved to the second display position, it indicates that the follow animation playback has ended.
16. The method according to any one of claims 1-4, characterized in that, The method further includes: At the second display position where the follow-up interactive information is located, the information identifier of the target interactive information is displayed; The information identifier includes at least one of the following: the user identifier of the information sender of the target interactive information, and the information digest of the target interactive information.
17. The method as described in claim 1, characterized in that, The target interactive information includes first text information; the information selection window includes at least one of the following: one or more reference candidate information under image information type, and one or more reference candidate information under text information type; Any reference candidate information under the image information type includes: a descriptive image that reflects the information semantics of the first text information, an image obtained by fusing the descriptive image with the first text information, or an image obtained by fusing the descriptive image with approximate text information of the first text information; Any reference candidate information under the text information type includes: second text information obtained by replacing the first string in the first text information with the second string; the first string includes one or more characters in the first text information, and the second string refers to: a string whose semantic similarity with the first string is greater than a threshold.
18. An information display device, characterized in that, include: The display unit is used to display N interactive messages in the information interaction interface, where N is a positive integer greater than 1; The display unit is also used to display the information follow-up entry of the target interactive information among the multiple interactive information if there are multiple consecutively repeated interactive information among the N interactive information; The processing unit is configured to output an information selection window in response to a trigger operation on the information following entry. The information selection window includes one or more candidate information items associated with the target interactive information; The display unit is further configured to display follow-up interaction information in the information interaction interface when any candidate information in the information selection window is selected, wherein the follow-up interaction information is generated based on the selected candidate information; The display unit is also used to display an interactive follow-up entry about the follow-up interactive information in the information interaction interface; the interactive follow-up entry is used to trigger the output of a new information selection window, the new information selection window including one or more candidate information associated with the target interactive information, and / or one or more candidate information associated with the follow-up interactive information.
19. A terminal, comprising an input interface and an output interface, characterized in that, Also includes: A processor, adapted to implement one or more instructions; as well as, A computer storage medium storing one or more instructions, said one or more instructions being adapted to be loaded by the processor and executed as described in any one of claims 1-17.
20. A computer storage medium, characterized in that, The computer storage medium stores one or more instructions, which are adapted to be loaded by a processor and executed as described in any one of claims 1-17.
21. A computer program product comprising computer instructions, characterized in that, The computer instructions are stored in a computer-readable storage medium and are adapted to be read and executed by a processor of a computer device, causing the computer device to perform the information display method as described in any one of claims 1-17.
Citation Information
Patent Citations
Method and device for inputting picture
CN102662568A
Instant messaging session control method and device and electronic equipment
CN110022258A
View display control method and device, electronic equipment and storage medium
CN111694630A