Live broadcast interactive information display method, processing method, device and equipment

Abstract

The invention provides a live broadcast interactive information display method, processing method, device and equipment, and relates to the technical field of Internet live broadcast. The live broadcast interaction information display method in the disclosure comprises the steps of displaying reminding information based on a graphical user interface, the reminding information being generated based on interaction information of a live broadcast room; obtaining an interactive operation of the graphical user interface, wherein the interactive operation comprises a touch operation or a click operation; and determining the display position of the reminding information based on the distribution condition of the interactive operation in the graphical user interface.

Description

Technical Field

[0001] This specification relates to the field of Internet live streaming technology, and in particular to a method for displaying interactive live streaming information, a method for processing interactive live streaming information, an apparatus, a computer device, a computer-readable storage medium, and a computer program product. Background Technology

[0002] With the rapid development of mobile internet and the live streaming industry, the forms of online live streaming have also diversified. Some streamers use real-time screen recording for live streaming, such as game streaming, software tutorial streaming, and online hand-drawing tutorial streaming. In these types of live streams, the streamer can operate in a game or a specific software and present the live content by sharing their screen. When the streamer wants to view the interactive messages sent by the audience, they need to switch back to the live stream from the current game or software to view the interactive messages. This method requires the streamer to interrupt the ongoing live stream operation and switch interfaces to view the interactive messages, which not only affects the live stream quality but also increases the streamer's operational burden. Some live streaming software can also display the audience's interactive messages directly on the screen, but the display position of the interactive messages is fixed and may overlap with the streamer's operation position, thus interfering with the streamer's operation and increasing the rate of operational errors.

[0003] In view of this, some embodiments of this specification provide a method for displaying live interactive information, a method for processing live interactive information, an apparatus, a computer device, a computer-readable storage medium, and a computer program product, which aim to adaptively adjust the display position of live interactive information according to the broadcaster's operation, avoid the displayed information from interfering with the broadcaster's operation, and improve the broadcaster's live streaming experience. Summary of the Invention

[0004] This specification provides one or more embodiments of a live interactive information display method, the method comprising: displaying reminder information based on a graphical user interface, the reminder information being generated based on interactive information in the live stream; acquiring interactive operations of the graphical user interface, the interactive operations including touch operations or click operations; and determining the display position of the reminder information based on the distribution of the interactive operations on the graphical user interface.

[0005] According to one or more embodiments of this specification, the method for determining the display position of a reminder message based on the distribution of interactive operations in a graphical user interface includes: determining high-frequency operation areas and low-frequency operation areas in the graphical user interface based on the distribution of interactive operations in the graphical user interface; when the reminder message is displayed in the high-frequency operation area of ​​the graphical user interface, adjusting the display position of the reminder message so that the reminder message is displayed in the low-frequency operation area of ​​the graphical user interface.

[0006] According to one or more embodiments of this specification, a method for determining high-frequency and low-frequency operation areas in a graphical user interface (GUI) based on the distribution of interactive operations within the GUI includes: dividing the GUI into a preset number of unit areas; determining the operation frequency of each unit area based on the proportion of the number of interactive operations in each unit area to the total number of interactive operations within the GUI within a preset time period; and determining the high-frequency and low-frequency operation areas in the GUI based on the operation frequency of each unit area and a preset threshold.

[0007] According to one or more embodiments of this specification, adjusting the display position of a reminder message so that the reminder message is displayed in a low-frequency operation area of ​​a graphical user interface includes: adjusting the display position of the reminder message to a low-frequency operation area that is close to the original display position of the reminder message.

[0008] According to one or more embodiments of this specification, the method further includes: acquiring reminder information and the priority of the reminder information; determining the display order of the reminder information based on the priority of the reminder information; and displaying the reminder information based on a graphical user interface, including: displaying the reminder information based on the graphical user interface in the display order; wherein the priority of the reminder information is determined based on a preset evaluation dimension associated with the interactive information, and the preset evaluation dimension includes at least one of the following dimensions: the value of the interactive information, fan level, keyword hits, combo status, rarity, and timeliness.

[0009] According to one or more embodiments of this specification, the method for obtaining reminder information and the priority of reminder information includes: obtaining interactive information; determining the priority of interactive information based on a preset evaluation dimension associated with the interactive information, wherein different priorities correspond to different summary generation methods; generating reminder information based on the summary generation method corresponding to the priority of interactive information and the interactive information, and determining the priority of the reminder information based on the priority of interactive information.

[0010] According to one or more embodiments of this specification, the reminder information includes individual reminder information and aggregated reminder information. Based on the priority of the interactive information and the corresponding summary generation method, the generation of reminder information includes: processing high-priority interactive information separately to generate individual reminder information; and aggregating interactive information with lower priority than high priority to generate aggregated reminder information.

[0011] The method provided according to one or more embodiments of this specification further includes: determining the operation intensity of the graphical user interface based on the interactive operation of the graphical user interface; and adjusting the priority of interactive information based on the operation intensity of the graphical user interface.

[0012] According to one or more embodiments of this specification, the method for determining the operation intensity of a graphical user interface based on interactive operations of the graphical user interface includes: determining operation information based on interactive operations of the graphical user interface, wherein the operation information includes at least one of the following: operation frequency, operation speed, and whether multi-finger operation is used; and determining the operation intensity based on the operation information and the weight of the operation information.

[0013] According to one or more embodiments of this specification, a method for displaying reminder information based on a graphical user interface includes: determining multimodal configuration information corresponding to the reminder information based on the type of the live stream or the priority of interactive information; the multimodal configuration information includes at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information; displaying the reminder information on the graphical user interface based on the display configuration information; and outputting a multimodal reminder message corresponding to the reminder information based on the vibration configuration information and / or the audio configuration information; wherein, the vibration configuration information includes at least one of the following configuration information: no vibration mode, vibration enabled mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity; the audio configuration information includes at least one of the following configuration information: no sound effect, sound effect present, sound effect type, and sound effect file; the display configuration information includes at least one of the following configuration information: whether to delay display, delay display duration, transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

[0014] According to the method provided in one or more embodiments of this specification, the interactive information includes at least one of the following: bullet comments, gifts, likes, following the streamer, sharing the live stream, and entering the live stream.

[0015] One or more embodiments of this specification also provide a method for processing live interactive information, the method comprising: acquiring interactive information of a live room; generating reminder information based on the interactive information, the reminder information being displayed on a graphical user interface of a client, the display position of the reminder information on the graphical user interface being determined based on the distribution of interactive operations on the graphical user interface, the interactive operations including touch operations or click operations.

[0016] According to one or more embodiments of this specification, a method for generating reminder information based on interactive information includes: determining the priority of interactive information based on preset evaluation dimensions associated with the interactive information, wherein different priorities correspond to different summary generation methods; generating reminder information based on the summary generation method corresponding to the priority of the interactive information and the interactive information; wherein the preset evaluation dimensions include at least one of the following dimensions: value of interactive information, fan level, keyword hits, combo status, rarity, and timeliness.

[0017] According to one or more embodiments of this specification, the reminder information includes individual reminder information and aggregated reminder information. Based on the priority of the interactive information and the corresponding summary generation method, the generation of reminder information includes: processing high-priority interactive information separately to generate individual reminder information; and aggregating interactive information with lower priority than high priority to generate aggregated reminder information.

[0018] According to one or more embodiments of this specification, the method further includes: obtaining the operation intensity of the graphical user interface of the client, the operation intensity being determined based on the interactive operations of the graphical user interface; and adjusting the priority of interactive information based on the operation intensity of the graphical user interface.

[0019] According to one or more embodiments of this specification, the method further includes: determining multimodal configuration information corresponding to the reminder information based on the type of the live broadcast room or the priority of the interactive information. The multimodal configuration information is used to configure the display method of the reminder information displayed in the graphical user interface, or to configure the reminder method of the multimodal reminder message corresponding to the reminder information. The multimodal configuration information includes at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information. The vibration configuration information includes at least one of the following configuration information: no vibration mode, vibration enabled mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity. The audio configuration information includes at least one of the following configuration information: no sound effect, sound effect, sound effect type, and sound effect file. The display configuration information includes at least one of the following configuration information: whether to delay display, delay display duration, transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

[0020] One or more embodiments of this specification also provide a live interactive information display device, the device comprising: a reminder information display module, used to display reminder information based on a graphical user interface, the reminder information being generated based on interactive information in the live broadcast room; an interactive operation acquisition module, used to acquire interactive operations of the graphical user interface, the interactive operations including touch operations or click operations; and a display position determination module, used to determine the display position of the reminder information based on the distribution of interactive operations in the graphical user interface.

[0021] One or more embodiments of this specification also provide a live interactive information processing device, the device comprising: an interactive information acquisition module for acquiring interactive information of a live broadcast room; and a reminder information generation module for generating reminder information based on the interactive information, the reminder information being displayed on a graphical user interface of a client, the display position of the reminder information on the graphical user interface being determined based on the distribution of interactive operations on the graphical user interface, the interactive operations including touch operations or click operations.

[0022] This specification also provides a live interactive information processing system in one or more embodiments. The system includes a client and a server. The server is used to acquire interactive information from the live broadcast room and generate reminder information based on the interactive information. The client is used to display the reminder information based on the graphical user interface and acquire interactive operations of the graphical user interface. Based on the distribution of interactive operations on the graphical user interface, the client determines the display position of the reminder information. The interactive operations include touch operations or click operations.

[0023] One or more embodiments of this specification also provide a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it can implement the live interactive information display and live interactive information processing methods described in some embodiments of this specification.

[0024] One or more embodiments of this specification also provide a computer-readable storage medium storing computer instructions. When the computer instructions are executed by a processor, they can implement the live interactive information display method and the live interactive information processing method described in some embodiments of this specification.

[0025] One or more embodiments of this specification also provide a computer program product, including a computer program, which, when at least a portion of the computer program is executed by a processor, can implement the live interactive information display method and the live interactive information processing method described in some embodiments of this specification.

[0026] The beneficial effects that the embodiments of this specification may bring include, but are not limited to: displaying reminder information generated based on interactive information in the live broadcast room based on the graphical user interface, acquiring interactive operations of the graphical user interface, determining the display position of the reminder information based on the distribution of interactive operations in the graphical user interface, and thus adaptively adjusting the display position of the reminder information according to the broadcaster's operation, avoiding the displayed information from interfering with the broadcaster's operation and improving the broadcaster's live broadcast experience. By adjusting the reminder information from the high-frequency operation area to the low-frequency operation area, the display position of the reminder information is adaptively adjusted, avoiding the reminder information from obscuring the core area of ​​the broadcaster's operation. In live broadcast scenarios that require high concentration and precise control, such as game battles and software operations, the adaptive adjustment of the display position of the reminder information can prevent the broadcaster's visual focus and operation space from being disturbed, greatly reducing the broadcaster's error rate and ensuring the professionalism and smoothness of the broadcaster's content production. In addition, by adjusting the display position of the reminder information to a low-frequency operation area close to the original display position of the reminder information, "proximity avoidance" can be achieved, avoiding visual focus jumps. The broadcaster does not need to significantly adjust the visual focus or shift attention, thus focusing on the operation and reducing the error rate. The display order of reminders is determined based on their priority, and then displayed on the graphical user interface (GUI) according to this order. This prioritizes high-value reminders, allowing broadcasters to quickly access important content and avoid missing crucial information. By displaying reminders of different priorities in different locations on the GUI, broadcasters can quickly determine the importance of reminders based on their location without needing to read the content carefully, reducing visual distractions and information recognition burden. The priority of interactive information is determined based on a preset evaluation dimension associated with the interactive information. Reminders are generated based on the summary generation method corresponding to the priority of the interactive information and the interactive information itself. The priority of the reminders is further determined based on the priority of the interactive information, and a hierarchical summarization strategy is used to aggregate lower-priority interactive information while processing higher-priority interactive information separately. This preserves the complete display of high-priority events or questions, effectively reducing the occupation of the GUI by unimportant information and information noise, thus improving overall information reading efficiency. It should be noted that different embodiments may produce different beneficial effects. In different embodiments, the beneficial effects may be any one or a combination of the above, or any other possible beneficial effects. Attached Figure Description

[0027] This specification will be further described by way of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. The same numbers in the drawings denote the same structures or steps.

[0028] Figure 1 This is a schematic diagram of a live streaming operating environment according to some embodiments of this specification.

[0029] Figure 2 This is an exemplary flowchart illustrating a live interactive information display method according to some embodiments of this specification.

[0030] Figure 3 This is a schematic diagram of a graphical user interface according to some embodiments of this specification.

[0031] Figure 4 This is a schematic diagram of another graphical user interface according to some embodiments of this specification.

[0032] Figure 5 This is an exemplary flowchart illustrating a method for displaying reminder information according to some embodiments of this specification.

[0033] Figure 6 This is a schematic diagram of another graphical user interface according to some embodiments of this specification.

[0034] Figure 7 This is an exemplary flowchart illustrating the reminder information and priority acquisition method according to some embodiments of this specification.

[0035] Figure 8 This is a flowchart illustrating a method for prioritizing interactive information according to some embodiments of this specification.

[0036] Figure 9 This is an exemplary flowchart illustrating a live interactive information processing method according to some embodiments of this specification.

[0037] Figure 10 This is an exemplary block diagram of a live interactive information display device according to some embodiments of this specification.

[0038] Figure 11 This is an exemplary block diagram of a live interactive information processing apparatus according to some embodiments of this specification.

[0039] Figure 12 This is an exemplary block diagram of a live interactive information processing system according to some embodiments of this specification. Detailed Implementation

[0040] To more clearly illustrate the technical solutions of the embodiments in this specification, the embodiments will be described in detail below with reference to the accompanying drawings. Obviously, the content described below are some examples or embodiments of this specification. For those skilled in the art, without creative effort, the technical solutions or means disclosed in this specification can be applied to other scenarios based on this technical content.

[0041] It should be understood that the terms "system," "device," "unit," and / or "module" used in this specification are a method of distinguishing different components, elements, parts, sections, or assemblies at different levels. However, if other terms can achieve the same purpose, they may be replaced by other expressions.

[0042] Unless otherwise specified, the technical terms used to describe components, elements, etc. in this specification are not singular but may include plural. Generally speaking, terms such as "comprising" or "including" only indicate that explicitly identified steps, elements, or components are included, and these steps, elements, and components do not constitute an exclusive list, as the described method or apparatus may also include other steps or components.

[0043] This specification uses flowcharts to illustrate the operational steps performed by the apparatus or system of related embodiments. However, unless otherwise specified, the order in which these steps are described should not be construed as a limitation on the order of execution. Those skilled in the art can adjust the order of these steps based on the knowledge and information conveyed by the embodiments in this specification. Such adjustments include, but are not limited to, reversing the order of steps, merging multiple steps, and splitting a step.

[0044] Live streaming (or webcasting) is a technology that transmits audio and video content in real time over the internet. Hosts can record their live activities (such as performances, explanations, games, software tutorials, online drawing tutorials, etc.) using video capture devices or screen recording, then encode them through a live streaming platform and transmit them to viewers in different regions. Viewers can send interactive messages in the live stream (such as bullet comments, sending virtual gifts, liking, following the live stream, sharing the live stream, etc.). The live streaming platform can push these interactions back to the host, enabling real-time interaction between the host and viewers.

[0045] Figure 1 This is a schematic diagram illustrating a live streaming operating environment based on some embodiments of this specification. For example... Figure 1As shown, the live streaming environment 100 may include: a server 110, a broadcaster 120, a viewer 130, and a network 140. The server 110, broadcaster 120, and viewer 130 can transmit data via the network 140. During the live stream, the broadcaster 120 can send the live video data to the server 110 via the network 140. The server 110 can further process the live video data and then send it to the viewer 130 via the network 140 for the viewer's viewing. The viewer 130 can send interactive information (such as bullet comments, sending virtual gifts, liking, following the live stream, forwarding the live stream, etc.) to the server 110 via the network 140. The server 110 can send the interactive information to the broadcaster 120 via the network 140, or further process the interactive information and then send it to the broadcaster 120 via the network 140.

[0046] The server 110 can be a high-performance computer device used for storing, forwarding, configuring, analyzing, and processing interactive information. In some embodiments, the server 110 may include a local server or a cloud server. Depending on different service requirements, a local server corresponding to a specific region can be deployed in one or more regions. In some embodiments, the server 110 may include a background processing server and a streaming media server. The background processing server can be used to forward or further analyze and process interactive information. For example, the background processing server can send interactive information to the broadcaster 120, or further process the interactive information into reminder information and send the reminder information to the broadcaster 120. The background processing server can also be used to perform audio and video encoding, transcoding, encryption, and other processing on the video data of the broadcaster 120. The streaming media server can transmit data based on a streaming media transmission protocol. In some embodiments, the server 110 can be a single computer device or a computing cluster composed of multiple computer devices, thereby providing more powerful computing power and more efficient response to user service requests.

[0047] The broadcast client 120 can be used to display reminder information generated based on interactive information and determine the display position of the reminder information. In some embodiments, the broadcast client 120 may include, but is not limited to, terminal devices such as desktop computers, smartphones, laptops, tablets, smart TVs, and in-vehicle terminals. The broadcast client 120 may include a display screen and a processor, the display screen being used to present a graphical user interface. For example, the broadcast client 120 can present reminder information sent by the server 110 through the graphical user interface, the reminder information being generated based on interactive information in the live broadcast room; or, for another example, the broadcast client 120 can further process the interactive information sent by the server 110 into reminder information and present the reminder information through the graphical user interface. In some embodiments, the display screen may be separate from a human-machine interface device (e.g., a mouse), allowing users to interact on the graphical user interface through the human-machine interface device, and the processor of the broadcast client 120 can receive the interactive operations through the human-machine interface device on the graphical user interface. For example, the processor of the broadcast client 120 can receive click operations through the human-machine interface device on the graphical user interface. In other embodiments, the display screen may be a touch screen, which can receive interactive operations input by the user based on the graphical user interface. For example, the processor of the broadcaster terminal 120 can receive touch operations via a touchscreen on a graphical user interface. In some embodiments, the processor can also determine the display location of the reminder information based on the operations on the graphical user interface. For example, the processor of the broadcaster terminal 120 can determine the display location of the reminder information based on the distribution of interactive operations on the graphical user interface.

[0048] The viewer terminal 130 can be used to send interactive information to the server terminal 110. In some embodiments, the viewer terminal 130 may include, but is not limited to, terminal devices such as desktop computers, smartphones, laptops, VR (Virtual Reality) devices, tablets, smart TVs, and in-vehicle terminals.

[0049] Network 140 can be any form of wired or wireless network, or any combination thereof. As examples, network 140 can be one or more combinations of wired networks, fiber optic networks, telecommunications networks, internal networks, the Internet, local area networks (LANs), wide area networks (WANs), wireless local area networks (WLANs), metropolitan area networks (MANs), public switched telephone networks (PSTNs), and Bluetooth networks. Network 140 can have multiple access points, through which server 110, broadcaster 120, and viewer 130 can access network 140.

[0050] It should be noted that, Figure 1The schematic diagram of the live streaming operating environment shown is merely an example. The live streaming operating environment described in the embodiments of this specification is intended to more clearly illustrate the technical solutions of the embodiments of this specification and does not constitute a limitation on the technical solutions provided in the embodiments of this specification. For example, Figure 1 The number of server-side 110, broadcaster-side 120, and viewer-side 130 in this specification is merely illustrative and is not intended to limit the scope of patent protection of this application. Depending on the actual situation, any number of server-side 110, broadcaster-side 120, and viewer-side 130 may be included. Those skilled in the art will understand that with the development of live streaming technology and the emergence of new business scenarios, the technical solutions provided in the embodiments of this specification are also applicable to similar technical problems.

[0051] With the rapid development of mobile internet and the live streaming industry, the forms of online live streaming are also showing a diversified trend. Some streamers use real-time screen recording for live streaming. Examples include game streaming, software tutorial streaming, and online hand-drawing tutorial streaming. In these types of live streams, the streamer can operate within a game or a specific software and present the live content by sharing their screen. In some related implementations, when the streamer wants to view interactive messages sent by viewers, they need to switch back to the live stream from the current game or software to view the interactive messages. This method requires the streamer to interrupt the ongoing live stream operation and switch interfaces to view the interactive information, which not only affects the live stream quality but also increases the streamer's operational burden. Some live streaming software can also directly display viewers' interactive messages on the screen; however, the display position of the interactive messages is fixed and may overlap with the streamer's operating position, thus interfering with the streamer's operation and increasing the error rate.

[0052] To address this, some embodiments of this specification propose a method for displaying interactive information in live streaming. This method displays reminder information generated based on interactive information in the live streaming room through a graphical user interface (GUI), acquires the interactive operations of the GUI, determines the display position of the reminder information based on the distribution of the interactive operations in the GUI, and thus adaptively adjusts the display position of the reminder information according to the broadcaster's operations, avoiding interference with the broadcaster's operations and improving the broadcaster's live streaming experience.

[0053] Figure 2 This is an exemplary flowchart illustrating a live interactive information display method according to some embodiments of this specification. Figure 2 The illustrated process 200 can be executed by a computer device, for example, by a live interactive information display device 1000 deployed on the computer device. In some embodiments, the computer device can be a terminal device, for example, the computer device can be a terminal device such as... Figure 1 The broadcaster terminal 120 is shown. In other embodiments, part of process 200 may be handled by a client (e.g., Figure 1The execution is performed by a computer device (e.g., the broadcaster terminal 120 shown), while another part can be performed by a server (e.g., Figure 1 The server (110) shown is executed by the computer device. Figure 2 As shown, process 200 may include the following steps.

[0054] Step 210: Display reminder information based on the graphical user interface. In some embodiments, step 210 can be implemented by the reminder information display module 1010.

[0055] In some embodiments, the notification information can be generated based on the interactive information in the live stream. This interactive information can be interactive data generated from various interactive behaviors performed by viewers through their terminal devices (e.g., viewer terminal 130) during the live stream. For example, the interactive information can include at least one of the following: bullet comments, gifts, likes, following the streamer, sharing the live stream, and entering the live stream. Bullet comments can be comments entered by viewers in the live stream, such as text, emoticons, symbols, etc. Gifts can be virtual items (e.g., hearts, coins, diamonds, etc.) purchased and given to the streamer by viewers in the live stream; the value of a gift can vary depending on the purchase amount. For example, the value of a coin can be 1, and the value of a diamond can be 10. A like can be the act of a viewer expressing approval or support by clicking the like icon in the live stream. Following the streamer can be the act of a viewer subscribing to the streamer's live stream and becoming a fan. Sharing the live stream can be the act of a viewer forwarding the live stream link. Entering the live stream can be the act of a viewer entering the live stream. It is understood that in the specific implementation of this specification, the collection, use or processing of data (such as interactive information in the live broadcast room, preset evaluation dimensions associated with interactive information, etc.) is involved. When one or more embodiments of this specification are applied to the implementation of specific products or technologies, permission or consent from the data subject is required. Moreover, the collection, use or processing of related data must strictly comply with the relevant laws, regulations and standards of the relevant countries and regions, such as the data source and implementation location. De-identification technology is used to ensure that the final data used is de-identified data that has been securely processed, thereby protecting the rights and interests of the data subject and data security.

[0056] In some embodiments, the computer device can obtain reminder information from the server and display the reminder information based on a graphical user interface. For example, the reminder information may be "XXX sent 1 gold coin," "XXX: 666," "XXX liked the streamer's post," "XXX followed the streamer," "XXX entered the live stream," etc., where "XXX" can be a viewer identifier, such as a viewer's nickname. In other embodiments, the computer device can obtain interaction information from the server and generate reminder information based on the interaction information. For a detailed explanation of this part, please refer to the description in flowchart 700 below.

[0057] In some embodiments, a computer device may display a floating layer based on a graphical user interface (GUI) and display reminder information within the floating layer. The floating layer may be a movable interface component drawn on the GUI to carry the reminder information. The computer device may configure the visual style information of the floating layer, which may include the floating layer's display size, display position, transparency, background color, border style, animation effects, special effects, and the style of the text carried by the floating layer (such as font color and font size). For example, the display size of the floating layer may be set to a default preset size, which may occupy less than or equal to 5% of the GUI display area. This preset size may also be the size of the GUI or the screen size. The floating layer may have a certain degree of transparency, while the text within the floating layer may be opaque.

[0058] In some embodiments, the graphical user interface may display one or more floating layers, and one or more reminder messages may be displayed in a floating layer. The display time of the reminder message may be a preset time. When the display time of the reminder message exceeds the preset time, the computer device may remove the reminder message from the graphical user interface and display the next reminder message.

[0059] Step 220: Obtain the interactive operations of the graphical user interface. In some embodiments, step 220 can be implemented by the interactive operation acquisition module 1020.

[0060] In some embodiments, interactive operations may include touch operations or click operations. For example, touch operations may include the broadcaster tapping or moving on a touchscreen. Click operations may include the broadcaster tapping or dragging on a graphical user interface via a human-computer interface device (such as a mouse).

[0061] In some embodiments, the computer device may listen for touch events (or click events) in a graphical user interface and record data related to the touch events (or click events). For example, the data related to the touch events (or click events) may include the coordinates of the touch event (or click event) within the graphical user interface and the timestamp information of when the touch event (or click event) occurred. The computer device may also periodically clean up data exceeding a time window based on the timestamp information of the touch events (or click events), for example, setting the time window to 10 seconds and automatically cleaning up touch events (or click events) and related data that are more than 10 seconds away from the current time.

[0062] Step 230: Determine the display location of the reminder information based on the distribution of interactive operations in the graphical user interface. In some embodiments, step 230 can be implemented by the display location determination module 1030.

[0063] In some embodiments, the computer device can determine high-frequency and low-frequency operation areas in the graphical user interface (GUI) based on the distribution of interactive operations. When a notification message is displayed in a high-frequency operation area, the computer device can adjust the display position of the notification message to place it in a low-frequency operation area. The high-frequency operation area can be an area where the streamer frequently and densely performs interactive operations such as touching or clicking on the GUI. For example, in game streaming, the high-frequency operation area could be the virtual joystick area for controlling game character movement or the button area for releasing skills. The low-frequency operation area can be an area where the streamer performs fewer interactive operations such as touching or clicking on the GUI. For example, in game streaming, the low-frequency operation area could be an area other than the joystick area and the button area.

[0064] In some embodiments, the computer device may divide the graphical user interface into a preset number of unit areas, and determine the operation frequency of each unit area based on the proportion of the number of interactive operations in each unit area to the total number of interactive operations in the graphical user interface within a preset time period. Based on the operation frequency of each unit area and a preset threshold, high-frequency operation areas and low-frequency operation areas in the graphical user interface are determined. For example, the computer device may divide the graphical user interface into unit areas of M rows × N columns. Figure 3 This is a schematic diagram of a graphical user interface according to some embodiments of this specification, such as... Figure 3 As shown, a floating layer appears at the top of the graphical user interface, containing the notification message "Generous viewers send super rockets." The graphical user interface (GUI) is divided into a 10×10 grid, resulting in 100 unit grids. Each unit grid corresponds to a rectangular area on the GUI, and the floating layer carrying the notification information can occupy multiple unit grids simultaneously. Alternatively, the computer device can divide the grid according to the size of the floating layer carrying the notification information, ensuring that the size of a single grid is greater than or equal to the size of the floating layer, and the floating layer carrying the notification information can occupy a single unit grid. For example, the computer device can count the number of interactive operations occurring within each unit grid within a preset time period (e.g., within 10 seconds) based on the coordinate position of touch events (or click events) on the GUI. , , … The total number of interactive operations (b) within the graphical user interface is determined based on the number of interactive operations within each cell grid, and the number of interactive operations within each cell grid is then determined separately. , , … The ratio of the total number b of interactive operations within the graphical user interface / b、 / b、 / b… / b, thereby determining the operating frequency of each cell grid. In some embodiments, the computer device may compare the operating frequency of each cell grid with a preset threshold, identifying cell grids with operating frequencies greater than or equal to the preset threshold as high-frequency operating regions, and cell grids with operating frequencies less than the preset threshold as low-frequency operating regions. The graphical user interface may include multiple high-frequency operating regions and multiple low-frequency operating regions. For example... Figure 3 As shown, the areas marked with the " / / / " icon can be considered high-frequency operation areas, while the other areas can be considered low-frequency operation areas. It should be understood that... Figure 3 The " / / / " icon, dashed lines, and pointing lines in the diagram are merely identifiers to aid understanding and clarify the annotated objects in the graphical user interface. They should not be considered part of the graphical user interface itself. Similar icons, dashed lines, or pointing lines will also appear in subsequent graphical user interface diagrams, serving a similar purpose, and will not be repeated hereafter.

[0065] In some embodiments, when a reminder message is displayed in a high-frequency operation area of ​​the graphical user interface, the computer device can adjust the display position of the reminder message to a low-frequency operation area closer to the original display position. In some embodiments, the computer device can determine whether the reminder message is displayed in a high-frequency operation area of ​​the graphical user interface by judging whether there is overlap between the high-frequency operation area and the area occupied by the floating layer carrying the reminder message. For example, when the high-frequency operation area and the area occupied by the floating layer carrying the reminder message completely overlap, the computer device can determine that the reminder message is displayed in a high-frequency operation area of ​​the graphical user interface. When the high-frequency operation area and the area occupied by the floating layer carrying the reminder message partially overlap, the computer device can also calculate the ratio of the overlapping area to the area occupied by the floating layer. This ratio can represent the degree of overlap between the high-frequency operation area and the area occupied by the floating layer carrying the reminder message. When the ratio of the overlapping area to the area occupied by the floating layer is greater than a preset ratio, it indicates that the overlap between the high-frequency operation area and the area occupied by the floating layer carrying the reminder message is severe, and the computer device can determine that the reminder message is displayed in a high-frequency operation area of ​​the graphical user interface.

[0066] In some embodiments, when the floating layer carrying the reminder information occupies a single cell grid, and that single cell grid is a high-frequency operation area, the computer device can adjust the display position of the floating layer to a cell grid that is closer to the floating layer and is determined to be a low-frequency operation area. For example, the computer device can calculate the distance between the center point of the cell grid occupied by the floating layer and the center points of each cell grid determined to be a low-frequency operation area, determine the cell grid with the shortest distance (or one of a plurality of cell grids with a distance less than a preset value) as the low-frequency operation area closest to the floating layer, and adjust the display position of the floating layer to that cell grid with the shortest distance.

[0067] In some embodiments, when the floating layer carrying the reminder information occupies multiple cell grids simultaneously, and there are high-frequency operation areas within these multiple cell grids, the computer device can determine a virtual detection area of ​​the same size based on the dimensions of the floating layer. This virtual detection area is used to simulate the various positions the floating layer may occupy in the graphical user interface. The computer device can control the virtual detection area to move from the current position of the floating layer in a preset direction and with a preset step size. After each movement, it can determine whether the area within the virtual detection area overlaps with the high-frequency operation area. When the area within the virtual detection area does not overlap with the high-frequency operation area, it can be determined that the area within the virtual detection area is a low-frequency operation area close to the floating layer. The movement of the virtual detection area is then stopped, and the floating layer is moved to the area where the virtual detection area is located. The computer device can also determine multiple areas that do not overlap with the high-frequency operation area by moving the virtual detection area multiple times, obtaining multiple candidate areas. Based on the distance between the floating layer and the multiple candidate areas, it can determine the low-frequency operation area close to the floating layer. The preset direction can be a vertical or horizontal direction, and the preset step size can be the length or width of a single (or N, where N can be an integer) cell grid. In some embodiments, the computer device can also smoothly move the suspending layer to a low-frequency operation area, thereby making the position change of the reminder information more fluid and natural.

[0068] In some embodiments, when the size of the floating layer occupies the entire screen size, the display position of the reminder information can be adjusted only to move the reminder information from a high-frequency operation area to a low-frequency operation area. The reminder information can occupy a display area in the graphical user interface. For example, when the display area of ​​the reminder information occupies a single cell grid, and that single cell grid is a high-frequency operation area, the computer device can adjust the display area of ​​the reminder information to a cell grid that is closer to that display area and is determined to be a low-frequency operation area. When the display area of ​​the reminder information simultaneously occupies multiple cell grids, and high-frequency operation areas exist in these multiple cell grids, the computer device can determine a virtual detection area of ​​the same size based on the size of the display area of ​​the reminder information. This virtual detection area is used to simulate the possible locations of the reminder information's display area in the graphical user interface. The computer device can control the virtual detection area to move from the current position of the reminder information display area to a preset direction and a preset step size, and determine whether the area within the virtual detection area overlaps with the high-frequency operation area after each movement. When the area within the virtual detection area does not overlap with the high-frequency operation area, it can be determined that the area within the virtual detection area is a low-frequency operation area close to the reminder information display area, the movement of the virtual detection area is stopped, and the reminder information display area is moved to the area where the virtual detection area is located. Figure 4 This is a schematic diagram of another graphical user interface according to some embodiments of this specification. For example, before adjusting the display position of the reminder information, the floating layer carrying the reminder information can be displayed as follows: Figure 3 The top of the graphical user interface shown overlaps or partially overlaps with the high-frequency operation area. The computer device can determine a virtual detection area of ​​the same size based on the dimensions of the floating layer. Starting from the current position of the floating layer, the virtual detection area is moved vertically downwards in steps equal to the width of a single grid cell. After moving one step, if the computer device determines that the area within the virtual detection area does not overlap with the high-frequency operation area, it stops moving the virtual detection area and moves the floating layer to the area where the virtual detection area is located. The display position of the moved floating layer can be as follows: Figure 4 As shown.

[0069] In some embodiments of this specification, the display position of the reminder information is adaptively adjusted by moving it from a high-frequency operation area to a low-frequency operation area. This prevents the reminder information from obscuring the core area of ​​the broadcaster's operation. In live streaming scenarios requiring high concentration and precise control, such as gaming and software operation, adaptively adjusting the display position of the reminder information ensures that the broadcaster's visual focus and operating space are not disturbed, significantly reducing the error rate and ensuring the professionalism and smoothness of the broadcast content. Furthermore, adjusting the display position of the reminder information to a low-frequency operation area closer to its original position achieves "proximity avoidance," preventing visual focus jumps. The broadcaster does not need to significantly adjust their visual focus or shift their attention, allowing them to concentrate on the operation and reducing the error rate.

[0070] In some embodiments, when no low-frequency operation area is available in the graphical user interface, the computer device can also adjust the visual style information of the floating layer. For example, increasing the transparency of the floating layer or reducing its size can reduce its impact on the broadcaster's operations.

[0071] In some embodiments, when there are multiple reminder messages, the computer device can also determine the display order of the reminder messages in the graphical user interface based on their priority. Figure 5 This is an exemplary flowchart illustrating a method for displaying reminder information according to some embodiments of this specification. Figure 5 The process 500 shown can be executed by a computer device, for example, by a live interactive information display device 1000 deployed on a computer device. Figure 5 As shown, in some embodiments, process 500 may include the following steps.

[0072] Step 510: Obtain the reminder information and its priority. In some embodiments, step 510 can be implemented by the display order determination module 1040.

[0073] In some embodiments, the priority of a reminder message can be represented by a preset level. For example, the priority of a reminder message may include "high priority", "medium priority", and "low priority". The priority of a reminder message can also be represented by a score, with a higher score indicating a higher priority. The priority of a reminder message can also be represented by both a preset level and a score. For example, the priority of a reminder message may include "high priority 35 points", "high priority 30 points", "medium priority 20 points", and "low priority 10 points".

[0074] In some embodiments, the computer device can obtain reminder information and its priority from the server. The reminder information can be generated based on interactive information from the live stream, and its priority can be determined based on a preset evaluation dimension associated with the interactive information. The generation of the reminder information and the calculation of its priority can be obtained by the server processing the interactive information from the live stream and then sending the reminder information and its priority to the computer device. For a detailed explanation of this part, please refer to the description of process 900 below.

[0075] In some embodiments, the computer device may also obtain interactive information from the server and generate reminder information and determine the priority of the reminder information based on the interactive information. The generation of reminder information and the calculation of the priority of reminder information can be obtained by the computer device after processing the interactive information from the server. For a detailed explanation of this part, please refer to the description in process 700 below.

[0076] Step 520: Determine the display order of the reminder information based on its priority. In some embodiments, step 520 can be implemented by the display order determination module 1040.

[0077] In some embodiments, the computer device can create and maintain a rendering queue, which can be used to schedule and manage reminder information to control the timing and display order of reminder information in the graphical user interface. After obtaining the reminder information and its priority, the computer device can determine the sorting position of the reminder information in the rendering queue according to its priority, and add the reminder information to the rendering queue according to its sorting position. The sorting of the reminder information in the rendering queue is the display order of the reminder information. In some embodiments, the rendering queue can be configured with a capacity limit. When a new reminder information needs to be added to the rendering queue, if the rendering queue is full, the computer device can delete the reminder information with the lowest priority according to the priority of the new reminder information and the priorities of the reminder information in the rendering queue. For example, if the priority of the new reminder information is lower than the priority of the reminder information in the rendering queue, the new reminder information can be discarded directly without being added to the rendering queue. If the priority of the new reminder information is higher than the lowest priority of the reminder information in the rendering queue, the lowest priority reminder information in the rendering queue can be removed, and the sorting position of the new reminder information in the rendering queue can be determined according to its priority, and the new reminder information can be added to the rendering queue according to its sorting position.

[0078] Step 530: Display reminder information based on the graphical user interface according to the display order. In some embodiments, step 530 can be implemented by the reminder information display module 1010.

[0079] In some embodiments, the graphical user interface may display one or more floating layers, and one floating layer may display one or more reminder messages. For example, the graphical user interface may display a single floating layer that simultaneously displays multiple reminder messages with different priorities. For example, the graphical user interface may display multiple floating layers, with reminder messages of the same priority displayed in the same floating layer, and reminder messages of different priorities displayed in different floating layers. Figure 6 This is a schematic diagram of another graphical user interface according to some embodiments of this specification. For example... Figure 6 As shown, the graphical user interface can display floating layers 6-1 and 6-2. Floating layer 6-1 can display high-priority reminders, while floating layer 6-2 can display medium-priority and low-priority reminders. By displaying reminders of different priorities in different locations within the graphical user interface, the broadcaster can quickly determine the importance of reminders based on their location without needing to carefully read the content, thus reducing visual distractions and information recognition burden. In some embodiments, when the floating layer occupies the entire screen size, multiple reminders can be displayed within it. For example, multiple reminders can be displayed simultaneously in one display area of ​​the floating layer. Alternatively, multiple reminders of different priorities can be displayed simultaneously in multiple display areas of the floating layer.

[0080] In some embodiments, the computer device may display reminder messages in the graphical user interface according to the display order of the reminder messages in the rendering queue. For example, the first message in the rendering queue is a high-priority reminder message a1, the second message is a high-priority reminder message a2, and the third message is a medium-priority reminder message a3. Figure 6 As shown, the high-priority reminder message in suspended layer 6-1 is "A wealthy viewer sent a super rocket". The medium-priority notification message "+10 bullet comments" in floating layer 6-2 is removed from the graphical user interface after 5 seconds of display. There are empty display spaces in floating layers 6-1 and 6-2. Computer devices can first... Figure 6The floating layer 6-1 displays high-priority reminder information a1. After reminder information a1 is displayed, high-priority reminder information a2 is displayed in floating layer 6-1. After reminder information a2 is displayed, medium-priority reminder information a3 is displayed in floating layer 6-2. Alternatively, the computer device can display high-priority reminder information a1 in floating layer 6-1 and medium-priority reminder information a3 in floating layer 6-2. After high-priority reminder information a1 is displayed in floating layer 6-1, high-priority reminder information a2 is displayed in floating layer 6-1. By determining the display order of reminder information based on its priority and displaying reminder information according to the display order based on the graphical user interface, high-priority, high-value reminder information is displayed first, making it easier for broadcasters to obtain important content first and avoiding missing key information.

[0081] In some embodiments, the computer device may obtain interactive information from the server, and generate reminder information and determine the priority of the reminder information based on the interactive information. Figure 7 This is an exemplary flowchart illustrating the reminder information and priority acquisition method according to some embodiments of this specification. Figure 7 The illustrated process 700 can be executed by a computer device, for example, by the reminder information and priority acquisition module 1050 in a live interactive information display device 1000 deployed on a computer device. Figure 7 As shown, in some embodiments, process 700 may include the following steps.

[0082] Step 710: Obtain interactive information.

[0083] In some embodiments, the computer device can obtain interactive information from the server. This interactive information may include at least one of the following: bullet comments, gifts, likes, following the streamer, sharing the live stream, and entering the live stream. Bullet comments can be comments entered by viewers in the live stream, such as text, emoticons, and symbols. Gifts can be virtual items (such as hearts, coins, diamonds, etc.) purchased and sent to the streamer by viewers in the live stream; the value of gifts varies depending on the purchase amount. Likes can be the act of viewers clicking the like icon in the live stream to express their approval or support. Following the streamer can be the act of viewers subscribing to the streamer's live stream and becoming fans. Sharing the live stream can be the act of viewers forwarding the live stream link. Entering the live stream can be the act of viewers entering the live stream.

[0084] In some embodiments, the interactive information may include interactive events and associated information. Taking a gift as an example, the interactive information may include the interactive event type (e.g., "gift"), audience identifiers (e.g., audience UID and audience nickname), gift identifier (e.g., "10001"), gift name (e.g., "rocket"), gift combo status (e.g., "triple combo"), gift price (e.g., "1000"), event timestamp, fan level (e.g., "25"), fan badge (e.g., "diehard fan"), and whether it is a VIP, etc. After receiving the interactive information, the computer device can further perform data standardization processing, such as converting the interactive information into a preset format and removing redundant fields.

[0085] In some embodiments, the computer device can create and maintain an interactive information queue, which can be used for scheduling and managing interactive information. The interactive information queue can be configured with a capacity limit, for example, a first preset queue length. When the computer device receives new interactive information, if the queue length of the interactive information queue is less than the first preset queue length, the new interactive information can be directly added to the interactive information queue. Specifically, when controlling the queuing of interactive information, the computer device can determine the sorting position of the interactive information in the interactive information queue based on its initial priority. For example, the initial priority of a bullet comment can be 1, the initial priority of liking and following a streamer can be 0.5, and the initial priority of a gift can be the gift price / 100. When the queue length of the interactive information queue is greater than or equal to the first preset queue length, if the initial priority of the new interactive information is greater than the lowest initial priority of the interactive information in the interactive information queue, the interactive information with the lowest initial priority in the interactive information queue can be removed, and the new interactive information can be inserted into the interactive information queue according to its initial priority; if the initial priority of the new interactive information is less than the lowest initial priority of the interactive information in the interactive information queue, the new interactive information can be directly discarded. In some embodiments, the computer device can also utilize a natural language processing (NLP) model to identify repetitive interactive information within a preset time period, discard the repetitive interactive information, and record the frequency of occurrence of the repetitive interactive information. The NLP model can be a pre-trained language understanding model based on the Transformer architecture. For example, when the computer device receives a new bullet comment (danmu), it can use the NLP model to compare the bullet comment content with other bullet comment content within a preset time period, determine the similarity between the bullet comment content and other bullet comment content, and discard the bullet comment if the similarity is greater than a preset similarity, without adding it to the interactive information queue. In some embodiments, the computer device can also utilize the NLP model to identify the emotion of the interactive information and output an emotion label for the interactive information (e.g., bullet comments). For example, emotion labels can include positive, negative, and neutral. For interactive information with a negative emotion label, the computer device can discard the interactive information without adding it to the interactive information queue.

[0086] Step 720: Determine the priority of interactive information based on the preset evaluation dimensions associated with the interactive information.

[0087] In some embodiments, the preset evaluation dimensions include at least one of the following dimensions: the value of the interactive information, fan level, keyword hits, combo count, rarity, and timeliness. The value of the interactive information can be its economic contribution to the streamer. For example, the value of the interactive information can be the price of a gift. Fan level can be the level of a fan following the streamer. For example, level 1 fan, level 10 fan, level 50 fan, etc. Keyword hits can be keywords in the bullet comments that match preset keywords. For example, the computer device can be configured with a keyword library, which can include preset keywords of different categories. For example, the keyword library can include positive high-value keywords (e.g., "amazing," "666," "awesome," "strong," "too strong," "teaching"), question-type keywords ("how," "why," "how," "how," "how"), and suggestion-type keywords ("suggestion," "can try," "want or not"), etc. The computer device can match the bullet comments with the keywords in the keyword library to determine the successfully matched keywords. Combo status can refer to the number of consecutive gifts sent. For example, when a viewer sends three identical gifts in a row during a live stream, the combo status is called a triple combo. Rarity refers to the rarity of interactive information. For example, for gifts, gold coins have a rarity of 0, while a sports car has a rarity of 50. For interactive information such as bullet comments, likes, entering the live stream, and sharing the live stream, the rarity of the interactive information can be determined based on the fan level. For example, the higher the fan level, the higher the rarity of the interactive information when the fan performs interactive actions such as sending bullet comments, liking, entering the live stream, or sharing the live stream. Timeliness can be used to evaluate the time value of interactive information; the closer the interactive information is to the current time, the higher its timeliness.

[0088] In some embodiments, the computer device may determine the importance score of the interactive information based on the scores and weights of preset evaluation dimensions associated with the interactive information, and determine the priority of the interactive information based on the importance score. The following describes in detail how the priority of the interactive information is determined.

[0089] In some embodiments, the pre-defined evaluation dimensions may include a value score for the interactive information, a fan level score, a keyword hit score, a combo score, a rarity score, and a timeliness score. For example, the value score for the interactive information can be represented as gift_score= (gift_value+1)*10, where gift_score represents the gift's value score, and gift_value represents the gift's price. For example, the gift value score for a 1 yuan gift could be... (1+1)×10=3 points, the gift value of a 100 yuan gift can be... (100+1)×10=20 points, the gift value of a 1000 yuan gift can be... (1000+1)×10=30 points. Fan level score can be represented as fan_score=fan_level*2. Here, fan_score represents the fan level score, and fan_level represents the fan level. For example, a level 1 fan has a fan level score of 1×2=2 points, a level 10 fan has a fan level score of 10×2=20 points, and a level 50 fan has a fan level score of 50×2=100 points. Keyword hit score can be represented as keyword_score=number of hit keywords*5. Here, keyword_score represents the score for each hit keyword. For example, if a viewer sends the comment "666, how is it so strong?", and this comment matches the three preset keywords "666", "how", and "strong" in the keyword database, then the keyword hit score for this comment is 3×5=15 points. Combo score can be represented as combo_score=combo_count*3. Here, combo_score represents the score for each combo, and combo_count represents the number of combos. For example, for a single gift with 0 hits, the corresponding hit score is 0×3=0 points; for a three-hit gift with 3 hits, the corresponding hit score is 3×3=9 points; and for a ten-hit gift with 10 hits, the corresponding hit score is 10×3=30 points. The rarity score can be a preset score corresponding to the interactive information; for example, gold coins have a rarity score of 0, and a sports car has a rarity score of 50. A fan with a fan level of 80 who performs interactive actions such as sending a comment, liking, entering the live stream, or sharing the live stream for the first time in the live stream will receive a rarity score of 20 points. The timeliness score can be expressed as time_score=100e^(-λ*Δt), where time_score represents the timeliness score, λ represents the decay coefficient, e^(-λ*Δt) represents e raised to the power of (-λ*Δt), for example, λ=0.001, Δt=current time – timestamp of the interaction information. As time goes by, Δt gradually increases from 0, and the timeliness score gradually decreases from 100.

[0090] In some embodiments, the weights of the preset evaluation dimensions can be preset weights. The importance score of interactive information can be expressed as Score = W1 × Value score of interactive information + W2 × Fan level score + W3 × Keyword hit score + W4 × Combo score + W5 × Rarity score + W6 × Timeliness score. For example, the weight W1 corresponding to the value score of interactive information can be set to 0.4, the weight W2 corresponding to the fan level score can be set to 0.2, the weight W3 corresponding to the keyword hit score can be set to 0.15, the weight W4 corresponding to the combo score can be set to 0.1, the weight W5 corresponding to the rarity score can be set to 0.1, and the weight W6 corresponding to the timeliness score can be set to 0.05.

[0091] In some embodiments, the computer device can use the importance score of the interactive information as its priority; the higher the importance score, the higher the priority of the interactive information. In other embodiments, the computer device can also compare the importance score of the interactive information with a preset score threshold to determine the priority level of the interactive information. For example, when the importance score of the interactive information is greater than a first preset score threshold, the priority of the interactive information is determined to be high priority; when the importance score of the interactive information is not less than a second preset score threshold and not greater than the first preset score threshold, the priority of the interactive information is determined to be medium priority; when the importance score of the interactive information is less than the second preset score threshold, the priority of the interactive information is determined to be low priority. The first preset score threshold can be greater than the second preset score threshold. For example, the first preset score threshold is 25 points, and the second preset score threshold is 10 points. In some embodiments, the preset score threshold can also be dynamically adjusted. For example, the broadcaster can adjust the value of the preset score threshold in the configuration page of the live broadcast room to adjust the priority of the interactive information. In other embodiments, the computer device can also use both the importance score and the priority level of the interactive information as the priority of the interactive information. For example, the priority of the interactive information can include "high priority 35 points", "high priority 30 points", "medium priority 20 points", "low priority 10 points", etc.

[0092] In some embodiments, the computer device can adjust the priority of interactive information based on the queue length in the interactive information queue. For example, when the queue length in the interactive information queue is greater than a second preset queue length but less than a first preset queue length, the computer device can increase the value of a first preset scoring threshold, thereby raising the criterion for determining high-priority interactive information. For instance, the value of the first preset scoring threshold can be adjusted from 25 points to 30 points.

[0093] In some embodiments, when no interactive information is received within a preset time, the computer device may also display encouraging information in the graphical user interface, such as "No new interaction, focus on the game..." and lower the value of the second preset rating threshold, such as adjusting the value of the second preset rating threshold from 10 points to 5 points.

[0094] In some embodiments, when the interactive information is a preset interactive information, the computer device can also directly elevate the priority of the preset interactive information to the preset priority. For example, when a bullet comment hits a preset keyword (such as question-type keywords like "how" or "why"), the computer device can directly determine the priority of the bullet comment as medium priority. For example, if the interactive information is following a streamer for the first time, the computer device can directly determine the priority corresponding to following a streamer for the first time as medium priority. In some embodiments, the computer device can also use a natural language processing model to identify the intent of the interactive information and output the intent label of the interactive information (such as bullet comments). For example, the intent label may include asking a question, making a suggestion, praising, chatting, etc., and the computer device can directly determine the priority of interactive information with the intent labels "asking a question" and "making a suggestion" as medium priority. In some embodiments, when the same viewer is detected to send gifts multiple times within a preset time, the computer device can also accumulate the importance scores corresponding to the multiple gifts sent by the viewer, thereby comprehensively calculating the importance score of the viewer's interactive information.

[0095] Step 730: Generate reminder information based on the summary generation method corresponding to the priority of interactive information and the interactive information, and determine the priority of the reminder information based on the priority of interactive information.

[0096] In some embodiments, the summary generation method for high-priority interactions can be to process the interactive information individually to generate summary content, while the summary generation method for medium-priority interactions can be to aggregate the interactive information to generate summary content. The generated summary content can be a reminder message, which may include individual reminder messages and aggregated reminder messages. The computer device can process high-priority interactive information individually to generate individual reminder messages, and aggregate interactive information with lower priority to generate aggregated reminder messages.

[0097] In some embodiments, the computer device can process interactive information individually or aggregated based on a preset template library. The preset template library may contain templates for interactive information of different priorities. For example, for high-priority interactive information templates, a template for a regular gift might be "{sender_name} send {gift_type} × {count}", a template for a combo gift might be "{sender_name} {combo} combo send {gift_type}", and a template for a rare gift might be "{sender_name} send {gift_type}". The template for bullet comments can be "{sender_name}:{content}". Here, sender_name can be the viewer's nickname, gift_type can be the gift name, count can be the number of hits, and content can be the bullet comment content. For example, in a high-priority interaction message, sender_name can be "Enthusiastic Fan", gift_type can be "Rocket", and count can be "3". The computer device can then process this high-priority interaction message separately using the template for ordinary gifts, generating a separate reminder message such as "Enthusiastic Fan sent 3 Rockets". For medium-priority interaction messages, the template for bullet comments can be "+{N} bullet comments", the template for likes can be "{N} people liked", and the template for gifts can be "Received {N} small gifts". The computer device can aggregate medium-priority interaction messages of the same type within a preset time period according to the type of interaction message, and generate aggregated reminder messages based on the templates of the corresponding medium-priority interaction messages. For example, if 3 viewers like a post within 1 second, the aggregated notification message could be "3 people liked this post". For low-priority interaction messages, the template could be "Received {N} interactions". The computer device can aggregate all low-priority interaction messages within a preset time period and generate aggregated notification messages based on the templates for these low-priority messages. For example, if 3 viewers enter the live stream and 1 viewer shares the live stream within 10 seconds, the aggregated notification message could be "Received 4 interactions". In other embodiments, the computer device can also utilize a large language model to process interaction messages individually or aggregate them. This large language model can be a generative pre-trained language model based on the Transformer architecture. For example, the computer device can input high-priority interaction messages individually into the large language model and instruct the model to generate individual notification messages based on the interaction messages in the prompt. Alternatively, the computer device can input medium-priority interaction messages of the same type together into the large language model within a preset time period and instruct the model to aggregate the interaction messages based on the prompt, outputting aggregated notification messages.

[0098] In some embodiments, the priority of interactive information can be the same as the priority of reminder information. For example, for high-priority interactive information, the reminder information generated based on that interactive information also has a high priority. For multiple reminders of medium priority, the reminder information obtained after aggregating these multiple reminders also has a medium priority. In other embodiments, the computer device can also obtain the priority of the reminder information by merging the priorities of multiple interactive information. For example, if the reminder information is generated by aggregating interactive information 1 (medium priority score 23) and interactive information 2 (medium priority score 25), then the priority of the reminder information can be medium priority score 24.

[0099] In some embodiments of this specification, the priority of interactive information is determined based on a preset evaluation dimension associated with the interactive information. Based on the summary generation method corresponding to the priority of the interactive information and the interactive information, reminder information is generated. The priority of the reminder information is determined based on the priority of the interactive information. A hierarchical summary strategy is adopted to aggregate the lower priority interactive information and process the higher priority interactive information separately. The complete display of high priority events or question-type content is retained, which effectively reduces the occupation of non-important information on the graphical user interface and information noise, and improves the overall information reading efficiency.

[0100] In some embodiments, the computer device may also determine the operational intensity of the graphical user interface and adjust the priority of interactive information based on the operational intensity. Figure 8 This is a flowchart illustrating a method for prioritizing interactive information according to some embodiments of this specification. Figure 8 The illustrated process 800 can be executed by a computer device, for example, by a first priority adjustment module 1060 in a live interactive information display device 1000 deployed on a computer device. Figure 8 As shown, in some embodiments, process 800 may include the following steps.

[0101] Step 810: Determine the intensity of the graphical user interface operation based on the interactive operation of the graphical user interface.

[0102] In some embodiments, the interaction may include touch or click operations. Further details regarding interaction operations can be found in the description of process 200 above, and will not be repeated here.

[0103] In some embodiments, a computer device can determine operation information based on interactive operations of a graphical user interface, and determine operation intensity based on the operation information and its weight. The operation information may include at least one of the following: operation frequency, operation speed, and whether multi-finger operation is used. The determination of operation intensity is described in detail below.

[0104] In some embodiments, the computer device can determine the operation frequency based on the number of interactive operations occurring in the graphical user interface within a preset time period. For example, the computer device can count the number N of valid touch operations or valid click operations occurring in the graphical user interface within a sliding time window (e.g., T = 500 ms), and the operation frequency can be expressed as N / T. For example, if a total of 8 touch events are detected in the graphical user interface within 500 ms, then the operation frequency = 8 / 0.5 = 16 times / second.

[0105] In some embodiments, the computer device can determine the operation speed based on the distance traveled in the graphical user interface during an interactive operation within a preset time period. For example, the computer device can calculate the distance D from the start position to the end position of the interactive operation within a sliding time window (e.g., T = 500 ms), and the operation speed can be expressed as D / T. For example, if a touch operation is detected within 500 ms, moving from touch point A (100, 200) to touch point B (300, 400), and the distance D = sqrt((300-100)² + (400-200)²) = 282.8 pixels, then the operation speed = D / T = 282.8 / 0.5 = 565.6 pixels / second. Where (100, 200) and (300, 400) can represent the coordinate positions of touch point A and touch point B in the graphical user interface, and sqrt((300-100)²+(400-200)²) means calculating the Euclidean distance between touch point A (100, 200) and touch point B (300, 400).

[0106] In some embodiments, the computer device can detect whether multiple touch points exist simultaneously in the graphical user interface (GUI) to determine whether the interaction is a multi-finger operation. For example, when the computer device detects two or more touch points simultaneously, it determines that the current interaction is a multi-finger operation. The computer device can also determine a score corresponding to the multi-finger operation. For example, if only one touch point is detected in the GUI, there is no multi-finger operation, and the score corresponding to the multi-finger operation can be an initial score (e.g., 0 or 20 points). If multiple touch points are detected in the GUI, there is a multi-finger operation, and the score corresponding to the multi-finger operation can be the initial score + 10 points. In some embodiments, the more touch points detected simultaneously in the GUI, the higher the score corresponding to the multi-finger operation can be. For example, if only one touch point is detected in the GUI, the score for the multi-finger operation is 0 points; if two touch points are detected simultaneously, the score is 20 points; and if three touch points are detected simultaneously, the score is 30 points.

[0107] In some embodiments, the computer device can determine a comprehensive score for the operation information based on its weights, and determine the operation intensity of the graphical user interface (GUI) based on the comprehensive score. For example, the comprehensive score of the operation information can be represented as W7 × operation frequency + W8 × operation speed + W9 × multi-finger operation score. Here, W7, W8, and W9 can represent the weights corresponding to the operation information. In some embodiments, when the comprehensive score of the operation information is greater than a third preset score threshold, the operation intensity of the GUI can be determined to be high, indicating that the streamer may be in a game battle; when the comprehensive score of the operation information is not less than a fourth preset score threshold and not greater than the third preset score threshold, the operation intensity of the GUI can be determined to be medium, indicating that the streamer may be moving or exploring the map in the game; when the comprehensive score of the operation information is less than the fourth preset score threshold, the operation intensity of the GUI can be determined to be low, indicating that the streamer may be idle. Here, the third preset score threshold can be greater than the fourth preset score threshold. In some embodiments, the computer device can update the operation intensity of the GUI at preset time intervals. For example, the comprehensive score of the operation information is updated every 500ms, thereby updating the operation intensity of the GUI.

[0108] In some embodiments, the computer device may also determine the operation intensity of the graphical user interface (GUI) based on preset conditions. For example, when the operation frequency is greater than a first preset operation frequency, the operation speed is greater than a first preset operation speed, and multi-finger operation is detected, the operation intensity of the GUI is determined to be high. When the operation frequency is greater than a second preset operation frequency but less than the first preset operation frequency, the operation intensity of the GUI is determined to be medium. When the operation frequency is less than the second preset operation frequency, and the duration of the operation frequency being less than the second preset operation frequency is greater than a preset time, the operation intensity of the GUI is determined to be low.

[0109] Step 820: Adjust the priority of interactive information based on the intensity of the graphical user interface operation.

[0110] In some embodiments, the computer device can adjust a preset scoring threshold corresponding to the priority of interactive information based on the intensity of the graphical user interface (GUI) operation. The explanation regarding the priority of interactive information and the preset scoring threshold corresponding to that priority can be found in step 720 above, and will not be repeated here. For example, when the GUI operation intensity is high, the computer device can increase the scoring threshold corresponding to medium priority to raise the judgment standard for medium-priority interactive information. When the GUI operation intensity is low, the computer device can decrease the scoring threshold corresponding to medium priority to lower the judgment standard for medium-priority interactive information.

[0111] In some embodiments, the computer device can adjust the display configuration information of the reminder information based on the intensity of operation. The display configuration information may include at least one of the following: whether to delay display, the delay duration, the transparency of the floating layer carrying the reminder information, and whether to display the full content of the reminder information. For example, when the operation intensity of the graphical user interface is high, the display of low-priority reminder information can be delayed, the transparency of the floating layer carrying the reminder information can be increased to 70%, and only a portion of the bullet-screen type reminder information can be displayed. For example, only the first 15 characters of the bullet-screen type reminder information can be displayed. When the operation intensity of the graphical user interface is medium, the display of low-priority reminder information can be delayed, and only a portion of the bullet-screen type reminder information can be displayed. When the operation intensity of the graphical user interface is low, the display time of the reminder information can be extended, and the full content of the bullet-screen type reminder information can be displayed.

[0112] In some embodiments, the computer device can determine the multimodal configuration information corresponding to the reminder information based on the type of the live broadcast room or the priority of the interactive information, and display the reminder information on the graphical user interface based on the display configuration information, and output a multimodal reminder message corresponding to the reminder information based on the vibration configuration information and / or audio configuration information. The multimodal configuration information may include at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information. The vibration configuration information may include at least one of the following configuration information: no vibration mode, vibration enabled mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity. The audio configuration information may include at least one of the following configuration information: no sound effect, sound effect present, sound effect type, and sound effect file. The display configuration information may include at least one of the following configuration information: whether to delay display, delay display duration, transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

[0113] In some embodiments, the type of live stream room may include MOBA (Multiplayer Online Battle Arena) landscape mode, FPS (First-Person Shooter) landscape mode, or card game. The streamer can select a preset live stream room type before or during the live stream. For example, a configuration menu can be displayed by long-pressing the floating layer, or opened via a shortcut gesture (e.g., by swiping down with three fingers), and the preset live stream room type can be selected from the configuration menu. Alternatively, a preset live stream room type can be quickly selected via voice commands; for example, entering the voice command "switch to FPS mode" will allow the computer device to directly select FPS mode. In some embodiments, the computer device can identify the type of live stream room based on the content of the live stream screen. For example, OCR (Optical Character Recognition) technology can be used to recognize text (e.g., game name, application title, software name, etc.) in the live stream screen, and the recognized text content can be matched with the preset live stream room type to determine the current live stream room type.

[0114] For example, when the live stream is a MOBA landscape mode, the floating layer carrying the notification information can be displayed in the center of the graphical user interface near the top, the vibration configuration can be enabled, and the transparency of the floating layer can be medium. When the live stream is an FPS landscape mode, the vibration configuration can be disabled, the audio configuration can be silent, and the transparency of the floating layer can be low. When the live stream is a card game, the vibration configuration can be enabled, the audio configuration can be audio with sound effects, the display configuration can be delayed by 10 seconds, the transparency of the floating layer carrying the notification information can be high, and the entire notification information can be displayed.

[0115] In some embodiments, the type of live streaming room may include landscape mode and portrait mode. The computer device can also acquire the screen orientation and determine the type of live streaming room based on the screen orientation. For example, the computer device can acquire the screen orientation using an API interface provided by the operating system running on the computer device, and determine the type of live streaming room based on the acquired screen orientation. In some embodiments, the computer device can determine the type of live streaming room based on the user interface layout in the live streaming screen. For example, the computer device can detect the icon layout in the live streaming screen (e.g., virtual joysticks, button icons, etc. in a game) to determine whether the type of live streaming room is landscape mode or portrait mode.

[0116] For example, when the priority of the interactive information is high, the vibration configuration information of the reminder information generated based on the interactive information may include enabling vibration mode, dual vibration mode (e.g., performing a 100-millisecond vibration, pausing briefly for 50 milliseconds, and then performing another 100-millisecond vibration), and vibration intensity of 200 (vibration intensity range is 0-255). The audio configuration information of the reminder information may include sound effects, the sound effect type can be a crisp and short sound effect, and the sound effect file can be gift_high.mp3. The display configuration information of the reminder information may include a red light, the light flashing mode can be a rapid flash twice, the display time of the floating layer carrying the reminder information can be 1.5-2 seconds, the display position of the floating layer carrying the reminder information can be the center of the top of the screen, the background color of the floating layer carrying the reminder information can be a semi-transparent red, the color of the reminder information can be white, the font size can be 16sp or 14pt, the font border is gold, the animation effect of the floating layer carrying the reminder information is fade-in and fade-out, the special effect of the floating layer carrying the reminder information is a slight flicker, and the number of characters of the reminder information displayed in the floating layer can be limited to 15 characters.

[0117] When the priority of the interactive information is medium, the vibration configuration information of the notification information generated based on the interactive information can include enabling vibration mode, single vibration mode (e.g., performing a vibration for 80 milliseconds), and vibration intensity of 150 (vibration intensity range is 0-255). The audio configuration information of the notification information can include sound effects, the sound effect type can be a soft sound effect, the sound effect file can be notification.mp3, and the sound effect playback volume can be adaptively adjusted based on the current game volume. The display configuration information of the notification information can include a display time of 1 second for the floating layer carrying the notification information, a display position of the floating layer carrying the notification information in the upper right corner of the screen, a background color of a semi-transparent blue for the floating layer carrying the notification information, a white color for the notification information, a font size of 14sp or 12pt, an animation effect of a right-swipe-in / right-swipe-out for the floating layer carrying the notification information, and a character limit of 12 characters for the notification information displayed in the floating layer.

[0118] When the priority of the interactive information is low, the vibration configuration information of the reminder information generated based on the interactive information can include a no-vibration mode. The audio configuration information of the reminder information can include no sound effects. The display configuration information of the reminder information can include a display time of 0.8 seconds for the floating layer carrying the reminder information, a display position of the floating layer carrying the reminder information in the upper right corner of the screen, a background color of semi-transparent gray for the floating layer carrying the reminder information, a white color for the reminder information, a font size of 12sp or 10pt, an animation effect of the floating layer carrying the reminder information that can be a fast fade-in and fade-out, and a character limit of 10 characters for the reminder information displayed in the floating layer.

[0119] By determining the multimodal configuration information corresponding to the reminder information based on the type of the live broadcast room or the priority of interactive information, a multimodal collaborative reminder mechanism based on vision, touch, and hearing is realized. Different reminder combinations are matched in different types of live broadcast rooms, or reminder information with different priorities can be automatically matched with different reminder combinations. Even in intense games, the streamer will not miss key information. By automatically recognizing the type of the live broadcast room (such as the type of game in the live broadcast screen), interference with game sound effects or vibrations in the game can also be avoided.

[0120] Figure 9 This is an exemplary flowchart of a live interactive information processing method according to some embodiments of this specification. Figure 9 The illustrated process 900 can be executed by a computer device, for example, by a live interactive information processing device 1100 deployed on the computer device. In some embodiments, the computer device can be as follows: Figure 1 The server shown is 110. (For example...) Figure 9 As shown, process 900 may include the following steps.

[0121] Step 910: Obtain interactive information from the live stream. In some embodiments, step 910 can be implemented by the interactive information acquisition module 1110.

[0122] In some embodiments, the computer device can obtain interactive information from a client. For example, the client may be such as Figure 1 The viewer terminal 130 is shown. The client terminal can also be as follows: Figure 1 The broadcaster's client 120 is shown. Interactive information may include at least one of the following: bullet comments, gifts, likes, following the broadcaster, sharing the live stream, and entering the live stream. The instructions for obtaining interactive information from the client are similar to those for obtaining interactive information from the server; please refer to step 710 above for details. The difference is that step 910 involves the server obtaining interactive information from the client (e.g., ...). Figure 1 The audience terminal 130 shown obtains interactive information, and step 710 is the client (e.g., Figure 1The broadcaster (120) shown in the image receives data from the server (e.g., the server). Figure 1 The server shown (110) obtains interactive information.

[0123] Step 920: Generate a reminder message based on the interactive information. In some embodiments, step 920 can be implemented by the reminder message generation module 1120.

[0124] In some embodiments, the alert information can be used on the client (e.g. Figure 1 The graphical user interface (GUI) of the broadcaster terminal 120 (shown) displays the notification information. The display position of the notification information on the GUI can be determined based on the distribution of interactive operations on the GUI. Interactive operations can include touch operations or click operations. In some embodiments, the client (e.g., Figure 1 The broadcast client 120 shown can display reminder information based on the graphical user interface (GUI) and obtain interactive operations from the GUI. Based on the distribution of interactive operations on the GUI, it determines the display position of the reminder information. For a detailed explanation of this part, please refer to the description in process 200 above, which will not be repeated here.

[0125] In some embodiments, a computer device can determine the priority of interactive information based on preset evaluation dimensions associated with the interactive information, and generate reminder information based on the summary generation method corresponding to the priority of the interactive information and the interactive information itself. Different priorities may correspond to different summary generation methods, and the preset evaluation dimensions may include at least one of the following dimensions: value of the interactive information, fan level, keyword hits, combo status, rarity, and timeliness. For example, the computer device can determine the importance score of the interactive information based on the ratings and weights of the preset evaluation dimensions associated with the interactive information, and determine the priority of the interactive information based on the importance score.

[0126] In some embodiments, the reminder information may include individual reminder information and aggregated reminder information. The computer device can process high-priority interactive information individually to generate individual reminder information, and aggregate interactive information with lower priority to generate aggregated reminder information. For example, the computer device can process or aggregate interactive information based on a preset template library, or it can use a large language model to process or aggregate interactive information individually to generate individual or aggregated reminder information.

[0127] In some embodiments, the computer device may also determine the priority of the reminder information based on the priority of the interactive information. For example, the priority of the interactive information may be the same as the priority of the reminder information, or the computer device may merge the priorities of multiple interactive information to obtain the priority of the reminder information.

[0128] For further explanation of step 920, please refer to the descriptions in steps 720 and 730 above. The difference is that the execution entity of step 920 is the server (e.g., Figure 1 The server 110 shown is executed by the client (e.g., the client is the execution subject of steps 720 and 730). Figure 1 The broadcaster terminal shown is 120.

[0129] In some embodiments, the computer device can obtain the client (e.g. Figure 1 The operation intensity of the graphical user interface (GUI) of the broadcaster (120) shown is determined, and the priority of interactive information is adjusted based on the operation intensity of the GUI. The operation intensity can be determined based on the interactive operations of the GUI. For a related explanation of operation intensity, please refer to the description in step 810 above, which will not be repeated here. For a related explanation of adjusting the priority of interactive information based on the operation intensity of the GUI, please refer to the description in step 820 above. The difference is that the execution subject of step 920 is the server (e.g., [example server]). Figure 1 (As shown in the server 110), the execution subject of step 820 is the client (e.g., Figure 1 The broadcaster terminal shown is 120.

[0130] In some embodiments, the computer device can determine the multimodal configuration information corresponding to the reminder information based on the type of the live broadcast room or the priority of the interactive information. The multimodal configuration information can be used to configure the display method of the reminder information displayed in the graphical user interface, or to configure the reminder method of the multimodal reminder message corresponding to the reminder information. The multimodal configuration information may include at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information. Vibration configuration information may include at least one of the following configuration information: no vibration mode, vibration enabled mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity. Audio configuration information may include at least one of the following configuration information: no sound effect, sound effect present, sound effect type, and sound effect file. Display configuration information may include at least one of the following configuration information: whether to delay display, delay display duration, transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects. After determining the multimodal configuration information corresponding to the reminder information, the computer device can send the multimodal configuration information to the client (e.g., ...). Figure 1 (as shown in the broadcaster terminal 120), so that the client can display reminder information or configure the reminder method of the multimodal reminder message corresponding to the reminder information based on the multimodal configuration information. For more explanation of this part, please refer to the description in step 820 above. The difference is that the execution subject of step 920 is the server (e.g., Figure 1 (As shown in the server 110), the execution subject of step 820 is the client (e.g., Figure 1The broadcaster terminal shown is 120.

[0131] This specification also provides a live interactive information display device. Figure 10 This is an exemplary block diagram of a live interactive information display device according to some embodiments of this specification. In some embodiments, the live interactive information display device 1000 may be deployed on a computer device. For example, deployed on a computer device such as... Figure 1 The broadcaster terminal shown is 120. (As shown in the image.) Figure 10 As shown, in some embodiments, the live interactive information display device 1000 may include a reminder information display module 1010, an interactive operation acquisition module 1020, and a display position determination module 1030.

[0132] The reminder information display module 1010 can be used to display reminder information based on a graphical user interface. The reminder information can be generated based on the interactive information in the live broadcast room.

[0133] The interactive operation acquisition module 1020 can be used to acquire interactive operations of the graphical user interface, which may include touch operations or click operations.

[0134] The display position determination module 1030 can be used to determine the display position of the reminder information based on the distribution of interactive operations in the graphical user interface.

[0135] In some optional embodiments, the display position determination module 1030 can also be used to determine the high-frequency operation area and low-frequency operation area in the graphical user interface based on the distribution of interactive operations in the graphical user interface; when the reminder information is displayed in the high-frequency operation area in the graphical user interface, the display position of the reminder information is adjusted so that the reminder information is displayed in the low-frequency operation area in the graphical user interface.

[0136] In some optional embodiments, the display position determination module 1030 can also be used to divide the graphical user interface into a preset number of unit areas; determine the operation frequency of each unit area based on the proportion of the number of interactive operations in each unit area to the total number of interactive operations in the graphical user interface within a preset time; and determine the high-frequency operation area and low-frequency operation area in the graphical user interface based on the operation frequency of each unit area and a preset threshold.

[0137] In some optional embodiments, the display position determination module 1030 can also be used to adjust the display position of the reminder information to a low-frequency operation area close to the original display position of the reminder information.

[0138] In some optional embodiments, the live interactive information display device 1000 may further include a display order determination module 1040, used to acquire reminder information and the priority of the reminder information; determine the display order of the reminder information based on the priority of the reminder information; the reminder information display module 1010 may also be used to display the reminder information according to the display order based on the graphical user interface; wherein, the priority of the reminder information is determined based on a preset evaluation dimension associated with the interactive information, and the preset evaluation dimension includes at least one of the following dimensions: the value of the interactive information, fan level, keyword hit, combo status, rarity, and timeliness.

[0139] In some optional embodiments, the live interactive information display device 1000 may further include a reminder information and priority acquisition module 1050, which is used to acquire interactive information; determine the priority of interactive information based on a preset evaluation dimension associated with the interactive information, wherein different priorities correspond to different summary generation methods; generate reminder information based on the summary generation method corresponding to the priority of interactive information and the interactive information, and determine the priority of the reminder information based on the priority of interactive information.

[0140] In some optional embodiments, the reminder information includes individual reminder information and aggregated reminder information. The reminder information and priority acquisition module 1050 can also be used to process high-priority interactive information separately to generate individual reminder information; and to aggregate interactive information with lower priority than high priority to generate aggregated reminder information.

[0141] In some optional embodiments, the live interactive information display device 1000 may further include a first priority adjustment module 1060, which is used to determine the operation intensity of the graphical user interface based on the interactive operation of the graphical user interface; and adjust the priority of the interactive information based on the operation intensity of the graphical user interface.

[0142] In some optional embodiments, the first priority adjustment module 1060 can also be used to determine operation information based on the interactive operation of the graphical user interface, the operation information including at least one of the following: operation frequency, operation speed, whether multi-finger operation; and determine operation intensity based on the operation information and the weight of the operation information.

[0143] In some optional embodiments, the live interactive information display device 1000 may further include a first multimodal configuration information determination module 1070, used to determine the multimodal configuration information corresponding to the reminder information based on the type of the live room or the priority of the interactive information. The multimodal configuration information includes at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information; displaying the reminder information on the graphical user interface based on the display configuration information, and outputting a multimodal reminder message corresponding to the reminder information based on the vibration configuration information and / or audio configuration information; wherein, the vibration configuration information includes at least one of the following configuration information: no vibration mode, vibration enabled mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity; the audio configuration information includes at least one of the following configuration information: no sound effect, sound effect, sound effect type, and sound effect file; the display configuration information includes at least one of the following configuration information: whether to delay display, delay display duration, transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

[0144] This specification also provides a live interactive information processing device. Figure 11 This is an exemplary block diagram of a live interactive information processing apparatus according to some embodiments of this specification. In some embodiments, the live interactive information processing apparatus 1100 may be deployed on a computer device. For example, deployed on a computer device such as... Figure 1 The server shown is 110. (For example...) Figure 11 As shown, in some embodiments, the live interactive information processing device 1100 may include an interactive information acquisition module 1110 and a reminder information generation module 1120.

[0145] In some optional embodiments, the interactive information acquisition module 1110 can be used to acquire interactive information in the live broadcast room.

[0146] In some optional embodiments, the reminder information generation module 1120 can be used to generate reminder information based on interactive information. The reminder information is used to display on the graphical user interface of the client. The display position of the reminder information on the graphical user interface is determined based on the distribution of interactive operations on the graphical user interface, including touch operations or click operations.

[0147] In some optional embodiments, the reminder information generation module 1120 can also be used to determine the priority of interactive information based on a preset evaluation dimension associated with the interactive information, wherein different priorities correspond to different summary generation methods; and generate reminder information based on the summary generation method corresponding to the priority of the interactive information and the interactive information; wherein the preset evaluation dimension includes at least one of the following dimensions: value of interactive information, fan level, keyword hit, combo status, rarity, and timeliness.

[0148] In some optional embodiments, the reminder information may include individual reminder information and aggregated reminder information. The reminder information generation module 1120 may also be used to process high-priority interactive information separately to generate individual reminder information; and to aggregate interactive information with lower priority than high priority to generate aggregated reminder information.

[0149] In some optional embodiments, the live interactive information processing device 1100 may further include a second priority adjustment module 1130, which is used to obtain the operation intensity of the client's graphical user interface, the operation intensity being determined based on the interactive operation of the graphical user interface; and to adjust the priority of interactive information based on the operation intensity of the graphical user interface.

[0150] In some optional embodiments, the live interactive information processing device 1100 may further include a second multimodal configuration information determination module 1140, which is used to determine the multimodal configuration information corresponding to the reminder information based on the type of the live room or the priority of the interactive information. The multimodal configuration information is used to configure the display method of the reminder information displayed on the graphical user interface, or to configure the reminder method of the multimodal reminder message corresponding to the reminder information. The multimodal configuration information includes at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information. Among them, the vibration configuration information includes at least one of the following configuration information: no vibration mode, vibration enabled mode, single vibration mode, double vibration mode, triple vibration mode, and vibration intensity. The audio configuration information includes at least one of the following configuration information: no sound effect, sound effect, sound effect type, and sound effect file. The display configuration information includes at least one of the following configuration information: whether to delay display, delay display duration, transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

[0151] This manual also provides a live interactive information processing system. Figure 12 This is an exemplary block diagram of a live interactive information processing system according to some embodiments of this specification. Figure 12 As shown, in some embodiments, the live interactive information processing system 1200 may include a server 1210 and a client 1220. In some embodiments, the server 1210 may be as follows: Figure 1 The server 110 and client 1220 shown can be as follows: Figure 1 The broadcaster terminal shown is 120.

[0152] Server 1210 can be used to obtain interactive information from the live stream and generate reminder messages based on the interactive information.

[0153] Client 1220 can be used to display reminder information based on a graphical user interface and to obtain interactive operations of the graphical user interface. Based on the distribution of interactive operations on the graphical user interface, the display position of the reminder information can be determined. The interactive operations include touch operations or click operations.

[0154] For more information on each module, please refer to [link / reference]. Figures 2-9 The relevant explanations will not be repeated here. It should be understood that... Figures 10-12 The apparatus, system, and modules illustrated can be implemented in various ways. For example, in some embodiments, they can be implemented by hardware, software, or a combination of both. The hardware portion can be implemented using dedicated logic; the software portion can be stored in memory and executed by an appropriate instruction execution system, such as a microprocessor or dedicated-design hardware. Those skilled in the art will understand that the methods, apparatus, and systems described above can be implemented using computer-executable instructions and / or included in the control code of a processor, such as code provided in the memory of a programmable device on a media such as a disk, CD, or DVD-ROM. The apparatus and modules described in this specification can be implemented not only by hardware circuitry such as very large-scale integrated circuits or gate arrays, semiconductors such as logic chips or transistors, or programmable hardware devices such as field-programmable gate arrays or programmable logic devices, but also by software, for example, executed by various types of processors, or by a combination of the aforementioned hardware circuitry and software (e.g., firmware).

[0155] It should be noted that the above descriptions of the devices, systems, and modules are for convenience only and should not be construed as limiting this specification to the embodiments described. It is understood that those skilled in the art, after understanding the principle of the device, can arbitrarily combine the various modules without departing from this principle to form sub-devices connected to other modules. Alternatively, some modules can be split to obtain more modules or multiple units under a single module. Such modifications are all within the scope of this specification.

[0156] Some embodiments of this specification also provide a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it can implement this specification. Figures 2-9 The method shown.

[0157] Some embodiments of this specification also provide a computer-readable storage medium storing computer instructions that, when executed by a processor, can implement this specification. Figures 2-9 The method shown.

[0158] Some embodiments of this specification also provide a computer program product, including a computer program that, when at least a portion of the computer program is executed by a processor, can implement this specification. Figures 2-9 The method is illustrated. In some embodiments, the computer program product may refer only to a computer program, which may be carried on a storage medium or a processing device. In other embodiments, the computer program product may also be a storage medium or a processing device containing the aforementioned computer program. The processing device may include one or more processors, and the storage medium.

[0159] In some embodiments, the processor may be a combination of one or more of the following processors: central processing unit (CPU), application-specific integrated circuit (ASIC), application-specific instruction set processor (ASIP), graphics processing unit (GPU), physical processing unit (PPU), digital signal processor (DSP), field-programmable gate array (FPGA), programmable logic device (PLD), programmable logic controller (PLC), reduced instruction set computer (RISC), and microprocessor.

[0160] In some embodiments, the storage medium may include one or more combinations of the following: mass storage, removable storage, volatile read-write memory, and read-only memory (ROM). Exemplary mass storage may include disks, optical disks, solid-state drives, etc. Exemplary removable storage may include flash drives, floppy disks, optical disks, memory cards, compressed hard disks, magnetic tapes, etc. Exemplary volatile read-write memory may include random access memory (RAM). Exemplary RAM may include dynamic random access memory (DRAM), dual data rate synchronous dynamic random access memory (DDRSDRAM), static random access memory (SRAM), silicon controlled retrieval memory (T-RAM), and zero-capacitance memory (Z-RAM), etc. Exemplary read-only memory may include masked read-only memory (MROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), compressed hard disk read-only memory (CD-ROM), and digital multifunction hard disk read-only memory, etc.

[0161] The basic concepts have been described above. It is obvious that the detailed disclosure above is merely illustrative and does not constitute a limitation of this specification. Although not explicitly stated herein, various modifications, improvements, and corrections may be made to this specification by those skilled in the art. Such modifications, improvements, and corrections are taught in this specification and therefore remain within the spirit and scope of the exemplary embodiments described herein.

Claims

1. A method of displaying live interactive information, characterized by, The method includes: The reminder information is displayed based on a graphical user interface, and the reminder information is generated based on the interactive information in the live broadcast room. The interactive operations of the graphical user interface are obtained, including touch operations or click operations; The display location of the reminder information is determined based on the distribution of the interactive operations on the graphical user interface.

2. The method according to claim 1, characterized in that, Determining the display location of the reminder information based on the distribution of the interactive operations on the graphical user interface includes: Based on the distribution of the interactive operations in the graphical user interface, determine the high-frequency operation area and the low-frequency operation area in the graphical user interface. When the reminder information is displayed in the high-frequency operation area of ​​the graphical user interface, the display position of the reminder information is adjusted so that the reminder information is displayed in the low-frequency operation area of ​​the graphical user interface.

3. The method according to claim 2, characterized in that, The step of determining high-frequency and low-frequency operation areas in the graphical user interface based on the distribution of the interactive operations on the graphical user interface includes: The graphical user interface is divided into a preset number of unit areas; The operation frequency of each unit area is determined based on the proportion of the number of interactive operations in each unit area within a preset time to the total number of interactive operations in the graphical user interface. Based on the operating frequency of each unit region and a preset threshold, the high-frequency operation region and the low-frequency operation region in the graphical user interface are determined.

4. The method according to claim 2, characterized in that, Adjusting the display position of the reminder information so that it is displayed in the low-frequency operation area of ​​the graphical user interface includes: Adjust the display position of the reminder message to a low-frequency operation area that is close to the original display position of the reminder message.

5. The method according to claim 1, characterized in that, The method further includes: Obtain the reminder information and its priority; The display order of the reminder information is determined based on the priority of the reminder information; The method of displaying reminder information based on a graphical user interface includes: The reminder information is displayed in the order described above, based on the graphical user interface. The priority of the reminder information is determined based on a preset evaluation dimension associated with the interactive information. The preset evaluation dimension includes at least one of the following dimensions: the value of the interactive information, fan level, keyword hits, combo status, rarity, and timeliness.

6. The method according to claim 5, characterized in that, The acquisition of the reminder information and the priority of the reminder information include: Obtain the interactive information; The priority of the interactive information is determined based on a preset evaluation dimension associated with the interactive information, wherein different priorities correspond to different summary generation methods; Based on the summary generation method corresponding to the priority of the interactive information and the interactive information, the reminder information is generated, and the priority of the reminder information is determined based on the priority of the interactive information.

7. The method according to claim 6, characterized in that, The reminder information includes individual reminder information and aggregated reminder information. The generation of the reminder information based on the priority of the interaction information and the interaction information includes: The high-priority interactive information is processed separately to generate the separate reminder information; The interactive information with a lower priority than the higher priority is aggregated to generate the aggregated reminder information.

8. The method according to claim 6 or 7, characterized in that, The method further includes: The intensity of the operation of the graphical user interface is determined based on the interactive operations of the graphical user interface. The priority of the interactive information is adjusted based on the intensity of the operation of the graphical user interface.

9. The method according to claim 8, characterized in that, The determination of the operational intensity of the graphical user interface based on the interactive operations of the graphical user interface includes: Operation information is determined based on the interactive operations of the graphical user interface, and the operation information includes at least one of the following: operation frequency, operation speed, and whether multi-finger operation is used. The intensity of the operation is determined based on the operation information and its weight.

10. The method according to claim 6 or 7, characterized in that, The method of displaying reminder information based on a graphical user interface includes: The multimodal configuration information corresponding to the reminder information is determined based on the type of the live broadcast room or the priority of the interactive information. The multimodal configuration information includes at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information. The reminder information is displayed on the graphical user interface based on the display configuration information, and a multimodal reminder message corresponding to the reminder information is output based on the vibration configuration information and / or the audio configuration information. The vibration configuration information includes at least one of the following configuration information: no vibration mode, vibration on mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity. The audio configuration information includes at least one of the following configuration information: no sound effect, sound effect present, sound effect type, and sound effect file; The display configuration information includes at least one of the following configuration information: whether to delay the display, the delay display duration, the transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

11. The method according to claim 1, characterized in that, The interactive information includes at least one of the following: Comments, gifts, likes, following the streamer, sharing the live stream, and entering the live stream.

12. A method for processing live interactive information, characterized in that, The method includes: Get interactive information from the live stream; A reminder message is generated based on the interactive information. The reminder message is displayed on the client's graphical user interface. The display position of the reminder message on the graphical user interface is determined based on the distribution of interactive operations on the graphical user interface. The interactive operations include touch operations or click operations.

13. The method according to claim 12, characterized in that, The generation of reminder information based on the interactive information includes: The priority of the interactive information is determined based on a preset evaluation dimension associated with the interactive information, wherein different priorities correspond to different summary generation methods; The reminder information is generated based on the summary generation method corresponding to the priority of the interactive information and the interactive information itself; The preset evaluation dimensions include at least one of the following dimensions: the value of the interactive information, fan level, keyword hits, combo status, rarity, and timeliness.

14. The method according to claim 13, characterized in that, The reminder information includes individual reminder information and aggregated reminder information. The generation of the reminder information based on the priority of the interaction information and the interaction information includes: The high-priority interactive information is processed separately to generate the separate reminder information; The interactive information with a lower priority than the higher priority is aggregated to generate the aggregated reminder information.

15. The method according to claim 13 or 14, characterized in that, The method further includes: The operational intensity of the graphical user interface of the client is obtained, and the operational intensity is determined based on the interactive operations of the graphical user interface; The priority of the interactive information is adjusted based on the intensity of the operation of the graphical user interface.

16. The method according to claim 13 or 14, characterized in that, The method further includes: The multimodal configuration information corresponding to the reminder information is determined based on the type of the live broadcast room or the priority of the interactive information. The multimodal configuration information is used to configure the display method of the reminder information displayed on the graphical user interface, or to configure the reminder method of the multimodal reminder message corresponding to the reminder information. The multimodal configuration information includes at least one of the following configuration information: vibration configuration information, audio configuration information, and display configuration information; The vibration configuration information includes at least one of the following configuration information: no vibration mode, vibration on mode, single vibration mode, dual vibration mode, triple vibration mode, and vibration intensity. The audio configuration information includes at least one of the following configuration information: no sound effect, sound effect present, sound effect type, and sound effect file; The display configuration information includes at least one of the following configuration information: whether to delay the display, the delay display duration, the transparency of the floating layer carrying the reminder information, whether to display the full content of the reminder information, and lighting effects.

17. A live interactive information display device, characterized in that, The device includes: A reminder information display module is used to display reminder information based on a graphical user interface, wherein the reminder information is generated based on interactive information from the live broadcast room. An interactive operation acquisition module is used to acquire the interactive operations of the graphical user interface, including touch operations or click operations. The display location determination module is used to determine the display location of the reminder information based on the distribution of the interactive operations on the graphical user interface.

18. A live interactive information processing device, characterized in that, The device includes: The interactive information acquisition module is used to acquire interactive information from the live stream. The reminder information generation module is used to generate reminder information based on the interactive information. The reminder information is used to display on the graphical user interface of the client. The display position of the reminder information on the graphical user interface is determined based on the distribution of interactive operations on the graphical user interface. The interactive operations include touch operations or click operations.

19. A live interactive information processing system, characterized in that, The system includes a client and a server; The server is used to obtain interactive information from the live stream and generate reminder information based on the interactive information. The client is configured to display the reminder information based on a graphical user interface, acquire the interactive operations of the graphical user interface, and determine the display position of the reminder information based on the distribution of the interactive operations on the graphical user interface. The interactive operations include touch operations or click operations.

20. A computer device, characterized in that, The computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it is able to implement the method as described in any one of claims 1 to 16.

21. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer instructions that, when executed by a processor, enable the implementation of the method as described in any one of claims 1 to 16.

22. A computer program product, characterized in that, It includes a computer program that, when at least a portion of the computer program is executed by a processor, enables the implementation of the method as described in any one of claims 1 to 16.

Images