Barrage display method and device, electronic equipment and storage medium

By acquiring real-time user eye-tracking information and adjusting the display attributes of the bullet comments, the problem of overlapping bullet comments in trending videos was solved, improving the user's viewing experience and the clarity of the bullet comment display.

CN119729089BActive Publication Date: 2025-12-16SHANGHAI BILIBILI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311273612.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-09-27
Publication Date
2025-12-16
Estimated Expiration
2043-09-27

AI Technical Summary

Technical Problem

When a large number of users send bullet comments simultaneously in a trending video, the bullet comments overlap, making it impossible to clearly identify the specific text content and affecting the user's reading and viewing experience.

Method used

By acquiring real-time eye-tracking information from client users, the system identifies target bullet comments associated with the user's eye focus position and adjusts their display attributes, including 3D coordinates, display size, font, animation effects, and bullet comment trajectory, to highlight the bullet comment content that the user is interested in.

Benefits of technology

It improves the user's viewing experience, ensures that users can clearly and completely view the bullet comments, and enables bullet comment display control based on individual differences among different users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119729089B_ABST
    Figure CN119729089B_ABST
Patent Text Reader

Abstract

The present disclosure provides a barrage display method and device, electronic equipment and storage medium. The implementation scheme of the barrage display method is: obtaining eyeball tracking information of a client user watching a played video; determining one or more target barrages associated with the eyeball tracking information from a plurality of barrages presented in the played video based on the eyeball tracking information; and adjusting display attribute information of the one or more target barrages.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, in particular to a bullet screen display method and device, electronic equipment, computer readable storage medium and computer program product. BACKGROUND

[0002] With the continuous development of Internet technology, users are no longer limited to traditional ways such as television to watch video media, but can watch network video media through the network. The bullet screen is an interactive comment that is rapidly displayed in the form of text when watching network video media. Users can not only express their own opinions by publishing bullet screens, but also interact with the displayed bullet screens, thereby increasing the interest of users in watching video media.

[0003] The methods described in this section can not be the methods previously conceived or used. Unless otherwise indicated, nothing in this section should be assumed to be prior art merely because it is included in this section. Similarly, any problems mentioned in this section should not be assumed to have been recognized in the art unless otherwise indicated. SUMMARY

[0004] The present disclosure provides a bullet screen display method and device, electronic equipment, computer readable storage medium and computer program product.

[0005] According to an aspect of the present disclosure, a bullet screen display method is provided, comprising: obtaining eye tracking information of a client user watching a played video; determining one or more target bullet screens associated with the eye tracking information from a plurality of bullet screens presented in the played video based on the eye tracking information; and adjusting display attribute information of the one or more target bullet screens.

[0006] According to another aspect of the present disclosure, a bullet screen display device is provided, comprising: an obtaining unit configured to obtain eye tracking information of a client user watching a played video; a target bullet screen determining unit configured to determine one or more target bullet screens associated with the eye tracking information from a plurality of bullet screens presented in the played video based on the eye tracking information; and an adjusting display attribute information unit configured to adjust display attribute information of the one or more target bullet screens.

[0007] According to another aspect of the present disclosure, an electronic equipment is also provided, comprising: at least one processor; and at least one memory communicatively connected with the at least one processor, wherein the at least one memory stores a computer program which, when executed by the at least one processor, implements the above-mentioned bullet screen display method.

[0008] According to another aspect of the present disclosure, there is also provided a non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the above-described bullet screen display method.

[0009] According to another aspect of the present disclosure, there is also provided a computer program product comprising a computer program, wherein the computer program, when executed by a processor, implements the above-described bullet screen display method.

[0010] According to one or more embodiments of the present disclosure, eye tracking information of a client user watching a played video can be acquired in real time, and display attribute information of one or more bullet screens associated with the eye tracking information can be adjusted. Since the eye tracking information can reflect the gaze point position of the client user on the current display interface in real time, the real attention and interest of the client user to the bullet screen on the display interface can be better reflected. Based on this, the display attribute information of the associated bullet screen is automatically adjusted, the bullet screen focused by the client user can be highlighted, so that the user can watch clear and complete bullet screen content, not only improving the user's watching experience, but also being conducive to realizing the bullet screen display control of individual differences between different users.

[0011] It should be understood that the content described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS

[0012] The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments and together with the description serve to explain exemplary implementations of the application. The illustrated embodiments are exemplary only and not limiting of the scope of the claims. In all the drawings, like reference numerals refer to like parts throughout the several views.

[0013] Figure 1 shows a schematic diagram of an exemplary system in which the various methods described herein can be implemented according to embodiments of the present disclosure;

[0014] Figure 2 shows a flowchart of a bullet screen display method according to embodiments of the present disclosure;

[0015] Figure 3 shows a flowchart of determining a target bullet screen at a current time associated with eye tracking information according to embodiments of the present disclosure;

[0016] Figure 4 shows a flowchart of a bullet screen display method according to further embodiments of the present disclosure;

[0017] Figure 5A flowchart of a method for displaying a barrage is shown according to some embodiments of the present disclosure.

[0018] Figure 6 A structural block diagram of a barrage display device is shown according to an embodiment of the present disclosure.

[0019] Figure 7 A structural block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0020] Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to assist in understanding them. These should be considered in their context only as illustrative. Thus, those of ordinary skill in the art will recognize various changes and modifications of the embodiments described herein, without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0021] In the present disclosure, the terms "first", "second", and the like are used to describe various elements only and do not intend to limit the positional relationship, the chronological relationship, or the importance of the elements, and such terms are only used to distinguish one element from another. In some examples, the first element and the second element can refer to the same instance of the element, and in some cases, based on the context of the description, they can also refer to different instances.

[0022] The terms used in the description of various described examples in the present disclosure are only for the purpose of describing specific examples and are not intended to be limiting. Unless the number of elements is specifically limited, the element can be one or more than one, unless the context clearly indicates otherwise. In addition, the term "and / or" used in the present disclosure encompasses any one of the listed items and all possible combinations thereof.

[0023] With the continuous development of Internet technology, users are no longer limited to traditional ways such as television to watch video media, but can watch network video media through the network. The barrage is an interactive comment that is rapidly displayed in the form of text when watching network video media. Users can not only express their own opinions by publishing barrages, but also interact with the displayed barrages, thereby increasing the interest of users in watching video media.

[0024] The current display mode of the barrage usually includes barrage arrangement, style adjustment, animation effect, occlusion processing, adaptive display, etc. The barrage arrangement refers to displaying the barrage according to the time when the user sends the barrage and a certain display rule, for example, scrolling the barrage from the right side to the left side of the display screen of the terminal device, displaying the barrage at a fixed position, or displaying the barrage in different regions, etc. The style adjustment refers to displaying the barrage in a certain font, color, etc. The animation effect refers to giving a specific barrage a specific animation effect, for example, according to the meaning of the text represented by the barrage. The occlusion processing refers to dynamically adjusting the position and transparency of the barrage by calculating the position and size of the barrage to avoid the barrage from occluding important content in the played video. The adaptive display refers to adjusting the size and layout of the barrage according to the current display screen size and resolution of the terminal device, so that the barrage can be properly displayed on various devices.

[0025] However, the inventors found that for some hot videos, there may be a situation that a large number of users send barrages at the same time, which will cause a large number of barrages to appear on the screen at the same time. Even if the barrage display mode as described above is adopted, the situation that the barrages overlap with each other and the specific text content of the barrage cannot be clearly recognized may still occur. This will greatly affect the reading and viewing experience of the user, and some important information or comments will be ignored.

[0026] Therefore, the embodiments of the present disclosure provide a barrage display method, which can obtain eye tracking information of a client user who is watching a played video in real time, and adjust display attribute information of one or more barrages associated with the eye tracking information. Since the eye tracking information can reflect the gaze point position of the client user on the current display interface in real time, it can better reflect the real attention and interest of the client user to the barrage on the display interface. Based on this, the display attribute information of the associated barrage is automatically adjusted, which can highlight the display of the barrage that the client user is interested in, so that the user can watch clear and complete barrage content, which not only improves the user's viewing experience, but also facilitates the realization of barrage display control for individual differences between different users.

[0027] Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0028] Figure 1 A schematic diagram of an exemplary system 100 in which the various methods and apparatus described herein can be implemented according to embodiments of the present disclosure is shown. Referring to FIG. 1, the system 100 includes a terminal device 110, a server 120, and a database 130. Figure 1System 100 includes one or more client devices 101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120. Client devices 101, 102, 103, 104, 105, and 106 can be configured to execute one or more applications. It should be understood that, although... Figure 1 Only six client devices are described, but this disclosure can support any number of client devices.

[0029] exist Figure 1 In the illustrated system, server 120 may include one or more components to perform one or more operations. For example, in embodiments of this disclosure, these one or more operations may include the steps described above of determining target bullet comments and adjusting their corresponding display attribute information. These components may include software components, hardware components, or combinations thereof executable by one or more processors. Users operating client devices 101, 102, 103, 104, 105, and / or 106 may sequentially use one or more client applications to interact with server 120 to utilize the services provided by these components. It should be understood that various different system configurations are possible and may differ from system 100. Therefore, Figure 1 This is an example of a system used to implement the various methods described herein, and is not intended to be limiting.

[0030] Users can initiate communication with server 120 using client devices 101, 102, 103, 104, 105, and / or 106. The client devices can provide an interface that allows users to interact with the client devices. The client devices can also output information to users through this interface.

[0031] Client devices 101, 102, 103, 104, 105, and / or 106 can include various types of computer devices, such as portable handheld devices, general purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, smart screen devices, self-service kiosk devices, service robots, gaming systems, thin clients, various messaging devices, sensors or other sensing devices, and the like. These computer devices can run various types and versions of software applications and operating systems, such as MICROSOFT Windows, APPLE iOS, UNIX-like operating systems, Linux or Linux-like operating systems (such as GOOGLE Chrome OS); or including various mobile operating systems, such as MICROSOFT Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices can include cellular telephones, smartphones, tablet computers, personal digital assistants (PDAs), and the like. Wearable devices can include head-mounted displays (such as smart glasses) and other devices. Gaming systems can include various handheld gaming devices, Internet-enabled gaming devices, and the like. Client devices are capable of executing a variety of different applications, such as various Internet-related applications, communication applications (such as email applications), short message service (SMS) applications, and can use various communication protocols.

[0032] Network 110 can be any type of network familiar to those skilled in the art that can support data communications using any of a variety of available protocols, including without limitation TCP / IP, SNA, IPX, etc. As examples only, network 110 can be a local area network (LAN), an Ethernet-based network, a Token Ring network, a wide area network (WAN), the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, a public switched telephone network (PSTN), an infrared network, a wireless network (e.g., a Bluetooth, WIMAX, and / or Wi-Fi network), and / or any combination of these and / or other networks.

[0033] Server 120 can include one or more general purpose computers, special purpose server computers (e.g., PC (personal computer) servers, UNIX servers, midrange servers), blade servers, mainframe computers, server clusters, or any other appropriate arrangement and / or combination. Server 120 can include one or more virtual machines running a virtual operating system, or other computing architectures involving virtualization (such as one or more flexible pools of logical storage devices that can be virtualized to maintain virtual storage devices for servers). In various embodiments, server 120 can run one or more services or software applications that provide the functionality described below.

[0034] The computing units in the server 120 can run one or more operating systems including any of the operating systems described above, as well as any commercially available server operating systems. Server 120 can also run any of a variety of additional server applications and / or mid-tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.

[0035] In some embodiments, the server 120 can include one or more applications to analyze and consolidate data feeds and / or event updates from users of the client devices 101, 102, 103, 104, 105, and / or 106. The server 120 can also include one or more applications to present the data feeds and / or real-time events via one or more display devices of the client devices 101, 102, 103, 104, 105, and / or 106.

[0036] In some embodiments, the server 120 can be a server of a distributed system, or a server combined with a blockchain. The server 120 can also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology. The cloud server is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business expansion in traditional physical host and virtual private server (VPS, Virtual Private Server) services.

[0037] The system 100 can also include one or more databases 130. In certain embodiments, these databases can be used to store data and other information. For example, one or more of the databases 130 can be used to store information such as eye tracking information, barrage information, and display attribute information for each barrage. The databases 130 can reside in a variety of locations. For example, databases used by the clients 101, 102, 103, 104, 105, and / or 106 can reside locally on the clients, or can be remote from the clients and can communicate with the clients via a network or dedicated connection. As another example, databases used by the server 120 can reside locally on the server 120, or can be remote from the server 120 and can communicate with the server 120 via a network or dedicated connection. The databases 130 can be of different types. In certain embodiments, databases used by the server 120 can be, for example, a relational database. One or more of these databases can store, update, and retrieve data to and from the databases in response to commands.

[0038] In certain embodiments, one or more of the databases 130 can also be used by the application program to store application data. The databases used by the application program can be different types of databases, such as a key-value store, an object store, or a regular store supported by a file system.

[0039] Figure 1 The system 100 can be configured and operated in various ways to enable the application of various methods and apparatuses described in accordance with the present disclosure.

[0040] Figure 2 A flowchart of a method 200 of displaying a barrage in accordance with an embodiment of the present disclosure is shown. As shown, the method 200 can include: step S210, obtaining eye tracking information of a client user watching a played video; step S220, determining one or more target barrages associated with the eye tracking information from a plurality of barrages presented in the played video based on the eye tracking information; and step S230, adjusting display attribute information of the one or more target barrages. Figure 2

[0041] By obtaining the eye tracking information of the client user watching the played video in real time, the real attention and interest of the client user to the barrages on the display interface can be reflected. On this basis, adjusting the display attribute information of the associated one or more barrages can highlight the barrages that the client user is interested in, so that the user can watch clear and complete barrage content, not only improving the user's watching experience, but also facilitating the realization of barrage display control for individual differences between different users.

[0042] It will be understood that the eye tracking information of the client user watching the played video can be obtained in real time, and based thereon to determine the target barrages and adjust the display attributes of the target barrages, or information about the target barrages can be stored, and the display attribute adjustment can be performed when the user watches the video again, alone or together with the target barrages determined in real time.

[0043] According to some embodiments of the present disclosure, in step S210, the eye tracking information can be obtained by real-time tracking and recording the movement trajectory and fixation point of the eyes of the client user through eye movement tracking technologies such as infrared light, high-speed camera, etc. For example, an infrared light source and a camera can be used to capture the infrared light reflected by the eyes of the client user, and the fixation point and movement path of the eyes can be determined by analyzing the reflection pattern and eye shape. Further, a high-speed camera can record the micro-movement and transition of the eyes at a speed of, for example, 100 frames per second. Through a corresponding calibration process, an accurate mapping relationship can be established, thereby ensuring the accuracy and accuracy of the eye tracking information.

[0044] ​According to some embodiments of the present disclosure, in step S220, the eye tracking information can include current eye focus position information of the client user. The current eye focus position information may, for example, be position coordinates of the current eye focus. For example, when viewing the terminal device in landscape mode, a coordinate system can be established with the horizontal direction as the X axis, the vertical direction as the Y axis, and the direction perpendicular to the display screen of the terminal device as the Z axis. In this case, the current eye focus position information may, for example, be (Xi, Yi, Zi).

[0045] Figure 3 A flowchart of determining target bullet screens associated with a current time according to eye tracking information is shown according to an embodiment of the present disclosure. As shown in Figure 3 determining one or more target bullet screens associated with the eye tracking information from a plurality of bullet screens presented in a played video based on the eye tracking information can include: step S322, determining a subset of bullet screens within a first threshold distance range from the current eye focus position information included in the eye tracking information from the plurality of bullet screens; and step S324, determining one or more target bullet screens based on the subset of bullet screens.

[0046] According to some embodiments of the present disclosure, after obtaining the eye tracking information and the eye focus position coordinates indicated thereby, a bullet screen search frame can be determined with the coordinates as the center and a specific threshold distance as the radius. Then, all bullet screens on the current display interface falling within the bullet screen search frame can be selected as the subset of bullet screens.

[0047] It should be noted that falling within the bullet screen search frame can mean that the bullet screen completely falls within the bullet screen search frame, or that the bullet screen partially falls within the bullet screen search frame (for example, just rolling into the bullet screen search frame or about to roll out of the bullet screen search frame).

[0048] It should also be noted that the threshold distance can be any suitable value, such as 30 pixels, 50 pixels, 75 pixels, etc. The threshold distance can also be adapted according to actual application scenarios or needs, etc. For example, in the case of a large number of bullet screens, the threshold distance can be adapted to be smaller than in the case of a small number of bullet screens. For another example, in the scenario of a game video, the threshold distance can be adapted to be smaller than in the scenario of viewing a normal video. Thus, the target bullet screens corresponding to the client user can be more accurately determined.

[0049] Compared with the traditional way that the user manually selects the barrage of interest, by determining the current eye focus position information and the corresponding threshold distance range, the barrage area that more reflects the user's focus and interest point can be automatically determined, so that more accurate target barrage can be obtained from all the currently presented barrages. On the other hand, by setting the threshold distance range, in the case that there is no barrage at the current eye focus position, the target barrage search area can be expanded to avoid missing.

[0050] According to some embodiments of the present disclosure, the step S324 of determining one or more target barrages based on the barrage subset can include determining each barrage in the barrage subset as a target barrage.

[0051] According to some other embodiments of the present disclosure, with reference to Figure 4 , the step S324 of determining one or more target barrages based on the barrage subset can include the step S326 of calculating the distance between each barrage in the barrage subset and the current eye focus position indicated by the current eye focus position information, and the step S328 of determining the barrage as a target barrage in response to determining that the distance is less than the second threshold distance.

[0052] As described above, falling into the barrage search box can refer to the part of the barrage falling into the barrage search box (for example, just rolling into the barrage search box, about to roll out of the barrage search box). However, in general, the barrage about to roll out of the barrage search box can not be the barrage that the user expects to focus on and understand, and the barrage just rolling into the barrage search box can not have attracted the user's attention, so in some cases, such as the two types of barrages described above, the barrage can not accurately reflect the user's real attention and interest. By further calculating the distance between each barrage falling into the barrage search box and the current eye focus position, barrages that do not meet the needs of the scene can be further filtered out, thereby avoiding frequent automatic adjustment of the barrage display attribute operation.

[0053] According to some embodiments of the present disclosure, in the step S326, the distance between each barrage and the current eye focus position can be calculated by the following formula:

[0054]

[0055] wherein d represents the distance between the barrage m and the current eye focus i, (Xi, Yi, Zi) represents the coordinate value of the current eye focus i, and (Xm, Ym, Zm) represents the coordinate value of the center point of the barrage frame where the barrage m is located. In this document, the barrage frame can refer to a rectangular frame including the barrage, and the center point is the center point of the rectangular frame.

[0056] Further, in step S328, the second threshold distance can be set to any suitable value less than or equal to the threshold distance range, and the barrage whose distance value calculated according to the above formula is greater than the second threshold distance is filtered out, so as to obtain more accurate target barrage.

[0057] According to some embodiments of the present disclosure, the barrage display method 200 can further include updating the one or more target barrages, wherein updating the one or more target barrages can include: sorting the distance between each target barrage and the current eye focus position indicated by the current eye focus position information; and selecting the first preset number of target barrages with the smallest distance as the updated target barrage.

[0058] According to some examples, the first preset number can be any integer that meets the actual scene requirements, including but not limited to 5, 8, 10, etc., which may, for example, depend on the total number of all barrages currently displayed.

[0059] By sorting the distance between each target barrage and the current eye focus position, an ordered target barrage set arranged in ascending order can be obtained. By selecting the first preset number of barrages from the ordered target barrage set as the updated target barrage, the range of target barrage can be further narrowed, and the barrage that the user is really interested in or interested in can be more accurately determined.

[0060] Figure 4 A flowchart of a barrage display method 400 according to some other embodiments of the present disclosure is shown. Referring to Figure 4 , the method 400 can include steps S410-S430 similar to steps S210-S230 in the barrage display method 200 described with reference to Figure 2 ; and step S440, obtaining gaze duration information of the client user for the one or more target barrages.

[0061] If the current displayed number of bullet screens is large, there can be a case that the user only glances at all bullet screens without focusing on a certain bullet screen of interest. In this case, if the target bullet screen is determined according to all eye tracking information of the user in the glancing process, and the display attribute of the bullet screen is adjusted accordingly, a large number of bullet screens can be adjusted in display attribute, the display interface is cluttered, but the user's real intention is not to focus on these bullet screens. By obtaining the gaze duration information of the determined target bullet screen, the real intention of the user can be further determined. For example, if the gaze duration on a certain target bullet screen is only 0.1 second, it can be that the user only glances at the bullet screen. For another example, if the gaze duration on a certain target bullet screen is 1 second, it can mean that the user really focuses on the bullet screen, so it can be determined that the bullet screen is the user's focus point or point of interest. Adjusting the bullet screen on this basis not only meets the actual needs of the user and improves the viewing experience, but also avoids the inconvenience brought by the operation of adjusting the display attribute of a large number of bullet screens.

[0062] According to some embodiments of the present disclosure, the step S440 of obtaining the gaze duration information of the client user on the one or more target bullet screens can include: obtaining the current eye focus position, the corresponding time stamp and other eye movement features from the obtained eye tracking information; then, obtaining the trajectory change of the client user's focus point according to the current eye focus position, the corresponding time stamp and other eye movement features, and counting the gaze duration on each target bullet screen.

[0063] According to some embodiments of the present disclosure, the step S440 of obtaining the gaze duration information of the client user on the one or more target bullet screens can include: for each of the one or more target bullet screens: obtaining a time stamp list corresponding to the target bullet screen, wherein each time stamp in the time stamp list represents a time when the bullet screen was previously determined as a target bullet screen; and updating the time stamp list corresponding to the target bullet screen to include the current time.

[0064] Specifically, a corresponding timestamp list can be created for each target barrage, and whenever the barrage is determined to be a target barrage, the corresponding time is recorded in the timestamp list. For example, the eye tracking data can be called back at fixed time intervals (e.g., 0.5 seconds). In response to determining that the barrage is first determined to be a target barrage at the current time t, a timestamp list attention_time_list can be created for the barrage, and the time t is recorded in the list, attention_time_list = [t]. In response to determining that the barrage is determined to be a target barrage at a time before the current time t, for example, 1.5 seconds, 1 second, 0.5 seconds, then attention_time_list = [t-1.5, t-1, t-0.5, t]. It should be understood that non-fixed time intervals can also be used to call back the eye tracking data. Similarly, the time determined to be a target barrage is also recorded in the corresponding timestamp list.

[0065] By creating a timestamp list for each target barrage and recording the time when each barrage is determined to be a target barrage, the user's gaze duration on the barrage within a certain time period can be quickly calculated. Compared with obtaining the trajectory change of the user's focus point and directly timing the attention duration of each barrage, the above operation is simpler and requires less data storage.

[0066] According to some embodiments of the present disclosure, step S230 and / or step S430, adjusting the display attribute information of one or more target barrages can include: for each of the one or more target barrages, determining whether the corresponding gaze duration information of the target barrage meets a first preset standard; and in response to determining that the corresponding gaze duration information of the target barrage meets the first preset standard, adjusting the display attribute information of the target barrage.

[0067] By comparing the gaze duration with the first preset standard, it can be determined whether the user's gaze on the target barrage lasts for a preset time, thereby determining whether the user is truly interested in the target barrage. On this basis, the barrage is adjusted, which is more in line with the actual needs of the user, and avoids the operation of constantly adjusting the display attributes of a large number of barrages.

[0068] According to some examples, the first preset standard can be that the user's continuous gaze on the target barrage lasts for a preset time, for example, 2 seconds, 3 seconds.

[0069] According to some examples, the second preset number can be any integer satisfying actual scene requirements, including but not limited to 4, 6, 8, etc. Similarly, the third preset number can also be any integer satisfying actual scene requirements and less than the second preset number. The scope of protection required by the present disclosure is not limited in this respect.

[0070] According to some examples, the second preset number can be any integer satisfying actual scene requirements, including but not limited to 4, 6, 8, etc. Similarly, the third preset number can also be any integer satisfying actual scene requirements and less than the second preset number. The scope of protection required by the present disclosure is not limited in this respect.

[0071] For example, the timestamp list of a certain target barrage is attention_time_list = [1.5, 3, 4, 4.5, 5.5, 6], the current time t = 6, and the callback time interval of the eye tracking information is 0.5 seconds. In the case where the second preset number is 4 and the third preset number is 2, the four consecutive timestamps selected from the timestamp list are [4, 4.5, 5.5, 6]. Then, the time intervals between adjacent two timestamps are calculated as 0.5, 1, and 0.5, respectively, and the number of time intervals equal to the callback time interval 0.5 seconds is 2. In this case, it can be determined that the corresponding gaze duration of the target barrage meets the first preset standard.

[0072] In the process of watching a played video, the scrolling speed of each barrage may be different, which may cause the client user to be covered by a barrage with faster scrolling speed and "steal" the current eye focus while watching a certain barrage, but in fact the client still expects to continue watching the previously watched barrage. In addition, the client user may also cause the current eye focus to leave a certain barrage due to distraction or other reasons. By setting the second preset number and the third preset number, especially in the case where the third preset number is set to be less than the second preset number, the instantaneous defocus in the eye movement tracking process can be avoided.

[0073] According to some embodiments of the present disclosure, step S230 and / or step S430, adjusting the display attribute information of one or more target barrages, can further include: in response to determining that the corresponding gaze duration information of the target barrage no longer meets the first preset standard, adjusting the display attribute information of the target barrage to the previous display attribute information.

[0074] According to some examples, as described above, in the case where the first preset criterion is that the continuous time length of the user's gaze on the target barrage is equal to a preset time, when the client user shifts his gaze from the target barrage to a non-barrage area on the display screen, the user can no longer be interested in the target barrage, at which time the display attribute information of the target barrage can be adjusted to the previous display attribute information, so as to, for example, restore the original barrage display effect, for example, restore the default display font size, display font color, barrage running track, etc.

[0075] According to some examples, as described above, in the case where the first preset criterion is that the continuous time length of the user's gaze on the target barrage is equal to a preset time, when the client user shifts his gaze from the target barrage to a non-barrage area on the display screen, the user can no longer be interested in the target barrage, at which time the display attribute information of the target barrage can be adjusted to the previous display attribute information, so as to, for example, restore the original barrage display effect, for example, restore the default display font size, display font color, barrage running track, etc.

[0076] By restoring the display attribute of the target barrage as usual or to the adjusted display attribute when the gaze time on the target barrage does not meet the criterion, the display effect of the barrage on the client display screen can be adjusted in a timely manner during the constant change of the user's eye focus position, avoiding the barrage that is no longer the user's focus point still being highlighted, so that the barrage is displayed more clearly, which is conducive to improving the user's viewing experience.

[0077] According to some examples of the present disclosure, the step S230 of adjusting the display attribute information of one or more target barrages can include adjusting one or more of the following information of one or more target barrages: three-dimensional coordinate information, display size information, font information, animation effect information, and barrage track information.

[0078] As described above, the existing barrage is usually displayed on the 2D plane display area of the terminal device, and is usually displayed in a default or artificially set manner. However, in the case where a large number of barrages exist at the same time, merely using the above-mentioned default adjustment of barrage display manner can not be able to further distinguish and display the overlapping barrages.

[0079] Therefore, the barrage can be displayed by using a spatial 3D display technology. The spatial 3D technology refers to presenting content to a user in a realistic three-dimensional form by using a display device (e.g., a head-mounted display or a stereoscopic display) that employs advanced optical technology and special display devices and a rendering technology. The technology has a high-resolution, high-refresh-rate display screen, and combines precise image processing and projection algorithms to achieve a three-dimensional visual effect of each content element as in the real world. In this display mode, by adjusting the three-dimensional coordinate information, display size information, font information, animation effect information, and barrage trajectory information of the target barrage, barrages with different distances, different levels, different sizes, different animation effects, and different motion trajectories can be presented in the three-dimensional space, so that the user can not only feel the depth and stereoscopic effect of the real world, but also avoid the overlapping display of barrages, thereby obtaining a clearer viewing experience of the barrage.

[0080] According to some embodiments of the present disclosure, adjusting the three-dimensional coordinate information of the one or more target barrages and / or the display size information of the one or more target barrages can include: calculating a distance between each of the one or more target barrages and a current eye focus position indicated by the eye tracking information; and determining the three-dimensional coordinate information and / or the display size information of each target barrage based on the distance corresponding to the target barrage.

[0081] By calculating the distance between each target barrage and the current eye focus position, the target barrages can be sorted in descending order, and the smaller the distance, the higher the attention or interest of the user to the corresponding target barrage. Therefore, adjusting the three-dimensional coordinate information and / or the display size information of the target barrage based on the distance can distinguish the display of the target barrage, so that the target barrage that the user pays more attention to is displayed more clearly or prominently.

[0082] It will be understood that the calculation of the distance between each target barrage and the current eye focus position indicated by the eye tracking information can be the same as or similar to the calculation method used in step S326 described above. For the sake of brevity, it will not be described here again.

[0083] According to some embodiments of the present disclosure, determining the three-dimensional coordinate information and / or the display size information of each target barrage based on the distance corresponding to the target barrage can include: sorting the calculated distances corresponding to each target barrage; and determining the three-dimensional coordinate information and / or the display size information of each target barrage based on the sorting result.

[0084] According to some examples, the three-dimensional coordinate information of each target barrage can be determined based on the position of the target barrage in the descendingly sorted set, the distance between the display screen of the terminal device and the eyes of the user. For example, the Z-axis coordinate of each target barrage can be calculated by the following formula:

[0085] Z i =Z i0 +(i+1)*(Z0 / n)

[0086] wherein Z i represents the Z-axis coordinate of the i-th target barrage after being arranged in descending order (i=[0,n-1]), Z i0 represents the original Z-axis coordinate of the i-th target barrage, Z0represents half of the distance between the display screen of the terminal device and the user's eye (it will be understood that Z0is not limited to half of the distance between the display screen and the user's eye, but can also be one-third, two-thirds, or any suitable value of the distance), and n represents the total number of target barrages.

[0087] In the above manner, hierarchical arrangement of target barrage blocks can be achieved, so that the target barrage blocks closer to the current eye focus position are displayed closer to the user's eye, so that the user can more clearly watch the barrages of interest or interest, and improve the viewing experience.

[0088] According to some examples, the display size information of each target barrage can also be determined based on the position of the target barrage in the descendingly sorted set, the distance between the terminal device display screen and the user's eye. For example, the magnification ratio of each target barrage can be calculated by the following formula:

[0089] S i =1+(i+1)*(1 / n)

[0090] wherein S i represents the magnification ratio of the i-th target barrage after being arranged in descending order (i=[0,n-1]), 1 represents the original magnification ratio of the i-th target barrage (i.e., no magnification), and n represents the total number of target barrages.

[0091] Similarly, in the above manner, the target barrage blocks can be proportionally magnified, so that the target barrage blocks closer to the current eye focus position are displayed with a larger magnification ratio, so that the user can more clearly watch the barrages of interest or interest, and improve the viewing experience.

[0092] According to some embodiments of the present disclosure, adjusting the animation effect information of the one or more target bullet screens can include: for each of the one or more target bullet screens, configuring an interaction option for the target bullet screen, the interaction option being configured to be displayed on the client in association with the target bullet screen; obtaining gaze duration information of the client user on the interaction option of the target bullet screen; and in response to determining that the gaze duration information of the client user on the interaction option of the target bullet screen meets a second preset criterion, configuring an interaction animation effect for the target bullet screen to be displayed on the client in association with the target bullet screen.

[0093] According to some examples, the interaction option can be, for example, a like, a report, a reply, or the like, associated with the target bullet screen, so that when the user's eye focus is positioned on the target bullet screen, the user's interactive expression on the target bullet screen can be quickly realized through these interaction options.

[0094] According to some examples, the second preset criterion can be similar to the first preset criterion. For example, meeting the second preset criterion can be that the continuous duration of the user's gaze on the interaction option is equal to a preset time. For another example, meeting the second preset criterion can be that from a list of time stamps of the interaction option, a continuous fourth preset number of time stamps including the current time are selected; the time interval between each adjacent two time stamps in the fourth preset number of time stamps is calculated; and in response to determining that the number of time intervals equal to the callback time interval of the eye tracking information is not less than a fifth preset number, it is determined that the corresponding gaze duration information of the interaction option meets the second preset criterion. Wherein, the selection of the preset number can be the same as or similar to the selection of the preset number in the description of the first preset criterion above, and therefore will not be described here.

[0095] Accordingly, after displaying the interaction option of the target bullet screen, when the gaze duration of the user on the interaction option meets the preset criterion described above, the interaction animation effect for the interaction option can be displayed. Examples of the interaction animation effect include, but are not limited to, an animation effect of automatically displaying "+1" near the interaction option, an animation effect of automatically displaying a heart near the interaction option, changing the font color, font size of the interaction option, and / or changing the motion trajectory of the interaction option, etc.

[0096] By configuring the interaction option for the target bullet screen, the interactive experience of the client user when watching the video can be further enhanced. At the same time, by automatically displaying animation effects such as "+1", for example, the user's operation can be reduced while realizing the user's interactive expression on the target bullet screen.

[0097] According to some embodiments of the present disclosure, adjusting the font information can refer to adjusting the display font of the target barrage to be different from the display font of other barrages, for example, adjusting the display font of the target barrage to be Kai Ti, while the display font of other barrages is the default Song Ti. According to still some embodiments of the present disclosure, adjusting the barrage track information can refer to adjusting the motion track of the target barrage to be different from the motion track of other barrages, for example, adjusting the motion track of the target barrage to be reverse movement from left to right, while the motion track of other barrages is forward movement from right to left. It should be understood that any one of the above display attribute information or a plurality of display attribute information of the above display attribute information can be adjusted in combination according to the actual scene (for example, according to the number of barrages) to further highlight the target barrage to distinguish from other barrages.

[0098] Figure 5 A flowchart of a barrage display method 500 according to some embodiments of the present disclosure is shown. As shown, the method 500 can include: step S510, obtaining eye tracking information of a client user watching a played video; step S520, determining a barrage subset within a first threshold distance range from current eye focus position information included in the eye tracking information from a plurality of barrages presented in the played video; step S530, calculating a distance between each barrage in the barrage subset and a current eye focus position indicated by the current eye focus position information, and determining the barrage as a target barrage in response to determining that the distance is less than a threshold distance; step S540, sorting the distance between each target barrage and the current eye focus position, and selecting a first preset number of target barrages with the smallest distance as updated target barrages; step S550, obtaining a timestamp list corresponding to the target barrage, updating the timestamp list corresponding to the target barrage to include a current time; step S560, selecting a latest continuous second preset number of timestamps from the timestamp list of the target barrage; step S570, determining whether the number of callback time intervals for each adjacent two timestamps is not less than a third preset number; step S580, in response to determining that the number of callback time intervals for each adjacent two timestamps is not less than the third preset number, sorting the calculated distance between the current eye focus position and each target barrage, and adjusting three-dimensional coordinate information and display size information of the target barrage based on the sorting result; and step S590, in response to determining that the number of callback time intervals for each adjacent two timestamps is less than the third preset number, abandoning to adjust the display attribute information of the target barrage. Figure 5 It should be understood that,

[0099] Figure 5 ​The various steps in the described method 500 can be similar to the operations, features, and advantages described above for methods 200 and 400. For the sake of brevity, certain operations, features, and advantages are not described again here.

[0100] Figure 6 A structural block diagram of a barrage display apparatus 600 is shown according to an embodiment of the present disclosure. As shown, the barrage display apparatus 600 can include: an acquisition unit 610 configured to acquire eye tracking information of a client user watching a played video; a target barrage determination unit 620 configured to determine one or more target barrages associated with the eye tracking information from a plurality of barrages presented in the played video based on the eye tracking information; and an adjustment display attribute information unit 630 configured to adjust display attribute information of the one or more target barrages. Figure 6

[0101] By acquiring the eye tracking information of the client user watching the played video in real time, the real attention and interest of the client user to the barrages on the display interface can be reflected. On this basis, adjusting the display attribute information of the associated one or more barrages can highlight the barrages that the client user is interested in, so that the user can watch clear and complete barrage content, not only improving the user's viewing experience, but also facilitating the realization of barrage display control for individual differences between different users.

[0102] According to some embodiments of the present disclosure, the eye tracking information can include current eye focus position information of the client user, and wherein the target barrage determination unit 620 can include: a barrage subset determination unit configured to determine a barrage subset within a first threshold distance range from the current eye focus position information included in the eye tracking information from the plurality of barrages; and a target barrage subset determination unit configured to determine the one or more target barrages based on the barrage subset.

[0103] According to some embodiments of the present disclosure, the target barrage subset determination unit can include determining each barrage in the barrage subset as a target barrage.

[0104] According to some embodiments of the present disclosure, the target barrage subset determination unit can include calculating a distance between each barrage in the barrage subset and a current eye focus position indicated by the current eye focus position information; and in response to determining that the distance is less than a second threshold distance, determining the barrage as a target barrage.

[0105] ​According to some embodiments of the present disclosure, the barrage display apparatus 600 can further include an updating unit configured to update the one or more target barrages, wherein the updating unit can include: a unit configured to sort a distance between each target barrage and a current eye focus position indicated by the current eye focus position information; and a unit configured to select a first preset number of target barrages with the smallest distance as updated target barrages.

[0106] According to some embodiments of the present disclosure, the barrage display apparatus 600 can further include a gaze duration obtaining unit configured to obtain gaze duration information of the client user for the one or more target barrages.

[0107] According to some embodiments of the present disclosure, the display attribute information adjusting unit 630 can include: a unit configured to determine, for each of the one or more target barrages, whether corresponding gaze duration information of the target barrage satisfies a first preset criterion; and a unit configured to adjust display attribute information of the target barrage in response to determining that the corresponding gaze duration information of the target barrage satisfies the first preset criterion.

[0108] According to some embodiments of the present disclosure, the display attribute information adjusting unit 630 can further include a unit configured to adjust the display attribute information of the target barrage to previous display attribute information in response to determining that the corresponding gaze duration information of the target barrage no longer satisfies the first preset criterion.

[0109] According to some embodiments of the present disclosure, the gaze duration obtaining unit can include, for each of the one or more target barrages: a unit configured to obtain a timestamp list corresponding to the target barrage, wherein each timestamp in the timestamp list represents a time when the barrage was previously determined to be a target barrage; and a unit configured to update the timestamp list corresponding to the target barrage to include a current time.

[0110] According to some embodiments of the present disclosure, the unit configured to determine whether the corresponding gaze duration information of the target barrage satisfies the first preset criterion can include: a unit configured to select, from the timestamp list of the target barrage, a second preset number of continuous timestamps including the current time; a unit configured to calculate a time interval between each adjacent two timestamps in the second preset number of timestamps; and a unit configured to determine that the corresponding gaze duration information of the target barrage satisfies the first preset criterion in response to determining that a number of callback time intervals equal to the time interval is not less than a third preset number, wherein the callback time interval represents a sampling time interval at which the eye tracking information is obtained.

[0111] According to some embodiments of the present disclosure, the adjusting display attribute information unit 630 can comprise an adjusting sub-unit configured to adjust one or more of the following information of the one or more target bullet screens: three-dimensional coordinate information, display size information, font information, animation effect information, and bullet screen track information.

[0112] According to some embodiments of the present disclosure, the adjusting sub-unit can comprise a unit configured to calculate a distance between each of the one or more target bullet screens and the current eyeball focal point position indicated by the eyeball tracking information; and a unit configured to determine the three-dimensional coordinate information and / or the display size information of each of the target bullet screens based on the distance corresponding to the target bullet screen.

[0113] According to some embodiments of the present disclosure, the unit configured to determine the three-dimensional coordinate information and / or the display size information of each of the target bullet screens based on the distance corresponding to the target bullet screen can comprise a unit configured to sort the calculated distances corresponding to each of the target bullet screens; and a unit configured to determine the three-dimensional coordinate information and / or the display size information of each of the target bullet screens based on the sorting result.

[0114] According to some embodiments of the present disclosure, the adjusting sub-unit can comprise, for each of the one or more target bullet screens, a unit configured to configure an interactive option for the target bullet screen, the interactive option being configured to be displayed on the client in association with the target bullet screen; a unit configured to obtain gaze duration information of the client user on the interactive option of the target bullet screen; and a unit configured to configure an interactive animation effect for the target bullet screen to be displayed on the client in association with the target bullet screen in response to determining that the gaze duration information of the client user on the interactive option of the target bullet screen satisfies a second preset criterion.

[0115] It should be understood that Figure 6 The various units of the apparatus 600 shown in FIG. 6 can correspond to the various steps in the methods 200, 400, 500 described with reference to Figure 2 , Figure 3 , Figure 4 and Figure 5 Thus, the operations, features, and advantages described above with respect to the methods 200, 400, 500 apply equally to the apparatus 600 and the units included therein. For the sake of brevity, certain operations, features, and advantages are not described again here.

[0116] It should also be understood that the techniques described herein can be described in the general context of software hardware elements or program modules. The methods described above with respect to Figure 6The various units described can be implemented in hardware or in hardware combined with software and / or firmware. For example, the units can be implemented as computer program code / instructions configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, the units can be implemented as hardware logic / circuitry. For example, in some embodiments, one or more of the acquiring unit 610, the determining target barrage unit 620, and the adjusting display attribute information unit 630 can be implemented together in a System on Chip (SoC). The SoC can include an integrated circuit chip (which includes one or more of a processor (e.g., a Central Processing Unit (CPU), a microcontroller, a microprocessor, a Digital Signal Processor (DSP), etc.), a memory, one or more communication interfaces, and / or other circuitry), and can optionally execute received program code and / or include embedded firmware to perform functions.

[0117] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and at least one memory communicatively connected with the at least one processor; wherein the at least one memory stores a computer program which, when executed by the at least one processor, implements the barrage display method described above.

[0118] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program is also provided, wherein the computer program, when executed by a processor, implements the barrage display method described above.

[0119] According to another aspect of the present disclosure, a computer program product is also provided, comprising a computer program, wherein the computer program, when executed by a processor, implements the barrage display method described above.

[0120] Referring to Figure 7 A block diagram of an electronic device 700, which can be an example of a hardware device that can be used in aspects of the present disclosure, will now be described as an example of an electronic device that can be used as a host client or a viewer client of the present disclosure. The electronic device can be different types of computer devices, such as a laptop computer, a desktop computer, a workstation, a personal digital assistant, a server, a blade server, a mainframe computer, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components, their connections, and their functions, as described herein, are meant only to be examples and are not intended to limit the implementations of the present disclosure described and / or claimed in this document.

[0121] As shown in FIG. 7, the electronic device 700 can include at least one processor 710, a working memory 720, an input unit 740, a display unit 750, a speaker 760, a storage unit 770, a communication unit 780, and other output unit 790, which can communicate with each other via a system bus 730. Figure 7

[0122] The processor 710 can be a single processing unit or a plurality of processing units, all of which can include single or multiple computing units or multiple cores. The processor 710 can be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitries, and / or any devices that manipulate signals based on operational instructions. The processor 710 can be configured to retrieve and execute computer-readable instructions stored in the working memory 720, the storage unit 770, or other computer-readable media, such as program codes of an operating system 720a, program codes of an application 720b, and the like.

[0123] The working memory 720 and the storage unit 770 are examples of computer-readable storage media for storing instructions that are executed by the processor 710 to implement the various functions described above. The working memory 720 can include both volatile memory and non-volatile memory (e.g., RAM, ROM, and the like). In addition, the storage unit 770 can include a hard disk drive, a solid state drive, removable media, including external and removable drives, memory cards, flash memory, floppy disks, optical disks (e.g., CD, DVD), storage arrays, network attached storage, storage area networks, and the like. The working memory 720 and the storage unit 770 can be collectively referred to herein as a memory or a computer-readable storage medium, and can be a non-transitory medium capable of storing computer-readable, processor-executable program instructions as computer program codes that can be executed by the processor 710 as a particular machine configured to implement the operations and functions described in the examples herein.

[0124] ​The input unit 760 can be any type of device capable of inputting information to the electronic device 700, and can receive inputted digital or character information, and generate key signal input related to user settings and / or function control of the electronic device, and can include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a jog wheel, a microphone, and / or a remote control. The output unit can be any type of device capable of presenting information, and can include, but is not limited to, the display unit 750, a speaker 760, and other output units 790, which can include, but are not limited to, a video / audio output terminal, a vibrator, and / or a printer. The communication unit 780 allows the electronic device 700 to exchange information / data with other devices through a computer network, such as the Internet, and / or various telecommunication networks, and can include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and / or a chipset, such as a Bluetooth TM device, an 802.11 device, a Wi-Fi device, a WiMAX device, a cellular communication device, and / or the like.

[0125] The application program 720b in the working register 720 can be loaded to execute the various methods and processes described above, such as Figure 2 steps S210-S230 in the method 200, Figure 3 steps S322-S328 in the method 400, and Figure 4 steps S410-S440 in the method 500. For example, in some embodiments, the methods 200, 400, 500 described above can be implemented as a computer software program, which is tangibly embodied in a machine-readable medium, such as the storage unit 770. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 700 via the storage unit 770 and / or the communication unit 780. When the computer program is loaded and executed by the processor 710, one or more steps of the methods 200, 400, 500 described above can be performed. Alternatively, in other embodiments, the processor 710 can be configured to perform the methods 200, 400, 500 by any other suitable means, such as by means of firmware.

[0126] The various embodiments of the systems and techniques described above can be implemented in digital electronic circuitry, integrated circuitry, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on a chip (SOC), a load programmable logic device (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include implementation in one or more computer programs that are executable and / or interpretable on a programmable system including at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0127] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces the functions / operations specified in the flowcharts and / or the block diagrams. The program code can be executed entirely on a machine, partially on a machine, partially on a machine as a stand-alone software package, or entirely on a remote machine or server.

[0128] In the context of the present disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0129] To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0130] The systems and techniques described here can be implemented in a computing system that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0131] The computing system can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

[0132] It should be understood that the various forms of flow shown above can be re-ordered, added to, or deleted from without departing from the spirit of the present disclosure. For example, the steps recited in the present disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technology disclosed in the present disclosure are achieved, which is not limited herein.

[0133] While embodiments or examples of this disclosure have been described with reference to the figures, it will be understood that the methods, systems, and devices described above are merely exemplary embodiments or examples, and the scope of the application is not limited to these embodiments or examples. Various elements of the embodiments or examples can be omitted or substituted by equivalents thereof. Furthermore, the steps can be performed in a different order than described in the disclosure. Further, various elements of the embodiments or examples can be combined in various ways. It is important that as technology evolves, many of the elements described herein can be substituted by equivalents which serve the same function.

Claims

1. A method for displaying a barrage of messages, comprising: obtaining eye tracking information of a client user watching a playing video; determining one or more target barrages of messages from a plurality of barrages of messages presented in the playing video based on the eye tracking information; obtaining gaze duration information of the client user for the one or more target barrages of messages, comprising: for each target barrage of message in the one or more target barrages of messages: obtaining a list of timestamps corresponding to the target barrage of message, wherein each timestamp in the list of timestamps represents a time when the barrage of message was previously determined to be a target barrage of message; and updating the list of timestamps corresponding to the target barrage of message to include a current time; and adjusting display attribute information of the one or more target barrages of messages, comprising: for each target barrage of message in the one or more target barrages of messages, determining whether corresponding gaze duration information of the target barrage of message satisfies a first preset criterion, comprising: selecting a first preset number of consecutive timestamps including the current time from the list of timestamps of the target barrage of message; calculating a time interval between each pair of adjacent timestamps in the first preset number of timestamps; and in response to determining that a number of the time intervals equal to a callback time interval of the eye tracking information is not less than a second preset number, determining that the corresponding gaze duration information of the target barrage of message satisfies the first preset criterion, wherein the callback time interval represents a sampling time interval of obtaining the eye tracking information; and in response to determining that the corresponding gaze duration information of the target barrage of message satisfies the first preset criterion, adjusting the display attribute information of the target barrage of message.

2. The method of claim 1, wherein, the eye tracking information comprises current eye focus position information of the client user, and wherein determining the one or more target barrages of messages from the plurality of barrages of messages presented in the playing video based on the eye tracking information comprises: determining a subset of barrages of messages from the plurality of barrages of messages that are within a first threshold distance range from the current eye focus position information included in the eye tracking information; and determining the one or more target barrages of messages based on the subset of barrages of messages.

3. The method of claim 2, wherein, determining the one or more target barrages of messages based on the subset of barrages of messages comprises: determining each barrage of message in the subset of barrages of messages as a target barrage of message.

4. The method of claim 2, wherein, determining the one or more target barrages of messages based on the subset of barrages of messages comprises: calculating a distance between each barrage of message in the subset of barrages of messages and a current eye focus position indicated by the current eye focus position information; and in response to determining that the distance is less than a second threshold distance, determining the barrage of message as a target barrage of message.

5. The method of claim 3 or 4, further comprising updating the one or more target barrages, wherein, updating the one or more target barrages of messages comprises: sorting distances between each target barrage of message and a current eye focus position indicated by the current eye focus position information; and selecting a third preset number of target barrages of messages with the smallest distances as updated target barrages of messages.

6. The method of claim 1, wherein, adjusting the display attribute information of the one or more target barrages of messages further comprises: adjust the display attribute information of the target barrage to the previous display attribute information in response to determining that the corresponding gaze duration information of the target barrage no longer satisfies the first preset standard.

7. The method of any one of claims 1-4, wherein, adjusting the display attribute information of the one or more target barrages includes adjusting one or more of the following information of the one or more target barrages: three-dimensional coordinate information, display size information, font information, animation effect information, and barrage trajectory information.

8. The method of claim 7, wherein, adjusting the three-dimensional coordinate information of the one or more target barrages and / or the display size information of the one or more target barrages includes: calculating a distance between each of the one or more target barrages and a current eye focus position indicated by the eye tracking information; and determining the three-dimensional coordinate information and / or the display size information of each of the one or more target barrages based on the distance corresponding to the target barrage.

9. The method of claim 8, wherein, determining the three-dimensional coordinate information and / or the display size information of each of the one or more target barrages based on the distance corresponding to the target barrage includes: sorting the calculated distance corresponding to each of the one or more target barrages; and determining the three-dimensional coordinate information and / or the display size information of each of the one or more target barrages based on the sorting result.

10. The method of claim 7, wherein, adjusting the animation effect information of the one or more target barrages includes, for each of the one or more target barrages, configuring an interactive option for the target barrage, the interactive option being configured to be displayed on the client in association with the target barrage; obtaining gaze duration information of the client user on the interactive option of the target barrage; and configuring an interactive animation effect for the target barrage to be displayed on the client in association with the target barrage in response to determining that the gaze duration information of the client user on the interactive option of the target barrage satisfies a second preset standard.

11. A barrage display apparatus, comprising: an obtaining unit configured to obtain eye tracking information of a client user watching a played video; a target barrage determining unit configured to determine one or more target barrages associated with the eye tracking information from a plurality of barrages presented in the played video based on the eye tracking information; an obtaining gaze duration unit configured to obtain gaze duration information of the client user on the one or more target barrages, wherein the obtaining of the gaze duration information of the client user on the one or more target barrages includes: for each of the one or more target barrages: obtaining a timestamp list corresponding to the target barrage, wherein each timestamp in the timestamp list represents a time when the barrage was previously determined to be a target barrage; and updating the timestamp list corresponding to the target barrage to include a current time; and an adjusting display attribute unit configured to adjust display attribute information of the one or more target barrages, wherein the adjusting of the display attribute information of the one or more target barrages includes: for each of the one or more target barrages, determining whether corresponding gaze duration information of the target barrage satisfies a first preset standard, including: selecting, from the timestamp list of the target barrage, a first preset number of continuous timestamps including the current time point; calculating a time interval between each two adjacent timestamps in the first preset number of timestamps; and in response to determining that the time interval is equal to a number of callback time intervals of the eye tracking information, which represents a sampling time interval of the eye tracking information, is not less than a second preset number, determining that the corresponding gaze duration information of the target barrage meets the first preset standard; and in response to determining that the corresponding gaze duration information of the target barrage meets the first preset standard, adjusting the display attribute information of the target barrage.

12. An electronic device, comprising: at least one processor; and at least one memory connected with the at least one processor in communication, wherein the at least one memory stores a computer program which, when executed by the at least one processor, implements the method of any one of claims 1-10.

13. A non-transitory computer readable storage medium storing a computer program, wherein, The computer program, when executed by the processor, implements the method of any one of claims 1-10.

14. A computer program product comprising a computer program, wherein, The computer program, when executed by the processor, implements the method of any one of claims 1-10.

Citation Information

Patent Citations

  • Method and device for display bullet screen

    CN109246463A

  • Method and device for adjusting display attribute of bullet screen in virtual reality equipment

    CN110221695A