Bullet screen display method and device, electronic equipment and storage medium
By obtaining the eye tracking information of the client user in real time, determining and adjusting the display attributes of the target barrage, the problem of overlapping barrage in hot videos is solved, the user's viewing experience is improved and individual barrage display control is realized.
Patent Information
- Application Number
- CN202311273612.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-27
- Publication Date
- 2025-03-28
- Estimated Expiration
- 2043-09-27
AI Technical Summary
When watching hot videos, a large number of users send barrage at the same time, the barrage overlaps with each other, and it is impossible to clearly identify the specific text content of the barrage, affecting the user's reading and viewing experience.
By obtaining the eye tracking information of the client user in real time, determining the target barrage associated with the eye tracking information, and adjusting its display attribute information to highlight the barrage that the client user is concerned about.
It realizes the key display of barrages that the client user is concerned about, allowing users to view clearly and complete barrage content, improves the user's viewing experience, and is conducive to the realization of barrage display control over individual differences between different users.
Smart Images

Figure CN119729089A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology, and in particular to a bullet screen display method and device, an electronic device, a computer-readable storage medium, and a computer program product. Background Art
[0002] With the continuous development of Internet technology, users are no longer limited to watching video media through traditional methods such as TV, but can watch online video media through the Internet. Bullet comments are interactive comments that scroll rapidly in the form of text when watching online video media. Users can not only express their opinions by posting bullet comments, but also interact with the displayed bullet comments, thereby increasing the fun of watching video media for users.
[0003] The methods described in this section are not necessarily methods that have been previously conceived or employed. Unless otherwise indicated, it should not be assumed that any method described in this section is considered to be prior art simply because it is included in this section. Similarly, unless otherwise indicated, the issues mentioned in this section should not be considered to have been recognized in any prior art. Summary of the invention
[0004] The present disclosure provides a bullet screen display method and device, an electronic device, a computer-readable storage medium, and a computer program product.
[0005] According to one aspect of the present disclosure, a method for displaying barrages is provided, including: obtaining eye tracking information of a client user watching a playing video; based on the eye tracking information, determining one or more target barrages associated with the eye tracking information from multiple barrages presented in the playing video; and adjusting display attribute information of the one or more target barrages.
[0006] According to another aspect of the present disclosure, a barrage display device is provided, including: an acquisition unit, configured to acquire eye tracking information of a client user watching a played video; a target barrage determination unit, configured to determine one or more target barrages associated with the eye tracking information from multiple barrages presented in the played video based on the eye tracking information; and a display attribute information adjustment unit, configured to adjust display attribute information of one or more target barrages.
[0007] According to another aspect of the present disclosure, an electronic device is also provided, including: at least one processor; and at least one memory communicatively connected to the at least one processor, wherein the at least one memory stores a computer program, and the computer program implements the above-mentioned barrage display method when executed by the at least one processor.
[0008] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program is also provided, wherein the computer program implements the above-mentioned barrage display method when executed by a processor.
[0009] According to another aspect of the present disclosure, a computer program product is also provided, including a computer program, wherein the computer program implements the above-mentioned barrage display method when executed by a processor.
[0010] According to one or more embodiments of the present disclosure, it is possible to obtain eye tracking information of a client user watching a played video in real time, and adjust the display attribute information of one or more barrages associated with the eye tracking information. Since the eye tracking information can reflect the position of the client user's gaze point on the current display interface in real time, it can better reflect the client user's real attention and interest in the barrage on the display interface. Based on this, the display attribute information of the associated barrage is automatically adjusted, and the barrage that the client user is concerned about can be displayed prominently, so that the user can view clear and complete barrage content, which not only improves the user's viewing experience, but also helps to achieve barrage display control for individual differences between different users.
[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.
[0013] Figure 1 A schematic diagram showing an exemplary system in which the various methods described herein may be implemented according to an embodiment of the present disclosure;
[0014] Figure 2 A flowchart of a bullet screen display method according to an embodiment of the present disclosure is shown;
[0015] Figure 3 A flow chart of determining a target barrage at a current moment associated with eye tracking information according to an embodiment of the present disclosure is shown;
[0016] Figure 4 A flowchart of a bullet screen display method according to other embodiments of the present disclosure is shown;
[0017] Figure 5A flowchart of a bullet screen display method according to other embodiments of the present disclosure is shown;
[0018] Figure 6 A structural block diagram of a bullet screen display device according to an embodiment of the present disclosure is shown;
[0019] Figure 7 A structural block diagram of an exemplary electronic device that can be used to implement the embodiments of the present disclosure is shown. DETAILED DESCRIPTION
[0020] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope of the present disclosure. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0021] In the present disclosure, unless otherwise specified, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, timing relationship, or importance relationship of these elements, and such terms are only used to distinguish one element from another element. In some examples, the first element and the second element may refer to the same instance of the element, and in some cases, based on the description of the context, they may also refer to different instances.
[0022] The terms used in the description of various examples in this disclosure are only for the purpose of describing specific examples and are not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the element can be one or more. In addition, the term "and / or" used in this disclosure covers any one of the listed items and all possible combinations.
[0023] With the continuous development of Internet technology, users are no longer limited to watching video media through traditional methods such as TV, but can watch online video media through the Internet. Bullet comments are interactive comments that scroll rapidly in the form of text when watching online video media. Users can not only express their opinions by posting bullet comments, but also interact with the displayed bullet comments, thereby increasing the fun of watching video media for users.
[0024] The current barrage display methods generally include barrage arrangement, style adjustment, animation effects, occlusion processing, adaptive display, etc. Barrage arrangement refers to displaying barrage according to the time when the user sends the barrage and a certain display rule, such as scrolling the barrage from the right to the left of the display screen of the terminal device, displaying the barrage in a fixed position, or displaying the barrage in different areas. Style adjustment refers to displaying the barrage in a certain font, color, etc. Animation effect refers to giving a specific animation effect to a specific barrage, for example, giving a corresponding animation effect according to the meaning of the text represented by the barrage. Occlusion processing refers to dynamically adjusting the position and transparency of the barrage by calculating the position and size of the barrage to avoid the barrage from blocking important content in the video being played. Adaptive display refers to adjusting the size and layout of the barrage according to the current display screen size and resolution of the terminal device, so that the barrage can be properly displayed on various devices.
[0025] However, the inventors have found that for some popular videos, a large number of users may send bullet comments at the same time, which will cause a large number of bullet comments to appear on the screen at the same time. Even if the bullet comment display method described above is adopted, the bullet comments may still overlap with each other, and the specific text content of the bullet comments cannot be clearly identified. This will greatly affect the user's reading and viewing experience, causing some important information or comments to be ignored.
[0026] In view of this, an embodiment of the present disclosure provides a method for displaying a barrage of bullets, which can obtain eye tracking information of a client user who is watching a video in real time, and adjust the display attribute information of one or more barrages associated with the eye tracking information. Since the eye tracking information can reflect the position of the client user's gaze point on the current display interface in real time, it can better reflect the client user's real attention and interest in the barrage on the display interface. Based on this, the display attribute information of the associated barrage is automatically adjusted, and the barrage that the client user is concerned about can be displayed in a focused manner, so that the user can see clear and complete barrage content, which not only improves the user's viewing experience, but also helps to realize the barrage display control of individual differences between different users.
[0027] The embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.
[0028] Figure 1 FIG. 1 is a schematic diagram of an exemplary system 100 in which various methods and apparatuses described herein may be implemented according to an embodiment of the present disclosure. Figure 1, system 100 includes one or more client devices 101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks 110 coupling the one or more client devices to the server 120. The client devices 101, 102, 103, 104, 105, and 106 may be configured to execute one or more applications. It should be understood that although Figure 1 Only six client devices are depicted, but the present disclosure may support any number of client devices.
[0029] exist Figure 1 In the system shown, the server 120 may include one or more components to implement one or more operations performed by it. For example, in an embodiment of the present disclosure, the one or more operations may include the above-mentioned one or more steps of determining the target barrage and adjusting its corresponding display attribute information. These components may include software components, hardware components, or a combination thereof that can be executed by one or more processors. Users operating client devices 101, 102, 103, 104, 105 and / or 106 can in turn use one or more client applications to interact with the server 120 to utilize the services provided by these components. It should be understood that a variety of different system configurations are possible, which may be different from system 100. Therefore, Figure 1 is one example of a system for implementing the various methods described herein and is not intended to be limiting.
[0030] A user may use client devices 101, 102, 103, 104, 105, and / or 106 to initiate communication with server 120. The client device may provide an interface that enables a user of the client device to interact with the client device. The client device may also output information to the user via the interface.
[0031] Client devices 101, 102, 103, 104, 105 and / or 106 may include various types of computer devices, such as portable handheld devices, general-purpose computers (such as personal computers and laptop computers), workstation computers, wearable devices, smart screen devices, self-service terminal devices, service robots, game systems, thin clients, various messaging devices, sensors or other sensing devices, etc. These computer devices may run various types and versions of software applications and operating systems, such as MICROSOFT Windows, APPLE iOS, UNIX-like operating systems, Linux or Linux-like operating systems (such as GOOGLE Chrome OS); or include various mobile operating systems, such as MICROSOFT Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices may include cellular phones, smart phones, tablet computers, personal digital assistants (PDAs), etc. Wearable devices may include head-mounted displays (such as smart glasses) and other devices. Game systems may include various handheld game devices, Internet-enabled game devices, etc. Client devices are capable of executing various different applications, such as various Internet-related applications, communication applications (such as email applications), short message service (SMS) applications, and may use various communication protocols.
[0032] The network 110 may be any type of network known to those skilled in the art that may support data communications using any of a variety of available protocols, including but not limited to TCP / IP, SNA, IPX, etc. By way of example only, the network 110 may be a local area network (LAN), an Ethernet-based network, a token ring, a wide area network (WAN), the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, a public switched telephone network (PSTN), an infrared network, a wireless network (e.g., Bluetooth, WIFI), and / or any combination of these and / or other networks.
[0033] Server 120 may include one or more general purpose computers, dedicated server computers (e.g., PC (personal computer) servers, UNIX servers, mid-range servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and / or combination. Server 120 may include one or more virtual machines running virtual operating systems, or other computing architectures involving virtualization (e.g., one or more flexible pools of logical storage devices that may be virtualized to maintain a server's virtual storage device). In various embodiments, server 120 may run one or more services or software applications that provide the functionality described below.
[0034] The computing units in the server 120 may run one or more operating systems including any of the above operating systems and any commercially available server operating systems. The server 120 may also run any of a variety of additional server applications and / or middle-tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, etc.
[0035] In some implementations, server 120 may include one or more applications to analyze and consolidate data feeds and / or event updates received from users of client devices 101, 102, 103, 104, 105, and / or 106. Server 120 may also include one or more applications to display data feeds and / or real-time events via one or more display devices of client devices 101, 102, 103, 104, 105, and / or 106.
[0036] In some embodiments, the server 120 may be a server of a distributed system, or a server combined with a blockchain. The server 120 may also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology. A cloud server is a host product in a cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and virtual private servers (VPS) services.
[0037] The system 100 may also include one or more databases 130. In some embodiments, these databases may be used to store data and other information. For example, one or more of the databases 130 may be used to store information such as eye tracking information, bullet screen information, and display attribute information of each bullet screen. The database 130 may reside in various locations. For example, the database used by the client 101, 102, 103, 104, 105, and / or 106 may be local to the client, or may be remote from the client and may communicate with the client via a network-based or dedicated connection. For another example, the database used by the server 120 may be local to the server 120, or may be remote from the server 120 and may communicate with the server 120 via a network-based or dedicated connection. The database 130 may be of different types. In some embodiments, the database used by the server 120 may be, for example, a relational database. One or more of these databases may store, update, and retrieve data from the database and the database in response to a command.
[0038] In some embodiments, one or more of the databases 130 may also be used by applications to store application data. The databases used by the applications may be different types of databases, such as a key-value store, an object store, or a conventional store backed by a file system.
[0039] Figure 1 The system 100 may be configured and operated in various ways to enable the application of various methods and apparatuses described in the present disclosure.
[0040] Figure 2 FIG. 2 shows a flow chart of a bullet screen display method 200 according to an embodiment of the present disclosure. Figure 2 As shown, method 200 may include: step S210, obtaining eye tracking information of a client user watching a played video; step S220, based on the eye tracking information, determining one or more target barrages associated with the eye tracking information from multiple barrages presented in the played video; and step S230, adjusting display attribute information of one or more target barrages.
[0041] By obtaining the eye tracking information of the client user watching the video in real time, the client user's real attention and interest in the bullet screen on the display interface can be reflected. On this basis, adjusting the display attribute information of one or more associated bullet screens can focus on the bullet screen that the client user is concerned about, so that the user can see the clear and complete bullet screen content, which not only improves the user's viewing experience, but also helps to realize the individual difference between different users in the bullet screen display control.
[0042] It will be understood that the eye tracking information of the client user watching the video can be obtained in real time, and the target barrage can be determined based on this and the display properties of these target barrages can be adjusted. The information about the target barrage can also be stored, and when the user watches the video again, the display properties can be adjusted alone or together with the target barrage determined in real time.
[0043] According to some embodiments of the present disclosure, in step S210, eye tracking technologies such as infrared light and high-speed video can be used to track and record the movement trajectory and gaze point of the client user's eyes in real time to obtain eye tracking information. For example, an infrared light source and a camera can be used to capture the infrared light reflected by the client user's eyes, and the gaze point and movement path of the eyes can be determined by analyzing the reflection pattern and the shape of the eyeball. Furthermore, a high-speed camera can record tiny movements and transitions of the eyes at a speed of, for example, 100 frames per second. Through the corresponding calibration process, an accurate mapping relationship can be established to ensure the precision and accuracy of the eye tracking information.
[0044] According to some embodiments of the present disclosure, in step S220, the eye tracking information may include the current eye focus position information of the client user. The current eye focus position information may be, for example, the position coordinates of the current eye focus. For example, when viewing the terminal device horizontally, a coordinate system may be established with the horizontal direction as the X-axis, the vertical direction as the Y-axis, and the direction perpendicular to the display screen of the terminal device as the Z-axis. In this case, the current eye focus position information may be, for example, (Xi, Yi, Zi).
[0045] Figure 3 FIG. 4 is a flowchart of determining a target bullet screen at the current moment associated with eye tracking information according to an embodiment of the present disclosure. Figure 3 As shown, step S220, based on eye tracking information, determining one or more target barrages associated with the eye tracking information from multiple barrages presented in the played video may include: step S322, determining a subset of barrages from the multiple barrages that are within a first threshold distance range from the current eye focus position information included in the eye tracking information; and step S324, determining one or more target barrages based on the barrage subset.
[0046] According to some embodiments of the present disclosure, after obtaining the eye tracking information and the eye focus position coordinates indicated by the eye tracking information, a bullet screen search box can be determined with the coordinates as the center and a specific threshold distance as the radius. Then, all bullet screens on the current display interface that fall within the bullet screen search box can be selected as a bullet screen subset.
[0047] It should be noted that falling into the barrage search box may mean that the barrage falls completely into the barrage search box, or may mean that the barrage falls partially into the barrage search box (for example, it has just scrolled into the barrage search box and is about to scroll out of the barrage search box).
[0048] It should also be noted that the threshold distance can be any suitable value, such as 30 pixels, 50 pixels, 75 pixels, etc. The threshold distance can also be adapted according to actual application scenarios or requirements. For example, when there are a large number of bullet screens, the threshold distance can be adapted to be smaller than the threshold distance when there are a small number of bullet screens. For another example, in the scenario of a game video, the threshold distance can be adapted to be smaller than the threshold distance in the scenario of watching an ordinary video. Thus, the target bullet screen corresponding to the client user can be determined more accurately.
[0049] Compared with the traditional method of manually selecting the bullet comments that users are interested in, by determining the current eye focus position information and the corresponding threshold distance range, the bullet comment area that better reflects the user's focus and interest points can be automatically determined, so that a more accurate target bullet comment can be initially obtained from all the currently presented bullet comments. On the other hand, by setting the threshold distance range, if there is no bullet comment at the current eye focus position, the target bullet comment search area can be expanded to avoid omissions.
[0050] According to some embodiments of the present disclosure, step S324, determining one or more target barrages based on the barrage subset may include: determining each barrage in the barrage subset as a target barrage.
[0051] According to other embodiments of the present disclosure, Figure 4 , step S324, determining one or more target barrages based on the barrage subset may include: step S326, calculating the distance between each barrage in the barrage subset and the current eye focus position indicated by the current eye focus position information; and step S328, in response to determining that the distance is less than a second threshold distance, determining that the barrage is a target barrage.
[0052] As described above, falling into the barrage search box may refer to a portion of the barrage falling into the barrage search box (for example, just scrolling into the barrage search box and about to scroll out of the barrage search box). However, usually, the barrage that is about to scroll out of the barrage search box may not be the barrage that the user expects to focus on identifying and understanding, and the barrage that has just scrolled into the barrage search box may not have attracted the user's attention. Therefore, in some cases, barrages such as the above two categories may not be able to accurately reflect the user's true attention and interest. By further calculating the distance between each barrage that falls into the barrage search box and the current eye focus position, barrages that do not meet the needs or requirements of the scene can be further filtered out, thereby avoiding the operation of frequently automatically adjusting the barrage display properties.
[0053] According to some embodiments of the present disclosure, in step S326, the distance between each bullet comment and the current eye focus position may be calculated by the following formula:
[0054]
[0055] Wherein, d represents the distance between the bullet screen m and the current eye focus i, (Xi, Yi, Zi) represents the coordinate value of the current eye focus i, and (Xm, Ym, Zm) represents the coordinate value of the center point of the bullet screen frame where the bullet screen m is located. In this article, the bullet screen frame may refer to a rectangular frame including the bullet screen, and the center point is the center point of the rectangular frame.
[0056] Further, in step S328, the second threshold distance can be set to any suitable value less than or equal to the threshold distance range, and the barrage with a distance value calculated according to the above formula greater than the second threshold distance can be filtered out to obtain a more accurate target barrage.
[0057] According to some embodiments of the present disclosure, the barrage display method 200 may further include: updating one or more target barrages, wherein updating one or more target barrages may include: sorting the distance between each target barrage and the current eye focus position indicated by the current eye focus position information; and selecting a first preset number of target barrages with the shortest distance as the updated target barrages.
[0058] According to some examples, the first preset number may be any integer that meets the needs of actual scenarios, including but not limited to 5, 8, 10, etc., which may depend on the total number of all barrages currently displayed, for example.
[0059] By sorting the distance between each target bullet screen and the current eye focus position, an ordered target bullet screen set in ascending order can be obtained. By selecting the first preset number of bullet screens from the ordered target bullet screen set as the updated target bullet screen, the range of the target bullet screen can be further narrowed, and the bullet screen that the user is really concerned about or interested in can be determined more accurately.
[0060] Figure 4 FIG. 4 is a flowchart of a bullet screen display method 400 according to some other embodiments of the present disclosure. Figure 4 , the method 400 may include: with reference Figure 2 Steps S410 - S430 are similar to steps S210 - S230 in the described bullet screen display method 200 ; and step S440 , obtaining the gaze duration information of the client user on one or more target bullet screens.
[0061] If there are a large number of barrages currently displayed, there may be a situation where the user only scans all the barrages instead of focusing on a barrage of interest. In this case, if the target barrage is determined based on all the user's eye tracking information during the scanning process, and the display properties of the barrage are adjusted accordingly, a large number of barrages may have their display properties adjusted, the display interface may be chaotic, but the user's true intention is not to pay attention to these barrages. By obtaining the gaze duration information of the determined target barrage, the user's true intention can be further determined. For example, if the gaze duration of a target barrage is only 0.1 seconds, the user may just scan and browse the barrage. For another example, if the gaze duration of a target barrage is as long as 1 second, it may mean that the user does continue to pay attention to the barrage, so that the barrage can be determined as the user's focus or interest point. Adjusting the barrage on this basis not only meets the actual needs of users and improves the viewing experience, but also avoids the inconvenience caused by the operation of constantly adjusting the display properties of a large number of barrages.
[0062] According to some embodiments of the present disclosure, step S440, obtaining the client user's gaze duration information on one or more target bullet screens may include: obtaining eye movement features such as the current eye focus position and the corresponding timestamp from the acquired eye tracking information; then, based on the current eye focus position, the corresponding timestamp and other eye movement features, obtaining the trajectory changes of the client user's focus point, and counting the gaze duration on each target bullet screen.
[0063] According to other embodiments of the present disclosure, step S440, obtaining the client user's gaze duration information on one or more target barrages may include: for each of the one or more target barrages: obtaining a timestamp list corresponding to the target barrage, wherein each timestamp in the timestamp list represents the time when the barrage was previously determined as a target barrage; and updating the timestamp list corresponding to the target barrage to include the current moment.
[0064] Specifically, a corresponding timestamp list can be created for each target barrage, and whenever the barrage is determined to be a target barrage, the corresponding moment is recorded in the timestamp list. For example, eye tracking data can be called back at fixed time intervals (e.g., 0.5 seconds). In response to determining that the barrage is first determined as a target barrage at the current moment t, a timestamp list attention_time_list can be created for the barrage, and the moment t can be recorded in the list, attention_time_list = [t]. In response to determining that the barrage is determined to be a target barrage, for example, 1.5 seconds, 1 second, and 0.5 seconds before the current moment t, attention_time_list = [t-1.5, t-1, t-0.5, t]. It should be understood that non-fixed time intervals can also be used to call back eye tracking data. Similarly, the corresponding timestamp list also records the moment when it is determined to be the target barrage.
[0065] By creating a timestamp list for each target bullet, and recording the time when each bullet is identified as a target bullet, the user's gaze duration on the bullet in a specific time period can be quickly calculated. Compared with obtaining the trajectory changes of the user's focus point and directly timing the focus duration of each bullet, the above operation is simpler and requires less data storage.
[0066] According to some embodiments of the present disclosure, step S230 and / or step S430, adjusting the display attribute information of one or more target barrages may include: determining, for each of the one or more target barrages, whether the corresponding gaze duration information of the target barrage meets a first preset standard; and in response to determining that the corresponding gaze duration information of the target barrage meets the first preset standard, adjusting the display attribute information of the target barrage.
[0067] By comparing the gaze duration with the first preset standard, it can be determined whether the user has gazed at the target bullet screen for a preset time, thereby determining whether the user is truly interested in the target bullet screen. Adjusting the bullet screen on this basis is more in line with the actual needs of the user, avoiding the operation of constantly adjusting a large number of bullet screen display properties.
[0068] According to some examples, the first preset standard may be that the user stares at the target bullet screen for a certain preset time, such as 2 seconds or 3 seconds.
[0069] According to other examples, determining whether the corresponding gaze duration information of the target barrage meets the first preset standard may include: selecting a second preset number of consecutive timestamps including the current moment from the timestamp list of the target barrage; calculating the time interval between each two adjacent timestamps in the second preset number of timestamps; and in response to determining that the time interval is equal to the number of callback time intervals of eye tracking information is not less than a third preset number, determining that the corresponding gaze duration information of the target barrage meets the first preset standard, wherein the callback time interval represents a sampling time interval for obtaining eye tracking information.
[0070] According to some examples, the second preset number may be any integer that meets the actual scene requirements, including but not limited to 4, 6, 8, etc. Similarly, the third preset number may also be any integer that meets the actual scene requirements and is less than the second preset number. The scope of protection claimed in the present disclosure is not limited in this respect.
[0071] For example, the timestamp list of a target bullet comment is attention_time_list = [1.5, 3, 4, 4.5, 5.5, 6], the current time t = 6, and the callback time interval of the eye tracking information is 0.5 seconds. When the second preset number is 4 and the third preset number is 2, 4 consecutive timestamps are selected from the timestamp list as [4, 4.5, 5.5, 6]. Then, the time intervals between two adjacent timestamps are calculated, that is, 0.5, 1, and 0.5, respectively, and the number of time intervals equal to the callback time interval of 0.5 seconds is 2. In this case, it can be determined that the corresponding attention duration of the target bullet comment meets the first preset standard.
[0072] In the process of watching a video, the scrolling speeds of different bullet screens may be different, which may cause the client user to be covered by a bullet screen with a faster scrolling speed and "snatch away" the current eye focus while watching a certain bullet screen, but in fact the client still wants to continue watching the previously watched bullet screen. In addition, it is also possible that the client user's current eye focus leaves the bullet screen due to reasons such as distraction while watching a certain bullet screen. By setting the second preset number and the third preset number, especially when the third preset number is set to be less than the second preset number, instantaneous loss of focus during eye tracking can be avoided.
[0073] According to some embodiments of the present disclosure, step S230 and / or step S430, adjusting the display attribute information of one or more target barrages may also include: in response to determining that the corresponding gaze duration information of the target barrage no longer meets the first preset standard, adjusting the display attribute information of the target barrage to the previous display attribute information.
[0074] According to some examples, as described above, when the first preset criterion is that the user stares at the target barrage for a certain preset time, when the client user shifts his or her gaze from the target barrage to the non-barrage area on the display screen, the user may no longer be interested in the target barrage. At this time, the display attribute information of the target barrage can be adjusted to the previous display attribute information, so as to restore the original barrage display effect, for example, restore the default display font size, display font color, barrage running trajectory, etc.
[0075] According to other examples, as described above, when the first preset criterion is that the time interval between each two adjacent timestamps of a preset number of consecutive timestamps including the current moment selected from the timestamp list of the target barrage is equal to or greater than a preset number of callback time intervals of the eye tracking information, when the client user continuously gazes at a non-barrage area or other barrages on the display screen, for example, for more than the preset number of callback time intervals, the user may no longer be interested in the target barrage. At this time, the display attribute information of the target barrage can be adjusted to the previous display attribute information to restore the original barrage display effect, for example, restoring the default display font size, display font color, barrage running trajectory, etc.
[0076] By restoring the display properties of the barrage to normal or to the display properties before adjustment when the gaze duration of the target barrage does not meet the standard, the display effect of the barrage on the client display screen can be adjusted in time as the user's eye focus position continues to change, avoiding the barrage that is no longer the user's focus still being highlighted, thereby making the barrage displayed more clearly, which is beneficial to improving the user's viewing experience.
[0077] According to some embodiments of the present disclosure, step S230, adjusting the display attribute information of one or more target barrages may include: adjusting one or more of the following information of one or more target barrages: three-dimensional coordinate information, display size information, font information, animation effect information and barrage trajectory information.
[0078] As mentioned above, the existing bullet screens are usually displayed on the 2D plane display area of the terminal device, and are usually scrolled in a default or manually set manner. However, when there are a large number of bullet screens at the same time, only using the above default adjustment method of bullet screen display may not be able to further distinguish and display the overlapping bullet screens.
[0079] In view of this, spatial 3D display technology can be used to display barrages. Spatial 3D technology refers to the use of display devices (such as head-mounted displays or stereoscopic displays) that use advanced optical technology and special display devices, as well as rendering technology to present content to users in a realistic three-dimensional form. This technology uses a high-resolution, high-refresh rate display screen, combined with precise image processing and projection algorithms, to achieve a three-dimensional visual effect for each content element just like the real world. In this display mode, by adjusting the three-dimensional coordinate information, display size information, font information, animation effect information, and barrage trajectory information of the target barrage, barrages of different distances, levels, sizes, animation effects, and motion trajectories can be presented in three-dimensional space, which not only allows users to feel the depth and three-dimensional sense of the real world, but also avoids overlapping displays between barrages, thereby obtaining a clearer viewing experience of barrages.
[0080] According to some embodiments of the present disclosure, adjusting the three-dimensional coordinate information of one or more target barrages and / or the display size information of one or more target barrages may include: calculating the distance between each target barrage in the one or more target barrages and the current eye focus position indicated by the eye tracking information; and determining the three-dimensional coordinate information and / or display size information of the target barrage based on the distance corresponding to each target barrage.
[0081] By calculating the distance between each target bullet screen and the current eye focus position, these target bullet screens can be sorted in descending order, and the smaller the distance, the higher the user's attention or interest in the corresponding target bullet screen. Therefore, by adjusting the three-dimensional coordinate information and / or display size information of the target bullet screen based on the distance, the display of the target bullet screen can be distinguished, so that the target bullet screen that the user pays more attention to is displayed more clearly or prominently.
[0082] It will be understood that the distance between each target bullet screen and the current eye focus position indicated by the eye tracking information can be calculated in the same or similar manner as the calculation method used in step S326 described above. For the sake of brevity, it will not be repeated here.
[0083] According to some embodiments of the present disclosure, determining the three-dimensional coordinate information and / or display size information of the target barrage based on the distance corresponding to each target barrage may include: sorting the calculated distances corresponding to each target barrage; and determining the three-dimensional coordinate information and / or display size information of each target barrage based on the sorting result.
[0084] According to some examples, the three-dimensional coordinate information of each target bullet message can be determined based on the position of the target bullet message in the descending sorted set and the distance between the terminal device display screen and the user's eyes. For example, the Z-axis coordinate of each target bullet message can be calculated by the following formula:
[0085] Z i =Z i0 +(i+1)*(Z0 / n)
[0086] Among them, Z i represents the Z-axis coordinate of the i-th target bullet message after sorting in descending order (i=[0,n-1]), Z i0 represents the original Z-axis coordinate of the i-th target barrage, Z0 represents half of the distance between the display screen of the terminal device and the user's eyes (it will be understood that Z0 is not limited to half of the distance between the display screen and the user's eyes, it can also be one-third, two-thirds or any other suitable value of the distance), and n represents the total number of target barrages.
[0087] Through the above method, a hierarchical arrangement of target barrage blocks can be achieved, so that the target barrage blocks that are closer to the current eye focus position are displayed closer to the user's eyes, so that the user can more clearly see the barrages that they are concerned about or interested in, thereby improving the viewing experience.
[0088] According to some other examples, the display size information of each target bullet screen can also be determined based on the position of the target bullet screen in the descending sorted set and the distance between the terminal device display screen and the user's eyes. For example, the magnification ratio of each target bullet screen can be calculated by the following formula:
[0089] S i =1+(i+1)*(1 / n)
[0090] Among them, S i represents the magnification ratio of the i-th target barrage after being arranged in descending order (i=[0,n-1]), 1 represents the original magnification ratio of the i-th target barrage (ie, no magnification), and n represents the total number of target barrages.
[0091] Similarly, through the above method, the target barrage block can be magnified proportionally, so that the target barrage block that is closer to the current eye focus position is displayed with a larger magnification ratio, so that users can more clearly watch the barrage that they are concerned about or interested in, thereby improving the viewing experience.
[0092] According to some embodiments of the present disclosure, adjusting the animation effect information of the one or more target barrages may include: for each of the one or more target barrages, configuring an interactive option for the target barrage, the interactive option being used to be displayed on the client in association with the target barrage; obtaining the client user's gaze duration information for the interactive option of the target barrage; and in response to determining that the client user's gaze duration information for the interactive option of the target barrage meets a second preset standard, configuring an interactive animation effect for the target barrage, so as to be displayed on the client in association with the target barrage.
[0093] According to some examples, the interactive options may be options associated with the target barrage, such as like, report, reply, etc., so that when the user's eye focus is on the target barrage, the user can quickly express the interactive expression of the target barrage through these interactive options.
[0094] According to some examples, the second preset standard may be a standard similar to the first preset standard. For example, satisfying the second preset standard may be that the user gazes at the interactive option for a continuous period of time up to a preset time. For another example, satisfying the second preset standard may be selecting a fourth preset number of consecutive timestamps including the current moment from the timestamp list of the interactive option; calculating the time interval between each two adjacent timestamps in the fourth preset number of timestamps; and in response to determining that the time interval is equal to the number of callback time intervals of the eye tracking information is not less than the fifth preset number, determining that the corresponding gaze duration information of the interactive option meets the second preset standard. Among them, the selection of the preset number may be the same or similar to the selection of the preset number in the above description of the first preset standard, so it will not be repeated here.
[0095] Accordingly, after the interactive option of the target bullet screen is displayed, when the user's gaze time on the interactive option meets the above preset standard, an interactive animation effect for the interactive option can be displayed. Examples of interactive animation effects include, but are not limited to: automatically displaying an animation effect of "+1" near the interactive option, automatically displaying an animation effect of "heart" near the interactive option, changing the font color and font size of the interactive option, and / or changing the motion trajectory of the interactive option.
[0096] By configuring interactive options for the target bullet comments, the interactive experience of the client user when watching the video can be further enhanced. At the same time, by automatically displaying animation effects such as "+1", the user's operation can be reduced while the user's interactive expression of the target bullet comments can be realized.
[0097] According to some embodiments of the present disclosure, adjusting the font information may refer to adjusting the display font of the target barrage to a font different from other barrages, for example, adjusting the display font of the target barrage to Kaiti, while the display font of other barrages is the default Songti. According to some other embodiments of the present disclosure, adjusting the barrage trajectory information may refer to adjusting the motion trajectory of the target barrage to a motion trajectory different from other barrages, for example, adjusting the motion trajectory of the target barrage to move in the reverse direction "from left to right", while the motion trajectory of other barrages is moving in the forward direction "from right to left". It should be understood that any one of the above-mentioned display attribute information may be selected to be adjusted according to the actual scenario (for example, according to the number of barrages) or multiple display attribute information in the above-mentioned display attribute information may be adjusted in combination to further highlight the target barrage to distinguish it from other barrages.
[0098] Figure 5 FIG. 5 is a flowchart of a bullet screen display method 500 according to some other embodiments of the present disclosure. Figure 5 As shown, method 500 may include: step S510, obtaining eye tracking information of a client user watching a played video; step S520, determining a subset of barrages within a first threshold distance range from the current eye focus position information included in the eye tracking information from a plurality of barrages presented in the played video; step S530, calculating the distance between each barrage in the barrage subset and the current eye focus position indicated by the current eye focus position information, and in response to determining that the distance is less than the threshold distance, determining that the barrage is a target barrage; step S540, sorting the distance between each target barrage and the current eye focus position, and selecting a first preset number of target barrages with the smallest distance as updated target barrages; step S550, obtaining a timestamp list corresponding to the target barrage, updating the target barrage A timestamp list corresponding to the target bullet screen is prepared to include the current moment; step S560, selecting the nearest second consecutive preset number of timestamps from the timestamp list of the target bullet screen; step S570, determining whether the time interval between each two adjacent timestamps is the number of callback time intervals is not less than a third preset number; step S580, in response to determining that the time interval between each two adjacent timestamps is the number of callback time intervals is not less than a third preset number, sorting the calculated distances corresponding to each target bullet screen and the current eye focus position, and adjusting the three-dimensional coordinate information and display size information of the target bullet screen based on the sorting result; and step S590, in response to determining that the time interval between each two adjacent timestamps is the number of callback time intervals is less than the third preset number, abandoning adjusting the display attribute information of the target bullet screen.
[0099] It should be understood that Figure 5The various steps in the described method 500 may be similar to the operations, features, and advantages described above for methods 200 and 400. For the sake of brevity, certain operations, features, and advantages are not described in detail herein.
[0100] Figure 6 FIG. 6 shows a structural block diagram of a bullet screen display device 600 according to an embodiment of the present disclosure. Figure 6 As shown, the barrage display device 600 may include: an acquisition unit 610, configured to acquire eye tracking information of a client user watching a played video; a target barrage determination unit 620, configured to determine one or more target barrages associated with the eye tracking information from multiple barrages presented in the played video based on the eye tracking information; and a display attribute information adjustment unit 630, configured to adjust the display attribute information of one or more target barrages.
[0101] By obtaining the eye tracking information of the client user watching the video in real time, the client user's real attention and interest in the bullet screen on the display interface can be reflected. On this basis, adjusting the display attribute information of one or more associated bullet screens can focus on the bullet screen that the client user is concerned about, so that the user can see the clear and complete bullet screen content, which not only improves the user's viewing experience, but also helps to realize the individual difference between different users in the bullet screen display control.
[0102] According to some embodiments of the present disclosure, eye tracking information may include current eye focus position information of the client user, and wherein the target barrage determination unit 620 may include: a barrage subset determination unit, configured to determine, from multiple barrages, a barrage subset that is within a first threshold distance range from the current eye focus position information included in the eye tracking information; and a target barrage sub-unit determination unit, configured to determine one or more target barrages based on the barrage subset.
[0103] According to some embodiments of the present disclosure, determining the target barrage subunit may include determining each barrage in the barrage subset as a target barrage.
[0104] According to some embodiments of the present disclosure, determining the target barrage sub-unit may include calculating the distance between each barrage in the barrage subset and the current eye focus position indicated by the current eye focus position information; and in response to determining that the distance is less than a second threshold distance, determining that the barrage is the target barrage.
[0105] According to some embodiments of the present disclosure, the barrage display device 600 may further include an updating unit configured to update one or more target barrages, wherein the updating unit may include: a unit configured to sort the distance between each target barrage and the current eye focus position indicated by the current eye focus position information; and a unit configured to select a first preset number of target barrages with the shortest distance as the updated target barrages.
[0106] According to some embodiments of the present disclosure, the bullet screen display device 600 may further include a gaze duration acquisition unit configured to acquire gaze duration information of a client user on one or more target bullet screens.
[0107] According to some embodiments of the present disclosure, the display attribute information adjustment unit 630 may include: a unit configured to determine, for each target barrage of one or more target barrages, whether the corresponding gaze duration information of the target barrage meets a first preset standard; and a unit configured to adjust the display attribute information of the target barrage in response to determining that the corresponding gaze duration information of the target barrage meets the first preset standard.
[0108] According to some embodiments of the present disclosure, the display attribute information adjustment unit 630 may also include: a unit configured to adjust the display attribute information of the target barrage to the previous display attribute information in response to determining that the corresponding gaze duration information of the target barrage no longer meets the first preset standard.
[0109] According to some embodiments of the present disclosure, obtaining the gaze duration unit may include, for each target barrage of one or more target barrages: being configured to obtain a timestamp list corresponding to the target barrage, wherein each timestamp in the timestamp list represents a unit of time when the barrage was previously determined as a target barrage; and being configured to update the timestamp list corresponding to the target barrage to include a unit at the current moment.
[0110] According to some embodiments of the present disclosure, a unit configured to determine whether the corresponding gaze duration information of the target barrage meets the first preset standard may include: a unit configured to select a second preset number of consecutive timestamps including the current moment from the timestamp list of the target barrage; a unit configured to calculate the time interval between each two adjacent timestamps in the second preset number of timestamps; and a unit configured to determine that the corresponding gaze duration information of the target barrage meets the first preset standard in response to determining that the time interval is equal to the number of callback time intervals of the eye tracking information is not less than a third preset number, wherein the callback time interval represents the sampling time interval for obtaining the eye tracking information.
[0111] According to some embodiments of the present disclosure, the display attribute information adjustment unit 630 may include: an adjustment subunit, configured to adjust one or more of the following information of one or more target barrages: three-dimensional coordinate information, display size information, font information, animation effect information and barrage trajectory information.
[0112] According to some embodiments of the present disclosure, the adjustment subunit may include: a unit configured to calculate the distance between each of one or more target barrages and the current eye focus position indicated by eye tracking information; and a unit configured to determine the three-dimensional coordinate information and / or display size information of the target barrage based on the distance corresponding to each target barrage.
[0113] According to some embodiments of the present disclosure, a unit configured to determine the three-dimensional coordinate information and / or display size information of a target barrage based on the distance corresponding to each target barrage may include: a unit configured to sort the calculated distances corresponding to each target barrage; and a unit configured to determine the three-dimensional coordinate information and / or display size information of each target barrage based on the sorting result.
[0114] According to some embodiments of the present disclosure, the adjustment subunit may include: for each target barrage of one or more target barrages, a unit configured to configure an interactive option for the target barrage, and the interactive option is used to be displayed on the client in association with the target barrage; a unit configured to obtain the gaze duration information of the client user for the interactive option of the target barrage; and a unit configured to configure an interactive animation effect for the target barrage in response to determining that the gaze duration information of the client user for the interactive option of the target barrage meets a second preset standard, so as to be displayed on the client in association with the target barrage.
[0115] It should be understood that Figure 6 The various units of the device 600 shown in FIG. 6 can be compared with those of the reference Figure 2 , Figure 3 , Figure 4 and Figure 5 The steps in the described methods 200, 400, and 500 correspond to each other. Therefore, the operations, features, and advantages described above for the methods 200, 400, and 500 are also applicable to the apparatus 600 and the units included therein. For the sake of brevity, some operations, features, and advantages are not described in detail here.
[0116] It should also be understood that various techniques may be described herein in the general context of software hardware elements or program modules. Figure 6The various units described can be implemented in hardware or in hardware in combination with software and / or firmware. For example, these units can be implemented as computer program codes / instructions, which are configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, these units can be implemented as hardware logic / circuits. For example, in some embodiments, one or more of the acquisition unit 610, the target barrage determination unit 620, and the adjustment display attribute information unit 630 can be implemented together in a system on chip (System on Chip, SoC). SoC may include an integrated circuit chip (which includes a processor (e.g., a central processing unit (CPU), a microcontroller, a microprocessor, a digital signal processor (DSP), etc.), a memory, one or more communication interfaces, and / or one or more components in other circuits), and may optionally execute the received program code and / or include embedded firmware to perform functions.
[0117] According to another aspect of the present disclosure, an electronic device is also provided, comprising: at least one processor; and at least one memory communicatively connected to the at least one processor; wherein the at least one memory stores a computer program, and the computer program implements the above-mentioned barrage display method when executed by the at least one processor.
[0118] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing a computer program is also provided, wherein the computer program implements the above-mentioned barrage display method when executed by a processor.
[0119] According to another aspect of the present disclosure, a computer program product is also provided, including a computer program, wherein the computer program implements the above-mentioned barrage display method when executed by a processor.
[0120] See also Figure 7 , a block diagram of an electronic device 700 that can be used as a host client or an audience client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device can be different types of computer devices, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.
[0121] like Figure 7 As shown, the electronic device 700 may include at least one processor 710 , a working memory 720 , an input unit 740 , a display unit 750 , a speaker 760 , a storage unit 770 , a communication unit 780 , and other output units 790 that can communicate with each other via a system bus 730 .
[0122] The processor 710 may be a single processing unit or multiple processing units, all of which may include a single or multiple computing units or multiple cores. The processor 710 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuits, and / or any device that manipulates signals based on operating instructions. The processor 710 may be configured to obtain and execute computer-readable instructions stored in the working memory 720, the storage unit 770, or other computer-readable media, such as program codes of an operating system 720a, program codes of an application 720b, and the like.
[0123] The working memory 720 and the storage unit 770 are examples of computer-readable storage media for storing instructions that are executed by the processor 710 to implement the various functions described above. The working memory 720 may include both volatile memory and non-volatile memory (e.g., RAM, ROM, etc.). In addition, the storage unit 770 may include a hard disk drive, a solid-state drive, a removable medium, including external and removable drives, a memory card, a flash memory, a floppy disk, an optical disk (e.g., a CD, a DVD), a storage array, a network attached storage, a storage area network, etc. The working memory 720 and the storage unit 770 may all be collectively referred to herein as memory or computer-readable storage media, and may be a non-transitory medium capable of storing computer-readable, processor-executable program instructions as computer program code, which may be executed by the processor 710 as a specific machine configured to implement the operations and functions described in the examples herein.
[0124] The input unit 760 may be any type of device capable of inputting information into the electronic device 700. The input unit 760 may receive input digital or character information, and generate key signal input related to user settings and / or function control of the electronic device, and may include but is not limited to a mouse, a keyboard, a touch screen, a trackpad, a trackball, a joystick, a microphone and / or a remote controller. The output unit may be any type of device capable of presenting information, and may include but is not limited to a display unit 750, a speaker 760, and other output units 790. Other output units 790 may include but are not limited to video / audio output terminals, vibrators and / or printers. The communication unit 780 allows the electronic device 700 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks, and may include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver and / or a chipset, such as Bluetooth. TM devices, 802.11 devices, Wi-Fi devices, WiMAX devices, cellular communication devices, and / or the like.
[0125] The application 720b in the working register 720 can be loaded to execute the various methods and processes described above, such as Figure 2 Steps S210-S230, Figure 3 Steps S322-S328 in Figure 4 . For example, in some embodiments, the methods 200, 400, 500 described above may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 770. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 700 via the storage unit 770 and / or the communication unit 780. When the computer program is loaded and executed by the processor 710, one or more steps of the methods 200, 400, 500 described above may be performed. Alternatively, in other embodiments, the processor 710 may be configured to perform the methods 200, 400, 500 in any other appropriate manner (e.g., by means of firmware).
[0126] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0127] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0128] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0129] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0130] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0131] A computer system may include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship to each other.
[0132] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.
[0133] Although the embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above-mentioned methods, systems and devices are merely exemplary embodiments or examples, and the scope of the present invention is not limited by these embodiments or examples, but only by the claims after authorization and their equivalent scope. Various elements in the embodiments or examples can be omitted or replaced by their equivalent elements. In addition, each step can be performed in an order different from that described in the present disclosure. Further, the various elements in the embodiments or examples can be combined in various ways. It is important that with the evolution of technology, many elements described herein can be replaced by equivalent elements that appear after the present disclosure.
Claims
1. A bullet screen display method, comprising: Obtain eye tracking information of client users watching the video; Based on the eye tracking information, determining one or more target bullet comments associated with the eye tracking information from a plurality of bullet comments presented in the played video; as well as Adjust the display attribute information of the one or more target bullet comments.
2. The method according to claim 1, wherein: The eye tracking information includes the current eye focus position information of the client user, and Wherein, based on the eye tracking information, determining the one or more target bullet comments associated with the eye tracking information from the multiple bullet comments presented in the played video includes: Determine, from the plurality of bullet comments, a bullet comment subset that is within a first threshold distance range from the current eye focus position information included in the eye tracking information; and The one or more target bullet comments are determined based on the bullet comment subset.
3. The method according to claim 2, wherein: Determining the one or more target bullet comments based on the bullet comment subset includes: Each barrage in the barrage subset is determined as a target barrage.
4. The method according to claim 2, wherein: Determining the one or more target bullet comments based on the bullet comment subset includes: Calculating the distance between each bullet comment in the bullet comment subset and the current eye focus position indicated by the current eye focus position information; and In response to determining that the distance is less than the second threshold distance, the barrage is determined to be a target barrage.
5. The method according to claim 3 or 4, further comprising updating the one or more target bullet comments, wherein: Updating the one or more target bullet comments includes: sorting the distance between each target bullet comment and the current eye focus position indicated by the current eye focus position information; and A first preset number of target bullet screens with the smallest distances are selected as updated target bullet screens.
6. The method according to any one of claims 1-5 further includes obtaining the gaze duration information of the client user on the one or more target bullet comments.
7. The method according to claim 6, wherein: Adjusting the display attribute information of the one or more target bullet comments includes: For each of the one or more target bullet screens, determining whether the corresponding gaze duration information of the target bullet screen meets a first preset standard; and In response to determining that the corresponding gaze duration information of the target bullet screen meets the first preset standard, the display attribute information of the target bullet screen is adjusted.
8. The method according to claim 7, wherein: Adjusting the display attribute information of the one or more target bullet comments further includes: In response to determining that the corresponding gaze duration information of the target bullet screen no longer meets the first preset standard, the display attribute information of the target bullet screen is adjusted to the previous display attribute information.
9. The method according to any one of claims 6 to 8, wherein: Acquiring the gaze duration information of the client user on the one or more target bullet screens includes: for each of the one or more target bullet screens: Obtaining a timestamp list corresponding to the target bullet comment, wherein each timestamp in the timestamp list indicates the time when the bullet comment was previously determined as the target bullet comment; and Update the timestamp list corresponding to the target barrage to include the current time.
10. The method according to claim 9, wherein: Determining whether the corresponding gaze duration information of the target bullet screen meets the first preset standard includes: Selecting a second preset number of consecutive timestamps including the current moment from the timestamp list of the target bullet comment; Calculating the time interval between every two adjacent time stamps among the second preset number of time stamps; and In response to determining that the time interval is equal to the number of callback time intervals of the eye tracking information is not less than a third preset number, it is determined that the corresponding gaze duration information of the target barrage meets the first preset standard, wherein the callback time interval represents the sampling time interval for obtaining the eye tracking information.
11. The method according to any one of claims 1 to 10, wherein: Adjusting the display attribute information of the one or more target barrages includes adjusting one or more of the following information of the one or more target barrages: three-dimensional coordinate information, display size information, font information, animation effect information, and barrage trajectory information.
12. The method according to claim 11, wherein: Adjusting the three-dimensional coordinate information of the one or more target bullet comments and / or the display size information of the one or more target bullet comments includes: Calculating the distance between each of the one or more target bullet comments and the current eye focus position indicated by the eye tracking information; and The three-dimensional coordinate information and / or the display size information of each target barrage is determined based on the distance corresponding to the target barrage.
13. The method according to claim 12, wherein: Determining the three-dimensional coordinate information and / or the display size information of each target bullet screen based on the distance corresponding to the target bullet screen includes: sorting the calculated distances corresponding to each target bullet screen; and The three-dimensional coordinate information and / or the display size information of each target bullet comment is determined based on the sorting result.
14. The method according to claim 11, wherein: Adjusting the animation effect information of the one or more target bullet screens includes: for each of the one or more target bullet screens, Configuring interactive options for the target bullet screen, wherein the interactive options are used to be displayed on the client in association with the target bullet screen; Obtaining the gaze duration information of the client user on the interactive option of the target bullet screen; and In response to determining that the gaze duration information of the client user for the interactive option of the target barrage meets a second preset standard, an interactive animation effect is configured for the target barrage to be displayed on the client in association with the target barrage.
15. A bullet screen display device, comprising: An acquisition unit is configured to acquire eye tracking information of a client user watching a played video; A target barrage determining unit is configured to determine, based on the eye tracking information, one or more target barrages associated with the eye tracking information from a plurality of barrages presented in the playing video; as well as The display attribute information adjustment unit is configured to adjust the display attribute information of one or more target bullet comments.
16. An electronic device, comprising: at least one processor; as well as at least one memory communicatively coupled to the at least one processor, The at least one memory stores a computer program, and when the computer program is executed by the at least one processor, the method according to any one of claims 1 to 14 is implemented.
17. A non-transitory computer-readable storage medium storing a computer program, wherein: The computer program implements the method according to any one of claims 1 to 14 when executed by a processor.
18. A computer program product comprising a computer program, wherein: The computer program implements the method according to any one of claims 1 to 14 when executed by a processor.
Citation Information
Patent Citations
Method and device for display bullet screen
CN109246463A
Method and device for adjusting display attribute of bullet screen in virtual reality equipment
CN110221695A
Bullet screen information display method and device
CN110234030A
Method and apparatus for eye tracking latency reduction
US20050273185A1
Physiologically adaptive user interface
US20170329396A1