Hot zone display method, device, equipment and storage medium for live broadcast screen

Abstract

The present application discloses a method, device, equipment and storage medium for displaying hot zones of a live broadcast screen, and belongs to the field of live broadcast technology. The method includes: displaying a live broadcast screen in a live broadcast room, wherein the live broadcast screen displays at least one recommended object; in response to a hot zone display instruction triggered for the live broadcast screen, presenting at least one visual hot zone in the live broadcast screen, wherein the visual hot zone is used to represent the number of viewers who are looking at the area where the corresponding recommended object is located in the live broadcast screen. In this way, when watching the live broadcast screen, the audience does not need to actively interact, but can also more intuitively understand the audience's interest in each recommended object through the displayed visual hot zones, obtain audience feedback more promptly, and thereby improve the accuracy of the live broadcast content.

Description

Technical Field

[0001] The present application relates to the field of computer technology, in particular to the field of live broadcast technology, and provides a method, device, equipment and storage medium for displaying hot spots of a live broadcast screen. Background Art

[0002] With the development of network technology, live streaming has gained widespread popularity and gradually become a popular entertainment application. Generally speaking, live streaming scenarios include a host client and a viewer client. The host can create a live broadcast room in the host client, and the viewer can enter the live broadcast room through the viewer client and interact with the host client. For example, when the host broadcasts a live broadcast through the host client, the viewer can comment or like the live broadcast room through the viewer client. Accordingly, the comments or likes initiated by the viewer client will be displayed in the corresponding areas of the host client and the viewer client.

[0003] However, currently, due to physical limitations during live broadcasts, hosts cannot directly see the audience watching the live broadcast on the other end. Instead, they can only judge the audience's preferences for the live broadcast content through the interactive content initiated by the audience. However, this method allows hosts to passively receive feedback from the audience. If the majority of the audience lacks interaction, the host will not be able to obtain timely feedback, which may lead to the inability to adjust the live broadcast content in a timely manner. For example, when the host recommends items to the audience in the live broadcast room, if they cannot obtain timely feedback from the audience and determine which items the audience is interested in, they will not be able to adjust the current recommended items in time, and it is very likely that they will not be able to accurately recommend items to the audience. The accuracy of the recommendation of items is low, and the audience's viewing experience is also poor. Summary of the Invention

[0004] The embodiments of the present application provide a method, apparatus, device and storage medium for displaying hot spots of a live broadcast screen, which are used to display visual hot spots of a live broadcast screen, improve the timeliness of obtaining audience feedback, and thereby improve the accuracy of the live broadcast content.

[0005] In one aspect, a method for displaying hot spots of a live broadcast image is provided, the method comprising:

[0006] Displaying a live broadcast screen in the live broadcast room, wherein the live broadcast screen displays at least one recommended object;

[0007] In response to a hot zone display instruction triggered for the live broadcast screen, at least one visual hot zone is presented in the live broadcast screen, and the visual hot zone is used to represent the number of viewers who are looking at the location area where the corresponding recommended object is located in the live broadcast screen.

[0008] In one aspect, a device for displaying hot spots of a live broadcast image is provided, the device comprising:

[0009] A screen display unit, configured to display a live screen of the live broadcast room, wherein the live screen displays at least one recommended object;

[0010] A hot zone presentation unit is used to present at least one visual hot zone in the live screen in response to a hot zone display instruction triggered for the live screen, wherein the visual hot zone is used to represent the number of viewers who are looking at the area where the corresponding recommended object is located in the live screen.

[0011] Optionally, the live broadcast screen further displays a hot zone display control, and the hot zone presentation unit is further configured to:

[0012] In response to a triggering operation on the hot zone display control, the hot zone display instruction is obtained.

[0013] Optionally, the device further comprises a hot zone generating unit, configured to:

[0014] Performing object recognition on the live broadcast screen to obtain a location area of ​​each of the at least one recommended object in the live broadcast screen; and

[0015] Obtaining a viewer account associated with each of the at least one recommended object; wherein the association between the recommended object and the viewer account is established based on a positional relationship between a location area of ​​each of the at least one recommended object in the live broadcast image and an eye gaze point detected by the terminal device when the terminal device plays the live broadcast image using the viewer account;

[0016] The associated viewer account is marked in the location area of ​​each recommended object to generate a visual hotspot corresponding to each recommended object.

[0017] Optionally, the hot zone generation unit is specifically used to:

[0018] Receive multiple sets of association relationships sent by the backend server, each set of association relationships including a recommended object associated with a viewer account;

[0019] The recommended objects in the multiple groups of association relationships are compared with the at least one recommended object to determine the viewer account associated with each recommended object in the at least one recommended object.

[0020] Optionally, at least one of the following methods is used to present at least one visual hotspot in the live broadcast image:

[0021] In the location area of ​​each recommended object, at least one tag information is displayed, where each tag information represents at least one viewer account associated with the corresponding recommended object;

[0022] Display the number of viewer accounts associated with each recommended object, where the number of viewer accounts is positively correlated with the density of the tagged information;

[0023] The recommended objects with the largest number of associated viewer accounts are displayed in a hot zone display style different from that of the other recommended objects;

[0024] Recommended objects with different numbers of associated viewer accounts are displayed in different hot zone display styles;

[0025] Recommended objects whose numbers of associated viewer accounts are in different numerical ranges are displayed in different hot zone display styles.

[0026] Optionally, the live broadcast screen further displays a hot zone display control, and the hot zone presentation unit is further configured to:

[0027] In response to a triggering operation on the hot zone display control, the hot zone display instruction is obtained.

[0028] Optionally, the device further includes a gaze point recognition unit, configured to:

[0029] Performing object recognition on the live broadcast screen to obtain a location area of ​​each of the at least one recommended object in the live broadcast screen;

[0030] Obtaining position information of the detected eye gaze point on the live broadcast image;

[0031] Determining a target recommended object corresponding to the location information based on a positional relationship between the location information and the location areas of each recommended object;

[0032] An association relationship between the currently used target audience account and the target recommendation object is established, and the association relationship is uploaded to the backend server.

[0033] Optionally, the device further includes an object focusing unit, configured to:

[0034] receiving a trigger operation performed on a target visual hotspot among the at least one visual hotspot;

[0035] Displaying a focus operation control for the target recommended object corresponding to the target visual hotspot;

[0036] In response to a triggering operation on the focus operation control, the target recommended object is displayed in an enlarged manner.

[0037] Optionally, the object focusing unit is specifically configured to:

[0038] In response to a trigger operation on the focus operation control, sending a focus instruction to a connected camera device, wherein the focus instruction is used to instruct the camera device to focus on the target recommended object;

[0039] A screen display is performed based on the focused screen data sent by the camera device to display the magnified target recommended object.

[0040] Optionally, the hot zone presentation unit is further configured to:

[0041] After receiving a trigger operation for a target visual hot zone in the at least one visual hot zone, displaying an information display control corresponding to the target recommended object;

[0042] In response to a triggering operation on the information display control, an information display page of the target recommended object is displayed, and the information display page displays at least one of object introduction information of the target recommended object and an account identifier of an associated viewer account.

[0043] Optionally, the information display page further displays a first object recommendation control corresponding to the target recommended object;

[0044] The device further includes a recommendation unit, configured to:

[0045] In response to a triggering operation performed on the first object recommendation control, the object link address associated with the target recommended object is sent to a viewer account associated with the target recommended object.

[0046] Optionally, the recommendation unit is further configured to:

[0047] In response to a triggering operation performed on an account identifier of a target audience account among the audience accounts displayed on the information display page, displaying an instant messaging page with the target audience account as a communication object, the instant messaging page displaying a second object recommendation control corresponding to the target recommended object;

[0048] In response to a triggering operation performed on the second object recommendation control, the object link address associated with the target recommended object is sent to the target audience account.

[0049] Optionally, the hot zone presentation unit is further configured to:

[0050] In response to a triggering operation performed on the account identifier of the target audience account, displaying a gaze track page of the target audience account, the gaze track page including each recommended object corresponding to the eye gaze point of the target audience account on the corresponding terminal device;

[0051] The account identifier of the target audience account is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page.

[0052] Optionally, the hot zone presentation unit is specifically configured to:

[0053] Sorting the recommended objects according to the dwell time of the eye gaze point corresponding to the target audience account within the location area of ​​each recommended object, and displaying the gaze point track page based on the sorting order of the recommended objects; or

[0054] The recommended objects are sorted according to the track order of the eye gaze points corresponding to the target audience accounts within the position areas of the recommended objects, and the gaze point track page is displayed based on the sorting order of the recommended objects.

[0055] Optionally, the hot zone presentation unit is further configured to:

[0056] Display hot zone off controls;

[0057] In response to a triggering operation on the hot zone closing control, the at least one visual hot zone is hidden and the live broadcast screen is displayed again.

[0058] Optionally, the live broadcast screen further displays a display control of a display page of the at least one recommended object;

[0059] The hot zone presentation unit is further configured to:

[0060] In response to a trigger operation on the display page display control, a display page including the at least one recommended object is displayed; in the display page, a display control for viewing a viewer account associated with each recommended object is displayed;

[0061] In response to a triggering operation performed on a display manipulation control corresponding to a target recommendation object, an account identifier of a viewer account associated with the target recommendation object is displayed.

[0062] Optionally, the hot zone presentation unit is specifically configured to:

[0063] sorting the at least one recommended object according to the number of viewer accounts associated with each of the at least one recommended object;

[0064] The display page is displayed based on the sort order of the at least one recommended object.

[0065] In one aspect, a computer device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the above methods when executing the computer program.

[0066] In one aspect, a computer storage medium is provided, on which computer program instructions are stored, and when the computer program instructions are executed by a processor, the steps of any of the above methods are implemented.

[0067] In one aspect, a computer program product or computer program is provided, the computer program product or computer program comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the steps of any of the above methods.

[0068] In an embodiment of the present application, the terminal device can present at least one visual hotspot, which is used to represent the number of viewers who are looking at the location of the corresponding recommended object in the live broadcast image. Therefore, when watching the live broadcast image, without the need for the audience to actively interact, the audience's interest in each recommended object can be more intuitively understood, and audience feedback can be obtained more promptly. Accordingly, the anchor can adjust the live broadcast content in a timely manner to improve the accuracy of the live broadcast content. For example, when the anchor recommends an item during a live broadcast, the item can be introduced and recommended in a targeted manner, thereby improving the accuracy of the item recommendation and providing a better experience for the audience. BRIEF DESCRIPTION OF THE DRAWINGS

[0069] Figure 1 Schematic diagram of application scenarios provided by embodiments of the present application;

[0070] Figure 2 A flow chart of a method for displaying hot spots on a live broadcast screen according to an embodiment of the present application;

[0071] Figure 3a-3b A schematic diagram of a live broadcast screen provided in an embodiment of the present application;

[0072] Figure 4a to Figure 4c A schematic diagram of a live broadcast screen presenting a visual hotspot provided in an embodiment of the present application;

[0073] Figure 5 Another schematic diagram of the flow of the method for displaying hot spots of a live broadcast screen provided in an embodiment of the present application;

[0074] Figure 6 A schematic diagram of the eye tracking principle provided in an embodiment of the present application;

[0075] Figure 7 A further flow chart of the method for displaying hot spots of a live broadcast screen provided in an embodiment of the present application;

[0076] Figure 8 Another flowchart of the hot zone display method of the live broadcast screen provided in the embodiment of the present application;

[0077] Figure 9a to Figure 9g This is a schematic diagram of the operation of the live broadcast screen provided in an embodiment of the present application;

[0078] Figure 10A schematic diagram of the operation of displaying a display page provided in an embodiment of the present application;

[0079] Figure 11 A schematic diagram of the structure of a hot zone display device for a live broadcast screen provided in an embodiment of the present application;

[0080] Figure 12 A schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0081] In order to make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application. In the absence of conflict, the embodiments in the present application and the features in the embodiments can be combined with each other in any way. In addition, although a logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in an order different from that here.

[0082] To facilitate understanding of the technical solutions provided in the embodiments of the present application, some key terms used in the embodiments of the present application are explained here:

[0083] Live broadcast: Live broadcast refers to the technology of collecting audio or video data from the host through audio or video acquisition equipment, compressing it into a viewable and transmittable video stream through a series of processing such as video encoding, and outputting it to the audience's end device for playback. Live broadcast is a broadcast method that combines post-production synthesis and broadcasting simultaneously. In addition to the audio or video data collected by the acquisition equipment, the live broadcast screen will also synthesize and display other content, such as screen effects (such as beauty effects or face masking effects), interactive operation controls (such as controls such as likes, comments, or follows), and entrances to recommended objects (such as products).

[0084] Recommended objects: The recommended objects can be the content displayed in the live broadcast screen, such as physical objects placed in the main physical space, or electronic content displayed in the live broadcast screen, such as virtual objects, text or link addresses. For example, when the host recommends physical goods displayed in the physical space, the host can introduce each product, and the audience can decide whether to purchase the goods based on the host's introduction. In this case, the recommended objects can be these products. For some live broadcasts, the objects recommended by the host are not physical goods, but electronic content displayed on the screen, such as text. In this case, the recommended objects can also be these texts. The embodiments of this application do not limit the specific form of the recommended objects.

[0085] Visual hotspots: Visual hotspots measure the level of attention each recommended object receives from viewers watching the live stream. They are calculated by dividing the live stream into regions based on the level of attention paid to each recommended object. For example, the higher the viewer's attention to a recommended object, the higher the level of attention represented by the visual hotspot. For example, when using color blocks, the color blocks in the area of ​​the recommended object with higher attention are darker and more densely packed. Attention is primarily measured based on the recommended object where the viewer's eye is focused.

[0086] Eye gaze point: The eye gaze point refers to the point where the viewer's gaze is located on the terminal device, as determined using eye tracking technology. In the embodiments of this application, this is primarily focused on the point where the viewer's gaze is located on the live broadcast screen. Eye tracking technology is a science and technology that can predict the user's gaze point in real time. When a person's eyes look in different directions, there will be subtle changes in the eyes. These changes will produce extractable features. These features can be detected by the terminal device through image capture or scanning extraction, thereby tracking eye changes in real time and predicting the user's gaze point.

[0087] Viewer Account: In live streaming scenarios, this generally includes both hosts and viewers. Viewers use their accounts to watch live content by logging into their accounts through the live streaming client. It should be noted that in practice, viewers can watch live streams using guest accounts without registering an account. Therefore, the term "viewer account" here also includes guest accounts.

[0088] The following is a brief introduction to the design concept of the embodiments of this application.

[0089] With the continuous development of technology, various traffic platforms provide live broadcast functions, and anchors can recommend objects to viewers through live broadcasts. However, due to physical space limitations, anchors cannot directly see the audience and cannot directly obtain feedback from the audience. Instead, they can only passively accept feedback from the audience, which makes the anchors have certain uncertainties in the selection of live broadcast content, and thus cannot adjust the currently recommended items in time. It is very likely that they will not be able to accurately recommend items to the audience, and the accuracy of item recommendations is low. For example, when the anchor does not know which item the audience likes, if he introduces some items that the audience is not interested in, the audience's viewing experience will also be poor.

[0090] The main reason for these problems is that the anchor cannot actively obtain feedback from the audience, and can only judge the audience's preferences through barrages, likes or gifts. These judgment dimensions have a high threshold and require the audience to take these active actions before making judgments. Therefore, to solve these problems, a new dimension of obtaining audience feedback is needed, so that the anchor's end device can actively present the audience's feedback to the anchor.

[0091] In view of this, an embodiment of the present application provides a method for displaying hot zones of a live screen. In this method, a terminal device can present at least one visual hot zone, which is used to represent the number of viewers who are looking at the area where the corresponding recommended object is located in the live screen. Therefore, when watching the live screen, the audience does not need to actively interact, and can more intuitively understand the audience's interest in each recommended object, and obtain audience feedback more promptly.

[0092] In some embodiments, when a terminal device uses a viewer account to play a live broadcast, the viewer account is associated with the recommended object by detecting the location area of ​​the eye gaze point on the live broadcast, and then when a visual hot zone needs to be presented on the live broadcast, the corresponding visual hot zone can be presented on the live broadcast.

[0093] In some embodiments, by collecting the viewer's gaze points and trajectories on the audience side and displaying them in the form of hot zones on the host's side device, the host can then judge which pictures the viewers are interested in and which are not based on the hot zones. The host can then adjust the live broadcast content in a timely manner, such as adjusting the live broadcast lens or speaking content, and focusing on the pictures that the viewers are more interested in, making the live broadcast more flexible, just like giving a live speech, and being able to adjust the words in time according to the audience's feedback, liven up the atmosphere, and improve the audience's viewing experience.

[0094] As can be seen, in the method provided by the embodiment of the present application, the host's terminal device can actively present audience feedback to the host, expanding the dimensions of the host's ability to obtain audience feedback. Accordingly, the host can adjust the live broadcast content in a timely manner, improving the accuracy of the live broadcast content. For example, when the host recommends items during a live broadcast, the host can introduce and recommend items in a targeted manner, thereby improving the accuracy of the item recommendations and enhancing the audience's experience.

[0095] After introducing the design concepts of the embodiments of the present application, the following briefly introduces the application scenarios to which the technical solutions of the embodiments of the present application can be applied. It should be noted that the application scenarios introduced below are only used to illustrate the embodiments of the present application and are not limiting. In the specific implementation process, the technical solutions provided by the embodiments of the present application can be flexibly applied according to actual needs.

[0096] The solution provided by the embodiment of the present application can be applied to most video application scenarios, especially to real-time video application scenarios such as live broadcast scenarios. Figure 1 As shown, a schematic diagram of a network architecture provided in an embodiment of the present application is provided, in which the architecture may include a first device 101, a server 102 and a second device 103.

[0097] The first device 101 can install and run a real-time video application that can play videos, such as a browser or a real-time video client, and the user can perform corresponding real-time video services, such as live broadcast services, on the application. The application involved in the embodiment of the present application can be a software client, or a client such as a web page or a small program, and the server is a background server corresponding to the software or web page, small program, etc., and the specific type of client is not limited. The first device 101 can be a terminal used by the first type of user, and the first type of user can play real-time video using the first device 101.

[0098] The server 102 may be a background server corresponding to the real-time video application installed on the first device 101. For example, it may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It may also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, i.e., content delivery networks (CDNs), as well as big data and artificial intelligence platforms, but is not limited thereto.

[0099] The second device 103 may also have a real-time video application installed and running that can play videos, such as a browser or a real-time video client. The user can use the application to perform corresponding real-time video services, such as live broadcast services. The second device 103 may be a terminal used by the second type of user, and the second type of user can use the first device 101 to initiate and play real-time videos.

[0100] The first device 101 and the server 102, as well as the second device 103 and the server, can be directly or indirectly connected via one or more networks. The network can be a wired network or a wireless network, for example, a mobile cellular network or a Wireless Fidelity (WIFI) network. Of course, other possible networks are also possible, and the embodiments of the present invention do not limit this.

[0101] The first device 101 or the second device 103 mentioned above can be, for example, a smart phone, a smart handheld device, a tablet computer (PAD), a laptop computer, a desktop computer, a smart TV, a car terminal or other devices, but is not limited thereto.

[0102] Taking the live broadcast scenario as an example, the first device 101 can be the anchor-end device, and accordingly, the application installed on the first device 101 can be the anchor client used by the anchor. The anchor can collect audio data or video data through the data acquisition devices included in the first device 101 itself, such as cameras and microphones, or can collect audio data or video data through external cameras or recording devices connected to the first device 101, and upload these audio data or video data to the server 102 to generate a live broadcast picture through the collected audio or video data.

[0103] The second device 103 may be a viewer-end device, and the application on the terminal device 103 may be a viewer client used by the viewer. The viewer may use the viewer client to obtain live screen data from the server 102 and display the data through the viewer client.

[0104] In actual scenarios, a terminal device can usually serve as both the first device 101 and the second device 103.

[0105] In actual application, after the host creates a live broadcast room using the first device 101, the audience can enter the live broadcast room through the second device 103 and watch the live broadcast. While the audience is watching the live broadcast, the second device 103 can detect the viewer's eye gaze point in real time using eye tracking technology. The second device 103 can detect the eye gaze point through methods such as infrared detection or image recognition. Of course, other possible methods can also be used to detect the eye gaze point. Taking infrared detection as an example, the second device 103 can include an infrared (IR) light camera, which can then illuminate the pupil with IR light and determine the eye gaze point based on the light reflected from the pupil. At the same time, the second device 103 can also perform real-time image recognition on the live broadcast screen to identify the location area of ​​each recommended object in the live broadcast screen. Then, based on the location information of the eye gaze point in the live broadcast screen, it can determine the recommended object that the viewer is looking at, and upload the viewer information (i.e., the viewer account information currently logged in by the second device 103) and the recommended objects that each viewer has looked at to the server 102 in real time.

[0106] In one possible implementation, the first device 101 can also perform real-time image recognition on the live broadcast screen, identify the location area of ​​each recommended object in the live broadcast screen, and upload the location area of ​​each recommended object on the first device 101 terminal to the server 102. The server 102 can then generate a visual hotspot corresponding to each recommended object based on the recommended objects that each viewer has looked at, which are received from the second device 103, and the location area of ​​each recommended object uploaded by the first device 101. When the first device 101 requests to display the visual hotspot, the generated visual hotspot data is sent to the first device 101 so that the visual hotspot is presented on the first device 101.

[0107] In another possible implementation, the server 102 sends the recommended objects that each viewer has looked at to the first device 101. The first device 101 can also perform real-time image recognition on the live screen, identify the location area of ​​each recommended object in the live screen, and generate visual hot spots for each recommended object in combination with the recommended objects that each viewer has looked at. When the host operates to display the visual hot spots, the first device 101 can present the visual hot spots in the live screen. In this way, the generation of visual hot spots implemented by the first device 101 can effectively reduce the delay in the presentation of the visual hot spots, and improve the real-time nature of the visual hot spot information obtained by the host.

[0108] Of course, in the above embodiments, the first device 101 presents the visual hot zone as an example, but in actual applications, the second device 103 can also present the visual hot zone.

[0109] In addition, in the above-mentioned embodiments, the live broadcast scene is taken as an example, but the method of the embodiment of the present application can also be applied to other video scenes. For example, the method of the embodiment of the present application can be applied to a multi-person video conferencing scene, and each terminal device in the multi-person video conferencing scene can correspond to the above-mentioned first device 101 or the second device 103. Alternatively, the method of the embodiment of the present application can also be applied to an online classroom scene, and the teacher-end device in the online classroom scene can correspond to the above-mentioned first device 101, and the student-end device can correspond to the above-mentioned second device 103. Of course, it can also be applied to other video scenes, and the embodiment of the present application does not limit this.

[0110] It should be noted that in the embodiment of the present application, the number of first devices 101 can be one or more, and similarly, the number of servers 102 can be one or more, that is, there is no restriction on the number of first devices 101 or servers 102.

[0111] In one possible application scenario, the relevant data involved in the embodiments of this application (such as the recommended objects viewed by each viewer account) can be stored using cloud storage technology. Cloud storage is a new concept that extends and develops from the concept of cloud computing. A distributed cloud storage system refers to a storage system that uses cluster applications, grid technology, and distributed storage file systems to bring together a large number of different types of storage devices (or storage nodes) in a network through application software or application interfaces to work together and provide external data storage and service access functions.

[0112] Currently, storage systems utilize a method for creating logical volumes. When creating a logical volume, physical storage space is allocated for each logical volume. This physical storage space may consist of disks on a specific storage device or several storage devices. When a client stores data on a logical volume, it stores the data on a file system. The file system divides the data into multiple parts, each of which is an object. An object contains not only the data but also additional information such as the data identifier (ID) of the data entity. The file system writes each object to the physical storage space of the logical volume and records the storage location information of each object. Therefore, when a client requests access to data, the file system can provide access to the data based on the storage location information of each object.

[0113] The storage system allocates physical storage space to logical volumes by pre-dividing the physical storage space into stripes based on the estimated capacity of the objects to be stored in the logical volume (this estimate often has a large margin relative to the actual capacity of the objects to be stored) and the Redundant Array of Independent Disks (RAID) groupings. A logical volume can be understood as a stripe, thereby allocating physical storage space to the logical volume.

[0114] In one possible application scenario, to reduce communication latency, servers 102 can be deployed in various regions. Alternatively, for load balancing, different servers 102 can serve the regions corresponding to the first device 101 or the second device 103. Multiple servers 102 can share data through blockchain, and multiple servers 102 are equivalent to a data sharing system composed of multiple servers 102. For example, the first device 101 or the second device 103 is located at location a and communicates with server 102. The first device 101 or the second device 103 is located at location b and communicates with other servers 102.

[0115] Each server 102 in the data sharing system has a node identifier corresponding to that server 102. Each server 102 in the data sharing system can store the node identifiers of other servers 102 in the data sharing system so that the generated blocks can be broadcast to other servers 102 in the data sharing system based on the node identifiers of other servers 102. Each server 102 can maintain a node identifier list, storing the server 102 name and node identifier in the node identifier list. The node identifier can be an Internet Protocol (IP) address for interconnection between networks, or any other information that can be used to identify the node.

[0116] Of course, the method provided in the embodiment of the present application is not limited to Figure 1 The application scenarios shown can also be used in other possible application scenarios, and the embodiments of this application are not limited thereto. Figure 1 The functions that can be implemented by each device in the application scenario shown will be described in subsequent method embodiments and will not be described in detail here.

[0117] The method flow provided in each embodiment of the present application can be Figure 1 The process may be executed by any one of the first device 101, the second device 103 or the server 102, or may be executed jointly by the first device 101 and the second device 103, or may be executed jointly by the first device 101, the second device 103 and the server 102. The following mainly introduces the process by taking the first device 101, the second device 103 and the server 102 as examples.

[0118] See also Figure 2 The figure shows a flow chart of the hot zone display method of the live broadcast screen provided in an embodiment of the present application.

[0119] Step 201: The terminal device displays a live broadcast screen of the live broadcast room, and the live broadcast screen displays at least one recommended object.

[0120] It should be noted that the terminal device here can be the first device 101 mentioned above, or the second device 103 mentioned above. That is to say, in actual applications, the device for displaying visual hot zones can be a host-end device or a viewer-end device, and this embodiment of the present application does not limit this.

[0121] During the specific implementation process, the terminal device can respond to the host's live broadcast room creation operation to create a corresponding live broadcast room, and can respond to the host's broadcast start operation. When the host is broadcasting live, in order to enable the host to understand the live broadcast situation and the audience's feedback, the live broadcast picture of the live broadcast room is displayed on the terminal device.

[0122] In some embodiments, the terminal device can start the live broadcast application in response to the host's start-up operation on the live broadcast application, and based on the host's start-up operation in the live broadcast application, request the server corresponding to the live broadcast application to start broadcasting. Correspondingly, based on the server's response, the live broadcast screen is displayed on the terminal device.

[0123] In some implementations, the terminal device can also initiate a live broadcast application in response to a trigger from another device. For example, when a live streamer is broadcasting, they typically connect other external devices, such as cameras, microphones, lighting, and an external display. Once all devices are debugged and the broadcast is confirmed to begin, these devices can trigger the terminal device to initiate the live broadcast application and perform subsequent operations.

[0124] Correspondingly, the terminal device can also enter the anchor's live broadcast room in response to the viewer's operation of entering the live broadcast room, that is, display the live broadcast picture of the live broadcast room on the terminal device.

[0125] In some embodiments, the terminal device can start the live broadcast application in response to the viewer's start-up operation on the live broadcast application, and based on the live broadcast room selected by the viewer in the live broadcast application, request the live broadcast data of the live broadcast room from the server, and then display the live broadcast picture on the terminal device based on the server's response.

[0126] In some embodiments, the content displayed by the host-end device and the audience-end device may be the same, or there may be certain differences. For example, the live broadcast screen displayed by the host-end device may include function buttons that are not included in the live broadcast screen displayed by the audience-end device. Similarly, the live broadcast screen displayed by the audience-end device may also include function buttons that are not included in the live broadcast screen displayed by the host-end device.

[0127] In the above process, the terminal device starts the live broadcast application and displays a live broadcast screen in the live broadcast application, in which one or more recommended objects are displayed.

[0128] In some implementations, the recommended objects may be physical items placed in the physical space of the live broadcast room.

[0129] See also Figure 3a As shown in the figure, it is a schematic diagram of a live broadcast screen. When anchor A creates a live broadcast room, or starts broadcasting in an already created live broadcast room, viewers who enter anchor A’s live broadcast room can see the following: Figure 3a When anchor A is broadcasting live, he can use an image acquisition device such as a camera to shoot video images and show them to the audience, such as Figure 3a As shown, the host A uses a camera to shoot an item display stand in a physical space, so that the item display stand can also be displayed in the live broadcast screen. The item display stand displays multiple physical items, such as Figure 3a As shown, the item display stands in the top row display dolls from multiple companies, and the item display stands in the second row display toy cars, cups, rabbit dolls, etc. Through the live broadcast screen displayed on the audience-end device, the audience can view the various physical items on the item display stands, and these physical items can be recommended objects. The anchor can introduce each physical item, and the audience can judge whether they need the physical item based on the anchor's introduction.

[0130] In some implementations, the recommended object may also be electronic content displayed in the live broadcast screen, such as virtual items, text, or link addresses.

[0131] See also Figure 3b As shown in the figure, it is a schematic diagram of another live broadcast screen. Figure 3a In the live broadcast picture shown, host A may not use image acquisition equipment such as cameras to provide the live broadcast picture, but may directly present the electronic content interface. For example, the screen of other electronic devices may be connected to form the live broadcast picture, and the electronic content presented in the live broadcast picture may also be used as a recommendation object.

[0132] For example, anchor A can be a game anchor, then anchor A can connect the game screen he is currently playing to form a live broadcast screen, see Figure 3b As shown, anchor A may currently be in the game hero selection interface, on which game heroes 1 to 4 are displayed. Through this interface, anchor A may select the hero to play next, or select the hero to explain to the audience, and these heroes may then be recommended.

[0133] Step 202: The terminal device responds to the hot zone display instruction triggered for the live broadcast image and presents at least one visual hot zone in the live broadcast image, where each visual hot zone is used to represent the number of viewers who are looking at the location area of ​​the corresponding recommended object in the live broadcast image.

[0134] In an embodiment of the present application, in order to enable the host or the audience to obtain the interest level of the audience currently watching the live broadcast screen in each recommended object in the live broadcast screen, the visual hot spots of the current live broadcast screen can be displayed to them.

[0135] In some embodiments, see Figure 3a and Figure 3b As shown, a hot zone display control is also displayed in the live broadcast screen. When the visual hot zone of the live broadcast screen needs to be presented, the hot zone display control can be triggered. Correspondingly, based on the trigger operation, the terminal device can receive the hot zone display instruction. For example, the live broadcast application client on the terminal device may receive the hot zone display instruction and then present the corresponding visual hot zone.

[0136] exist Figure 3a and Figure 3b In the embodiment, the hot zone display controls are respectively displayed at the bottom and top of the live screen, but it should be understood that the display position and icon style of the hot zone display controls are not limited in the embodiment of the present application, and corresponding settings can be made according to actual conditions in actual applications.

[0137] Optionally, the user's triggering operation for the hot zone display control includes but is not limited to: a click operation, a long press operation, a double-click operation, a sliding operation, etc. The embodiment of the present application does not limit the type of triggering operation. Similarly, when the triggering operation is mentioned later, the operation type of the operation can be the above-mentioned operation, and for the triggering operation of different spaces, the triggering operation type can be the same or different.

[0138] In some embodiments, for the neatness of the live broadcast screen, the hot zone display control may not be displayed in the live broadcast screen, and the user (which may be the host or the audience) may trigger the terminal device to obtain the hot zone display instruction in other ways. For example, a shortcut key can be set, that is, a certain key of the terminal device is set as a shortcut key for hot zone display, and then the terminal device can obtain the hot zone display instruction by operating the shortcut key. Alternatively, it can be performed by gesture operation, that is, a gesture for hot zone display is pre-set, and when the operator uses the gesture to operate the terminal device, the terminal device can obtain the hot zone display instruction. Of course, the hot zone display instruction can also be triggered in other ways, such as voice control, eye movement triggering, expression triggering, and body movement triggering, etc. The embodiment of the present application does not limit the method for triggering the hot zone display instruction.

[0139] In some embodiments, the terminal device can also detect whether the conditions for triggering the hot zone display are currently met. If so, the hot zone display instruction is automatically triggered. Accordingly, the terminal device displays the visual hot zone based on the hot zone display instruction triggered by itself. For example, the frequency of hot zone display can be pre-set, such as once every 2 minutes or once every 5 minutes. When the time arrives, the terminal device determines that the trigger conditions for hot zone display are met and automatically triggers the hot zone display instruction; or the terminal device can also detect the live broadcast screen. When specific content appears in the live broadcast screen, the terminal device determines that the trigger conditions for hot zone display are met and automatically triggers the hot zone display instruction; or the terminal device can make a judgment based on the current attention of each viewer to the recommended object. For example, when the attention of a certain product is particularly high, while the attention of the product currently introduced by the anchor is low, the terminal device determines that the trigger conditions for hot zone display are met and automatically triggers the hot zone display instruction. Of course, the hot zone display instruction can also be triggered by a trigger condition. The embodiment of the present application does not limit the method for triggering the hot zone display instruction.

[0140] In an embodiment of the present application, when using a live broadcast application, the user can selectively select a triggering method for the hot zone display instruction, that is, the desired triggering method can be set in advance, and then during the display of the anchor screen, the corresponding triggering method will be used to trigger the hot zone display instruction.

[0141] Optionally, the user can also choose to turn off the hot zone display function, which means that the user does not want to display the visual hot zone. Therefore, the display of the visual hot zone will not be triggered during the live screen display.

[0142] In the embodiment of the present application, the visual hot zone is used to represent the number of viewers who are looking at the location area of ​​the corresponding recommended object in the live broadcast screen. In actual applications, usually one viewer uses one viewer account to watch the live broadcast content, so each visual hot zone also represents the number of viewer accounts associated with the corresponding recommended object. The association relationship between the recommended object and the viewer account is established based on the position relationship between the position area of ​​at least one recommended object in the live broadcast screen and the eye gaze point detected by the terminal device when the terminal device uses the viewer account to play the live broadcast screen. In other words, it can also reflect the regional distribution of the viewer's eye gaze points on the live broadcast screen. The denser the distribution of the viewer's eye gaze points in the location area of ​​a recommended object, it indicates that more viewers are currently more interested in the recommended object.

[0143] In some embodiments, the association between a viewer account and a recommended object indicates the recommended object that the viewer account is looking at. That is, when a viewer's eye gazes on a recommended object while watching a live broadcast through their corresponding viewer account, the viewer account is associated with the recommended object. It should be noted that because viewers' eye gazes continuously change while watching a live broadcast, for example, they may focus on product A one second and shift their gaze to product B the next. Therefore, this association changes in real time and is not a fixed relationship.

[0144] In the embodiment of the present application, at least one of the following methods can be used to present at least one visual hotspot in the live broadcast image, and combined with Figure 4a to Figure 4c As shown, Figure 4a and Figure 4b Both are schematic diagrams of live broadcast images showing visual hot spots.

[0145] (1) At least one tag information is displayed in the location area corresponding to each recommended object, where each tag information represents at least one viewer account associated with the corresponding recommended object.

[0146] In the embodiment of the present application, the number of viewer accounts may be presented by marking each viewer account associated with each recommendation object.

[0147] In some implementations, one tag may correspond to one viewer account. That is, when viewer account 1 is associated with recommended object A, a tag is added to the location area of ​​recommended object A, so that the number of tags reflects the number of viewer accounts associated with recommended object A.

[0148] In some implementations, color blocks can be used as marking information, and the color blocks of each viewer account are the same. When viewer account 1 is associated with recommended object A, a color block is added to the location area of ​​recommended object A. In this way, the color blocks of viewer accounts associated with recommended object A are superimposed within its location area. The density and color depth of the color blocks can intuitively reflect the attention of recommended object A. The denser the color blocks and the darker the color, the higher the attention of recommended object A. Figure 4a As shown, a corresponding number of color blocks are superimposed in the location area corresponding to each displayed product. For example, in the first row of product display stands, the number of viewers whose eyes are fixed on the first penguin doll area from the left is less than the number of viewers whose eyes are fixed on the second penguin doll area from the left. Therefore, in the visual hotspot, the number of color blocks in the first penguin doll area is significantly less than that in the second penguin doll area. However, it should be noted that due to the possible superposition of color blocks, Figure 4a The number of color blocks shown may not directly correspond to the number of viewers.

[0149] In some implementations, one tag information may correspond to multiple viewer accounts. That is, one tag information may represent multiple viewer accounts that viewed a certain recommended object. For example, if there are 10,000 viewers viewing a certain recommended object, one tag information is added within the location area of ​​the recommended object.

[0150] In the embodiment of the present application, the density of the tag information is positively correlated with the number of associated viewer accounts, that is, the more viewers watch a recommended object, the more tag information is within the location area of ​​the recommended object.

[0151] Optionally, in the specific implementation process, the specific style of the color block is not limited in the embodiment of the present application. For example, different recommended objects can use the same color block color, such as red or green, or different recommended objects can use different color block colors, such as each recommended object corresponds to a color number. In addition, different recommended objects can use the same color block shape, such as Figure 4aThe circle shown, or different recommended objects can also use different color block shapes, such as a circle for recommended object A and a star for recommended object. Furthermore, the marking style of visual hotspots is not limited to color blocks; it can be any visual style that serves the marking purpose.

[0152] In some implementations, visual hotspots can also be presented in the form of a heat map. When a viewer account is associated with a recommended object A, the color of the location area of ​​the recommended object A is darkened by one unit. In this way, the number of viewer accounts associated with the recommended object A determines the color depth of its location area. The color depth in the heat map can intuitively reflect the attention of the recommended object A. Figure 4b As shown, by superimposing colors in the position area corresponding to each game hero, the audience's attention to each game hero is reflected. For example, the color of game hero 1 is obviously lighter than that of game hero 2, which indicates that the audience's attention to game hero 2 is higher than that of game hero 1.

[0153] (2) Display the number of viewer accounts associated with each recommended object.

[0154] In order to more intuitively reflect the attention of each recommended object, the number of viewer accounts associated with each recommended object can also be directly displayed.

[0155] See also Figure 4a and Figure 4b As shown, each recommended object also shows the number of viewers who are watching the recommended object. The viewers who are watching a recommended object refer to the viewers whose sight points (i.e., the detected eye gaze points) fall within the recommended object area.

[0156] In some embodiments, the number of viewers can be displayed in the corresponding area of ​​the recommended object. Figure 4a As shown in the first row of item display stands, the area near the first penguin doll from the left shows "about 20,000 people watching", which means that the number of viewers whose eyes are focused on the penguin doll area is about 20,000. Figure 4b As shown, “about 20,000 people are watching” is displayed in the position area of ​​the game hero 1, which means that the number of viewers whose eyeballs are fixated on the game hero 1 is about 20,000.

[0157] In some implementations, the number of viewers watching each recommended object can also be displayed in a sorted manner. Figure 4cAs shown, in order to make it easier for the anchor to obtain the attention ranking of each game hero, the number of viewers watching each game hero can be directly presented in a ranked manner. For example, in the current live broadcast screen, the number of viewers watching Game Hero 2 is about 90,000, ranking first, and the number of viewers watching Game Hero 3 is about 60,000, ranking second, and so on.

[0158] It should be noted that there are no restrictions on the display method and display style of the number of viewers. For example, other possible bubble styles can be used, or the number of viewers can be displayed in other locations. In addition, the data displayed in the visual hotspot is not limited to the number of people, but can be all data related to the user profile, such as geographic location, age, etc.

[0159] (3) The recommended object with the largest number of associated viewer accounts is displayed in a hot zone display style different from that of the other recommended objects.

[0160] In this embodiment of the present application, the first recommended object is used to represent the recommended object with the largest number of associated viewer accounts, that is, the recommended object with the most viewers, and the second recommended object is the recommended object other than the first recommended object. In order to help the host more intuitively know which recommended object has the highest attention, the visual hotspot of this recommended object can be displayed in a different way from other recommended objects.

[0161] In one embodiment, the visual hotspot of the first recommended object can be highlighted. The highlighted content can be the location area of ​​the recommended object or the number of viewers. Figure 4a As shown, the number of viewers watching the penguin doll in the middle of the first row is about 70,000, ranking first among all items. Therefore, the penguin doll is the first recommended object, and the other items are the second recommended objects. When presenting the visual hot zone, the bubble of the number of viewers watching the penguin doll can be highlighted. Figure 4a Specifically, a darker bubble is used to display the number of viewers watching the penguin doll, making the number of viewers watching the penguin doll more eye-catching. Figure 4b As shown, the number of viewers watching Game Hero 2 is about 90,000, ranking first among all game heroes. Therefore, Game Hero 2 is the first recommended object, and the other game heroes are the second recommended objects. When presenting the visual hot zone, the number of viewers watching Game Hero 2 can be highlighted. Figure 4b Specifically, bold font is used to display the number of viewers watching Game Heroes 2, making the number of viewers watching Game Heroes 2 more eye-catching.

[0162] (4) Based on the number of associated viewer accounts, develop display styles for different visual hotspots.

[0163] In an embodiment of the present application, recommended objects with different numbers of associated viewer accounts are displayed in different hot zone display styles; or, recommended objects with different numerical ranges of associated viewer accounts are displayed in different hot zone display styles.

[0164] In some embodiments, the first category of recommended objects represents recommended objects whose number of associated viewer accounts is greater than the object quantity threshold, and the second category of recommended objects represents recommended objects whose number of associated viewer accounts is not greater than the object quantity threshold. In other words, the quantity threshold can be set in advance to highlight the recommended objects with higher audience attention. For example, the object quantity threshold can be set to 30% of the total number of viewers in the live broadcast room, so that the visual hotspots of the recommended objects with more than 30% of the audience watching can be highlighted and displayed. Of course, the object quantity threshold here is only an example. In actual applications, the corresponding numerical value can be set according to actual needs, and the embodiments of the present application do not limit this.

[0165] It should be noted that Figure 4a to Figure 4c The live broadcast screen showing the visual hot zone is only an example. In actual application, any other possible method can be used to present the visual hot zone, and the embodiments of the present application are not limited to this.

[0166] It should be noted that since the association between recommended objects and viewer accounts changes in real time, the visual hotspots will also change accordingly. For example, if the number of viewers watching recommended object A at the previous moment was 80,000, but the number of viewers watching object A at the current moment is only 20,000, the visual hotspots for recommended object A will need to be adjusted accordingly, such as adjusting the number and color of the displayed color blocks, as well as the value of the number of viewers watching. In addition, during a live broadcast, the host may also adjust the camera's shooting area or the content of the live broadcast, which will change the live broadcast image accordingly, and thus the visual hotspots will also change accordingly. For example, if the area captured at the previous moment included item A, but the camera lens is adjusted, item A is removed from the live broadcast image. In this case, the visual hotspot for item A will no longer be displayed. However, if a new item B appears, the visual hotspot for item B will be displayed based on the new data.

[0167] In the examples of this application, see Figure 4a to Figure 4c As shown, after the terminal device responds to the hot zone display instruction, it will also change the status of some controls on the live broadcast interface. For example, the hot zone display control will be changed to a hot zone closing control, which is changed to a "Close Hot Zone" button as shown in the figure. Then the user can trigger the hot zone closing control. Accordingly, the terminal device will respond to the trigger operation, hide at least one visual hot zone displayed, and return to the live broadcast screen before display.

[0168] The following describes the solution of the embodiment of the present application by taking the second device (viewer-end device) collecting the viewer's eye gaze points and displaying the visual hotspots on the first device (anchor-end device) as an example. Figure 5 As shown, it is another flow chart of the hot zone display method of the live broadcast screen provided in an embodiment of the present application.

[0169] Step 501a: The first device performs object recognition on the live broadcast screen to obtain the location area of ​​each recommended object in the live broadcast screen.

[0170] Step 501b: The second device performs object recognition on the live broadcast screen to obtain the location area of ​​each recommended object in the live broadcast screen.

[0171] In the embodiments of the present application, generally speaking, both the host end and the audience end will display the live broadcast screen, but due to the different devices used by the live broadcast end and the audience end, the position of each recommended object on the device screen may be different. Therefore, each terminal device (including the first device and the second device) can identify the live broadcast screen (including the people and objects in the screen) in real time, and record the position area of ​​each recommended object (including the people and objects in the screen) on the live broadcast screen in real time.

[0172] In some embodiments, the location area may refer to the location area of ​​the recommended object on the screen of the terminal device when the terminal device displays a live broadcast image. By identifying the location area of ​​each recommended object in real time, it is convenient to compare it with the audience's actual landing point, or to facilitate the subsequent display of visual hot spots.

[0173] In the embodiment of the present application, object recognition refers to the recognition of the live broadcast screen by image recognition, that is, the recognition of the recommended objects and corresponding location areas contained in the live broadcast screen. Since the live broadcast screen usually contains other function buttons or icons in addition to the video stream screen (referring to the video screen shot by the camera device), object recognition can only refer to the recognition of the video stream screen, that is, each frame of the video stream screen can be used as an image to be recognized, so that the video frame image can be recognized frame by frame, and the recommended objects and corresponding location areas included in each frame can be stored; or, object recognition can also be the recognition of the entire current live broadcast screen, for example, the display screen of the terminal device can be captured to obtain the image to be recognized, and then the captured image to be recognized is recognized, and the recommended objects and corresponding location areas included in each frame are stored.

[0174] It should be noted that there is no substantial sequential relationship between the processes of the above-mentioned step 501a and step 501b, and the first device executing step 501a and the second device executing step 501b can both be performed in real time and continuously. Therefore, the first device executing step 501a and the second device executing step 501b may be performed simultaneously, or there may be a certain order of precedence.

[0175] Step 502: The second device obtains the position information of the detected eye gaze point on the live broadcast screen.

[0176] The second device here can be the terminal device corresponding to any viewer account that enters the live broadcast room. In the specific implementation process, due to the hardware limitations of some terminal devices, eye tracking may not be supported, so the second device here may not be included.

[0177] The second device can detect the current viewer's eye gaze point in real time based on eye tracking technology.

[0178] In some embodiments, eye tracking can be performed using an eye tracker included in the second device. Figure 6 Figure 1 is a schematic diagram of the eye tracking principle. The eye tracking device may include a built-in infrared light source, an optical sensor, an image processor, and a viewpoint computing core.

[0179] When the second device is playing a live broadcast, the audience watches the live broadcast, and at this time, the eye tracker included in the second device executes Figure 6 In step S1, the eye tracker projects the created set image onto the human eye. The image can be projected by an infrared light source, for example, and the human eye usually cannot perceive the image. After the image is projected, the eye tracker executes step S2, which is to capture the face image through the optical sensor included therein, thereby obtaining the image information of the eye from the face image. Then, based on the captured eye image information, the eye tracker executes step S3, which is to extract the eye image features through the image processor included therein. Furthermore, the eye tracker executes step S4 based on the eye image features, which is to calculate the eye gaze point position information through the viewpoint calculation core included therein, such as the coordinates on the screen of the second device (the screen coordinates can be mapped to the position on the live screen).

[0180] In some implementations, the facial image of the audience may be captured by a camera of the second device, and then the facial image may be analyzed using a deep learning model to obtain the eye gaze point of the audience corresponding to the second device.

[0181] In the embodiments of this application, the eye tracking technology used is not limited to its specific implementation method or required physical conditions, as long as it can detect the viewer's eye gaze point. Furthermore, it should be understood that the use of eye tracking technology to detect eye gaze point can be performed with the viewer's permission. For example, during the initial detection, the live broadcast application may request the viewer to authorize the eye detection function.

[0182] Step 503: The second device determines the target recommendation object corresponding to the location area where the location information is located.

[0183] In the embodiment of the present application, by comparing the position information of the eye gaze point with the position area of ​​each recommended object, it is possible to obtain the position area of ​​the recommended object in which the eye gaze point is located, and the recommended object is the target recommended object.

[0184] In some implementations, the location information may be represented by coordinates. The coordinates of the eye gaze point may be used to traverse the location area included in each recommended object to obtain the target recommended object corresponding to the matching coordinates.

[0185] Step 504: The second device establishes an association relationship between the target audience account and the target recommendation object, and uploads the association relationship to the backend server.

[0186] In the embodiment of the present application, the target audience account refers to the account logged in to the live broadcast application on the second device. In some scenarios, the second device can use the live broadcast application as a visitor, so the visitor identity can also be considered as the target audience account.

[0187] In some embodiments, when a viewer uses a target viewer account to watch a live broadcast, if their eye gaze falls within the location area of ​​the target recommended object, then an association relationship exists between the target viewer account and the target recommended object, and the association relationship is uploaded to the backend server of the live broadcast application.

[0188] It should be noted that the detection of eye gaze points is carried out continuously in real time, and the association relationship can also be uploaded in real time. That is, whenever the second device determines that the viewer's eye gaze point falls within the location area of ​​a recommended object, that is, after the second device determines the recommended object that the current viewer is looking at, the target viewer account used by the viewer and the recommended objects viewed are uploaded to the background server.

[0189] Optionally, the uploaded target audience account information may be information such as an account identity (ID) that can uniquely identify an audience account, and the uploaded recommended object information may also be information such as an object ID or an object connection address that can uniquely identify a recommended object.

[0190] In the embodiment of the present application, generating a visual hotspot may include the following two methods.

[0191] (1) The first method

[0192] This method generates a visual hotspot by the first device, i.e. Figure 5 The method shown.

[0193] Step 505: The first device receives multiple sets of association relationships sent by the backend server, each set of association relationships includes a recommended object associated with a viewer account.

[0194] In an embodiment of the present application, in order to generate visual hot spots, the first device needs to obtain corresponding supporting data, that is, obtain the audience account associated with each recommended object in the live broadcast screen, and the background server receives the association relationship uploaded by each second device in real time. Then the background server can send the received association relationship to the first device, so that the first device can know the audience account associated with each recommended object based on the association relationship.

[0195] In some embodiments, the backend server may continuously receive association relationships and sequentially send the received association relationships to the first device. That is, whenever the backend server receives an association relationship sent by the second device, the backend server will synchronize it to the first device.

[0196] In some embodiments, the backend server may continue to receive association relationships until a certain trigger condition is determined to be met, and then send the association relationship to the first device. The trigger condition may be, for example, that the time difference from the last transmission reaches a time difference threshold, or that all association relationships of the second devices have been received, or that the number of received association relationships reaches a certain number threshold. Of course, other possible trigger conditions are also possible, and the embodiments of the present application are not limited thereto.

[0197] In an embodiment of the present application, after receiving the association relationship, the first device can compare the recommended objects in the multiple groups of association relationships with at least one recommended object to determine the viewer account associated with each recommended object in the at least one recommended object.

[0198] For example, items A, B, C, and D are displayed in the live broadcast screen, and the association relationship received by the first device is shown in Table 1 below, wherein the item associated with viewer account 1001 is item A, the item associated with viewer account 1001 is item A, the item associated with viewer account 1002 is item C, the item associated with viewer account 1003 is item B, the item associated with viewer account 1004 is item A, the item associated with viewer account 1005 is item C, the item associated with viewer account 1006 is item D, and the item associated with viewer account 1007 is item A.

[0199]

[0200]

[0201] Table 1

[0202] After comparison, it can be found that the audience accounts associated with item A are 1001, 1004 and 1007, the audience account associated with item B is 1003, the audience accounts associated with item C are 1002 and 1005, and the audience account associated with item D is 1006.

[0203] Step 506: The first device marks the associated viewer account in the location area of ​​each recommended object, and generates a visual hotspot corresponding to each recommended object.

[0204] In the embodiment of the present application, based on the real-time identified location area of ​​each recommended object, marking is performed within the corresponding location area to form a visual hotspot for each recommended object. For example, when using color blocks as marking information, a color block can be marked within the corresponding location area for each viewer account ID associated with the recommended object. Once all viewer account IDs associated with the recommended object are marked, the visual hotspot corresponding to the recommended object is obtained.

[0205] It should be noted that the visual hot zone generated by the first device is not displayed directly. The first device can receive the association relationship data sent by the background server in real time, that is, the viewer account ID and the recommended object data they have viewed, and form the visual hot zone in the background of the first device, but do not display it. When the display is triggered, it will be presented on the live screen based on the formed visual hot zone.

[0206] Step 507: The first device presents a visual hot zone in the live broadcast picture in response to the hot zone display instruction triggered for the live broadcast picture.

[0207] This step can be referred to the introduction of the above step 202 and will not be described again here.

[0208] (2) The second method

[0209] In this method, the backend server integrates the association relationship of each recommended object and generates visual hotspots on the first device. Figure 7 The manner shown, wherein Figure 7 Steps 501a, 501b and steps 502 to 504 are the same as Figure 5 The embodiments shown are identical and therefore will not be described again here.

[0210] Step 508: The first device uploads the identified recommended objects to the backend server.

[0211] Step 509: Receive the viewer account associated with each recommended object in the live broadcast image sent by the backend server.

[0212] In an embodiment of the present application, after identifying the live broadcast screen, the first device can upload the identified recommended objects to the background server in real time. At the same time, the background server will also receive the association relationship from the second device. The background server can then integrate the recommended objects uploaded by the first device and the association relationship uploaded by the second device to obtain statistics on the audience accounts associated with each recommended object uploaded by the first device, and feed back to the first device.

[0213] It should be noted that, when the backend server performs data integration, the method it adopts may be the same as that used by the first device to integrate the data, so please refer to the introduction of step 505 above.

[0214] Step 510: The first device marks the associated viewer account in the location area of ​​each recommended object, and generates a visual hotspot corresponding to each recommended object.

[0215] Step 511: The first device presents a visual hot zone in the live broadcast picture in response to a hot zone display instruction triggered for the live broadcast picture.

[0216] Step 510 and step 511 can refer to the introduction of the above steps 506 and 507, and will not be repeated here.

[0217] (3) The third method

[0218] In this method, the background server generates the visual hotspot, and the first device displays the hotspot. Figure 8 The manner shown, wherein Figure 8 Steps 501a, 501b and steps 502 to 504 are the same as Figure 5 The embodiments shown are identical and therefore will not be described again here.

[0219] Step 512: The first device uploads the identified recommended objects and corresponding location area information to the backend server.

[0220] Step 513: The first device sends a hot zone request to the background server in response to the hot zone display instruction triggered for the live broadcast image.

[0221] In an embodiment of the present application, the first device can upload the identified recommended objects to the background server in real time after identifying the live broadcast screen. At the same time, the background server will also receive the association relationship from the second device. The background server can then integrate the recommended objects uploaded by the first device and the association relationship uploaded by the second device to obtain statistics on the audience accounts associated with each recommended object uploaded by the first device, and combine the location area information of each recommended object to mark it in the corresponding location area to form a visual hot zone for each recommended object.

[0222] When the first device needs to present the visual hot zone, such as the host clicks the "Show Hot Zone" button, the first device responds to the hot zone display instruction triggered by the click operation and sends a hot zone request to the background server to request the visual hot zone data to be displayed.

[0223] Step 514: The first device presents the visual hot zone in the live broadcast image based on the visual hot zone data returned by the background server.

[0224] In the embodiment of the present application, after the visual hot spots are presented in the live broadcast screen, the anchor can more easily know the recommended objects that the audience is interested in, so as to introduce the recommended objects in a targeted manner. Figure 9a to Figure 9c The figure shows the operation flow of focusing on the target recommendation object.

[0225] See also Figure 9a As shown in the figure, after the visual hotspots are presented in the live screen, it is easy to see that the penguin doll in the middle of the first row is the most popular recommended object. Then, the anchor can adjust the live content to introduce the penguin doll. Then, the target visual hotspot can be selected from the visual hotspots presented in the live screen. Here, the target visual hotspot is the visual hotspot corresponding to the penguin doll with the highest attention, and the target visual hotspot is triggered to jump to Figure 9b The interface shown.

[0226] Optionally, the triggering operation on the target visual hot zone may include but is not limited to: a click operation, a long press operation, a double-click operation, a sliding operation, etc. The embodiment of the present application does not limit the type of triggering operation.

[0227] See also Figure 9b As shown in FIG, after the target visual hot zone is triggered, the operable controls for the target recommended object corresponding to the target visual hot zone are displayed on the live screen, including the following: Figure 9b The focus operation controls and information display controls are shown, but it should be understood that, within a reasonable range, when other operations are required on the target recommendation object, the corresponding operation controls may also be displayed, and the embodiments of the present application do not impose any restrictions on this.

[0228] Optionally, in order to make the interface neat, after operating the target visual hotspot, the display can be hidden. Figure 9a Part of the interface shown, such as Figure 9b The number of viewers currently watching the video is hidden to avoid a cluttered interface that may cause a poor viewing experience for users. Of course, other content can also be hidden, such as color block markers.

[0229] The focus operation control is used to focus on the target recommended object to display the details of the target recommended object. If the target recommended object needs to be focused, the focus operation control can be triggered. The terminal device responds to the trigger operation of the focus operation control and jumps to the following Figure 9c In the interface shown, the target recommended object is displayed in an enlarged manner.

[0230] In some embodiments, the terminal device can zoom in on the area of ​​the live broadcast where the target recommended object is located, thereby achieving an effect of magnified display of the target recommended object. If the terminal device is a viewer-end device and the viewer-end device cannot adjust the camera device of the live broadcast, the viewer-end device can use image magnification to magnify the area where the target object is located to focus on the target recommended object.

[0231] In some embodiments, if the terminal device is a host device, the host device can adjust the lens of the camera device to focus on the target recommended object. The camera device here can be a camera included in the host device itself or an external camera device.

[0232] Specifically, the host-end device can send a focus instruction to the connected camera device (including the camera of its own device) in response to the trigger operation of the focus operation control. The focus instruction is used to instruct the camera device to focus on the target recommended object, and then the camera can adjust the focal length and transmit the adjusted image data back, so that the host-end device can display the image based on the focused image data sent by the camera device to display the enlarged target recommended object. At the same time, after the camera device is adjusted, the live broadcast image displayed by the audience-end device will also be adjusted synchronously, that is, the enlarged target recommended object will also be displayed. Due to the adjustment method of the camera device, the loss of image quality can be minimized, thereby providing users with a better viewing experience.

[0233] Specifically, after monitoring the user clicking the "Zoom in" button, the system sends a command to zoom in on the visual hotspot, and the front end displays the zoomed-in effect. Figure 9c As shown, the selected penguin doll is magnified and displayed, so that the audience can see the details of the penguin doll more clearly to determine whether to purchase the product.

[0234] It should be understood that after the focus operation is performed, the live broadcast interface can be switched to a normal interface, that is, an interface that does not display the visual hotspot. Accordingly, the status of certain spaces displayed in the live broadcast screen showing the visual hotspot needs to be switched accordingly. For example, see Figure 9c As shown, if the "Close Hot Zone" button is displayed on the live broadcast interface presenting the visual hot zone, it will be switched to the "Show Hot Zone" button for display.

[0235] Continue to see Figure 9b As shown, there is also an information display control, namely Figure 9b The "Details" shown in the figure is used to display the detailed information of the target recommendation object. Figure 9d The figure shows a schematic diagram of the information display page of the target recommendation object.

[0236] Specifically, the terminal device may display the information display page of the target recommended object in response to a triggering operation on the information display control.

[0237] In some embodiments, as Figure 9d As shown, the information display page can be presented on the live screen in the form of a pop-up window. Figure 9d The pop-up window shown is only a possible example. In actual applications, the style and position of the pop-up window are reasonably adjusted, and the embodiments of the present application do not limit this.

[0238] In some implementations, the information display page may also be displayed as a complete page, that is, one may jump from the live broadcast screen to the information display page.

[0239] The information display page displays at least one of the following information.

[0240] (1) Introduction information of the target recommendation object.

[0241] like Figure 9d As shown, the information display page displays the information of the most popular penguin doll, such as its name, price, and item introduction. It can be imagined that after the information display page is presented on the anchor's device, the anchor can better introduce the product based on the information on the page.

[0242] In the embodiment of the present application, in order to display the object introduction information of each recommended object, it is necessary to create an object information library in advance, recording the object introduction information of each possible recommended object. In this way, during the live broadcast, after clicking on the detailed information, the corresponding information display page will be presented with data as support. For example, the operator has established an information library of all items in advance. When the anchor clicks on an item, the anchor can view the detailed information of the item, which helps the anchor introduce the item in more detail.

[0243] In the embodiment of the present application, the created object information library can be stored in the background server, for example, when the anchor clicks Figure 9b After clicking the "Details" button shown, the terminal device sends an information acquisition request for the target recommended object to the background server, and displays the target recommended object based on the object introduction information returned by the background server. Figure 9d The information display page shown.

[0244] (2) The account ID of the viewer account associated with the target recommendation object

[0245] like Figure 9d As shown, the information display page can also display the account ID of the audience account associated with the target recommendation object. Figure 9d It is specifically shown with an account avatar, but it should be noted that in the actual implementation process, other content can also be displayed as the account identifier, and the embodiments of the present application do not limit this.

[0246] (3) Related recommended objects ( Figure 9d (not shown)

[0247] In an embodiment of the present application, the information display interface can also display other recommended objects related to the target recommended object, and the other recommended objects are not limited to the recommended objects already in the live broadcast room.

[0248] (4) First Object Recommendation Control

[0249] like Figure 9d As shown, the "Bulk Send Product Link" button displayed in the information display page is the first object recommendation control, which is used to send the object link address of the target recommended object in bulk.

[0250] Specifically, when a host is live streaming, viewers who have seen the target recommended object are generally interested in it. Therefore, the object link address of the target recommended object can be sent to the viewer accounts of these viewers. The host can then trigger the first object recommendation control, and the terminal device, in response to the trigger, sends the object link address associated with the target recommended object to the viewer accounts associated with the target recommended object.

[0251] In some implementations, after the terminal device receives the trigger operation, it may send a group message to a default viewer account, such as the viewer account of a viewer who has viewed the target recommendation object.

[0252] In some embodiments, after the terminal device receives the trigger operation, it may display the following Figure 9e The display page shown is provided to the host to select the group message recipients.

[0253] In an embodiment of the present application, the anchor can choose to send the object link address of the target recommended object to all viewer accounts in the live broadcast room; or, the anchor can choose to send the object link address of the target recommended object to all viewer accounts in the live broadcast room who have watched the target recommended object; or, the anchor can choose to send the object link address of the target recommended object to a specified viewer account. After selecting "Group send to specified viewing audiences", you can jump to the account selection page, and after the selection is completed, the object link address of the target recommended object will be sent to the selected viewer account.

[0254] It should be noted that the above descriptions are all based on the host-side device as an example, but the operations performed on the host-side device can also be applied to the viewer-side device.

[0255] In the embodiment of the present application, a function of sending a target recommendation object link separately can also be provided. Figure 9f As shown in , after the target recommendation object information display page is displayed, the account ID on the page can also be operated. Figure 9f The first audience account is used as the target audience account, and after a trigger operation is performed on its avatar, the terminal device responds to the trigger operation performed on the target audience account and displays an instant messaging page with the target audience account as the communication object.

[0256] like Figure 9f As shown in the middle right figure, the instant messaging page displays the account ID corresponding to the target recommended object, as well as interactive controls for instant messaging interaction with the target recommended object, such as voice controls, emoticon controls, etc. In addition, the instant messaging page also displays a second object recommendation control, which is used to send the object link address associated with the target recommended object to the target audience account. When the second object recommendation control is triggered, the terminal device responds to the triggering operation and can send the object link address associated with the target recommended object to the target audience account. In this way, the anchor can send the product link to the audience separately in the form of a private message.

[0257] It should be noted that the terminal device sending the object connection address mentioned in the embodiment of the present application can be a link sent through the background server, that is, the terminal device sends a request to the background server, requesting the background server to send the object connection address to the corresponding viewer account.

[0258] See also Figure 9gThe following is a schematic diagram of the gaze track page. The user can also trigger the account ID of the target audience account. Correspondingly, the terminal device responds to the trigger operation and displays the gaze track page of the target audience account. The gaze track page includes the recommended objects corresponding to the eye gaze point of the target audience account on the corresponding terminal device, that is, the gaze track of the audience corresponding to the target audience account, such as Figure 9g As shown in the middle right picture, the items viewed by Account A include penguin dolls, drinking cups, and rabbit dolls.

[0259] Optionally, the account identifier is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page. That is, the gaze track page can be displayed by triggering the account identifier displayed on the instant messaging page. Figure 9g Alternatively, the gaze track page can be displayed by triggering the account ID displayed on the information display page, that is, Figure 9g The method shown in (2).

[0260] In some embodiments, the recommended objects can be sorted according to the target audience account's eye gaze point and the length of time the target audience account stays in the location area of ​​each recommended object, and the gaze point trajectory page can be displayed based on the sorting order of each recommended object. Figure 9g The display method shown in the middle right picture is that according to the length of stay of account A, the display order is penguin doll, drinking cup, rabbit doll and toy car, etc.

[0261] In some embodiments, the recommended objects can also be sorted according to the trajectory order of the eye gaze point of the target audience account within the location area of ​​each recommended object, and the gaze point trajectory page can be displayed based on the sorting order of each recommended object, that is, displayed in sequence according to the detection timeline of the eye gaze point.

[0262] Please continue to see Figure 3a A display page control may also be displayed on the live broadcast screen. The display page control is used to display recommended objects within the live broadcast room. In addition to at least one recommended object currently displayed on the live broadcast screen, the recommended objects within the live broadcast room may also include recommended objects not currently displayed on the live broadcast screen. A trigger operation may be performed on the display page control, and the terminal device may respond to the trigger operation by displaying the display page.

[0263] See also Figure 10 The following is a schematic diagram of the display page interface. In the display page, multiple products are displayed, such as Figure 10 The displayed items include penguin dolls, drinking cups, rabbit dolls, toy cars, etc.

[0264] In some implementations, the terminal device can periodically collect statistics on the data of each recommended object, for example, it can count the number of viewer accounts that each recommended object has been historically associated with, and then sort at least one recommended object according to the number of viewer accounts associated with each recommended object, and display the recommended objects in the sorted order on the display page. Figure 10 As shown, the display page can be used as a product ranking list, which is sorted according to the number of people who have viewed each product. For example, the penguin doll has been viewed by 2,345 people and ranks first, and the drinking cup has been viewed by 2,341 people and ranks second.

[0265] See also Figure 10 As shown, the display page also displays a display control for viewing the audience account associated with each recommended object. Then, by operating the display control corresponding to the target recommended object, you can jump to the following Figure 10 The interface shown in the right figure displays the account ID of the viewer account associated with the target recommendation object. Figure 10 As shown in the right figure, when the penguin doll is used as the target recommendation object, the display operation control corresponding to the penguin doll is Figure 10 After the penalty operation is performed on the "People who have seen" button shown, the terminal device can display the account identification corresponding to the audience who have seen the penguin doll, such as avatar, account ID, etc.

[0266] Optionally, the account IDs of the audience accounts associated with the target recommendation objects can also be sorted and displayed according to the number of times they have been viewed. Figure 10 This is specifically shown as an example, or the images can be sorted and displayed in the order of actual viewing time, so as to assist the anchor to perform better live broadcasting.

[0267] It should be noted that the display page can be presented on the live screen in the form of a pop-up window. Figure 10 The pop-up window shown is only one possible example. In actual applications, the style and position of the pop-up window can be adjusted appropriately, and the embodiments of the present application do not limit this. Alternatively, it can be displayed as a complete page, that is, it can jump from the live broadcast screen to the display page. Similarly, the display page of the account identification of the associated viewer account is also the same.

[0268] In summary, the embodiment of the present application uses the front-end system of the viewer-end device to image-recognize objects and people in the live broadcast screen, and mark the coordinates in real time, and uses eye tracking technology to record the coordinates of the viewer's sight point, and obtains the objects and people that the viewer has viewed through comparison, and uploads them to the background server in real time. The background server then sends it to the front-end system of the host-end device in real time. The front-end system parses the data for visual display, so that the host can view the objects and people viewed by the audience on the other end in real time, and understand which ones the viewers are more interested in. In this way, the host can adjust the lens or words in time, making the live broadcast more flexible, just like giving a live speech, and can adjust the words in time according to the audience's feedback, liven up the atmosphere, and improve the audience's viewing experience. For example, when selling goods live, the host will know which products the audience is more interested in, so that the host will focus on introducing the products during the oral broadcast, improve the accuracy of product recommendations, and thus improve the success rate of product transactions.

[0269] See Figure 11 Based on the same inventive concept, the embodiment of the present application further provides a hot zone display device 110 for a live broadcast screen, the device comprising:

[0270] The screen display unit 1101 is used to display the live screen of the live broadcast room, where the live screen displays at least one recommended object;

[0271] The hot zone presentation unit 1102 is used to present at least one visual hot zone in the live screen in response to a hot zone display instruction triggered for the live screen. The visual hot zone is used to represent the number of viewers who are looking at the location area of ​​the corresponding recommended object in the live screen.

[0272] Optionally, the live broadcast screen also displays a hot zone display control, and the hot zone presentation unit 1102 is further configured to:

[0273] In response to a trigger operation on the hot zone display control, a hot zone display instruction is obtained.

[0274] Optionally, the device further includes a hot zone generating unit 1103, configured to:

[0275] Performing object recognition on the live broadcast screen to obtain a location area of ​​at least one recommended object in the live broadcast screen; and

[0276] Obtaining a viewer account associated with each of the at least one recommended object; wherein the association between the recommended object and the viewer account is established based on a positional relationship between a location area of ​​each of the at least one recommended object in a live broadcast image and an eye gaze point detected by the terminal device when the terminal device uses the viewer account to broadcast the live broadcast image;

[0277] The associated viewer account is marked in the location area of ​​each recommended object to generate a visual hotspot corresponding to each recommended object.

[0278] Optionally, the hot zone generating unit 1103 is specifically configured to:

[0279] Receive multiple sets of association relationships sent by the backend server, each set of association relationships including a recommended object associated with a viewer account;

[0280] The recommended objects in the plurality of groups of association relationships are compared with the at least one recommended object to determine a viewer account associated with each recommended object in the at least one recommended object.

[0281] Optionally, at least one of the following methods is used to present at least one visual hotspot in the live broadcast image:

[0282] Displaying at least one tag information in the location area of ​​each recommended object, where each tag information represents at least one viewer account associated with the corresponding recommended object;

[0283] Displays the number of audience accounts associated with each recommendation object;

[0284] The recommended objects with the largest number of associated viewer accounts are displayed in a hot zone display style different from that of the other recommended objects;

[0285] The density of tagged information is positively correlated with the number of associated viewer accounts;

[0286] Recommended objects with different numbers of associated viewer accounts are displayed in different hot zone display styles;

[0287] Recommended objects whose numbers of associated viewer accounts are in different numerical ranges are displayed in different hot zone display styles.

[0288] Optionally, the live broadcast screen also displays a hot zone display control, and the hot zone presentation unit 1102 is further configured to:

[0289] In response to a trigger operation on the hot zone display control, a hot zone display instruction is obtained.

[0290] Optionally, the apparatus further includes a gaze point recognition unit 1104, configured to:

[0291] Performing object recognition on the live broadcast screen to obtain a location area of ​​at least one recommended object in the live broadcast screen; and

[0292] Obtain the position information of the detected eye gaze point on the live broadcast screen;

[0293] Determine a target recommended object corresponding to the target location area where the location information is located;

[0294] Establish an association relationship between the currently used target audience account and the target recommendation object, and upload the association relationship to the backend server.

[0295] Optionally, the apparatus further includes an object focusing unit 1105, configured to:

[0296] receiving a trigger operation performed on a target visual hotspot in at least one visual hotspot;

[0297] Display the focus operation control of the target recommended object corresponding to the target visual hot zone;

[0298] In response to a trigger operation performed on the focused operation control, the target recommended object is displayed in an enlarged manner.

[0299] Optionally, the object focusing unit 1105 is specifically configured to:

[0300] In response to a trigger operation on a focus operation control, a focus instruction is sent to a connected camera device, where the focus instruction is used to instruct the camera device to focus on a target recommended object;

[0301] The image is displayed based on the focused image data sent by the camera device to display the enlarged target recommended object.

[0302] Optionally, the hot zone presenting unit 1102 is further configured to:

[0303] After receiving a trigger operation for a target visual hot zone in at least one visual hot zone, displaying an information display control corresponding to the target recommended object;

[0304] In response to a trigger operation on the information display control, an information display page of the target recommended object is displayed, and the information display page displays at least one of object introduction information of the target recommended object and an account identifier of an associated viewer account.

[0305] Optionally, the information display page further displays a first object recommendation control corresponding to the target recommended object;

[0306] The device further includes a recommendation unit 1106, configured to:

[0307] In response to a trigger operation performed on the first object recommendation control, the object link address associated with the target recommended object is sent to the viewer account associated with the target recommended object.

[0308] Optionally, the recommendation unit 1106 is further configured to:

[0309] In response to a trigger operation performed on the account identifier of the target audience account among the audience accounts displayed on the information display page, an instant messaging page with the target audience account as a communication object is displayed, and the instant messaging page displays a second object recommendation control corresponding to the target recommended object;

[0310] In response to the triggering operation performed on the second object recommendation control, the object link address associated with the target recommended object is sent to the target audience account.

[0311] Optionally, the hot zone presenting unit 1102 is further configured to:

[0312] In response to a trigger operation performed on the account identifier of the target viewer account, displaying a gaze track page of the target viewer account, the gaze track page including each recommended object corresponding to the eye gaze point of the target viewer account on the corresponding terminal device;

[0313] The account identifier of the target audience account is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page.

[0314] Optionally, the hot zone presentation unit 1102 is specifically configured to:

[0315] Sort the recommended objects according to the eye gaze points corresponding to the target audience accounts and the duration of stay in the location area of ​​each recommended object, and display the gaze point track page based on the sorting order of each recommended object; or

[0316] The recommended objects are sorted according to the track order of the eye gaze points corresponding to the target audience account within the position area of ​​each recommended object, and the gaze point track page is displayed based on the sorting order of each recommended object.

[0317] Optionally, the hot zone presenting unit 1102 is further configured to:

[0318] Display hot zone off controls;

[0319] In response to a triggering operation on a hot zone closing control, at least one visual hot zone is hidden and the live broadcast screen is displayed again.

[0320] Optionally, the live broadcast screen further displays a display control for a display page of at least one recommended object;

[0321] The hot zone presenting unit 1102 is further configured to:

[0322] In response to a trigger operation on a display page display control, a display page including at least one recommended object is displayed; on the display page, a display control control for viewing a viewer account associated with each recommended object is displayed;

[0323] In response to a triggering operation performed on a display manipulation control corresponding to a target recommendation object, an account identifier of a viewer account associated with the target recommendation object is displayed.

[0324] Optionally, the hot zone presentation unit 1102 is specifically configured to:

[0325] sorting the at least one recommended object according to the number of viewer accounts associated with each of the at least one recommended object;

[0326] Based on the sort order of the at least one recommended object, a display page is displayed.

[0327] The device can be used to execute the methods shown in the various embodiments of the present application. Therefore, for the functions that can be implemented by the various functional modules of the device, please refer to the description of the aforementioned embodiments and no further details will be given.

[0328] The device provided in the embodiment of the present application can associate the viewer account with the recommended object by detecting the position area of ​​the eye gaze point on the live screen when the live screen is played using the viewer account. Then, when it is necessary to present a visual hot zone on the live screen, the corresponding visual hot zone can be presented in the live screen. The visual hot zone is used to represent the number of viewer accounts associated with each recommended object. Therefore, when watching the live screen, the viewer does not need to actively interact, and can more intuitively understand the audience's interest in each recommended object, and obtain audience feedback more timely.

[0329] See Figure 12 Based on the same technical concept, the embodiment of the present application further provides a computer device 120, which can be Figure 1 As shown in the terminal device or server, the computer device 120 may include a memory 1201 and a processor 1202 .

[0330] The memory 1201 is used to store computer programs executed by the processor 1202. The memory 1201 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created according to the use of the computer device, etc. The processor 1202 may be a central processing unit (CPU), or a digital processing unit, etc. The specific connection medium between the above-mentioned memory 1201 and the processor 1202 is not limited in the embodiment of the present application. The embodiment of the present application is Figure 12 In the embodiment, the memory 1201 and the processor 1202 are connected via a bus 1203. The bus 1203 is connected to the processor 1202 via a bus 1203. Figure 12The bus 1203 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 12 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0331] Memory 1201 may be a volatile memory, such as random-access memory (RAM); or a non-volatile memory, such as read-only memory, flash memory, a hard disk drive (HDD), or a solid-state drive (SSD); or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but is not limited thereto. Memory 1201 may be a combination of the aforementioned memories.

[0332] The processor 1202 is configured to execute the methods described in the above embodiments when calling the computer program stored in the memory 1201 .

[0333] In some possible implementations, various aspects of the method provided in the present application may also be implemented in the form of a program product, which includes program code. When the program product is run on a computer device, the program code is used to enable the computer device to execute the steps of the method according to the various exemplary embodiments of the present application described above in this specification. For example, the computer device can execute the methods executed in the above embodiments.

[0334] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0335] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present application.

[0336] Obviously, those skilled in the art may make various changes and modifications to this application without departing from the spirit and scope of this application. Thus, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application is intended to include these modifications and variations.

Claims

1. A method for displaying hot spots of a live broadcast screen, characterized in that: The method comprises: Displaying a live broadcast screen of a live broadcast room, wherein the live broadcast screen displays at least one recommended object, wherein the at least one recommended object is an item recommended by the live broadcast room to viewers, and the live broadcast screen includes a location area corresponding to each of the at least one recommended object; In response to a hot zone display instruction triggered for the live broadcast screen, at least one visual hot zone is presented in the live broadcast screen, one visual hot zone corresponds to one recommended object, one visual hot zone is used to represent the number of viewers who are gazing at the location area where the corresponding recommended object is located in the live broadcast screen, and one visual hot zone is generated by marking an associated viewer account in the location area of ​​the corresponding recommended object, wherein the association relationship between the recommended object and the viewer account is established based on the positional relationship between the location area of ​​each of the at least one recommended objects in the live broadcast screen and the eye gaze point detected by the terminal device when the terminal device uses the viewer account to play the live broadcast screen.

2. The method according to claim 1, wherein The live broadcast screen further displays a hot zone display control. Before presenting at least one visual hot zone in the live broadcast screen in response to the hot zone display instruction triggered for the live broadcast screen, the method further includes: In response to a triggering operation on the hot zone display control, the hot zone display instruction is obtained.

3. The method according to claim 1, wherein The method further comprises: Performing object recognition on the live broadcast screen to obtain a location area of ​​each of the at least one recommended object in the live broadcast screen; Obtaining a viewer account associated with each of the at least one recommended object; The associated viewer account is marked in the location area of ​​each recommended object to generate a visual hotspot corresponding to each recommended object.

4. The method according to claim 3, wherein Obtaining a viewer account associated with each of the at least one recommended object includes: Receive multiple sets of association relationships sent by the backend server, each set of association relationships including a recommended object associated with a viewer account; The recommended objects in the multiple groups of association relationships are compared with the at least one recommended object to determine the viewer account associated with each recommended object in the at least one recommended object.

5. The method according to claim 3, wherein At least one of the following methods is used to present at least one visual hotspot in the live broadcast image: In the location area of ​​each recommended object, at least one tag information is displayed, where each tag information represents at least one viewer account associated with the corresponding recommended object; Display the number of viewer accounts associated with each recommended object, where the number of viewer accounts is positively correlated with the density of the tagged information; The recommended objects with the largest number of associated viewer accounts are displayed in a hot zone display style different from that of the other recommended objects; Recommended objects with different numbers of associated viewer accounts are displayed in different hot zone display styles; Recommended objects whose numbers of associated viewer accounts are in different numerical ranges are displayed in different hot zone display styles.

6. The method according to claim 1, wherein The method further comprises: Performing object recognition on the live broadcast screen to obtain a location area of ​​each of the at least one recommended object in the live broadcast screen; Obtaining position information of the detected eye gaze point on the live broadcast image; Determining a target recommended object corresponding to the location information based on a positional relationship between the location information and the location areas of each recommended object; An association relationship between the currently used target audience account and the target recommendation object is established, and the association relationship is uploaded to the backend server.

7. The method according to any one of claims 1 to 6, wherein: After presenting at least one visual hot zone in the live screen in response to a hot zone display instruction triggered for the live screen, the method further includes: receiving a trigger operation performed on a target visual hotspot among the at least one visual hotspot; Displaying a focus operation control for the target recommended object corresponding to the target visual hotspot; In response to a triggering operation on the focus operation control, the target recommended object is displayed in an enlarged manner.

8. The method according to claim 7, wherein In response to a triggering operation on the focus operation control, enlarging and displaying the target recommended object includes: In response to a trigger operation on the focus operation control, sending a focus instruction to a connected camera device, wherein the focus instruction is used to instruct the camera device to focus on the target recommended object; A screen display is performed based on the focused screen data sent by the camera device to display the magnified target recommended object.

9. The method according to claim 7, wherein After receiving a trigger operation performed on a target visual hotspot among the at least one visual hotspot, the method further includes: Display the information display control corresponding to the target recommendation object; In response to a triggering operation on the information display control, an information display page of the target recommended object is displayed, and the information display page displays at least one of object introduction information of the target recommended object and an account identifier of an associated viewer account.

10. The method according to claim 9, wherein The information display page also displays a first object recommendation control corresponding to the target recommended object; The method further comprises: In response to a triggering operation performed on the first object recommendation control, the object link address associated with the target recommended object is sent to a viewer account associated with the target recommended object.

11. The method according to claim 9, wherein After displaying the information display page of the target recommended object in response to the triggering operation on the information display control, the method further includes: In response to a triggering operation performed on an account identifier of a target audience account among the audience accounts displayed on the information display page, displaying an instant messaging page with the target audience account as a communication object, the instant messaging page displaying a second object recommendation control corresponding to the target recommended object; In response to a triggering operation performed on the second object recommendation control, the object link address associated with the target recommended object is sent to the target audience account.

12. The method according to claim 11, wherein The method further comprises: In response to a triggering operation performed on the account identifier of the target audience account, displaying a gaze track page of the target audience account, the gaze track page including each recommended object corresponding to the eye gaze point of the target audience account on the corresponding terminal device; The account identifier of the target audience account is the account identifier displayed on the information display page, or the account identifier displayed on the instant messaging page.

13. The method according to claim 12, wherein: The gaze track page of the target audience account is displayed, including: Sort the recommended objects according to the dwell time of the eye gaze point corresponding to the target audience account within the location area of ​​each recommended object, and display the gaze point track page based on the sorting order of the recommended objects; or The recommended objects are sorted according to the track order of the eye gaze points corresponding to the target audience accounts within the position areas of the recommended objects, and the gaze point track page is displayed based on the sorting order of the recommended objects.

14. The method according to any one of claims 1 to 6, wherein: In response to a hot zone display instruction triggered for the live screen, the method further includes: Display hot zone off controls; In response to a triggering operation on the hot zone closing control, the at least one visual hot zone is hidden and the live broadcast screen is displayed again.

15. The method according to any one of claims 1 to 6, wherein: The live broadcast screen further displays a display control for a display page of the at least one recommended object; The method further comprises: In response to a trigger operation on the display page display control, a display page including the at least one recommended object is displayed; in the display page, a display control for viewing a viewer account associated with each recommended object is displayed; In response to a triggering operation performed on a display manipulation control corresponding to a target recommendation object, an account identifier of a viewer account associated with the target recommendation object is displayed.

16. The method according to claim 15, wherein Displaying a display page including the at least one recommended object includes: sorting the at least one recommended object according to the number of viewer accounts associated with each of the at least one recommended object; The display page is displayed based on the sort order of the at least one recommended object.

17. A hot zone display device for a live broadcast screen, characterized in that: The device comprises: a screen display unit, configured to display a live screen of the live broadcast room, wherein the live screen displays at least one recommended object, the at least one recommended object being an item recommended by the live broadcast room to viewers, and the live screen including location areas corresponding to the at least one recommended object; A hot zone presentation unit is used to present at least one visual hot zone in the live screen in response to a hot zone display instruction triggered for the live screen, wherein one visual hot zone corresponds to one recommended object, and one visual hot zone is used to represent the number of viewers who are gazing at the location area where the corresponding recommended object is located in the live screen. One visual hot zone is generated by marking an associated viewer account in the location area of ​​the corresponding recommended object, wherein the association relationship between the recommended object and the viewer account is established based on the positional relationship between the location area of ​​each of the at least one recommended objects in the live screen and the eye gaze point detected by the terminal device when the terminal device uses the viewer account to play the live screen.

18. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 16 are implemented.

19. A computer storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

20. A computer program product comprising computer program instructions, characterized in that When the computer program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.

Images