Live-streaming interaction method and apparatus, and device, medium and program product

By detecting pre-planned events in the live data stream and presenting guiding messages, the problem of low efficiency in live interaction in existing technologies is solved, achieving more efficient audience interaction and a better live streaming experience.

WO2026067839A1PCT designated stage Publication Date: 2026-04-02BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-09-30
Publication Date
2026-04-02

AI Technical Summary

Technical Problem

Existing live streaming interaction solutions are inefficient, and gift interactions at fixed times result in poor conversion rates and are likely to disturb viewers.

Method used

By detecting pre-arranged events in the live data stream, identifying these events using text, image, and audio recognition technologies, and presenting guiding messages on client devices, viewers can be flexibly triggered to donate virtual resources.

Benefits of technology

It improved the efficiency and effectiveness of live streaming interaction, reduced interference with viewers, and enhanced viewing interest and interactivity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025125793_02042026_PF_FP_ABST
    Figure CN2025125793_02042026_PF_FP_ABST
Patent Text Reader

Abstract

Provided in the present disclosure are a live-streaming interaction method and apparatus, and a device, a medium and a program product. The method comprises: presenting a data stream at a client device for a live-streaming application; and in response to determining that the data stream involves a predetermined event, presenting, at the client device, a guidance message for guiding a user of the client device to execute a predetermined action.
Need to check novelty before this filing date? Find Prior Art

Description

Live interaction method, apparatus, device, medium and program product

[0001] The present application claims priority to the Chinese Patent Application No. 202411391612.8, filed on September 30, 2024, entitled “Live interaction method, apparatus, device, medium and program product”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Exemplary implementations of the present disclosure generally relate to the field of computers, and in particular, to a live interaction method, apparatus, device, computer-readable storage medium, and computer program product. BACKGROUND

[0003] More and more applications are able to provide live streaming functions. In some live streams (such as network game live streaming, sports live streaming, singing live streaming, etc.), users can perform various interactions within the live stream. For example, a spectator user can gift virtual resources to a host user who is live streaming. However, the existing interaction scheme is inefficient. SUMMARY

[0004] In a first aspect of the present disclosure, a live interaction method is provided. In the method, a data stream is presented at a client device of a live streaming application. In response to determining that the data stream relates to a predetermined event, a guide message for guiding a user of the client device to perform a predetermined action is presented at the client device.

[0005] In a second aspect of the present disclosure, a live interaction apparatus is provided. The apparatus comprises a data stream presentation module configured to present a data stream at a client device of a live streaming application; and a guide message presentation module configured to present, in response to determining that the data stream relates to a predetermined event, a guide message for guiding a user of the client device to perform a predetermined action at the client device.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The electronic device comprises at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method according to the first aspect of the present disclosure.

[0007] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, having computer-executable instructions stored thereon, the computer-executable instructions, when executed by a processor, causing the processor to implement the method according to the first aspect of the present disclosure.

[0008] In a fifth aspect of the present disclosure, a computer program product is provided, comprising computer executable instructions, wherein the computer executable instructions, when executed by a processor, implement the method according to the first aspect of the present disclosure.

[0009] It is to be understood that the details set forth herein do not limit the key or critical features of the subject application, which are described in connection with the attached drawings and disclosed claims. Other features of the subject application will be apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects and advantages of various implementations of the present disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numbers represent like elements throughout. In the drawings:

[0011] FIG. 1 illustrates a block diagram of an application environment according to one example implementation of the present disclosure;

[0012] FIG. 2 illustrates a live interaction block diagram according to some implementations of the present disclosure;

[0013] FIG. 3 illustrates a flowchart of a process for detecting a predetermined event according to some implementations of the present disclosure;

[0014] FIG. 4 illustrates a flowchart of a process for checking timeliness for a predetermined event according to some implementations of the present disclosure;

[0015] FIG. 5 illustrates a flowchart of a live interaction process according to some implementations of the present disclosure;

[0016] FIG. 6 illustrates a flowchart of a live interaction method according to some implementations of the present disclosure;

[0017] FIG. 7 illustrates a block diagram of a live interaction apparatus according to some implementations of the present disclosure; and

[0018] FIG. 8 illustrates a block diagram of a device capable of implementing various implementations of the present disclosure. DETAILED DESCRIPTION

[0019] Implementations of the present disclosure will now be described with reference to the attached drawings. While the present disclosure is susceptible to various modifications and alternative forms, structure and function described herein is shown by way of example in the drawings and is designated by reference number. It should be understood, however, that the drawings and accompanying detailed description are not intended to limit the disclosure to the particular implementation set forth, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the spirit and scope of the present disclosure as defined by the appended claims.

[0020] In the description of the implementations of the present disclosure, the term "comprising" and its similar terms are understood to be open-ended, i.e., "including but not limited to". The term "based on" is understood to mean "based, at least in part, on". The term "one implementation" or "an implementation" is understood to mean "at least one implementation". The term "some implementations" is understood to mean "at least some implementations". Other explicit or implicit definitions can also be included below. As used herein, the term "model" can represent the association relationship between various data. For example, the above association relationship can be obtained based on various technical solutions that are currently known and / or will be developed in the future.

[0021] It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws and regulations and relevant provisions.

[0022] It can be understood that, before using the technical solutions disclosed by the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the use range, the use scenario, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0023] For example, in response to receiving the active request of the user, prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require the acquisition and use of personal information of the user. Thus, the user can voluntarily choose whether to provide personal information to the software or hardware such as electronic devices, application programs, servers or storage media that perform the operation of the technical solutions of the present disclosure according to the prompt information.

[0024] As an optional but non-limiting implementation, in response to receiving the active request of the user, the way of sending prompt information to the user may, for example, be a pop-up window manner, and the prompt information can be presented in the form of text in the pop-up window. In addition, the pop-up window can also carry selection controls for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0025] It can be understood that the above notification and user authorization process is only illustrative and does not limit the implementations of the present disclosure, and other ways that meet the relevant laws and regulations can also be applied to the implementations of the present disclosure.

[0026] The term "in response to" used herein indicates the state that the corresponding event occurs or the condition is met. It will be understood that the execution time of the subsequent action performed in response to the event or condition is not necessarily strongly associated with the time when the event occurs or the condition is established. For example, in some cases, the subsequent action can be performed immediately when the event occurs or the condition is established; while in other cases, the subsequent action can be performed after a period of time after the event occurs or the condition is established.

[0027] Example Environment

[0028] In a live streaming environment (e.g., a live streaming room), a user watching a live stream (may be referred to as a spectator user) donates virtual resources to a host user initiating a live stream (may also be referred to as a live streaming session), and / or a user watching a live stream donates virtual resources to a guest invited by the host user in the live stream, etc. Referring to FIG. 1, an application environment according to one example implementation of the present disclosure is described, which shows a block diagram of an application environment 100 according to one example implementation of the present disclosure. As shown in FIG. 1, the environment 100 includes a live streaming application 110. The live streaming application 110 may, for example, be an application capable of providing audio and / or video live streaming functions. For example, the live streaming application 110 can provide that a host user live streams a network game match, a ball game match, sings, the host user invites some spectator users to participate in a live streaming activity as guests, etc. In the context of the present disclosure, a specific application environment guiding user actions will be described taking an example of a host user live streaming a ball game match (e.g., a football match) as an event. Alternatively and / or additionally, the ball game match live streamed herein can be a football game match.

[0029] In the live streaming application 110, assuming that a host user initiates a live streaming of a football match, an identity of a match party can be presented in an interface of the live streaming application 110 so as to help a spectator user understand the match party of the live streamed match and improve the interest level of the spectator user. For example, an identity 120-1 of a team A and an identity 120-2 of a team B (may be referred to as an identity 120 individually or collectively) of the match party can be presented in an interface of the live streaming application 110. The identity 120 may, for example, include text, image, etc., and is intended to distinguish the match party, which is not specifically limited herein.

[0030] In a live stream provided by the live streaming application 110, a spectator user can donate virtual resources to a host user and / or a guest user invited by the host user. The virtual resources can be presented in the form of a media item. The media item may, for example, include a two-dimensional sticker, a three-dimensional object, etc. Alternatively and / or additionally, the live streaming application 110 can present an interactive panel 130 in which one or more virtual gifts can be presented for a spectator user to select and initiate donation. In order to further improve interactivity, a spectator user can be guided to donate a virtual gift in a live stream.

[0031] However, the timing of guiding the audience user to send the virtual gift in the live broadcast is usually fixed at present. For example, the audience user is guided to send the virtual gift at a preset time point (such as 1 minute after the audience user enters the live broadcast room or other time points). The audience user can also be prompted to send the virtual gift by the host user initiating the gift sending guide message, and so on. However, this guiding method has the following defects: 1) the gift interaction based on the gift panel is low in efficiency. 2) the gift sending is guided at a fixed time point without distinction, resulting in poor conversion effect of the guidance and easy disturbance to the audience user.

[0032] Summary of guiding user action

[0033] To at least partially solve the deficiencies in the prior art, according to one example implementation of the present disclosure, a live broadcast interaction method is proposed. A summary according to one example implementation of the present disclosure is described with reference to FIG. 2, which shows a live broadcast interaction block diagram 200 according to some implementations of the present disclosure.

[0034] As shown in FIG. 2, at the client device of the live broadcast application 110, a data stream can be presented. The live broadcast application 110 can be, for example, an application capable of providing audio and / or video live broadcast functions, such as singing, storytelling, etc. for audio live broadcast, and network game live broadcast, sports match live broadcast, etc. for video live broadcast. According to one example implementation of the present disclosure, the data stream can be a live broadcast data stream associated with a host user in the live broadcast application 110. Illustratively, the data stream can be a data stream of a live broadcast initiated by the host user in the live broadcast application 110. It should be understood that the data stream can be presented at the client devices of the host user and the audience user. In the context of the present disclosure, the example implementation of the present disclosure will be described taking the example of the host user live broadcasting a sports match (such as the live broadcast of the football match presented in FIG. 1) as an event. In the example of the live broadcast of the football match, the identification 120-1 of the A group and the identification 120-2 of the B group in the two teams of the match can be presented in the live broadcast application 110.

[0035] Further, in response to determining that the data stream relates to the predetermined event 210, a guide message for guiding a user of the client device to perform a predetermined action can be presented at the client device. According to one example implementation of the present disclosure, the client device can be associated with an audience user in the live broadcast application 110. Accordingly, the guided user of the client device can be the audience user. According to one example implementation of the present disclosure, the predetermined event 210 is set based on the host user and / or the audience user, and the predetermined action is a gift sending action (which can be a virtual gift in a virtual resource), and in addition, a like action, a comment action, etc.

[0036] Alternatively and / or additionally, the predetermined event 210 can be an event related to a data stream that is likely to attract the attention of the host user and / or the audience user. For example, an event of a goal being scored by one of the two teams in a live football match, an event of a victory of one of the two teams (e.g., a victory of Team B), and the like. Taking the predetermined event of a victory of Team B as an example, a graphic text identifier about the “victory of Team B” can be presented in the live application 110, and / or a message about the victory of Team B can be announced through audio, and the like.

[0037] Alternatively and / or additionally, the guide message can include, for example, automatically popping up the interactive panel 130, which can provide one or more virtual gifts for the audience user to select and send. The guide message can also include, for example, presenting a dialog box for the audience user to confirm whether to send the pre-determined one or more virtual gifts in the interface of the live application 110. In general, the presentation manner of the guide message can be set according to specific application scenarios, which are not limited herein.

[0038] With the example implementation of the present disclosure, the guide message about sending virtual resources can be automatically triggered when a predetermined event is involved in a live event, so as to guide the audience user to send virtual resources such as virtual gifts. This implementation is flexible and effective, which can avoid the defects of the host user switching the gift sending guide page in the live application or only guiding the gift sending at fixed time points, is conducive to creating a better live interactive atmosphere, and effectively reduces the interference on the audience user watching the live broadcast, which is conducive to improving the watching interest of the audience user, thereby improving the interactivity of the live broadcast. It should be understood that although the above takes sending virtual gifts as an example of the predetermined action, alternatively and / or additionally, the predetermined action can also include but is not limited to a comment action, a like action, and the like.

[0039] Detailed process of guiding user actions

[0040] The above has described the process of guiding user actions according to one example implementation of the present disclosure. In the following, more details about guiding user actions will be described. According to one example implementation of the present disclosure, the live application 110 can be, for example, an application capable of providing audio and / or video live broadcast functions. For example, the live application 110 can provide, for example, a host user live broadcasting a network game match, a ball game match, singing, the host user inviting part of the audience users to participate in a live activity as a guest, and the like. In this way, more diverse live broadcasts (which can also be referred to as live broadcast sessions) can be provided in the live application 110. For the convenience of description, in the following, only the process of guiding user actions will be described by taking the example of the host user live broadcasting a ball game (e.g., a football match).

[0041] According to one example implementation of the present disclosure, upon determining that the data stream involves a predetermined event, the predetermined event can be detected in the data stream, and / or a message indicating that the data stream involves the predetermined event can be received. The specific implementation of detecting the predetermined event in the data stream will be discussed in detail below.

[0042] According to one example implementation of the present disclosure, data processing can be performed on the data stream in order to identify the predetermined event. The data processing can include at least any of text recognition, image recognition, and audio recognition. Alternatively and / or additionally, in order to improve the efficiency of the data processing, upon detecting the predetermined event in the data stream, a set of data frames can be extracted from the data stream at a predetermined frequency, which can be determined according to the duration of the predetermined event. Then, the data processing, e.g., text recognition, image recognition, can be performed on the set of data frames. The process of detecting the predetermined event will be described in detail below in connection with FIG. 3.

[0043] FIG. 3 illustrates a flowchart of a process 300 for detecting a predetermined event according to some implementations of the present disclosure. In the process 300, after starting a live broadcast (310), a frame extraction frequency can be first determined (320) based on the type of the live event. The type of the live event can be, for example, a network game match live broadcast, a ball game live broadcast, a singing live broadcast, etc. An example of the type of the live event here is the football match live broadcast involved in FIG. 2. The frame extraction frequency can be the predetermined frequency described above. Alternatively and / or additionally, the predetermined frequency can be a fixed frequency preset in advance, or a frequency selected from a plurality of candidate frequencies.

[0044] Alternatively and / or additionally, the predetermined frequency can also be determined according to the duration of the predetermined event, e.g., the predetermined frequency can be higher than the frequency corresponding to the duration of the predetermined event. Taking the predetermined event of a B team victory in the two teams of the football match live broadcast as an example, assuming that the victory screen (a set of data frames in the data stream) regarding the B team victory lasts for 10 seconds or other duration, the frame extraction frequency can be higher than 1 time per 10 seconds or other frequency. Taking the predetermined event of a B team goal in the two teams of the football match live broadcast as an example, assuming that the scoring screen (another set of data frames in the data stream) regarding the B team goal lasts for 3 seconds or other duration, the frame extraction frequency can be higher than 1 time per 3 seconds or other frequency. Considering both of the two different events, a frequency higher than 1 time per 3 seconds (i.e., a higher frequency) can be selected as the frame extraction frequency.

[0045] Further, after a set of data frames are extracted from the data stream at the predetermined frequency, if the data frames related to the predetermined event contain corresponding text and images, the determining OCR strategy (330) in FIG. 3 can be executed to identify the predetermined event that the audience user and / or the anchor user pay more attention to in the live event through OCR (Optical Character Recognition). Next, it is determined whether a new data frame in the live data stream is received (340). If a new data frame is received, it is determined whether to frame the new data frame based on the frame extraction frequency (350).

[0046] If no frame extraction is performed, the step 340 is returned to. If it is determined to perform frame extraction, the step of performing OCR on the extracted data frame to identify the predetermined event (360) is performed. Then, it is determined whether the predetermined event is identified from the extracted data frame (370). If the predetermined event is not identified, the step 340 is returned to. If it is determined that the predetermined event is identified, the predetermined event information and the timestamp of the corresponding data frame can be issued through the message channel (380). The timestamp of the data frame corresponding to the predetermined event will be discussed below.

[0047] In the example of the predetermined event of the B group victory in the football match live broadcast, if the predetermined event is to be identified based on audio, the audio information about the B group victory can be captured by using speech recognition technology. For example, audio information containing similar speeches such as “victory”, “win”, “win out”, “win” and the like, so as to identify the predetermined event by using the captured audio information. Alternatively and / or additionally, the goal picture in the match and / or the winning team can be determined based on image recognition, and the like.

[0048] Alternatively and / or additionally, the above example implementation of detecting the predetermined event in the data stream can be executed at the client device or at the server device, and the server sends a message indicating that the data stream involves the predetermined event to the client device. In this way, the workload at the client device can be reduced.

[0049] With the example implementation of the present disclosure, by extracting data frames at a predetermined frequency and identifying predetermined events by using text recognition, image recognition, and audio recognition, the accuracy and efficiency of identifying the predetermined event can be ensured. In addition, in actual application scenarios, considering performance reasons, an upper limit of the predetermined frequency can be set to avoid too frequent extraction of data frames affecting the performance of the client device or the server device.

[0050] According to one example implementation of the present disclosure, when identifying the predetermined event, the predetermined position associated with the data frame in the data stream can be determined based on the attribute information of the predetermined event. Then, the predetermined event can be determined at the predetermined position in the set of data frames.

[0051] In such an example implementation, still taking the live broadcast of the football match involved in FIG. 2 as an example, the predetermined event may, for example, be an event about a victory of one of the two parties in the match, an event about a goal of one of the two parties, etc. For different predetermined events, the respective detection position (i.e., the predetermined position) can be determined based on the respective attribute information. For example, the graphic-text identifier (which may, for example, include a text identifier and an image identifier) about the victory of one of the two parties can appear in the center region of the screen of the data frame. For example, the graphic-text identifier of the score about the goal of one of the two parties can appear in the lower right corner region or other region of the screen of the data frame, etc. In this way, when performing the OCR recognition, the graphic-text recognition can be directly performed on the predetermined position, so as to determine the predetermined event. Alternatively and / or additionally, the attribute information of the predetermined event can include the type information of the predetermined event. Alternatively and / or additionally, comprehensive detection can be performed on multiple predetermined positions, so as to determine the accuracy of the recognized predetermined event.

[0052] With the example implementation of the present disclosure, by determining the predetermined event at the position or region in the data frame, the efficiency of determining the predetermined event can be effectively improved.

[0053] According to one example implementation of the present disclosure, when identifying the predetermined event, for at least one data frame in which the predetermined event is detected, the data stream is determined to involve the predetermined event in response to determining that the at least one data frame satisfies a predetermined condition. Such an example implementation can verify whether the predetermined event is truly identified. Alternatively and / or additionally, the predetermined condition can include: 1) the number of data frames of the predetermined event exceeds a preset number; and 2) the time span of the data frames of the predetermined event exceeds a preset time length.

[0054] For example, assuming that the preset number is 2 or other number, and assuming that the predetermined event is an event about a victory of one of the two parties in the match, when the data frames of the predetermined event exceed 2 or other number, it can be determined that the data stream involves the predetermined event. Assuming that the preset time length for the predetermined event is 8 seconds, when the time span of the data frames of the predetermined event exceeds 8 seconds or other time length, it can be determined that the data stream involves the predetermined event. With the example implementation of the present disclosure, the accuracy of the identification of the predetermined event can be improved, and misjudgment can be avoided.

[0055] According to one example implementation of the present disclosure, when presenting the guide message, a difference between a current time and a time for presenting a data segment in a data stream associated with a predetermined event can be determined, and in response to determining that the difference is less than a predetermined threshold, the guide message is presented at the first device. Alternatively and / or additionally, the first device can include a client device of a spectator user, and can also include a client device of a host user. In such example implementations, since it takes time to identify the predetermined event, for example, when a server device issues predetermined event information to a client device, the client device can have already played the picture (or can not have played the picture due to network reasons), and thus a timeliness check needs to be performed on the predetermined event.

[0056] FIG. 4 shows a flowchart of a process 400 for timeliness checking for a predetermined event, according to some implementations of the present disclosure. In the process 400, first, a client device receives predetermined event information and a timestamp of a corresponding data frame through a message channel (410), and the timestamp (i.e., a time for presenting a data segment in a data stream associated with a predetermined event) can be denoted as ts. Then, it can be determined whether the timestamp ts is within a current time interval [t min ,t max ] (420), or whether a difference between a current time and a time for presenting a data segment in a data stream associated with a predetermined event is less than a predetermined threshold. t min may represent a minimum time of the current time interval, and t max may represent a maximum time of the current time interval. The time interval [t min ,t max ] and the predetermined threshold can be determined based on experience.

[0057] Further, if it is determined that the timestamp ts is within the current time interval [t min ,t max ] or the difference is less than the predetermined threshold, a picture of the predetermined event is just presented or is about to be presented, and at this time a guide message about giving a virtual gift can be presented (430). If it is determined that the timestamp ts is not within the current time interval [t min ,t max ], it is determined whether the timestamp ts is less than t min (440). If it is determined that the timestamp ts is less than t min , it means that the picture of the predetermined event has been presented for a period of time, and the corresponding guide message can be ignored (450). If it is determined that the timestamp ts is not less than t min , it is determined whether the timestamp ts is greater than t min (460). If it is determined that the timestamp ts is greater than t minIf the predetermined event screen is still a while away, the predetermined event information is cached and the guide message is presented later (470). Exemplarily, the predetermined event information to be cached can be cached in a cache space of the client device.

[0058] According to one example implementation of the disclosure, in response to determining that the data stream does not include the data segment associated with the predetermined event, a subsequent portion of the data stream can be received. In response to determining that the subsequent portion of the data stream includes the data segment, the guide message can be presented. In such example implementation, since the client device can receive the predetermined event information and the timestamp of the corresponding data frame through the message channel (e.g., IM, instant message), and the message channel transmits messages can be faster than the data stream transmission, if it is determined that the data stream does not include the data segment associated with the predetermined event, the subsequent portion of the data stream can be received to determine whether the subsequent portion includes the data segment associated with the predetermined event. If the subsequent portion includes the data segment associated with the predetermined event, the guide message can be presented, otherwise the guide message is not presented.

[0059] With the above disclosed example implementation, the guide message can be flexibly and effectively presented even if there is a delay in the live data stream.

[0060] According to one example implementation of the disclosure, the type of the guide message can match the type of the predetermined event. Still taking the live football game involved in FIG. 2 as an example, the type of the predetermined event can be, for example, an event type about a party winning the game, an event type about a party losing the game, an event type about a party scoring a goal, etc. At this time, the type of the guide message can be matched for different types of predetermined events. As discussed above, the guide message can include, for example, one or more pre-determined gifts for the audience user to present in the interface of the live application 110 in the corresponding dialog box.

[0061] FIG. 5 shows a flowchart of a live interaction process 500 according to some implementations of the disclosure. In the process 500, first when the predetermined event information takes effect and the gifting guide is performed (510), it is determined whether the type of the predetermined event is an event type about a party winning the game (520). If the type of the predetermined event is an event type about a party winning the game, a dialog box of a virtual gift of a gifting trophy type can be presented in the interface of the live application 110 (530).

[0062] If the type of the predetermined event is not the event type related to a party winning, it can be continued to determine whether the type of the predetermined event is the event type related to a party losing (540). If it is determined that the type of the predetermined event is the event type related to a party losing, a dialog box for gifting a virtual gift of the type of encouraging representation (such as a heart) can be presented on the interface of the live streaming application 110 (550).

[0063] If it is determined that the type of the predetermined event is not the event type related to a party losing, it can be continued to determine whether the type of the predetermined event is the event type related to a goal (560). If it is determined that the type of the predetermined event is the event type related to a goal, a dialog box for gifting a virtual gift of the type of flowers can be presented on the interface of the live streaming application 110 (570).

[0064] With the exemplary implementation of the present disclosure, the interest of the audience user in gifting virtual gifts can be promoted, and the interactive atmosphere of the live streaming can be promoted.

[0065] According to one example implementation of the present disclosure, in response to receiving an interaction request for the guide message, a predetermined action can be performed at the client device. The predetermined action can be an action of gifting a virtual gift. When the guide message is the automatic popping up of the interactive panel 130, the corresponding interaction request can be to make the audience user select and gift a virtual gift among one or more virtual gifts in the interactive panel 130. When the guide message is the presentation of a corresponding dialog box for one or more to-be-gifted gifts pre-determined for the audience user on the interface of the live streaming application 110, the corresponding interaction request can be to make the audience user confirm whether to gift the currently presented to-be-gifted gift through the dialog box.

[0066] With the exemplary implementation of the present disclosure, the interactivity of the audience user in gifting virtual gifts can be promoted.

[0067] Example process

[0068] FIG. 6 shows a flowchart of a live streaming interaction method 600 according to some implementations of the present disclosure. At block 610, a data stream is presented at a client device of a live streaming application. At block 620, in response to determining that the data stream involves a predetermined event, a guide message for guiding a user of the client device to perform a predetermined action is presented at the client device.

[0069] According to one example implementation of the present disclosure, determining that the data stream involves a predetermined event comprises at least one of the following: detecting the predetermined event in the data stream; and receiving a message indicating that the data stream involves the predetermined event.

[0070] According to one example implementation of the present disclosure, detecting the predetermined event in the data stream includes extracting a set of data frames from the data stream at a predetermined frequency, the predetermined frequency being determined according to a duration of the predetermined event, and performing data processing on the set of data frames to identify the predetermined event, the data processing including at least one of text recognition, image recognition, and audio recognition.

[0071] According to one example implementation of the present disclosure, identifying the predetermined event further includes determining a predetermined position associated with a data frame in the data stream based on attribute information of the predetermined event, and determining the predetermined event at the predetermined position in the set of data frames.

[0072] According to one example implementation of the present disclosure, identifying the predetermined event includes determining, for at least one data frame in which the predetermined event is detected, that the data stream involves the predetermined event in response to determining that the at least one data frame satisfies a predetermined condition.

[0073] According to one example implementation of the present disclosure, presenting the guide message includes determining a difference between a current time and a time for presenting a data segment in the data stream associated with the predetermined event, and presenting the guide message at the first device in response to determining that the difference is less than a predetermined threshold.

[0074] According to one example implementation of the present disclosure, the method 600 further includes receiving a subsequent portion of the data stream in response to determining that the data stream does not include the data segment associated with the predetermined event, and presenting the guide message in response to determining that the subsequent portion of the data stream includes the data segment.

[0075] According to one example implementation of the present disclosure, a type of the guide message matches a type of the predetermined event.

[0076] According to one example implementation of the present disclosure, the method 600 further includes performing a predetermined action at the client device in response to receiving an interaction request for the guide message.

[0077] According to one example implementation of the present disclosure, the data stream is a live data stream associated with a host user in a live application, the client device is associated with a viewer user in the live application, the predetermined event is set based on the host user and / or the viewer user, and the predetermined action is a gifting action.

[0078] Example apparatuses and devices

[0079] FIG. 7 illustrates a block diagram of a live interaction apparatus 700, according to some implementations of the present disclosure. The apparatus 700 includes a data stream presentation module 770 configured to present a data stream at a client device of a live application, and a guidance message presentation module 720 configured to present, at the client device, a guidance message for guiding a user of the client device to perform a predetermined action, in response to determining that the data stream relates to a predetermined event.

[0080] According to one example implementation of the present disclosure, the guidance message presentation module 720 is further configured to determine that the data stream relates to the predetermined event based on at least one of: detecting the predetermined event in the data stream, and receiving a message indicating that the data stream relates to the predetermined event.

[0081] According to one example implementation of the present disclosure, the guidance message presentation module 720 is further configured to extract a set of data frames from the data stream at a predetermined frequency, the predetermined frequency being determined according to a duration of the predetermined event, and perform data processing on the set of data frames to identify the predetermined event, the data processing including at least one of: text recognition, image recognition, and audio recognition.

[0082] According to one example implementation of the present disclosure, the guidance message presentation module 720 is further configured to determine a predetermined position associated with a data frame in the data stream based on attribute information of the predetermined event, and determine the predetermined event at the predetermined position in the set of data frames.

[0083] According to one example implementation of the present disclosure, the guidance message presentation module 720 is further configured to determine that the data stream relates to the predetermined event in response to determining that at least one data frame of the predetermined event satisfies a predetermined condition.

[0084] According to one example implementation of the present disclosure, the guidance message presentation module 720 is further configured to determine a difference between a current time and a time for presenting a data segment in the data stream associated with the predetermined event, and present the guidance message at the first device in response to determining that the difference is less than a predetermined threshold.

[0085] According to one example implementation of the present disclosure, the apparatus 700 further includes a receiving module configured to receive a subsequent portion of the data stream in response to determining that the data stream does not include the data segment associated with the predetermined event, and present the guidance message in response to determining that the subsequent portion of the data stream includes the data segment.

[0086] According to one example implementation of the present disclosure, a type of the guidance message matches a type of the predetermined event.

[0087] According to one example implementation of the present disclosure, the apparatus 700 further includes an execution module configured to perform a predetermined action at the client device in response to receiving the interaction request for the boot message.

[0088] According to one example implementation of the present disclosure, the data stream is a live data stream associated with a host user in a live application, the client device is associated with a viewer user in the live application, the predetermined event is set based on the host user and / or the viewer user, and the predetermined action is a gifting action.

[0089] FIG. 8 illustrates a block diagram of a device 800 that is capable of implementing the various implementations of the present disclosure. It should be understood that the computing device 800 illustrated in FIG. 8 is merely an example and should not be construed as any limitation of the functionality and scope of the implementations described herein. The computing device 800 illustrated in FIG. 8 can be used to implement the methods described above.

[0090] As shown in FIG. 8, the computing device 800 is in the form of a general- purpose computing device. The components of the computing device 800 can include, but are not limited to, one or more processors 810, a memory 820, a storage device 830, one or more communication units 840, one or more input devices 850, and one or more output devices 860. The processor 810 can be a real or virtual processor and is capable of executing various processing in accordance with programs stored in the memory 820. In a multi-processor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of the computing device 800.

[0091] The computing device 800 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the computing device 800 and includes both volatile and non-volatile media, removable and non-removable media. The memory 820 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory), or some combination thereof. The storage device 830 can be a removable or non-removable media and can include machine-readable media such as a flash drive, a magnetic disk drive, or any other media that can be used to store information and / or data (e.g., training data for training) and that can be accessed by the computing device 800.

[0092] The computing device 800 can further include additional removable / non-removable, volatile / non-volatile storage devices. Although not shown, a floppy disk drive for reading from or writing to a removable, non-removable, and volatile memory disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-removable, and volatile memory disk (e.g., a "CD-ROM" or "DVD") can be provided. In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The storage device(s) 820 can include a computer program product 825 having one or more program modules configured to carry out the various methods or actions of the various implementations of the present disclosure.

[0093] The communication unit 840 enables communications with other computing devices over a communication medium. Additionally, the functionality of the components of the computing device 800 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating over a communication connection. Thus, the computing device 800 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in the networking environment.

[0094] The input device(s) 850 can be one or more input devices, such as a mouse, keyboard, trackball, etc. The output device(s) 860 can be one or more output devices, such as a display, speakers, a printer, etc. The computing device 800 can also include other peripheral components, such as one or more of a modem, a network interface card, a printer, an I / O interface, etc., which can enable the computing device 800 to communicate in a network environment.

[0095] According to example implementations of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the methods described above. According to example implementations of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the methods described above. According to example implementations of the present disclosure, a computer program product is provided having computer executable instructions stored thereon, which program is executed by a processor to implement the methods described above.

[0096] The computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer readable storage medium that does not include propagated signals.

[0097] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer readable storage medium that does not include propagated signals.

[0098] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer readable storage medium that does not include propagated signals.

[0099] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0100] Having described various implementations of the disclosure above, the descriptions are not exhaustive and do not limit the disclosure to the disclosed implementations. Numerous modifications and adaptations thereof will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The scope of the disclosure includes all of the implementations described above and equivalents thereto. Language used in this specification should not be used to limit the scope of the claims.

Claims

1. A live interactive method, comprising: presenting, at a client device of a live application, a data stream; and in response to determining that the data stream involves a predetermined event, presenting, at the client device, a guide message for guiding a user of the client device to perform a predetermined action. 2.The method of claim 1, wherein determining that the data stream involves the predetermined event comprises at least one of: detecting the predetermined event in the data stream; and receiving a message indicating that the data stream involves the predetermined event. 3.The method of claim 2, wherein detecting the predetermined event in the data stream comprises: extracting a set of data frames from the data stream at a predetermined frequency, the predetermined frequency being determined according to a duration of the predetermined event; and performing data processing on the set of data frames to identify the predetermined event, the data processing comprising at least one of text recognition, image recognition, and audio recognition. 4.The method of claim 3, wherein identifying the predetermined event further comprises: determining a predetermined position associated with a data frame in the data stream based on attribute information of the predetermined event; and determining the predetermined event at the predetermined position in the set of data frames. in response to determining that at least one data frame in which the predetermined event is detected satisfies a predetermined condition, determining that the data stream involves the predetermined event. 6.The method of claim 1, wherein presenting the guide message comprises: determining a difference between a current time and a time for presenting a data segment associated with the predetermined event in the data stream; and 5. The method of claim 3, wherein identifying the predetermined event comprises: in response to determining that the difference is less than a predetermined threshold, presenting the guide message at the first device. 7.The method of claim 1, further comprising: in response to determining that the data stream does not include a data segment associated with the predetermined event, receiving a subsequent portion of the data stream; and in response to determining that the subsequent portion of the data stream includes the data segment, presenting the guide message. 8.The method of claim 1, wherein a type of the guide message matches a type of the predetermined event. in response to receiving an interaction request for the guide message, performing the predetermined action at the client device. 10.The method of claim 1, wherein the data stream is a live data stream associated with a host user in the live application, the client device is associated with a viewer user in the live application, the predetermined event is set based on the host user and / or the viewer user, and the predetermined action is a resource-giving action. 11.A live interactive apparatus, comprising: a data stream presenting module configured to present, at a client device of a live application, a data stream; and a guide message presenting module configured to present, at the client device, a guide message for guiding a user of the client device to perform a predetermined action in response to determining that the data stream involves a predetermined event.

9. The method of claim 1, further comprising: 12.An electronic device, comprising: ​ ​ ​ ​ ​ ​ at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1-10.

13. A computer-readable storage medium having computer-executable instructions stored thereon that, when executed by a processor, cause the processor to implement the method according to any one of claims 1-10.

14. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1-10.

Citation Information

Patent Citations

  • Live broadcast interaction method and device, equipment and storage medium

    CN115802115A

  • Information display method and device, equipment and storage medium

    CN117354570A

  • Live broadcast interaction method and device and computer readable storage medium

    CN117915143A

  • Information display method and device, electronic equipment, storage medium and program product

    CN118612497A

  • Interaction method and device in virtual scene, equipment and storage medium

    CN118747053A