Method and apparatus for live-streaming interaction, and device, medium and program product
Patent Information
- Application Number
- PCT/SG2025/050413
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-13
- Filing Date
- 2025-06-13
- Publication Date
- 2026-02-05
AI Technical Summary
During a live stream, if the streamer does not actively log out, the resumption of live stream interactions leads to a decline in user experience, affecting the continuity and efficiency of live stream interactions.
By acquiring data associated with live interactive events, the interactive context in the live stream user's interface can be restored, including communication connection status, screen layout, and interactive configuration, ensuring the continuity of live interaction.
It improved the experience for all participants in live interactive events, reduced the negative impact of streamer users leaving the live interaction, and improved user experience and interaction efficiency.
Smart Images

Figure SG2025050413_05022026_PF_FP_ABST
Abstract
Description
[0001]Method, device, apparatus, medium and program product for live interaction This application claims priority to the Chinese patent application No. 202410766639.4, filed on June 13, 2024, and entitled “Method, device, apparatus, medium and program product for live interaction”, the whole content of which is incorporated herein by reference. TECHNICAL FIELD The example embodiments of the present disclosure generally relate to the field of computer, and in particular, to a method, device, apparatus, computer readable storage medium and computer program product for live interaction. BACKGROUND TECHNIQUE More and more applications can provide live function at present. The live or live session is also called “live room” sometimes. During the live, the host user can interact with the audience user, can attract more audience users, and improve the live experience of the audience. For example, some live rooms can create interactive events (e.g., live room games, mic activities, etc.), and users can participate in the interactive events in the live room. The users participating in the interactive events and other users watching the live room can interact in the live room. SUMMARY In a first aspect of the present disclosure, a method for live interaction is provided. The method comprises: in response to determining that a restarted live is associated with a live interaction event before disconnection, obtaining live interaction data associated with the live interaction event, the live interaction event corresponding to participants including a first participant and at least one second participant; and based on the live interaction data, restoring, in a live interface corresponding to the first participant, a live interaction context of the first participant and the at least one second participant in the live interaction event. In a second aspect of the present disclosure, a method for live interaction is provided. The method comprises: in response to determining that a first participant of a live exits a live interaction event in the live, maintaining a second participant of the live interaction event in the live interaction event, the live interaction event corresponding to participants including at least the first participant and the second participant; and in response to determining that the first participant rejoins the live interaction event, restoring, in a live interface corresponding to the second participant, live information of the first participant in the live interaction event. In a third aspect of the present disclosure, a device for live interaction is provided. The device comprises: an obtaining module configured to, in response to determining that a restarted live is associated with a live interaction event before disconnection, obtain live interaction data associated with the live interaction event, the live interaction event corresponding to participants including a first participant and at least one second participant; and a restoring module configured to, based on the live interaction data, restore, in a live interface corresponding to the first participant, a live interaction context of the first participant and the at least one second participant in the live interaction event. In a fourth aspect of the present disclosure, a device for live interaction is provided. The device comprises: an obtaining module configured to, in response to determining that a first participant of a live exits a live interaction event in the live, maintain a second participant of the live interaction event in the live interaction event, the live interaction event corresponding to participants including at least the first participant and the second participant; and a restoring module configured to, in response to determining that the first participant rejoins the live interaction event, restore, in a live interface corresponding to the second participant, live information of the first participant in the live interaction event.The apparatus comprises: a maintaining module configured to, in response to determining that a first participant of a live broadcast exits a live interactive event in the live broadcast, maintain a second participant of the live interactive event in the live interactive event, the participants corresponding to the live interactive event including at least the first participant and the second participant; and a resuming module configured to, in response to determining that the first participant re-joins the live interactive event, resume live information of the first participant in the live interactive event in a live interface corresponding to the second participant. In a fifth aspect of the present disclosure, an electronic device is provided. The device comprises at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect or the second aspect. In a sixth aspect of the present disclosure, a computer-readable storage medium is provided. The medium has stored thereon a computer program which, when executed by a processor, implements the method of the first aspect or the second aspect. In a seventh aspect of the present disclosure, a computer program product is provided. The computer program product is tangibly stored on a computer storage medium and comprises computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect or the second aspect. It should be understood that the content described in this section is not intended to limit key features or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become apparent through the following description. BRIEF DESCRIPTION OF DRAWINGS The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent as various embodiments of the present disclosure are described in detail with reference to the drawings, of which: FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented; FIG. 2 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure; FIG. 3 shows a schematic diagram of an example of a live interface corresponding to a first participant according to some embodiments of the present disclosure; FIG. 4 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure; FIG. 5 shows a schematic diagram of an example of a live interface corresponding to a second participant according to some embodiments of the present disclosure; FIG. 6 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure; FIG. 7 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure; FIG. 8 shows a schematic structural block diagram of an apparatus for live interaction according to some embodiments of the present disclosure; FIG. 9 shows a schematic structural block diagram of an apparatus for live interaction according to some embodiments of the present disclosure; and FIG. 10 shows an electronic device in which one or more embodiments of the present disclosure can be implemented.DETAILED DESCRIPTION Embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It should be understood that the drawings of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure. In the description of embodiments of the present disclosure, the terms "comprise" and "comprising" and the like are to be construed in an open-ended fashion, i.e., as "including, but not limited to." The term "based on" is to be construed as "based at least in part on." The terms "one embodiment" or "the embodiment" are to be understood as "at least one embodiment." The term "some embodiments" is to be understood as "at least some embodiments." The following detailed description can also include other explicit and implicit definitions. In this document, unless explicitly stated, performing a step "in response to A" does not mean that the step is performed immediately after A, but can include one or more intermediate steps. It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, the obtaining or use of the data) should comply with the requirements of relevant laws and regulations and relevant provisions. It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the type, scope of use, use scenario, etc. of the personal information involved in the present disclosure should be notified to the user and the authorization of the user should be obtained in a proper manner according to relevant laws and regulations. For example, in response to receiving the active request of the user, a prompt message is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using the personal information of the user, so that the user can voluntarily choose whether to provide the personal information to the software or hardware such as an electronic device, an application, a server or a storage medium that performs the operation of the technical solutions of the present disclosure as an optional but non-limiting implementation manner. In response to receiving the active request of the user, the prompt message is sent to the user, for example, in the form of a pop-up window, and the prompt message can be presented in the form of text in the pop-up window. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device. It can be understood that the above notification and user authorization process is only illustrative, and does not limit the implementation of the present disclosure, and other ways that meet the relevant laws and regulations can also be applied to the implementation of the present disclosure. FIG. 1 shows a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented.In the environment 100, one or more users 110-1, 110-2, 110-3, …, 110-N can watch a live broadcast (sometimes also referred to as a "live session") and participate in a live interactive event, etc. through their respective associated terminal devices 120-1, 120-2, …, 120-N. The users 110 can also be referred to as participants for example. For ease of discussion, the users 110-1, 110-2, …, 110-N can be collectively or individually referred to as the users 110. ? And the terminal devices 120-1, 120-2, …, 120-N can be collectively or individually referred to as the terminal devices 120. Among all the users 110, initiates the live broadcast. In some scenarios, the user 110-1 who initiates the live broadcast can also be referred to as a host, a host user, a host participant, a broadcaster, or a broadcast manager of the live session. In some embodiments, the participants of the live interactive event can include the host user 110-1 (i.e., a first participant) and one or more other participants 110-N (i.e., second participants). The other participants 110-N can be guest participants who do not start their own live broadcast but join the live room interactive event (i.e., a mic-in event) of the current host participant. In some embodiments, live interactions between multiple host users who each start their own live broadcast can be allowed, so the participants of the live interactive event can include multiple host participants. In this case, any of the multiple host participants can be considered as the "first participant" mentioned herein, and the other host participants can be considered as the "second participant" mentioned herein. In addition, the other users 110 can also include viewers or listeners who watch the live broadcast. In some embodiments, the terminal devices 120 can be respectively installed with an application capable of providing a live broadcast service, or can access a website capable of providing a live broadcast service. 120 to access the corresponding application or website. Accordingly, the terminal device 120 can present a corresponding live interface which, for example, can provide live content of the live room, e.g., audio live content or video live content, etc. In some embodiments, the terminal device 120 can also communicate with the server 130 through the network 132 to implement the provisioning of the live service. The server 130 can provide functions of management, configuration and maintenance, etc. with respect to the application or website. In some embodiments, the server 130 can store data generated in the live process, including live interaction data generated in the live interaction. The terminal device 120 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, stationery computer, laptop computer, notebook computer, netbook computer, tablet computer, media player, multimedia tablet, personal communication system (PCS) device, personal navigation device, personal digital assistant (PDA), audio / video player, digital camera / camcorder, television receiver, radio receiver, electronic book device, game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the terminal device 120 can also be capable of supporting any type of interface to user, such as "wearable" circuitry, etc. cThe server 110 can be various types of computing systems / servers capable of providing computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, and the like. It should be understood that the structure and functionality of the various elements in the environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the present disclosure. Generally, users (including hosts and guests) who join a live broadcast can initiate and participate in interactive events in the live broadcast, such as a mic activity (including voice or video chat interaction) between users, a game, and the like. Taking the mic activity as an example, in the mic process, if an abnormality occurs in the live broadcast application of the host participant, such as application crash, application failure, or application process being exited, the host participant will be passively exited from the live broadcast, including exiting the live broadcast interactive event. At this time, the guests who are live interacting can continue chatting. However, the host often plays the role of a host in the live interactive scene to lead the entire live interactive process. If the application at the host end cannot be restored to the connected state before the exit, it will have a great impact on the live interaction, affecting the user experience. Therefore, in the live interaction, it is of great significance to enable the host to quickly rejoin the live interaction in the case of passive exit from the live interaction. According to embodiments of the present disclosure, an improved scheme for live interaction is provided. According to the scheme, in response to determining that a restarted live broadcast is associated with a live interaction event before being disconnected, live interaction data associated with the live interaction event is obtained, and the participants corresponding to the live interaction event include a first participant and at least one second participant. Accordingly, based on the live interaction data, the live interaction context of the first participant and the at least one second participant in the live interaction event is restored in the live broadcast interface corresponding to the first participant. Thus, the scheme can enable the first participant to quickly restore to the live interaction state before passive exit when the first participant participates in the live interaction event and is passively exited, thereby being able to improve the experience of the participants of the live interaction event and reduce the impact of the first participant on the live interaction event after exiting. Some example embodiments of the present disclosure will be described below with reference to the accompanying drawings. FIG. 2 shows a flowchart of a process 200 for live interaction according to some embodiments of the present disclosure. For ease of discussion, these embodiments will be described with reference to the environment 100 of FIG. 1. The process 200 can be implemented at the terminal device 120-1 of the first participant H0-1 of FIG. 1. In the process 200, the terminal device 120-1 can determine that the live broadcast of the first participant 110-1 is disconnected (210). In some scenarios, the live broadcast represents a virtual live broadcast scene created in a live broadcast platform.The reason for the live disconnect can be a non-active disconnect, i.e., the live is not actively exited by the first participant 110-1, but due to, for example, an abnormal running of the application corresponding to the live of the first participant 110-1, or the thread of the application is exited, etc. In the case of the live being disconnected, depending on the operation of the first participant 110-1, the terminal device 120-1 can determine that the first participant 110-1 reopens the live (220). Further, if it is determined that the first participant 110-1 reopens the disconnected live, the terminal device 120-1 can determine that the reopened live is associated with a live interactive event before the disconnection, and the live interactive event includes the first participant 110-1 and at least one second participant 110-i (i can be one or more integers selected from 2 to N). Referring to the example environment of FIG. 1, the users joining the live can include a plurality of users 110 (also referred to as participants of the live). The live interactive event can be initiated in the live. In some embodiments, the interactive event in the live can be initiated by the host participant of the live, or can be participated in by the host participant based on the requirement of the host participant of the other live. The participants in the interactive event in the live can include the host participant of the live, one or more guest participants of the current live, and / or the host participant of the other live, etc. In some embodiments, the first participant 110-1 and the at least one second participant 110-i participating in the interactive event can respectively include the initiator of the live interactive event and the receiver of the live interactive event. In some embodiments, the live interactive event can include a live-in-mic event. At this time, the first participant 110-1 and the at least one second participant 110-i participating in the interactive event can respectively include the initiator of the live-in-mic and the receiver of the live-in-mic. The initiator of the live-in-mic can be, for example, the first participant 110-1, and the receiver of the live-in-mic can be, for example, the at least one second participant 110-i. It should be understood that the embodiments of the present disclosure do not limit the type of participants participating in the live interactive event in the live. In some embodiments, the live interactive event in the live can be any online activity allowed in the live, such as singing, dancing, storytelling, chatting, playing, etc. The participants participating in the live interactive event can be allowed to open the live-in-mic permission or the video permission in the live, for example, to share audio and / or video. In some embodiments, the first participant 110-1 of the live can configure the live interactive event in the live, for example, the type of participating in the live interactive event, the number of participants participating in the live interactive event, the interaction order of the participants, the interaction constraints, the interaction duration, etc.In some embodiments, if it is determined that the first participant 110-1 reopens the live broadcast (220), the terminal device 120-1 can determine whether the reopened live broadcast belongs to a continuation of the previously disconnected live broadcast (230). In some embodiments, in determining whether the reopened live broadcast belongs to a continuation of the previously disconnected live broadcast, if it is detected that the live broadcast of the first participant 110-1 corresponds to an abnormal application running, or the first participant 110-1 previously passively exited from the live broadcast, the terminal device 120-1 can determine that the reopened live broadcast belongs to a continuation of the previously disconnected live broadcast. That is, if the terminal device 120-1 determines that the live broadcast is not a passive exit of the first participant 110-1, it can further determine that the live broadcast belongs to a continuation. Illustratively, the terminal device 120-1 can perceive that the opened live broadcast belongs to a continuation (230) through data obtained from the server 130. In some embodiments, if it is determined that the reopened live broadcast belongs to a continuation of the previously disconnected live broadcast (230), the terminal device 120-1 can determine whether the live broadcast is associated with a live broadcast interaction event before disconnection (240). If it is determined that the live broadcast is not associated with a live broadcast interaction event before disconnection, the terminal device 120-1 does not need to perform related operations on resuming the live broadcast interaction event, i.e., the process 200 ends (245). Further, if it is determined that the live broadcast is associated with a live broadcast interaction event before disconnection, the terminal device 120-1 can obtain live broadcast interaction data associated with the live broadcast interaction event (250). Illustratively, the terminal device 120-1 can obtain the live broadcast interaction data associated with the live broadcast interaction event from the server 130 through a network interface (250). Accordingly, based on the live broadcast interaction data, the terminal device 120-1 resumes the live broadcast interaction context of the first participant 110-1 and at least one second participant 110-i in the live broadcast interaction event in the live broadcast interface corresponding to the first participant 110-1. As discussed above, there can be multiple anchor participants joining the live broadcast interaction event, and in such a case, any anchor participant abnormally exiting the live broadcast can be resumed according to the manner proposed by the embodiments of the present disclosure. Some example operations of resuming the live broadcast interaction context on the first participant side will be further described below in conjunction with FIG. 2. In some embodiments, in the case of detecting whether the live broadcast is associated with a live broadcast interaction event before disconnection, a prompt information can also be sent to the first participant 110-1 to confirm whether the first participant 110-1 wants to resume the live broadcast interaction event. After receiving the confirmation of the first participant 110-1, the terminal device 120-1 can resume the live broadcast interaction context in the live broadcast interaction event.According to embodiments of the present disclosure, the first participant 110-1 can be automatically and quickly restored to the live interaction state before the passive exit when the first participant 110-1 participates in the live interaction event. This can improve the experience of each participant in the live interaction and reduce the negative impact on the live interaction after the first participant 110-1 exits. In some embodiments, the live interaction data at least indicates the communication connection state of the first participant 110-1 and at least one second participant 110-i with the live interaction event respectively. In some embodiments, the communication connection for the live interaction event can include a Real-Time Communication (RTC) connection. RTC technology mainly takes voice, video, and network phone as the main body of communication, and can realize instant communication of multiple parties, which is conducive to improving communication efficiency and reducing communication cost. Further, when the live interaction context is restored, based on the communication connection state, the terminal device 120-1 can cause the first participant 110-1 to re-establish the communication connection (260) corresponding to the live interaction event, wherein at least one second participant 110-i maintains the communication connection corresponding to the live interaction event during the live disconnection of the first participant 110-1. It should be understood that the live interaction event is established based on the communication connection (for example, the RTC connection), so after the first participant 110-1 passively exits the live interaction, the second participant 110-i can still maintain the communication connection. Unless the second participant 110-i chooses to actively exit the live interaction event, at which time the communication connection is exited. Therefore, it can be understood that the at least one second participant 110-i refers to the second participant who still maintains the communication connection during the live disconnection of the first participant 110-1. Therefore, the terminal device 120-1 of the first participant 110-1 helps to achieve the purpose of restoring the live interaction by re-establishing the communication connection according to the live interaction data. In some embodiments, the live interaction data at least indicates the layout information of the live picture corresponding to each of the first participant 110-1 and the at least one second participant 110-i. And when the live interaction context is restored, based on the layout information, the terminal device 120-1 can restore the layout of the live picture corresponding to the first participant 110-1 and the at least one second participant 110-i in the live interface corresponding to the first participant 110-1 (270). The live interface can refer to the entire live page of the live interaction displayed on the terminal device 120-1 of the first participant 110-1. The live picture can refer to each picture in the live interface used to represent each participant.The layout of the live picture can refer to the position of each participant's live picture in the live interface. FIG. 3 shows a schematic diagram of an example of a live interface 300 corresponding to a first participant according to some embodiments of the present disclosure. The live interface 300 can be implemented in the environment 100 of FIG. 1. The live interface 300 can be the live interface associated with the step 270 of FIG. 2. The live interface 300 includes an interface 301 and an interface 302, which can be provided by the terminal device 120-1 shown in FIG. 1. Such a live interface 300 can be associated with a live interactive event in a live broadcast, for displaying the layout of the pictures of the live interaction. Specifically, in the live interactive event, the terminal device 120-1 of the first participant 110-1 can display a plurality of live pictures corresponding to the first participant 110-1 and at least one second participant 110-i, such as pictures 310-1 to 310-60, in the live interface 301. When the first participant 110-1 resumes the live interaction after passively exiting the live broadcast, the terminal device 120-1 of the first participant 110-1 can resume displaying the original plurality of live pictures, such as pictures 310-1 to 310-60, in the live interface 302. Thus, by restoring the layout of the live interface, the experience of each participant and the audience watching the broadcast can be improved. In some embodiments, when the live interaction context is resumed, the terminal device 120-1 can also obtain live information corresponding to each of the at least one second participant 110-i via the communication connection corresponding to the live interactive event, and present the corresponding live information in the live picture corresponding to the at least one second participant 110-i (280). For example, the first frame notification of the communication connection, such as the first frame notification of the RTC connection, can be used to obtain the live information corresponding to each of the at least one second participant 110-i. When the position of each participant's live picture in the live interface is determined, the terminal device 120-1 of the first participant 110-1 can obtain the live information of the at least one second participant 110-i through the first frame notification. The live information may, for example, include the visual identifier, real-time image, or other appropriate image content of each participant. If a participant has opened the video or audio permission, the live information may, for example, also include the relevant identifier of the video, audio, etc., depending on the interaction settings of each participant. For example, in FIG. 3, picture 310-1 can include the relevant identifier or image of the first participant 110-1. Pictures 310-2 to 310-6 can include the relevant identifiers or images of the five second participants 110-i.Thus, the first participant 110-1 and the other second participants 110-i can be distinguished conveniently, and the live interactive experience can be improved. In some embodiments, the live interactive data at least indicates interactive configuration information of the first participant 110-1 and at least one second participant 110-i about the live interactive event. When the live interactive context is restored, based on the interactive configuration information, the terminal device 120-1 can set the corresponding configuration state of the first participant 110-1 and the at least one second participant 110-i in the live interactive event in the live interface corresponding to the first participant 110-1 (290). The interactive configuration information can include privacy permission configuration information of the first participant 110-1 and the second participant 110-i, such as whether to open the audio, whether to open the video, and the like. The interactive configuration information can also include other configuration information selected by the participants, such as whether to set a background for the live picture, what kind of background to set, and the like. In the traditional live restoration manner, the first participant can only restore the live, but cannot restore to the original live interactive event such as the mic-in, so that the first participant cannot re-engage in real-time voice or video interaction with the original second participant. Thus, compared with the traditional live restoration manner, the embodiment avoids making the second participant no-i re-operate the original interactive configuration, thereby improving the interactive experience of the first participant 110-1, the second participants 110-i, and the live audience. In some embodiments, the live interactive data also indicates live interactive messages associated with the live interactive event. When the live interactive context is restored, the terminal device 120-1 can present the live interactive messages associated with the live interactive event in the live interface corresponding to the first participant. The live interactive messages can include, for example, application information of the audience applying to participate in the live interaction, virtual gifts received by each participant in the live interaction, interactive texts, interactive expressions, and the like. Thus, the negative impact of the first participant 110-1 in the live interaction due to the exit is reduced. In some embodiments, when the live interactive data associated with the live interactive event is acquired, the terminal device 120-1 can receive the live interactive data associated with the live interactive event from the server device (i.e., the server 130), and the server device updates the live interactive data based on the operation of the second participant 110-i in the live interactive event during the live disconnection of the first participant 110-1. The change of the live interactive data during the live disconnection of the first participant 110-1 can be associated with the latest state of the live interactive event participated by the at least one second participant 110-i.That is, during the first participant 110-1 exits the live interaction, the data generated by the live interaction is updated to the server 130 in real time, avoiding the first participant 110-1 re-joining the live interaction after the information is missed, thereby affecting the experience of the live interaction. Based on the above-described process, the embodiments of the present disclosure can enable the first participant to quickly recover to the live interaction state before passive exit when the first participant participates in the live interaction event, thereby improving the experience of each participant of the live interaction event and reducing the negative impact on the live interaction event after the first participant exits. FIG. 4 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure. For ease of discussion, these embodiments are described with reference to the environment 100 of FIG. 1. In some embodiments, these embodiments can be implemented in the terminal device 120 of the second participant 110-i of FIG. 1. As shown in FIG. 4, in the process 400, if it is determined that the first participant 110-1 of the live exits the live interaction event in the live (410), the terminal device 120 can maintain the second participant 110-i of the live interaction event in the live interaction event (420). The live interaction event at least includes the first participant 110-1 and the second participant 110-i. Specifically, the second participant 110-i can be maintained in the live interaction during the first participant 110-1 exits the live interaction event based on the communication connection (e.g., RTC connection) corresponding to the live interaction of the second participant 110-i. Further, if it is determined that the first participant 110-1 re-joins the live interaction event (430), the terminal device 120 can restore the live information of the first participant 110-1 in the live interaction event in the live interface corresponding to the second participant 110-i. Specifically, the terminal device 120 can restore the live information of the first participant 110-1 after each second participant 110-i in the live interaction event receives the first frame notification (440). In some embodiments, when restoring the live information of the first participant 110-1 in the live interaction event, the terminal device 120 can obtain the live information corresponding to the first participant 110-1 via the communication connection (e.g., RTC connection) corresponding to the live interaction event, and present the live information corresponding to the first participant 110-1 in the live picture corresponding to the first participant 110-1 in the live interface corresponding to the second participant 110-i (440). The live information may, for example, include visual identifiers, real-time images, or other appropriate image content of each participant.If a participant has opened the video or audio permission, the live information may also include relevant identifiers of video, audio, etc., depending on the interaction settings of each participant. FIG. 5 shows a schematic diagram of an example of a live interface 500 corresponding to a second participant according to some embodiments of the present disclosure. The live interface 500 includes an interface 501, an interface 502, and an interface 503, which can be provided by the terminal device 120 shown in FIG. 1. Such live interfaces 501-503 can be associated with a live interaction event for displaying a layout of live interaction. As shown in FIG. 5, during the live interaction, the terminal device 120 of the second participant 110-i can display a plurality of live pictures corresponding to the first participant 110-1 and at least one second participant 110-i in the live interface 501, for example, pictures 310-1 to 310-60. After the first participant 110-1 passively exits the live, the terminal device 120 of the second participant 110-i displays the live interface 502, in which the identifier or image in the picture 310-1 corresponding to the first participant 110-1 can be presented as a dropped state, indicating that the first participant 110-1 is not currently in the live interaction event. When the live interaction is resumed, the terminal device 120 of the first participant 110-1 can resume displaying the original plurality of live pictures and corresponding live information in the live interface 303. Thus, by restoring the layout of the live interface and the live information, the experience of each participant and the audience is improved. In some embodiments, based on the interaction configuration information of the first participant 110-1 about the live interaction event, the terminal device 120 can set the corresponding configuration state of the first participant 110-1 in the live interaction event in the live interface corresponding to the second participant 110-i (450). The configuration state of the first participant 110-1 may, for example, include permission configurations such as whether the first participant 110-1 opens the audio, opens the video, etc., and may also include other configuration information of the first participant 110-1, such as whether the live picture is set with a background, what kind of background is set, etc. Thus, compared with the conventional live recovery method, the present embodiment avoids making the first participant 110-i re-operate the original interaction configuration, thereby improving the interaction experience of the first participant 110-1, the second participant 110-i, and the audience.Based on the process described above, the embodiments of the present disclosure can maintain the second participant in the live interaction when the first participant passively exits the live interactive event, and then quickly rejoin the live interactive event, without reconfiguring the live interaction, etc. The second participant can quickly recover to the live interaction state of each participant before passive exit, thereby improving the experience of each participant in the live interactive event. FIG. 6 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure. Process 600 can be implemented at terminal device 120-1 corresponding to the first participant in the live interactive event in FIG. 1. Process 600 is described below with reference to FIG. 1. As shown in FIG. 6, at block 610, in response to determining that the restarted live is associated with a live interactive event before disconnection, terminal device 120-1 obtains live interaction data associated with the live interactive event, the participants corresponding to the live interactive event including the first participant and at least one second participant. At block 620, based on the live interaction data, terminal device 120-1 recovers the live interaction context of the first participant and the at least one second participant in the live interactive event in the live interface corresponding to the first participant. In some embodiments, the live interaction data at least indicates the communication connection state of the first participant and the at least one second participant with the live interactive event respectively, and wherein recovering the live interaction context comprises: based on the communication connection state, causing the first participant to reestablish the communication connection corresponding to the live interactive event, wherein the at least one second participant maintains the communication connection corresponding to the live interactive event during the live disconnection of the first participant. In some embodiments, the communication connection includes a real-time communication (RTC) connection. In some embodiments, the live interaction data at least indicates the layout information of the live screen corresponding to the first participant and the at least one second participant respectively, and wherein recovering the live interaction context comprises: based on the layout information, recovering the layout of the live screen corresponding to the first participant and the at least one second participant in the live interface corresponding to the first participant. In some embodiments, recovering the live interaction context further comprises: obtaining the live information corresponding to the at least one second participant via the communication connection corresponding to the live interactive event; and presenting the corresponding live information in the live screen corresponding to the at least one second participant. In some embodiments, the live interaction data at least indicates the interaction configuration information of the first participant and the at least one second participant regarding the live interactive event, and wherein recovering the live interaction context comprises: based on the interaction configuration information, setting the corresponding configuration state of the first participant and the at least one second participant in the live interactive event in the live interface corresponding to the first participant.In some embodiments, the live interaction data further indicates a live interaction message associated with the live interaction event, and wherein the resuming the live interaction context comprises: presenting the live interaction message associated with the live interaction event in a live interface corresponding to the first participant. In some embodiments, the obtaining the live interaction data associated with the live interaction event comprises: receiving, from a server device, the live interaction data associated with the live interaction event, and wherein the server device updates the live interaction data based on an operation of a second participant in the live interaction event during the disconnection of the live of the first participant. In some embodiments, the process 600 further comprises: in response to determining that the live of the first participant is re-opened, determining whether the re-opened live belongs to a continuation of the previously disconnected live; and in response to determining that the re-opened live belongs to the continuation of the previously disconnected live, determining whether the live is associated with the live interaction event before the disconnection. In some embodiments, the determining whether the re-opened live belongs to the continuation of the previously disconnected live comprises: in response to detecting that an application corresponding to the live of the first participant is running abnormally, or the first participant previously exited the live passively, determining that the re-opened live belongs to the continuation of the previously disconnected live. In some embodiments, the live interaction event comprises a mic-in event in the live. FIG. 7 shows a flowchart of a process for live interaction according to some embodiments of the present disclosure. The process 700 can be implemented at the terminal device 120 corresponding to a second participant in a live interaction event in FIG. 1. The process 700 is described below with reference to FIG. 1. As shown in FIG. 7, at block 710, in response to determining that a first participant of a live exits a live interaction event in the live, the terminal device 120 maintains a second participant of the live interaction event in the live interaction event, the live interaction event corresponding to participants including at least the first participant and the second participant. At block 720, in response to determining that the first participant rejoins the live interaction event, the terminal device 120 resumes live information of the first participant in the live interaction event in a live interface corresponding to the second participant.In some embodiments, the recovering the live information of the first participant in the live interactive event comprises: obtaining the live information of the first participant via a communication connection corresponding to the live interactive event; and presenting the live information of the first participant in a live interface corresponding to the second participant and in a live picture corresponding to the first participant. In some embodiments, the process 700 further comprises: based on the interaction configuration information of the first participant with respect to the live interactive event, setting a corresponding configuration state of the first participant in the live interactive event in the live interface corresponding to the second participant. FIG. 8 shows a schematic structural block diagram of an apparatus for live interaction according to some embodiments of the present disclosure. The apparatus 800 can be implemented as or included in a terminal device 120-1 corresponding to a first participant of a live broadcast. Various modules / components in the apparatus 800 can be implemented by hardware, software, firmware, or any combination thereof. As shown in FIG. 8, the apparatus 800 includes an obtaining module 810 configured to, in response to determining that a restarted live broadcast is associated with a live interactive event before disconnection, obtain live interactive data associated with the live interactive event, the participants of the live interactive event including the first participant and at least one second participant; and a recovering module 820 configured to, based on the live interactive data, recover, in a live interface corresponding to the first participant, a live interactive context of the first participant and the at least one second participant in the live interactive event. In some embodiments, the live interactive data at least indicates respective communication connection states of the first participant and the at least one second participant with respect to the live interactive event, and the recovering module 820 is further configured to, based on the communication connection states, cause the first participant to re-establish a communication connection corresponding to the live interactive event, wherein the at least one second participant maintains the communication connection corresponding to the live interactive event during disconnection of the live broadcast of the first participant. In some embodiments, the communication connection comprises a real-time communication (RTC) connection. In some embodiments, the live interactive data at least indicates layout information of respective live pictures of the first participant and the at least one second participant, and the recovering module 820 is further configured to, based on the layout information, recover, in the live interface corresponding to the first participant, a layout of the live pictures of the first participant and the at least one second participant. In some embodiments, the recovering module 820 is further configured to: obtain live information of the at least one second participant via the communication connection corresponding to the live interactive event; and present the corresponding live information in a live picture corresponding to the at least one second participant.In some embodiments, the live interaction data indicates at least interaction configuration information of the first participant and the at least one second participant with respect to the live interaction event, and the recovery module 820 is further configured to set, based on the interaction configuration information, corresponding configuration states of the first participant and the at least one second participant in the live interaction event in a live interface corresponding to the first participant. In some embodiments, the live interaction data further indicates live interaction messages associated with the live interaction event, and the recovery module 820 is further configured to present the live interaction messages associated with the live interaction event in the live interface corresponding to the first participant. In some embodiments, the obtaining module 810 is further configured to receive, from a server device, the live interaction data associated with the live interaction event, and wherein the server device updates the live interaction data based on operations of the second participant in the live interaction event during the live disconnection of the first participant. In some embodiments, the apparatus 800 further includes a determination module configured to, in response to determining that the first participant reopens the live, determine whether the reopened live belongs to a continuation of the previously disconnected live, and in response to determining that the reopened live belongs to the continuation of the previously disconnected live, determine whether the live was associated with the live interaction event before the disconnection. In some embodiments, the determination module is further configured to, in response to detecting that an application corresponding to the live of the first participant is running abnormally or the first participant previously exited the live passively, determine that the reopened live belongs to the continuation of the previously disconnected live. In some embodiments, the live interaction event includes a mic-in event in the live. FIG. 9 shows a schematic structural block diagram of an apparatus for live interaction according to some embodiments of the present disclosure. The apparatus 900 can be implemented as or included in a terminal device 120 corresponding to a guest participant in a live interaction event. Various modules / components in the apparatus 900 can be implemented by hardware, software, firmware, or any combination thereof. As shown in FIG. 9, the apparatus 900 includes a maintenance module 910 configured to, in response to determining that a first participant of a live exits a live interaction event in the live, maintain a second participant of the live interaction event in the live interaction event, the participants corresponding to the live interaction event including at least the first participant and the second participant, and a recovery module 920 configured to, in response to determining that the first participant rejoins the live interaction event, recover live information of the first participant in the live interaction event in a live interface corresponding to the second participant. In some embodiments, the recovery module 920 is further configured to obtain the live information corresponding to the first participant via a communication connection corresponding to the live interaction event, and present the live information corresponding to the first participant within a live picture corresponding to the first participant in the live interface corresponding to the second participant.In some embodiments, the apparatus 900 further includes a setting module configured to set, based on the interaction configuration information of the first participant about the live interactive event, a corresponding configuration state of the first participant in the live interactive event in a live interface corresponding to the second participant. The units and / or modules included in the apparatus 800 or the apparatus 900 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a machine-readable medium. In addition or alternatively, part or all of the units and / or modules in the apparatus 800 or the apparatus 900 can be implemented at least in part by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc. FIG. 10 shows a block diagram of an electronic device 1000 in which one or more embodiments of the present disclosure can be implemented. It should be understood that the electronic device 1000 illustrated in FIG. 10 is merely an example and should not be construed as any limitation to the functionality and scope of the embodiments described herein. The terminal device 120 of FIG. 1 or the apparatus 800 of FIG. 8, the apparatus 900 of FIG. 9 can be implemented as or included in one or more electronic devices 1000. As shown in FIG. 10, the electronic device 1000 is in the form of a general computing device. Components of the electronic device 1000 can include, but are not limited to, one or more processors or processing units 1010, a memory 1020, a storage device 1030, one or more communication units 1040, one or more input devices 1050, and one or more output devices 1060. The processing unit 1010 can be a real or virtual processor and capable of performing various processes according to programs stored in the memory 1020. In a multi-processor system, multiple processing units perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 1000. The electronic device 1000 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the electronic device 1000 and includes both volatile and non-volatile media, removable and non-removable media.Memory 1020 can be volatile (such as register, cache, RAM), non-volatile (such as ROM, EEPROM, flash memory), or some combination of the two. Storage device 1030 can be removable or non-removable, and can include media, such as flash drives, magnetic disks, or any other medium that can be used to store information and / or data (e.g., training data for training) and that can be accessed by electronic device 1000. Electronic device 1000 can further include additional removable / non-removable, volatile / non-volatile memory. Although not shown in FIG. 1, a disk drive and / or a floppy disk drive can be provided to read from or write to a removable, non-removable, volatile / non-volatile disk (e.g., a "floppy disk"), and an optical disk drive can be provided to read from or write to a removable, non-removable, volatile / non-volatile media (e.g., a CD-ROM). In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 1020 can include computer program product 1025 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure. Communication unit 1040 enables communications with other electronic devices over a communication medium. Additionally, the functionality of the components of electronic device 1000 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating over a communication connection. Thus, electronic device 1000 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes. Input device 1050 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. Output device 1060 can be one or more output devices, such as a display, a speaker, a printer, etc. Electronic device 1000 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through communication unit 1040, one or more devices that enable a user to interact with electronic device 1000, or any devices (e.g., network cards, modems, etc.) that enable electronic device 1000 to communicate with one or more other electronic devices. Such communication can occur via an input / output (I / O) interface (not shown).According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above. Various aspects of the disclosure can be described in the context of flow diagrams and / or block diagrams that illustrate the functioning of methods, apparatuses, devices, and computer program products according to the present disclosure. It will be understood that each block of the flow diagrams and / or block diagrams, and combinations of blocks in the flow diagrams and / or block diagrams, can be implemented by computer readable program instructions. These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flow diagrams and / or block diagrams. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer readable medium having instructions stored therein comprises an article of manufacture including a manufacture that includes the instructions which implement the function / act specified in the flow diagrams and / or block diagrams. The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flow diagrams and / or block diagrams. The flow diagrams and block diagrams in the drawings are shown in accordance with a number of implementations of systems, methods and computer program products according to the present disclosure. In this regard, each block in the flow diagrams and block diagrams can represent a module, a segment, or a portion of instructions, which includes one or more executable instructions for implementing the specified logical functions. In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession can in fact be executed substantially concurrently or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved.It is also important to note that each block of the flowchart and / or block diagram illustrations, and combinations of blocks in the flowchart and / or block diagram illustrations, can be implemented by dedicated hardware-based systems that perform the specified functions or acts or combinations of special-purpose hardware and computer instructions. The implementation depicted in the block diagram and / or flowchart illustrations has been described above for purposes of clarity and example, not limitation, and the like. Numerous modifications and adaptations thereof will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The scope of each of the disclosed implementations is defined by the appended claims, and all techniques containing processing based on one or more of these processes qualify to be within the scope and spirit of the disclosed implementations. The language used in the specification should not be limiting, but should be construed to broadly cover the embodiments described herein and all compatible modifications and equivalent arrangements.
Claims
CLAIM 1. A method for live interaction, comprising: in response to determining that the re-opened live streaming is associated with a live streaming interaction event before disconnection, obtaining live streaming interaction data associated with the live streaming interaction event, the live streaming interaction event corresponding to a first participant and at least one second participant; and resuming, based on the live streaming interaction data, a live streaming interaction context of the first participant and the at least one second participant in the live streaming interaction event in a live streaming interface corresponding to the first participant.
2. The method of claim 1, wherein the live interaction data indicates at least a communication connection status corresponding to the live interaction event for the first participant and the at least one second participant, respectively, and wherein resuming the live interaction context comprises: based on the communication connection state, causing the first participant to re-establish a communication connection corresponding to the live streaming interaction event, wherein the at least one second participant maintains the communication connection corresponding to the live streaming interaction event during the live streaming disconnection of the first participant.
3. The method of claim 2, wherein the communication connection comprises a real-time communication (RTC) connection. 4.The method of claim 1, wherein the live interaction data indicates at least layout information of respective live video images corresponding to the first participant and the at least one second participant, and wherein restoring the live interaction context comprises: based on the layout information, resuming a layout of live streaming screens corresponding to the first participant and the at least one second participant in a live streaming interface corresponding to the first participant.
5. The method of claim 4, wherein restoring the live interaction context further comprises: obtaining, via the communication connection corresponding to the live streaming interaction event, live streaming information corresponding to the at least one second participant respectively; and presenting the corresponding live streaming information in a live streaming screen corresponding to the at least one second participant.
6. The method of claim 1, wherein the live interaction data indicates at least interaction configuration information of the first participant and the at least one second participant with respect to the live interaction event, and wherein restoring the live interaction context comprises: based on the interaction configuration information, setting a corresponding configuration state of the first participant and the at least one second participant in the live streaming interaction event in a live streaming interface corresponding to the first participant.
7. The method of claim 1, wherein the live streaming interaction data further indicates a live streaming interaction message associated with the live streaming interaction event, and wherein resuming the live streaming interaction context comprises: presenting, in a live streaming interface corresponding to the first participant, the live streaming interaction message associated with the live streaming interaction event.
8. The method of claim 1, wherein obtaining live interaction data associated with the live interaction event comprises: receiving, from a server device, live streaming interaction data associated with the live streaming interaction event, and wherein the server device updates the live streaming interaction data based on an operation of a second participant in the live streaming interaction event during the live streaming disconnection of the first participant.
9. The method of claim 1, further comprising: in response to determining that the first participant re-opens live streaming, determining whether the re-opened live streaming belongs to a continuation of the live streaming that was previously disconnected; and in response to determining that the re-opened live streaming belongs to the continuation of the live streaming that was previously disconnected, determining whether the live streaming was associated with the live streaming interaction event before the disconnection.
10. The method of claim 9, wherein determining whether a live broadcast that is re-opened belongs to a continuation of the live broadcast that was previously disconnected comprises: in response to detecting that an application corresponding to the live streaming of the first participant runs abnormally, or the first participant previously exited the live streaming passively, determining that the re-opened live streaming belongs to the continuation of the live streaming that was previously disconnected.
11. The method of claim 1, wherein the live streaming interaction event comprises a mic-sharing event in the live streaming.
12. A method for live interaction, comprising: in response to determining that the first participant of the live broadcast exits the live interactive event in the live broadcast, maintaining a second participant of the live interactive event in the live interactive event, the participants corresponding to the live interactive event including at least the first participant and the second participant; and in response to determining that the first participant re-joins the live interactive event, restoring live information of the first participant in the live interactive event in a live interface corresponding to the second participant.
13. The method of claim 12, wherein restoring live information of the first participant in the live interactive event comprises: obtaining the live information corresponding to the first participant via a communication connection corresponding to the live interactive event; and presenting the live information corresponding to the first participant in a live picture corresponding to the first participant in the live interface corresponding to the second participant. based on interaction configuration information of the first participant about the live interactive event, setting a corresponding configuration state of the first participant in the live interactive event in the live interface corresponding to the second participant.
14. The method of claim 12, further comprising:
15. An apparatus for live interaction, comprising: an obtaining module configured to, in response to determining that a re-started live broadcast is associated with a live interactive event before disconnection, obtain live interactive data associated with the live interactive event, the participants corresponding to the live interactive event including a first participant and at least one second participant; and a restoring module configured to, based on the live interactive data, restore live interactive context of the first participant and the at least one second participant in the live interactive event in a live interface corresponding to the first participant. in response to determining that the first participant of the live broadcast exits the live interactive event in the live broadcast, maintaining a second participant of the live interactive event in the live interactive event, the participants corresponding to the live interactive event including at least the first participant and the second participant; at least one processor; 16. An apparatus for live interaction, comprising: and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the apparatus to perform the method according to any one of claims 1 to 11 or the method according to any one of claims 12 to 14.
17. An electronic device, comprising:
18. A computer-readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions, when executed by a processor, implementing the method according to any one of claims 1 to 11 or the method according to any one of claims 12 to 14. 19. A computer program product, the computer program product being tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method of any one of claims 1 to 11 or the method of any one of claims 12 to 14. 18
Citation Information
Patent Citations
Interactive data processing method and device for live streaming room, storage medium and server
CN111385664A
Live broadcast microphone connection method and device, computer readable medium and electronic equipment
CN112235594A
Interaction method, device and equipment based on live broadcast, and computer readable storage medium
CN113094146A
Live broadcast interaction method, device, live broadcast server, terminal and storage medium
CN113366856A
Live broadcast interaction method and computer readable storage medium
CN113727127A