Live broadcast interaction method and device, electronic equipment, storage medium and program product

Abstract

The embodiment of the invention discloses a live broadcast interaction method and device, electronic equipment, a storage medium and a program product, and belongs to the technical field of Internet application, and the method comprises the steps: receiving interaction information; when it is recognized that the target object in the virtual space executes the first sub-target behavior within the preset duration, first prompt information is output, and the first prompt information is used for prompting that the target object in the virtual space has fed back to the interaction event. The first sub-target behavior is any sub-target behavior in target behaviors corresponding to the interaction event; when it is recognized that the target object in the virtual space does not execute any sub-target behavior within the preset duration, second prompt information is output, and the second prompt information is used for prompting that the target object does not feed back the interaction event. The purpose of providing effective interaction assistance in the live broadcast process can be achieved, and then the experience of audience watching the live broadcast is improved.

Description

Technical Field

[0001] This application relates to the field of Internet application technology, and includes, but is not limited to, a live streaming interactive method, device, electronic device, storage medium, and program product. Background Technology

[0002] With the rapid development of internet technology, more and more live streaming platforms have emerged, allowing viewers to choose their favorite live streaming rooms to watch the streamers' performances based on their preferences.

[0003] In related technologies, during the process of watching a live streamer perform, viewers may send virtual gifts to interact with the streamer. For example, after a viewer sends a gift, virtual effects may be added to the streamer's face or other parts of their body in the live stream, thus increasing the viewing experience for the audience.

[0004] However, in many related technological solutions, the ways in which streamers thank or respond to viewers after receiving gifts are limited. For example, streamers typically only express their gratitude verbally. Therefore, this approach fails to provide effective interactive support during the live stream, resulting in a poor viewing experience for viewers. Summary of the Invention

[0005] In view of this, the live streaming interactive method, apparatus, electronic device, storage medium, and program product provided in the embodiments of this application can achieve the purpose of providing effective interactive assistance during live streaming, thereby improving the viewing experience of the audience. The live streaming interactive method, apparatus, electronic device, storage medium, and program product provided in the embodiments of this application are implemented as follows:

[0006] A first aspect of this application provides a live streaming interaction method applied to a first terminal device, the method comprising:

[0007] Receive interactive information, wherein the interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device, the first terminal device has control over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device;

[0008] When it is detected that a target object in the virtual space performs a first sub-target behavior within a preset time period, a first prompt message is output. The first prompt message is used to prompt that the target object in the virtual space has responded to the interaction event. The first sub-target behavior is any one of the sub-target behaviors among the target behaviors corresponding to the interaction event.

[0009] If it is detected that the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period, a second prompt message is output. The second prompt message is used to prompt the target object that it has not responded to the interaction event.

[0010] In some embodiments, the second prompt information includes: missing prompt information or deviation prompt information;

[0011] If, upon detecting that a target object in the virtual space has not performed any of the sub-target behaviors within the preset time period, a second prompt message is output, including:

[0012] If it is detected that the target object has not performed any behavior within the preset time period, the missing prompt information is output. The missing prompt information is used to indicate that the target object has not performed any behavior within the preset time period.

[0013] If it is detected that the behavior performed by the target object within the preset time period does not belong to the target behavior, the deviation prompt information is output. The deviation prompt information is used to prompt that the behavior performed by the target object within the preset time period does not belong to the target behavior.

[0014] In some embodiments, the interaction event includes the interaction behavior initiated by the second terminal device in the virtual space;

[0015] If a target object in the virtual space is detected to perform a first sub-target action within a preset time period, a first prompt message is output, including:

[0016] When it is detected that the target object performs the first sub-target behavior within the preset time period, the first prompt information is output according to the target relationship between the first sub-target behavior and the interaction behavior. The first prompt information is used to prompt the target relationship between the first sub-target behavior and the interaction behavior. The target relationship includes the opposition relationship between the first sub-target behavior and the interaction behavior, or the splicing relationship between the first sub-target behavior and the interaction behavior.

[0017] In some embodiments, the target relationship includes the opposition relationship between the first sub-target behavior and the interaction behavior, and the first prompt information includes a first prompt sub-information, a second prompt sub-information, or a third prompt sub-information; the step of outputting the first prompt information based on the target relationship between the first sub-target behavior and the interaction behavior includes:

[0018] When the opposing relationship characterizes the first sub-target behavior as winning, the first prompt sub-information is output, which is used to prompt the first sub-target behavior as winning;

[0019] When the interaction behavior wins due to the opposition relationship, the second prompt sub-information is output, which is used to indicate that the interaction behavior has won.

[0020] When the opposing relationship characterizes the first sub-target behavior and the interaction behavior as equal, the third prompt sub-information is output, which is used to indicate that the first sub-target behavior and the interaction behavior are equal.

[0021] In some embodiments, the target relationship includes the concatenation relationship between the first sub-target behavior and the interaction behavior, the first prompt information includes a fourth prompt sub-information or a fifth prompt sub-information, and the step of outputting the first prompt information according to the target relationship between the first sub-target behavior and the interaction behavior includes:

[0022] When the splicing relationship is that the first sub-target behavior and the interaction behavior are spliced ​​into a preset behavior, the fourth prompt sub-information is output. The fourth prompt sub-information is used to indicate that the splicing relationship is that the first sub-target behavior and the interaction behavior are successfully spliced ​​into the preset behavior.

[0023] If the splicing relationship is such that the first sub-target behavior and the interaction behavior cannot be spliced ​​into the preset behavior, the fifth prompt sub-information is output. The fifth prompt sub-information is used to indicate that the splicing relationship is such that the first sub-target behavior and the interaction behavior cannot be spliced ​​into the preset behavior.

[0024] In some embodiments, the interaction event includes the interaction behavior initiated by the second terminal device in the virtual space; the first prompt information includes a sixth prompt sub-information and a seventh prompt sub-information, the sixth prompt sub-information being used to prompt that the behavior performed by the target object matches any one of the sub-target behaviors, and the seventh prompt sub-information being used to prompt the target relationship between the first sub-target behavior and the interaction behavior;

[0025] When a target object in the virtual space is detected to perform a first sub-target action within a preset time period, a first prompt message is output, including:

[0026] If the target object is found to perform the first sub-target behavior within the preset time period, the sixth prompt sub-information is output, and the seventh prompt sub-information is output according to the target relationship between the first sub-target behavior and the interaction behavior.

[0027] In some embodiments, the method further includes:

[0028] Display a virtual object, which is used to prompt the target object that it needs to respond to the interaction event, or to guide the target object to perform any one of the sub-target behaviors in the target behavior.

[0029] In some embodiments, the virtual object is used to guide the target object to perform any one of the sub-target behaviors in the target behavior, and the method further includes:

[0030] The display parameters of the virtual object are adjusted according to the behavior of the first sub-target. The display parameters include at least one of the following: display position, display size, and display effects.

[0031] In some embodiments, the first prompt information includes at least one of the following: a first special effects animation, a first text and / or a first voice, and the second prompt information includes at least one of the following: a second special effects animation, a second text and / or a second voice.

[0032] In some embodiments, the method further includes:

[0033] Output target behavior prompt information corresponding to the interaction event, the target behavior prompt information is used to prompt the target object to perform the target behavior.

[0034] In some embodiments, the method further includes:

[0035] If the target object is identified to perform a first sub-target action within the preset time period, and / or if the target relationship between the first sub-target action and the interaction action satisfies a preset condition, virtual resources are allocated to the first terminal device. The virtual resources include at least one of the following: virtual gifts, virtual points, virtual digital resources allocated to the first terminal device, and traffic allocated to the virtual space. The interaction event includes the interaction action initiated by the second terminal device in the virtual space.

[0036] In some embodiments, when the target behavior includes multiple different sub-target behaviors, and the target object is identified to have performed multiple sub-target behaviors within the preset time period, the method further includes:

[0037] The first sub-target action performed by the target object within the preset time period is taken as the first sub-target action; or...

[0038] The sub-target behavior that the target object maintains for the longest time within the preset duration is taken as the first sub-target behavior.

[0039] In some embodiments, the interaction event includes at least one of the following: an event in which the second terminal device sends a virtual gift to the first terminal device, or an event in which the second terminal device initiates an interaction request to the first terminal device.

[0040] A second aspect of this application provides a live streaming interaction method applied to a first terminal device, the method comprising:

[0041] In response to a first trigger operation on the second terminal device, interactive information is sent, wherein the interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device, the first terminal device has control permissions over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device;

[0042] The system receives and outputs live video data from the first terminal device. The live video data includes at least a first prompt message or a second prompt message. The first prompt message is used to indicate that the target object in the virtual space has responded to the interaction event, and the second prompt message is used to indicate that the target object has not responded to the interaction event.

[0043] In some embodiments, sending interactive information in response to a first trigger operation on the second terminal device includes:

[0044] In response to the first triggering operation, obtain the target behavior corresponding to the first triggering operation;

[0045] Send the interaction information, which is used to indicate the target behavior corresponding to the interaction event.

[0046] In some embodiments, the method further includes:

[0047] A control command is sent to the first terminal device, the control command being used to enable the first terminal device to identify whether the target object in the virtual space performs a first sub-target behavior within a preset time period, the first sub-target behavior being any one of the target behaviors corresponding to the interaction event.

[0048] In some embodiments, the live video data further includes virtual objects, which are displayed on the display interface of the second terminal device; the method further includes:

[0049] In response to a second triggering operation on the virtual object, the position and / or size of the virtual object are adjusted.

[0050] A third aspect of this application also provides a live streaming interactive device, applied to a first terminal device, the device comprising:

[0051] A receiving module is used to receive interactive information, wherein the interactive information is used to indicate an interactive event initiated by a second terminal device in the virtual space of the first terminal device, the first terminal device has control over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device.

[0052] The recognition output module is used to output a first prompt message when it is recognized that a target object in the virtual space performs a first sub-target behavior within a preset time period. The first prompt message is used to prompt that the target object in the virtual space has responded to the interaction event. The first sub-target behavior is any one of the sub-target behaviors among the target behaviors corresponding to the interaction event.

[0053] The identification output module is further configured to output a second prompt message when it is identified that the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period. The second prompt message is used to prompt the target object that it has not responded to the interaction event.

[0054] A fourth aspect of this application also provides a live streaming interactive device, applied to a second terminal device, the device comprising:

[0055] The sending module is used to send interactive information in response to a first trigger operation on the second terminal device. The interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device. The first terminal device has control permissions over the virtual space. The first terminal device is a device for initiating live streaming, and the second terminal device is a device for watching live streaming. The virtual space is a virtual live streaming room created by the first terminal device.

[0056] An execution module is configured to receive and output live video data output by the first terminal device. The live video data includes at least a first prompt message or a second prompt message. The first prompt message is used to indicate that the target object in the virtual space has responded to the interaction event, and the second prompt message is used to indicate that the target object has not responded to the interaction event.

[0057] The electronic device provided in this application includes a memory and a processor. The memory stores a computer program that can run on the processor. When the processor executes the program, it implements the method described in this application.

[0058] The computer-readable storage medium provided in this application embodiment stores a computer program thereon, which, when executed by a processor, implements the method provided in this application embodiment.

[0059] This application provides a computer program product, which includes a computer program (also called code or instructions) that, when run, causes a computer to implement the method provided in this application.

[0060] The live streaming interaction method, apparatus, electronic device, storage medium, and program product provided in this application receive interaction information. If a target object in the virtual space is detected to have performed a first sub-target action within a preset time period, a first prompt message is output. If the target object in the virtual space is detected not to have performed any sub-target action within the preset time period, a second prompt message is output.

[0061] Upon receiving interactive information, it indicates that at the current moment, the user (viewer) corresponding to the second terminal device expects to interact with the target object (host) in the virtual space. Since the preset duration is the effective time for the target object to respond to the interactive event, and the first sub-target action refers to an action actually performed by the target object within the preset duration that effectively responds to the interactive event, if the target object is found to have performed the first sub-target action within the preset duration, it can be determined that the target object has correctly and effectively responded to the interactive event. In this case, outputting the first prompt message allows both the target object and the user corresponding to the second terminal device to understand that the target object has responded to the interactive event. Conversely, if the target object is found not to have performed any target action within the preset duration, it can be determined that the target object has not responded to the interactive event. In this case, outputting the second prompt message allows both the target object and the user corresponding to the second terminal device to understand that the target object has not responded to the interactive event.

[0062] As can be seen from the above, for a live streamer, this proposed solution allows them to respond to the interactive event by executing a first sub-target behavior. This first sub-target behavior is one of the target behaviors corresponding to the interactive event; that is, the streamer can respond to the interactive event in a manner corresponding to that event. Since different interactive events may correspond to different target behaviors, the streamer may need to execute different first sub-target behaviors to respond to different interactive events. This allows the streamer to provide targeted responses to interactive events initiated by viewers and to interact with viewers in various ways, thereby enriching the ways in which the streamer and viewers interact and enriching the interactive content of the virtual space. Furthermore, outputting the first prompt information can introduce an entertaining reward mechanism for the streamer, and outputting the second prompt information can introduce an entertaining penalty mechanism to incentivize the streamer to respond to the interactive event.

[0063] Furthermore, for viewers watching the live stream, this proposed solution can accurately remind them of the streamer's response to the interactive event. After a viewer initiates the interactive event, the streamer must perform the corresponding action to complete the feedback. Therefore, if the streamer provides feedback, the viewer receives significant and targeted interactive feedback, increasing viewer engagement. Even if the streamer does not provide feedback, the second prompt can introduce an entertaining penalty to enhance viewer participation and viewing experience. Moreover, the first prompt can be used to introduce an entertaining reward mechanism, and the second prompt can be used to introduce an entertaining penalty mechanism, thus encouraging viewers to initiate new interactive events.

[0064] In this way, it is possible to respond to or thank viewers for their exchanges in various ways, thereby providing effective interactive assistance during the live stream and improving the viewer's experience, thus at least partially solving the technical problems raised in the background section. Attached Figure Description

[0065] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0066] Figure 1 This is a schematic diagram illustrating an application scenario provided in the embodiments of this application;

[0067] Figure 2 A flowchart illustrating the first live streaming interaction method provided in this application embodiment;

[0068] Figure 3 A flowchart illustrating the second live streaming interaction method provided in this application embodiment;

[0069] Figure 4 A schematic diagram of a first live streaming display interface provided in an embodiment of this application;

[0070] Figure 5 A flowchart illustrating the third live streaming interaction method provided in this application embodiment;

[0071] Figure 6 A schematic diagram of a second live streaming display interface provided in an embodiment of this application;

[0072] Figure 7 A schematic diagram of a third live streaming display interface provided in an embodiment of this application;

[0073] Figure 8 A flowchart illustrating the fourth live streaming interaction method provided in this application embodiment;

[0074] Figure 9 A schematic diagram of a fourth live streaming display interface provided in an embodiment of this application;

[0075] Figure 10 A flowchart illustrating the fifth live streaming interaction method provided in this application embodiment;

[0076] Figure 11 A flowchart illustrating the sixth live-streaming interaction method provided in this application embodiment;

[0077] Figure 12 A flowchart illustrating the seventh live streaming interaction method provided in this application embodiment;

[0078] Figure 13 A schematic diagram of the fifth live streaming display interface provided in the embodiments of this application;

[0079] Figure 14 A flowchart illustrating the eighth live streaming interaction method provided in this application embodiment;

[0080] Figure 15 A schematic diagram of a sixth live streaming display interface provided in an embodiment of this application;

[0081] Figure 16 A flowchart illustrating the ninth live streaming interaction method provided in this application embodiment;

[0082] Figure 17 A flowchart illustrating the tenth live streaming interaction method provided in this application embodiment;

[0083] Figure 18 A schematic diagram of the seventh live streaming display interface provided in the embodiments of this application;

[0084] Figure 19 A flowchart of the eleventh live streaming interaction method provided in the embodiments of this application;

[0085] Figure 20 A flowchart illustrating the twelfth live streaming interaction method provided in this application embodiment;

[0086] Figure 21 This is a schematic diagram of the structure of a live streaming interactive device provided in an embodiment of this application;

[0087] Figure 22 This is a schematic diagram of another live interactive device provided in an embodiment of this application. Detailed Implementation

[0088] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of this application will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.

[0089] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0090] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0091] It should be noted that the terms "first, second, third" used in the embodiments of this application are used to distinguish similar or different objects and do not represent a specific order of objects. It can be understood that "first, second, third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.

[0092] In related technologies, during the process of watching a live streamer perform, viewers may send virtual gifts to interact with the streamer. For example, after a viewer sends a gift, virtual effects may be added to the streamer's face or other parts of their body in the live stream, thus increasing the viewing experience for the audience.

[0093] However, in many related technological solutions, the ways in which streamers thank or respond to viewers after receiving gifts are limited. For example, streamers typically only express their gratitude verbally. Therefore, this approach fails to provide effective interactive support during the live stream, resulting in a poor viewing experience for viewers.

[0094] To address this, this application provides a live streaming interaction method. This method involves receiving interaction information; outputting a first prompt when a target object in the virtual space performs a first sub-target action within a preset time period; and outputting a second prompt when the target object in the virtual space does not perform any of the sub-target actions within the preset time period. The interaction information indicates an interaction event initiated by a second terminal device in the virtual space of a first terminal device. The first terminal device has control over the virtual space and is used to initiate the live stream. The second terminal device is used to watch the live stream. The virtual space is a virtual live stream room created by the first terminal device. The first prompt indicates that the target object in the virtual space has responded to the interaction event. The first sub-target action is any one of the target actions corresponding to the interaction event. The second prompt indicates that the target object has not responded to the interaction event. This method effectively assists viewers during the live stream, thereby improving their viewing experience.

[0095] This application uses a live streaming interaction method applied in electronic devices as an example for illustration. However, it does not imply that this application's embodiments can only be applied to live streaming interaction in electronic devices.

[0096] Optionally, the electronic device may include, but is not limited to, mobile phones, wearable devices (such as smartwatches, smart bracelets, smart glasses, etc.), tablets, laptops, in-vehicle terminals, PCs (Personal Computers), etc. The functions implemented by this method can be achieved by the processor in the electronic device calling program code. Of course, the program code can be stored in a computer storage medium. Therefore, the electronic device includes at least a processor and a storage medium.

[0097] Before introducing the live streaming interaction method provided in the embodiments of this application, the application scenarios that this method may be applicable to will be briefly described. For example, Figure 1 For an illustration of an application scenario provided in this application embodiment, please refer to [link / reference]. Figure 1 This application scenario can include a first terminal device A, a server B, and multiple second terminal devices C. Figure 1 The following explanation uses three second terminal devices C as an example.

[0098] Optionally, the first terminal device A and each of the second terminal devices C can be any possible device such as a smartphone, tablet, or laptop; the server B can be a server built from any possible electronic device. This application does not limit this aspect.

[0099] Optionally, communication connections can be established between the first terminal device A, the server B, and each of the second terminal devices C. For example, connections can be established via Wi-Fi, cellular data, etc., so that any two devices can send corresponding instructions and transmit corresponding data to each other. This application embodiment does not limit this.

[0100] In this embodiment, the first terminal device A and each of the second terminal devices C can have a live streaming application installed. This application can be a live streaming application, a social application, or a conferencing application; this embodiment does not limit the specific application. Server B provides backend services for this application. The broadcaster can log in to the application through the first terminal device A, and viewers can log in through the first terminal device B to interact with the server B, watch the live stream, and interact with the broadcaster. During the interaction, server B receives a live stream initiation request from the first terminal device A and receives the live stream data stream from the first terminal device A used to display the broadcaster's virtual space. Correspondingly, server B responds to any live stream viewing request from any of the second terminal devices C by sending the corresponding live stream data stream to the second terminal device C. Thus, the second terminal device C can play the received live stream data stream. In other words, the first terminal device A is the live stream content producer, and the second terminal devices C are the live stream content receivers.

[0101] For example, during a live broadcast using a first terminal device A, where the first terminal device A can refer to the device used by the broadcaster, it can be used to log into the broadcaster's first account and run the corresponding application to open a virtual space for recording video and broadcasting. Server B can receive video streams, text, voice, and any other possible data pushed by the first terminal device A, and push the received data (video streams, etc.) to various second terminal devices C that access the virtual space opened by the first terminal device A through server B. Each second terminal device C can refer to a viewer's terminal device, where it can log into the viewer's second account and display the video stream received from server B. In this way, the purpose of displaying the virtual space of the first terminal device A on the second terminal device C can be achieved, that is, the purpose of allowing viewers to see the broadcaster's performance content can be achieved.

[0102] For example, while a viewer is watching a live stream using a second terminal device C, the second terminal device C can respond to the viewer's triggering actions by sending corresponding interactive commands, text, voice, or other possible data to the server B. For instance, the interactive command could be anything from connecting to the live stream to sending virtual gifts. The server B can also receive interactive commands, text, voice, and other possible data sent by any second terminal device C, and push the received interactive commands and other data to the first terminal device A. Upon receiving the corresponding interactive commands and other data from the server B, the first terminal device A can process the data to perform corresponding operations, such as displaying special effects animations, displaying text, or outputting voice. In this way, the goal of displaying the data sent by the second terminal device C in the virtual space of the first terminal device A can be achieved, that is, the goal of enabling interaction between the viewer and the streamer can be achieved.

[0103] The examples above are provided to give a general explanation of the basic working principle of this application scenario, and do not mean that the devices in this application scenario provided in this application embodiment can only interact according to the operations in the above examples. In actual applications, the devices in this application scenario can also perform any other possible operations. This application embodiment does not limit this.

[0104] In this case, each step in the live interaction method provided in this application embodiment can be executed by the first terminal device A, and can be set and adjusted according to actual needs. This application embodiment does not limit this.

[0105] The live streaming interaction method provided in the embodiments of this application will be explained in detail below.

[0106] Figure 2 This is a flowchart illustrating a live streaming interaction method provided in this application. This method can be applied to the aforementioned first terminal device A. The first terminal device A may include any control unit and / or processor with functions such as processing, control, recognition, and calculation. See also... Figure 2 This application provides a live streaming interaction method, which includes:

[0107] Step 110: Receive interactive information.

[0108] The interactive information is used to indicate the interactive events initiated by the second terminal device in the virtual space of the first terminal device.

[0109] Optionally, as described above, the first terminal device can be owned by the broadcaster initiating the live stream, and the first terminal device can control the virtual space by logging into the aforementioned first account; while the second terminal device can be owned by any viewer watching the live stream. Therefore, the first terminal device has control permissions over the virtual space. For example, these control permissions may include the permission to create the virtual space, the permission to terminate the virtual space, the permission to configure parameters in the virtual space, and any other possible permissions. This application embodiment does not limit this.

[0110] The virtual space can be created independently by the user corresponding to the first terminal device, or it can be allocated and created by the aforementioned server; wherein, the user corresponding to the first terminal device refers to a user who can operate the first terminal device, i.e., a broadcaster. This application embodiment does not limit this.

[0111] This virtual space, also known as a virtual live streaming room, can be a digital live streaming space constructed in real time by a computer program. This virtual space can use 3D modeling, real-time rendering, and / or network transmission technologies to map the interactions between the broadcaster and the audience onto the virtual environment, and adjust various virtual elements within the virtual space based on corresponding instructions or rules. Furthermore, this virtual space can also separate the broadcaster from the physical operator; however, this embodiment of the application does not limit this aspect.

[0112] In this embodiment, the interaction event includes interactive behaviors initiated by the second terminal device in the virtual space. For example, the interaction event could be an event where a user corresponding to the second terminal device sends a virtual gift to the first terminal device through the second terminal device, or it could be any other event initiated by a user corresponding to the second terminal device to interact with the streamer. Here, the user corresponding to the second terminal device refers to a user capable of operating the second terminal device, i.e., a viewer. This embodiment does not limit this.

[0113] The interactive event can also instruct the broadcaster on the target action to be performed, and it can also be used to instruct on the content of the prompt information to be output in the virtual space. Generally, if the interactive event is an event in which a viewer sends a virtual gift to the user corresponding to the first terminal device through the second terminal device, then the content indicated by the interactive event can correspond to the virtual gift. For example, if the virtual gift requires the user to speak, then the interactive event can instruct the broadcaster to speak the corresponding voice. This application does not limit this aspect.

[0114] It should be noted that the operation of the second terminal device initiating an interactive event in the virtual space of the first terminal device can be as exemplified in the application scenario above. The viewer triggers the second terminal device to send an interactive command to the server, and then the server forwards or pushes the interactive command to the first terminal device. The viewer can be the user corresponding to the second terminal device (or the user corresponding to the second account). The viewer triggers the second terminal device to send an interactive command to the first terminal device, and the interactive command is sent to the first terminal device through the server.

[0115] It is worth noting that receiving this interaction information indicates that the viewer expects to interact with the streamer at the current moment. Therefore, it is necessary to accurately determine whether the streamer has responded accordingly to the interaction.

[0116] Step 120: If the target object in the virtual space is detected to perform the first sub-target behavior within a preset time period, output the first prompt message.

[0117] Optionally, when performing step 120, any possible recognition algorithm, such as a gesture recognition algorithm, action recognition algorithm, or speech recognition algorithm, can be invoked to determine whether the broadcaster has performed the first sub-target behavior within a preset time period. This embodiment of the application does not limit this.

[0118] Optionally, the preset duration may refer to the effective time for responding to the interactive event. The preset duration can be set by relevant technical personnel according to actual needs, and it can be set to be relatively short. Furthermore, the preset duration may correspond to the interactive event. For example, if the interactive event is a user of the second terminal device sending a virtual gift to the first terminal device through the second terminal device, and the virtual gift requires the user to speak, then the preset duration may be 3 seconds; if the virtual gift requires the user to make a corresponding gesture or action, then the preset duration may be 5 seconds. This application embodiment does not limit this.

[0119] Optionally, the first sub-target behavior can be any one of the target behaviors corresponding to the interaction event; that is, the target behavior can be one or more. This application does not limit this.

[0120] The target behavior corresponding to the interaction event refers to the behavior that can effectively respond to the interaction event. The target behavior can be determined by the interaction event. For example, if the interaction event is an event in which a user of the second terminal device sends a virtual gift to the first terminal device through the second terminal device, then the at least one target behavior can be determined by the virtual gift. This application embodiment does not limit this.

[0121] In this embodiment, the first sub-target behavior can refer to a sub-target behavior actually performed by the broadcaster within a preset time period. Furthermore, the target behavior and / or the first group of target behaviors can be action-type behaviors, voice-type behaviors, or a combination of action-type and voice-type behaviors. This application embodiment does not limit this.

[0122] In this embodiment, the target object in the virtual space can refer to a real person or a virtual person appearing in the virtual space. That is, the target object in the virtual space can refer to the user corresponding to the first terminal device or the anchor.

[0123] In this embodiment, the first prompt message is used to indicate that the target object in the virtual space has responded to the interaction event.

[0124] For example, the first prompt message can be any possible form, such as special effects animation, text, or voice, and this application embodiment does not limit this. Moreover, the first prompt message can refer to information that enhances the aesthetics of the visuals, optimizes the interactive experience, or strengthens the appeal of the content. For instance, the first prompt message could be a special effects animation that shows "gently patting the streamer's head." In other words, the first prompt message can provide entertaining reward feedback to the streamer, increasing viewer engagement.

[0125] Optionally, the operation of outputting the first prompt information may be to output the first prompt information in the virtual space, so that both the first terminal device and the second terminal device can output the first prompt information. For example, both the first terminal device and the second terminal device can display the special effects animation, text, and / or play the voice corresponding to the first prompt information. This application embodiment does not limit this.

[0126] It's worth noting that since the preset duration is the effective time for the broadcaster to respond to the interactive event, and the first sub-target action refers to an action actually performed by the broadcaster within that preset duration that effectively responds to the interactive event, recognizing that the broadcaster has performed the first sub-target action within the preset duration confirms that the broadcaster has correctly and effectively responded to the interactive event. In this case, outputting the first prompt message allows both the broadcaster and the viewer to understand that the broadcaster has responded to the interactive event.

[0127] Step 130: If it is found that the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period, output the second prompt message.

[0128] In this embodiment, the fact that the target object in the virtual space did not perform any target behavior within the preset time period can mean that the streamer did not perform any behavior within the preset time period, or that the behavior performed by the streamer within the preset time period does not belong to any sub-target behavior among the at least one target behavior. This application embodiment does not limit this.

[0129] Optionally, the second prompt message is used to indicate that the target object in the virtual space has not responded to the interaction event.

[0130] For example, the second prompt can be any possible form, such as special effects animation, text, or voice. Furthermore, the second prompt can refer to information that deliberately reduces the aesthetic appeal of the visuals, creates distracting elements, or triggers punitive feedback. For instance, the second prompt could be a special effects animation that shows "hitting the anchor's head" or "distorting the anchor's face." In other words, the second prompt can provide entertaining punitive feedback to the anchor, increasing viewer engagement. This application does not limit this aspect.

[0131] Generally, the second prompt message is different from the first prompt message, so as to distinguish whether the target object in the virtual space responds to the interactive event through different information.

[0132] Optionally, the operation of outputting the second prompt information can be to output the second prompt information in the virtual space, so that the second prompt information can be output on the live broadcast screens of both the first terminal device and the second terminal device. For example, both the first terminal device and the second terminal device can display the special effects animation, text, and / or play the voice corresponding to the second prompt information. This application embodiment does not limit this.

[0133] It's worth noting that since the preset duration is the effective time for the target object in the virtual space to respond to the interactive event, and the at least one target behavior refers to an action that can effectively respond to the interactive event, if it is identified that the target object in the virtual space has not performed any sub-target behavior within the preset duration, it can be determined that the broadcaster has not responded to the interactive event. In this case, outputting the second prompt message will allow both the broadcaster and the viewer to understand that the broadcaster has not responded to the interactive event.

[0134] In this embodiment, interactive information is received. If the target object in the virtual space is detected to have performed a first sub-target action within a preset time period, a first prompt is output. If the target object in the virtual space is detected not to have performed any of the sub-target actions within the preset time period, a second prompt is output.

[0135] For example, receiving interactive information indicates that at the current moment, the user (viewer) corresponding to the second terminal device expects to interact with the target object (host) in the virtual space. Since the preset duration is the effective time for the target object to respond to the interactive event, and the first sub-target action refers to an action actually performed by the target object within the preset duration that effectively responds to the interactive event, if it is recognized that the target object performs the first sub-target action within the preset duration, it can be determined that the target object has correctly and effectively responded to the interactive event. In this case, outputting the first prompt information allows both the target object and the user corresponding to the second terminal device to understand that the target object has responded to the interactive event. If it is recognized that the target object has not performed any target action within the preset duration, it can be determined that the target object has not responded to the interactive event. In this case, outputting the second prompt information allows both the target object and the user corresponding to the second terminal device to understand that the target object has not responded to the interactive event.

[0136] In this scenario, receiving an interaction event initiated by the second terminal device in the virtual space indicates that the user (viewer) corresponding to the second terminal device expects to interact with the target object (host) in the virtual space at the current moment. Since the preset duration is the effective time for the target object to respond to the interaction event, and the first sub-target action refers to an action actually performed by the target object within the preset duration that effectively responds to the interaction event, if the target object is found to have performed the first sub-target action within the preset duration, it can be determined that the target object has correctly and effectively responded to the interaction event. In this case, outputting the first prompt message allows both the target object and the user corresponding to the second terminal device to understand that the target object has responded to the interaction event. Conversely, if the target object is found not to have performed any target action within the preset duration, it can be determined that the target object has not responded to the interaction event. In this case, outputting the second prompt message allows both the target object and the viewer to understand that the target object has not responded to the interaction event.

[0137] As can be seen from the above, for a live streamer, this proposed solution allows them to respond to the interactive event by executing a first sub-target behavior. This first sub-target behavior is one of the target behaviors corresponding to the interactive event; that is, the streamer can respond to the interactive event in a manner corresponding to that event. Since different interactive events may correspond to different target behaviors, the streamer may need to execute different first sub-target behaviors to respond to different interactive events. This allows the streamer to provide targeted responses to interactive events initiated by viewers and to interact with viewers in various ways, thereby enriching the ways in which the streamer and viewers interact and enriching the interactive content of the virtual space. Furthermore, outputting the first prompt information can introduce an entertaining reward mechanism for the streamer, and outputting the second prompt information can introduce an entertaining penalty mechanism to incentivize the streamer to respond to the interactive event.

[0138] Furthermore, for viewers watching the live stream, this proposed solution can accurately remind them of the streamer's response to the interactive event. After a viewer initiates the interactive event, the streamer must perform the corresponding action to complete the feedback. Therefore, if the streamer provides feedback, the viewer receives significant and targeted interactive feedback, increasing viewer engagement. Even if the streamer does not provide feedback, the second prompt can introduce an entertaining penalty to enhance viewer participation and viewing experience. Moreover, the first prompt can be used to introduce an entertaining reward mechanism, and the second prompt can be used to introduce an entertaining penalty mechanism, thus encouraging viewers to initiate new interactive events.

[0139] In this way, it is possible to respond to or thank viewers for their exchanges in various ways, thereby providing effective interactive assistance during the live stream and improving the viewer's experience.

[0140] Since the first prompt and / or the second prompt can be any possible form such as special effects animation, text, or voice, in one possible implementation, the first prompt can include at least one of the following: a first special effects animation, a first text, and / or a first voice, and the second prompt can include at least one of the following: a second special effects animation, a second text, and / or a second voice.

[0141] That is, when outputting the first prompt message, the first special effects animation, the first text, and / or the first voice can be displayed on the live broadcast screen.

[0142] In some embodiments, the live stream may refer to a continuous stream of images currently generated in the virtual space.

[0143] The first special effects animation, the first text, and the first voice can all provide entertaining reward feedback to the broadcaster. The content of the first special effects animation, the first text, and the first voice can be determined based on the interactive event. For example, if the interactive event refers to a viewer sending a virtual gift, the entertaining reward feedback can also be determined based on the content of the virtual gift. For instance, if the virtual gift requires the user to speak, the entertaining reward feedback could be playing a cheerful voice message; if the virtual gift requires the user to make a corresponding gesture or action, the entertaining reward feedback could be playing a funny animation.

[0144] Furthermore, the first special effects animation and the first text can be displayed in the live stream using any possible method such as texturing or rendering. The first audio can be played as background music for the live stream. This application does not limit this aspect.

[0145] In addition, when outputting the second prompt message, a second special effects animation, a second text, and / or a second voice can be displayed on the live broadcast screen.

[0146] The second special effects animation, the second text, and the second voice can all provide entertaining punitive feedback to the broadcaster. The content of the second special effects animation, the second text, and the second voice can be determined based on the interactive event. For example, if the interactive event refers to a viewer sending a virtual gift, the entertaining punitive feedback can also be determined based on the content of the virtual gift. For instance, if the virtual gift requires the user to speak, the entertaining punitive feedback could be playing a sad voice message; if the virtual gift requires the user to make a corresponding gesture or action, the entertaining punitive feedback could be playing an animation of hitting the broadcaster. Moreover, the second special effects animation and the second text can be displayed in the live broadcast screen using any possible method such as stickers or rendering. The second voice can be played as background music for the live broadcast screen. This application embodiment does not limit this aspect.

[0147] In some embodiments, the second special effects animation is different from the first special effects animation, the second text is different from the first text, and the second voice is different from the first voice. This application does not limit this aspect.

[0148] It is worth noting that in this embodiment, the purpose of outputting the first prompt information and / or the second prompt information can be achieved in different forms. Moreover, displaying the first special effect animation or the second special effect animation can enhance the fun of the live broadcast and thus improve the viewing experience of the audience.

[0149] In some possible scenarios, the aforementioned second prompt information may include: missing prompt information or deviation prompt information. In this case, the embodiments of this application also provide a possible implementation method, see [link to relevant documentation]. Figure 3 If the target object in the virtual space is found not to have performed any sub-target action within the preset time period, a second prompt message is output, including:

[0150] Step 1301: If it is found that the target object has not performed any behavior within the preset time period, output the missing prompt message.

[0151] In this embodiment, the missing information can be used to indicate that the target object has not performed any action within the preset time period.

[0152] Optionally, the missing notification message can be in any possible form, such as special effects animation, text, or voice. Furthermore, the missing notification message can also be used by the broadcaster to create entertaining punitive feedback, enhancing audience engagement. This application's embodiments do not limit this aspect.

[0153] Step 1302: If it is found that the behavior performed by the target object within the preset time period does not belong to the target behavior, output the deviation prompt information.

[0154] In this embodiment, the deviation prompt information can be used to indicate that the behavior performed by the target object within the preset time period does not belong to the target behavior.

[0155] Optionally, the deviation notification can be in any possible form, such as special effects animation, text, or voice. Furthermore, the deviation notification can also be used by the broadcaster to create entertaining punitive feedback, enhancing viewer engagement. This application does not limit this aspect.

[0156] Generally, the deviation warning message and the missing message message are different.

[0157] For example, if the interaction event refers to a viewer sending a virtual gift that requires the user to say "I love you," then the target behavior corresponding to this interaction event can be determined to be: "saying 'I love you.'" If it is detected that the broadcaster has not uttered any voice within the preset time period, then a missing message can be output, for example, see [link to relevant documentation]. Figure 4 In (a), the missing prompt could be an animated effect of "tapping the host's head" or a text prompt asking "Why aren't you talking?". If it is detected that the host utters a voice message within the preset duration, but the content of this voice message is not "I love you" as indicated by the target behavior, then the deviation prompt can be output, for example, see [link to example]. Figure 4In (b), the missing message could be an animated effect of "covering the streamer's head with a clown emoji" or a text message saying "You misspoke!"

[0158] For example, if the virtual gift requires the user to perform a "headbutt" action, then the target behavior corresponding to this interaction event can be determined as: "perform the 'headbutt' action." If it is detected that the streamer has not performed any action within the preset time period, then a missing message can be output, for example, see [link to relevant documentation]. Figure 4 In (c), the missing prompt message could be an animation effect of "hitting the streamer's head with a brick" or a text message saying "Can't take this." If it is detected that the streamer performed an action within the preset time, but this action was not the "head-hitting" action indicated by the target behavior, then the deviation prompt message can be output, for example, see [link to example]. Figure 4 In (d), the missing prompt message can be a special effect animation of "covering the streamer's head with a clown expression" or a prompt text of "What are you doing?". This application embodiment does not limit this.

[0159] This approach not only outputs the second prompt even when the streamer fails to respond to the interactive event, serving as a punitive feedback to the streamer and enhancing the entertainment value and viewer engagement of the live stream, but also allows for the output of deviation or missing prompts based on the streamer's different reactions to the interactive event. This enables viewers to intuitively and clearly understand why the streamer did not respond to the interactive event. Consequently, it increases the diversity of the second prompt and improves the viewer's viewing experience.

[0160] In some possible scenarios, the aforementioned interactive event can also be an interactive behavior initiated by the second terminal device in the virtual space. In this case, the embodiments of this application also provide a possible implementation method, see [link to relevant documentation]. Figure 5 If a target object in the virtual space is detected to perform a first sub-target action within a preset time period, a first prompt message is output, including:

[0161] Step 1201: If it is found that the target object performs the first sub-target behavior within the preset time period, the first prompt information is output according to the target relationship between the first sub-target behavior and the interaction behavior.

[0162] In this embodiment, the interaction event may include an interactive behavior initiated by the second terminal device in the virtual space. This interactive behavior may refer to an action selected by the viewer when initiating the interaction event to interact with the viewer.

[0163] Optionally, the first prompt information is further used to indicate the target relationship between the first sub-target behavior and the interaction behavior. This target relationship includes an opposing relationship between the first sub-target behavior and the interaction behavior, a concatenation relationship between the first sub-target behavior and the interaction behavior, or any other possible relationship. The opposing relationship can refer to a win-lose relationship between the first sub-target behavior and the interaction behavior, and the concatenation relationship can refer to whether the first sub-target behavior and the interaction behavior can be concatenated into a new gesture or a new action. This application embodiment does not limit this aspect.

[0164] For example, suppose the interaction event refers to a viewer sending a virtual gift, and the virtual gift requires the streamer to make a "scissors," "rock," or "paper" gesture. Then it can be determined that the target behavior corresponding to this interaction event is: "making a 'scissors,' 'rock,' or 'paper' gesture," and the viewer's interaction behavior is "making a 'scissors' gesture." See, for example, [link to relevant documentation]. Figure 6 In (a), if the host makes a "stone" gesture within the preset time period, then the target relationship can be determined as "the first sub-target behavior wins the interaction behavior", that is, the host wins against the audience. At this time, the first prompt information indicating the host's victory can be output.

[0165] For example, see Figure 6 In (b), if the host makes a "paper" gesture within the preset time period, then it can be determined that the relationship is "the interaction behavior wins the first sub-target behavior", that is, the viewer wins against the host. At this time, the first prompt information can be output to indicate the viewer's victory.

[0166] For example, see Figure 6 In step (c), if the broadcaster is detected to have made a "scissors" gesture within the preset time period, then it can be determined that the relationship is "the interaction behavior and the first sub-target behavior are tied," that is, the viewer and the broadcaster are tied. At this time, a first prompt message indicating a tie can be output. This application embodiment does not limit this.

[0167] Additionally, for example, suppose the interaction event refers to a viewer sending a virtual gift, and the virtual gift requires the streamer to make a gesture that can be successfully combined with the interaction, and the viewer's interaction is a "thumb and forefinger gesture". Then it can be determined that the target behavior corresponding to the interaction event is: "making the 'thumb and forefinger gesture' and successfully combining it with the viewer's interaction". For example, see... Figure 7In step (a), if it is recognized that the broadcaster makes a "thumb and index finger" gesture within the preset time period, and the broadcaster's gesture is successfully combined with the viewer's interactive behavior to form a new gesture, then it can be determined that the target relationship is "the first sub-target behavior can be successfully combined with the interactive behavior," that is, the broadcaster has successfully responded to the interactive behavior and the interactive event. At this time, a first prompt message can be output to indicate that the broadcaster has responded to the interactive event. This application embodiment does not limit this.

[0168] It's worth noting that when the target audience (the broadcaster) responds to the interactive event within a preset timeframe, the target relationship between the broadcaster's first sub-target action and the interactive action can be determined. Then, based on this target relationship, different first prompt messages can be generated and output. This increases the flexibility of outputting the first prompt message. Furthermore, since the first prompt message is determined by the target relationship between the interactive action and the first sub-target action, it can accurately indicate how the broadcaster responded to the interactive action, thereby enhancing viewer engagement and viewing experience.

[0169] This application provides another possible implementation method, see [link to implementation details]. Figure 8 When the target relationship includes the opposition between the first sub-target behavior and the interaction behavior, the first prompt information is output based on the target relationship between the first sub-target behavior and the interaction behavior, including:

[0170] Step 1202: If the first sub-target behavior wins in the case of the opposition relationship, output the first prompt sub-information.

[0171] Optionally, the first prompt sub-information is used to indicate that the first sub-target behavior has won.

[0172] Step 1203: If the interaction behavior wins in the case of the opposition relationship, output the second prompt sub-information.

[0173] Optionally, the second prompt sub-information is used to indicate that the interaction has succeeded.

[0174] Step 1204: If the opposing relationship represents that the first sub-target behavior and the interaction behavior are equal, output the third prompt sub-information.

[0175] Optionally, the third prompt sub-information is used to indicate that the first sub-target behavior and the interaction behavior are equal.

[0176] As can be seen from the above, the first prompt information may include a first prompt sub-information, a second prompt sub-information, or a third prompt sub-information.

[0177] For example, see Figure 9 Suppose that the interaction event refers to a viewer sending a virtual gift, and the target behavior corresponding to this interaction event is "making a 'scissors,' 'rock,' or 'paper' gesture," and the viewer's interaction behavior is "making a 'scissors' gesture." For example, see... Figure 9 In (a), if the host makes a "stone" gesture within the preset time period, it can be determined that the behavior performed by the host matches at least one sub-target behavior in the target behavior. Then, it can be determined that the opposition relationship is "the first sub-target behavior wins the interaction behavior", that is, the host wins the audience. At this time, the first prompt sub-information can be output to indicate that the first sub-target behavior wins and the host wins.

[0178] For example, see Figure 9 In (b), if the host makes a "paper" gesture within the preset time period, it can be determined that the behavior performed by the host matches at least one sub-target behavior in the target behavior. Then, it can be determined that the opposition relationship is "the interactive behavior wins the first sub-target behavior", that is, the viewer wins against the host. At this time, a second prompt sub-information can be output to indicate that the interactive behavior wins and the viewer wins.

[0179] For example, see Figure 9 In step (c), if the anchor makes a "scissors" gesture within the preset time period, it can be determined that the behavior performed by the anchor matches at least one sub-target behavior in the target behavior. Then, it can be determined that the opposition relationship is "the interaction behavior and the first sub-target behavior are tied", that is, the viewer and the anchor are tied. At this time, a third prompt sub-information can be output to indicate that the first sub-target behavior and the interaction behavior are tied.

[0180] It is worth noting that when the broadcaster responds to the interactive event within the preset time, not only can a first prompt message be output to indicate that the broadcaster's behavior matches at least one of the target behaviors, that is, to indicate that the broadcaster has correctly responded to the interactive event, but also the opposition relationship between the broadcaster's response to the interactive event (that is, the first sub-target behavior performed by the broadcaster) and the interactive behavior can be determined, and then different sub-prompt messages can be generated and output according to the opposition relationship, such as the first prompt sub-message, the second prompt sub-message, or the third prompt sub-message.

[0181] This improves the flexibility of outputting the first prompt information. Moreover, since the first, second, or third prompt sub-information is determined by the opposition between the interactive behavior and the first sub-target behavior, the first, second, or third prompt sub-information can accurately indicate how the anchor responds to the interactive behavior, thereby enhancing the audience's sense of participation and viewing experience.

[0182] This application provides another possible implementation method, see [link to implementation details]. Figure 10 When the target relationship includes the concatenation relationship between the first sub-target behavior and the interaction behavior, the first prompt information is output according to the target relationship between the first sub-target behavior and the interaction behavior, including:

[0183] Step 1205: When the splicing relationship is that the first sub-target behavior and the interaction behavior are spliced ​​together to form a preset behavior, output the fourth prompt sub-information.

[0184] Optionally, the fourth prompt sub-information is used to indicate that the splicing relationship is the first sub-target behavior and the interaction behavior are successfully spliced ​​into the preset behavior.

[0185] In this embodiment, the preset behavior can be any possible behavior such as a gesture or action. Generally, the preset behavior corresponds to the interaction behavior. For example, if the interaction behavior is a gesture of "extending the thumb and index finger", then the preset behavior can refer to a new gesture formed by combining two identical gestures of "extending the thumb and index finger".

[0186] Step 1206: If the first sub-target behavior and the interaction behavior cannot be combined to form the preset behavior, output the fifth prompt sub-information.

[0187] Optionally, the fifth prompt sub-information is used to indicate that the splicing relationship between the first sub-target behavior and the interaction behavior cannot be spliced ​​into the preset behavior.

[0188] As can be seen from the above, the first prompt information may include a first prompt sub-information, a second prompt sub-information, or a third prompt sub-information.

[0189] For example, see [link to previous article] Figure 7Suppose that the interaction event refers to a viewer sending a virtual gift, and the target behavior corresponding to the interaction event is a "thumb and index finger gesture," and the viewer's interaction behavior is also a "thumb and index finger gesture." For example, if the broadcaster is identified to have made a "thumb and index finger gesture" within a preset time period, then it can be determined that the broadcaster's behavior matches at least one of the target behaviors. Then, it can be further determined whether the viewer's interaction behavior and the broadcaster's first sub-target behavior can be combined into a preset behavior by using the relative angle and / or relative position between the viewer's interaction behavior and the broadcaster's first sub-target behavior.

[0190] For example, see Figure 7 In (a), if the interaction behavior of "extending thumb and index finger gesture S" selected by the viewer matches the relative position and / or relative angle between the "extending thumb and index finger" gesture made by the anchor within the preset time, and the "extending thumb and index finger gesture S" selected by the viewer and the "extending thumb and index finger" gesture made by the anchor within the preset time form a new gesture that is approximately "heart-shaped", that is, the viewer's interaction behavior and the anchor's first sub-target behavior are successfully combined into the preset behavior, then a fourth prompt sub-information can be output to indicate that the combination relationship is that the first sub-target behavior and the interaction behavior are successfully combined into the preset behavior.

[0191] For example, see Figure 7 In (b), if the interaction behavior of "extending thumb and index finger gesture S" selected by the viewer matches the relative position and / or relative angle between the "extending thumb and index finger" gesture made by the anchor within the preset time, and the "extending thumb and index finger gesture S" selected by the viewer and the "extending thumb and index finger" gesture made by the anchor within the preset time are combined to form a new gesture that is approximately "elliptical", that is, the viewer's interaction behavior and the anchor's first sub-target behavior are successfully combined into the preset behavior, then a fourth prompt sub-information can be output to indicate that the combination relationship is that the first sub-target behavior and the interaction behavior are successfully combined into the preset behavior.

[0192] For example, see Figure 7In (c), if the relative position and / or relative angle between the interactive behavior of "extending thumb and index finger" selected by the viewer and the "extending thumb and index finger" gesture made by the anchor within the preset time period do not match, and cannot be spliced ​​into a new gesture that is approximately "elliptical" or "heart-shaped", that is, the viewer's interactive behavior and the anchor's first sub-target behavior cannot be spliced ​​into the preset behavior, then a fifth prompt sub-information can be output to indicate that the splicing relationship is that the first sub-target behavior and the interactive behavior cannot be spliced ​​into the preset behavior.

[0193] Based on the above examples, the preset behavior could include a new gesture that approximates a "heart" shape and a new gesture that approximates an "ellipse."

[0194] In this scenario, the connection is considered successful as long as the first sub-target action performed by the streamer can be combined with the interactive action. The preset action can also include a new gesture resembling a heart shape or an oval shape. In this case, the connection is considered successful only if the first sub-target action performed by the streamer is combined with the interactive action to form a new action identical to the preset action. This allows for adjustments to the preset action to change the difficulty of the connection for the user, offering more diverse possibilities and thus enhancing the entertainment value of the live stream.

[0195] It is worth noting that, when the broadcaster responds to the interactive event within the preset time, not only can a first prompt message be output to instruct the broadcaster to perform an action that matches at least one of the target actions—that is, to instruct the broadcaster to correctly respond to the interactive event—but also the broadcaster's response to the interactive event can be determined (i.e., the broadcaster performed an action that matches at least one of the target actions).

[0196] The first sub-target behavior of the line is concatenated with the interaction behavior, and then different sub-prompt information is generated and output according to the concatenation relationship, such as the fourth prompt sub-information or the fifth prompt sub-information.

[0197] This improves the flexibility of outputting the first prompt information. Furthermore, since the fourth or fifth prompt sub-information is determined by the splicing relationship between the interactive behavior and the first sub-target behavior, the fourth or fifth prompt sub-information can accurately indicate how the anchor responds to the interactive behavior, thereby enhancing the audience's sense of participation and viewing experience.

[0198] This application provides another possible implementation method, see [link to implementation details]. Figure 11 If a target object in the virtual space is detected to perform a first sub-target action within a preset time period, a first prompt message is output. The method further includes:

[0199] Step 1207: If it is found that the target object performs the first sub-target behavior within the preset time period, output the sixth prompt sub-information, and output the seventh prompt sub-information according to the target relationship between the first sub-target behavior and the interaction behavior.

[0200] Optionally, the first prompt information may include a sixth prompt sub-information and a seventh prompt sub-information. For example, the sixth prompt sub-information is used to indicate that the behavior performed by the target object matches any one of the sub-target behaviors, and the seventh prompt sub-information is used to indicate the target relationship between the first sub-target behavior and the interaction behavior.

[0201] Generally, the sixth prompt sub-information can be output first, followed by the seventh prompt sub-information; or the seventh prompt sub-information can be output first, followed by the sixth prompt sub-information; or the sixth and seventh prompt sub-information can be output simultaneously. This application embodiment does not limit this.

[0202] For example, see [link to previous article] Figure 9 Suppose that the interaction event refers to a viewer sending a virtual gift, and the target behavior corresponding to this interaction event is "making a 'scissors,' 'rock,' or 'paper' gesture," and the viewer's interaction behavior is "making a 'scissors' gesture." For example, see... Figure 9 In step (a), if the broadcaster makes a "stone" gesture within the preset time period, it can be determined that the broadcaster's behavior matches at least one sub-target behavior in the target behavior. Then, a "smiley face" special effect animation can be displayed to output the sixth prompt sub-information. In addition, it can be determined that the opposition relationship is "the first sub-target behavior wins the interaction behavior", that is, the broadcaster wins the audience. At this time, a seventh prompt sub-information can be output to indicate that the first sub-target behavior has won and the broadcaster has won.

[0203] For example, see Figure 9 In (b), if the broadcaster makes a "paper" gesture within the preset time period, it can be determined that the broadcaster's behavior matches at least one sub-target behavior in the target behavior. Then, a "smiley face" special effect animation can be displayed to output the sixth prompt sub-information. In addition, it can be determined that the opposition relationship is "the interactive behavior wins the first sub-target behavior", that is, the viewer wins against the broadcaster. At this time, a seventh prompt sub-information can be output to indicate that the interactive behavior has won and the viewer has won.

[0204] For example, see Figure 9In step (c), if the broadcaster makes a "scissors" gesture within the preset time period, it can be determined that the broadcaster's behavior matches at least one sub-target behavior in the target behavior. Then, a "smiley face" special effect animation can be displayed to output the sixth prompt sub-information. In addition, it can be determined that the opposition relationship is "the interactive behavior and the first sub-target behavior are tied", that is, the viewer and the broadcaster are tied. At this time, a seventh prompt sub-information can be output to indicate that the first sub-target behavior and the interactive behavior are tied.

[0205] In addition, the seventh prompt sub-information can also be used to indicate the relationship corresponding to the above splicing relationship. Adaptive adjustments can be made by referring to the description of the above embodiments, and this application embodiment does not limit this.

[0206] It is worth noting that when the broadcaster responds to the interactive event within the preset time, not only can a sixth prompt sub-information be output, indicating that the broadcaster's action matches at least one of the target actions, but also the relationship between the user's response to the interactive event and the target action of the interactive behavior can be determined. Then, different seventh prompt sub-informations are generated and output based on this target relationship. The sixth and seventh prompt sub-informations together constitute the first prompt information.

[0207] This improves the flexibility of outputting the first prompt information. Moreover, since the seventh prompt sub-information in the first prompt information is determined by the target relationship between the interactive behavior and the first sub-target behavior, the first prompt information can accurately indicate how the anchor responds to the interactive behavior, thereby improving the audience's sense of participation and viewing experience.

[0208] In one possible implementation, see [link to relevant documentation]. Figure 12 After receiving an interaction event initiated by the second account in the virtual space of the first account, the method further includes:

[0209] Step 1401: Display the virtual object.

[0210] Optionally, the virtual object corresponds to the interactive event. Generally, the virtual object can be displayed in the virtual space or the live broadcast screen.

[0211] In this embodiment, the virtual object is used to prompt the target object that it needs to respond to the interaction event, or to guide the target object to perform any one of the sub-target behaviors in the target behavior.

[0212] For example, see Figure 13Suppose that the interactive event refers to a viewer sending a virtual gift, and the virtual gift requires the user to make a "head-banging" action, then the virtual object corresponding to the interactive event can be a "virtual brick". In that case, a brick-shaped virtual object can be displayed in the virtual space or the live broadcast.

[0213] Alternatively, the virtual object can be any possible special effects animation or text. Displaying this virtual object can then serve as a notification to the broadcaster that the interactive event has been received, such as notifying the broadcaster that a gift has been received from a viewer, thus prompting the broadcaster to respond to the interactive event. This application does not limit this aspect.

[0214] Understandably, step 1401 can generally be executed after step 110. Since the virtual object usually corresponds to the interactive event, displaying the virtual object allows the broadcaster to understand that the second terminal device has initiated an interactive event in the virtual space of the first terminal device, thus achieving the purpose of prompting the target object to respond to the interactive event. Furthermore, the virtual object can also guide the target object to respond to the interactive event by executing any sub-target behavior within the target behavior through special effects animations or text.

[0215] Additionally, see also Figure 13 When the virtual object is used to guide the target object to perform any one of the sub-target behaviors of the target behavior, the method may further include:

[0216] Step 1402: Adjust the display parameters of the virtual object according to the behavior of the first sub-target.

[0217] In this embodiment, the display parameters of the virtual object may include any possible parameters such as appearance, color, content, and position. This application does not limit these parameters.

[0218] For example, the display parameters of the virtual object can be adjusted based on the number of times the broadcaster performs the first sub-target behavior within the preset duration.

[0219] For example, if the target behavior corresponding to the interaction event is "to perform the action of 'headbutting a virtual object'", then, if the anchor performs this first sub-target behavior for the first time, then continue to see Figure 13 In (a), a crack can be displayed on the "virtual brick"; if the anchor performs the first sub-target action a second time, see [link to relevant documentation]. Figure 13 In (b), multiple cracks can be displayed on the "virtual brick"; if the anchor performs the first sub-target action for the third time, continue to see Figure 10 (4) in the middle can show that the "virtual brick" is completely broken.

[0220] Furthermore, the display parameters of the virtual object can be adjusted based on parameters such as the direction in which the broadcaster performs the first sub-target action within the preset duration. For example, if the virtual object is originally displayed directly above the broadcaster's head, and the target action corresponding to the interactive event is "to perform the action of 'headbutting the virtual object'," then if the direction in which the broadcaster performs the first sub-target action is "from the lower right corner to the upper left corner," then when adjusting the virtual object according to the first sub-target action, the virtual object can be displayed in the upper left corner above the broadcaster's head. This application embodiment does not limit this.

[0221] It is worth noting that in this embodiment, the display parameters of the virtual object can be adjusted according to the user's actual behavior within the preset time period. In this way, the live broadcast can be made more interesting when the audience sends the interactive event, thereby improving the audience's sense of participation and viewing experience.

[0222] It should be noted that the explanation and description of any feature mentioned in this embodiment, or any feature identical to that in the foregoing embodiments, can be found in the descriptions of any other embodiments mentioned above, and will not be repeated here. In this embodiment, steps 1401 and 1402 can be executed before or after any other steps, or simultaneously with any other steps. For example, generally, step 1401 can be executed after step 110, and step 1402 can be executed after step 120; or step 1402 can be executed simultaneously with step 120. In practical applications, adjustments can be made according to actual needs, and this application embodiment does not limit this.

[0223] In one possible implementation, see [link to relevant documentation]. Figure 14 After receiving the interaction event, the method also includes:

[0224] Step 150: Output the target behavior prompt information corresponding to the interaction event.

[0225] Optionally, the target behavior includes one or more target behaviors.

[0226] In this embodiment, the target behavior prompt information can be used to prompt the target object to perform the target behavior, or to prompt the target behavior corresponding to the interaction event, or to prompt the preset duration, so as to help the broadcaster make a quick response. In addition, the target behavior prompt information can also be used to prompt any other possible information, which is not limited in this embodiment.

[0227] For example, suppose the interactive event refers to a viewer sending the virtual gift, and the target behavior corresponding to the interactive event is: "making a 'scissors,' 'rock,' or 'paper' gesture," and the preset duration is 5 seconds. See Figure 15 Then, the text content "Please make the gesture of 'scissors,' 'rock,' or 'paper' within 5 seconds to complete the feedback of the current interactive event" can be displayed at any location in the virtual space or the live broadcast screen.

[0228] Furthermore, see continue. Figure 6 , Figure 8 , Figure 12 As can be seen, the text "playing rock-paper-scissors" can also be displayed at any location in the virtual space or the live broadcast screen to instruct the broadcaster to perform gestures related to "rock-paper-scissors".

[0229] Alternatively, the target behavior prompt information can be output in any possible form such as images or sounds, and this application embodiment does not limit this.

[0230] It is worth noting that by outputting the target behavior prompt information corresponding to the interactive event, the broadcaster can be reminded to perform any one of the target behaviors within a preset time period when the audience sends the interactive event, thus providing timely and effective feedback to the interactive event. In this way, effective interactive assistance can be provided to the broadcaster.

[0231] In one possible implementation, see [link to relevant documentation]. Figure 16 The method also includes:

[0232] Step 1601: If it is found that the target object performs the first sub-target behavior within the preset time period, and / or if the target relationship between the first sub-target behavior and the interaction behavior meets the preset conditions, virtual resources are allocated to the first terminal device.

[0233] Optionally, the virtual resource can refer to any possible resource such as traffic allocated to the virtual space corresponding to the first terminal device, the live broadcast evaluation score corresponding to the first terminal device, and / or the virtual digital resources corresponding to the first terminal device. That is, the virtual resource includes at least one of the following: virtual gifts, virtual points, virtual digital resources allocated to the first terminal device, and traffic allocated to the virtual space.

[0234] In this embodiment, the interaction event includes the interaction behavior initiated by the second terminal device in the virtual space.

[0235] In this embodiment, the preset condition can be set by relevant technical personnel according to actual needs. For example, the preset condition can be "the first sub-target behavior wins over the interactive behavior, that is, the anchor wins over the audience"; the preset condition can also be "the first sub-target behavior wins over the interactive behavior, or the interactive behavior and the first sub-target behavior are tied". This application embodiment does not limit this.

[0236] In this context, allocating virtual resources to the first account corresponding to the first terminal device could mean increasing the bandwidth allocated to the virtual space corresponding to the first terminal device, increasing the amount of virtual gifts and / or virtual points and / or virtual digital resources allocated to the first terminal device, etc. This application embodiment does not limit this. In this way, by rewarding the streamer's positive feedback, user participation is increased.

[0237] It's worth noting that this allows for increased virtual resources allocated to the first account when the target object performs the first sub-target action within the preset timeframe (i.e., the broadcaster responds to the interactive event), and / or when the target relationship between the first sub-target action and the interactive action meets preset conditions. This incentivizes and guides the broadcaster to respond more actively to the interactive event. Furthermore, more active feedback from the broadcaster can enhance the viewer's experience.

[0238] It should be noted that the explanation and description of any feature mentioned in this embodiment can refer to the description in any of the other embodiments described above, and will not be repeated here. In this embodiment, step 1601 can also be executed before or after any other step, or it can be executed simultaneously with any other step. For example, generally, step 1601 can be executed after step 120; or step 1601 can also be executed simultaneously with step 120. In practical applications, adjustments can be made according to actual needs, and this application embodiment does not limit this.

[0239] In one possible implementation, see [link to relevant documentation]. Figure 17 If the target behavior includes multiple different sub-target behaviors, and it is identified that the target object has performed multiple sub-target behaviors within the preset time period, the method further includes:

[0240] Step 1701: The first sub-target behavior executed by the target object within the preset time period is taken as the first sub-target behavior.

[0241] Optionally, the first sub-target behavior executed by the target object within the preset time period may refer to the first behavior among multiple behaviors executed by the target object within the preset time period that matches the target behavior.

[0242] For example, suppose the target behavior corresponding to the interaction event is: "making a 'scissors,' 'rock,' or 'paper' gesture." If the broadcaster sequentially performs the "smile," "scissors," and "rock" gestures within the preset time period, then since the "smile" gesture does not match the target behavior, while the "scissors" and "rock" gestures do match, and the broadcaster performs the "scissors" gesture first, then the "scissors" gesture can be considered the first sub-target behavior.

[0243] In this way, a target behavior can be accurately selected as the first sub-target behavior, which can avoid the problem that multiple first sub-target behaviors cannot be determined because the user may have performed multiple target behaviors within the preset time, thus causing subsequent steps to fail to execute correctly.

[0244] Alternatively, when the target behavior includes multiple different sub-target behaviors, and it is identified that the target object has performed multiple sub-target behaviors within the preset time period, the method further includes:

[0245] Step 1702: The sub-target behavior that the target object maintains for the longest time within the preset duration is taken as the first sub-target behavior.

[0246] Optionally, the sub-target behavior that the target object maintains for the longest time within the preset duration can refer to the behavior with the longest duration among multiple sub-target behaviors that the target object performs within the preset duration and match the target behavior.

[0247] For example, suppose the target behavior corresponding to the interaction event is: "making a 'scissors,' 'rock,' or 'paper' gesture." If the broadcaster sequentially performs the following three behaviors within the preset time: a "smile" gesture for 1 second, a "scissors" gesture for 2 seconds, and a "rock" gesture for 3 seconds, then since the "smile" gesture does not match the target behavior, while the "scissors" and "rock" gestures do match the target behavior, and the broadcaster holds the "rock" gesture for the longest time, then the "rock" gesture can be taken as the first sub-target behavior.

[0248] In this way, a sub-target behavior can be accurately selected as the first sub-target behavior, which can avoid the problem that the user may have executed multiple sub-target behaviors in the target behavior within the preset time, making it impossible to determine the accurate first sub-target behavior and causing subsequent steps to fail to execute correctly.

[0249] In one possible implementation, after receiving the interaction information, the method further includes:

[0250] Display audio playback controls.

[0251] In response to a trigger operation on the audio playback control, play the audio corresponding to the audio playback control.

[0252] Optionally, the audio playback control can be a triggerable control for adjusting the background music played in the virtual space.

[0253] Optionally, the triggering operation can be any possible operation such as a click operation, a long press operation, or a swipe operation, and this application embodiment does not limit this.

[0254] The audio corresponding to the audio playback control can be set by the broadcaster, or it can be the audio corresponding to the interactive event. This application does not limit this specific choice.

[0255] For example, if the interactive event refers to a viewer sending a virtual gift, and the virtual gift requires the streamer to perform an action of "headbutting a virtual object," then the virtual object corresponding to this interactive event could be a "virtual brick." In this case, the audio playback control can be displayed in the virtual space or the live stream. See also... Figure 18 The audio playback control displays "Click to play the background music of 'ABC'". After the broadcaster clicks the audio playback control, the background music playing in the virtual space can be changed to "ABC".

[0256] See also Figure 18 While displaying the audio playback control, the system can also display text at any location in the virtual space or the live stream, stating, "Received a 'virtual brick' interactive gift from viewer A. Please perform the action of 'headbutting' within 5 seconds to complete the feedback of the current interactive event." This application embodiment does not limit this aspect.

[0257] In this way, when the audience sends the interactive event, the audio playback control can be displayed, allowing the host to choose whether to play the audio corresponding to the audio playback control. This can increase the interactive atmosphere at the sound level, thereby improving the audience's sense of participation and viewing experience.

[0258] In one possible implementation, the method further includes:

[0259] The live stream data corresponding to the virtual space and the first prompt information are sent to the aforementioned server, or the live stream data corresponding to the virtual space and the second prompt information are sent to the server.

[0260] In this way, by pushing live video streams, viewers can see the streamer's performance, the first prompt, and / or the second prompt.

[0261] The following is an example illustrating how the live streaming interaction method provided in this application identifies whether the streamer has performed the first sub-target behavior within the preset duration.

[0262] In one possible implementation, see [link to relevant documentation]. Figure 19 After receiving an interaction event initiated by the second account in the virtual space of the first account, the method further includes:

[0263] Step 180: Based on the target behavior corresponding to the interaction event and the behavior performed by the target object within the preset time period, identify whether the target object performed the first sub-target behavior within the preset time period.

[0264] In the first possible scenario, if the target behavior corresponding to the interaction event is "to speak the corresponding voice", step 180 may include:

[0265] Determine the preset voice corresponding to this interaction event.

[0266] Optionally, the preset voice can indicate the voice content that the target object needs to say when correctly responding to the interactive event. For example, the voice content indicated by the preset voice can be "I love you" as exemplified in the above embodiments. This application embodiment does not limit this.

[0267] If the first voice matches the preset voice, it is determined that the target object has performed the first sub-target behavior within the preset time period.

[0268] Optionally, the first speech is the speech actually emitted by the target object within the preset duration. For example, the first speech can be matched with the preset speech by invoking the aforementioned speech recognition algorithm; for instance, the phonemes of the first speech and the preset speech can be compared sequentially. This application does not limit this approach.

[0269] If the target object does not emit a voice within the preset time period, or if the first voice does not match the preset voice, it is determined that the target object has not performed the target behavior within the preset time period.

[0270] For example, if the target object does not utter any speech within the preset time period, it can be determined that the target object has not performed any action within the preset time period, and thus the aforementioned missing prompt information is output. If the first speech does not match the preset speech, it can be determined that the action performed by the target object within the preset time period does not belong to the target action, and thus the aforementioned deviation prompt information is output.

[0271] In the second possible scenario, if the target behavior corresponding to the interaction event is "to perform the corresponding action", step 180 may include:

[0272] Determine the preset action corresponding to the target behavior.

[0273] Optionally, the preset action can indicate the action that the target object needs to perform when correctly responding to the interactive event. For example, the preset action can be the "head-banging" action, the "scissors" gesture, the "rock" gesture, or the "paper" gesture, as exemplified in the above embodiments. This application does not limit this aspect.

[0274] If the first action matches the preset action, it is determined that the target object has performed the first sub-target behavior within the preset time period.

[0275] Optionally, the first action is an action performed by the target object within the preset time period. For example, the first action can be matched against the preset action by invoking the aforementioned action recognition algorithm and / or the gesture recognition algorithm. This application does not limit this aspect.

[0276] If the target object does not perform any action within the preset time period, or if the first action does not match the preset action, it is determined that the target object has not performed the target behavior within the preset time period.

[0277] For example, if the target object does not perform any action within the preset time period, it can be determined that the target object has not performed any behavior within the preset time period, and thus the aforementioned missing prompt information is output. If the first action does not match the preset action, it can be determined that the behavior performed by the target object within the preset time period does not belong to the target behavior, and thus the aforementioned deviation prompt information is output.

[0278] In the third possible scenario, if the target behavior corresponding to the interaction event is "to perform the corresponding action", step 180 may include:

[0279] Determine the preset voice and preset action corresponding to the target behavior.

[0280] If the first action matches the preset action and the first voice matches the preset voice, then it is determined that the target object has been identified and the first sub-target action has been performed within the preset time period.

[0281] For example, the first speech can be matched with the preset speech by calling the aforementioned speech recognition algorithm, and the first action can be matched with the preset action by calling the aforementioned action recognition algorithm and / or the gesture recognition algorithm. This application does not limit this aspect.

[0282] If the target object does not perform any action within the preset time period, the first action does not match the preset action, the target object does not emit any voice within the preset time period, and / or the first voice does not match the preset voice, then it is determined that the target object has not performed the target behavior within the preset time period.

[0283] For example, if the target object does not utter a voice or perform an action within the preset time period, it can be determined that the target object has not performed any behavior within the preset time period, and thus the aforementioned missing prompt information is output. If the first voice does not match the preset voice, and / or the first action does not match the preset action, it can be determined that the behavior performed by the target object within the preset time period does not belong to the target behavior, and thus the aforementioned deviation prompt information is output.

[0284] It should be understood that the above three scenarios are merely examples provided in the embodiments of this application, and do not mean that the embodiments of this application can only identify whether the target object has performed the first sub-target behavior within the preset time period in the manner described above. In practical applications, any possible method can be used to identify whether the target object has performed the first sub-target behavior within the preset time period, and the embodiments of this application do not limit this.

[0285] Figure 20 This is a flowchart illustrating a live streaming interaction method provided in this application. This method can be applied to the aforementioned second terminal device C, which may include any control unit and / or processor with processing, control, recognition, and calculation functions. See also... Figure 20 This application provides a live streaming interaction method, which includes:

[0286] Step 210: In response to the first trigger operation on the second terminal device, send interactive information.

[0287] The interactive information is used to indicate the interactive event initiated by the second terminal device in the virtual space of the first terminal device. The first terminal device has control over the virtual space. The first terminal device is used to initiate live streaming, and the second terminal device is used to watch live streaming. The virtual space is a virtual live streaming room created by the first terminal device.

[0288] In this embodiment, the first triggering operation can be an operation performed by the user corresponding to the second terminal device to control the second terminal device. For example, the first triggering operation can be any possible operation such as a click operation, a swipe operation, or a voice control operation, and this embodiment of the application does not limit this.

[0289] Step 220: Receive and output the live video data output by the first terminal device.

[0290] In this embodiment, the live video data includes at least a first prompt message or a second prompt message. The first prompt message is used to indicate that the target object in the virtual space has responded to the interaction event, and the second prompt message is used to indicate that the target object has not responded to the interaction event.

[0291] In one possible implementation, in response to a first trigger operation on the second terminal device, interactive information is sent, including:

[0292] In response to the first triggering operation, the target behavior corresponding to the first triggering operation is obtained.

[0293] Send this interactive message.

[0294] Optionally, the interaction information is used to indicate the target behavior corresponding to the interaction event.

[0295] It's worth noting that in this scenario, the user (viewer) of the second terminal device can select or specify the target behavior through the first trigger operation. The user then needs to execute the first sub-target behavior corresponding to the target behavior specified by the viewer to correctly respond to the interactive event. Therefore, the target behavior can be specified, selected, or modified by the viewer, which enhances viewer engagement and viewing experience.

[0296] In one possible implementation, the method further includes:

[0297] Send control commands to the first terminal device.

[0298] Optionally, the control instruction is used to enable the first terminal device to identify whether the target object in the virtual space performs a first sub-target behavior within a preset time period, wherein the first sub-target behavior is any one of the target behaviors corresponding to the interaction event.

[0299] Furthermore, the control command can be automatically generated by the second terminal device under certain conditions, or it can be generated by a corresponding trigger operation performed on the second terminal device. This application does not limit this aspect.

[0300] It is worth noting that, in this embodiment, the operation of the first terminal device identifying whether the target object in the virtual space performs the first sub-target behavior within a preset time period refers to identifying whether the target object has responded to the interactive event. Therefore, the second terminal device can send control commands to the first terminal device to trigger the first terminal device to identify whether the target object has responded to the interactive event. This enhances the viewer's sense of participation and viewing experience.

[0301] In one possible implementation, the live video data may further include virtual objects displayed on the display interface of the second terminal device. In this case, the method further includes:

[0302] In response to a second triggering operation on the virtual object, adjust the position and / or size of the virtual object.

[0303] Optionally, the second trigger operation can be an operation performed by the user corresponding to the second terminal device to control the second terminal device. For example, the second trigger operation can be any possible operation such as a click operation, a swipe operation, or a voice control operation, and this application embodiment does not limit this.

[0304] As can be seen, in this embodiment, the user corresponding to the second terminal device can control the virtual object displayed on the second terminal device through the second trigger operation. Furthermore, after adjusting the position and / or size of the virtual object in response to the second trigger operation, the adjusted parameters of the virtual object can be sent to the first terminal device, enabling the first terminal device to display the virtual object according to the adjusted parameters. Thus, when the virtual object can be used to guide the target object to perform any sub-target behavior within the target behavior, the viewer can change the position of the virtual object so that the broadcaster needs to perform different first sub-target behaviors to correctly respond to the interactive event.

[0305] In this way, it is possible to respond to or thank viewers for their exchanges in various ways, thereby providing effective interactive assistance during the live stream and improving the viewer's experience.

[0306] It should be understood that, since the live streaming interaction method applied to the second terminal device C and the live streaming interaction method applied to the first terminal device A belong to the same inventive concept, the live streaming interaction method applied to the second terminal device C can also include any other possible steps to achieve any possible function and effect. The live streaming interaction method applied to the second terminal device C is used in conjunction with the live streaming interaction method applied to the first terminal device A to achieve the corresponding function. Their implementation principles and technical effects are similar, and will not be elaborated further here.

[0307] It should be understood that although the steps in the above flowcharts are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the above flowcharts may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the sub-steps or stages of other steps.

[0308] Based on the foregoing embodiments, this application provides a live interactive device, which includes various modules and units included in each module, and can be implemented by a processor; of course, it can also be implemented by specific logic circuits; in the implementation process, the processor can be a central processing unit (CPU), microprocessor (MPU), digital signal processor (DSP) or field programmable gate array (FPGA), etc.

[0309] Figure 21 This is a schematic diagram of the structure of a live interactive device provided in an embodiment of this application. See also... Figure 21 Applied to the aforementioned first terminal device A, the device includes:

[0310] The receiving module 301 is used to receive interactive information, wherein the interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device, the first terminal device has control over the virtual space, the first terminal device is a device used to initiate live streaming, the second terminal device is a device used to watch live streaming, and the virtual space is a virtual live streaming room created by the first terminal device.

[0311] The recognition output module 302 is used to output a first prompt message when it is recognized that the target object in the virtual space performs a first sub-target behavior within a preset time period. The first prompt message is used to prompt that the target object in the virtual space has responded to the interaction event. The first sub-target behavior is any one of the sub-target behaviors among the target behaviors corresponding to the interaction event.

[0312] The recognition output module 302 is also used to output a second prompt message when the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period. The second prompt message is used to prompt the target object that it has not responded to the interaction event.

[0313] Figure 22This is a schematic diagram of the structure of a live interactive device provided in an embodiment of this application. See also... Figure 22 The device is applied to the aforementioned second terminal device C, and includes:

[0314] The sending module 401 is used to receive interactive information, wherein the interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device, the first terminal device has control over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device.

[0315] The execution module 402 is used to output a first prompt message when it is detected that the target object in the virtual space performs a first sub-target behavior within a preset time period. The first prompt message is used to prompt that the target object in the virtual space has responded to the interaction event. The first sub-target behavior is any one of the sub-target behaviors among the target behaviors corresponding to the interaction event.

[0316] The execution module 402 is further configured to output a second prompt message when it is detected that the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period. The second prompt message is used to prompt the target object that it has not responded to the interaction event.

[0317] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0318] It should be noted that, in the embodiments of this application... Figure 17 The module division of the live interactive device shown is illustrative and represents only one logical functional division; in actual implementation, other division methods may be used. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, exist as separate physical units, or be integrated into one unit with two or more units. The integrated units can be implemented in hardware, as software functional units, or a combination of both.

[0319] It should be noted that, in the embodiments of this application, if the above-described methods are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially or in other words, the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.

[0320] This application provides an electronic device, which may be the first terminal device described above. The electronic device includes a processor, a memory, and a network interface connected via a system bus. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The database stores data. The network interface communicates with external terminals via a network connection. When the computer program is executed by the processor, it implements the aforementioned method.

[0321] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the method provided in the above embodiments.

[0322] This application provides a computer program product containing instructions that, when run on a computer, cause the computer to perform the steps in the method provided in the above-described method embodiments.

[0323] Those skilled in the art will understand that the structure of the above-described electronic device is merely a block diagram of a portion of the structure related to the solution of this application, and does not constitute a limitation on the electronic device to which the solution of this application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have different component arrangements.

[0324] In one embodiment, the live interactive device provided in this application can be implemented as a computer program, which can run on the aforementioned electronic device. The memory of the electronic device can store the various program modules that make up the device. The computer program, composed of the various program modules, causes the processor to execute the steps of the methods in the various embodiments of this application described in this specification.

[0325] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium, storage medium, and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.

[0326] It should be understood that the phrases "one embodiment," "an embodiment," or "some embodiments" mentioned throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment," "in one embodiment," or "in some embodiments" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The descriptions of the various embodiments above tend to emphasize the differences between the various embodiments; their similarities or commonalities can be referred to mutually, and for the sake of brevity, they will not be repeated here.

[0327] In this article, the term "and / or" is merely a description of the relationship between related objects, indicating that there can be three kinds of relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist simultaneously, and object B exists alone.

[0328] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0329] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The embodiments described above are merely illustrative. For example, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple modules or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or modules can be electrical, mechanical, or other forms.

[0330] The modules described above as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules. They may be located in one place or distributed across multiple network units. Some or all of the modules may be selected to achieve the purpose of this embodiment according to actual needs.

[0331] In addition, each functional module in the various embodiments of this application can be integrated into one processing unit, or each module can be a separate unit, or two or more modules can be integrated into one unit; the integrated modules can be implemented in hardware or in the form of hardware plus software functional units.

[0332] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.

[0333] Alternatively, if the integrated units described above are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0334] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0335] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0336] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.

[0337] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0338] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A live streaming interaction method, characterized in that, Applied to a first terminal device, the method includes: Receive interactive information, wherein the interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device, the first terminal device has control over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device; When it is detected that a target object in the virtual space performs a first sub-target behavior within a preset time period, a first prompt message is output. The first prompt message is used to prompt that the target object in the virtual space has responded to the interaction event. The first sub-target behavior is any one of the sub-target behaviors among the target behaviors corresponding to the interaction event. If it is detected that the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period, a second prompt message is output. The second prompt message is used to prompt the target object that it has not responded to the interaction event.

2. The live streaming interaction method as described in claim 1, characterized in that, The second prompt information includes: missing prompt information or deviation prompt information; If, upon detecting that a target object in the virtual space has not performed any of the sub-target behaviors within the preset time period, a second prompt message is output, including: If it is detected that the target object has not performed any behavior within the preset time period, the missing prompt information is output, which is used to prompt that the target object has not performed any behavior within the preset time period; If it is detected that the behavior performed by the target object within the preset time period does not belong to the target behavior, the deviation prompt information is output. The deviation prompt information is used to prompt that the behavior performed by the target object within the preset time period does not belong to the target behavior.

3. The live streaming interaction method as described in claim 1, characterized in that, The interactive events include interactive behaviors initiated by the second terminal device in the virtual space; If a target object in the virtual space is detected to perform a first sub-target action within a preset time period, a first prompt message is output, including: When it is detected that the target object performs the first sub-target behavior within the preset time period, the first prompt information is output according to the target relationship between the first sub-target behavior and the interaction behavior. The first prompt information is used to prompt the target relationship between the first sub-target behavior and the interaction behavior. The target relationship includes the opposition relationship between the first sub-target behavior and the interaction behavior, or the splicing relationship between the first sub-target behavior and the interaction behavior.

4. The live streaming interaction method as described in claim 3, characterized in that, The target relationship includes the opposition between the first sub-target behavior and the interaction behavior, and the first prompt information includes a first prompt sub-information, a second prompt sub-information, or a third prompt sub-information; The step of outputting the first prompt information based on the target relationship between the first sub-target behavior and the interaction behavior includes: When the opposing relationship characterizes the first sub-target behavior as winning, the first prompt sub-information is output, which is used to prompt the first sub-target behavior as winning; When the interaction behavior wins due to the opposition relationship, the second prompt sub-information is output, which is used to indicate that the interaction behavior has won. When the opposing relationship characterizes the first sub-target behavior and the interaction behavior as equal, the third prompt sub-information is output, which is used to indicate that the first sub-target behavior and the interaction behavior are equal.

5. The live streaming interaction method as described in claim 3, characterized in that, The target relationship includes the concatenation relationship between the first sub-target behavior and the interaction behavior; the first prompt information includes a fourth prompt sub-information or a fifth prompt sub-information; and the step of outputting the first prompt information based on the target relationship between the first sub-target behavior and the interaction behavior includes: When the splicing relationship is that the first sub-target behavior and the interaction behavior are spliced ​​into a preset behavior, the fourth prompt sub-information is output. The fourth prompt sub-information is used to indicate that the splicing relationship is that the first sub-target behavior and the interaction behavior are successfully spliced ​​into the preset behavior. If the splicing relationship is such that the first sub-target behavior and the interaction behavior cannot be spliced ​​into the preset behavior, the fifth prompt sub-information is output. The fifth prompt sub-information is used to indicate that the splicing relationship is such that the first sub-target behavior and the interaction behavior cannot be spliced ​​into the preset behavior.

6. The live streaming interaction method as described in claim 1, characterized in that, The interactive event includes the interactive behavior initiated by the second terminal device in the virtual space; the first prompt information includes a sixth prompt sub-information and a seventh prompt sub-information, the sixth prompt sub-information is used to prompt that the behavior performed by the target object matches any one of the sub-target behaviors, and the seventh prompt sub-information is used to prompt the target relationship between the first sub-target behavior and the interactive behavior; When a target object in the virtual space is detected to perform a first sub-target action within a preset time period, a first prompt message is output, including: If the target object is found to perform the first sub-target behavior within the preset time period, the sixth prompt sub-information is output, and the seventh prompt sub-information is output according to the target relationship between the first sub-target behavior and the interaction behavior.

7. The live streaming interaction method as described in claim 1, characterized in that, The method further includes: Display a virtual object, which is used to prompt the target object that it needs to respond to the interaction event, or to guide the target object to perform any one of the sub-target behaviors in the target behavior.

8. The live streaming interaction method as described in claim 7, characterized in that, The virtual object is used to guide the target object to execute any one of the sub-target behaviors in the target behavior, and the method further includes: The display parameters of the virtual object are adjusted according to the behavior of the first sub-target. The display parameters include at least one of the following: display position, display size, and display effects.

9. The live streaming interaction method as described in any one of claims 1-8, characterized in that, The first prompt information includes at least one of the following: a first special effects animation, a first text and / or a first voice, and the second prompt information includes at least one of the following: a second special effects animation, a second text and / or a second voice.

10. The live streaming interaction method according to any one of claims 1-8, characterized in that, After receiving the interaction information, the method further includes: Output target behavior prompt information corresponding to the interaction event, the target behavior prompt information is used to prompt the target object to perform the target behavior.

11. The live streaming interaction method according to any one of claims 1-8, characterized in that, The method further includes: If the target object is identified to perform a first sub-target action within the preset time period, and / or if the target relationship between the first sub-target action and the interaction action satisfies a preset condition, virtual resources are allocated to the first terminal device. The virtual resources include at least one of the following: virtual gifts, virtual points, virtual digital resources allocated to the first terminal device, and traffic allocated to the virtual space. The interaction event includes the interaction action initiated by the second terminal device in the virtual space.

12. The live streaming interaction method according to any one of claims 1-8, characterized in that, When the target behavior includes multiple different sub-target behaviors, and the target object is identified to have performed multiple sub-target behaviors within the preset time period, the method further includes: The first sub-target action performed by the target object within the preset time period is taken as the first sub-target action; or... The sub-target behavior that the target object maintains for the longest time within the preset duration is taken as the first sub-target behavior.

13. The live streaming interaction method as described in any one of claims 1-8, characterized in that, The interaction event includes at least one of the following: an event in which the second terminal device sends a virtual gift to the first terminal device, or an event in which the second terminal device initiates an interaction request to the first terminal device.

14. A live streaming interaction method, characterized in that, Applied to a second terminal device, the method includes: In response to a first trigger operation on the second terminal device, interactive information is sent, wherein the interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device, the first terminal device has control permissions over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device; The system receives and outputs live video data from the first terminal device. The live video data includes at least a first prompt message or a second prompt message. The first prompt message is used to indicate that the target object in the virtual space has responded to the interaction event, and the second prompt message is used to indicate that the target object has not responded to the interaction event.

15. The live streaming interaction method as described in claim 14, characterized in that, The step of sending interactive information in response to a first trigger operation on the second terminal device includes: In response to the first triggering operation, obtain the target behavior corresponding to the first triggering operation; Send the interaction information, which is used to indicate the target behavior corresponding to the interaction event.

16. The live streaming interaction method as described in claim 14, characterized in that, The method further includes: A control command is sent to the first terminal device, the control command being used to enable the first terminal device to identify whether the target object in the virtual space performs a first sub-target behavior within a preset time period, the first sub-target behavior being any one of the target behaviors corresponding to the interaction event.

17. The live streaming interaction method as described in claim 14, characterized in that, The live video data also includes virtual objects, which are displayed on the display interface of the second terminal device; the method further includes: In response to a second triggering operation on the virtual object, the position and / or size of the virtual object are adjusted.

18. A live streaming interactive device, characterized in that, Applied to a first terminal device, the device includes: A receiving module is used to receive interactive information, wherein the interactive information is used to indicate an interactive event initiated by a second terminal device in the virtual space of the first terminal device, the first terminal device has control over the virtual space, the first terminal device is a device for initiating live streaming, the second terminal device is a device for watching live streaming, and the virtual space is a virtual live streaming room created by the first terminal device. The recognition output module is used to output a first prompt message when it is recognized that a target object in the virtual space performs a first sub-target behavior within a preset time period. The first prompt message is used to prompt that the target object in the virtual space has responded to the interaction event. The first sub-target behavior is any one of the sub-target behaviors among the target behaviors corresponding to the interaction event. The identification output module is further configured to output a second prompt message when it is identified that the target object in the virtual space has not performed any of the sub-target behaviors within the preset time period. The second prompt message is used to prompt the target object that it has not responded to the interaction event.

19. A live streaming interactive device, characterized in that, Applied to a second terminal device, the device includes: The sending module is used to send interactive information in response to a first trigger operation on the second terminal device. The interactive information is used to indicate an interactive event initiated by the second terminal device in the virtual space of the first terminal device. The first terminal device has control permissions over the virtual space. The first terminal device is a device for initiating live streaming, and the second terminal device is a device for watching live streaming. The virtual space is a virtual live streaming room created by the first terminal device. An execution module is configured to receive and output live video data output by the first terminal device. The live video data includes at least a first prompt message or a second prompt message. The first prompt message is used to indicate that the target object in the virtual space has responded to the interaction event, and the second prompt message is used to indicate that the target object has not responded to the interaction event.

20. An electronic device, characterized in that, The electronic device includes a memory and a processor. The memory stores a computer program that can run on the processor. When the processor executes the program, it implements the steps of the method according to any one of claims 1 to 13, or when the processor executes the program, it implements the steps of the method according to any one of claims 14 to 17.

21. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 13, or the method as described in any one of claims 14 to 17.

22. A computer program product having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-13, or the method as described in any one of claims 14 to 17.

Images