Special effects playback methods, systems and equipment for live streaming rooms

Abstract

This disclosure provides a method, system, and device for playing special effects in a live streaming room, relating to the field of computer processing technology. The method includes: identifying items in the live streaming room; determining corresponding special effects based on the items and target attributes of the live streaming room, wherein the correspondence between the items, the target attributes, and the special effects is preset; and playing the special effects in the live streaming room. This disclosure allows for the playback of corresponding special effects in the live streaming room based on the items present, which helps to enhance the entertainment value of the live stream.

Description

Technical Field

[0001] This disclosure relates to the field of computer processing technology, and in particular to a method, system, and device for playing special effects in a live streaming room. Background Technology

[0002] Users typically use electronic devices by using various applications on those devices. For example, with live streaming applications, a streamer can broadcast live through a streaming app, and viewers can watch the live stream through a streaming app.

[0003] How to improve the entertainment value of the live stream is an urgent issue to be addressed. Summary of the Invention

[0004] This disclosure provides a method, system, and device for playing special effects in a live streaming room, which can enhance the entertainment value of live streaming.

[0005] In a first aspect, embodiments of this disclosure provide a method for playing special effects in a live streaming room, the method comprising:

[0006] Identify items in the live stream;

[0007] The corresponding special effects are determined based on the target attributes of the item and the live stream room, and the correspondence between the item, the target attribute and the special effects is preset.

[0008] The special effects are played in the live stream.

[0009] Secondly, embodiments of this disclosure provide a special effects playback device for a live streaming room, the device comprising:

[0010] An item recognition module is used to identify items in the live streaming room;

[0011] The special effects determination module is used to determine the corresponding special effects based on the item and the target attributes of the live broadcast room. The correspondence between the item, the target attributes and the special effects is preset.

[0012] The special effects playback module is used to play the special effects in the live broadcast room.

[0013] Thirdly, embodiments of this disclosure provide an electronic device, including: at least one processor and a memory;

[0014] The memory stores computer-executed instructions;

[0015] The at least one processor executes computer execution instructions stored in the memory, causing the electronic device to perform the method as described in the first aspect.

[0016] Fourthly, embodiments of this disclosure provide a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, cause a computing device to implement the method described in the first aspect.

[0017] Fifthly, embodiments of this disclosure provide a computer program for implementing the method as described in the first aspect.

[0018] This disclosure provides a method, system, and device for playing special effects in a live streaming room. The method includes: identifying items in the live streaming room; determining corresponding special effects based on the items and target attributes of the live streaming room, wherein the correspondence between the items, the target attributes, and the special effects is preset; and playing the special effects in the live streaming room. This disclosure allows for the playback of corresponding special effects in the live streaming room based on the items in the room, which helps to enhance the entertainment value of the live stream. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0020] Figure 1 This is a schematic diagram of a live streaming scenario applicable to an embodiment of this disclosure;

[0021] Figure 2 This is a flowchart of the steps of a special effects playback method in a live streaming room provided by an embodiment of the present disclosure;

[0022] Figure 3 This is a structural block diagram of a special effects playback device for a live streaming room provided in an embodiment of this disclosure;

[0023] Figure 4 , Figure 5 These are structural block diagrams of two electronic devices provided in embodiments of this disclosure. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0025] The embodiments disclosed herein can be applied to live streaming scenarios. Figure 1 This is a schematic diagram illustrating a live streaming scenario applicable to an embodiment of this disclosure. (Refer to...) Figure 1 As shown, the live streaming scenario involves terminal devices and servers. Each terminal device runs a client, which is used to access the aforementioned server. Figure 1 It consists of one server and four terminal devices TE1, TE2, TE3, and TE4, each running CT1, CT2, CT3, and CT4 respectively. All CT1, CT2, CT3, and CT4 can connect to the server. Terminal device TE1 is used by the broadcaster and can also be called the broadcaster terminal; its corresponding client CT2 can be called the broadcaster client. Terminal devices TE1, TE3, and TE4 are used by the viewers and can also be called viewer terminals; their corresponding clients CT1, CT3, and CT4 can be called viewer clients.

[0026] When the aforementioned broadcaster client CT2 is broadcasting live in a live room, the broadcaster terminal TE2 can send the live data of the broadcaster client CT2 to the server. The server can then send this live data to the viewer terminals TE1, TE3, and TE4 that are connected to the live room, so that the terminal devices TE1, TE3, and TE4 can display the live data of the live room on the corresponding viewer clients CT1, CT3, and CT4.

[0027] During the aforementioned live stream, the host can showcase items in the live stream room. However, this method of simply showcasing items is rather monotonous, reducing the live stream's entertainment value.

[0028] To address the aforementioned issues, embodiments of this disclosure can play special effects based on items in the live stream. This combines items and special effects, enhancing the entertainment value of the live stream.

[0029] The technical solutions of the present disclosure and how the technical solutions of the present disclosure solve the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of the present disclosure will now be described with reference to the accompanying drawings.

[0030] Figure 2 This is a flowchart of the steps of a live streaming special effects playback method provided in this embodiment. Figure 2 The method shown can be applied to electronic devices, for example, as described above. Figure 1 The terminal devices included include: broadcaster terminals and viewer terminals. (Refer to...) Figure 2 As shown, the special effects playback methods in this live stream include:

[0031] S101: Identify items in the live stream.

[0032] The items in the live stream can be any items, such as trophies or medals.

[0033] This disclosure provides various methods for identifying the item. In this disclosure, items in the live stream can be identified according to a certain time period, for example, once every N milliseconds.

[0034] In the first method, multiple images of the target item can be pre-stored, which can be called the first image; then, during the live broadcast, screenshots of the live broadcast room or data from the live broadcast room are obtained to get the second image; finally, the first image and the second image are compared to determine whether the target item exists in the live broadcast room.

[0035] In the second approach, items in the live stream can also be identified using a pre-trained item recognition model. First, during the live stream, a screenshot of the live stream is taken or live stream data is obtained to create a second image; then, this second image is input into the item recognition model to identify the items in the live stream.

[0036] The aforementioned object recognition model can be any pre-trained machine model, such as a CNN (convolutional neural networks) model or a DNN (deep neural networks) model. This disclosure does not limit the type of object recognition model.

[0037] The training process of the aforementioned object recognition model is achieved through a training sample set and multiple iterations. The training sample set can include multiple sample images, each labeled with a sample object. In each iteration, firstly, each sample image is input into the object recognition model to identify the object predicted by the model; this predicted object is then determined based on the predicted and actual objects for all sample images used in the current iteration. Finally, the training is terminated based on the loss value. If the loss value does not meet a preset condition, the parameters of the object recognition model are adjusted for the next iteration. If the loss value meets the preset condition, training terminates, and the resulting object recognition model is used as the trained object recognition model.

[0038] The aforementioned loss value can be calculated using a loss function, which is an existing, well-known function, such as the cross-entropy loss function or the mean square loss function.

[0039] The process of acquiring sample images required in the above training process may include: first, identifying items that support special effects; then, taking pictures of these items under various conditions to obtain multiple sample images, such as taking pictures under different lighting conditions and different angles; finally, marking the item in the sample image as a sample item.

[0040] S102: Determine the corresponding special effect based on the target attributes of the item and the live stream. The correspondence between the item, the target attribute, and the special effect is preset.

[0041] The target attributes may include, but are not limited to: the streamer's attributes and the attributes of the live stream.

[0042] The aforementioned streamer attributes include at least one of the following: streamer identifier, streamer name, and streamer type. The streamer identifier can be the streamer's account in the live stream room, used to uniquely identify a streamer. The streamer type can be derived from any dimension. For example, streamers can be categorized based on their expertise in live streaming content, such as sports commentary streamers or sales streamers.

[0043] The attributes of the aforementioned live stream room include at least one of the following: live stream room identifier, live stream room name, and live stream room type. The live stream room type can be determined based on any dimension. For example, the live stream room can be divided into a live stream room for selling items or a live stream room for commenting on events, or it can be divided into live stream rooms of different durations based on the duration of the live stream room.

[0044] In this embodiment of the disclosure, after identifying items in the live broadcast room, the target attributes of the live broadcast room can be obtained, and then it can be determined whether to play special effects based on whether the target attributes and special effects are obtained.

[0045] In the first case, the target attribute was not obtained. Since the target attribute required for the effect was not determined at this time, the effect was not played.

[0046] In the second scenario, the target attribute is obtained, but the corresponding special effect is not retrieved based on the item and the target attribute. Since the special effect is not retrieved in this case, it will not play.

[0047] In the third case, the target attribute is obtained, and the corresponding special effect is obtained based on the item and the target attribute, thereby playing the special effect.

[0048] In this embodiment of the disclosure, multiple correspondences used in S102 can be pre-set, and the items and / or target attributes and / or special effects in different correspondences are different.

[0049] It should be noted that an item can correspond to multiple target attributes, and each target attribute corresponds to a special effect. For example, when the target attribute is the streamer's identifier, there are three correspondences: {M1, ID1, SE1}, {M1, ID2, SE2}, and {M1, ID3, SE1}. Therefore, in the live stream where the streamer's identifier is ID1, the special effect corresponding to item M1 is SE1; in the live stream where the streamer's identifier is ID2, the special effect corresponding to item M1 is SE2; and in the live stream where the streamer's identifier is ID3, the special effect corresponding to item M1 is SE1.

[0050] It can be seen that item M1 has corresponding special effects in the three streamers' live streams. The special effect of M1 in streamer ID1's live stream is different from the special effect in streamer ID2's live stream. However, the special effect in streamer ID1's live stream is the same as the special effect in streamer ID3's live stream.

[0051] In summary, the same item can have its effects displayed in multiple streamers' live streams, and these effects can be the same or different across different streamers. Thus, the effects correspond not only to the item but also to the target attributes. When the item and target attributes differ, the displayed effects can be different, increasing the flexibility of the effects.

[0052] Furthermore, a target attribute can correspond to one or more items, and the special effects corresponding to different items can be the same or different. For example, when the target attribute is the streamer's identifier, there are three correspondences: {M1, ID1, SE1}, {M2, ID1, SE2}, and {M3, ID1, SE1}. Thus, in the live stream room where the streamer's identifier is ID1, all three items M1 to M3 have corresponding special effects. However, M1 and M2 correspond to different special effects, while M1 and M3 correspond to the same special effect, SE1.

[0053] Finally, a target attribute and an item can correspond to two special effects. For example, when the target attribute is the streamer's identifier, there are two correspondences: {M1, ID1, SE1} and {M1, ID1, SE2}. Therefore, in a live stream where the streamer's identifier is ID1, item M1 can correspond to two special effects, SE1 and SE2. That is, for item M1, not only should effect SE1 be played, but also effect SE2. For example, in a live stream where the streamer's identifier is ID1, when the item M1 the streamer presents is a trophy, not only can the audio effect SE1 be played, but also the video effect SE2.

[0054] After obtaining one or more of the above correspondences, target correspondences that match the items identified in S101 and the target attributes of the live room in S101 can be selected from these one or more correspondences, and the special effects in the target correspondences can be used as special effects to be played in S103.

[0055] It is understandable that the target correspondence includes the correspondence between the items identified in S101 and the target attributes corresponding to the live broadcast room in S101.

[0056] S103: Play special effects in the above live stream room.

[0057] Special effects may include, but are not limited to: image effects, video effects, and audio effects.

[0058] The aforementioned image effects are effects represented by images. An image effect can be a frame of an image with specific content. For example, when the item is a trophy, the corresponding image effect can be a trophy image with the streamer's avatar.

[0059] The aforementioned video effects include effects represented by multiple consecutive frames of images. Each frame of image can include specific content. For example, when the item is a trophy, the corresponding video effect can be an animated GIF of a trophy with the streamer's avatar.

[0060] The aforementioned audio effects are effects represented by sound. For example, when the item is a trophy, the corresponding audio effect could be the sound of "Wow, the gold medal winner!"

[0061] To accurately play special effects based on the items in the live stream, effects can be played when preset conditions are met. These preset conditions may include, but are not limited to: the historical playback count being less than a preset threshold, the current time being within the effective time period of the effect, the item's status being the target item status, and the streamer's status being the target streamer status. Specifically, when one or more of the above preset conditions are met, the aforementioned special effect will be played in the aforementioned live stream. When one or more of the above preset conditions are not met, the aforementioned special effect will not be played in the aforementioned live stream.

[0062] The following explains the relationship between each preset condition and the playback of special effects.

[0063] When the preset condition is that the number of historical plays is less than the preset threshold, the system can first obtain the number of historical plays of the special effect in the above-mentioned live room within the preset time period; then, determine the relationship between the number of historical plays and the preset threshold. If the number of historical plays is less than the preset threshold, the special effect is played in the live room; if the number of historical plays is greater than or equal to the preset threshold, the special effect is not played in the live room.

[0064] The preset time period can be days, hours, etc. The following example illustrates the effect playback using a preset time period of hours and a preset number of times threshold of 1.

[0065] At 10:05, an item in a live stream was detected by S101. Since the historical playback count of the effect determined by S102 in the live stream between 10:00 and 11:00 of the current hour (0 to 11:00) is less than or equal to a preset threshold of 1, the effect can be played. Furthermore, the historical playback count of the aforementioned effect in the live stream is updated from 0 to 1.

[0066] When the item is detected again via S101 at 10:10, since the historical playback count of the effect determined by S102 in the live stream between 10:00 and 11:00 of the current hour is less than or equal to the preset threshold of 1, the effect can be played. Furthermore, the historical playback count of the effect in the live stream is updated from 1 to 2.

[0067] When the item is detected again via S101 at 10:15, the effect is not played because the historical playback count 2 of the effect determined by S102 in the live stream room between 10:00 and 11:00 of the current hour is greater than the preset threshold 1. Furthermore, the historical playback count of the effect in the live stream room is not updated.

[0068] Similarly, the item's special effects will no longer be displayed in the live stream between 10:15 and 11:00.

[0069] As can be seen, by using the preset conditions consisting of the historical playback count and the preset threshold, we can prevent the item's special effects from being repeatedly displayed when the item exists in the live stream for a long time, thereby avoiding the impact on the normal live stream.

[0070] When the preset condition is that the current time is within the effective time period, after the item is identified in S101 and the effect is determined in S102, the relationship between the current time and the effective time period of the effect can be determined. If the current time is within the effective time period, the effect determined in S102 will be played in the live stream room in S101. If the current time is not within the effective time period, the effect determined in S102 will not be played in the live stream room in S101.

[0071] The effective time period can be preset and is used to indicate the time period during which the special effect can be played in the live room corresponding to the target attribute.

[0072] The aforementioned valid time period can be associated with the correspondence in S102. Specifically, each correspondence in S102 corresponds to a valid time period. This allows the same item to have the same or different valid time periods in different streamers' live streams. For example, if the item identified in S101 is a trophy from 2015, a valid time period of 2015 to 2017 can be set for that trophy. Thus, even if the trophy is detected in a streamer's live stream after 2018, its effects will no longer be displayed in that live stream.

[0073] As can be seen, the embodiments of this disclosure can limit the playback time of special effects through the aforementioned effective time period, which can be a period during which the item has a significant influence. For example, for the aforementioned trophy, since fewer people may pay attention to it many years later, thus its influence is weaker, the effective time period can be set to a period of time after the trophy is awarded.

[0074] When the preset condition is that the item's state is the target item state, firstly, the state of the item in the live broadcast room is identified; then, it is determined whether the item's state is the target item state. If the item's state is the target item state, then the special effect is played in the live broadcast room; if the item's state is not the target item state, then the special effect is not played in the live broadcast room.

[0075] The state of the target item may include at least one of the following: being held in hand or being located at the target location.

[0076] The "handheld" state mentioned above refers to the item being in a person's hand. In other words, if the item is in a person's hand, it means the streamer is displaying the item, and thus the item's special effects can be played. Conversely, if the item is not in a person's hand, then the item's special effects will not be played.

[0077] The target location mentioned above can be a pre-set item display position. For example, the target location could be directly in front of the streamer. That is, if the item is directly in front of the streamer, it means the streamer is displaying the item, and thus the item's special effects can be played. Conversely, if the item is not directly in front of the streamer, then the item's special effects will not be played.

[0078] This embodiment of the disclosure can determine whether the streamer is displaying the item based on the item's state, thereby ensuring that special effects are played when the streamer is displaying the item. Specifically, when the item's state is the target item state, it is assumed that the streamer is displaying the item, and thus the special effects are played. When the item's state is not the target item state, it is assumed that the streamer is not displaying the item, and thus the special effects are not played. In this way, this embodiment of the disclosure can ensure that the special effects are played at the right time, avoiding the playback of special effects at the wrong time.

[0079] When the preset condition is that the streamer status is the target streamer status, firstly, the streamer status in the live room is identified; then, it is determined whether the streamer status is the target streamer status. If the streamer status is the target streamer status, special effects are played in the live room; if the streamer status is not the target streamer status, special effects are not played in the live room.

[0080] The target streamer status includes at least one of the following: the streamer's gesture is a gesture directed at the item, and the relative positional relationship between the streamer and the item is a target positional relationship.

[0081] The gestures used by the streamer mentioned above are gestures directed at the item, indicating that the streamer is demonstrating the item. For example, when demonstrating an item, the streamer will usually point to it with their hand.

[0082] The aforementioned target relative positional relationship can be the relative positional relationship between any of the broadcaster's limbs and the object. For example, when the broadcaster's face is facing the object, or their eyes are facing the object, or their entire body is facing the object, these relative positional relationships can all be used as target positional relationships to indicate that the broadcaster is displaying the object.

[0083] This embodiment of the disclosure can determine whether the streamer is displaying the item based on the streamer's status, thereby ensuring that special effects are played when the streamer is displaying the item. In this way, this embodiment of the disclosure can guarantee that the special effects are played at the right time, avoiding the playback of special effects at the wrong time.

[0084] When the preset condition is that the existence duration is less than or equal to the preset duration threshold, firstly, the existence duration of the item in the live broadcast room is determined; then, the relationship between the existence duration and the preset duration threshold is determined. If the existence duration is less than or equal to the preset duration threshold, the special effect is played in the live broadcast room; if the existence duration is greater than the preset duration threshold, the special effect is not played in the live broadcast room.

[0085] The preset duration threshold can be a small value to avoid the special effects playing for too long and affecting the live stream. For example, the preset duration threshold can be set to 10 seconds, so that the special effects play for the first 10 seconds when the item is displayed in the live stream, and after 10 seconds, even if the item is still displayed in the live stream, the special effects will no longer play.

[0086] When multiple preset conditions are set, the special effect should only be played if all preset conditions are met simultaneously. If at least one preset condition is not met, the special effect should not be played. For example, if the preset conditions include: the number of historical plays is less than a preset threshold, the current time is within the effective time period of the special effect, the item's state is the target item state, and the streamer's state is the target streamer state, then the special effect should be played when the number of historical plays is less than the preset threshold, the current time is within the effective time period of the special effect, the item's state is the target item state, and the streamer's state is the target streamer state. However, if the number of historical plays is greater than or equal to the preset threshold, and / or the current time is not within the effective time period of the special effect, and / or the item's state is not the target item state, and / or the streamer's state is not the target streamer state, the special effect should not be played.

[0087] It should be noted that when the aforementioned special effects are image or video effects, their playback in the live stream can be based on the item's position within the live stream. Specifically, effects can be played around the item in the live stream. This makes the relationship between the effects and the item clearer. For example, image or video effects can be played to the left, right, top, and bottom of a trophy.

[0088] Understandably, given the typically long duration of live streams, the streamer may showcase different items at different times during the stream, allowing the corresponding effects to be played sequentially. For example, if the streamer showcases item M1 at time t1, then item M1's effects can be played at time t1. If the streamer showcases item M2 at time t2, then item M2's effects can be played at time t2. Of course, the effects for M1 and M2 can be the same or different.

[0089] Corresponding to the live streaming effects playback method in the above embodiment, Figure 3 This is a structural block diagram of a special effects playback device for a live streaming room, provided in an embodiment of this disclosure, and applied to the aforementioned special effects playback system for a live streaming room. For ease of explanation, only the parts related to the embodiments of this disclosure are shown. (Refer to...) Figure 3 The special effects playback device 200 in the aforementioned live broadcast room includes: an item recognition module 201, a special effects determination module 202, and a special effects playback module 203.

[0090] The item recognition module 201 is used to identify items in the live broadcast room.

[0091] The special effects determination module 202 is used to determine the corresponding special effects based on the item and the target attributes of the live broadcast room. The correspondence between the item, the target attributes and the special effects is preset.

[0092] Special effects playback module 203 is used to play the special effects in the live broadcast room.

[0093] Optionally, the target attribute includes at least one of the following: the streamer attribute of the live broadcast room and the attributes of the live broadcast room.

[0094] Optionally, the streamer attributes include at least one of the following: streamer identifier, streamer name, and streamer type.

[0095] Optionally, the attributes of the live streaming room include at least one of the following: live streaming room identifier, live streaming room name, and live streaming room type.

[0096] Optionally, the special effects playback module 203 is further used for:

[0097] When preset conditions are met, the special effect is played in the live stream room. The preset conditions include at least one of the following: the number of times the special effect has been played in the live stream room within a preset time period is less than a preset number threshold; the current time is within the effective time period of the special effect; the state of the item in the live stream room is the target item state; the state of the streamer in the live stream room is the target streamer state; and the existence duration of the item in the live stream room is less than or equal to a preset duration threshold. The effective time period is used to indicate the time period during which the special effect can be played in the live stream room corresponding to the target attribute.

[0098] Optionally, the state of the target item includes at least one of the following: being held in hand or located at the target location.

[0099] Optionally, the target anchor state includes at least one of the following: the anchor's gesture is a gesture directed at the item, and the relative positional relationship between the anchor and the item is a target positional relationship.

[0100] Optionally, the special effects include at least one of the following: image effects, video effects, and audio effects.

[0101] Optionally, when the special effect is an image effect or a video effect, the special effect playback module 203 is further configured to:

[0102] The special effects are played around the items in the live stream.

[0103] The special effects playback device for the live streaming room provided in this embodiment can be used to perform the above-mentioned... Figure 5 The technical solutions of the method embodiments shown are similar in implementation principle and technical effect, and will not be described again here.

[0104] Figure 4 This is a structural block diagram of an electronic device 600 provided in an embodiment of the present disclosure. The electronic device 600 includes a memory 602 and at least one processor 601.

[0105] Among them, memory 602 stores computer-executed instructions.

[0106] At least one processor 601 executes computer execution instructions stored in memory 602, causing electronic device 600 to perform the aforementioned functions. Figure 2 The method in the middle.

[0107] In addition, the electronic device may also include a receiver 603 and a transmitter 604, wherein the receiver 603 is used to receive information from other devices or equipment and forward it to the processor 601, and the transmitter 604 is used to send information to other devices or equipment.

[0108] Further, refer to Figure 5 The diagram illustrates a structural schematic of an electronic device 900 suitable for implementing embodiments of the present disclosure. This electronic device 900 can be a terminal device. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0109] like Figure 5 As shown, the electronic device 900 may include a processing unit (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. The RAM 903 also stores various programs and data required for the operation of the electronic device 900. The processing unit 901, ROM 902, and RAM 903 are interconnected via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0110] Typically, the following devices can be connected to I / O interface 905: input devices 906 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 907 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 908 including, for example, magnetic tapes, hard disks, etc.; and communication devices 909. Communication device 909 allows electronic device 900 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 5 An electronic device 900 with various devices is shown; however, it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0111] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by a processing device 901, it performs the functions defined in the methods of embodiments of this disclosure.

[0112] It should be noted that the computer-readable medium described in this disclosure can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0113] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0114] The aforementioned computer-readable medium carries one or more programs, which, when executed by the electronic device, cause the electronic device to perform the methods shown in the above embodiments.

[0115] Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a Local Area Network (LAN) or a Wide Area Network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0116] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0117] The units described in the embodiments of this disclosure can be implemented in software or in hardware. The name of a unit does not necessarily limit the unit itself; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0118] The functions described above in this document can be performed at least in part by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0119] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0120] In a first example of the first aspect, this disclosure provides a method for playing special effects in a live streaming room, the method comprising:

[0121] Identify items in the live stream;

[0122] The corresponding special effects are determined based on the target attributes of the item and the live stream room, and the correspondence between the item, the target attribute and the special effects is preset.

[0123] The special effects are played in the live stream.

[0124] Based on the first example of the first aspect, in the second example of the first aspect, the target attribute includes at least one of the following: the anchor attribute of the live broadcast room and the attribute of the live broadcast room.

[0125] Based on the second example of the first aspect, in the third example of the first aspect, the broadcaster attribute includes at least one of the following: broadcaster identifier, broadcaster name, and broadcaster type.

[0126] Based on the second example of the first aspect, in the fourth example of the first aspect, the attributes of the live room include at least one of the following: live room identifier, live room name, and live room type.

[0127] Based on any one of the first to fourth examples of the first aspect, in the fifth example of the first aspect, the playing of the special effect in the live broadcast room includes:

[0128] When preset conditions are met, the special effect is played in the live stream room. The preset conditions include at least one of the following: the number of times the special effect has been played in the live stream room within a preset time period is less than a preset number threshold; the current time is within the effective time period of the special effect; the state of the item in the live stream room is the target item state; the state of the streamer in the live stream room is the target streamer state; and the existence duration of the item in the live stream room is less than or equal to a preset duration threshold. The effective time period is used to indicate the time period during which the special effect can be played in the live stream room corresponding to the target attribute.

[0129] Based on the fifth example of the first aspect, in the sixth example of the first aspect, the state of the target item includes at least one of the following: being held in hand, or being located at the target location.

[0130] Based on the fifth example of the first aspect, in the seventh example of the first aspect, the target anchor state includes at least one of the following: the anchor's gesture is a gesture directed at the item, and the relative positional relationship between the anchor and the item is a target positional relationship.

[0131] Based on any one of the first to fourth examples of the first aspect, in the eighth example of the first aspect, the special effect includes at least one of the following: image special effect, video special effect and audio special effect.

[0132] Based on the eighth example of the first aspect, in the ninth example of the first aspect, when the special effect is an image effect or a video effect, playing the special effect in the live broadcast room includes:

[0133] The special effects are played around the items in the live stream.

[0134] In a first example of the second aspect, a special effects playback device for a live streaming room is provided, the device comprising:

[0135] An item recognition module is used to identify items in the live streaming room;

[0136] The special effects determination module is used to determine the corresponding special effects based on the item and the target attributes of the live broadcast room. The correspondence between the item, the target attributes and the special effects is preset.

[0137] The special effects playback module is used to play the special effects in the live broadcast room.

[0138] Based on the first example of the second aspect, in the second example of the second aspect, the target attribute includes at least one of the following: the anchor attribute of the live broadcast room and the attribute of the live broadcast room.

[0139] Based on the second example of the second aspect, in the third example of the second aspect, the broadcaster attribute includes at least one of the following: broadcaster identifier, broadcaster name, and broadcaster type.

[0140] Based on the second example of the second aspect, in the fourth example of the second aspect, the attributes of the live room include at least one of the following: live room identifier, live room name, and live room type.

[0141] Based on any one of the first to fourth examples of the second aspect, in the fifth example of the second aspect, the special effects playback module is further used for:

[0142] When preset conditions are met, the special effect is played in the live stream room. The preset conditions include at least one of the following: the number of times the special effect has been played in the live stream room within a preset time period is less than a preset number threshold; the current time is within the effective time period of the special effect; the state of the item in the live stream room is the target item state; the state of the streamer in the live stream room is the target streamer state; and the existence duration of the item in the live stream room is less than or equal to a preset duration threshold. The effective time period is used to indicate the time period during which the special effect can be played in the live stream room corresponding to the target attribute.

[0143] Based on the fifth example of the second aspect, in the sixth example of the second aspect, the state of the target item includes at least one of the following: being held in hand, or being located at the target location.

[0144] Based on the fifth example of the second aspect, in the seventh example of the second aspect, the target anchor state includes at least one of the following: the anchor's gesture is a gesture directed at the item, and the relative positional relationship between the anchor and the item is a target positional relationship.

[0145] Based on any one of the first to fourth examples of the second aspect, in the eighth example of the second aspect, the special effect includes at least one of the following: image special effect, video special effect, and audio special effect.

[0146] Based on the eighth example of the second aspect, in the ninth example of the second aspect, when the special effect is an image effect or a video effect, the special effect playback module is further configured to:

[0147] The special effects are played around the items in the live stream.

[0148] Thirdly, according to one or more embodiments of the present disclosure, an electronic device is provided, comprising: at least one processor and a memory;

[0149] The memory stores computer-executed instructions;

[0150] The at least one processor executes computer execution instructions stored in the memory, causing the electronic device to implement the method described in any of the first aspects.

[0151] Fourthly, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, the computer-readable storage medium storing computer-executable instructions that, when executed by a processor, cause a computing device to implement the method described in any one of the first aspects.

[0152] Fifthly, according to one or more embodiments of the present disclosure, a computer program is provided for implementing the method described in any of the first aspects.

[0153] The above description is merely a preferred embodiment of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features disclosed in this disclosure that have similar functions.

[0154] Furthermore, while the operations are described in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, while several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of this disclosure. Certain features described in the context of individual embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented individually or in any suitable sub-combination in multiple embodiments.

[0155] Although the subject matter has been described using language specific to structural features and / or methodological logic, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are merely illustrative examples of implementing the claims.

Claims

1. A method for playing special effects in a live streaming room, characterized in that, The method includes: Identify items in the live stream; The corresponding special effects are determined based on the target attributes of the item and the live stream room, and the correspondence between the item, the target attribute and the special effects is preset. The special effects are played in the live stream room; The items are displayed in the live stream room, and the target attributes include the streamer attributes of the live stream room; Playing the special effects in the live stream includes: When preset conditions are met, the special effect is played in the live broadcast room. The preset conditions include that the state of the item is the target item state, and the target item state includes at least one of the following: handheld state, or located at the target position. The preset conditions also include at least one of the following: the number of times the special effect has been played in the live room within a preset time period is less than a preset number threshold; the current time is within the effective time period of the special effect; the streamer status in the live room is the target streamer status; the existence duration of the item in the live room is less than or equal to a preset duration threshold. The effective time period is used to indicate the time period during which the special effect can be played in the live room corresponding to the target attribute. The target streamer status includes at least one of the following: the streamer's gesture is a gesture directed at the item; the relative positional relationship between the streamer and the item is a target positional relationship.

2. The method according to claim 1, characterized in that, The target attributes also include the attributes of the live streaming room.

3. The method according to claim 2, characterized in that, The streamer attributes include at least one of the following: streamer identifier, streamer name, and streamer type.

4. The method according to claim 2, characterized in that, The attributes of the live streaming room include at least one of the following: live streaming room identifier, live streaming room name, and live streaming room type.

5. The method according to any one of claims 1 to 4, characterized in that, The special effects include at least one of the following: image effects, video effects, and audio effects.

6. The method according to claim 5, characterized in that, When the special effect is an image effect or a video effect, playing the special effect in the live broadcast room includes: The special effects are played around the items in the live stream.

7. A special effects playback device for a live streaming room, characterized in that, The device includes: An item recognition module is used to identify items in the live streaming room; The special effects determination module is used to determine the corresponding special effects based on the item and the target attributes of the live broadcast room. The correspondence between the item, the target attributes and the special effects is preset. A special effects playback module is used to play the special effects in the live broadcast room; The items are displayed in the live stream room, and the target attributes include the streamer attributes of the live stream room; The special effects playback module is specifically used for: When preset conditions are met, the special effect is played in the live broadcast room. The preset conditions include that the state of the item is the target item state, and the target item state includes at least one of the following: handheld state, or located at the target position. The preset conditions also include at least one of the following: the number of times the special effect has been played in the live room within a preset time period is less than a preset number threshold; the current time is within the effective time period of the special effect; the streamer status in the live room is the target streamer status; the existence duration of the item in the live room is less than or equal to a preset duration threshold. The effective time period is used to indicate the time period during which the special effect can be played in the live room corresponding to the target attribute. The target streamer status includes at least one of the following: the streamer's gesture is a gesture directed at the item; the relative positional relationship between the streamer and the item is a target positional relationship.

8. An electronic device, characterized in that, include: At least one processor and memory; The memory stores computer-executed instructions; The at least one processor executes computer execution instructions stored in the memory, causing the electronic device to perform the method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, cause the electronic device to perform the method as described in any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by an electronic device, it implements the method as described in any one of claims 1 to 6.

Images