Effect playback method, system, and device for live streaming room
The method enhances live streaming by identifying items and playing corresponding effects based on attributes, addressing the lack of engagement in live streaming applications and improving user experience.
Patent Information
- Application Number
- JP2023579381
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-10-14
- Filing Date
- 2022-10-14
- Publication Date
- 2025-07-30
- Estimated Expiration
- 2042-10-14
AI Technical Summary
Live streaming applications lack engaging and interactive methods for displaying items, leading to reduced interest and user experience.
A method and system for identifying items in a live streaming room, determining corresponding effects based on target attributes, and playing these effects, with a preset correspondence between items, attributes, and effects, enhancing interaction and user experience.
Enriches the display of items in live streaming by combining them with relevant effects, improving the interactive effect and user experience.
Smart Images

Figure 0007715847000001 
Figure 0007715847000002 
Figure 0007715847000003
Abstract
Description
Technical Field
[0001] This disclosure claims the priority of a Chinese patent application filed on October 14, 2021, with the application number 202111198430.5 and the title "Effect Reproduction Method, System and Device for Live Streaming Room", and all its contents are incorporated herein by reference.
[0002] Embodiments of the present disclosure relate to the field of computer processing technology, and in particular, to an effect reproduction method, system and device for a live streaming room.
Background Art
[0003] Using a user's electronic device usually means using various applications of the electronic device. For example, regarding using a live streaming application, a live streamer can conduct a live stream on the live streamer's side, and viewers can watch the live stream on the viewer's side.
Summary of the Invention
Problems to be Solved by the Invention
[0004] Embodiments of the present disclosure provide an effect reproduction method, system and device for a live streaming room.
Means for Solving the Problems
[0005] In a first aspect, embodiments of the present disclosure include identifying an item in a live streaming room, determining a corresponding effect according to the item and the target attribute of the live streaming room, reproducing the effect in the live streaming room, and the corresponding relationship between the item, the target attribute and the effect is preset, providing an effect reproduction method for a live streaming room.
[0006] In a second aspect, an embodiment of the present disclosure is an item identification module for identifying an item in a live broadcast room, an effect determination module for determining a corresponding effect according to the item and a target attribute of the live broadcast room, and an effect playback module for playing the effect in the live broadcast room, and provides an effect playback device for a live broadcast room, where a correspondence relationship between the item, the target attribute, and the effect is preset.
[0007] In a third aspect, an embodiment of the present disclosure includes at least one processor and a memory, where the memory stores computer-executable instructions, and when the computer-executable instructions stored in the memory are executed by the at least one processor, an electronic device is provided that realizes the method described in the first aspect.
[0008] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium that stores computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method described in the first aspect is realized on a computing device.
[0009] In a fifth aspect, an embodiment of the present disclosure provides a computer program for realizing the method described in the first aspect.
[0010] In a sixth aspect, an embodiment of the present disclosure provides a computer program product including a computer program that, when executed by a processor, realizes the method described in the first aspect.
Brief Description of the Drawings
[0011] To more clearly illustrate the embodiments of the present disclosure or the technical solutions of the prior art, the necessary drawings used in the following description of the embodiments or the prior art will be briefly described. The drawings in the following description are only some embodiments of the present disclosure, and those skilled in the art can obtain other drawings from these drawings without creative labor.
[0012]
Figure 1
[0013]
Figure 2
[0014]
Figure 3
[0015]
Figure 4
Figure 5
Modes for Carrying Out the Invention
[0016] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure. The embodiments described are only some embodiments of the present disclosure, not all embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative labor are included in the protection scope of the present disclosure.
[0017] Embodiments of the present disclosure can be applied to a live streaming scenario. FIG. 1 is a schematic diagram of a live streaming scenario to which embodiments of the present disclosure are applied. As shown with reference to FIG. 1, the live streaming scenario relates to terminal devices and a server. On each terminal device, a client for accessing the server is running. FIG. 1 includes one server and four terminal devices TE1, TE2, TE3, TE4 on which CT1, CT2, CT3, CT4 are respectively running. CT1, CT2, CT3, CT4 can all access the server. The terminal device TE2 is the terminal device used by the streamer and may be called the streamer terminal, and the corresponding client CT2 may be called the streamer client. The terminal devices TE1, TE3, TE4 are the terminal devices used by viewers respectively and may be called viewer terminals, and the corresponding clients CT1, CT3, CT4 may be called viewer clients.
[0018] While the streamer client CT2 is performing a live stream in a live streaming room, the streamer terminal TE2 can send the live stream data of the streamer client CT2 to the server. The server may send the live stream data to the viewer terminals TE1, TE3, TE4 accessing the live streaming room so that the terminal devices TE1, TE3, TE4 display the live stream data of the live streaming room to the corresponding viewer clients CT1, CT3, CT4.
[0019] During the above live stream, the streamer can display items in the live streaming room. However, the form of simply displaying items like this is single, and the interestingness of the live stream is reduced.
[0020] To solve the above problems, embodiments of the present disclosure provide a method, a system, and a device for playing effects in a live broadcast room. The method includes identifying an item in the live broadcast room, determining a corresponding effect according to the item and the target attribute of the live broadcast room, and playing the effect in the live broadcast room. The correspondence between the item, the target attribute, and the effect is preset. Embodiments of the present disclosure can play corresponding effects in the live broadcast room according to the items in the live broadcast room. Thereby, the item and the effect can be combined, enriching the display method of the items in the live broadcast room, enhancing the interactive effect of the live broadcast, and improving the user experience.
[0021] Hereinafter, specific embodiments will be used to describe in detail the technical solutions of the embodiments of the present disclosure and how the technical solutions of the present disclosure solve the above technical problems. Several specific embodiments below may be combined with each other. In some embodiments, the same or similar concepts and processes may not be repeatedly described. Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.
[0022] FIG. 2 is a flowchart of the steps of a method for playing effects in a live broadcast room provided by an embodiment of the present disclosure. The method shown in FIG. 2 can be applied to an electronic device, for example, any terminal device shown in FIG. 1 above, such as a live broadcaster terminal or a viewer terminal. As shown with reference to FIG. 2, the method for playing effects in the live broadcast room includes the following steps.
[0023] S101: Identify an item in the live broadcast room.
[0024] The item in the live broadcast room may be any item. For example, it may be a trophy or a medal, etc.
[0025] Embodiments of the present disclosure can provide various methods for identifying an item thereof. In embodiments of the present disclosure, an item in a live streaming room may be identified at regular time intervals, for example, every N milliseconds. Items in the live streaming room are, for example, physical objects photographed by a live streamer during live streaming, or items displayed by the live streamer.
[0026] In a first aspect, first, pictures of a plurality of target items, which can be called first images, are stored in advance. Next, during live streaming, the live streaming room is screen-shot, or live streaming room data is acquired to obtain a second image. Finally, the first image and the second image are compared to determine whether a target item exists in the live streaming room.
[0027] In a second aspect, an item in the live streaming room may be identified by an item identification model trained in advance. First, during live streaming, the live streaming room is screen-shot, or live streaming room data is acquired to obtain a second image. Next, the second image is input into the item identification model to obtain an item in the live streaming room.
[0028] The above item identification model is any machine model obtained by pre-training, for example, a CNN (convolutional neural networks) model, a DNN (deep neural networks) model, etc. Embodiments of the present disclosure do not limit the type of the item identification model.
[0029] The training process of the above item identification model is realized by a training sample set and multiple iterations. The training sample set may include a plurality of sample images in which sample items are marked. In each iterative training, first, each sample image is input into the item identification model to identify the item from the sample image. Since the item is predicted by the item identification model, it can be called a predicted item. Next, a loss value is determined according to the predicted items and sample items corresponding to all the sample images used in this iteration. Finally, it is determined whether to continue the next iteration or end the training according to the loss value. When the loss value does not meet the predetermined conditions, the parameters of the item identification model are adjusted according to the loss value to perform the next iterative training. When the loss value meets the predetermined conditions, the training is ended, and the item identification model after this iteration is used as the item identification model obtained by training.
[0030] The above loss value can be calculated by a loss function, which is a conventionally known function, for example, a cross-entropy loss function or a mean squared loss function.
[0031] As a process of obtaining the sample images required in the above training process, first, identify the items that support the effect. Next, photograph these items that support the effect under multiple conditions to obtain a plurality of sample images. For example, photograph under conditions such as different illuminations and different angles. Finally, the item may be marked on the sample image to be a sample item.
[0032] S102: According to the item and the target attribute of the live broadcast room, determine the corresponding effect. The correspondence relationship among the item, the target attribute, and the effect is preset.
[0033] The target attribute includes, but is not limited to, the attributes of the live broadcaster and the attributes of the live broadcast room.
[0034] The above-mentioned liver attributes include at least one of liver identification, liver name, and liver type. The liver identification may be the account of the liver in the live streaming room for uniquely identifying one liver. The liver type may be classified according to any genre. For example, according to the content of the live streaming that the liver is good at, it may be divided into a liver for game commentary and a liver for selling goods.
[0035] The attributes of the above-mentioned live streaming room include at least one of live streaming room identification, live streaming room name, and live streaming room type. The live streaming room type may be classified according to any genre. For example, the live streaming room may be divided into a live streaming room for selling items and a live streaming room for game commentary according to the use of the live streaming room. Furthermore, the live streaming room may be divided into live streaming rooms with different lengths of distribution according to the length of the distribution of the live streaming room.
[0036] In the embodiment of the present invention, after identifying the items in the live streaming room, the target attributes of the live streaming room can be obtained. Therefore, whether to play the effect can be determined according to whether the target attributes have been obtained and whether the effect has been obtained.
[0037] In the first situation, the target attributes could not be obtained. At this time, since the target attributes required for the effect are not specified, the effect is not played.
[0038] In the second situation, the target attributes were obtained, but the corresponding effect could not be obtained according to the items and the target attributes. At this time, since the effect could not be obtained, the effect is not played.
[0039] In the third situation, since the target attribute is acquired and the corresponding effect is acquired according to the item and the target attribute, the effect is reproduced.
[0040] In an embodiment of the present invention, a plurality of corresponding relationships used in S102 may be set in advance, and the items and / or target attributes and / or effects in different corresponding relationships are different.
[0041] Note that one item may correspond to a plurality of target attributes, and one effect corresponds to each target attribute. For example, when the target attribute is river identification, there are three corresponding relationships of {M1, ID1, SE1}, {M1, ID2, SE2}, and {M1, ID3, SE1}. Therefore, in the live broadcast room where the river identification is ID1, the effect corresponding to the item M1 is SE1, and in the live broadcast room where the river identification is ID2, the effect corresponding to the item M1 is SE2. In the live broadcast room where the river identification is ID3, the effect corresponding to the item M1 is SE1. In this way, the effect corresponding to the item M1 is associated in the live broadcast rooms of three rivers. The effect corresponding to M1 in the live broadcast room of river ID1 is different from the effect corresponding to the live broadcast room of river ID2. However, the effect corresponding to the live broadcast room of river ID1 is the same as the effect corresponding to the live broadcast room of river ID3.
[0042] As shown above, for the same item, the effect can be reproduced in the live broadcast rooms of a plurality of rivers, and the effects in different rivers may be the same or different. In this way, the effect corresponds not only to the item but also to the target attribute. When the items are different and the target attributes are different, the displayed effects can be made different, improving the flexibility of the effects.
[0043] Also, one target attribute may correspond to one or more items, and the effects corresponding to different items may be the same or different. For example, when the target attribute is river identification, there are three correspondence relationships of {M1, ID1, SE1}, {M2, ID1, SE2}, and {M3, ID1, SE1}. Therefore, in the live broadcast room where the river identification is ID1, the three items M1 to M3 all have corresponding effects. However, M1 and M2 correspond to different effects, and M1 and M3 correspond to the same effect SE1.
[0044] Finally, two effects may be corresponding to one target attribute and one item. For example, when the target attribute is river identification, there are two correspondence relationships of {M1, ID1, SE1} and {M1, ID1, SE2}. Therefore, in the live broadcast room where the river identification is ID1, the item M1 has two corresponding effects SE1 and SE2. That is, for the item M1, not only the effect SE1 but also the effect SE2 needs to be played. For example, in the live broadcast room where the river identification is ID1, when the item M1 taken out by the river is a trophy, not only the audio effect SE1 but also the video effect SE2 can be played.
[0045] After obtaining one or more of the above correspondence relationships, a target correspondence relationship that matches both the item identified in S101 and the target attribute corresponding to the live broadcast room in S101 may be selected from the one or more correspondence relationships, and the effect in the target correspondence relationship may be used as the effect to be played in S103.
[0046] The target correspondence relationship may be understood as a correspondence relationship including the item identified in S101 and the target attribute corresponding to the live broadcast room in S101.
[0047] S103: Play an effect in the above live streaming room.
[0048] The effect may include, but is not limited to, an image effect, a video effect, and an audio effect.
[0049] The above image effect is an effect displayed in an image. The image effect may be an image of one frame having specific content. For example, when the item is a trophy, the corresponding image effect may be an image of a trophy with the profile photo of the streamer attached.
[0050] The above video effect is an effect displayed in images of a plurality of consecutive frames. Each frame image may include specific content. For example, when the item is a trophy, the corresponding video effect may be a video of a trophy with the profile photo of the streamer attached.
[0051] The above audio effect is an effect expressed by sound. For example, when the item is a trophy, the corresponding audio effect may be the sound "Wow, you are the gold award winner".
[0052] In order to accurately play an effect according to the item in the live streaming room, the effect may be played when a predetermined condition is satisfied. The predetermined condition includes, but is not limited to, that the past playback times are less than or equal to a predetermined number threshold, the current time is within the valid period of the effect, the state of the item is the target item state, and the state of the streamer is the target streamer state. Specifically, when the above one or more predetermined conditions are satisfied, the above effect is played in the above live streaming room. When the above one or more predetermined conditions are not satisfied, the above effect is not played in the above live streaming room.
[0053] The relationship between various predetermined conditions and effect playback will be described below.
[0054] When the predetermined condition is that the past playback count is less than or equal to a predetermined count threshold, first, obtain the past playback count of the effect in the live distribution room within a predetermined time period. Next, determine the relationship between the past playback count and the predetermined count threshold. If the past playback count is less than or equal to the predetermined count threshold, play the effect in the live distribution room. If the past playback count is greater than the predetermined count threshold, do not play the effect in the live distribution room.
[0055] The predetermined time period may be several days, several hours, etc. Below, taking the case where the predetermined time period is 1 hour and the predetermined count threshold is 1 as an example, the playback status of the effect will be described.
[0056] At 10:05, an item in one live distribution room is detected at S101. At this time, since 0, which is the past playback count of the effect determined at S102 during the current time from 10 to 11 o'clock in this live distribution room, is less than the predetermined count threshold of 1, play that effect. Then, the past playback count of the effect in the live distribution room is updated from 0 to 1.
[0057] When this item is detected again at S101 at 10:10, since 1, which is the past playback count of the effect determined at S102 during the current time from 10 o'clock to 11 o'clock in this live distribution room, is equal to the predetermined count threshold of 1, play that effect. Then, the past playback count of the effect in the live distribution room is updated from 1 to 2.
[0058] When this item is detected again at S101 at 10:15, since the past playback count 2 of the effect determined at S102 in the live streaming room between 10:00 and 11:00, which is the current time, is greater than the predetermined count threshold 1, the effect is not played. And the past playback count of the effect in the live streaming room is not updated.
[0059] Similarly, between 10:15 and 11:00, the effect of this item is not displayed in this live streaming room.
[0060] It can be seen that by a predetermined condition consisting of the past playback count and the predetermined count threshold, when an item exists in a live streaming room for a long time, repeatedly displaying the effect of this item can be avoided, and furthermore, the impact on the normal live streaming of the live streaming room can be avoided.
[0061] The predetermined condition may be to judge the relationship between the current time and the effective period of the effect after the item is identified at S101 and the effect is determined at S102 when the current time is within the above effective period. If the current time is within this effective period, the effect determined at S102 in the live streaming room in S101 described above is played. If the current time is not within this effective period, the effect determined at S102 in the live streaming room in S101 described above is not played.
[0062] The effective period may be set in advance and is used to indicate the period during which the effect can be played in the live streaming room corresponding to the target attribute.
[0063] The above validity period may be associated with the correspondence relationship in S102. Specifically, one validity period corresponds to each of the correspondence relationships in S102 described above. In this way, in the live streaming rooms of different streamers, the validity periods of the same item may be the same or different. For example, the item identified by S101 is a trophy in 2015, and a validity period from 2015 to 2017 is set for this trophy. As a result, even if this trophy is detected in the live streaming room of this streamer after 2018, the effect of this trophy will not be displayed in this live streaming room.
[0064] The embodiments of the present disclosure may limit the playback time of the effect according to the above validity period, and it can be understood that this validity period may be the period during which this item has a great influence. For example, for the above trophy, after several years, the number of people interested in this trophy decreases and the influence weakens, so the validity period may be a certain period after the awarding time of this trophy.
[0065] When the predetermined condition is that the state of the item is the target item state, first, identify the state of the item in the live streaming room, and then determine whether the state of the item is the target item state. If the state of the item is the target item state, play the effect in the live streaming room; if the state of the item is not the target item state, do not play the effect in the live streaming room.
[0066] The target item state may include at least one of the held state and the position at the target position.
[0067] The above held state means that a person's hand is holding the item. That is, if the item is in a person's hand, it means that the streamer is showing this item, so the effect of this item is played. Conversely, if the item is not in a person's hand, the effect of this item is not played.
[0068] The target position may be a preset item display position. For example, the target position may be directly in front of the liver. That is, if the item is directly in front of the liver, it means that the liver is displaying this item, and thus, the effect of this item is reproduced. Conversely, if the item is not directly in front of the liver, the effect of this item is not reproduced.
[0069] The embodiments of the present invention can determine whether the liver is displaying an item according to the state of the item, and thus, can ensure that the effect is reproduced during the display of the item by the liver. Specifically, when the state of the item is the target item state, it is considered that the liver is displaying this item, and thus, the effect is reproduced. On the other hand, when the state of the item is not the state of the target item, it is considered that the liver is not displaying this item, and thus, the effect is not reproduced. In this way, the embodiments of the present invention can ensure that the reproduction of the effect is timely and avoid the reproduction of the effect at the wrong timing.
[0070] Under the predetermined conditions, when the state of the liver is the target liver state, first, identify the state of the liver in the live broadcast room, then determine whether the state of the liver is the target liver state. If the state of the liver is the target liver state, reproduce the effect in the live broadcast room; if the state of the liver is not the target liver state, do not reproduce the effect in the live broadcast room.
[0071] The target liver state includes at least one of the following: the gesture of the liver is a gesture towards the item, and the relative positional relationship between the liver and the item is the target positional relationship.
[0072] The gesture of the liver is a gesture towards the item and can indicate that the liver is displaying this item. For example, when the liver is displaying an item, it usually points at the item with a hand.
[0073] The relative positional relationship with respect to the target may be the relative positional relationship between any limb of the liver and the item. For example, when the liver faces this item with its face, or looks towards this item with its eyes, or turns the whole body towards this item, any of these relative positional relationships may also be the target positional relationship indicating that the liver is displaying this item.
[0074] The embodiments of the present invention can determine that the liver is displaying this item based on the state of the liver, and thus can ensure that an effect is played during the display of the item by the liver. In this way, the embodiments of the present invention can ensure that the playback of the effect is timely and avoid the playback of the effect at the wrong timing.
[0075] When the predetermined condition is that the existence time is less than or equal to a predetermined time threshold, first, identify the existence time of this item in the live streaming room, then determine the relationship between the existence time and the predetermined time threshold. If the existence time is less than or equal to the predetermined time threshold, play an effect in the live streaming room; if the existence time is greater than the predetermined time threshold, do not play an effect in the live streaming room.
[0076] The predetermined time threshold may be set to a small value so that the playback time of the effect does not become too long and affect the live streaming. For example, the predetermined time threshold may be set to 10 seconds so that the effect is played within the first 10 seconds after the item is displayed in the live streaming room, and the effect is not played even if the item is displayed in the live streaming room after 10 seconds.
[0077] When a plurality of predetermined conditions are set, it is necessary to reproduce an effect when the plurality of predetermined conditions are satisfied simultaneously. If at least one of the predetermined conditions is not satisfied, the effect is not reproduced. For example, the set predetermined conditions are that the past number of reproductions is less than or equal to a predetermined number threshold, the current time is within the valid period of the effect, the state of the item is the target item state, and. When the river state is the target river state, if the past number of reproductions is less than or equal to a predetermined number threshold, and the current time is within the valid period of the effect, and the state of the item is the target item state, and the river state is the target river state, the effect is reproduced. However, when the past number of reproductions becomes greater than the predetermined number threshold, and / or the current time is not within the valid period of the effect, and / or the state of the item is not the target item state, and / or the river state is not the target river state, the effect is not reproduced.
[0078] In addition, when the above effect is an image effect or a video effect, when reproducing the above effect in a live streaming room, the image effect or the video effect may be reproduced according to the position of the item in the live streaming room. Specifically, the effect is reproduced around the item in the live streaming room. Thereby, the relationship between the effect and the item can be made clearer. For example, an image effect or a video effect may be reproduced to the left, right, above, or below the trophy.
[0079] Normally, since the live streaming time is long and the river may display different items at different times during the live streaming, it is understood that the effects corresponding to each item may be reproduced one by one in chronological order. For example, at time t1, the river displays item M1, and the effect of item M1 may be reproduced at time t1. At time t2, the river also displays item M2, and the effect of item M2 may be reproduced at time t2. Of course, the effects of M1 and M2 may be the same or different.
[0080] Corresponding to the method for playing effects in the live streaming room of the above embodiment, FIG. 3 is a block diagram of the configuration of an apparatus for playing effects in a live streaming room provided by an embodiment of the present disclosure applied to a system for playing effects in a live streaming room. For the sake of convenience of explanation, only parts related to the embodiments of the present disclosure are shown. Referring to FIG. 3, the apparatus 200 for playing effects in the live streaming room includes an item identification module 201, an effect determination module 202, and an effect playback module 203.
[0081] The item identification module 201 is used to identify items in the live streaming room.
[0082] The effect determination module 202 is used to determine corresponding effects according to the item and the target attributes of the live streaming room, and the correspondence between the item, the target attributes, and the effects is preset.
[0083] The effect playback module 203 is used to play the effects in the live streaming room.
[0084] Optionally, the target attributes include at least one of the attributes of the live streamer in the live streaming room and the attributes of the live streaming room.
[0085] Optionally, the attributes of the live streamer include at least one of the streamer identification, the streamer name, and the streamer type.
[0086] Optionally, the attributes of the live streaming room include at least one of the live streaming room identification, the live streaming room name, and the live streaming room type.
[0087] Optionally, the effect playback module 203 When the predetermined conditions are satisfied, it is also used to play the effect in the live broadcast room. The predetermined conditions include that the past playback count of the effect in the live broadcast room within a predetermined time period is equal to or less than a predetermined count threshold, the current time is within the valid period of the effect for indicating the period during which the effect can be played in the live broadcast room corresponding to the target attribute, the state of the item in the live broadcast room is the target item state, the state of the live broadcaster in the live broadcast room is the target live broadcaster state, and at least one of the presence time of the item in the live broadcast room being equal to or less than a predetermined time threshold is included.
[0088] Optionally, the target item state includes at least one of a held state and being located at a target position.
[0089] Optionally, the target live broadcaster state includes at least one of the gesture of the live broadcaster being a gesture towards the item and the relative positional relationship between the live broadcaster and the item being a target positional relationship.
[0090] Optionally, the effect includes at least one of an image effect, a video effect, and an audio effect.
[0091] Optionally, when the effect is an image effect or a video effect, the effect playback module 203 is also used to play the effect around the item in the live broadcast room.
[0092] The effect playback device for the live broadcast room provided by this embodiment can be used to execute the technical solution of the method embodiment shown in FIG. 2 above. Its realization principle and technical effects are similar, and this embodiment will not be repeatedly described here.
[0093] FIG. 4 is a block diagram of the configuration of an electronic device 600 provided according to an embodiment of the present disclosure. The electronic device 600 includes a memory 602 and at least one processor 601.
[0094] The memory 602 stores computer-executable instructions.
[0095] At least one processor 601 executes the computer-executable instructions stored in the memory 602 so that the electronic device 600 implements the method in FIG. 2 above.
[0096] Further, the electronic device may further include a receiver 603 for receiving information from other devices or apparatuses and transferring it to the processor 601, and a transmitter 604 for transmitting information to other devices or apparatuses.
[0097] Furthermore, referring to FIG. 5, a schematic diagram of the configuration of an electronic device 900 suitable for implementing an embodiment of the present disclosure is shown. The electronic device 900 may be a terminal device. The terminal device may include, for example, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (abbreviated as PDAs), tablets (abbreviated as PADs), portable media players (abbreviated as PMPs), in-vehicle terminals (such as car navigation terminals), etc., and fixed terminals such as digital televisions (TVs), desktop computers, etc., but is not limited thereto. The electronic device shown in FIG. 5 is merely an example and does not limit the functions and usage ranges of the embodiments of the present disclosure.
[0098] As shown in FIG. 5, the electronic device 900 may include a processing device (e.g., a central processor, a graphics processor, etc.) 901 that can execute various appropriate operations and processes according to a program stored in a read-only memory (abbreviated as ROM) 902 or a program loaded from a storage device 908 into a random access memory (abbreviated as RAM) 903. Various programs and data necessary for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.
[0099] Generally, an input device 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc., an output device 907 including, for example, a liquid crystal display (abbreviated as LCD), a speaker, a vibrator, etc., a storage device 908 including, for example, a magnetic tape, a hard disk, etc., and a communication device 909 may be connected to the I / O interface 905. The communication device 909 can enable the electronic device to communicate with other devices wirelessly or wiredly to exchange data. Although FIG. 5 shows an electronic device 900 having various devices, it should be understood that it is not necessary to implement or include all of the illustrated devices. Instead, it is also possible to implement or include more or fewer devices.
[0100] In particular, according to the embodiments of the present disclosure, the process described with reference to the above flowchart can be implemented as a computer software program. For example, the embodiments of the present disclosure include a computer program product. The computer program product includes a computer program carried on a non-transitory computer-readable storage medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 909, or may be installed from the storage device 908 or the ROM 902. When the computer program is executed by the processing device 901, the above-described functions defined in the method according to the embodiments of the present disclosure are executed.
[0101] Note that the computer-readable storage medium in the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, electrical, magnetic, optical, electromagnetic, infrared, or a semiconductor system, apparatus, or device. Alternatively, it may be any combination thereof, but is not limited thereto. More specific examples of the computer-readable storage medium include an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (Electrical Programmable Read Only Memory, EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (Compact Disc Read Only Memory, CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination of the above, but is not limited thereto. In the present disclosure, the computer-readable storage medium may be any tangible medium that includes or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a data signal that is propagated in a baseband or propagated as part of a carrier wave on which a computer-readable program code is carried. Such a propagated data signal may take various forms and may include electromagnetic signals, optical signals, or any suitable combination of the above, but is not limited thereto. The computer-readable signal medium may be any computer-readable storage medium other than a computer-readable storage medium that can transmit, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device.The program code included in a computer-readable storage medium may be transmitted via any suitable medium, including but not limited to wires, optical cables, radio frequency (RF), or any suitable combination thereof.
[0102] The computer-readable storage medium may be included in the above-described electronic device or may exist alone without being incorporated into the electronic device.
[0103] The computer-readable storage medium stores one or more programs, and when the one or more programs are executed by an electronic device, the electronic device is caused to execute the methods shown in the above embodiments.
[0104] The computer program code for performing the operations of the present disclosure can be described in one or more programming languages, or combinations thereof. The programming languages include, but are not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as the "C" language. The program code may be executed entirely on the user's computer, partially on the user's computer, may be executed as a stand-alone software package, partially on the user's computer and partially on a remote computer, or may be executed entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., connected via the Internet using an Internet service provider).
[0105] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of systems, methods, and computer program products that can be implemented according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of code. The module, program segment, or part of code includes one or more executable instructions for implementing a given logical function. Also, note that in some alternative implementations, the functions shown within the boxes can occur in an order different from that shown. For example, two boxes shown consecutively can actually be executed substantially in parallel by related functions, or in reverse order. Further, each box in the block diagram and / or flowchart, and combinations of boxes in the block diagram and / or flowchart, can be implemented using a dedicated hardware-based system for performing a given function or operation, or using a combination of dedicated hardware and computer instructions.
[0106] In the embodiments of the present disclosure, the units described can be implemented in software or in hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may be described as "a unit for acquiring at least two Internet protocol addresses".
[0107] The functions described above in this specification can be executed, at least in part, by one or more hardware logic elements. For example, examples of hardware logic elements that can be used include Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System On Chip (SOC), Complex Programmable Logic Device (CPLD), and the like.
[0108] In a first example of the first aspect, embodiments of the present disclosure include identifying an item in a live streaming room, determining a corresponding effect according to the item and target attributes of the live streaming room, and playing the effect in the live streaming room, and provide a method for playing an effect in a live streaming room, where the correspondence between the item, the target attribute, and the effect is preset. The correspondence between the item, the target attribute, and the effect is preset.
[0109] Based on the first example of the first aspect, in a second example of the first aspect, the target attribute includes at least one of the streamer attribute of the live streaming room and the attribute of the live streaming room.
[0110] Based on the second example of the first aspect, in a third example of the first aspect, the streamer attribute includes at least one of streamer identification, streamer name, and streamer type.
[0111] Based on the second example of the first aspect, in the fourth example of the first aspect, the attributes of the live streaming room include at least one of a live streaming room identification, a live streaming room name, and a live streaming room type.
[0112] Based on any one of the first to fourth examples of the first aspect, in the fifth example of the first aspect, playing the effect in the live streaming room includes playing the effect in the live streaming room when a predetermined condition is satisfied, and the predetermined condition includes at least one of: the past playback count of the effect in the live streaming room within a predetermined time period is less than or equal to a predetermined count threshold; the current time is within the effective period of the effect for indicating a period during which the effect can be played in the live streaming room corresponding to the target attribute; the state of the item in the live streaming room is a target item state; the state of the live streamer in the live streaming room is a target live streamer state; and the existence time of the item in the live streaming room is less than or equal to a predetermined time threshold.
[0113] Based on the fifth example of the first aspect, in the sixth example of the first aspect, the target item state includes at least one of a held state and being located at a target position.
[0114] Based on the fifth example of the first aspect, in the seventh example of the first aspect, the target live streamer state includes at least one of: the gesture of the live streamer is a gesture towards the item; and the relative positional relationship between the live streamer and the item is a target positional relationship.
[0115] Based on any one of the first to fourth examples of the first aspect, in the eighth example of the first aspect, the effect includes at least one of an image effect, a video effect, and an audio effect.
[0116] Based on the eighth example of the first aspect, in a ninth example of the first aspect, when the effect is an image effect or a video effect, playing the effect in the live streaming room includes: and playing the effect around the item in the live streaming room.
[0117] In a first example of the second aspect, an item identification module for identifying an item in a live streaming room; an effect determination module for determining a corresponding effect according to target attributes of the item and the live streaming room; an effect playback module for playing back the effect in the live streaming room; The effect reproducing device for a live distribution room is provided, in which the correspondence between the item, the target attribute, and the effect is set in advance.
[0118] Based on the first example of the second aspect, in the second example of the second aspect, the target attributes include at least one of the attributes of the live streamer of the live streaming room and the attributes of the live streaming room.
[0119] Based on the second example of the second aspect, in a third example of the second aspect, the liver attributes include at least one of liver identification, liver name, and liver type.
[0120] Based on the second example of the second aspect, in a fourth example of the second aspect, the attributes of the live streaming room include at least one of a live streaming room identification, a live streaming room name, and a live streaming room type.
[0121] Based on any one of the first to fourth examples of the second aspect, in a fifth example of the second aspect, the effect reproduction module When a predetermined condition is satisfied, it is also used to play the effect in the live streaming room. The predetermined condition includes at least one of the following: the past number of times the effect has been played in the live streaming room within a predetermined time period is less than or equal to a predetermined number threshold; the current time is within the effective period of the effect for indicating the period during which the effect can be played in the live streaming room corresponding to the target attribute; the state of the item in the live streaming room is the target item state; the state of the live streamer in the live streaming room is the target live streamer state; and the existence time of the item in the live streaming room is less than or equal to a predetermined time threshold. The effective period is used for...
[0122] Based on the fifth example of the second aspect, in the sixth example of the second aspect, the target item state includes at least one of the held state and the state of being located at the target position.
[0123] Based on the fifth example of the second aspect, in the seventh example of the second aspect, the target live streamer state includes at least one of the state where the gesture of the live streamer is a gesture towards the item and the state where the relative positional relationship between the live streamer and the item is the target positional relationship.
[0124] Based on any one of the first to fourth examples of the second aspect, in the eighth example of the second aspect, the effect includes at least one of an image effect, a video effect, and an audio effect.
[0125] Based on the eighth example of the second aspect, in the ninth example of the second aspect, when the effect is an image effect or a video effect, the effect playback module is also used to play the effect around the item in the live streaming room. It is also used to play the effect around the item in the live streaming room.
[0126] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device comprising at least one processor and a memory, wherein the memory stores computer-executable instructions, and when the computer-executable instructions stored in the memory are executed by the at least one processor, the method according to any one of the first aspect is realized.
[0127] In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium storing computer-executable instructions, and when the computer-executable instructions are executed by a processor, the method according to any one of the first aspect is realized on a computing device.
[0128] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program for realizing the method according to any one of the first aspect.
[0129] In a sixth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program product including a computer program which, when executed by a processor, realizes the method according to any one of the first aspect.
[0130] The above description is only an explanation of the preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art should understand that the disclosure scope of the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and other technical solutions formed by any combination of the above disclosed technical features or their equivalent features without departing from the above disclosed gist should also be included. For example, the technical solutions formed by replacing the above features with technical features having similar functions (but not limited to these) disclosed in the present disclosure are also included.
[0131] Also, although the operations have been described in a particular order, these operations should not be construed as requiring that they be performed in the particular order shown or in sequential order. In certain environments, multitasking and parallel processing may be advantageous. Similarly, some of the specific implementation details described above should not be construed as limiting the scope of the present disclosure. The particular features described in individual embodiments can be implemented in combination in a single embodiment. Conversely, each feature described in a single embodiment can be implemented alone or in any suitable combination in multiple embodiments.
[0132] Although the subject matter of the present disclosure has been described in terms of structural features and / or logical operations specific to methods, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely exemplary forms for implementing the claims.
Claims
1. Identifying an item in a live streaming room; Determining a corresponding effect according to the item and the target attribute of the live streaming room; Playing the effect in the live streaming room, including: The correspondence between the item, the target attribute, and the effect is preset; Playing the effect in the live streaming room means: When a predetermined condition is satisfied, playing the effect in the live streaming room, including: The predetermined condition includes at least one of the following: the past playback times of the effect in the live streaming room within a predetermined time period are less than or equal to a predetermined number threshold; the current time is within the valid period of the effect for indicating a period during which the effect can be played in the live streaming room corresponding to the target attribute; the state of the item in the live streaming room is the target item state; the state of the liver in the live streaming room is the target liver state; and the existence time of the item in the live streaming room is less than or equal to a predetermined time threshold; A method for playing an effect in a live streaming room.
2. The target attribute includes at least one of the liver attribute of the live streaming room and the attribute of the live streaming room. The method according to claim 1.
3. The liver attribute includes at least one of liver identification, liver name, and liver type. The method according to claim 2.
4. The attribute of the live streaming room includes at least one of live streaming room identification, live streaming room name, and live streaming room type. The method according to claim 2 or 3.
5. The target item state includes at least one of the held state and being located at the target position. The method according to claim 1.
6. The target liver state includes at least one of the gesture of the liver being a gesture for the item and the relative positional relationship between the liver and the item being the target positional relationship. The method according to claim 1.
7. The effect includes at least one of an image effect, a video effect, and an audio effect. The method according to any one of claims 1 to 3.
8. When the effect is an image effect or a video effect, playing the effect in the live streaming room includes playing the effect around the item in the live streaming room. The method according to any one of claims 1 to 3.
9. An item identification module for identifying an item in a live streaming room, an effect determination module for determining a corresponding effect according to the item and target attributes of the live streaming room, and an effect playback module for playing the effect in the live streaming room, and the correspondence between the item, the target attribute, and the effect is preset, the effect playback module plays the effect in the live streaming room when a predetermined condition is satisfied, the predetermined condition includes that the past playback times of the effect in the live streaming room within a predetermined time period are less than or equal to a predetermined number threshold, the current time is within the valid period of the effect for indicating a period during which the effect can be played in the live streaming room corresponding to the target attribute, the state of the item in the live streaming room is the target item state, the state of the liver in the live streaming room is the target liver state, and the existence time of the item in the live streaming room is less than or equal to a predetermined time threshold, and at least one of them is included. An effect playback device for a live streaming room.
10. Comprising at least one processor and a memory, the memory stores computer-executable instructions, when the computer-executable instructions stored in the memory are executed by the at least one processor, an electronic device that realizes the method according to any one of claims 1 to 3.
11. Stores computer-executable instructions, when the computer-executable instructions are executed by a processor, causes a computing device to realize the method according to any one of claims 1 to 3. A computer-readable storage medium.
12. A computer program for implementing the method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Character virtual gift content recommendation method, device and equipment and storage medium
CN111031334A
Virtual gift display method, device and equipment and storage medium
CN111225231A
Virtual object transfer method and device, electronic equipment and storage medium
CN112738543A
Live streaming room interaction method and device, electronic equipment and storage medium
CN112738544A
Method and device for controlling video display
CN113301356A