Special effect display method, device, equipment, storage medium and product

Abstract

An embodiment of the present disclosure provides a special effect display method, an apparatus, a device, a storage medium, and a product, the method including: obtaining a special effect trigger command, where the special effect trigger command corresponds to a first image frame in a streaming content of a live space, and the special effect trigger command further corresponds to first special effect information; in response to the special effect trigger command, determining target special effect information according to the first special effect information and a target object in the first image frame; and sending the target special effect information to a first client terminal device associated with the live space, so as to cause the first client terminal device to display a special effect corresponding to the target special effect information.

Description

[Technical field]

[0001] TECHNICAL FIELD The embodiments of the present disclosure relate to the field of data processing technology, and in particular to a special effect display method, device, apparatus, storage medium and product. [Background technology]

[0002] With the continuous advancement of network technology, online live streaming has gradually entered into users' lives. Online live streaming refers to broadcasting one's video and audio in real time on the Internet through a terminal so that everyone on the Internet can watch it. During live streaming, users can give virtual objects corresponding to the corresponding special effect information to live streamers, or live streamers can select different special effects to use during live streaming. Summary of the Invention [Problem to be solved by the invention]

[0003] The embodiments of the present disclosure provide a special effect display method, an apparatus, a device, a storage medium, a computer program product, and a computer program. [Means for solving the problem]

[0004] In a first aspect, an embodiment of the present disclosure provides a special effect display method, the method comprising: Obtaining a special effect trigger command, the special effect trigger command corresponding to a first image frame in a streaming content of a live space, the special effect trigger command further corresponding to first special effect information; determining target special effect information according to the first special effect information and a target object in the first image frame in response to the special effect trigger command; transmitting the target special effect information to a first client terminal device associated with the live space, and causing the first client terminal device to display a special effect corresponding to the target special effect information.

[0005] In a second aspect, an embodiment of the present disclosure provides a special effect display method, the method comprising: Displaying live spatial streaming content; and In response to detecting a special effect triggering operation, determining first time information corresponding to the special effect triggering operation to determine first special effect information corresponding to the special effect triggering operation; Sending a special effect trigger command to a server, the special effect trigger command indicating the first special effect information, and the special effect trigger command further indicating a first image frame in the streaming content of the live space corresponding to the first time information; obtaining a special effect display command from the server, the special effect display command indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame; and displaying a special effect corresponding to the target special effect information.

[0006] In a third aspect, an embodiment of the present disclosure provides a special effect display method, the method comprising: pushing streaming content to a first client terminal device and a second client terminal device associated with the live space; Obtaining a special effect trigger command from the first client terminal device, the special effect trigger command indicating target special effect information, the target special effect information being associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information including special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponding to first time information, and the first image frame including an image frame in the streaming content of the live space corresponding to the first time information; transmitting the target special effect information to the second client terminal device to cause the second client terminal device to display a special effect corresponding to the target special effect information.

[0007] In a fourth aspect, an embodiment of the present disclosure provides a special effect display device, the device comprising: An acquisition module for acquiring a special effect trigger command, the special effect trigger command corresponding to a first image frame in a streaming content of a live space, the special effect trigger command further corresponding to a first special effect information; a determining module responsive to the special effect trigger command for determining target special effect information according to the first special effect information and a target object in the first image frame; and a transmitting module for transmitting the target special effect information to a first client terminal device associated with the live space, and causing the first client terminal device to display a special effect corresponding to the target special effect information.

[0008] In a fifth aspect, an embodiment of the present disclosure provides a special effect display device, the device comprising: a content display module for displaying streaming content in a live space; a special effect determination module for determining, in response to detecting a special effect trigger operation, first time information corresponding to the special effect trigger operation, and determining first special effect information corresponding to the special effect trigger operation; A command sending module for sending a special effect trigger command to a server, the special effect trigger command indicating the first special effect information, and the special effect trigger command further indicating a first image frame in the streaming content of the live space corresponding to the first time information; an instruction acquisition module for acquiring a special effect display instruction from the server, the special effect display instruction indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame; a special effect display module for displaying a special effect corresponding to the target special effect information.

[0009] In a sixth aspect, an embodiment of the present disclosure provides a special effect display device, the device comprising: a content push module for pushing streaming content to a first client terminal device and a second client terminal device associated with the live space; a command acquisition module for acquiring a special effect trigger command from the first client terminal device, the special effect trigger command indicating target special effect information, the target special effect information being associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information including special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponding to first time information, and the first image frame including an image frame in the streaming content of the live space corresponding to the first time information; a target special effect transmitting module for transmitting the target special effect information to the second client terminal device, and causing the second client terminal device to display a special effect corresponding to the target special effect information.

[0010] In a seventh aspect, an embodiment of the present disclosure provides a special effect display device, the device including a memory and a processor; the memory is used to store computer instructions; The processor is adapted to execute computer instructions stored in the memory to cause the special effect display device to realize the special effect display method described in the first, second or third aspect.

[0011] In an eighth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions, when executed by a computing device, causing the computing device to implement the special effect display method described in the first aspect, the second aspect, or the third aspect.

[0012] In a ninth aspect, an embodiment of the present disclosure provides a computer program product including a computer program, which, when executed by a processor, realises the special effect display method described in the first aspect, the second aspect or the third aspect.

[0013] In a tenth aspect, an embodiment of the present disclosure provides a computer program, which, when executed by a processor, realises the special effect display method described in the first aspect, the second aspect or the third aspect. [Brief description of the drawings]

[0014] In order to more clearly describe the embodiments of the present disclosure or the solutions in the prior art, the drawings that need to be used in the description of the embodiments or the prior art will be briefly described below. Of course, the drawings described below are some embodiments of the present disclosure, and those skilled in the art can think of other drawings based on these drawings without creative efforts. [Figure 1] 1 is a flowchart of a special effect display method provided by Example 1 of the present disclosure. [Diagram 2] FIG. 1 is a system architecture diagram on which embodiments of the present disclosure are based. [Diagram 3]FIG. 2 is another system architecture diagram on which embodiments of the present disclosure are based. [Figure 4] 4 is a flowchart of a special effect display method provided by Example 2 of the present disclosure. [Diagram 5] 11 is a flowchart of a special effect display method provided by Example 3 of the present disclosure. [Figure 6] FIG. 2 is a schematic diagram of one display screen provided by an embodiment of the present disclosure. [Figure 7] FIG. 2 is a schematic diagram of another display screen provided by an embodiment of the present disclosure. [Figure 8] 11 is a flowchart of a special effect display method provided by Example 4 of the present disclosure. [Figure 9] 11 is a flowchart of a special effect display method provided by Example 5 of the present disclosure. [Figure 10] 11 is a flowchart of a special effect display method provided by Example 6 of the present disclosure. [Figure 11] FIG. 11 is a structural schematic diagram of a special effect display device provided in accordance with Example 7 of the present disclosure. [Figure 12] FIG. 11 is a structural schematic diagram of a special effect display device provided in Example 8 of the present disclosure. [Figure 13] FIG. 11 is a structural schematic diagram of a special effect display device provided by Example 9 of the present disclosure. [Figure 14] FIG. 16 is a structural schematic diagram of a special effect display device provided by Example 10 of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] In order to make the objectives, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions will be described clearly and completely below with reference to the drawings of the embodiments of the present disclosure, but it should be understood that the described embodiments are only a part of the embodiments of the present disclosure, and are not all of the embodiments. All other embodiments obtained by those skilled in the art without creative labor based on the embodiments in the present disclosure all belong to the protection scope of the present disclosure.

[0016] In response to the problem of the above-mentioned related special effect fusion methods during live streaming blocking the fused special effects and making it impossible to fully display the special effect information, the present disclosure provides a special effect display method, device, equipment, storage medium, and product.

[0017] The special effect display method, device, equipment, storage medium, and product provided by the present disclosure can be applied to special effect display scenes of various virtual objects in live spaces.

[0018] In the related art, when a special effect is triggered, the fusion operation between the special effect and the live streaming content is generally realized on the live stream user side. Specifically, the live streaming image data is acquired on the live stream user side, the image data is fused with the special effect, and the fused data can be transmitted to the user side watching the live broadcast by means of a video stream and displayed. However, when the special effect fusion is performed using the above method, when the user side watching the live broadcast plays back the fused data transmitted from the live stream user side, data such as comments and live space notifications are simultaneously displayed on the screen, blocking the fused special effect and making it impossible to completely display the special effect information.

[0019] In order to solve the above technical problems, the inventors have conducted intensive research and discovered that a special effect trigger command corresponding to a first image frame and a first special effect information can be generated, and target special effect information can be synthesized on the client terminal device side or the server side according to the special effect trigger command, and the target special effect information can be transmitted to a first client terminal device related to the live space for display. As a result, there is no need for the live streamer's terminal device to perform a special effect fusion operation, and by simply determining the first image frame and the first special effect information, the synthesis of the target special effect information and the display of the corresponding special effect can be realized on the client terminal device or the server, and data in the live space will no longer obstruct the special effect corresponding to the target special effect information.

[0020] FIG. 1 is a flowchart of a special effect display method provided in the first embodiment of the present disclosure. As shown in FIG. 1, the method includes steps 101 to 103.

[0021] In step 101, a special effect trigger command is obtained, the special effect trigger command corresponds to a first image frame in a streaming content of a live space, and the special effect trigger command further corresponds to first special effect information.

[0022] The execution subject of this embodiment is a special effect display device, which may be coupled into a client terminal device or into a server, and the present disclosure is not limited thereto.

[0023] In this embodiment, in order to realize the display of a special effect, a special effect trigger command can first be obtained. Specifically, the special effect trigger command may be generated after it is detected that a user watching a live broadcast sends a virtual object to a target live streamer corresponding to the live space, or the special effect trigger command may be generated by a target live streamer's user triggering a special effect according to actual needs.

[0024] Specifically, the special effect trigger command may correspond to a first image frame in the streaming content of the live space, and the streaming content may specifically be live streaming video data of the target live streamer user that is sent to the client terminal device and displayed by using a stream means. The special effect trigger command also corresponds to first special effect information. With reference to the above example, the first special effect information may be special effect information corresponding to a virtual object, or the first special effect information may be special effect information corresponding to a special effect triggered by the target live streamer user according to actual needs. Here, the live space is a virtual space having an interconnected relationship.

[0025] Step 102, in response to the special effect trigger command, determines target special effect information according to the first special effect information and a target object in the first image frame.

[0026] In this embodiment, after obtaining a special effect trigger command, in response to the special effect trigger command, a fusion operation can be performed based on the first special effect information and the first image frame to obtain target special effect information.

[0027] Specifically, an image recognition operation can be performed on a first image frame to obtain a target object corresponding to the first image frame, and a fusion operation can be performed on the first special effect information and the target object to obtain the target special effect information.

[0028] Alternatively, the first special effect information can be merged into a preset position or a user-specified position in the first image frame to obtain the target special effect information, although the present disclosure is not limited thereto.

[0029] In step 103, the target special effect information is transmitted to a first client terminal device associated with the live space, and a special effect corresponding to the target special effect information is displayed on the first client terminal device.

[0030] In this embodiment, after generating the target special effect information, the target special effect information can be sent to a first client terminal device. Here, the first client terminal device may specifically be a client terminal device of a viewer in a live space. In response, the first client terminal device can obtain the target special effect information and then display a special effect corresponding to the target special effect information.

[0031] Here, the target special effect information may be integrated special effect information, or may be a group of data including the first special effect information and the target object, so that the first client terminal device can display the special effect corresponding to the target special effect information.

[0032] In the special effect display method provided by this embodiment, after obtaining a special effect trigger command, target special effect information is generated based on the first image frame and first special effect information in the streaming content of the live space corresponding to the special effect trigger command, and the target special effect information is sent to a first client terminal device related to the live space, so that the first client terminal device displays the special effect corresponding to the target special effect information. This eliminates the need for special effect fusion operations on the live streamer's terminal device, and by simply determining the first image frame and the first special effect information, the synthesis of the target special effect information and the display of the corresponding special effect can be realized on the client terminal device or server, and data in the live space will no longer obstruct the special effect corresponding to the target special effect information.

[0033] Further, based on Example 1, before step 101, the method further comprises: The method further includes the steps of: in response to detecting a special effect trigger operation, determining first time information corresponding to the special effect trigger operation; determining the first image frame in the streaming content of the live space corresponding to the first time information; and determining the first special effect information corresponding to the special effect trigger operation.

[0034] 2 is a system architecture diagram on which this embodiment is based. As shown in FIG. 2, the system architecture includes a live streamer client terminal device 21 and a first client terminal device 22, among which, a special effect display device written in a language such as C / C++, Java (registered trademark), Shell or Python is arranged in the live streamer client terminal device 21, and the live streamer client terminal device 21 and the first client terminal device 22 can be, for example, a mobile phone, a desktop computer, a tablet computer, etc. The live streamer client terminal device 21 and the first client terminal device 22 are communicatively connected to enable information interaction.

[0035] Based on the above system architecture, the execution subject of this embodiment can be specifically a special effect display device, and the special effect display device can be coupled in the first client terminal device 22. In response to detecting a special effect trigger operation, the special effect display device can determine first time information corresponding to the special effect trigger operation. Here, the first time information can be specifically information about the time of a virtual object gift operation triggered by a user watching a live space, or information about the time when a live streamer user in a live space triggers special effect information.

[0036] Since the streaming content includes multiple image frames being live-streamed in the live space and timestamps corresponding to each image frame, it is possible to determine a first image frame in the streaming content that corresponds to the first time information based on the first time information.

[0037] Determine the first special effect information corresponding to the special effect trigger operation. Specifically, the special effect trigger operation may include special effect identifier information. Therefore, the first special effect information corresponding to the special effect identifier information can be obtained in the preset data server according to the special effect identifier information.

[0038] Further, based on the first embodiment, step 101 specifically includes: Responsive to detecting a special effect trigger operation, generating the special effect trigger command.

[0039] In this embodiment, the special effect display device can obtain a special effect trigger operation of a user, which may be a virtual object sending operation of a user watching a live space, or a special effect selection operation of a live streamer user corresponding to the live space, and generate a special effect trigger command based on the special effect trigger operation.

[0040] Further, based on Example 1, after step 102, the method further comprises: The method further includes displaying a special effect corresponding to the target special effect information.

[0041] In this embodiment, the special effect display device coupled in the first client terminal device can directly control the preset display screen to display the target special effect information after generating the target special effect information. Optionally, the first client terminal device can also transmit the target special effect information to all other first client terminal devices related to the live space, so as to make the other first client terminal devices display the target special effect information.

[0042] The special effect display method provided by this embodiment involves a special effect display device coupled in a first client terminal device generating target special effect information based on a first image frame and first special effect information in the streaming content of the live space corresponding to the special effect trigger command, transmitting the target special effect information to a first client terminal device related to the live space, and causing the first client terminal device to display special effects corresponding to the target special effect information. This eliminates the need for special effect fusion operations in the live streamer's terminal device, and allows the generation of target special effect information in the first client terminal based only on the special effect trigger command, thereby improving the efficiency of generating the target special effect information and avoiding the problem of special effects being blocked after data fusion is performed in the live streamer's client terminal device.

[0043] Further, based on any of the above embodiments, step 101 specifically includes: The method includes obtaining the special effect trigger command from the first client terminal device, the special effect trigger command indicating the first image frame, and the special effect trigger command further indicating the first special effect information.

[0044] 3 is another system architecture diagram on which the embodiment of the present disclosure is based, as shown in FIG. 3, the system architecture includes at least a server 31 and a first client terminal device 32, in which the server 31 is configured with a special effect display device written in languages ​​such as C / C++, Java, Shell or Python, and the first client terminal device 32 can be, for example, a mobile phone, a desktop computer, a tablet computer, etc. The server 31 and the first client terminal device 32 are communicatively connected to enable information interaction.

[0045] Based on the above system architecture, the execution subject of this embodiment is a special effect display device, and the special effect display device can be coupled in a server. The special effect display device can obtain a special effect trigger command from a first client terminal device, in which the special effect trigger command indicates a first image frame and a first special effect information. Here, the special effect trigger command is generated after the first client terminal device detects a special effect trigger operation preset by a live streamer user or a viewer user. The special effect trigger operation may specifically be a virtual object gift operation of a user watching a live space, or a special effect selection operation of a live streamer user corresponding to the live space.

[0046] Further, based on any of the above embodiments, the special effect trigger instruction indicating the first image frame may further include: The special effect trigger command indicates first time information, and the first image frame includes the first image frame in the streaming content of the live space that corresponds to the first time information.

[0047] In this embodiment, the special effect trigger command indicates first time information, and the first time information may be information about the time of a virtual object gift operation triggered by a user watching the live space, or a live streamer in the live space may trigger a special effect. information The information may be information regarding the time at which the trigger is to be performed.

[0048] Since the streaming content includes multiple image frames being live-streamed in the live space and timestamps corresponding to each image frame, it is possible to determine a first image frame in the streaming content that corresponds to the first time information based on the first time information.

[0049] Further, based on any of the above embodiments, after step 102, the method further comprises: The method further includes transmitting the target special effect information to a second client terminal device associated with the live space, and causing the second client terminal device to display a special effect corresponding to the target special effect information.

[0050] In this embodiment, after generating the target special effect information, the target special effect information can be sent to all second client terminal devices related to the live space, so that the second client terminal devices can obtain the target special effect information and then display special effects corresponding to the target special effect information.

[0051] The special effect display method provided by this embodiment involves a special effect display device coupled in a server generating target special effect information based on a first image frame and first special effect information in the streaming content of the live space corresponding to the special effect trigger command, and transmitting the target special effect information to a second client terminal device related to the live space, thereby causing the second client terminal device to display special effects corresponding to the target special effect information. This eliminates the need for special effect fusion operations to be performed in the live streamer's terminal device, and allows the generation of target special effect information to be realized in the second client terminal solely based on the special effect trigger command, thereby improving the efficiency of generating the target special effect information and avoiding the problem of special effects being blocked after data fusion is performed in the live streamer's client terminal device.

[0052] FIG. 4 is a flowchart of a special effect display method provided by the second embodiment of the present disclosure. Based on the first embodiment, as shown in FIG. 4, step 102 specifically includes step 401 and step 402.

[0053] In step 401, for the first image frame, Approval A recognition operation is performed to obtain the target object.

[0054] In step 402, a data fusion operation is performed on the target object and the first special effect information to obtain the target special effect information.

[0055] In this embodiment, after obtaining a special effect trigger command, a fusion operation can be performed based on the first image frame and the first special effect information indicated by the special effect trigger command to obtain the target special effect information.

[0056] Specifically, a recognition operation can be performed on the profile image of the live streamer in the first image frame to obtain a target object, and the target object is specifically the live streamer's Local (e.g., head) A data fusion operation is performed on the target object and the first special effect information to obtain the target special effect information.

[0057] Optionally, the special effect trigger command can further indicate a position of special effect fusion, so that the first special effect information can be fused to the special effect fusion position in the first image frame according to the position of the special effect fusion to obtain the target special effect information.

[0058] The special effect display method provided in this embodiment performs an image recognition operation on a first image frame to obtain a target object, and performs a data fusion operation on the target object and the first special effect information to obtain the target special effect information, thereby improving the degree of fusion between the first special effect information and the first image frame and improving the display effect of the target special effect information.

[0059] FIG. 5 is a flowchart of a special effect display method provided in the third embodiment of the present disclosure. Based on the first embodiment, as shown in FIG. 5, step 102 specifically includes steps 501 to 502.

[0060] In step 501, the type of current live broadcast of the live space is determined.

[0061] In step 502, obtain the first image frame corresponding to first time information corresponding to the special effect trigger command according to a type of the live broadcast.

[0062] In this embodiment, the types of live streaming in the live space can specifically include a type of solo live streaming and a type of competitive live streaming, and the live streamer frames displayed on the display screen of the two types of live streaming are different. In order to accurately process the target special effect information, before acquiring the first image frame, it is necessary to first determine the type of the current live streaming in the live space. According to the type of the live streaming, a means corresponding to the type of the live streaming is used to acquire the first image frame.

[0063] Further, based on the first embodiment, step 502 specifically includes: When the type of live streaming is a one-man live streaming type of a target live streamer user corresponding to a live space, the step of determining an image frame corresponding to the first time information as the first image frame includes:

[0064] In this embodiment, when the type of live streaming is the one-man live streaming type of the target live streamer, only the live streaming frame of the target live streamer is displayed on the current display screen, so that the image frame corresponding to the first time information in the video stream can be directly determined as the first image frame.

[0065] FIG. 6 is a schematic diagram of a display screen provided by an embodiment of the present disclosure. As shown in FIG. 6, the current display screen 61 only includes a live streaming slot 62 corresponding to a target live streamer user, so that the image frame in the video stream corresponding to the first time information can be directly determined as the first image frame 63.

[0066] Further, based on the first embodiment, step 502 specifically includes: When the type of live distribution is a type of live distribution in which a target live user corresponding to a live space competes with other live users, determining an identifier of the target live user; According to the identifier of the target live streamer user, a screenshot operation is performed on the image frame corresponding to the first time information to obtain a first image frame corresponding to the identifier of the live streamer user; Here, when the target live streamer user competes with other live streamers for live streaming, live streaming slots for the target live streamer user and the other live streamers are simultaneously displayed in the image frame.

[0067] In this embodiment, when the type of live distribution is a type in which the target live user competes with other live users, the live distribution frames of the target live user and the other live users are simultaneously displayed on the display screen of the user watching the live distribution. Therefore, in order to accurately generate the target special effect information, a screenshot operation can be performed on the image frame corresponding to the first time information according to the identifier of the target live user to obtain the first image frame.

[0068] FIG. 7 is a schematic diagram of another display screen provided by an embodiment of the present disclosure. As shown in FIG. 7, a live streaming frame 72 of a target live streamer user and a live streaming frame 73 of another live streamer user are simultaneously displayed on a current display screen 71. At this time, according to the identifier of the target live streamer user, a screenshot operation can be performed on the image frame corresponding to the first time information to obtain a first image frame 74.

[0069] Further, based on the first embodiment, after the step of transmitting the data waiting to be displayed to a user side viewing the live distribution and displaying the data, the method further comprises: The method further includes a step of controlling a client terminal device to display the target special effect information in full screen on top of a live distribution frame of the target live streamer user and other live streamer users.

[0070] In this embodiment, in the type of competitive live streaming, the target special effect information is only displayed within the live streaming frame of the target live streamer user, so in order to avoid the problem of the display effect of the special effects being deteriorated, after obtaining the target special effect information, the user watching the live streaming can be controlled so that the target special effect information is displayed in full screen above the live streaming frame of the target live streamer user and other live streamers.

[0071] The special effect display method provided by this embodiment obtains the first image frame corresponding to the first time information corresponding to the special effect trigger command according to the type of live streaming, and controls the user watching the live streaming to display the target special effect information in full screen above the live streaming frame of the target live streaming user and other live streaming users. This effectively avoids the problem that in the competitive live streaming type, the integrated special effects are only displayed within the live streaming frame of the target live streaming user, resulting in poor display effect of the special effects, and improves the display effect of the special effects.

[0072] FIG. 8 is a flowchart of a special effect display method provided by embodiment 4 of the present disclosure. Based on any of the above embodiments, as shown in FIG. 8, after step 101, the method further includes steps 801 to 803.

[0073] In step 801, it is detected in real time whether any client terminal device has triggered a preset target operation in the live space.

[0074] In step 802, when any client terminal device triggers a preset target operation in the live space, second special effect information corresponding to the target operation and second time information corresponding to the target operation are determined.

[0075] In step 803, the first special effect information and the second special effect information are added to the same message queue in chronological order based on the first time information and the second time information.

[0076] In this embodiment, the related special effect display method includes a video stream containing a fused special effect transmitted from a target live streamer user side, and when playing the video stream, the user watching the live broadcast may trigger a preset target operation at the same time. In this case, the special effect corresponding to the target special effect information and the special effect corresponding to the target operation are displayed at the same time, so that the target special effect information is blocked, resulting in a poor display effect. Here, the preset target operation is specifically as follows: Live streaming It can be generated after a viewing user presents a specific virtual object in the live space.

[0077] Therefore, after determining the first time information indicated by the special effect trigger command and sending the target special effect information to the first client terminal device, it is detected in real time whether any of the client terminal devices has triggered a preset target operation in the live space. If any of the client terminal devices has triggered a preset target operation in the live space, it determines second special effect information corresponding to the target operation and second time information corresponding to the target operation. Based on the first time information and the second time information, the first special effect information and the second special effect information are added to the same message queue in chronological order.

[0078] Further, based on any of the above embodiments, after step 803, the method further comprises: The method further includes a step of sequentially obtaining first special effect information or second special effect information in the message queue in the time order, and determining target special effect information according to the first special effect information or the second special effect information and a target object in a first image frame corresponding to the first time information or a second image frame corresponding to the second time information.

[0079] In this embodiment, the first special effect information and the second special effect information are currently in the same message queue, and therefore cannot be played simultaneously. At this time, the first special effect information or the second special effect information in the message queue is obtained in chronological order, and the target special effect information is determined according to the first special effect information or the second special effect information and the target object in the first image frame corresponding to the first time information or the second image frame corresponding to the second time information.

[0080] The special effect display method provided by this embodiment adds the first special effect information and the second special effect information to the same message queue so that they are not played simultaneously, thereby avoiding the technical problem that the special effect corresponding to the first special effect information is blocked by the special effect corresponding to the second special effect information, and improving the display effect of the target special effect information.

[0081] FIG. 9 is a flowchart of a special effect display method provided in the fifth embodiment of the present disclosure. As shown in FIG. 9, the method includes steps 901 to 905.

[0082] In step 901, streaming content in a live space is displayed.

[0083] In step 902, in response to detecting a special effect triggering operation, first time information corresponding to the special effect triggering operation is determined, and the first special effect information corresponding to the special effect triggering operation is determined.

[0084] In step 903, a special effect trigger command is sent to a server, the special effect trigger command indicating the first special effect information, and the special effect trigger command further indicates a first image frame in the streaming content of the live space corresponding to the first time information.

[0085] In step 904, a special effects display command is obtained from the server, the special effects display command indicating target special effects information, the target special effects information being associated with the first special effects information and a target object in the first image frame.

[0086] In step 905, the special effect corresponding to the target special effect information is displayed.

[0087] The subject of this embodiment is a special effect display device, which can be coupled into a first client terminal device, and can use a server to process target special effect information accordingly.

[0088] In this embodiment, the first client terminal device can display streaming content in a live space. When a special effect trigger operation triggered by a live streamer user or a viewer user is detected, first time information corresponding to the special effect trigger operation is determined, and first special effect information corresponding to the special effect trigger operation is determined. A special effect trigger command is generated based on the special effect trigger operation, and the special effect trigger command is sent to a server. Here, the special effect trigger command indicates the first special effect information, and the special effect trigger command further indicates a first image frame in the streaming content in the live space corresponding to the first time information. After the server obtains the special effect trigger command, the server can perform a fusion operation on the first image frame and the first special effect information according to the special effect trigger command, obtain target special effect information, and feed back the target special effect information. The first client terminal device can obtain a special effect display command sent from the server, and the special effect display command indicates target special effect information, and the target special effect information is associated with the first special effect information and a target object in the first image frame. The first client terminal device can display the special effect corresponding to the target special effect information.

[0089] The special effect display method provided by this embodiment generates a special effect trigger command based on the special effect trigger operation, and sends the special effect trigger command to a server. The server generates target special effect information based on a first image frame and first special effect information in the streaming content of the live space corresponding to the special effect trigger command, and sends the target special effect information to a first client terminal device related to the live space, causing the first client terminal device to display the special effect corresponding to the target special effect information. This eliminates the need for special effect fusion operations on the live streamer's terminal device, and by simply determining the first image frame and the first special effect information, the synthesis of the target special effect information and the display of the corresponding special effect can be realized on the client terminal device or the server, and data in the live space will no longer obstruct the special effect corresponding to the target special effect information.

[0090] FIG. 10 is a flowchart of a special effect display method provided in the sixth embodiment of the present disclosure. As shown in FIG.

[0091] In step 1001, streaming content is pushed to a first client terminal device and a second client terminal device associated with a live space.

[0092] In step 1002, a special effect trigger command is obtained from the first client terminal device, the special effect trigger command indicating target special effect information, the target special effect information is associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information includes special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponds to first time information, and the first image frame includes an image frame in the streaming content of the live space corresponding to the first time information.

[0093] In step 1003, the target special effect information is transmitted to the second client terminal device, causing the second client terminal device to display a special effect corresponding to the target special effect information.

[0094] The execution subject of this embodiment is a special effect display device, which can be coupled into a server, and the target special effect information can be specifically generated in the server.

[0095] In this embodiment, the server can push streaming content to a first client terminal device and a second client terminal device related to the live space. A special effect trigger command is obtained from the first client terminal device, the special effect trigger command indicates target special effect information, the target special effect information is associated with the first special effect information and a target object in a first image frame in the streaming content, the first special effect information includes special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponds to first time information, and the first image frame includes an image frame in the streaming content of the live space corresponding to the first time information. The target special effect information can be specifically generated in the first client terminal device and fed back to the server by the first client terminal device. The server can send the target special effect information to the second client terminal device to allow the second client terminal device to display a special effect corresponding to the target special effect information.

[0096] The special effect display method provided by this embodiment generates target special effect information in a first client terminal device, and transmits the generated target special effect information to a second client terminal device related to the live space for display, thereby eliminating the need for special effect fusion operations on the live streamer's terminal device. By simply determining the first image frame and the first special effect information, the synthesis of the target special effect information and the display of the corresponding special effect can be realized on the client terminal device or server, and data in the live space will no longer obstruct the special effect corresponding to the target special effect information.

[0097] FIG. 11 is a structural schematic diagram of a special effect display device provided by the seventh embodiment of the present disclosure. As shown in FIG. 11, the device includes an acquisition module 1101, a determination module 1102, and a sending module 1103. Wherein, the acquisition module 1101 is used for acquiring a special effect trigger command, where the special effect trigger command corresponds to a first image frame in the streaming content of a live space, and the special effect trigger command further corresponds to first special effect information. The determination module 1102 is used for determining target special effect information according to the first special effect information and a target object in the first image frame in response to the special effect trigger command. The sending module 1103 is used for sending the target special effect information to a first client terminal device related to the live space, so as to cause the first client terminal device to display a special effect corresponding to the target special effect information.

[0098] Further, based on Example 7, the device further includes a processing module used for determining, in response to detecting a special effect trigger operation, first time information corresponding to the special effect trigger operation, determining the first image frame in the streaming content of the live space corresponding to the first time information, and determining the first special effect information corresponding to the special effect trigger operation.

[0099] Further, according to Example 7, the acquisition module is adapted to generate the special effect trigger command in response to detecting a special effect trigger operation.

[0100] Further according to Example 7, the apparatus further includes a display module for displaying a special effect corresponding to the target special effect information.

[0101] Further, based on any of the above embodiments, the acquisition module is used to acquire the special effect trigger command from the first client terminal device, the special effect trigger command indicating the first image frame, and the special effect trigger command further indicating the first special effect information.

[0102] Further, based on any of the above embodiments, the special effect trigger command indicating the first image frame includes the special effect trigger command indicating first time information, and the first image frame includes the first image frame in the streaming content of the live space that corresponds to the first time information.

[0103] Further, based on any of the above embodiments, the device further includes a special effect transmission module that transmits the target special effect information to a second client terminal device associated with the live space, and causes the second client terminal device to display a special effect corresponding to the target special effect information.

[0104] Further, based on any of the above embodiments, the device further includes a type determination module for determining a type of a current live broadcast of the live space, and an image processing module is used to obtain the first image frame corresponding to first time information corresponding to the special effect trigger command according to the type of the live broadcast.

[0105] Further, based on any of the above embodiments, the image processing module is used for determining an identifier of the target live streamer when the type of live streaming is a type of live streaming in which a target live streamer corresponding to a live space competes with other live streamers, and performing a screenshot operation on an image frame corresponding to the first time information according to the identifier of the target live streamer to obtain a first image frame corresponding to the identifier of the target live streamer. Among them, when the target live streamer competes with other live streamers to live stream, the live streaming frames of the target live streamer and the other live streamers are displayed simultaneously in the image frame.

[0106] Further, based on any of the above embodiments, when the type of live streaming is a one-man live streaming type of a target live streamer user corresponding to a live space, the image processing module is used to determine an image frame corresponding to the first time information as the first image frame.

[0107] Further, based on any of the above embodiments, the device further includes a control module for controlling a client terminal device to display the target special effect information in full screen on top of a live streaming frame of the target live streamer user and other live streamer users.

[0108] Further, based on any of the above embodiments, the determination module may determine, for the first image frame, Approval performing a data identification operation on the target object to obtain the target object; and performing a data fusion operation on the target object and the first special effect information to obtain the target special effect information.

[0109] Further, based on any of the above embodiments, the apparatus further includes: a detection module for detecting in real time whether any client terminal device triggers a preset target operation in the live space; a time information determination module for determining, when any client terminal device triggers a preset target operation in the live space, second special effect information corresponding to the target operation and second time information corresponding to the target operation; and an ordering module for adding the first special effect information and the second special effect information to a same message queue in time order based on the first time information and the second time information.

[0110] Further, based on any of the above embodiments, the device further includes a special effect acquisition module for sequentially acquiring first special effect information or second special effect information in the message queue in the time order, and determining target special effect information according to the first special effect information or the second special effect information and a target object in the first image frame corresponding to the first time information or the second image frame corresponding to the second time information.

[0111] FIG. 12 is a structural schematic diagram of a special effect display device provided by the eighth embodiment of the present disclosure. As shown in FIG. 12, the device includes a content display module 1201, a special effect determination module 1202, a command sending module 1203, a command acquisition module 1204, and a special effect display module 1205. The content display module 1201 is used to display streaming content in a live space. The special effect determination module 1202 is used to determine first time information corresponding to the special effect trigger operation in response to detecting a special effect trigger operation, and determine the first special effect information corresponding to the special effect trigger operation. The command sending module 1203 is used to send a special effect trigger command to a server, where the special effect trigger command indicates the first special effect information, and the special effect trigger command further indicates a first image frame in the streaming content in the live space corresponding to the first time information. The command acquisition module 1204 is used to acquire a special effect display command from the server, the special effect display command indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame. The special effect display module 1205 is used to display a special effect corresponding to the target special effect information.

[0112] FIG. 13 is a structural schematic diagram of a special effect display device provided by the ninth embodiment of the present disclosure. As shown in FIG. 13, the device includes a content push module 1301, a command acquisition module 1302, and a target special effect sending module 1303. Wherein, the content push module 1301 is used for pushing streaming content to a first client terminal device and a second client terminal device related to a live space. The command acquisition module 1302 is used for acquiring a special effect trigger command from the first client terminal device, the special effect trigger command indicates target special effect information, the target special effect information is associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information includes special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponds to first time information, and the first image frame includes an image frame in the streaming content of the live space corresponding to the first time information. The target special effect sending module 1303 is used for sending the target special effect information to the second client terminal device, so as to make the second client terminal device display the special effect corresponding to the target special effect information.

[0113] The apparatus provided by this embodiment can be used to implement the technical solutions of the above method embodiments, and the realization principles and technical effects are similar, so this embodiment will not be described repeatedly here.

[0114] FIG. 14 is a structural schematic diagram of a special effect display device provided by the tenth embodiment of the present disclosure, showing a structural schematic diagram of an electronic device 1400 suitable for realizing the embodiments of the present disclosure, and the electronic device 1400 can be a terminal device or a server. The terminal device can include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (abbreviated as PDA), tablet computers (abbreviated as Portable Android Devices, abbreviated as PAD), portable multimedia players (abbreviated as PMP), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs (Television), desktop computers, etc. The electronic device shown in FIG. 14 is merely an example, and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0115] As shown in FIG. 14, the electronic device 1400 may include a processing unit (such as a central processing unit or a graphic processor) 1401, which may perform various appropriate operations and processes according to a program stored in a read only memory (ROM) 1402 or a program loaded from a storage device 1408 into a random access memory (RAM) 1403. The RAM 1403 also stores various programs and data necessary for the operation of the electronic device 1400. The processing unit 1401, the ROM 1402, and the RAM 1403 are connected to each other via a bus 1404. An input / output (I / O) interface 1405 is also connected to the bus 1404.

[0116] Typically, input devices 1406 including a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc., output devices 1407 including a liquid crystal display (LCD), speaker, vibrator, etc., storage devices 1408 including a magnetic tape, hard disk, etc., and communication devices 1409 can be connected to the I / O interface 1405. The communication devices 1409 can enable the electronic device 1400 to communicate and exchange data with other devices wirelessly or via wires. Although FIG. 14 illustrates the electronic device 1400 with various devices, it should be understood that not all of the devices illustrated need be implemented or deployed. Alternatively, more or fewer devices can be implemented or deployed.

[0117] In particular, according to an embodiment of the present disclosure, the above processes described with reference to the flowcharts can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a computer-readable medium, the computer program including program code for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication device 1409, or installed from the storage device 1408, or installed from the ROM 1402. When the computer program is executed by the processing device 1401, the above functions defined in the method according to the embodiment of the present disclosure are performed.

[0118] It should be noted that the computer readable medium described in this disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. The computer readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of computer readable storage media may include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic memory component, or any suitable combination of the above. In this disclosure, a computer readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, with computer-readable program code embedded therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted using any suitable medium, including but not limited to wire, fiber optic cable, RF (Radio Frequency), etc., or any suitable combination of the above.

[0119] The computer-readable medium may be included in the electronic device, or may exist independently without being assembled in the electronic device.

[0120] The computer-readable medium includes one or more programs stored therein, and when the one or more programs are executed by the electronic device, the electronic device performs the method shown in the above embodiments.

[0121] Another embodiment of the present disclosure further provides a computer-readable storage medium, the computer-readable storage medium storing computer-executable instructions, which, when executed by a computing device, cause the computing device to realize the special effect display method described in any of the above embodiments.

[0122] Another embodiment of the present disclosure further provides a computer program product, the computer program product comprising a computer program, which, when executed by a processor, realizes the special effect display method described in any of the above embodiments.

[0123] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages, or a combination thereof. The program code can run entirely on the user's computer, partly on the user's computer, as a standalone software package, partly on the user's computer, partly on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer via any kind of network, such as a Local Area Network (LAN) or a Wide Area Network (WAN), or can be connected to an external computer (e.g., connected via the Internet using an Internet Service Provider).

[0124] The flowcharts and block diagrams in the drawings illustrate the architecture, functions, and operations that can be realized by the systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or part of code that includes one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions shown in the blocks may be executed in a different order than that shown in the figures. For example, two blocks shown as connected may actually be executed in parallel, or the blocks may be executed in the reverse order depending on the related functionality. It should be noted that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified functions or operations, or may be implemented using a combination of dedicated hardware and computer instructions.

[0125] The modules described in the embodiments of the present disclosure may be implemented in software or hardware, and the names of the modules may not be intended to limit the modules themselves in a particular context.

[0126] The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that may be used include Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (APIs), and the like. Application Specific Integrated CircuitThese may include, but are not limited to, ASICs, Application Specific Standard Products (ASSPs), System-on-a-chips (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

[0127] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of machine-readable storage media may include electrical connections based on one or more wires, portable computer disks, hard disks, random access memories (RAMs), read-only memories (ROMs), erasable programmable read-only memories (EPROMs or flash memories), optical fibers, portable compact disk read-only memories (CD-ROMs), optical storage devices, magnetic memory components, or any suitable combination of the above.

[0128] In a first aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display method, the method comprising: Obtaining a special effect trigger command, the special effect trigger command corresponding to a first image frame in a streaming content of a live space, the special effect trigger command further corresponding to first special effect information; determining target special effect information according to the first special effect information and a target object in the first image frame in response to the special effect trigger command; transmitting the target special effect information to a first client terminal device associated with the live space, and causing the first client terminal device to display a special effect corresponding to the target special effect information.

[0129] According to one or more embodiments of the present disclosure, before obtaining the special effect trigger command, the method includes: The method further includes, in response to detecting a special effect trigger operation, determining first time information corresponding to the special effect trigger operation, determining the first image frame in the streaming content of the live space corresponding to the first time information, and determining the first special effect information corresponding to the special effect trigger operation.

[0130] According to one or more embodiments of the present disclosure, obtaining the special effect trigger command includes generating the special effect trigger command in response to detecting a special effect trigger operation.

[0131] According to one or more embodiments of the present disclosure, in response to the special effect trigger command, after determining target special effect information according to the first special effect information and a target object in the first image frame, the method includes: The method further includes displaying a special effect corresponding to the target special effect information.

[0132] According to one or more embodiments of the present disclosure, obtaining the special effect trigger command includes: and obtaining the special effect trigger command from the first client terminal device, where the special effect trigger command indicates the first image frame, and where the special effect trigger command further indicates the first special effect information.

[0133] According to one or more embodiments of the present disclosure, the special effect trigger instruction indicating the first image frame may include: The special effect trigger command indicates first time information, and the first image frame includes the first image frame in the streaming content of the live space that corresponds to the first time information.

[0134] According to one or more embodiments of the present disclosure, in response to the special effect trigger command, after determining target special effect information according to the first special effect information and a target object in the first image frame, the method includes: The method further includes transmitting the target special effect information to a second client terminal device associated with the live space, and causing the second client terminal device to display a special effect corresponding to the target special effect information.

[0135] According to one or more embodiments of the present disclosure, the method includes: determining a current live broadcast type of the live space; The method further includes obtaining the first image frame corresponding to first time information corresponding to the special effect trigger command according to a type of the live broadcast.

[0136] According to one or more embodiments of the present disclosure, obtaining the first image frame corresponding to first time information corresponding to the special effect trigger command according to a type of the live broadcast includes: When the type of live distribution is a type of live distribution in which a target live user corresponding to a live space competes with other live users, determining an identifier of the target live user; According to the identifier of the target live streamer user, a screenshot operation is performed on the image frame corresponding to the first time information to obtain a first image frame corresponding to the identifier of the target live streamer user; Here, when the target live streamer user competes with other live streamers for live streaming, the live streaming slots of the target live streamer user and the other live streamers are simultaneously displayed in the image frame.

[0137] According to one or more embodiments of the present disclosure, obtaining the first image frame corresponding to first time information corresponding to the special effect trigger command according to a type of the live broadcast includes: When the type of live streaming is a one-man live streaming type of a target live streamer user corresponding to a live space, the method includes determining an image frame corresponding to the first time information as the first image frame.

[0138] According to one or more embodiments of the present disclosure, after transmitting the target special effect information to a first client terminal device associated with the live space, the method includes: The target special effect information is displayed in full screen on the upper layer of the live distribution frame of the target live user and other live users. 1. Further comprising controlling the client terminal device.

[0139] According to one or more embodiments of the present disclosure, determining target special effect information in response to the special effect trigger command according to the first special effect information and a target object in the first image frame includes: For the first image frame Approval performing a recognition operation to obtain the target object; performing a data fusion operation on the target object and the first special effect information to obtain the target special effect information.

[0140] According to one or more embodiments of the present disclosure, the method includes: Either nine Detecting in real time whether a client terminal device triggers a preset target operation in the live space; When any of the client terminal devices triggers a preset target operation in the live space, determining second special effect information corresponding to the target operation and second time information corresponding to the target operation; The method further includes adding the first special effect information and the second special effect information to a same message queue in chronological order based on the first time information and the second time information.

[0141] According to one or more embodiments of the present disclosure, after adding the first special effect information and the second special effect information to a same message queue in time order based on the first time information and the second time information, the method includes: The method further includes sequentially obtaining first special effect information or second special effect information in the message queue in the time order, and determining target special effect information according to the first special effect information or the second special effect information and a target object in a first image frame corresponding to the first time information or a second image frame corresponding to the second time information.

[0142] In a second aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display method, the method comprising: Displaying live spatial streaming content; and In response to detecting a special effect triggering operation, determining first time information corresponding to the special effect triggering operation to determine first special effect information corresponding to the special effect triggering operation; Sending a special effect trigger command to a server, the special effect trigger command indicating the first special effect information, and the special effect trigger command further indicating a first image frame in the streaming content of the live space corresponding to the first time information; obtaining a special effect display command from the server, the special effect display command indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame; and displaying a special effect corresponding to the target special effect information.

[0143] In a third aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display method, the method comprising: pushing streaming content to a first client terminal device and a second client terminal device associated with the live space; Obtaining a special effect trigger command from the first client terminal device, the special effect trigger command indicating target special effect information, the target special effect information being associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information including special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponding to first time information, and the first image frame including an image frame in the streaming content of the live space corresponding to the first time information; transmitting the target special effect information to the second client terminal device to cause the second client terminal device to display a special effect corresponding to the target special effect information.

[0144] No. 4 In one aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display device, the device comprising: An acquisition module for acquiring a special effect trigger command, the special effect trigger command corresponding to a first image frame in a streaming content of a live space, the special effect trigger command further corresponding to a first special effect information; a determining module responsive to the special effect trigger command for determining target special effect information according to the first special effect information and a target object in the first image frame; and a transmitting module for transmitting the target special effect information to a first client terminal device associated with the live space, and causing the first client terminal device to display a special effect corresponding to the target special effect information.

[0145] According to one or more embodiments of the present disclosure, the apparatus comprises: The system further includes a processing module used for: determining, in response to detecting a special effect trigger operation, first time information corresponding to the special effect trigger operation; determining the first image frame in the streaming content of the live space corresponding to the first time information; and determining the first special effect information corresponding to the special effect trigger operation.

[0146] According to one or more embodiments of the present disclosure, the acquisition module is adapted to generate the special effect trigger command in response to detecting a special effect trigger operation.

[0147] According to one or more embodiments of the present disclosure, the apparatus comprises: The display device further includes a display module for displaying a special effect corresponding to the target special effect information.

[0148] According to one or more embodiments of the present disclosure, the acquisition module includes: used to obtain the special effect trigger command from the first client terminal device, the special effect trigger command indicating the first image frame, and the special effect trigger command further indicating the first special effect information.

[0149] According to one or more embodiments of the present disclosure, the special effect trigger instruction indicating the first image frame may include: The special effect trigger command indicates first time information, and the first image frame includes the first image frame in the streaming content of the live space that corresponds to the first time information.

[0150] According to one or more embodiments of the present disclosure, the device further includes a special effect transmission module for transmitting the target special effect information to a second client terminal device associated with the live space, and causing the second client terminal device to display a special effect corresponding to the target special effect information.

[0151] According to one or more embodiments of the present disclosure, the apparatus comprises: a type determination module for determining a type of a current live broadcast of the live space; and an image processing module for obtaining the first image frame corresponding to first time information corresponding to the special effect trigger command according to a type of the live broadcast.

[0152] According to one or more embodiments of the present disclosure, the image processing module includes: When the type of live distribution is a type of live distribution in which a target live user corresponding to a live space competes with other live users, determining an identifier of the target live user; According to the identifier of the target live streamer user, a screenshot operation is performed on the image frame corresponding to the first time information to obtain a first image frame corresponding to the identifier of the target live streamer user; When the target live streamer user competes with other live streamers for live streaming, the live streaming frames of the target live streamer user and the other live streamers are simultaneously displayed in the image frame.

[0153] According to one or more embodiments of the present disclosure, the image processing module includes: When the type of live streaming is a one-man live streaming type of a target live streamer user corresponding to a live space, it is used to determine the image frame corresponding to the first time information as the first image frame.

[0154] According to one or more embodiments of the present disclosure, the apparatus comprises: The system further includes a control module for controlling a client terminal device to display the target special effect information in full screen on an upper layer of a live distribution frame of the target live streamer user and other live streamer users.

[0155] According to one or more embodiments of the present disclosure, the determination module comprises: For the first image frame Approval performing a recognition operation to obtain the target object; performing a data fusion operation on the target object and the first special effect information to obtain the target special effect information.

[0156] According to one or more embodiments of the present disclosure, the apparatus comprises: a detection module for detecting in real time whether any client terminal device triggers a preset target operation in the live space; a time information determination module for determining, when any client terminal device triggers a preset target operation in the live space, second special effect information corresponding to the target operation and second time information corresponding to the target operation; and an ordering module for adding the first special effect information and the second special effect information to a same message queue in time order based on the first time information and the second time information.

[0157] According to one or more embodiments of the present disclosure, the apparatus comprises: The display device further includes a special effect acquisition module for sequentially acquiring first special effect information or second special effect information in the message queue in the time order, and determining target special effect information according to the first special effect information or the second special effect information and a target object in a first image frame corresponding to the first time information or a second image frame corresponding to the second time information.

[0158] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display device, the device comprising: a content display module for displaying streaming content in a live space; a special effect determination module for determining, in response to detecting a special effect triggering operation, first time information corresponding to the special effect triggering operation, and determining the first special effect information corresponding to the special effect triggering operation; A command sending module for sending a special effect trigger command to a server, the special effect trigger command indicating the first special effect information, and the special effect trigger command further indicating a first image frame in the streaming content of the live space corresponding to the first time information; an instruction acquisition module for acquiring a special effect display instruction from the server, the special effect display instruction indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame; a special effect display module for displaying a special effect corresponding to the target special effect information.

[0159] In a sixth aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display device, the device comprising: a content push module for pushing streaming content to a first client terminal device and a second client terminal device associated with the live space; a command acquisition module for acquiring a special effect trigger command from the first client terminal device, the special effect trigger command indicating target special effect information, the target special effect information being associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information including special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponding to first time information, and the first image frame including an image frame in the streaming content of the live space corresponding to the first time information; a target special effect transmitting module for transmitting the target special effect information to the second client terminal device, and causing the second client terminal device to display a special effect corresponding to the target special effect information.

[0160] In a seventh aspect, according to one or more embodiments of the present disclosure, there is provided a special effect display device, including a memory and a processor; the memory is used to store computer instructions; The processor is used to execute computer instructions stored in the memory to cause the special effect display device to realize the special effect display method described in the first, second or third aspect above.

[0161] In an eighth aspect, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, the computer-readable storage medium causing the computing device to realize the special effect display method described in the first aspect, the second aspect or the third aspect above, when executed by a computing device.

[0162] In a ninth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program product including a computer program, which, when executed by a processor, realises the special effect display method described in the first aspect, the second aspect or the third aspect above.

[0163] In a tenth aspect, according to one or more embodiments of the present disclosure, there is provided a computer program which, when executed by a processor, realises the special effect display method described in the first, second or third aspect above.

[0164] According to the special effect display method, apparatus, device, storage medium, and product provided by the present disclosure, the method obtains a special effect trigger command, then generates target special effect information based on a first image frame and first special effect information in the streaming content of the live space corresponding to the special effect trigger command, and transmits the target special effect information to a first client terminal device related to the live space, and displays the special effect corresponding to the target special effect information on the first client terminal device, eliminating the need for a special effect fusion operation on the live streamer's terminal device. By simply determining the first image frame and the first special effect information, the synthesis of the target special effect information and the display of the corresponding special effect can be realized on the client terminal device or the server, and data in the live space will no longer obstruct the special effect corresponding to the target special effect information.

[0165] The above description is merely a description of some preferred embodiments of the present disclosure and a description of the applied technical principles. Those skilled in the art should understand that the disclosure scope of the present disclosure is not limited to the solution formed by a specific combination of the above technical features, but should also cover other solutions formed by any combination of the above technical features or their equivalent features without departing from the concept of the above disclosure, for example, by replacing the above features with technical features having similar functions (but not limited to) disclosed in the present disclosure.

[0166] It should be noted that although operations are described in a particular order, this should not be understood as requiring that these operations be performed in the particular order or sequence shown. Multitasking or parallel processing may be advantageous in certain circumstances. Similarly, although the above description includes some specific implementation details, these should not be construed as limiting the scope of the disclosure. Certain features that are described in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments, either alone or in any suitable subcombination.

[0167] Although the present subject matter has been described using language specific to structural features and / or methodological logical operations, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. Rather, the specific features and operations described above are merely example forms for implementing the claims.

[0168] This application claims priority to a Chinese patent application filed on April 6, 2021, bearing application number 202110369428.3, and entitled "Special effect display method, device, equipment, storage medium and product," the entire contents of which are incorporated herein by reference.

Claims

1. A special effect display method, comprising: Obtaining a special effect trigger command, the special effect trigger command corresponding to a first image frame in the live streaming content, the special effect trigger command further corresponding to first special effect information; determining target special effect information in response to the special effect trigger command as a function of the first special effect information and a target object in the first image frame; transmitting the target special effect information to a first client terminal device related to the live performance, and causing the first client terminal device to display a special effect corresponding to the target special effect information; the target special effect information is synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame; A special effect display method, wherein the image displayed by the first client terminal device includes the first image frame and the special effect.

2. A special effect display method, comprising: Obtaining a special effect trigger command, the special effect trigger command corresponding to a first image frame in the live streaming content, the special effect trigger command further corresponding to first special effect information; determining target special effect information in response to the special effect trigger command as a function of the first special effect information and a target object in the first image frame; transmitting the target special effect information to a first client terminal device related to the live performance, and causing the first client terminal device to display a special effect corresponding to the target special effect information; the target special effect information is a set of data including the first special effect information and target object information corresponding to the target object in the first image frame; A special effect display method, wherein the image displayed by the first client terminal device includes the first image frame and the special effect.

3. Prior to obtaining the special effect trigger command, the method further comprises: In response to detecting a special effect triggering operation, determining first time information corresponding to the special effect triggering operation; determining the first image frame in the live streaming content that corresponds to the first time information; The method of claim 1 or 2, further comprising: determining the first special effect information corresponding to the special effect trigger operation.

4. Obtaining special effect trigger instructions The method of claim 3 , further comprising generating the special effect trigger instruction in response to detecting the special effect trigger operation.

5. After determining target special effect information in response to the special effect trigger command and in response to the first special effect information and a target object in the first image frame, the method further comprises: The method of claim 1 or 2, further comprising displaying a special effect corresponding to the target special effect information.

6. Obtaining special effect trigger instructions 3. The method of claim 1 or 2, further comprising obtaining the special effect trigger command from the first client terminal device, the special effect trigger command indicating the first image frame, and the special effect trigger command further indicating the first special effect information.

7. The special effect trigger instruction indicating the first image frame may further include: The method of claim 6 , wherein the special effect triggering instructions indicate first time information, the first time information corresponding to the first image frame in the live streaming content.

8. After determining target special effect information in response to the special effect trigger command and in response to the first special effect information and a target object in the first image frame, the method further comprises: The method according to claim 1 or 2, further comprising transmitting the target special effect information to a second client terminal device associated with the live performance, and causing the second client terminal device to display a special effect corresponding to the target special effect information.

9. The method comprises: Determining a type of a current live broadcast of the live broadcast, including a type in which the target live broadcast user corresponding to the live broadcast competes with other live broadcast users and / or a type of a one-man live broadcast of the target live broadcast user; The method of claim 1 or 2, further comprising: acquiring the first image frame corresponding to first time information corresponding to the special effect trigger command according to a type of the live broadcast.

10. According to a type of the live broadcast, acquiring the first image frame corresponding to first time information corresponding to the special effect trigger command includes: When the type of the live distribution is a type of live distribution in which the target live user corresponding to the live broadcast competes with other live users, determining an identifier of the target live user; According to the identifier of the target live streamer user, a screenshot operation is performed on the image frame corresponding to the first time information to obtain a first image frame corresponding to the identifier of the target live streamer user; The method according to claim 9, wherein, when the target live streamer user competes with other live streamers, live stream slots of the target live streamer user and the other live streamers are simultaneously displayed in the image frame.

11. According to a type of the live broadcast, acquiring the first image frame corresponding to first time information corresponding to the special effect trigger command includes: The method of claim 9, further comprising determining an image frame corresponding to the first time information as the first image frame when the type of live broadcast is a one-man live broadcast type of the target live broadcast user corresponding to the live broadcast.

12. After transmitting the target special effect information to a first client terminal device associated with the live performance, the method further comprises: The method according to claim 10, further comprising controlling the first client terminal device to display the target special effect information in full screen on top of a live streaming frame of the target live streamer user and other live streamer users.

13. determining target special effect information in response to the special effect trigger command in response to the first special effect information and a target object in the first image frame, performing a recognition operation on the first image frame to obtain the target object; and performing a data fusion operation on the target object and the first feature information to obtain the target feature information.

14. The method comprises: Detecting in real time whether any client terminal device triggers a preset target operation within the live; When any of the client terminal devices triggers a preset target operation in the live stream, determining second special effect information corresponding to the target operation and second time information corresponding to the target operation; 9. The method of claim 8, further comprising: adding the first feature information and the second feature information to a same message queue in chronological order based on the first time information and the second time information.

15. After adding the first special effect information and the second special effect information to a same message queue in time order based on the first time information and the second time information, the method further comprises:

15. The method of claim 14, further comprising: sequentially obtaining the first special effect information or the second special effect information in the message queue in the time order; and determining the target special effect information according to the first special effect information or the second special effect information and the target object in the first image frame corresponding to the first time information or the target object in the second image frame corresponding to the second time information.

16. A special effect display method, comprising: Displaying live streaming content; and In response to detecting a special effect triggering operation, determining first time information corresponding to the special effect triggering operation to determine first special effect information corresponding to the special effect triggering operation; sending a special effect triggering command to a server, the special effect triggering command indicating the first special effect information, the special effect triggering command further indicating a first image frame in the live streaming content corresponding to the first time information; obtaining a special effect display command from the server, the special effect display command indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame; displaying a special effect corresponding to the target special effect information; The target special effect information is synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame, or the target special effect information is a set of data including the first special effect information and target object information corresponding to the target object in the first image frame; A special effect display method, comprising: a display unit displaying a special effect on the display screen; a display unit displaying a display screen including the display unit displaying the special effect on the display screen;

17. A special effect display method, comprising: Displaying live streaming content; and a special effect display method for displaying a special effect corresponding to target special effect information when a special effect trigger operation is detected, the target special effect information being associated with first special effect information and a target object in a first image frame, the first special effect information being special effect information corresponding to the special effect trigger operation, and the first image frame being an image frame in the live streaming content corresponding to the special effect trigger operation, the target special effect information being synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame, or the target special effect information being a set of data including the first special effect information and target object information corresponding to the target object in the first image frame, and an image displayed by an entity executing the special effect display method includes the first image frame and the special effect.

18. A special effect display method, comprising: Pushing streaming content to a first client terminal device and a second client terminal device associated with the live broadcast; obtaining a special effect trigger command from the first client terminal device, the special effect trigger command indicating target special effect information, the target special effect information being associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information including special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponding to first time information, the first image frame including an image frame in the live streaming content corresponding to the first time information, the target special effect information being synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame, or the target special effect information being a set of data including the first special effect information and target object information corresponding to the target object in the first image frame; transmitting the target special effect information to the second client terminal device to cause the second client terminal device to display a special effect corresponding to the target special effect information; The image displayed by the second client terminal device includes the first image frame and the special effect.

19. 1. A special effects display device, comprising: an acquisition module for acquiring a special effect trigger instruction, the special effect trigger instruction corresponding to a first image frame in a live streaming content, the special effect trigger instruction further corresponding to first special effect information; a determining module responsive to the special effect trigger command for determining target special effect information according to the first special effect information and a target object in the first image frame; a transmission module for transmitting the target special effect information to a first client terminal device related to the live performance, and causing the first client terminal device to display a special effect corresponding to the target special effect information; The target special effect information is synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame, or the target special effect information is a set of data including the first special effect information and target object information corresponding to the target object in the first image frame; A special effect display device, wherein the image displayed by the first client terminal device includes the first image frame and the special effect.

20. 1. A special effects display device, comprising: a content display module for displaying live streaming content; a special effect determination module for determining, in response to detecting a special effect trigger operation, first time information corresponding to the special effect trigger operation to determine first special effect information corresponding to the special effect trigger operation; a command sending module for sending a special effect trigger command to a server, the special effect trigger command indicating the first special effect information, and the special effect trigger command further indicating a first image frame in the live streaming content corresponding to the first time information; an instruction acquisition module for acquiring a special effect display instruction from the server, the special effect display instruction indicating target special effect information, the target special effect information being associated with the first special effect information and a target object in the first image frame; a special effect display module for displaying a special effect corresponding to the target special effect information; The target special effect information is synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame, or the target special effect information is a set of data including the first special effect information and target object information corresponding to the target object in the first image frame; The image displayed by the special effect display module includes the first image frame and the special effect.

21. 1. A special effects display device, comprising: a content push module for pushing streaming content to a first client terminal device and a second client terminal device associated with the live broadcast; an instruction acquisition module for acquiring a special effect trigger instruction from the first client terminal device, the special effect trigger instruction indicating target special effect information, the target special effect information being associated with first special effect information and a target object in a first image frame in the streaming content, the first special effect information including special effect information corresponding to a special effect trigger operation detected by the first client terminal device, the special effect trigger operation corresponding to first time information, and the first image frame including an image frame in the live streaming content corresponding to the first time information; a target special effect transmitting module for transmitting the target special effect information to the second client terminal device, and causing the second client terminal device to display a special effect corresponding to the target special effect information; The target special effect information is synthesized according to the first special effect information and target object information corresponding to the target object in the first image frame, or the target special effect information is a set of data including the first special effect information and target object information corresponding to the target object in the first image frame; A special effect display device, wherein the image displayed by the second client terminal device includes the first image frame and the special effect.

22. 1. A special effects display device, comprising a memory and a processor, the memory is used to store computer instructions; A special effect display device, wherein the processor is used to execute computer instructions stored in the memory to cause the special effect display device to realize the special effect display method according to any one of claims 1, 2, and 16 to 18.

23. A computer-readable storage medium having computer-executable instructions stored therein, the computer-readable storage medium causing the computing device to realize the special effect display method according to any one of claims 1, 2, and 16 to 18, when the computer-executable instructions are executed by the computing device.

24. A computer program, which, when executed by a processor, realizes the special effect display method according to any one of claims 1, 2, and 16 to 18.

Images