Live streaming video processing method, device, equipment and medium
The method and device for live streaming video processing address the complexity of reusing special effects by displaying a special effect indicator, allowing users to quickly access and use special effects, thereby improving user experience and interaction in collaborative and PK scenes.
Patent Information
- Application Number
- JP2024560233
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-08-23
- Filing Date
- 2023-08-23
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2043-08-23
AI Technical Summary
In live streaming scenarios, users face complications when trying to reuse special effects images used by collaborative users, leading to a lengthy reuse process that negatively impacts user experience.
A method and device for processing live streaming video that displays a special effect indicator on the live streaming interface when a special effect image is used by another user, allowing the first user to quickly reuse the special effect image by triggering the indicator.
This solution provides a shortcut for reusing special effect images, improving user experience by reducing the complexity of operations required to access and use special effects, and enhancing interaction in collaborative and PK scenes.
Smart Images

Figure 2025513043000001_ABST
Abstract
Description
[Technical field]
[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority to a Chinese patent application filed with the China Patent Office on August 23, 2022, bearing application number 202211014041.7 and entitled "Live streaming video processing method, device, equipment and medium," the entire contents of which are incorporated herein by reference.
[0002] The present disclosure relates to the field of computer technology, and in particular to a live streaming video processing method, device, apparatus and medium. [Background technology]
[0003] With the continuous development of live streaming technology, more and more users are interacting through live streaming. During live streaming, users can increase the fun of the live room by adding special effects, attracting more viewers. In addition, they can also increase their popularity through collaboration, live connection, or PK. In this scenario, if users want to use the special effects used by the collaborating users, they need to perform cumbersome operations before using the same special effects, which will affect the user's experience. Summary of the Invention [Problem to be solved by the invention]
[0004] In view of this, the embodiments of the present application provide a live streaming video processing method, device, equipment, and medium that shortens the reuse path and improves the user experience. [Means for solving the problem]
[0005] To achieve the above objectives, the technical solutions provided by this application are as follows:
[0006] In a first aspect of the present application, there is provided a live streaming video processing method, the method comprising: displaying a live streaming interface, the live streaming interface including a first display image corresponding to a first user and a second display image corresponding to a second user; In response to a first special effect image being displayed on the second display image, displaying a first special effect indicator corresponding to the first special effect image on the live streaming interface; and displaying the first special effect image on the first display image in response to a trigger operation by the first user on the first special effect sign.
[0007] In a second aspect of the present application, there is provided a live streaming video processing device, comprising: A first display unit for displaying a live streaming interface, the live streaming interface including a first display image corresponding to a first user and a second display image corresponding to a second user; a second display unit for displaying a first special effect sign corresponding to the first special effect image on the live streaming interface in response to the first special effect image being displayed on the second display image; and a third display unit for displaying the first special effect image on the first display image in response to a trigger operation by the first user on the first special effect sign.
[0008] In a third aspect of the present application, there is provided an electronic device, the device including a processor and a memory, The memory is used to store instructions or computer programs; The processor is adapted to execute the instructions or computer programs in the memory to cause the electronic device to perform the method according to the first aspect.
[0009] In a fourth aspect of the present application, there is provided a computer readable storage medium having instructions stored thereon which, when executed on a device, cause the device to perform the method of the first aspect.
[0010] In a fifth aspect of the present application there is provided a computer program product, said computer program product comprising computer programs / instructions which, when executed by a processor, effectuate the method according to the first aspect.
[0011] As a result, the embodiments of the present application have the following beneficial effects.
[0012] In the embodiment of the present application, the live streaming interface corresponding to the first user displays a first display image corresponding to the first user and a second display image corresponding to the second user, and when the second display image displays the first special effect image, the live streaming interface corresponding to the first user displays a first special effect sign corresponding to the first special effect image. In response to the first user's trigger operation on the first special effect sign, the first special effect image is displayed on the first display image. That is, by displaying the first special effect sign corresponding to the first special effect image on the live streaming interface corresponding to the first user, a shortcut entry for reusing the first special effect image is provided for the first user, and the first user does not need to perform complicated operations, improving the user's usage experience. Furthermore, the multiple users collaborating can quickly use multiple same special effect images to enrich the interaction method of the live room, which contributes to improving the interaction atmosphere of the collaboration scene, especially the PK scene. [Brief description of the drawings]
[0013] In order to more clearly explain the technical solutions in the embodiments of the present application or the prior art, the following briefly introduces drawings necessary for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application, and those skilled in the art can obtain other drawings according to these drawings on the premise of not making any effort worthy of inventive step. [Figure 1] FIG. 2 is a schematic diagram of a display of a special effect panel according to an embodiment of the present application. [Diagram 2] 1 is a flowchart of a live streaming video processing method according to an embodiment of the present application. [Figure 3a] Figure 3a is a schematic diagram of displaying a first special effect sign on a live streaming interface according to an embodiment of the present application, Figure 3b is a schematic diagram of displaying a user sign on the first special effect sign according to an embodiment of the present application, and Figure 3c is a schematic diagram of displaying a user sign on a special effect panel according to an embodiment of the present application. [Figure 3b] Figure 3a is a schematic diagram of displaying a first special effect sign on a live streaming interface according to an embodiment of the present application, Figure 3b is a schematic diagram of displaying a user sign on the first special effect sign according to an embodiment of the present application, and Figure 3c is a schematic diagram of displaying a user sign on a special effect panel according to an embodiment of the present application. [Figure 3c] Figure 3a is a schematic diagram of displaying a first special effect sign on a live streaming interface according to an embodiment of the present application, Figure 3b is a schematic diagram of displaying a user sign on the first special effect sign according to an embodiment of the present application, and Figure 3c is a schematic diagram of displaying a user sign on a special effect panel according to an embodiment of the present application. [Figure 4a] FIG. 4a is a schematic diagram of displaying two user indicators on a special effects panel according to an embodiment of the present application, and FIG. 4b is another schematic diagram of displaying two user indicators on a special effects panel according to an embodiment of the present application. [Figure 4b] FIG. 4a is a schematic diagram of displaying two user indicators on a special effects panel according to an embodiment of the present application, and FIG. 4b is another schematic diagram of displaying two user indicators on a special effects panel according to an embodiment of the present application. [Diagram 5] FIG. 1 is a schematic diagram of a live streaming video processing device according to an embodiment of the present application. [Figure 6] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] In order to allow those skilled in the art to better understand the solutions in the present application, the following clearly and completely describes the technical solutions in the embodiments of the present application in combination with the drawings in the embodiments of the present application. Obviously, the described embodiments are not all the embodiments of the present application, but only some of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments that can be obtained by those skilled in the art without creative labor belong to the protection scope of the present application.
[0015] Currently, in the collaborative streaming scene, if one of the live streamers wants to use a special effect image used by a collaborating user, he or she needs to trigger multiple operations in the live streaming interface before the special effect panel can be called up, and then clicks on the special effect image used by the collaborating user in the special effect panel to realize the reuse of special effects. The reuse link corresponding to this reuse method is long, which affects the user's usage experience. Collaborative streaming may include collaboration between different live streamers, or a live streamer may collaborate with viewers in a live room.
[0016] For example, with reference to the schematic diagram of the live distribution interface shown in FIG. 1, a scene in which multiple live streamers collaborate will be described as an example. There are a total of three live streamers in the live room, and the vision of live streamer A will be described as an example. A navigation bar is displayed at the bottom of the live distribution interface corresponding to live streamer A, and the navigation bar includes an interaction control 201, a share control 202, an extension control 203, and other controls 204. The interaction control 201 is used by live streamer A to interact with viewers of the live room, the share control 202 is used by live streamer A to share the current live room with other users, the extension control 203 is used to perform an extension process on the display image corresponding to the current live streamer A, and the other controls 204 are used to display more function controls that can be triggered in response to the trigger operation of live streamer A. As can be seen from FIG. 1, when Liver A wants to reuse a certain special effect image, he / she first clicks on the extension control 203 to display an extension panel, which includes a beauty control, a special effect control, and a sticker control. In response to Liver A's trigger operation on the special effect control, a special effect panel is displayed, which includes various special effect indicators. Liver A needs to click on a certain special effect indicator (e.g., a special effect indicator corresponding to a special effect image used by Liver B) to trigger the use of the special effect image corresponding to the special effect indicator. In this way, the path for Liver A to reuse a special effect image is relatively long, which affects the usage experience.
[0017] Based on this, the present application provides a live streaming video processing method, specifically including the following steps: Display a live streaming interface corresponding to a first user, the live streaming interface including a first display image corresponding to the first user and a second display image corresponding to a second user. In response to the first special effect image being displayed on the second display image, display a first special effect sign corresponding to the first special effect image on the live streaming interface corresponding to the first user, and the first special effect sign provides an entry for the first user to quickly use the first special effect image. In response to the first user's trigger operation corresponding to the first special effect sign, display the first special effect image on the first display image. That is, the present application provides an entry for the first user to quickly use the first special effect image by displaying the first special effect sign on the live streaming interface of the first user, so that the first user displays the first special effect image on the first display image by triggering the first special effect sign, thereby improving the user's usage experience.
[0018] In order to facilitate understanding of the technical solutions provided by the embodiments of the present application, the following description will be made in conjunction with the accompanying drawings. Hereinafter, the display information of a live streaming interface will be described by taking the perspective of a first user in a live room as an example.
[0019] Referring to Fig. 2, the figure shows a live streaming video processing method according to an embodiment of the present application, the method can be executed by a live streaming client, the live streaming client is a live streaming client corresponding to a first user, and can be installed in an electronic device. The electronic device may include a device having a communication function, such as a mobile phone, a tablet, a notebook computer, a desktop computer, an in-vehicle terminal, a wearable electronic device, a multifunction printer, a smart home device, etc., or may be a device simulated by a virtual machine or a simulator. As shown in Fig. 2, the method may include steps S201 to S203. S201: Display a live streaming interface, where the live streaming interface includes a first display image corresponding to a first user and a second display image corresponding to a second user.
[0020] In this embodiment, when a first user and a second user start collaborating in a live room, a live streaming interface including a first display image corresponding to the first user and a second display image corresponding to the second user is displayed.
[0021] The live streaming interface may be a collaboration live streaming interface, the first user and the second user are users participating in the collaboration, the first user may be a live streamer or guest of the live room, the initiator / inviter of the collaboration, or the invitee of the collaboration, and the second user may be the initiator or the invitee of the collaboration. Below, a scene where two live streamers connect live will be described, taking as an example a case where the first user is the invitee of the live connection, and the second / third / fourth / fifth users are the invitees of the live connection.
[0022] S202: In response to the first special effect image being displayed on the second display image, a first special effect indicator corresponding to the first special effect image is displayed on the live streaming interface.
[0023] In this embodiment, when the second user triggers and uses the first special effect image through the live streaming interface corresponding to the second user, the first special effect image is displayed on the second display image. When it is detected that the first special effect image is displayed on the second display image, the first special effect indicator corresponding to the first special effect image is displayed on the live streaming interface corresponding to the first user. Note that, under the condition that the first user does not use the first special effect image, the first special effect indicator corresponding to the first special effect image is displayed on the live streaming interface corresponding to the first user.
[0024] It should be noted that the first special effect sign refers to a sign associated with the first special effect / first special effect image. In different embodiments, the first special effect sign can be displayed in different locations, for example, the first special effect sign can be displayed on the live streaming interface, on the first control, on the navigation bar, on the special effect panel, etc. In the present disclosure, the display location of the first special effect sign is not limited, and any special effect sign associated with the first special effect / first special effect image can be referred to as the first special effect sign.
[0025] When the first special effect indicator is displayed on the live streaming interface corresponding to the first user, the first special effect indicator can be displayed on a navigation bar of the live streaming interface corresponding to the first user. Furthermore, the first special effect indicator can be displayed on a first control shown on the navigation bar. The first control is used to perform an enhancement process on the first display image, and the enhancement process can include one or more of beauty, filter, and special effect processes. Specifically, in response to the first control being displayed on the live streaming interface and the first special effect image being displayed on the second display image, the first special effect indicator is displayed on the first control. The first control includes an entry for a special effect panel.
[0026] For example, as shown in FIG. 3a, when live streamer B in a live room uses a special effect and a special effect image is included on the corresponding display image, a special effect indicator corresponding to the special effect image is displayed on the first control (extended control), thereby providing an entry for live streamer A to quickly use the special effect image.
[0027] In some embodiments, in order to intuitively and clearly inform the first user which user uses the special effect sign shown in the live streaming interface, the user sign of the second user may be further displayed on the first special effect sign displayed on the live streaming interface corresponding to the first user. The user sign may be the avatar of the second user, a thumbnail of the second display image and / or a nickname, etc. For example, in the display effect diagram shown in FIG. 3b, the avatar of the live streamer B is displayed on the special effect sign. The display position of the user sign on the first special effect sign may be set according to the actual application situation, for example, as shown in FIG. 3b, the avatar of the live streamer B is displayed in the upper left corner of the first special effect sign.
[0028] In some embodiments, when it is detected that the first special effect image is displayed on the second display image, the time for displaying the first special effect image on the second display image can be counted, and when the display time is equal to or longer than a second predetermined time, a first special effect indicator is displayed on the live streaming interface corresponding to the first user, thereby ensuring the stability of the information displayed on the live streaming interface. For example, when the second predetermined time is 10 seconds, when the time for using the first special effect image of the second user exceeds 10 seconds, the first special effect indicator is displayed on the live streaming interface corresponding to the first user.
[0029] S203: In response to a trigger operation by a first user on a first special effect sign, a first special effect image is displayed on the first display image.
[0030] In this embodiment, when the first user triggers the first special effect indicator displayed on the live streaming interface, the first special effect image is displayed on the first display image, that is, the first special effect indicator provides an entry for the first user to quickly use the first special effect image.
[0031] In this way, when the first display image corresponding to the first user and the second display image corresponding to the second user are displayed on the live distribution interface, and the first special effect image is displayed on the second display image, the first special effect indicator corresponding to the first special effect image is displayed on the live distribution interface corresponding to the first user. In response to the trigger operation of the first user on the first special effect indicator, the first special effect image is displayed on the first display image. That is, by displaying the first special effect indicator corresponding to the first special effect image on the live distribution interface corresponding to the first user, a shortcut entry for reusing the first special effect image is provided for the first user, and the first user does not need to perform complicated operations, improving the user's usage experience. In addition, by allowing multiple users collaborating to quickly use multiple identical special effect images to enrich the interaction method of the live room, it contributes to improving the interaction atmosphere of the collaboration scene, especially the PK scene.
[0032] Displaying the first special effect image on the first display image based on the first user's trigger operation on the first special effect sign can be realized in the following manner.
[0033] In one implementation, the first special effect image is directly displayed on the first display image in response to the first user clicking the first special effect sign, i.e., when the first user clicks the first special effect sign, the first user indicates that he / she wants to use the first special effect image, and the first special effect image is directly added on the first display image.
[0034] Another implementation is a method of displaying a special effect panel including a first special effect sign in response to a trigger operation of the first user on the first special effect sign, and displaying a first special effect image on the first display image in response to the trigger operation of the first user on the first special effect sign on the special effect panel. That is, when the trigger operation of the first user on the first special effect sign displayed on the live streaming interface is detected, the first user triggers a confirmation operation on the first special effect sign on the special effect panel by directly calling up the special effect panel, thereby displaying the first special effect image on the first display image. That is, this embodiment provides a method of quickly calling up the special effect panel, so that the first user can quickly reuse the first special effect image, improving the user experience.
[0035] In order to allow the first user to intuitively know which user in the live room is using the special effect image corresponding to the special effect sign displayed on the special effect panel, the user sign of the second user may be displayed on the first special effect sign displayed on the special effect panel. For example, as shown in FIG. 3c, the live streamer A calls the special effect panel by triggering the first special effect sign displayed on the live distribution interface, and the first special effect sign is displayed on the special effect panel, and the avatar of the live streamer B is displayed on the first special effect sign.
[0036] In some embodiments, the live streaming interface further includes a third display image corresponding to a third user, the third display image including the first special effect image, and the method further includes displaying a user indicator of the third user on the first special effect indicator displayed on the special effect panel, i.e., when other users in the live room also use the first special effect image, user indicators corresponding to all users who use the first special effect image are displayed on the first special effect indicator displayed on the special effect panel.
[0037] When the user marker of the second user and the user marker of the third user are displayed on the first special effect sign, the user marker of the second user and the user marker of the third user can be displayed at different positions of the first special effect sign, respectively, and the display positions corresponding to the two user markers do not overlap. For example, as shown in FIG. 4a, the avatar of Liver B is displayed at the upper left corner of the first special effect sign, and the avatar of Liver C is displayed at the upper right corner of the first special effect sign, and the display areas corresponding to the two avatars do not overlap. When the user markers of different users are displayed at different positions of the first special effect sign, the corresponding display positions can be specified according to the start time at which the user starts using the first special effect image, and the user marker of the user can be displayed at the corresponding display positions. That is, the correspondence between the different start times and the display positions can be set in advance, and the matching display positions can be specified based on the correspondence. For example, the display position corresponding to the user mark corresponding to the user who uses the first special effect image latest is the upper left corner of the first special effect mark, and the display position corresponding to the user mark corresponding to the user who uses the first special effect image earliest is the lower right corner of the first special effect mark.
[0038] In addition, a number threshold for displaying user markers may be set in advance, and if the number of users using the first special effect image is greater than the number threshold, the number of users up to the number threshold will be identified according to time, and the user markers of each of the number threshold users will be displayed on the first special effect marker.
[0039] When the user indicator of the second user and the user indicator of the third user are displayed on the first special effect indicator, they may be displayed in the following manner. That is, the user indicator of the third user and the user indicator of the second user are displayed superimposed on the first special effect indicator. A display area occupied by the user indicator of the second user on the first special effect indicator and a display area occupied by the user indicator of the third user on the first special effect indicator have a partial overlapping area. Furthermore, the superimposing positions corresponding to the user indicator of the third user and the user indicator of the second user may be specified according to the time when the third user enables the first special effect image and the time when the second user enables the second special effect image. For example, when the time when the third user enables the first special effect image is earlier than the time when the second user enables the second special effect image, the user indicator of the second user is displayed superimposed on the user indicator of the third user. For example, as shown in Figure 4b, the first special effect sign shows the avatar of live streamer B and the avatar of live streamer C, and since the time when live streamer C uses the first special effect image is earlier than the time when live streamer B uses the first special effect image, live streamer B's avatar is displayed shifted over live streamer C's avatar.
[0040] In some embodiments, the method further includes canceling display of the first special effect sign in the live streaming interface in response to the first user not triggering the first special effect sign within a first predetermined time, i.e., a time for allowing the first special effect sign to be displayed in the live streaming interface can be preset, and the display is automatically canceled when the display time is equal to the first predetermined time.
[0041] In some embodiments, when the live streaming interface further includes a fourth display image corresponding to a fourth user, the fourth display image displays the second special effect image, and the step of displaying the first special effect indicator on the live streaming interface includes a step of displaying the first special effect indicator and the second special effect indicator corresponding to the second special effect image in a carousel on the live streaming interface. That is, when a plurality of users other than the first user use different special effect images for a live room, the live streaming interface corresponding to the first user displays the special effect indicators corresponding to the different special effect images in a carousel, thereby providing a shortcut entry for reusing each special effect image for the first user and improving the user's usage experience. Or, the first special effect indicator and the second special effect indicator are displayed in an overlapping manner on the live streaming interface. In a situation where they are displayed in an overlapping manner, the first special effect image and the second special effect image are displayed on the first display image in response to a trigger operation of the first user on the first special effect indicator. That is, a plurality of special effect images can be added to the first display image by one trigger operation, improving the convenience of adding a plurality of special effect images.
[0042] In response to a trigger operation by the first user on the first special effect sign, a special effect panel may be displayed, the special effect panel is used to display a plurality of special effect signs, the plurality of special effect signs including the first special effect sign, and in response to a selection operation triggered by the first user on a third special effect sign displayed on the special effect panel, the first special effect image displayed on the first display image may be replaced with a third special effect image corresponding to the third special effect sign. That is, when a trigger operation by the first user on the first special effect sign is detected, the special effect panel is directly called up, and the special effect panel can be quickly entered, so that the special effect image that the user is interested in can be obtained more efficiently and the user's usage experience is improved.
[0043] In some embodiments, the live streaming interface further includes a fifth display image corresponding to a fifth user, and a fourth special effect image is displayed on the fifth display image, and the method further includes the steps of: acquiring a first effective time corresponding to the use of the first special effect image by the second live streamer and a second effective time corresponding to the use of the second special effect image by the fifth user; determining display positions corresponding to the first special effect sign and the fourth special effect sign on the special effect panel based on the first effective time and the second effective time; and displaying the first special effect sign at the display position corresponding to the first special effect sign and the fourth special effect sign at the display position corresponding to the fourth special effect sign. That is, the display positions of the special effect signs on the special effect panel can be determined according to the time at which each special effect image is enabled, and further displayed at the corresponding display positions. For example, the special effect signs corresponding to the special effect images used by each user are displayed in order from the latest effective time to the earliest effective time, which facilitates an intuitive understanding of the time order in which each special effect image is used. For example, if the time when Liver B starts using special effect 1 is earlier than the time when Liver C starts using special effect 2, then special effect 2 will be displayed first, followed by special effect 1 on the special effects panel.
[0044] In addition, a fourth special effect indicator may be displayed on the live streaming interface to provide an entry for the first user to quickly reuse the fourth special effect image. For the fourth special effect indicator and the related implementation manner of displaying the fourth special effect image on the first display image, reference may be made to the description of the first special effect indicator in S201-S203 above, and the present embodiment will not repeat the description here.
[0045] Based on the above method embodiment, the embodiment of the present application provides a live streaming video processing apparatus and device, which will be described below in conjunction with the drawings.
[0046] Referring to FIG. 5, this figure is a structural diagram of a live streaming video processing device according to an embodiment of the present application. As shown in FIG. 5, the device may include a first display unit 501, a second display unit 502, and a third display unit 503. The first display unit 501 is used for displaying a live streaming interface, the live streaming interface including: a first display image corresponding to a first user and a second display image corresponding to a second user; the second display unit 502 is used for displaying a first special effect sign corresponding to the first special effect image on the live streaming interface in response to the first special effect image being displayed on the second display image; The third display unit 503 is used for displaying the first special effect image on the first display image in response to a trigger operation of the first user on the first special effect sign.
[0047] In an embodiment of the present disclosure, the second display unit 502 is further used for displaying a user sign of the second user on the first special effect sign displayed on the live streaming interface.
[0048] In one embodiment of the present disclosure, the third display unit 503 is specifically used for directly displaying the first special effect image on the first display image in response to the first user's click operation on the first special effect sign.
[0049] In one embodiment of the present disclosure, the third display unit 503 is specifically used for displaying a special effect panel in response to the first user's trigger operation on the first special effect sign, the special effect panel including the first special effect sign, and is used for displaying the first special effect image on the first display image in response to the first user's trigger operation on the first special effect sign on the special effect panel.
[0050] In one embodiment of the present disclosure, the device comprises: The display device further includes a fourth display unit for displaying a user sign of the second user on the first special effect sign displayed on the special effect panel.
[0051] In one embodiment of the present disclosure, the live streaming interface further includes a third display image corresponding to a third user, the third display image includes the first special effect image, and the fourth display unit is further used to display a user sign of the third user on the first special effect sign displayed on the special effect panel.
[0052] In one embodiment of the present disclosure, the fourth display unit is specifically used to superimpose the user sign of the third user and the user sign of the second user on the first special effect sign, and there is a partial overlapping area between the display area occupied by the user sign of the second user on the first special effect sign and the display area occupied by the user sign of the third user on the first special effect sign.
[0053] In one embodiment of the present disclosure, the live streaming interface further includes a fourth display image corresponding to a fourth user, a second special effect image is displayed in the fourth display image, and the second display unit 502 is specifically used for carousel display of the first special effect sign and a second special effect sign corresponding to the second special effect image on the live streaming interface.
[0054] In one embodiment of the present disclosure, in response to the first user triggering the first special effect sign, the device further includes a fifth display unit; the fifth display unit is used for displaying a special effect panel, and a plurality of special effect signs are displayed on the special effect panel, and the plurality of special effect signs include the first special effect sign; The third display unit 503 is further used to replace the first special effect image displayed on the first display image with a third special effect image corresponding to the third special effect sign in response to a selection operation triggered by the first user on a third special effect sign displayed on the special effect panel.
[0055] In one embodiment of the present disclosure, the live streaming interface further includes a fifth display image corresponding to a fifth user, and a fourth special effect image is displayed on the fifth display image, and the device further includes an acquisition unit, an identification unit, and a sixth display unit; the obtaining unit is used for obtaining a first valid time corresponding to a use of the first special effect image by the second user and a second valid time corresponding to a use of the fourth special effect image by the fifth user; the identifying unit is used to identify display positions corresponding to the first special effect sign and the fourth special effect sign on a special effect panel according to the first effective time and the second effective time; The sixth display unit is used for displaying the first special effect sign at a display position corresponding to the first special effect sign, and for displaying the fourth special effect sign at a display position corresponding to the fourth special effect sign.
[0056] In one embodiment of the present disclosure, a first control is displayed on the live streaming interface, and the second display unit 502 is used to display a first special effect sign corresponding to the first special effect image on the first control in response to a first special effect image being displayed on the second display image, and the first control is used to perform enhancement processing on the first display image.
[0057] In one embodiment of the present disclosure, the apparatus further comprises a processing unit; The processing unit is adapted to cancel display of the first special effect sign in the live streaming interface in response to the first live broadcaster not triggering the first special effect sign within a first predetermined time.
[0058] For the specific implementation of each unit in this embodiment, reference can be made to the relevant description in the above method embodiment. In the embodiment of the present application, the partition for the unit is schematic and is merely a logical function partition, and may have a different partitioning scheme when actually implemented. Each functional unit in the embodiment of the present application may be integrated into one processing unit, each unit may exist physically alone, or two or more units may be integrated into one unit. For example, in the above embodiment, the processing unit and the transmission unit may be the same unit or different units. The integrated unit may be implemented in the form of hardware or in the form of a software functional unit.
[0059] Referring to FIG. 6, a structural schematic diagram of an electronic device 600 suitable for implementing an embodiment of the present disclosure is shown. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 6 is merely an example and should not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.
[0060] 6, the electronic device 600 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 601 capable of performing various suitable operations and processes according to a program stored in a read-only memory (ROM) 602 or loaded from a storage device 608 into a random access memory (RAM) 603. Various programs and data necessary for the operation of the electronic device 600 are further stored in 603. The processing unit 601, the ROM 602 and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.
[0061] Typically, input devices 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyro, etc., output devices 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc., storage devices 608 including, for example, a magnetic tape, a hard disk, etc., and a communication device 609 can be connected to the I / O interface 605. The communication device 609 allows the electronic device 600 to communicate wirelessly or wired with other devices to exchange data. Although FIG. 6 illustrates the electronic device 600 having various devices, it should be understood that it is not required to implement or include all of the devices shown. Instead, more or fewer devices may be implemented or included.
[0062] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer readable medium, the computer program including program code for performing the method illustrated in the flowcharts. In such embodiments, the computer program may be downloaded and installed from a network via the communication device 609, or installed from the storage device 608, or stored in a ROM. 602. When the computer program is executed by the processing unit 601, it performs the above-mentioned functions defined in the manner of the embodiments of the present disclosure.
[0063] The electronic device provided by the embodiments of the present disclosure belongs to the same inventive concept as the method provided by the above embodiments, and for technical details not described in detail in this embodiment, the above embodiments may be referred to, and this embodiment has the same beneficial effects as the above embodiments.
[0064] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon, which, when executed by a processor, implements the method provided by the above embodiment.
[0065] It should be noted that the above computer readable medium of the present disclosure may be a computer readable signal medium, or a computer readable storage medium, or any combination of the above. The computer readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagating in baseband or as part of a carrier wave, the data signal carrying a computer-readable program code. Such a propagated data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, the computer-readable signal medium being capable of transmitting, propagating, or transmitting a program for use by or in connection with an instruction execution system, apparatus, or device. The program code included in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, an electrical wire, an optical fiber cable, RF (radio frequency), or the like, or any suitable combination of the above.
[0066] In some embodiments, the client and server may communicate over a network using, for example, HTTP (Hypertext Transfer Protocol (HTTP) The networks may communicate using any network protocol now known or later developed, such as the HyperText Transfer Protocol (HTTP), and may interconnect any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include a local area network ("LAN"), a wide area network ("WAN"), the World Wide Web (e.g., the Internet), an end-to-end network (e.g., ad hoc end-to-end networks), and any networks now known or developed in the future.
[0067] The computer-readable medium may be included in the electronic device, or may be separate from and not located on the electronic device.
[0068] The computer-readable medium stores one or more programs that, when executed by the electronic device, cause the electronic device to perform the method.
[0069] The computer program code for carrying out the operations of the present disclosure can be written in one or many programming languages or combinations thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and further including, but not limited to, conventional procedural programming languages such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a single stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. When a remote computer is involved, the remote computer can be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., connecting via the Internet using an Internet service provider).
[0070] The flowcharts and block diagrams in the drawings illustrate architecture, functions, and operations that can be realized according to the system, method, and computer program product of various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram can represent a module, program segment, or part of code, which includes one or more executable instructions for implementing a certain logical function. It should be noted that in some alternative implementations, the functions shown in the blocks may occur according to an order different from the order shown in the figures. For example, two blocks shown in succession may actually be executed essentially in parallel, or in some cases according to the reverse order, depending on the related functions. Also, each block in the block diagram and / or flowchart, and combinations of blocks in the block diagram and / or flowchart may be realized in a dedicated system by hardware, or in a combination of dedicated hardware and computer instructions, for executing a certain function or operation.
[0071] The units described in the embodiments of the present disclosure may be implemented in a software manner or a hardware manner, and the names of the units / modules, if any, do not constitute limitations on the units themselves.
[0072] The functionality described herein may be performed, at least in part, by one or more hardware logic components, For example, exemplary types of hardware logic components that may be utilized include, but are not limited to, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.
[0073] In this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program that may be used by or in combination with an instruction execution system, device, or machine. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium includes, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or machine, or any suitable combination of the above. More specific examples of machine-readable storage media include an electrical connection by one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0074] In addition, each embodiment in this specification will be described step by step, and each embodiment will focus on the differences from other embodiments, and the same or similar parts between each embodiment can be referred to each other. The system or apparatus disclosed in the embodiment corresponds to the method disclosed in the embodiment, so it will be briefly described, and the relevant parts can be referred to the method part.
[0075] In this application, it should be understood that "at least one" means one or more, and "multiple" means two or more. "And / or" is used to describe the related relationship of related objects, and indicates that three types of relationships can exist, for example, "A and / or B" can indicate three situations: only A exists, only B exists, and A and B exist simultaneously, and A and B may be singular or plural. The character " / " generally indicates that the related objects before and after are in an "or" relationship. "At least one of the following" or similar expressions means any combination of these terms, including any combination of single terms or multiple terms. For example, at least one of a, b, or c can indicate a, b, c, "a and b", "a and c", "b and c", or "a, b and c", and a, b, c may be single or multiple.
[0076] It should be noted that relational terms such as "first" and "second" are merely intended to distinguish an entity or operation from other entities or operations and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprise", "comprises", or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that includes a set of elements further includes not only those elements but also other elements not expressly listed or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the element.
[0077] The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination thereof. The software module may be located in a Random Access Memory (RAM), a memory, a Read Only Memory (ROM), an Electrically Programmable ROM, an Electrically Erasable Programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0078] The above description of the disclosed embodiments will enable one skilled in the art to make or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Thus, the present application is not limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A live streaming video processing method executed by an electronic device, comprising: displaying a live streaming interface, the live streaming interface including a first display image corresponding to a first user and a second display image corresponding to a second user; In response to a first special effect image being displayed on the second display image, displaying a first special effect sign corresponding to the first special effect image on the live streaming interface; displaying the first special effect image on the first display image in response to a trigger operation of the first special effect sign by the first user; The method according to claim 1, further comprising:
2. The method further includes the step of displaying a user sign of the second user on the first special effect sign displayed on the live distribution interface.
2. The method of claim 1 .
3. The step of displaying the first special effect image on the first display image in response to a trigger operation by the first user on the first special effect sign includes: directly displaying the first special effect image on the first display image in response to a click operation by the first user on the first special effect sign.
2. The method of claim 1 .
4. The step of displaying the first special effect image on the first display image in response to a trigger operation by the first user on the first special effect sign includes: displaying a special effects panel in response to a trigger operation by the first user on the first special effects sign, the special effects panel including the first special effects sign; displaying the first special effect image on the first display image in response to a trigger operation by the first user on the first special effect sign on the special effect panel; 2. The method of claim 1, comprising:
5. further comprising the step of displaying a user sign of the second user on the first special effect sign displayed on the special effect panel.
5. The method of claim 4.
6. The live streaming interface further includes a third display image corresponding to a third user, the third display image including the first special effect image, and the method further includes: further comprising the step of displaying a user sign of the third user on the first special effect sign displayed on the special effect panel.
6. The method of claim 5 .
7. The step of displaying a user sign of the third user on the first special effect sign displayed on the special effect panel includes: a step of displaying a user mark of the third user and a user mark of the second user in an overlapping manner on the first special effect sign, wherein a display area occupied by the user mark of the second user on the first special effect sign and a display area occupied by the user mark of the third user on the first special effect sign have a partial overlapping area; 7. The method of claim 6.
8. The live streaming interface further includes a fourth display image corresponding to a fourth user, a second special effect image is displayed in the fourth display image, and the step of displaying a first special effect indicator corresponding to the first special effect image on the live streaming interface includes: displaying the first special effect sign and a second special effect sign corresponding to the second special effect image in a carousel on the live streaming interface; 2. The method of claim 1 .
9. In response to the first user triggering the first special effect sign, the method includes: displaying a special effect panel, the special effect panel displaying a plurality of special effect signs, the plurality of special effect signs including the first special effect sign; In response to a selection operation triggered by the first user with respect to a third special effect sign displayed on the special effect panel, replacing the first special effect image displayed on the first display image with a third special effect image corresponding to the third special effect sign; The method of claim 1 further comprising:
10. The live streaming interface further includes a fifth display image corresponding to a fifth user, and a fourth special effect image is displayed on the fifth display image, and the method includes: obtaining a first valid time corresponding to a use of the first special effect image by the second user and a second valid time corresponding to a use of the fourth special effect image by the fifth user; determining display positions on a special effect panel corresponding to the first special effect sign and the fourth special effect sign, respectively, based on the first effective time and the second effective time; displaying the first special effect sign at a display position corresponding to the first special effect sign, and displaying the fourth special effect sign at a display position corresponding to the fourth special effect sign; The method of claim 1 further comprising:
11. the step of displaying a first special effect sign corresponding to the first special effect image on the live streaming interface in response to a first control being displayed on the live streaming interface and a first special effect image being displayed on the second display image, comprising: displaying a first special effect indicator on the first control in response to a first special effect image being displayed on the second display image, the first control including a special effect panel entry; 2. The method of claim 1, comprising:
12. canceling display of the first special effect sign in the live streaming interface in response to the first live streamer not triggering the first special effect sign within a first predetermined time; The method according to any one of claims 1 to 11, further comprising:
13. A live streaming video processing device, comprising: A first display unit for displaying a live streaming interface, the live streaming interface including a first display image corresponding to a first user and a second display image corresponding to a second user; a second display unit for displaying a first special effect sign corresponding to the first special effect image on the live streaming interface in response to the first special effect image being displayed on the second display image; a third display unit for displaying the first special effect image on the first display image in response to a trigger operation of the first user on the first special effect sign; An apparatus comprising:
14. An electronic device including a processor and a memory, The memory is used to store instructions or computer programs; The processor is adapted to execute the instructions or computer programs in the memory to cause the electronic device to perform the method according to any one of claims 1 to 12.
1. An electronic device comprising:
15. 1. A computer-readable storage medium, comprising: The computer readable storage medium has stored thereon instructions which, when executed on an apparatus, cause the apparatus to carry out a method according to any one of claims 1 to 12. A computer-readable storage medium comprising:
16. A computer program product comprising computer program instructions, which when executed on a computer cause the computer to carry out the method according to any one of claims 1 to 12.
23. A computer program product comprising:
Citation Information
Patent Citations
Adaptive loudness normalization for audio object clustering
CN113366865A
Direct broadcasting room switching method and device and computer equipment
CN113938700A
Game operation synchronization system, method and device, equipment and storage medium
CN114025180A
Information synchronization method and device, computer equipment, storage medium and program product
CN114466213A
Communication system
JP2015529031A