Live streaming video processing method, device, equipment and medium
The method addresses video stream hopping in live streaming by using a mask layer to smoothly swap display positions of live streamers, ensuring a seamless viewing experience.
Patent Information
- Application Number
- JP2024573742
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-06-30
- Filing Date
- 2023-06-30
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2043-06-30
AI Technical Summary
Live streaming video experiences momentary 'hopping' during location switching, causing lag and affecting viewer experience in collaborative streaming scenarios.
A method involving a mask layer is used to swap display positions of live streamers in a live room interface, masking the current images and then swapping them smoothly without perceivable video stream hopping.
Ensures a seamless viewing experience by preventing momentary video stream hopping during location or team switching in live streaming, enhancing user interaction and understanding.
Smart Images

Figure 0007757552000001 
Figure 0007757552000002 
Figure 0007757552000003
Abstract
Description
[Technical Field]
[0001] This application claims priority from a Chinese patent application filed with the China Patent Office on June 30, 2022, bearing application number 202210772659.3 and entitled "Live streaming video processing method, device, equipment and medium," the entire contents of which are incorporated herein by reference.
[0002] The present application relates to the field of computer technology, and in particular to a method, apparatus, device and medium for processing live streaming video. [Background technology]
[0003] With the continuous development of live streaming technology, more and more users are interacting through live streaming. To increase the interest of live streaming, users can collaborate or compete during live streaming to attract more viewers. In collaborative streaming scenarios, users usually need to switch locations, for example, in PK, there is a need for group switching. In related technologies, when switching locations, the video stream of the live room will experience a momentary "hopping", which will cause a lag in the video stream and affect the viewers' viewing experience. Summary of the Invention [Problem to be solved by the invention]
[0004] In view of this, the present application provides a method, apparatus, device and medium for processing live streaming video. [Means for solving the problem]
[0005] To achieve the above objectives, the technical solutions provided by this application are as follows: According to a first aspect of the present application, there is provided a method for processing live streaming video, the method comprising: Displaying a live room interface including a first display area and a second display area, displaying a display image corresponding to a first live streamer in the first display area, and displaying a display image corresponding to a second live streamer in the second display area; displaying a mask layer in the first display area and the second display area in response to a display switching request for the first display area and the second display area, respectively; In response to the switching being completed, the method includes a step of canceling the display of the mask layer in the first display area and the second display area, displaying a display image corresponding to the second driver in the first display area, and displaying a display image corresponding to the first driver in the second display area.
[0006] According to a second aspect of the present application, there is provided a live streaming video processing device, the device comprising: a first display unit that displays a live room interface including a first display area and a second display area, displays a display image corresponding to a first live streamer in the first display area, and displays a display image corresponding to a second live streamer in the second display area; a second display unit that displays a mask layer in the first display area and the second display area in response to a display switching request for the first display area and the second display area, respectively; and a third display unit that, in response to the switching being completed, cancels the display of the mask layer in the first display area and the second display area, displays a display image corresponding to the second driver in the first display area, and displays a display image corresponding to the first driver in the second display area.
[0007] According to a third aspect of the present application, there is provided an electronic device, the device comprising: a memory for storing instructions or computer programs; and a processor that executes the instructions or computer program in the memory to cause the electronic device to perform the method of the first aspect.
[0008] According to a fourth aspect of the present application, there is provided a computer-readable storage medium having stored thereon instructions that, when executed on a device, cause the device to perform the method of the first aspect.
[0009] According to a fifth aspect of the present application, there is provided a computer program product, the computer program product comprising computer programs / instructions which, when executed by a processor, implement the method of the first aspect. [Brief explanation of the drawings]
[0010] In order to more clearly explain the technical solutions of the embodiments or related art of the present application, the following briefly introduces the drawings necessary for the description of the embodiments or related art. The drawings described below are only some of the embodiments described in the present application, and those skilled in the art can obtain other drawings based on these drawings on the premise that they do not make efforts that amount to inventive step. [Figure 1] 1 is a flowchart of a live streaming video processing method according to an embodiment of the present application; [Figure 2a] FIG. 1 is a schematic diagram of a live streaming scenario according to an embodiment of the present application. [Figure 2b] FIG. 1 is a schematic diagram of another live streaming scenario according to an embodiment of the present application. [Figure 2c] FIG. 1 is a schematic diagram of adjusting a live broadcast window according to an embodiment of the present application; [Figure 2d] 1 is a schematic diagram of a mask layer covered according to an embodiment of the present application; [Figure 2e] FIG. 10 is a schematic diagram of another mask layer covered according to an embodiment of the present application. [Figure 3] 1 is a schematic diagram of a live streaming video processing device according to an embodiment of the present application; [Figure 4] 1 is a structural schematic diagram of an electronic device according to an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION
[0011] In order to help those skilled in the art to better understand the solution of the present application, the following clearly and completely describes the technical solutions of the embodiments of the present application, combined with the drawings of the embodiments of the present application, and the described embodiments are not all of the embodiments, but only some of the embodiments of the present application. Based on the embodiments of the present application, on the premise that those skilled in the art do not make efforts that amount to inventive steps, all other embodiments obtained fall within the protection scope of the present application.
[0012] In a live streaming scenario, when multiple live streamers collaborate in a single live room, the display positions of the multiple live streamers need to be adjusted. For example, the live streamer displayed in the center of the live room needs to be switched to another live streamer. Or, when a live room transitions from a multi-person collaborative stream to a team battle, if the live streamers from the same team are not on the same side, the live stream group in the live room interface and the PK progress bar belonging to that group need to be synchronized, and the live streamer's seat needs to be swapped to easily inform users of the PK progress and the live streamers corresponding to each PK group. Currently, because the live stream viewing side uses push streaming technology, when the live streamer's display position is swapped, the live stream video stream in the live room momentarily hops, giving viewers the illusion of lag. Furthermore, because the hopping of the live streamer's display position does not prompt the viewer, it increases the user's understanding cost and can be mistaken for a system abnormality. Collaborative streaming is a microphone sequence mode that allows multiple players to speak simultaneously using microphones, realizing needs such as multiplayer interaction and program exchange. Live streaming collaborative streaming is a new social method that uses live streaming as a foundation and voice technology to foster closer interaction and exchange.
[0013] Based on this, the present application provides a live streaming video processing method. Specifically, before switching, the displayed live room interface includes a first display area and a second display area. A display image corresponding to a first live streamer is displayed in the first display area, and a display image corresponding to a second live streamer is displayed in the second display area. After receiving a display switching request for the first and second display areas, a mask layer is displayed in the first and second display areas, respectively, to mask the images displayed in each display area. After the display switching is completed, the display of the mask layer is canceled in the first and second display areas, and a display image corresponding to the second live streamer is displayed in the first display area, and a display image corresponding to the first live streamer is displayed in the second display area. That is, by masking using the mask layer, the display positions of the first and second live streamers in the live room are swapped, preventing momentary hopping of the video stream on the live streaming viewer side and ensuring a smooth live streaming viewing experience.
[0014] It should be understood that before using the technical solutions of each embodiment of the present disclosure, the type, scope of use, usage scenario, etc. of the relevant personal information will be notified to the user in an appropriate manner, and the user's permission will be obtained.
[0015] For example, in response to receiving a voluntary request from a user, prompt information may be sent to the user to clearly prompt the user that the requested operation requires the acquisition and use of the user's personal information, so that the user can voluntarily choose whether to provide personal information to software or hardware, such as an electronic device, application program, server, or storage medium, that performs the operation of the technical solution of the present disclosure, based on the prompt information.
[0016] In an optional but non-limiting embodiment, the form in which the prompt information is sent to the user in response to receiving a voluntary request from the user may be, for example, a form in which the prompt information is displayed in text form in a pop-up window, and the pop-up window may be equipped with a selection control for the user to select "agree" or "reject" providing personal information to the electronic device.
[0017] Here, the above notification and user permission acquisition process does not limit the implementation of the present disclosure, but is merely a general outline, and other forms that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0018] In order to facilitate understanding of the technical solutions provided by the embodiments of the present application, the following description will be given in conjunction with the drawings.
[0019] Referring to Figure 1, this figure is a flowchart of a live streaming video processing method provided by an embodiment of the present application, which can be performed by a live streaming video processing device, which can be an electronic device, which can be a device with a communication function such as a mobile phone, a tablet, a laptop, a desktop computer, an in-vehicle terminal, a wearable electronic device, an all-in-one device, a smart home device, etc., or a device simulated by a virtual machine or a simulator. As shown in Figure 1, the method can include the following steps: S101: Display the live room interface. The live room interface includes a first display area and a second display area, and displays a display image corresponding to a first live streamer in the first display area and a display image corresponding to a second live streamer in the second display area. S102: In response to a display switching request for the first display area and the second display area, a mask layer is displayed in the first display area and the second display area, respectively.
[0020] In this embodiment, after receiving a display switching request for the first display area and the second display area, a mask layer (e.g., a first mask layer) is displayed in the first display area, and a mask layer (e.g., a second mask layer) is displayed in the second display area, and the images displayed in each display area are shielded by the mask layer, thereby switching the displayed images when a mask layer is present. The mask layer can cover the images in the area connected to the mask layer.
[0021] The display switch request requests that the display images displayed in the first display area and the second display area be switched, and the display switch request can be triggered as follows.
[0022] In one case, when it is necessary to switch the image displayed in the central position of the live room, a display switch request is sent, the display switch request being a switch request targeting the display areas of the first and second live streamers. The step of triggering the switch of the image displayed in the central position includes the following: the live streamer triggers a switch operation in the live room, for example, the first display area is a display area corresponding to the central position of the live room, and the first live streamer triggers a switch operation in the live room, and in response to the switch operation, the live streaming client sends a display switch request to the corresponding server. Alternatively, if the resource value acquired by another live streamer in the live room is equal to or greater than a preset resource threshold, the live streaming client voluntarily sends a display switch request to the server. For example, if the first display area is a display area corresponding to the central position of the live room, the first live streamer is located in the central position, and the resource value acquired by the second live streamer is equal to the preset resource threshold, the live streaming client triggers the display switch. Furthermore, a display period threshold for each live streamer at the center position is set in advance, and when the display period for a certain live streamer at the center position is equal to the display period threshold, display switching is triggered.
[0023] For example, in the schematic diagram of a live room scenario shown in Figure 2a, the live room includes four display areas, namely, display area 1, display area 2, display area 3, and display area 4, which respectively display images of Liver A, Liver B, Liver C, and Liver D, with the central position being display area 1. When Liver A triggers a switching operation in the live room, he sends a display switching request.
[0024] In another case, when multiple live streamers in a live room collaborate and form a team for penalty kicks, if the live stream windows of different live streamers belonging to the same live stream group are not located on the same side, the display positions of the live stream windows need to be adjusted. Specifically, before the penalty kick begins, the live stream windows corresponding to the live streamers belonging to the same team are displayed on the same side, for example, the left or right, to allow viewers to intuitively understand which live streamers belong to the same team. In the live room, if the live stream windows of the live streamers from the same team are not located on the same side, a display switching request is triggered. In this case, a display image corresponding to a first live streamer in a first live stream group is displayed in a first display area, and a display image corresponding to a second live streamer in a second live stream group is displayed in a second display area. The display switching request is a switching request for the live stream groups of the first and second live streamers. If the service detects that the live stream windows of the live streamers belonging to the same team are not located on the same side, the display switching may be triggered by the live streamer via a live stream client.
[0025] Specifically, in the process of forming a team and playing PK, the live streamer who starts forming the team may further select team members through the client, and the display switch is triggered in response to the selection operation triggered by the live streamer. Specifically, the live streaming client includes a selection control, and when the live streamer triggers the selection control, a member selection interface is displayed, and the live streamer selects members to be included in the team from the member selection interface. In response to the selection operation triggered by the live streamer, a display switch request is sent to the live streaming service side.
[0026] The live streaming windows of each live streamer in the first live streaming group are located on a first side of the live room, and the live streaming windows of each live streamer in the second live streaming group are located on a second side of the live room. Specifically, the live room is divided into a left display area and a right display area, with the first side being the left display area of the live room and the second side being the right display area.
[0027] For example, when transitioning from a four-person collaborative broadcast shown in FIG. 2b to a team competition, Liver A and Liver B belong to Team 1, Liver C and Liver D belong to Team 2, and Liver A's live streaming video stream is displayed in Display Area 1, Liver B's live streaming video stream is displayed in Display Area 2, Liver C's live streaming video stream is displayed in Display Area 3, and Liver D's live streaming video stream is displayed in Display Area 4. However, if Liver A and Liver B are located on different sides, and Liver C and Liver D are also located on different sides, the first Liver is Liver A, the second Liver is Liver D, the first display area is Display Area 1, and the second display area is Display Area 4, or the first Liver is Liver B, and the second Liver is Liver C, the first display area is Display Area 2, and the second display area is Display Area 3.
[0028] In response to multiple live streamers in a live room completing team formation, before the competition begins, the live streaming window of the live room moves downward overall, and the competition progress bar corresponding to each competing group is displayed in the downward-moving portion. The competition progress bar is used to reflect the achievements of a team during the competition. As shown in Figure 2c, the live streaming window in the right-hand figure moves downward relative to the live streaming window in the left-hand figure, and the competition progress bar for Team 1 and the competition progress bar for Team 2 are displayed in the downward-moving portion.
[0029] In one embodiment of the present disclosure, in order to allow a user viewing a live room to intuitively know which live streamer's display image is displayed in the masked display area, a live streamer indicator of the live streamer corresponding to the display image displayed in the masked display area is displayed on the mask layer, thereby allowing the user to directly know the live streamer corresponding to the current area and reducing the user's understanding cost. The live streamer indicator may include a live streamer avatar.
[0030] For example, in the application scenario shown in Figure 2b, if the first live streamer is Live streamer B and the second live streamer is Live streamer C, one mask layer is coated on each of display area 2 corresponding to Live streamer B and display area 3 corresponding to Live streamer C, and the live streamer avatar corresponding to the masked live streamer is displayed on each mask layer, as shown in Figure 2d.
[0031] The live streamer avatar may be an avatar of the live streamer obtained from a live streaming window corresponding to the live streamer. Specifically, the live streamer avatar may be an image that the live streamer has installed for display.
[0032] S103: In response to the completion of the switching, the display of the mask layer is canceled in the first display area and the second display area, and a display image corresponding to the second driver is displayed in the first display area, and a display image corresponding to the first driver is displayed in the second display area.
[0033] After displaying the mask layer in each of the first and second display areas, the display images in the two display areas are triggered to be mutually exchanged. That is, the display image displayed in the first display area is switched from the display image corresponding to the first live streamer to the display image corresponding to the second live streamer, and the display image displayed in the second display area is switched from the display image corresponding to the second live streamer to the display image corresponding to the first live streamer, thereby completing the switching operation. After the switching operation is completed, the display of the mask layer can be canceled, and the live streaming video stream can be viewed in the live room. Because the switching of the display image is performed below the mask layer, viewers do not perceive video stream hopping. Note that in one embodiment, the display switching may be performed by both the live streamer and the live streaming viewer.
[0034] In one embodiment of the present disclosure, there are two ways to mutually exchange the display image corresponding to the first display area and the display image corresponding to the second display area.
[0035] According to one embodiment, the display image corresponding to the first display area and the display image corresponding to the second display area are mutually exchanged by mutually exchanging the positions of the display container on the first display area and the display container on the second display area. The display container is used to load a corresponding video stream when a live streamer performs a live broadcast. Specifically, when a live streamer starts a live broadcast through a live streaming platform, the live streaming platform assigns a display container to the live streamer, and different live streamers correspond to different display containers. When it is necessary to mutually exchange the display images displayed in the first display area and the second display area, the display container corresponding to the live streamer displayed in the first display area and the display container corresponding to the live streamer displayed in the second display area are mutually exchanged.
[0036] Here, the live streamer side simultaneously exchanges the display container with the video stream loaded into the display container. That is, by simultaneously exchanging the display container and display image in the first display area with the display container and display image in the second display area, it is ensured that the live streamer side can view the post-switching effect in a timely manner. The live stream viewer side switches the video stream and then switches the display container. That is, the display image corresponding to the first display area and the display image corresponding to the second display area are mutually exchanged, and then the display container in the first display area and the display container in the second display area are mutually exchanged. Because the number of users on the live stream viewer side is relatively large, the above switching can avoid the occupation of system resources due to simultaneous switching.
[0037] According to another aspect, the display image corresponding to the first display area and the display image corresponding to the second display area are mutually exchanged by mutually exchanging the live-streamed video stream in the display container on the first display area and the video stream in the display container on the second display area. In this implementation, the display containers on the display areas are not mutually exchanged, but the live-streamed video streams in the display containers are controlled to be mutually exchanged, thereby exchanging the display images displayed in the display areas.
[0038] In one embodiment of the present disclosure, in order to reduce user's understanding of the exchange of the display images of the live streamers, the live streamer labels on the mask layers are simultaneously exchanged with each other, thereby corresponding the live streamer labels on the mask layers to the live streamers corresponding to the masked display areas. Specifically, the positions of the mask layer on the first display area and the mask layer on the second display area are exchanged with each other, thereby exchanging the live streamer labels with each other. Alternatively, the live streamer labels displayed on the mask layer on the first display area and the live streamer labels displayed on the mask layer on the second display area are exchanged with each other.
[0039] For example, in the application scenario shown in Figure 2d, if the display area 2 corresponding to live streamer B is covered with mask layer 1 and the avatar sign of live streamer B is displayed, and the display area 3 corresponding to live streamer C is covered with mask layer 2 and the avatar sign of live streamer C is displayed, the display image corresponding to live streamer B and the display image corresponding to live streamer C are swapped, and the avatar sign of live streamer C is displayed on mask layer 1, and the avatar sign of live streamer B is displayed on mask layer 2.
[0040] The timing of mutually exchanging the driver signs on the mask layer includes the following three: one is to mutually exchange the driver signs on the mask layer after receiving a display switch request, and then trigger a mutual exchange between the display image corresponding to the first display area and the display image corresponding to the second display area; another is to mutually exchange the display image corresponding to the first display area and the display image corresponding to the second display area after receiving a display switch request, and then trigger a mutual exchange of the driver signs on the mask layer; and still another is to simultaneously mutually exchange the display image and the driver signs after receiving a display switch request.
[0041] In one embodiment of the present disclosure, when the driver marks on the mask layer are interchanged, the driver marks on the mask layer can be interchanged by scaling the driver marks to present the interchange effect to viewers, thereby improving the user's viewing experience. For example, the original driver marks on the mask layer are first displayed at a reduced size, and after the driver marks are interchanged, the interchanged driver marks are displayed at an enlarged size.
[0042] Specifically, the scaled display of the driver signs is realized as follows: the driver signs on the first mask layer and the driver signs on the second mask layer are displayed in a reduced size. After the switching is completed, the driver signs on the first mask layer and the driver signs on the second mask layer are exchanged with each other before canceling the display of the mask layers. The first mask layer is the mask layer displayed in the first display area, and the second mask layer is the mask layer displayed in the second display area. For example, the first mask layer is mask layer 1 in FIG. 2d, and the second mask layer is mask layer 2 in FIG. 2d. The driver signs for driver B on mask layer 1 and driver C on mask layer 2 are first displayed in a reduced size. After the display images in mask layer 1 and mask layer 2 are swapped, the liver sign of liver C is replaced in mask layer 1, and the liver sign of liver B is replaced in mask layer 2, and each liver sign is enlarged and displayed.
[0043] In one embodiment of the present disclosure, to further reduce user confusion regarding the position adjustment of the display images of different live streamers, the mask layer further includes prompt information to notify the user that a mutual exchange is in progress, making it easier for the user to understand the meaning of the mask layer and avoiding user inconvenience. For example, as shown in Figure 2e, the mask layer includes a live streamer avatar corresponding to the masked live streamer and the prompt information "changing position."
[0044] In one embodiment of the present disclosure, if the mask layer includes prompt information, then in response to the switching being completed, the display of the prompt information is stopped and the corresponding respective video stream is displayed.
[0045] In this way, the displayed live room interface includes a first display area and a second display area, and a display image corresponding to the first live streamer is displayed in the first display area, and a display image corresponding to the second live streamer is displayed in the second display area. After receiving a display switching request for the first and second display areas, mask layers are displayed in the first and second display areas, respectively, thereby masking the images displayed in each display area. After the display switching is completed, the display of the mask layers in the first and second display areas is canceled, and a display image corresponding to the second live streamer is displayed in the first display area, and a display image corresponding to the first live streamer is displayed in the second display area. In other words, in this application, by adding a mask layer and completing the switching of the display images in different display areas under the mask layer, momentary hopping of the video stream on the live streaming viewer side is avoided, ensuring a smooth live streaming viewing experience.
[0046] As can be seen, the present application has the following beneficial effects: In the present application, the displayed live room interface includes a first display area and a second display area, and displays a display image corresponding to a first live streamer in the first display area and a display image corresponding to a second live streamer in the second display area. After receiving a display switching request for the first display area and the second display area, mask layers are displayed in the first display area and the second display area, respectively, thereby masking the images displayed in each display area. After the display switching is completed, the display of the mask layers in the first display area and the second display area is canceled, and a display image corresponding to the second live streamer is displayed in the first display area, and a display image corresponding to the first live streamer is displayed in the second display area. In other words, in the present application, adding a mask layer and completing the switching of the display images in different display areas under the mask layer prevents momentary hopping of the video stream on the live streaming viewer side, ensuring a smooth live streaming viewing experience.
[0047] Based on the above method embodiment, the embodiment of the present application provides a live streaming video processing device and equipment, which will be described below in conjunction with the accompanying drawings.
[0048] Please refer to FIG. 3, which is a block diagram of a live streaming video processing device provided by an embodiment of the present application. As shown in FIG. 3, the device 300 includes: a first display unit 301 that displays a live room interface including a first display area and a second display area, displays a display image corresponding to a first live streamer in the first display area, and displays a display image corresponding to a second live streamer in the second display area; a second display unit 302 that displays a mask layer in the first display area and the second display area in response to a display switching request for the first display area and the second display area, respectively; and a third display unit 303 that, in response to the switching being completed, cancels the display of the mask layer in the first display area and the second display area, displays a display image corresponding to the second driver in the first display area, and displays a display image corresponding to the first driver in the second display area.
[0049] In one embodiment of the present disclosure, the step of displaying a display image corresponding to a first live streamer in the first display area and a display image corresponding to a second live streamer in the second display area includes a step of displaying a display image corresponding to a first live streamer in a first live streaming group in the first display area, and a step of displaying a display image corresponding to a second live streamer in a second live streaming group in the second display area.
[0050] In one embodiment of the present disclosure, the step of responding to a display switching request for the first display area and the second display area includes a step of responding to a display area switching request for the first live streamer and the second live streamer.
[0051] In one embodiment of the present disclosure, the step of responding to a display switching request for the first display area and the second display area includes a step of responding to a live streaming group switching request for the first live streamer and the second live streamer.
[0052] In one embodiment of the present disclosure, the device comprises: The display device further includes a first interchange unit that interchanges a display image corresponding to the first display area with a display image corresponding to the second display area before canceling the display of the mask layer in the first display area and the second display area.
[0053] In one embodiment of the present disclosure, the first interchange unit specifically interchanges the display image corresponding to the first display area with the display image corresponding to the second display area by mutually exchanging the positions of the display container on the first display area and the display container on the second display area, or interchanges the display image corresponding to the first display area with the display image corresponding to the second display area by mutually exchanging the live streaming video stream in the display container on the first display area with the video stream in the display container on the second display area.
[0054] In one embodiment of the present disclosure, the mask layer displays a driver's sign of a driver corresponding to the display image displayed in the masked display area.
[0055] In one embodiment of the present disclosure, the device comprises: The display switch unit further includes a second interchange unit for interchangeably exchanging the driver marks on the mask layer in response to the display switch request.
[0056] In one embodiment of the present disclosure, the second interchange unit specifically interchanges the Leiber marks on the mask layer by scaling the Leiber marks.
[0057] In one embodiment of the present disclosure, the second interchange unit specifically displays the liver signs on the first mask layer and the liver signs on the second mask layer in a reduced size, where the first mask layer is the mask layer displayed in the first display area and the second mask layer is the mask layer displayed in the second display area, and before canceling the display of the mask layers, in response to the switching being completed, interchanges the liver signs on the first mask layer and the liver signs on the second mask layer, and displays the liver signs on the first mask layer and the liver signs on the second mask layer in an enlarged size.
[0058] In one embodiment of the present disclosure, the device comprises: The device further includes a fourth display unit for displaying prompt information on the mask layer before the switching is completed to prompt that an interchange is in progress.
[0059] In one embodiment of the present disclosure, the device comprises: The device further includes a control unit that stops displaying the prompt information in response to the switching being completed.
[0060] Here, for the specific implementation of each unit in this embodiment, please refer to the relevant descriptions in the above method embodiments.
[0061] In the embodiments of the present application, the division of units is only a rough outline and merely represents the division of logical functions. In actual implementation, other division forms may be used. In the embodiments of the present application, each functional unit may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. For example, in the above embodiment, the processing unit and the transmission unit may be the same unit or different units. The above integrated units may be implemented in the form of hardware or in the form of software functional units.
[0062] Referring to Figure 4, there is shown a structural schematic diagram of an electronic device 400 for implementing an embodiment of the present disclosure. In the embodiment of the present disclosure, the terminal device may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablets), PMPs (portable media players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 4 is merely an example and does not limit the functions and scope of use of the embodiment of the present disclosure.
[0063] 4, the electronic device 400 includes a processing unit (e.g., a central processing unit, a graphics processor, etc.) 401, which can perform various appropriate operations and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. The RAM 403 further stores various programs and data necessary for the operation of the electronic device 400. 402 and RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.
[0064] Typically, input devices 406, including, for example, a touch screen, touch panel, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 407, including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 408, including, for example, a magnetic tape, hard disk, etc.; and communication devices 409, are connected to the I / O interface 405. The communication devices 409 enable the electronic device 400 to communicate wirelessly or via wires with other devices to exchange data. While FIG. 4 illustrates the electronic device 400 with various devices, it is not required to implement or include all of the devices shown. Alternatively, more or fewer devices may be implemented or included.
[0065] In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program including program code for performing the methods illustrated in the flowcharts. In such embodiments, the computer program is downloaded and installed from a network via the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, it performs the above-mentioned functions limited to the methods of the embodiments of the present disclosure.
[0066] The electronic device provided by the embodiments of the present disclosure belongs to the same inventive concept as the method provided by the above embodiments, and for technical details not described in detail in this embodiment, please refer to the above embodiments, and this embodiment has the same beneficial effects as the above embodiments.
[0067] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon, which, when executed by a processor, performs the method provided by the above embodiment.
[0068] Here, the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the above. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but are not limited to, an electrical connection having one or more leads, a portable computer magnetic disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical memory, a magnetic memory, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium includes a data signal propagated in baseband or as part of a carrier, the data signal carrying computer-readable program code. Such propagated data signals may take many forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium that transmits, propagates, or transmits a program used by or in conjunction with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.
[0069] In some embodiments, the client and the server may communicate over a network using, for example, HTTP (Hyper They communicate via any network protocol now known or later developed, such as Text Transfer Protocol (TTP), HyperText Transfer Protocol Secure (HTTP), and are interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), international networks (e.g., the Internet), and end-to-end networks (e.g., ad-hoc end-to-end networks), and any networks now known or later developed.
[0070] The computer-readable medium may be included in the electronic device, or may exist separately from the electronic device.
[0071] The computer-readable medium stores one or more programs, which, when executed by the electronic device, cause the electronic device to perform the method.
[0072] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and the like, and conventional procedural programming languages such as "C" or similar programming languages. The program code may execute entirely on the user computer, partially on the user computer, as a separate software package, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. When remote computers are involved, the remote computers may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or connected to an external computer (e.g., via the Internet using an Internet Service Provider).
[0073] The flowcharts and block diagrams in the drawings illustrate the system architecture, functions, and operations that can be implemented by systems, methods, and computer program products according to various embodiments of the present disclosure. Each block in the flowcharts or block diagrams represents a module, program section, or portion of code, which includes one or more executable instructions for implementing the specified logical function. In some implementations, the functions shown in the blocks may be performed in a different order than that shown in the drawings. For example, two connected blocks may actually be executed essentially in parallel, or in some cases, may be executed in the reverse order, depending on the functionality involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware system or a combination of dedicated hardware and computer instructions to perform the specified functions or operations.
[0074] The units described in the embodiments of the present disclosure may be implemented in the form of software or hardware, and in some cases, the names of the units / modules do not limit the units themselves.
[0075] The functions described herein are performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), etc.
[0076] In this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program used by or in conjunction with an instruction execution system, device, or apparatus. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include an electrical connection of one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0077] Here, each embodiment in this specification will be described in a progressive manner, and each embodiment will mainly describe the differences from other embodiments, and similar or similar parts between each embodiment may be referred to each other. Since the systems or devices disclosed in the embodiments correspond to the methods disclosed in the embodiments, the description thereof will be relatively brief, and only the description of the method part may be referred to for relevant parts.
[0078] Here, in this application, "at least one" refers to one or more, and "plurality" refers to two or more. "And / or" describes a related relationship between related objects and indicates a three-way relationship; for example, "A and / or B" indicates that only A is present, only B is present, or both A and B are present, and A and B may be singular or plural. The character " / " generally indicates that the related objects before and after it are in an "or" relationship. "At least one of" or similar expressions refers to any combination of these items, including any combination of single or multiple items. For example, "at least one of a, b, or c" refers to a, b, c, "a and b," "a and c," "b and c," or "a, b, and c," where a, b, and c may be singular or plural.
[0079] Herein, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another and do not necessarily require or imply any actual relationship or order between these entities or operations. Furthermore, the terms "comprise," "include," "comprises," or any other variant thereof are intended to include a non-exclusive inclusion, whereby a process, method, article, or device comprising a set of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent in such process, method, article, or device. Unless further limited, elements defined by the phrase "comprises" do not exclude that the process, method, article, or device comprising the elements also includes other identical elements.
[0080] The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of both, in Random Access Memory (RAM), memory, Read Only Memory (ROM), Electrically Programmable ROM, Electrically Erasable Programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other storage medium known in the art.
[0081] The above description of the disclosed embodiments enables those skilled in the art to make or use the present application. Many modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be embodied in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application is not limited to the embodiments herein but is accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A live streaming video processing method executed by an electronic device, comprising: Displaying a live room interface including a first display area and a second display area, displaying a display image corresponding to a first live streamer in the first display area, and displaying a display image corresponding to a second live streamer in the second display area; displaying a mask layer in the first display area and the second display area in response to a display switching request for the first display area and the second display area, respectively; In response to the completion of the switching, canceling the display of the mask layer in the first display area and the second display area, displaying a display image corresponding to the second driver in the first display area, and displaying a display image corresponding to the first driver in the second display area; A method comprising:
2. The step of displaying a display image corresponding to a first live streamer in the first display area and a display image corresponding to a second live streamer in the second display area includes: displaying a display image corresponding to a first live streamer in a first live streaming group in the first display area, and displaying a display image corresponding to a second live streamer in a second live streaming group in the second display area; 10. The method of claim 1, comprising:
3. The method of claim 1 , wherein responding to a display switching request for the first display area and the second display area includes responding to a display area switching request for the first live streamer and the second live streamer.
4. The method of claim 2 , wherein responding to a display switching request for the first display area and the second display area includes responding to a live broadcast group switching request for the first live streamer and the second live streamer.
5. and before canceling the display of the mask layer in the first display area and the second display area in response to the switching being completed, further exchanging a display image corresponding to the first display area with a display image corresponding to the second display area; 10. The method of claim 1, comprising:
6. The step of exchanging the display image corresponding to the first display area with the display image corresponding to the second display area includes: exchanging the positions of a display container on the first display area and a display container on the second display area, thereby exchanging a display image corresponding to the first display area and a display image corresponding to the second display area; or a step of mutually exchanging a display image corresponding to the first display area with a display image corresponding to the second display area by mutually exchanging a live streaming video stream in a display container on the first display area with a video stream in a display container on the second display area; 6. The method of claim 5, comprising:
7. The method of claim 1 , wherein the mask layer displays a driver's indicator corresponding to a display image displayed in a masked display area.
8. 8. The method of claim 7, further comprising the step of interchanging driver markings on the mask layer in response to the display switch request.
9. The step of exchanging the driver marks on the mask layer with each other includes:
9. The method of claim 8, further comprising the step of interchanging Leiber marks on the mask layer by scaling the Leiber marks.
10. The step of exchanging the Leiber marks on the mask layer by scaling the Leiber marks includes: a step of displaying reduced versions of the liver signs on a first mask layer and the liver signs on a second mask layer, the first mask layer being a mask layer displayed in the first display area, and the second mask layer being a mask layer displayed in the second display area; and exchanging the Leiber markings on the first mask layer with the Leiber markings on the second mask layer in response to the switching being completed before canceling the display of the mask layer. enlarging and displaying the Leiber markings on the first mask layer and the Leiber markings on the second mask layer; 10. The method of claim 9, comprising:
11. 8. The method of claim 7, further comprising the step of displaying prompt information on the mask layer before the switching is completed to prompt that an interchange is in progress.
12. The method of claim 11 , further comprising the step of ceasing display of the prompt information in response to the switching being completed.
13. A live streaming video processing device, comprising: a first display unit that displays a live room interface including a first display area and a second display area, displays a display image corresponding to a first live streamer in the first display area, and displays a display image corresponding to a second live streamer in the second display area; a second display unit that displays a mask layer in the first display area and the second display area in response to a display switching request for the first display area and the second display area, respectively; a third display unit that, in response to the completion of the switching, cancels the display of the mask layer in the first display area and the second display area, and displays a display image corresponding to the second driver in the first display area and a display image corresponding to the first driver in the second display area; An apparatus comprising:
14. An electronic device including a memory and a processor, the memory is used to store instructions or computer programs; An electronic device, wherein the processor is used to execute the instructions or computer programs in the memory to cause the electronic device to perform the method of any one of claims 1 to 12.
15. 1. A computer-readable storage medium, comprising: The computer readable storage medium has stored thereon instructions that, when executed by an apparatus, cause the apparatus to perform the method of any one of claims 1 to 12.
16. A computer program comprising computer programs / instructions which, when executed by a processor, implement the method of any one of claims 1 to 12.
Citation Information
Patent Citations
Interface updating method and device, terminal and storage medium
CN113407141A
Live broadcast interface display method, device, electronic equipment and storage medium
CN113949888A
Challenge Game System
JP2021525560A