Live streaming video processing methods, apparatus, devices, and media

The live streaming method and device enable dynamic screen adjustments to prioritize and enlarge specific streamers' images, addressing the limitations of uniform display areas and enhancing viewer engagement in multi-streamer interactions.

JP7843867B2Active Publication Date: 2026-04-10BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
BEIJING ZITIAO NETWORK TECH CO LTD
Filing Date
2023-09-13
Publication Date
2026-04-10

AI Technical Summary

Technical Problem

Existing live streaming technologies fail to accommodate diverse display needs during interactions among multiple streamers, leading to a diminished viewing experience due to uniform video stream areas that hinder focus on specific performers.

Method used

A live streaming method and device that allows for flexible screen adjustments by enlarging the display of a target streamer's image in response to a trigger operation, enabling viewers to focus on specific broadcasters and improving user experience.

Benefits of technology

Enhances viewer engagement by allowing dynamic adjustment of screen layouts to prioritize and enlarge the display of selected streamers, thereby improving the overall viewing experience in multi-streamer interactions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007843867000001
    Figure 0007843867000001
  • Figure 0007843867000002
    Figure 0007843867000002
  • Figure 0007843867000003
    Figure 0007843867000003
Patent Text Reader

Abstract

The present application discloses a live video processing method, apparatus, device, and medium. In an interaction scenario by multiple broadcasters, a first live broadcast screen corresponding to a first broadcaster is displayed, and the first live broadcast screen includes a first display image corresponding to the first broadcaster and a second display image corresponding to a second broadcaster. The second broadcaster is a broadcaster who interacts with the first broadcaster. In response to a trigger operation on a target image in the first live broadcast screen of the first broadcaster, the target display image is enlarged and displayed on the first live broadcast screen, so that it is easier for the viewers of the first live broadcast to watch.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application claims the priority of a Chinese patent application filed with the China National Intellectual Property Administration on September 14, 2022, with an application number of 202211117921.7 and an application title of "Live Streaming Video Processing Method, Apparatus, Device, and Medium", the entire content of which is incorporated herein by reference.

[0002] This application relates to the technical field of computers, and specifically to live streaming video processing methods, apparatuses, devices, and media.

Background Art

[0003] With the continuous development of live streaming technology, the number of users who communicate via live streaming is increasing. During the live streaming process, multiple streamers can participate in live streaming interactions through Live streaming format or PK battles. However, during the process of existing multiple streamers Live streaming performing interactions, Interaction due to the single screen display method, various display needs cannot be met, which affects the viewing experience.

Summary of the Invention

Means for Solving the Problems

[0004] In view of this, embodiments of this application provide a live streaming video method, apparatus, device, and medium.

[0005] To achieve the above object, the technical solutions provided by this application are as follows.

[0006] The first aspect of this application provides a live streaming video processing method, and the method includes: displaying a first Live streaming screen on which a first display image corresponding to a first streamer and second display images corresponding to each of the second streamers are displayed, where the second streamers are InteractionStep, a streamer who does this, The aforementioned first distributor Live streaming In response to a trigger operation on the target display image on the screen, the first Live streaming The method includes the step of displaying the target display image on the screen in an enlarged size, wherein the target display image is the first display image or the second display image.

[0007] A second aspect of the present application provides a live streaming video processing device, which includes: The first display shows a first display image corresponding to the first broadcaster and a second display image corresponding to each of the second broadcasters. Live streaming A first display unit for displaying a screen, wherein the second distributor and the first distributor Interaction The first display unit is the broadcaster who performs the following: The aforementioned first distributor Live streaming In response to a trigger operation on the target display image on the screen, the first Live streaming A second display unit for enlarging and displaying the target display image on a screen, the second display unit comprising the target display image being either the first display image or the second display image.

[0008] A third aspect of the present application provides an electronic device, including a processor and memory. The memory is used to store instructions or computer programs. The processor is used to execute the instructions or computer programs in the memory to cause the electronic device to perform the method described in the first embodiment.

[0009] A fourth aspect of the present invention provides a computer-readable storage medium in which instructions are stored, and when the instructions are executed on a device, the device is made to perform the method described in the first aspect.

[0010] A fifth aspect of the present application provides a computer program product which includes a computer program / instruction, and when the computer program / instruction is executed by a processor, the method described in the first aspect is realized.

[0011] To more clearly illustrate the embodiments of this application or the technical solutions in the prior art, the drawings that may be used to describe the embodiments or the prior art are briefly described below. Clearly, the drawings described below are only a few embodiments of this application, and those skilled in the art can obtain other drawings based on these without requiring any creative work. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 is a schematic diagram of a live streaming display according to an embodiment of the present invention. [Figure 2] Figure 2 is a flowchart of a live streaming video processing method according to an embodiment of the present invention. [Figure 3a] Figure 3a is an enlarged schematic diagram of a display image according to an embodiment of the present application. [Figure 3b] Figure 3b is a fully enlarged schematic diagram relating to an embodiment of the present invention. [Figure 4] Figure 4 is a schematic diagram of an operation panel according to an embodiment of the present invention. [Figure 5] Figure 5 is a schematic diagram of the authority setting according to an embodiment of the present invention. [Figure 6] Figure 6 is a schematic diagram based on an enlargement order relating to an embodiment of the present application. [Figure 7] Figure 7 is a schematic diagram of the structure of a live streaming video processing device according to an embodiment of the present invention. [Figure 8] Figure 8 is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. [Modes for carrying out the invention]

[0013] To help those skilled in the art better understand the solutions of this application, the technical solutions in the embodiments of this application will be clearly and completely described below while referring to the drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative labor shall fall within the protection scope of this application.

[0014] Currently, in the scenario of live streaming by multiple distributors Interaction where Interaction when a certain distributor participating in Interaction performs a performance, since the areas of the video streams corresponding to all the distributors participating in Live streaming are the same, the video stream of the distributor performing the performance cannot be focused, which affects the viewing experience of the viewers. The area of the video stream corresponding to the distributor is

[0015] For example, in the schematic diagram of the interface shown in FIG. 1 Live streaming there are 4 distributors in the Live streaming respectively being Distributor A, Distributor B, Distributor C, and Distributor D. Hereinafter, the vision of Distributor A will be taken as an example for explanation. In the Interaction scenario, the areas of the video streams corresponding to each of the 4 distributors are all equal. When Distributor B performs a performance, on the Live streaming screen corresponding to Distributor A, since the displayed image of Distributor B still occupies a small video stream area, the Live streaming visual focus of the viewers corresponding to Distributor A cannot be focused on the displayed image of Distributor B, which affects the viewing experience.

[0016] Based on this, this application provides a live streaming video processing method. In the scenario of live streaming by multiple distributors Interaction where Interaction for the first distributor participating in Live streaming the screen corresponding to the first distributor, that is, the first Live streamingDisplay the screen. 1 Live streaming The screen displays the first display image corresponding to the first broadcaster, and the first broadcaster and Interaction The second display image corresponding to the second broadcaster who performs the first broadcast is displayed. Live streaming When triggering an operation corresponding to the target display image on the screen, the first Live streaming By enlarging the target display image on the screen, the broadcaster and the broadcaster can Interaction This meets the need for flexible screen adjustments in scenarios where this is done, improving the user experience.

[0017] To facilitate understanding of the technical solutions provided by the embodiments of this application, the following explanation will be given with reference to the drawings. Live streaming Using the perspective of the first user as an example Live streaming This section explains the information displayed on the interface.

[0018] Referring to Figure 2, the figure shows a live streaming video processing method provided by an embodiment of the present application, which may be performed by a live streaming client, which is a live streaming client corresponding to a first streamer and may be installed on an electronic device. The electronic device may include devices with communication functions such as mobile phones, tablet computers, laptop computers, desktop computers, in-vehicle terminals, wearable electronic devices, multifunction printers, and smart home devices, and may also be devices simulated by a virtual machine or simulator. As shown in Figure 2, the method may include the following steps S201 to S202.

[0019] S201, 1st Live streaming Display the screen.

[0020] In this embodiment, the first distributor and the second distributor Live streaming in Interaction When starting, the first display image includes a first display image corresponding to the first broadcaster and a second display image corresponding to the second broadcaster. Live streaming Display the interface. 1 Live streaming The interface allows for voice chat. Live streaming It may be an interface, the first broadcaster may be the voice chat initiator / inviter, or the voice chat invitee, and the second broadcaster may be the voice chat invitee They may be, or they may be invited to a voice chat. Live streaming The screen shows one person's voice chat invitee There may be one or more voice chat invitees.

[0021] S202, the first broadcaster Live streaming In response to a trigger operation on the target display image on the screen, the target display image is enlarged and displayed on the first live streaming screen.

[0022] In this experiment, the first broadcaster was the first Live streaming When triggering a preset operation on the target display image on the screen, the first Live streaming The target display image is enlarged and displayed on the screen. The target display image is either the first display image or the second display image.

[0023] The first broadcaster Interaction of invitee In this case, the target display image may be the first display image or the second display image. The trigger operation is either the first trigger operation or the second trigger operation. The first trigger operation is Interaction Each of the participating streamers Live streaming The system instructs the screen to enlarge the target display image, and the second trigger operation corresponds to the broadcaster who triggered the second trigger operation. Live streaming The system is instructed to enlarge the target display image on the screen. In other words, the first trigger operation is: Interaction All participants Live streaming The second trigger operation is used to enlarge the target display image, i.e., to enlarge the entire image, and the second trigger operation is used to trigger the first trigger operation. Live streaming This is used to trigger the enlargement of the target display image, i.e., to perform a view enlargement.

[0024] Specifically, this time Interaction of invitee as, Interaction Streamers participating ( invitee By enabling the execution of a second trigger operation on a display image corresponding to (including) the first trigger operation on the display image, the display image can be transformed into a first trigger operation. Live streaming The screen can be enlarged and is compatible with the first broadcaster. Live streaming Viewers of the target display image focus This makes it easy to view and improves the user's viewing experience.

[0025] For example, as shown in Figure 3a, broadcaster A Interaction of invitee In this case, broadcasters B, C, and D are invited guests, and when broadcaster A triggers an action on the display image corresponding to broadcaster B, the corresponding image for broadcaster A Live streaming Enlarge the image displayed by streamer B.

[0026] In some embodiments, the first distributor Interaction of invitee If the trigger operation is a first trigger operation, an enlargement command is sent to the service terminal, which in turn sends an enlargement command to the client corresponding to the second distributor, and the client corresponding to the second distributor then enlarges and displays the target display image based on the enlargement command. In other words, the first trigger operation triggers the first Live streaming In addition to being able to control the enlargement of the target display image on the screen, Interaction Responding to other streamers participating Live streaming It is also possible to control the display of the target image to be enlarged, thereby Interaction This applies to all streamers participating. Live streaming Control the screen to uniformly enlarge the target display image.

[0027] For example, as shown in Figure 3b, when broadcaster A triggers a full zoom operation on the displayed image of broadcaster B, the corresponding broadcaster A Live streamingThe system enlarges the image displayed by distributor B and simultaneously sends an enlargement command to the service terminal, which then sends the enlargement command to the clients of distributors B, C, and D, respectively. After receiving the enlargement command, the clients of distributors B, C, and D all enlarge the image displayed by distributor B.

[0028] In some embodiments, the first distributor Interaction If the recipient is an invited person, the target display image is the first display image, and the trigger operation for the target display image is the second trigger operation, that is, the first sender Interaction If you are an invited person, you can enlarge your displayed image. For example, in the application scenario shown in Figure 1, broadcaster A is Interaction of invitee And streamers B, C, and D are respectively Interaction The three invited guests are their own Live streaming It triggers the display image corresponding to the user to be enlarged, but it cannot trigger the display image corresponding to other streamers.

[0029] In some embodiments, the first distributor Interaction of invitee Regardless of whether you are an invited person or not, if the trigger operation is the second trigger operation, then the first Live streaming The target display image is enlarged and displayed only on the screen. Interaction Responding to other streamers participating Live streaming The target display image in the image will not be enlarged. For example, the first broadcaster is broadcaster B in Figure 1, and when broadcaster B performs the second trigger operation on the display image corresponding to himself, the image corresponding to broadcaster B Live streaming The image displayed by streamer B is enlarged, but it corresponds to streamer A, streamer C, and streamer D respectively. Live streaming Furthermore, the image displayed by streamer B is still shown as in Figure 1 without being enlarged.

[0030] Specifically, the first broadcaster Interaction of invitee In that case, the first broadcaster Live streaming In response to a trigger operation on the target display image on the screen, an operation panel including a first control and a second control is displayed, and in response to a trigger operation on the first control or the second control by the first distributor, Live streaming The target display image is enlarged on the screen. The first trigger operation is a trigger operation for the first control, and the second trigger operation is a trigger operation for the second control. In this embodiment, the first distributor can enlarge the target display image by triggering one control according to their needs. For example, in the schematic diagram shown in Figure 4, when distributor A triggers a click operation on the display image of distributor B, an operation panel 400 for distributor B can be displayed, and the operation panel 400 may include a view enlargement control 401 (second control) and a full enlargement control 402 (first control), and icons corresponding to each control may be displayed at the same time. In addition, the operation panel may include, for example, a focus control ( Interaction Other controls may be displayed, such as a feature used to focus on a particular streamer participating in the event, and a mute control (used to control whether a streamer is muted).

[0031] In other words, Interaction of invitee If you click the full zoom control for any broadcaster, Interaction All participants Live streaming In each case, the enlarged layout screen corresponding to the aforementioned arbitrary distributor is displayed, that is, Interaction All participants Live streaming All viewers can view the enlarged layout screen corresponding to any of the aforementioned broadcasters. Interaction of invitee or Interaction If the invited person clicks the view zoom control, the broadcaster who clicked the view zoom control Live streaming Only the enlarged layout screen is displayed, that is, your Live streaming It is effective only against, and otherwise Live streamingAvoid affecting the screen.

[0032] The first broadcaster Interaction If you are an invited person, the first broadcaster Live streaming In response to a trigger on the target display image on the screen, an operation panel including a second control is displayed, and in response to a trigger operation on the second control by the first distributor, Live streaming The target display image is enlarged and displayed on the screen. In other words, the first broadcaster Interaction If you are an invited guest, you can enlarge only your own displayed image, and other Live streaming Avoid affecting the screen.

[0033] To avoid distracting the viewer's attention by simultaneously enlarging two display images, the first broadcaster will enlarge the other display image (the first one). Live streaming When triggering a first trigger operation or a second trigger operation on a display image (excluding the target display image) on the screen, the first Live streaming The system enlarges other displayed images on the screen and cancels the enlargement of the target image. In other words, only one video stream can be enlarged at a time.

[0034] In some embodiments, Interaction of invitee by Interaction To make scenario management easier, invitees Interaction The permission to remove invitee It can also be granted to the first distributor, specifically, the first distributor Interaction of invitee If so, in response to the first broadcaster's third trigger operation on the second display image, Live streaming Cancel the display of the second image on the screen. In other words, the first broadcaster initiated it themselves. Interaction Because they have control over it, they can control some participants as needed. Interaction It is easy to delete it in a timely manner. For example, the control panel shown in Figure 4 has Interaction A deletion control 403 may further be included, and the distributor A InteractionIn response to a trigger operation for delete control 403, distributor B Interaction Remove from.

[0035] In some embodiments, Interaction To maintain stability, Interaction of invitee The invited streamers Interaction Permissions can also be controlled, specifically by the first broadcaster Interaction of invitee If so, the first broadcaster Live streaming In response to configuration operations triggered on the screen, the server sends the configuration results to the server, which then uses those results to inform the second distributor Interaction Access control. Interaction The powers include, Live streaming interaction Invitation sending permission and / or Live streaming interaction The right to receive applications may be included. Interaction Having authority Live streaming It was started by the first streamer. Live streaming That is the case.

[0036] Specifically, the first broadcaster will communicate with the participants. Live streaming interaction If you grant the permission to send invitations, participants will be able to: Interaction To other streamers who are not participating Interaction By sending invitations, more streamers will be able to Interaction You can invite others to participate. Alternatively, the first broadcaster can invite participants to participate. Live streaming interaction If the application receiving authority is released, participants will be able to: Interaction Sent by other streamers who are not participating. Interaction The request can be received, and furthermore, the participant's client Interaction By forwarding the request to the first sender's client, the first sender... Interaction Confirm whether or not to allow participation.

[0037] Specifically, the first broadcaster is the first Live streaming In response to a setting operation triggered on the screen, a settings panel including a third control and a fourth control is displayed. The third control is Live streaming interactionIt is used to set the permission to send invitations, and the fourth control is Live streaming interaction It is used to set invitation acceptance permissions. In response to triggers on the third and / or fourth controls of the first sender, it sends the configuration result to the server.

[0038] As shown in Figure 5 Interaction Referring to the schematic diagram of permission settings, broadcaster A Live streaming When the permission setting operation is triggered, the settings panel 500 is displayed, and the settings panel 500 contains information on the participants Interaction The option to allow invitations to be initiated by other streamers Interaction This includes an option to allow the application to be initiated, and Distributor A can set any option.

[0039] The first broadcaster Interaction They are invited guests, and Live streaming interaction If you have permission to send invitations, the first broadcaster will respond to the sending operation triggered on the first live stream screen by sending an invitation to the third broadcaster's client. Interaction Send the invitation. The first broadcaster Interaction They are invited guests, and Live streaming interaction If you have permission to receive invitations, the fourth sender's client will send it. Interaction Receive the request.

[0040] In some embodiments, the first distributor Interaction If you are an invited person, the target display image is the first display image. Interaction of invitee When the corresponding client sends an enlargement command for the second display image, the first Live streaming The second image is displayed enlarged on the screen. That is, Interaction of invitee When a corresponding client sends an enlargement command for the second display image, it sends the enlargement command to the service terminal, which then sends the enlargement command to the first distributor's client, causing the first distributor's client to enlarge and display the second display image based on the enlargement command.

[0041] If the first distributor's client enlarges the second display image based on an enlargement command, the enlargement of the first display image is canceled. invitee The expansion priority triggered by this is higher than the expansion priority triggered by the invited person.

[0042] For example, as shown in Figure 6, when broadcaster B (the invited person) enlarges their own displayed image, the broadcaster A (transmitted by the service terminal) invitee When the client of broadcaster C sends a command to enlarge the image displayed by broadcaster C, broadcaster B's client cancels the enlargement of its own displayed image and performs the enlargement process on broadcaster C's displayed image.

[0043] As can be seen from the above, by multiple streamers Interaction In the scenario, the first broadcaster corresponds to the first Live streaming Display the screen and the first Live streaming The screen includes a first display image corresponding to the first broadcaster and a second display image corresponding to the second broadcaster. The second broadcaster and the first broadcaster Interaction This is a broadcaster who performs the following: In response to a trigger operation on the target image on the first live broadcast screen of the first broadcaster, the first Live streaming By enlarging the target display image on the screen, the first Live streaming This makes it easier for viewers to watch. In other words, the technical solution provided by this application makes it easier for broadcasters and broadcasters to watch. Interaction In scenarios where this is done, Interaction Any streamer who participates, Live streaming The displayed image is enlarged, the displayed image is focused on and displayed, and the broadcaster and the broadcaster Interaction This can meet the need for flexible screen adjustments in scenarios where this is done, and improve the user experience.

[0044] Based on the above-described embodiment of the method, the present invention provides a live streaming video processing device and equipment, which will be described below with reference to the drawings.

[0045] Referring to Figure 7, which is a schematic diagram of the structure of a live streaming video processing device according to an embodiment of the present application, the device includes a first display unit 701 and a second display unit 702.

[0046] The first display unit 701 displays a first display image corresponding to the first broadcaster and a second display image corresponding to each of the second broadcasters. Live streaming Used to display the screen, the second distributor and the first distributor Interaction He is a streamer who does this, The second display unit 702 is the first of the first distributor Live streaming In response to a trigger operation on the target display image on the screen, the first Live streaming It is used to enlarge and display the target display image on the screen, and the target display image is either the first display image or the second display image.

[0047] In one embodiment of the present disclosure, the first distributor Interaction of invitee In this case, the target display image is the first display image or the second display image, the trigger operation is the first trigger operation or the second trigger operation, and the first trigger operation is Interaction Each of the participating streamers Live streaming The system instructs the screen to enlarge the target display image, and the second trigger operation corresponds to the broadcaster who triggered the second trigger operation. Live streaming The system instructs the screen to enlarge the target display image, The aforementioned first distributor Interaction If the person is an invited person, the target display image is the first display image, and the trigger operation is the second trigger operation.

[0048] In one embodiment of the present disclosure, the apparatus further includes a transmitting unit, The transmission unit is used to send an enlargement command to a service terminal when the trigger operation is the first trigger operation, so that the service terminal sends the enlargement command to a client corresponding to the second distributor, and the client corresponding to the second distributor then enlarges and displays the target display image based on the enlargement command.

[0049] In one embodiment of the present disclosure, the second display unit 702 specifically indicates that the first distributor Interaction of invitee If so, the aforementioned first distributor Live streaming Displaying an operation panel including a first control and a second control in response to a trigger on a target display image on the screen, wherein the first trigger operation is a trigger operation on the first control and the second trigger operation is a trigger operation on the second control, and in response to a trigger operation on the first control or the second control by the first distributor, the first Live streaming The target display image is enlarged and displayed on the screen, or the first distributor Interaction If you are an invited person, the first distributor Live streaming In response to a trigger on a target display image on the screen, an operation panel including the second control is displayed, and in response to a trigger operation on the second control by the first distributor, the first Live streaming It is used to enlarge and display the target display image on the screen.

[0050] In one embodiment of the present disclosure, the first distributor Interaction of invitee If so, the device further includes a transmitting unit, The transmission unit is used when the first distributor is the first Live streaming In response to a setting operation triggered on the screen, the server sends the setting result to the server, which then uses the setting result to determine the second distributor Interaction Used to control authority, as described above Interaction The powers include, Live streaming interaction Invitation sending permission and / or Live streaming interaction The application receiving authority is included, as stated above. Live streaming It was started by the aforementioned first broadcaster. Live streaming That is the case.

[0051] In one embodiment of the present disclosure, the first distributor Interaction of invitee In that case, the apparatus further includes a processing unit, The processing unit responds to the first distributor's third trigger operation on the second display image, Live streaming This is used to cancel the display of the second display image on the screen.

[0052] In one embodiment of the present disclosure, the first distributor Interaction If the person is an invited person, the target display image is the first display image, and the device further includes a third display unit. The third display unit is, Interaction of invitee When the corresponding client sends an enlargement command for the second display image, the first Live streaming It is used to enlarge and display the second display image on the screen.

[0053] In one embodiment of the present disclosure, the apparatus further includes a processing unit, The processing unit is the first Live streaming This is used to cancel the enlarged display of the first displayed image on the screen.

[0054] As needs to be explained, the specific implementation of each unit in this embodiment can be found by referring to the relevant descriptions in the above-mentioned method embodiment. In the embodiment of this application, the division of units is illustrative and merely a logical functional division; other division methods may exist in actual implementation. Each functional unit in the embodiment of this application may be integrated into a single processing unit, each unit may exist individually physically, or two or more units may be integrated into a single unit. For example, in the above embodiment, the processing unit and the transmission unit may be the same unit or different units. The integrated unit may be implemented in hardware form or in the form of a software functional unit.

[0055] Referring to Figure 8, a schematic diagram of the structure of an electronic device 800 configured to realize an embodiment of the present disclosure is shown. The terminal devices in the embodiment of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 8 is merely an example and does not in any way limit the functions and scope of use of the embodiment of the present disclosure.

[0056] As shown in Figure 8, the electronic device 800 may include a processing unit (e.g., a central processor, graphics processor, etc.) 801 capable of performing various appropriate operations and processes based on a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. The RAM 803 further stores various programs and data necessary for the operation of the electronic device 800. The processing unit 801, ROM 802, and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0057] Typically, devices such as input devices 806 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 807 including, for example, liquid crystal displays (LCDs), speakers, and oscillators; storage devices 808 including, for example, magnetic tape and hard disks; and communication devices 809 may be connected to the I / O interface 805. The communication device 809 can enable the electronic device 800 to exchange data with other devices via wireless or wired communication. Figure 8 shows the electronic device 800 with various devices, but it should be understood that it is not required to implement or include all of the devices shown. More or fewer devices may be implemented or included as alternatives.

[0058] In particular, according to embodiments of the present disclosure, the process described with reference to the flowchart may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program carried on a non-temporary computer-readable medium, the computer program which includes program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by a processing unit 801, it performs the functions limited to the methods of embodiments of the present disclosure.

[0059] The electronic devices provided in the embodiments of this disclosure belong to the same inventive concept as the methods provided in the above embodiments, and for technical details not described in detail in these embodiments, refer to the above embodiments, and these embodiments have the same beneficial effects as the above embodiments.

[0060] Embodiments of this disclosure provide a computer storage medium on which a computer program is stored, and when the program is executed by a processor, the embodiment of the embodiment realizes the method provided by the embodiment.

[0061] As needs to be explained, the computer-readable medium in this disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage mediums may include, but are not limited to, an electrical connection having one or more wires, a portable computer magnetic disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact magnetic disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, the computer-readable signal medium may contain data signals propagated in the baseband or as part of a carrier wave, which carry computer-readable program code. The data signals propagated in this manner may take multiple forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, and the computer-readable signal medium may transmit, propagate, or transmit programs for use by or in combination with instruction execution systems, apparatus, or devices. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including but not limited to wires, cables, and RF (radio frequency), or any suitable combination thereof.

[0062] In some embodiments, the client and server may communicate using any currently known or future-developed network protocol, such as HTTP (Hypertext Transfer Protocol), and may interconnect with digital data communications (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the World Wide Web (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), and any currently known or future-developed networks.

[0063] The computer-readable medium described above may be included in the electronic device described above, or it may exist separately without being incorporated into the electronic device.

[0064] If one or more programs are carried on the computer-readable medium described above, and the one or more programs are executed by the electronic device, the electronic device can be made to perform the above method.

[0065] Computer program code for performing the operations disclosed herein may be written in one or more programming languages ​​or a combination thereof, and such programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, and further include ordinary procedural programming languages ​​such as the "C" language or similar programming languages. The program code may be executed entirely on a user computer, partially on a user computer, as a single standalone software package, partially on a user computer and partially on a remote computer, or entirely on a remote computer or server. If a remote computer is involved, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or it may be connected to an external computer (for example, connected via the Internet using an Internet service provider).

[0066] The flowcharts and block diagrams in the drawings illustrate the implementable system architectures, functions, and operations of systems, methods, and computer program products relating to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, program segment, or portion of code, which includes one or more executable instructions for implementing a given logic function. It should be noted that in some alternative implementations, the functions marked within a block may be generated in an order different from the order in which they are marked in the drawings. For example, two blocks shown consecutively may actually be executed almost in parallel, or in some cases in the opposite order, depending on the functions involved. It should be noted that each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, may be implemented using a dedicated system based on hardware that performs a given function or operation, or using a combination of dedicated hardware and computer instructions.

[0067] The units described and referred to in the embodiments of this disclosure may be implemented in software form or in hardware form. In some cases, the name of a unit / module is not limiting to the unit itself.

[0068] In this specification, the functions described above may be performed by at least partially one or more hardware logic components. For example, exemplary hardware logic components that are not restrictive but may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standards (ASSPs), on-chip systems (SOCs), and complex-programmable logic devices (CPLDs).

[0069] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or stores a program used by or in combination with an instruction execution system, device, or apparatus. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the above. More specific examples of machine-readable storage media include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0070] As should be noted, each embodiment in this specification is described step by step, and each embodiment focuses on the differences from other embodiments, with the same or similar parts between embodiments being referenced to one another. The descriptions of the systems or apparatus disclosed in the embodiments are relatively simple, corresponding to the methods disclosed in the embodiments, and relevant parts may be referenced to portions of the method description.

[0071] To ensure clarity, in this application, “at least one (item)” means one or more, and “multiple” means two or more. “And / or” is used to describe the relationship between related objects, and it is shown that three types of relationships are possible. For example, “A and / or B” can indicate three situations: A exists alone, B exists alone, and A and B exist simultaneously, and A and B may be singular or plural. The letter “ / ” generally indicates that the preceding and following related objects are in an “or” relationship. “At least one of the following items” or similar expressions means any combination of these items, including a single item or any combination of multiple items. For example, at least one of a, b, or c may be a, b, c, “a and b,” “a and c,” “b and c,” or “a and b and c,” and a, b, c may be singular or plural.

[0072] As further explanation is needed, relational terms such as "First" and "Second," etc., in this specification are merely for distinguishing one entity or operation from another, and do not necessarily require or imply that any such actual relationship or order exists between these entities or operations. Also, the terms "includes," "incorporates," or any other variation thereof are intended to cover non-exclusive inclusion, thereby including not only those elements but also other elements not explicitly listed, or elements specific to such a process, method, article, or apparatus. Unless further restrictions are found, the elements limited by "...includes" do not preclude the existence of other identical elements in the process, method, article, or apparatus that includes such elements.

[0073] Steps of the methods or algorithms described in combination with the embodiments disclosed herein may be carried out directly by hardware, a software module executed by a processor, or a combination of both. The software module may be located in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or any other form of storage medium known in the art.

[0074] Based on the above description of the disclosed embodiments, those skilled in the art can implement or use the present application. Several modifications to these embodiments are obvious to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Accordingly, the present application is not limited to these embodiments shown herein, but should be given the broadest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for processing live streaming video, A step of displaying a first live streaming screen in which a first display image corresponding to a first streamer and a second display image corresponding to a second streamer are displayed, wherein the second streamer is a streamer who interacts with the first streamer, The process includes the step of displaying an enlarged version of a target display image on the first live streaming screen in response to a trigger operation on the target display image on the first live streaming screen of the first broadcaster, wherein the target display image is either a first display image or a second display image. The first broadcaster is the inviter of the interaction, the target display image is the first display image or the second display image, the trigger operation is the first trigger operation or the second trigger operation, the first trigger operation instructs the live streaming screen corresponding to each of the broadcasters participating in the interaction to enlarge the target display image, and the second trigger operation instructs the live streaming screen corresponding to the broadcaster who triggered the second trigger operation to enlarge the target display image, or, A method wherein the first distributor is the invitee to the interaction, the target display image is the first display image, and the trigger operation is the second trigger operation.

2. The aforementioned method, The method according to claim 1, further comprising the steps of: if the trigger operation is the first trigger operation, sending an enlargement command to a service terminal, the service terminal sending the enlargement command to a client corresponding to the second distributor, and the client corresponding to the second distributor enlarging and displaying the target display image based on the enlargement command.

3. The step of enlarging and displaying the target display image on the first live streaming screen in response to a trigger operation on the target display image on the first live streaming screen of the first broadcaster is: The first broadcaster is the inviter of the interaction, and in response to a trigger on the target display image on the first live broadcast screen of the first broadcaster, the steps include displaying an operation panel including a first control and a second control, wherein the first trigger operation is a trigger operation on the first control and the second trigger operation is a trigger operation on the second control; and in response to a trigger operation on the first control or the second control of the first broadcaster, the steps include displaying the target display image enlarged on the first live broadcast screen, or The method according to claim 1, comprising the steps of: the first broadcaster being an invited participant in the interaction; displaying an operation panel including the second control in response to a trigger on the first broadcaster's first live streaming screen; and enlarging and displaying the target image on the first live streaming screen in response to a trigger operation on the second control by the first broadcaster.

4. The first distributor is the inviter of the interaction, and the method is The method according to claim 1, further comprising the step of sending a configuration result to a server in response to a configuration operation triggered by the first broadcaster on the first live streaming screen, the server controlling the interaction rights of the second broadcaster based on the configuration result, wherein the interaction rights include the right to send live streaming interaction invitations and / or the right to receive live streaming interaction requests, and the live streaming is a live streaming initiated by the first broadcaster.

5. The first distributor is the inviter of the interaction, and the method is The method according to claim 1, further comprising the step of canceling the display of the second display image on the first live streaming screen in response to a third trigger operation on the second display image by the first broadcaster.

6. The first distributor is the invitee to the interaction, the target display image is the first display image, and the method is The method according to claim 1, further comprising the step of enlarging and displaying the second display image on the first live streaming screen when a client corresponding to an interaction inviter sends an enlargement command to the second display image.

7. The aforementioned method, The method according to claim 6, further comprising the step of canceling the enlarged display of the first display image on the first live streaming screen.

8. An electronic device, including a processor and memory, The memory is used to store instructions or computer programs. The processor executes the instructions or computer programs in the memory to the electronic device. The first live streaming screen is displayed, which shows a first display image corresponding to the first streamer and a second display image corresponding to the second streamer, wherein the second streamer is a streamer who interacts with the first streamer. This is used to perform the following actions in response to a trigger operation on the target display image on the first live streaming screen of the first broadcaster: to enlarge and display the target display image on the first live streaming screen, wherein the target display image is either the first display image or the second display image. The first broadcaster is the inviter of the interaction, the target display image is the first display image or the second display image, the trigger operation is the first trigger operation or the second trigger operation, the first trigger operation instructs the live streaming screen corresponding to each of the broadcasters participating in the interaction to enlarge the target display image, and the second trigger operation instructs the live streaming screen corresponding to the broadcaster who triggered the second trigger operation to enlarge the target display image, or, An electronic device in which the first broadcaster is the invitee to the interaction, the target display image is the first display image, and the trigger operation is the second trigger operation.

9. A computer-readable storage medium, wherein instructions are stored in the computer-readable storage medium, and when the instructions are executed on a device, the device The first live streaming screen is displayed, which shows a first display image corresponding to the first streamer and a second display image corresponding to the second streamer, wherein the second streamer is a streamer who interacts with the first streamer. In response to a trigger operation on the target display image on the first live streaming screen of the first broadcaster, the target display image is enlarged and displayed on the first live streaming screen, wherein the target display image is either the first display image or the second display image. The first broadcaster is the inviter of the interaction, the target display image is the first display image or the second display image, the trigger operation is the first trigger operation or the second trigger operation, the first trigger operation instructs the live streaming screen corresponding to each of the broadcasters participating in the interaction to enlarge the target display image, and the second trigger operation instructs the live streaming screen corresponding to the broadcaster who triggered the second trigger operation to enlarge the target display image, or, A computer-readable storage medium in which the first distributor is the invitee to the interaction, the target display image is the first display image, and the trigger operation is the second trigger operation.

Citation Information

Patent Citations

  • Method of via-microphone live broadcast in live Internet broadcast, and anchor-side device

    CN106331754A

  • Video superposition information updating method and device thereof, electronic equipment and storage medium

    CN112929684A

  • Communication system

    JP2006173879A

  • Web conference system, information processing device, control method, and program

    JP2013141201A

  • Multi-participant live communication user interface

    JP2019197520A