Live broadcast background generation method and device, electronic equipment and computer readable medium

Abstract

This disclosure relates to a method, apparatus, electronic device, and computer-readable medium for generating live streaming backgrounds, belonging to the field of live streaming technology. The method includes: on a live streaming server, acquiring live streaming background material and segmenting the material to obtain material fragments corresponding to the background material; sending the material fragments and their corresponding fragment identifiers to a game server, and receiving a user-picked fragment identifier returned by the game server; placing the material fragment corresponding to the user-picked fragment identifier into a live streaming background material library; and generating a live streaming background video stream corresponding to the live streaming client in response to a background editing operation performed by a user in the live streaming client based on the material fragments in the live streaming background material library. This disclosure can enhance the correlation between the live streaming background and the live streaming content and improve interactivity with the live streaming audience.

Description

Technical Field

[0001] This disclosure relates to the field of live streaming technology, and more specifically, to a method for generating a live streaming background, a device for generating a live streaming background, an electronic device, and a computer-readable medium. Background Technology

[0002] With the continuous development of the live streaming industry, green screen live streaming has been widely used. By using green screen technology in live streaming, the live stream can be made unrestricted by scene or location, and it can also bring viewers an immersive experience.

[0003] In green screen live streaming, the background is typically generated either by the streaming provider randomly generating a virtual background, or by the streamer choosing one from existing backgrounds to replace the original green screen background. Generating the background in these ways not only makes it difficult to establish a connection between the background and the live content, but also results in poor interactivity with the audience.

[0004] Therefore, there is an urgent need in this field for a method to generate live streaming backgrounds that can enhance the relevance between the live streaming background and the live streaming content, and improve interactivity with the audience in the live streaming room.

[0005] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0006] The purpose of this disclosure is to provide a method, apparatus, electronic device, and computer-readable medium for generating a live background, thereby enhancing the relevance between the live background and the live content, and improving interactivity with the audience in the live room, at least to a certain extent.

[0007] According to the first aspect of this disclosure, a method for generating a live streaming background is provided, applied to a live streaming server, including:

[0008] Obtain the live stream background material and segment the live stream background material to obtain the material fragments corresponding to the live stream background material;

[0009] Send the material fragments and their corresponding fragment identifiers to the game server, and receive the user-picked fragment identifiers returned by the game server. Then, put the material fragments corresponding to the user-picked fragment identifiers into the live stream background material library.

[0010] In response to a user's background editing operation on the live streaming client based on material fragments in the live streaming background material library, a live streaming background video stream corresponding to the live streaming client is generated.

[0011] According to a second aspect of this disclosure, a method for generating a live streaming background is provided, applied to a game server, comprising:

[0012] Obtain material fragments of the live background material and the fragment identifiers corresponding to the material fragments from the live streaming server;

[0013] Based on the material fragments, corresponding virtual fragment items are generated, and the virtual fragment items are placed in the game scene;

[0014] In response to a user's action of picking up a virtual fragment item in the game scene, the user-picked fragment identifier corresponding to the picked-up virtual fragment item is returned to the live streaming server for use in generating the live streaming background video stream for the live streaming client.

[0015] According to a third aspect of this disclosure, a live streaming background generation apparatus is provided, applied to a live streaming server, comprising:

[0016] The material fragment generation module is used to acquire live background material and segment the live background material to obtain material fragments corresponding to the live background material.

[0017] The fragment acquisition module is used to send the material fragments and the fragment identifiers corresponding to the material fragments to the game server, and receive the user-acquired fragment identifiers returned by the game server, and put the material fragments corresponding to the user-acquired fragment identifiers into the live background material library;

[0018] The live background generation module is used to generate a live background video stream corresponding to the live client in response to the background editing operation performed by the user in the live client based on the material fragments in the live background material library.

[0019] According to a fourth aspect of this disclosure, a live streaming background generation apparatus is provided, applied to a game server, comprising:

[0020] The material fragment acquisition module is used to acquire material fragments of live background material and the fragment identifiers corresponding to the material fragments from the live streaming server;

[0021] The game item generation module is used to generate corresponding virtual fragment items based on the material fragments, and to place the virtual fragment items in the game scene;

[0022] The fragment pickup return module is used to respond to the user's pickup operation of virtual fragment items in the game scene on the game client, and to return the user pickup fragment identifier corresponding to the picked virtual fragment item to the live streaming server, so as to generate the live background video stream of the live streaming client.

[0023] According to a fifth aspect of this disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the live background generation method described in any of the preceding claims by executing the executable instructions.

[0024] According to a sixth aspect of this disclosure, a computer-readable medium is provided having a computer program stored thereon, which, when executed by a processor, implements the live background generation method described in any of the preceding claims.

[0025] The exemplary embodiments disclosed herein can have the following beneficial effects:

[0026] In the live background generation method of this exemplary embodiment, the live background material is segmented on the live server to obtain material fragments corresponding to the live background material. These material fragments, along with their corresponding fragment identifiers, are then sent to the game server. The game server generates corresponding virtual fragment items based on the material fragments and places them in the game scene. The user-picked fragment identifier corresponding to the virtual fragment item picked up by the user is returned to the live server. The live server then adds the material fragment corresponding to the user-picked fragment identifier to the live background material library. In response to the background editing operation performed by the user on the live client based on the material fragments in the live background material library, a live background video stream corresponding to the live client is generated. This live background generation method, on the one hand, enhances the relevance between the live background generation process and the game live content by placing the virtual fragment items corresponding to the live background material fragments in the game scene, allowing the user to pick them up on the game and add them to the live background material library. On the other hand, viewers in the live room can customize and generate personalized live backgrounds based on the material fragments in the live background material library, increasing the interactive experience between the game live stream and the viewers, and improving the interactivity of the live stream.

[0027] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0028] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.

[0029] Figure 1 A schematic diagram of an exemplary system architecture for a live streaming background generation method and apparatus applicable to embodiments of the present disclosure is shown;

[0030] Figure 2 A flowchart illustrating a method for generating a live background applied to a live streaming server according to an exemplary embodiment of this disclosure is shown.

[0031] Figure 3 A schematic diagram of the process for generating a live background video stream according to an exemplary embodiment of this disclosure is shown;

[0032] Figure 4 A schematic diagram of the process for sending a live video stream according to an exemplary embodiment of this disclosure is shown;

[0033] Figure 5 A flowchart illustrating a method for generating a live streaming background for a game server according to an exemplary embodiment of this disclosure is shown.

[0034] Figure 6 A block diagram of a live background generation apparatus applied to a live streaming server according to an exemplary embodiment of the present disclosure is shown.

[0035] Figure 7 A block diagram of a live streaming background generation apparatus applied to a game server according to an exemplary embodiment of the present disclosure is shown;

[0036] Figure 8 A schematic diagram of the structure of a computer system suitable for implementing the embodiments of the present disclosure is shown. Detailed Implementation

[0037] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided to make this disclosure more comprehensive and complete, and to fully convey the concept of the example embodiments to those skilled in the art. The described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a full understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of the specific details omitted, or other methods, components, apparatus, steps, etc., can be employed. In other instances, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0038] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0039] Figure 1 A schematic diagram of the system architecture of an exemplary application environment for a live background generation method and apparatus that can be applied to embodiments of the present disclosure is shown.

[0040] like Figure 1 As shown, system architecture 100 may include multiple mobile terminals 101, 102, and 103, a network 104, and a server 105. Network 104 serves as a medium for providing communication links between mobile terminals 101, 102, and 103 and server 105. Network 104 may include various connection types, such as wireless communication links.

[0041] It should be understood that Figure 1 The number of mobile terminals, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of mobile terminals, networks, and servers can be included. For example, server 105 could be a server cluster consisting of multiple servers.

[0042] Mobile terminals 101, 102, and 103 can be various electronic devices with processors, including but not limited to smartphones, tablets, and laptops. Server 105 can be a server providing various services. For example, mobile terminals 101, 102, and 103 can acquire live background materials through their processors and upload them to server 105. Server 105 can segment the live background materials to obtain material fragments corresponding to the live background materials; send the material fragments and their corresponding fragment identifiers to the game server; receive the user-picked fragment identifiers returned by the game server; and add the material fragments corresponding to the user-picked fragment identifiers to the live background material library; finally, in response to the background editing operations performed by the user in the live client based on the material fragments in the live background material library, it generates the live background video stream corresponding to the live client. Mobile terminals 101, 102, and 103 can also complete the entire process from acquiring live background materials to generating the live background video stream corresponding to the live client through the server.

[0043] This example implementation first provides a method for generating a live streaming background, applied to a live streaming server. (See references.) Figure 2As shown, the above method for generating a live streaming background may include the following steps:

[0044] Step S210. Obtain the live background material and segment it to obtain the material fragments corresponding to the live background material.

[0045] Step S220. Send the material fragments and their corresponding fragment identifiers to the game server, and receive the user-picked fragment identifiers returned by the game server. Place the material fragments corresponding to the user-picked fragment identifiers into the live stream background material library.

[0046] Step S230. In response to the background editing operation performed by the user in the live streaming client based on the material fragments in the live streaming background material library, generate the live streaming background video stream corresponding to the live streaming client.

[0047] In the live background generation method of this exemplary embodiment, the live background material is segmented on the live server to obtain material fragments corresponding to the live background material. These material fragments, along with their corresponding fragment identifiers, are then sent to the game server. The game server generates corresponding virtual fragment items based on the material fragments and places them in the game scene. The user-picked fragment identifier corresponding to the virtual fragment item picked up by the user is returned to the live server. The live server then adds the material fragment corresponding to the user-picked fragment identifier to the live background material library. In response to the background editing operation performed by the user on the live client based on the material fragments in the live background material library, a live background video stream corresponding to the live client is generated. This live background generation method, on the one hand, enhances the relevance between the live background generation process and the game live content by placing the virtual fragment items corresponding to the live background material fragments in the game scene, allowing the user to pick them up on the game and add them to the live background material library. On the other hand, viewers in the live room can customize and generate personalized live backgrounds based on the material fragments in the live background material library, increasing the interactive experience between the game live stream and the viewers, and improving the interactivity of the live stream.

[0048] Below, in conjunction with Figures 3 to 4 The steps described above in this example implementation will be explained in more detail.

[0049] In step S210, the live background material is obtained and segmented to obtain the material fragments corresponding to the live background material.

[0050] In green screen live streaming, a virtual live streaming background is needed to replace the original green screen background in order to achieve richer live streaming effects.

[0051] In this example implementation, the live streaming background materials can mainly include two types: one is a virtual live streaming background, such as a two-dimensional planar background or a three-dimensional stereoscopic scene background; the other is background decorative props, used to serve a decorative purpose within the virtual live streaming background. The methods for obtaining live streaming background materials can mainly include the following:

[0052] The first method involves obtaining pre-stored live streaming background materials, which include virtual live streaming backgrounds and background decoration props.

[0053] Live streaming rooms usually have multiple sets of virtual live streaming backgrounds and various background decorations pre-stored, so you can directly access the pre-stored live streaming background materials.

[0054] The second method is to obtain the material generation information triggered by preset game events from the game server, and obtain the corresponding live broadcast background material based on the material generation information.

[0055] For game livestreaming rooms, information on material generation triggered by preset game events can be obtained from the game server. These preset game events can include special item acquisition events or game victory events. For example, when a user obtains an item in the game, such as a weapon, weapon fragments can be generated simultaneously. The game server sends the fragment information to the livestreaming server. When a certain number of weapon fragments are collected, they can be combined to create a corresponding weapon decoration item. Alternatively, when a user wins a game, a victory screen image can be generated, and corresponding background material images can be generated based on this image.

[0056] The third method can also respond to preset event activities in the live broadcast room and generate live broadcast background materials related to the preset event activities.

[0057] Through live stream activities, such as gift-giving or when the number of likes in the live stream reaches a certain amount, corresponding live stream background materials, such as gift effect images, can also be generated.

[0058] In this example implementation, after obtaining the live background material, the live streaming server can segment the live background material, such as by performing random fragmentation processing similar to a jigsaw puzzle, to obtain the material fragments corresponding to the live background material.

[0059] In step S220, the material fragments and their corresponding fragment identifiers are sent to the game server, and the user-picked fragment identifiers returned by the game server are received. The material fragments corresponding to the user-picked fragment identifiers are then placed into the live stream background material library.

[0060] In this example implementation, after identifying the material fragments, the live streaming server sends the material fragments and their corresponding fragment identifiers to the game server. The fragment identifier can be, for example, A01, representing the first fragment in material A.

[0061] After acquiring the resource fragments and their identifiers, the game server can generate pickable items based on the resource patterns and randomly place them on the streamer's current game scene map. The streamer can pick them up in the game. After picking them up, the game server obtains the corresponding user-picked fragment identifier and sends it to the live streaming server. The live streaming server can display a notification on the front end and add the picked-up resource fragment to the live streaming background resource library.

[0062] In step S230, in response to the background editing operation performed by the user in the live streaming client based on the material fragments in the live streaming background material library, a live streaming background video stream corresponding to the live streaming client is generated.

[0063] In this example implementation, users in the live streaming room can edit and synthesize personalized virtual live streaming backgrounds for their respective live streaming clients based on material fragments in the current live streaming background material library.

[0064] In this example implementation, as Figure 3 As shown, in response to the background editing operation performed by the user in the live streaming client based on material fragments in the live streaming background material library, a live streaming background video stream corresponding to the live streaming client is generated, which may specifically include the following steps:

[0065] Step S310. Provide virtual background editing controls in the live streaming client of each live streaming user.

[0066] The live streaming front-end server can provide virtual background editing controls in the live streaming clients of users in each live streaming room, serving as the entry point for virtual background editing.

[0067] Step S320. In response to a user's click on the virtual background editing control in the live streaming room, open the virtual background editing interface of the live streaming client.

[0068] When a user clicks the virtual background editing control in the live stream, the virtual background editing interface of the live stream client is opened, and the user enters the virtual background editing state. In this state, the virtual background can display a 3D mesh image against a full background, similar to a modeling scene in modeling and rendering simulation software.

[0069] Step S330. In response to the background editing operation performed by the user in the live room on the virtual background editing interface based on the material fragments in the live background material library, generate a background image for the live client, and generate the corresponding live background video stream for the live client based on the background image.

[0070] In this example implementation, users in the live streaming room can drag and drop desired material fragments from the live streaming background material library onto the virtual background editing interface in edit mode. When editing is complete, a background image for the current live streaming client is generated, and a corresponding live streaming background video stream is generated based on the background image. The background editing operation for live streaming users can be divided into the following two cases:

[0071] In the first scenario, the entire virtual live stream background is fragmented. The editing state is the virtual background of the entire live stream room, and the editing interface is a 2D planar background. When the user selects any fragment, the editing interface displays a grayed-out live stream background image, such as the whitened-out state when no fragment is added.

[0072] In the second scenario, the virtual background is fixed, and background decoration props can be added to it. After entering edit mode, the editing interface is a 3D scene, and the background decoration props are 3D props. After selecting a prop, it can be placed in the 3D scene, and operations such as rotating the prop can be performed according to the grid.

[0073] The two methods described above can also be combined. You can edit the entire virtual live stream background or add background decorations. This example implementation does not impose any specific limitations.

[0074] In this example implementation, such as Figure 4 As shown, after generating the live background video stream corresponding to the live streaming client, the following steps can also be included:

[0075] Step S410. Merge the live background video stream corresponding to the live streaming client with the streamer's video stream to obtain the live video stream corresponding to the live streaming client.

[0076] After a user finishes editing in the live stream, the live streaming server generates a background video stream corresponding to the current live streaming client. By merging this background video stream with the streamer's video stream, the live video stream corresponding to the current live streaming client can be obtained.

[0077] Step S420. Mark the material type of the live video stream and send the marked live video stream to the live streaming client.

[0078] In this example implementation, when generating the live video stream corresponding to the current live streaming client, the live streaming server will mark the live video stream with material type, such as marking it as material A, or material A + material B. If there are background decoration props, the server can also mark the position information of the background decoration props, and then send it to the corresponding live streaming client to generate the live streaming screen.

[0079] In this example implementation, if multiple live streaming clients have the same material type label, the same live video stream will be sent to multiple live streaming clients with the same material type label to improve the efficiency of video stream transmission.

[0080] This example implementation also provides a method for generating a live streaming background, applied to a game server. The game server provides a graphical user interface (GUI) through a terminal device, and the GUI includes at least a portion of the game scene. (See reference) Figure 5 As shown, the above method for generating a live streaming background may include the following steps:

[0081] Step S510. Obtain the material fragments of the live background material and the fragment identifiers corresponding to the material fragments from the live streaming server.

[0082] The game server can obtain fragments of live stream background materials and corresponding fragment identifiers from the live stream server.

[0083] Step S520. Generate corresponding virtual fragment items based on the material fragments, and place the virtual fragment items in the game scene.

[0084] After the game server obtains the material fragments and fragment identifiers, it can generate collectible virtual fragment items based on the material style and place the virtual fragment items in the game scene of the streamer's current game.

[0085] Step S530. In response to the user's pickup operation of virtual fragment items in the game scene, the user pickup fragment identifier corresponding to the picked virtual fragment item is returned to the live streaming server to generate the live streaming background video stream of the live streaming client.

[0086] The streamer can pick up virtual fragment items in the game. The game server responds to the streamer's picking operation, obtains the user picking fragment identifier corresponding to the picked virtual fragment item, and returns the user picking fragment identifier to the live streaming server to generate the live background video stream of the live streaming client.

[0087] In addition, the game server can respond to preset game events triggered in the game, generating material generation information related to the preset game events and sending this information to the live streaming server to generate corresponding live streaming background materials. For example, when a user obtains an item in the game, such as a weapon, they can simultaneously obtain weapon item generation fragments, and the game server can send the fragment information to the live streaming server for crafting corresponding weapon decoration items. Alternatively, when a user wins a game, a victory screen image can be generated and sent to the live streaming server.

[0088] It should be noted that although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps.

[0089] Furthermore, this disclosure also provides a live streaming background generation apparatus for use on a live streaming server. (See reference) Figure 6 As shown, the live stream background generation device may include a material fragment generation module 610, a fragment acquisition module 620, and a live stream background generation module 630. Wherein:

[0090] The material fragment generation module 610 can be used to acquire live background material and segment the live background material to obtain material fragments corresponding to the live background material.

[0091] The fragment acquisition module 620 can be used to send material fragments and their corresponding fragment identifiers to the game server, receive the user-picked fragment identifiers returned by the game server, and put the material fragments corresponding to the user-picked fragment identifiers into the live background material library;

[0092] The live background generation module 630 can be used to generate a live background video stream corresponding to the live client in response to the background editing operation performed by the user in the live client based on the material fragments in the live background material library.

[0093] In some exemplary embodiments of this disclosure, the material fragment generation module 610 may include a first live background material acquisition unit, which can be used to acquire pre-stored live background materials in the live room, wherein the live background materials include virtual live backgrounds and background decoration props.

[0094] In some exemplary embodiments of this disclosure, the material fragment generation module 610 may further include a second live background material acquisition unit, which can be used to obtain material generation information triggered by a preset game event from the game server, and obtain the corresponding live background material based on the material generation information.

[0095] In some exemplary embodiments of this disclosure, the material fragment generation module 610 may further include a third live background material acquisition unit, which can be used to generate live background materials related to the preset activity event in response to a preset activity event in the live room.

[0096] In some exemplary embodiments of this disclosure, the live background generation module 630 may include an editing control display unit, an editing interface display unit, and an editing operation execution unit. Wherein:

[0097] The editing control display unit can be used to provide virtual background editing controls in the live streaming clients of users in various live streaming rooms;

[0098] The editing interface display unit can be used to respond to the click operation of the live broadcast room user on the virtual background editing control and open the virtual background editing interface of the live broadcast client;

[0099] The editing operation execution unit can be used to respond to the background editing operation performed by the user in the live room on the virtual background editing interface based on the material fragments in the live background material library, generate the background image of the live client, and generate the corresponding live background video stream of the live client based on the background image.

[0100] In some exemplary embodiments of this disclosure, the live background generation apparatus provided in this disclosure may further include a live video stream generation module, which may include a video stream merging unit and a video stream sending unit. Wherein:

[0101] The video stream merging unit can be used to merge the live background video stream corresponding to the live client with the broadcaster's video stream to obtain the live video stream corresponding to the live client.

[0102] The video stream sending unit can be used to mark the material type of the live video stream and send the marked live video stream to the live streaming client.

[0103] In some exemplary embodiments of this disclosure, the video stream sending unit may include a video stream tag sending unit, which can be used to send the same live video stream to multiple live clients with the same material type tag if multiple live clients have the same material type tag.

[0104] Furthermore, this disclosure also provides a device for generating live streaming backgrounds, applied to a game server. (See reference) Figure 7 As shown, the live stream background generation device may include a material fragment acquisition module 710, a game prop generation module 720, and a fragment pickup and return module 730. Wherein:

[0105] The material fragment acquisition module 710 can be used to obtain material fragments of live background material and the corresponding fragment identifiers from the live streaming server;

[0106] The game item generation module 720 can be used to generate corresponding virtual fragment items based on material fragments and place the virtual fragment items in the game scene;

[0107] The fragment pickup return module 730 can be used to respond to the user's pickup operation of virtual fragment items in the game scene, and return the user pickup fragment identifier corresponding to the picked virtual fragment item to the live streaming server to generate the live background video stream of the live streaming client.

[0108] In some exemplary embodiments of this disclosure, the live background generation apparatus provided by this disclosure may further include a material generation information sending module, which can be used to generate material generation information related to a preset game event triggered in the game, and send the material generation information to the live streaming server to generate live background material corresponding to the material generation information.

[0109] The specific details of each module / unit in the above-mentioned live background generation device have been described in detail in the corresponding method embodiment section, and will not be repeated here.

[0110] Figure 8 A schematic diagram of the structure of a computer system suitable for implementing the embodiments of the present disclosure is shown.

[0111] It should be noted that, Figure 8 The computer system 800 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0112] like Figure 8 As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 802 or programs loaded from storage section 808 into random access memory (RAM) 803. The RAM 803 also stores various programs and data required for system operation. The CPU 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0113] The following components are connected to I / O interface 805: an input section 806 including a keyboard, mouse, etc.; an output section 807 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN card, modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to I / O interface 805 as needed. A removable medium 811, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 810 as needed so that computer programs read from it can be installed into storage section 808 as needed.

[0114] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 809, and / or installed from removable medium 811. When the computer program is executed by central processing unit (CPU) 801, it performs various functions defined in the system of this disclosure.

[0115] It should be noted that the computer-readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0116] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0117] In another aspect, this disclosure also provides a computer-readable medium, which may be included in the electronic device described in the above embodiments; or it may exist independently and not assembled into the electronic device. The computer-readable medium carries one or more programs that, when executed by the electronic device, cause the electronic device to perform the methods described in the above embodiments.

[0118] It should be noted that although several modules for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules described above can be embodied in one module. Conversely, the features and functions of one module described above can be further divided and embodied by multiple modules.

[0119] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein.

[0120] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method for generating a live streaming background, applied to a live streaming server, characterized in that, include: Obtain the live stream background material and segment the live stream background material to obtain the material fragments corresponding to the live stream background material; The material fragments and their corresponding fragment identifiers are sent to the game server, so that the game server can generate corresponding virtual fragment items based on the material fragments and place them in the game scene, and return the user-picked fragment identifier corresponding to the virtual fragment item picked up by the game user to the live streaming server. Receive the user-picked fragment identifier returned by the game server, and put the material fragment corresponding to the user-picked fragment identifier into the live broadcast background material library; In response to a user's background editing operation on the live streaming client based on material fragments in the live streaming background material library, a live streaming background video stream corresponding to the live streaming client is generated.

2. The method of claim 1, wherein, The acquisition of live stream background materials includes: Obtain pre-stored live streaming background materials in the live streaming room, wherein the live streaming background materials include virtual live streaming backgrounds and background decoration props.

3. The method of claim 1, wherein, The acquisition of live stream background materials includes: The game server obtains material generation information triggered by preset game events, and obtains corresponding live streaming background materials based on the material generation information.

4. The method of claim 1, wherein, The acquisition of live stream background materials includes: In response to a preset event in the live stream, generate live stream background materials related to the preset event.

5. The method of claim 1, wherein, The step of generating a live background video stream corresponding to the live streaming client in response to a user's background editing operation on the live streaming client based on material fragments in the live background material library includes: Provide virtual background editing controls in the live streaming client for each user's live streaming room; In response to a user's click on the virtual background editing control in the live stream, the virtual background editing interface of the live stream client is opened; In response to a user in the live streaming room performing a background editing operation on the virtual background editing interface based on material fragments in the live streaming background material library, a background image of the live streaming client is generated, and a live streaming background video stream corresponding to the live streaming client is generated based on the background image.

6. The method of claim 1, wherein, After generating the live background video stream corresponding to the live streaming client, the method further includes: The live background video stream corresponding to the live streaming client is merged with the streamer's video stream to obtain the live video stream corresponding to the live streaming client. The live video stream is tagged with material type, and the tagged live video stream is sent to the live streaming client.

7. The method of claim 6, wherein, Sending the tagged live video stream to the live streaming client includes: If multiple live streaming clients have the same material type tag, then the same live streaming video stream will be sent to the multiple live streaming clients with the same material type tag.

8. A method for generating a live background, applied to a game server, comprising: The method includes providing a graphical user interface (GUI) via a terminal device, wherein the GUI includes at least a portion of the game scene. Obtain material fragments of the live background material and the fragment identifiers corresponding to the material fragments from the live streaming server; Based on the material fragments, corresponding virtual fragment items are generated, and the virtual fragment items are placed in the game scene; In response to a user's action of picking up a virtual fragment item in the game scene, the user-picked fragment identifier corresponding to the picked-up virtual fragment item is returned to the live streaming server for use in generating the live streaming background video stream for the live streaming client.

9. The method for generating a live streaming background according to claim 8, characterized in that, The method further includes: In response to a preset game event triggered in the game, material generation information related to the preset game event is generated, and the material generation information is sent to the live streaming server to generate live streaming background material corresponding to the material generation information.

10. A live streaming background generation device, applied to a live streaming server, characterized in that, include: The material fragment generation module is used to acquire live background material and segment the live background material to obtain material fragments corresponding to the live background material. The fragment acquisition module is used to send the material fragments and their corresponding fragment identifiers to the game server, so that the game server can generate corresponding virtual fragment items based on the material fragments and place them in the game scene, and return the user-picked fragment identifier corresponding to the virtual fragment item picked up by the game user to the live streaming server; receiving the user-picked fragment identifier returned by the game server, and placing the material fragment corresponding to the user-picked fragment identifier into the live streaming background material library; The live background generation module is used to generate a live background video stream corresponding to the live client in response to the background editing operation performed by the user in the live client based on the material fragments in the live background material library.

11. A live background generation apparatus applied to a game server, characterized in that, The device provides a graphical user interface via a terminal device, wherein the graphical user interface includes at least a portion of the game scene, and the device comprises: The material fragment acquisition module is used to acquire material fragments of live background material and the fragment identifiers corresponding to the material fragments from the live streaming server; The game item generation module is used to generate corresponding virtual fragment items based on the material fragments, and to place the virtual fragment items in the game scene; The fragment pickup return module is used to respond to the user's pickup operation of virtual fragment items in the game scene on the game client, and to return the user pickup fragment identifier corresponding to the picked virtual fragment item to the live streaming server, so as to generate the live background video stream of the live streaming client.

12. An electronic device, comprising: include: processor; as well as A memory for storing one or more programs, which, when executed by the processor, cause the processor to implement the method for generating a live background as described in any one of claims 1 to 9.

13. A computer readable medium having stored thereon a computer program, characterized in that When the program is executed by the processor, it implements the method for generating a live background as described in any one of claims 1 to 9.

Images