Multi-person video live broadcast method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a multi-user video live broadcast method and device, electronic equipment and a storage medium. The method comprises the following steps: creating a three-dimensional live broadcast room; a first target image is created in the three-dimensional live broadcast room based on a first video live broadcast stream sent by a first terminal device, the first terminal device corresponds to an anchor user, and the first target image represents a live broadcast room picture of a two-dimensional live broadcast room corresponding to the first video live broadcast stream; and a second video live stream corresponding to the three-dimensional live broadcast room is sent to target terminal equipment, the target terminal equipment comprises the first terminal equipment and / or second terminal equipment, and the second terminal equipment corresponds to audience users. Therefore, the display effect of the three-dimensional live broadcasting room is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of Internet technology, and in particular to a method, device, electronic device, and storage medium for multi-person video live broadcast. Background Art

[0002] Currently, in the application scenarios of live video broadcasting, multi-person live broadcasting refers to multiple anchor users jointly broadcasting through video links, so that audience users can watch the interaction between multiple anchors and improve the live video broadcasting effect.

[0003] However, the existing technology for implementing multi-person live broadcasting usually uses split-screen display for each anchor user, which causes a strong sense of spatial fragmentation and poor visual effects, affecting the overall live broadcast effect in the multi-person live broadcast scenario. Summary of the invention

[0004] The embodiments of the present disclosure provide a method, device, electronic device and storage medium for multi-person video live broadcasting, so as to overcome the problem of strong spatial separation between the screens of anchor users and poor visual effects during multi-person live broadcasting.

[0005] In a first aspect, an embodiment of the present disclosure provides a multi-person video live broadcast method, which is applied to a host terminal device, comprising:

[0006] Create a three-dimensional live broadcast room; create a first target image in the three-dimensional live broadcast room based on a first video live stream sent by a first terminal device, wherein the first terminal device corresponds to an anchor user, and the first target image represents a live broadcast room screen of a two-dimensional live broadcast room corresponding to the first video live stream; send a second video live stream corresponding to the three-dimensional live broadcast room to a target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to an audience user.

[0007] In a second aspect, an embodiment of the present disclosure provides a multi-person video live broadcast method, applied to a first terminal device, including:

[0008] Enter the 3D live broadcast room;

[0009] Sending a first video live stream to a host terminal device that creates the three-dimensional live studio to create a first target image in the three-dimensional live studio, wherein the first terminal device corresponds to a host user, and the first target image represents a live studio screen of a two-dimensional live studio corresponding to the first video live stream;

[0010] Receive a second video live stream corresponding to the three-dimensional live broadcast room, and play the second video live stream.

[0011] In a third aspect, the present disclosure provides a multi-person video live broadcast device, including:

[0012] Creation module, used to create a three-dimensional live broadcast room;

[0013] A generating module, configured to create a first target image in the three-dimensional live broadcast room based on a first video live broadcast stream sent by a first terminal device, wherein the first terminal device corresponds to a host user, and the first target image represents a live broadcast room screen of the two-dimensional live broadcast room corresponding to the first video live broadcast stream;

[0014] The transceiver module is used to send the second video live stream corresponding to the three-dimensional live room to the target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to the audience user.

[0015] In a fourth aspect, an embodiment of the present disclosure provides a multi-person video live broadcast device, including:

[0016] A processing module for entering a three-dimensional live broadcast room;

[0017] A sending module, used for sending a first video live stream to a host terminal device that creates the three-dimensional live studio, so as to create a first target image in the three-dimensional live studio, wherein the first terminal device corresponds to an anchor user, and the first target image represents a live studio screen of the two-dimensional live studio corresponding to the first video live stream;

[0018] The receiving module is used to receive the second video live stream corresponding to the three-dimensional live broadcast room and play the second video live stream.

[0019] In a fifth aspect, an embodiment of the present disclosure provides an electronic device, including:

[0020] A processor, and a memory communicatively connected to the processor;

[0021] The memory stores computer-executable instructions;

[0022] The processor executes the computer-executable instructions stored in the memory to implement the multi-person video live broadcast method as described in the first aspect and various possible designs of the first aspect, or to implement the multi-person video live broadcast method as described in the second aspect and various possible designs of the second aspect.

[0023] In a sixth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the multi-person video live broadcast method as described in the first aspect and various possible designs of the first aspect is implemented, or the multi-person video live broadcast method as described in the second aspect and various possible designs of the second aspect is implemented.

[0024] In a sixth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the multi-person video live broadcast method as described in the first aspect and various possible designs of the first aspect, or implements the multi-person video live broadcast method as described in the second aspect and various possible designs of the second aspect.

[0025] The multi-person video live broadcast method, device, electronic device and storage medium provided in this embodiment create a three-dimensional live broadcast room; based on the first video live broadcast stream sent by the first terminal device, create a first target image in the three-dimensional live broadcast room, wherein the first terminal device corresponds to the anchor user, and the first target image represents the live broadcast room screen of the two-dimensional live broadcast room corresponding to the first video live broadcast stream; send the second video live broadcast stream corresponding to the three-dimensional live broadcast room to the target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to the audience user. By creating a three-dimensional live broadcast room, the anchor image screen is projected into the three-dimensional live broadcast room for display, so that the anchor images of different users are integrated with the environment, reducing the sense of spatial fragmentation, improving the visual effect difference, and improving the overall live broadcast effect in the multi-person live broadcast scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0027] Figure 1 A diagram of an application scenario of the multi-person video live broadcast method provided in an embodiment of the present disclosure;

[0028] Figure 2 Schematic diagram of the process of the multi-person video live broadcast method provided in the embodiment of the present disclosure Figure 1 ;

[0029] Figure 3 A schematic diagram of creating a first target image in a three-dimensional live broadcast room provided by an embodiment of the present disclosure;

[0030] Figure 4 for Figure 2 A flowchart of a specific implementation method of step S102 in the illustrated embodiment;

[0031] Figure 5 for Figure 2 A flowchart of a specific implementation method of step S104 in the illustrated embodiment;

[0032] Figure 6 for Figure 2 A flowchart of a specific implementation method of step S105 in the illustrated embodiment;

[0033] Figure 7 A schematic diagram of a target virtual object moving in a three-dimensional live broadcast room provided by an embodiment of the present disclosure;

[0034] Figure 8 Schematic diagram of the process of the multi-person video live broadcast method provided in the embodiment of the present disclosure Figure 2 ;

[0035] Fig. 9 for Figure 8 A flowchart of a specific implementation method of step S208 in the illustrated embodiment;

[0036] Fig.10 A schematic diagram of determining a target display direction provided by an embodiment of the present disclosure;

[0037] Fig.11 Schematic diagram of the process of the multi-person video live broadcast method provided in the embodiment of the present disclosure Figure 3 ;

[0038] Fig.12 A structural block diagram of a multi-person video live broadcast device provided in an embodiment of the present disclosure;

[0039] Fig.13 A structural block diagram of another multi-person video live broadcast device provided in an embodiment of the present disclosure;

[0040] Fig.14 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure;

[0041] Fig.15 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0043] It should be noted that the request information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0044] The application scenarios of the embodiments of the present disclosure are explained below:

[0045] The multi-person video live broadcast method provided by the embodiments of the present disclosure can be applied to application scenarios of multi-person online live broadcast. Figure 1 An application scenario diagram of the multi-person video live broadcast method provided in the embodiment of the present disclosure. Specifically, the method provided in the embodiment of the present disclosure can be applied to the terminal device used by the anchor user. For example, taking the terminal device A used by the anchor user User_1 as an example, after the terminal device A runs the live broadcast application client (Application, APP), it responds to the user's instructions and creates a video live broadcast room for video live broadcast. After that, the live broadcast user User_1 can make a video connection with the terminal device B used by the anchor user User_2 through the terminal device A, which is also called "connection PK". After the video connection is established, the video screen of the anchor user User_1 and the video screen of the anchor user User_2 are displayed simultaneously in the live broadcast application client on the side of the terminal device A (based on needs, it can also be displayed on the terminal device B at the same time), thereby realizing multi-person interactive live broadcast between multiple anchor users. At the same time, the video live broadcast stream of the above-mentioned live broadcast room is distributed to the terminal device C used by the audience user through the server, so that the audience user can watch the live broadcast content of the multi-person live broadcast in the above-mentioned live broadcast room.

[0046] In the prior art, such as Figure 1 As shown in , the way to achieve multi-person live broadcast is usually to display each anchor user in a split screen, which causes a strong sense of spatial fragmentation and poor visual effects, affecting the overall live broadcast effect in a multi-person live broadcast scenario. The disclosed embodiment provides a multi-person video live broadcast method to solve the above problems.

[0047] refer to Figure 2 , Figure 2 Schematic diagram of the process of the multi-person video live broadcast method provided in the embodiment of the present disclosure Figure 1 The method of this embodiment can be applied to a video live broadcast server or a host terminal device. This embodiment is described by taking the case of application to a host terminal device (which can be a terminal corresponding to a host / room owner user) as an example. For example, the method for performing multi-person video live broadcast provided by this embodiment includes:

[0048] Step S101: Create a three-dimensional live broadcast room.

[0049] For example, reference Figure 1 As shown in the schematic diagram of the application scenario, after the host terminal device runs the live broadcast application, it can create a three-dimensional live broadcast room in response to the user's room creation instruction. The three-dimensional live broadcast room is a live broadcast room based on the three-dimensional live broadcast room form. Among them, in the application scenario of video live broadcast, the live broadcast room is a logical unit provided by the server of the live broadcast application for outputting the video live stream. The audience users who enter the live broadcast room can receive the video live stream corresponding to the live broadcast room, so as to watch the live content in the live broadcast room. The live broadcast room in the prior art is a two-dimensional live broadcast room, that is, on a fixed plane background, the video content corresponding to the anchor user is displayed, and the data constituting such a two-dimensional live broadcast room includes a live data stream and a plane image. Therefore, in the scenario of multi-person live broadcast, the two-dimensional live broadcast room receives the live data streams of different anchor users, and displays the live pictures of different anchor users on the plane image by displaying them in different areas.

[0050] The three-dimensional live broadcast room in this embodiment can be a live broadcast room with a three-dimensional stereoscopic effect constructed by a three-dimensional image engine. The data constituting the three-dimensional live broadcast room includes image model data and video live stream corresponding to the three-dimensional live broadcast room.

[0051] The three-dimensional live broadcast room provided in this embodiment refers to the three-dimensional live broadcast room, which needs to load three-dimensional image data, render three-dimensional live broadcast room, etc., so as to realize the creation of the three-dimensional live broadcast room. Furthermore, the three-dimensional live broadcast room corresponding to the created three-dimensional live broadcast room contains virtual objects, and different virtual environment scenes can be displayed through virtual objects, so as to realize the simulation of real environment scenes, such as concert scenes, variety show scenes, competition scenes, etc. The specific content in the above-mentioned three-dimensional live broadcast room and the realization of the overall virtual scene can be selected through user instructions. The three-dimensional live broadcast room can be initialized and created through the existing three-dimensional game engine, and the specific implementation method will not be repeated here.

[0052] Step S102: Based on the first video live stream sent by the first terminal device, create a first target image in the three-dimensional live broadcast room, wherein the first terminal device corresponds to the anchor user, and the first target image represents the live broadcast room screen of the two-dimensional live broadcast room corresponding to the first video live stream.

[0053] Exemplarily, after the host terminal device creates a 3D live broadcast room, the user operating the host terminal device can be regarded as the host / room owner user. After that, the host / room owner user can send an invitation message to the first terminal device corresponding to one or more anchor users through the host terminal device, so that the anchor user joins the 3D live broadcast room. Alternatively, the anchor user directly joins the 3D live broadcast room by receiving link push, autonomous search, etc. After the anchor user joins the 3D live broadcast room, it is equivalent to establishing a connection state between the first terminal device corresponding to the anchor user and the host terminal device that created the 3D live broadcast room. After that, the first terminal device sends the first video live stream to the host terminal device directly or indirectly, and the host terminal device renders the video content in the first video live stream into the 3D live broadcast room, thereby generating a first target image representing the image of the anchor user in the first video live stream in the 3D live broadcast room.

[0054] Figure 3 A schematic diagram of creating a first target image in a three-dimensional live broadcast room provided by an embodiment of the present disclosure, such as Figure 3 As shown, exemplarily, after creating a 3D live broadcast room, the host terminal device renders a corresponding 3D live broadcast room, referring to Figure 3 As shown in , the 3D live broadcast room includes virtual objects rendered based on a 3D image engine, such as a stage, an auditorium, and spectators in the auditorium. Afterwards, the host terminal device will receive the first video live stream steam_1 (shown as steam_1 in the figure) corresponding to the anchor user U1 sent by the terminal device D2_1, and the first video live stream steam_2 (shown as steam_2 in the figure) corresponding to the anchor user U2 sent by the terminal device D2_2. The host terminal device sets the live screen P1 generated based on the first video live stream steam_1 and the live screen P2 generated based on the first video live stream steam_2 (the live screen P1 and the live screen P2 are the first target images) at the positions pos_1 and pos_2 in the 3D live broadcast room for playback. In this way, the image screen of the anchor user U1 and the image screen of the anchor user U2 are visually located in the 3D live broadcast room at the same time, realizing the fusion of the image screen of the anchor user and the virtual environment.

[0055] In a possible implementation, after receiving the first live video stream, the host terminal device first processes the first live video stream, separates the anchor image part from the background part, and then generates the first target image in the three-dimensional live studio. This makes the first target image generated in the three-dimensional live studio more detailed and realistic. For example, Figure 4 As shown, the specific implementation of step S102 includes:

[0056] Step S1021: determining a target area of ​​a live image frame in the first live video stream, where the target area is an area where the host image is located in the live image frame.

[0057] Step S1022: Segment the live image frame based on the target area to generate a first target image.

[0058] Step S1023: setting the first target image in the three-dimensional live broadcast room.

[0059] Exemplarily, after obtaining the first video live stream, the host terminal device can obtain the corresponding live image frame after necessary decoding processing. The specific implementation process is the existing technology and will not be repeated here. After that, the host terminal device performs image recognition and segmentation for each live image frame, segments the image in the target area where the anchor image is located in the live image frame, and discards the image in the area outside the anchor image in the live image frame, thereby obtaining the anchor image with the background removed, that is, the first target image. In one possible implementation, the target area in the live image frame can be determined by the image color in the live image frame. For example, the first video live stream is generated by the first terminal device after shooting the anchor user in combination with a green screen. In the live image frame of the first video live stream, the background of the character is green, so the host terminal device can divide the target area by color. In another possible implementation, the host terminal device can also determine the current area by determining the outline of the image element in the live image frame and performing feature recognition on the image element. The specific implementation method of determining the target area can be set according to the specific situation, and no specific limitation is made here.

[0060] Exemplarily, optionally, after step S101, the method further includes:

[0061] Step S104: When the audience user enters the 3D live broadcast room, a target virtual object corresponding to the audience user is generated in the 3D live broadcast room.

[0062] Exemplarily, the three-dimensional live broadcast room includes at least one first spatial position and / or at least one second spatial position, wherein the first spatial position is used to display a first target image, and the second spatial position is used to display a virtual object, the first spatial position is determined based on first request information of a host user entering the three-dimensional live broadcast room, and the second spatial position is determined based on second request information of an audience user entering the three-dimensional live broadcast room.

[0063] Exemplarily, the first request information is the identifier of the anchor user entering the target anchor room, and the second request information is the identifier of the audience user entering the target anchor room. The host terminal device can obtain the above-mentioned first request information and second request information through the server of the live broadcast application, and then, based on the first request information and the second request information, set the first spatial position where the first target image is located and the second spatial position where the virtual object is located. For example, the corresponding first spatial position is determined based on the association between the anchor user and the host / room owner user, and for another example, the corresponding second spatial position is determined based on the association between the audience user and the anchor user.

[0064] In this embodiment, by obtaining the identifiers of the anchor user and the audience user to determine the corresponding spatial positions, more precise position control of image elements can be achieved in the three-dimensional live broadcast room, making the simulated scene presented in the three-dimensional live broadcast room more realistic.

[0065] Further, based on the introduction in the steps of the previous embodiment, for the anchor user in the 3D live broadcast room, the interaction between the anchor users can be achieved by displaying the video screen containing the anchor image in the 3D live broadcast room. However, for the audience users entering the 3D live broadcast room, it is impossible to perform differentiated display in the 3D live broadcast room, and it is impossible to interact with the anchor user. In order to solve the above problems, Figure 5 As shown, the specific implementation of step S104 includes:

[0066] Step S1041: when the target audience user enters the 3D live broadcast room, the second request information of the target audience user entering the 3D live broadcast room is obtained.

[0067] Step S1042: Based on the second request information, obtain the target appearance of the corresponding target virtual object.

[0068] Step S1043: Generate a target virtual object in the three-dimensional live broadcast room based on the target appearance.

[0069] Exemplarily, there is a preset mapping relationship between the second request information and the appearance of the virtual object. For example, the level of the live broadcast room represented by the second request information is mapped to the corresponding appearance color. Therefore, based on the second request information and the above mapping relationship, the target appearance of the corresponding target virtual object can be obtained. Afterwards, the target appearance is used as a rendering parameter to render the target virtual object into the three-dimensional live broadcast room, thereby achieving the purpose of generating the target virtual object corresponding to the second request information in the three-dimensional live broadcast room. Among them, the above mapping relationship is only exemplary, and the specific mapping between the second request information representation and the target appearance can be set as needed, and no specific limitation is made here.

[0070] Further, optionally, after step S104, the method further includes:

[0071] Step S105: In response to the action request sent by the second terminal device, control the target virtual object to move in the three-dimensional live broadcast room.

[0072] For example, the audience user can directly or indirectly send an action request to the host terminal device by operating the second terminal device. For example, after triggering the specified components and props on the second terminal device side, the second terminal device sends an action request to the host terminal device through the server. After receiving the action request, the host terminal device determines the target audience user corresponding to the action request, and then determines the target virtual object corresponding to the target audience user in the three-dimensional live broadcast room, such as the target virtual object produced by the three-dimensional image engine. After that, based on the specific content represented by the action request, the target virtual object is controlled to move in the three-dimensional live broadcast room. This enables interaction and communication between the audience user and the anchor user.

[0073] like Figure 6 As shown, illustratively, the specific implementation of step S105 includes:

[0074] Step S1051: in response to the action request sent by the second terminal device, obtaining action information corresponding to the target audience user.

[0075] Step S1052: Based on the action information, a target action of a target virtual object corresponding to the target audience user is generated.

[0076] Step S1053: Control the target virtual object to move in the three-dimensional live broadcast room based on the target action.

[0077] Figure 7 A schematic diagram of a target virtual object moving in a three-dimensional live broadcast room provided by an embodiment of the present disclosure, such as Figure 7As shown, after the target audience user enters the three-dimensional live broadcast room, the host terminal device receives the entry message Info_1 (shown as Info_1 in the figure), which can be sent indirectly by the second terminal device to the host terminal device through the server; then the host terminal device creates a corresponding target virtual object P1 for the target audience user in the virtual three-dimensional space corresponding to the three-dimensional live broadcast room. In the initial state, the virtual object P1 is in a standing posture with arms hanging down. Afterwards, the host terminal device receives the action information Info_2 (shown as Info_2 in the figure) sent indirectly by the first terminal device D2 through the server. Based on the action information Info_2, the host terminal device determines the corresponding target action, such as a cheering action of raising both hands, and controls the movement of the virtual object P1 based on the target action to make the cheering action of raising both hands, thereby realizing the control of the corresponding virtual object in the three-dimensional live broadcast room by the audience user, enabling the audience user to interact with the anchor user, and the audience user and the audience user, improving the interactive effect of the three-dimensional live broadcast room, and improving the overall live broadcast effect in the multi-person live broadcast scene.

[0078] Step S103: Sending a second video live stream corresponding to the three-dimensional live broadcast room to a target terminal device, wherein the target terminal device includes a first terminal device and / or a second terminal device, and the second terminal device corresponds to an audience user.

[0079] Exemplarily, after the host terminal device generates the first target image and virtual object in the above-mentioned three-dimensional live broadcast room, it uses the data corresponding to the three-dimensional live broadcast room to render the corresponding live data stream, i.e., the second video live stream, and uploads it to the server of the live broadcast application. After that, the server of the live broadcast application distributes the second video live stream to the first terminal device and / or the second terminal device, i.e., the target terminal device, so that the first terminal device and / or the second terminal device can watch the actual image in the three-dimensional live broadcast room on the side of the running live broadcast client (or anchor client). After the above steps, multiple anchor users are located in the same three-dimensional live broadcast room, and the image of the anchor user is integrated with the virtual environment, so it has better integrity and authenticity. At the same time, it can realize the interaction and communication between multiple anchor users in the three-dimensional live broadcast room, and improve the interaction efficiency of the three-dimensional live broadcast room.

[0080] In this embodiment, a three-dimensional live broadcast room is created; based on the first video live stream sent by the first terminal device, a first target image is created in the three-dimensional live broadcast room, wherein the first terminal device corresponds to the anchor user, and the first target image represents the live broadcast room screen of the two-dimensional live broadcast room corresponding to the first video live stream; and a second video live stream corresponding to the three-dimensional live broadcast room is sent to the target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to the audience user. By creating a three-dimensional live broadcast room, the image (anchor image) of the anchor user is projected into the three-dimensional live broadcast room for display, so that the images of different anchor users are integrated with the environment, reducing the sense of spatial fragmentation, improving the difference in visual effects, and improving the overall live broadcast effect in a multi-person live broadcast scene.

[0081] refer to Figure 8 , Figure 8 Schematic diagram of the process of the multi-person video live broadcast method provided in the embodiment of the present disclosure Figure 2 This example is described in detail in Figure 2 On the basis of the illustrated embodiment, a step of processing based on control information is further added, and the multi-person video live broadcast method includes:

[0082] Step S201: Create a three-dimensional live broadcast room.

[0083] Step S202: Acquire the target screen of the room owner / host user corresponding to the host terminal device.

[0084] Step S203: Based on the target screen of the host user, a second target image is generated in the three-dimensional live broadcast room, where the second target image represents the virtual object corresponding to the host user.

[0085] For example, in this embodiment, after creating a 3D live broadcast room, the host terminal device further creates a virtual object based on its own image in the 3D live broadcast room as the host role of the 3D live broadcast room. Specifically, first, the host terminal device collects the target screen of the host user located on one side of the host terminal device through the image acquisition unit, and then obtains the host image features based on feature extraction, and then uses the obtained host image features as parameters to input the 3D image engine, so as to render the corresponding virtual object in the 3D live broadcast room, such as a virtual character with the appearance of the host, that is, the second target image.

[0086] Step S204: Send invitation information to the first terminal device, where the invitation information is used to invite the first terminal device to enter the three-dimensional live broadcast room.

[0087] Step S205: After receiving the response information sent by the first terminal device, receive the first video live stream sent by the first terminal device.

[0088] Furthermore, after creating a three-dimensional live broadcast room, in a possible implementation, the host terminal device sends an invitation message to the first terminal device based on a user instruction to invite the anchor user on the first terminal device side to join the three-dimensional live broadcast room. After receiving the invitation message, the first terminal device displays a corresponding prompt mark and a corresponding selection component in the client of the live broadcast application. The prompt mark is, for example, "XXX user invites you to join the XR live broadcast room", and the appearance of the corresponding displayed selection component is "yes" and "no". When the anchor user clicks the selection component corresponding to "yes", the first terminal device sends a response message to the host terminal device. After receiving the response message, the host terminal device establishes a video connection with the first terminal device. The first terminal device sends the live video stream corresponding to the live broadcast room where the anchor user is currently located, that is, the first video live stream, to the host terminal device, so that the host terminal device receives the first video live stream and performs subsequent processing steps.

[0089] Step S206: creating a first target image in the three-dimensional live broadcast room based on the first video live stream sent by the first terminal device.

[0090] Step S207: receiving control information sent by the target terminal device, where the control information represents an observation position and / or an observation angle of an observation point in the three-dimensional live broadcast room, and the observation point is used to obtain an image in the three-dimensional live broadcast room.

[0091] Step S208: Generate a second video live stream corresponding to the target terminal device according to the control information.

[0092] Exemplarily, the target terminal device can be a first terminal device or a second terminal device, that is, a terminal device used by an anchor user or an audience user. Both the anchor user and the audience user can adjust the position and viewing angle of the live screen in the three-dimensional live studio through the corresponding terminal device (the client running inside). The following is a detailed introduction taking the audience user as an example. Exemplarily, the target terminal device is a second terminal device. After the second terminal device receives the operation instruction of the audience user, it sends control information to the host terminal device, wherein the operation instruction is such as a rotation lens instruction and a mobile lens position instruction. Through the above rotation lens instruction and mobile lens position instruction, the position parameters and angle parameters of the picture lens in the three-dimensional live studio can be obtained, that is, control information, wherein the picture lens is the observation point in the three-dimensional live studio, the position parameter is the information representing the observation position, and the angle parameter is the information representing the observation angle. After receiving the above control information, the host terminal device renders the corresponding two-dimensional image based on the observation position and / or observation angle represented by the control information, thereby generating a second video live stream, and returns it to the second terminal device, so that the audience user on the second terminal device side can see the live screen that matches the rotation lens instruction and mobile lens position instruction applied by it.

[0093] It should be noted that the control information may include information corresponding to both the observation position and the observation angle, or may only include information corresponding to the observation position or the observation angle. When the control information only includes information corresponding to the observation position or the observation angle, the other parameter may be automatically generated or fixed. For example, when the control information includes the parameter of the observation position, the observation angle may be automatically determined according to the direction of the vector formed by the observation position and the first spatial position where the first target image is located, so that the observation angle is always directed toward the first target image; when the control information includes the parameter of the observation angle, the observation position may be a preset value, which may be determined, for example, based on a previous instruction to move the lens position. The specific implementation method may be determined as needed and will not be described in detail here.

[0094] In one possible implementation, Fig. 9 As shown, step S208 includes three specific implementation steps: step S2081, S2082 and S2083:

[0095] Step S2081: According to the control information sent by the target terminal device, the spatial observation range of the observation point in the three-dimensional live broadcast room is obtained.

[0096] Step S2082: According to the control information, a target display direction of the first target image is obtained, wherein an angle between the target display direction and the direction of the position vector is less than an angle threshold, and the position vector is composed of a first spatial position corresponding to the first target image and an observation position corresponding to the control information.

[0097] Step S2083: Based on the spatial observation range and the target display direction, image acquisition is performed on the three-dimensional live broadcast room to generate a second video live stream.

[0098] Exemplarily, the control information includes an observation position and an observation angle. According to the observation position, the position of the observation point in the three-dimensional live broadcast room can be determined. Then, according to the observation angle and a preset field of view angle (for example, an angle range of 60 degrees up and down and 120 degrees left and right with the observation angle as the center), a spatial observation range can be determined. Then, in a possible implementation, if the first target image (the first spatial position where it is located) is outside the spatial observation range, the three-dimensional live broadcast room is imaged and encoded based on the spatial observation range to generate a second video live stream composed of two-dimensional image frames. In the specific implementation process, each time the user inputs an operation instruction (for example, rotate the viewing angle), the target terminal device generates control information, and after the target terminal device sends it, the host terminal device generates at least one two-dimensional image frame according to the control information, and sends it back to the target terminal device through the second video live stream for display, thereby producing a three-dimensional view effect.

[0099] In another possible implementation, if the first target image (the first spatial position where it is located) is within the spatial observation range, then the target display direction of the first target image is further obtained based on the control information, wherein the display direction of the first target image is the orientation of the first target image, and the target display direction of the first target image is determined by the direction of the position vector formed by the first spatial position corresponding to the first target image and the observation position corresponding to the control information. For example, the target display direction of the first target image is parallel to the direction of the position vector formed by the first spatial position and the observation position, or the angle is less than the angle threshold. Afterwards, the first target image displayed based on the target display direction and the three-dimensional live broadcast room corresponding to the spatial observation range are imaged and encoded to generate a second video live stream composed of two-dimensional image frames. In the two-dimensional image frames of the second video live stream, the display direction of the first target image is always toward the observation point, thereby avoiding the problem of the first target image being deflected in the live screen due to the movement of the observation point, thereby improving the picture effect.

[0100] Fig.10 A schematic diagram of determining a target display direction provided by an embodiment of the present disclosure is shown below in combination with the embodiment Fig.10 Further explanation of the above steps, such as Fig.10 As shown, according to the control information vers_1 (shown as vers_1 in the figure) sent by the second terminal device, when the observation point is set at the A_1 position in the three-dimensional live broadcast room, the target display direction of the first target image at the B position is seta_1, seta_1 is the direction of the line connecting the A_1 position and the B position, the host terminal device collects the image of the three-dimensional live broadcast room within the spatial observation range, and the first target image displayed with seta_1 as the display direction; then the two are merged, rendered and encoded to generate the second video live stream steam_1.

[0101] According to the control information vers_2 (shown as vers_2 in the figure) sent by the second terminal device, when the observation point is set at the A_2 position in the three-dimensional live broadcast room, the target display direction of the first target image at the B position is seta_2, seta_2 is the connection direction of the A_2 position and the B position, and the host terminal device collects the image of the three-dimensional live broadcast room within the spatial observation range, and the first target image displayed with seta_2 as the display direction; then the two are merged, rendered and encoded to generate the second video live stream steam_2.

[0102] Based on the embodiment shown in the above figure, although the second video live stream steam_1 and the second video live stream steam_2 correspond to observation positions of different observation points, since the target display direction is dynamically adjusted with the observation position, it is ensured that in the second video live stream steam_1 and the second video live stream steam_2, the first target image always faces the live camera (observation point), ensuring that the first target image can be normally displayed at any observation position.

[0103] Step S209: Send the corresponding second video live stream to each target terminal device.

[0104] Exemplarily, after the second video live stream is generated, it is sent to the first terminal device and / or the second terminal device, so that each anchor user and each audience user entering the live broadcast room can see the live broadcast picture generated based on the control information set by each of them.

[0105] In this embodiment, steps S201, S206, and S209 are implemented in the same manner as steps S101-S103 in the above embodiment. For detailed discussion, please refer to Figure 2 The relevant discussion in the illustrated embodiment will not be repeated here.

[0106] refer to Fig.11 , Fig.11 Schematic diagram of the process of the multi-person video live broadcast method provided in the embodiment of the present disclosure Figure 3 The method of this embodiment can be applied to a first terminal device used by a host user. Exemplarily, the method for performing multi-person video live broadcast provided by this embodiment includes:

[0107] Step S301: Enter the 3D live broadcast room.

[0108] Step S302: Send a first video live stream to a host terminal device that creates a three-dimensional live room to create a first target image in the three-dimensional live room, wherein the first target image represents a live room screen of a two-dimensional live room corresponding to the first video live stream.

[0109] Step S303: receiving a second video live stream corresponding to the three-dimensional live broadcast room, and playing the second video live stream.

[0110] Exemplarily, the method provided in this embodiment uses the first terminal device on the side of the anchor user as the execution subject. After entering the three-dimensional live broadcast room, the first terminal device sends the first video live stream to the host terminal device, so that the live broadcast screen of the anchor user is generated in the three-dimensional live broadcast room. After that, the second video live stream generated by the host terminal device after rendering the three-dimensional live broadcast room is received, and based on the second video live stream, it is played, so that different anchor users can be connected in a three-dimensional virtual environment. Since each anchor user can see the anchor image of himself and other anchor users through the above steps, it is possible to achieve live interaction in a three-dimensional environment and improve the live broadcast effect of multi-person live broadcast. The specific implementation process of the above steps has been introduced in the previous embodiment. The specific implementation method can refer to the interaction steps between the host terminal device and the first terminal device in the previous embodiment, which will not be repeated here.

[0111] Furthermore, on this basis, the method provided in this embodiment also includes:

[0112] Step S304: sending control information, where the control information represents an observation position and / or observation angle of an observation point in the three-dimensional live broadcast room, and the observation point is used to obtain an image in the three-dimensional live broadcast room.

[0113] After sending the control information, the specific implementation method of step S303 is: receiving the second video live stream generated based on the control information corresponding to the three-dimensional live room, and playing the second video live stream.

[0114] For example, after the anchor user joins the 3D live broadcast room, he can further operate the first terminal device to send control information to the host terminal device, thereby controlling the observation position and angle of the observation point in the 3D live broadcast room, thereby achieving a better interaction effect with other anchor users. The specific implementation method can refer to the relevant steps of the second terminal device sending control information to the host terminal device in the previous embodiment, and the implementation method is similar, which will not be repeated here.

[0115] Corresponding to the multi-person video live broadcast method of the above embodiment, Fig.12 This is a structural block diagram of a multi-person video live broadcast device provided by an embodiment of the present disclosure, which is applied to a host terminal device. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Fig.12 , the multi-person video live broadcast device 4 comprises:

[0116] A creation module 41, used for creating a three-dimensional live broadcast room;

[0117] A generating module 42 is used to create a first target image in a three-dimensional live broadcast room based on a first video live broadcast stream sent by a first terminal device, wherein the first terminal device corresponds to a host user, and the first target image represents a live broadcast room screen of a two-dimensional live broadcast room corresponding to the first video live broadcast stream;

[0118] The transceiver module 43 is used to send the second video live stream corresponding to the three-dimensional live room to the target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to the audience user.

[0119] In one embodiment of the present disclosure, the generation module 42 is specifically used to: determine a target area of ​​a live image frame in a first video live stream, where the target area is the area where the host image is located in the live image frame; segment the live image frame based on the target area to generate a first target image; and set the first target image in a three-dimensional live broadcast room.

[0120] In one embodiment of the present disclosure, the generation module 42 is also used to: receive control information sent by the target terminal device, the control information represents the observation position and / or observation angle of the observation point in the three-dimensional live broadcast room, and the observation point is used to obtain the image in the three-dimensional live broadcast room; and generate a second video live stream corresponding to the target terminal device according to the control information.

[0121] In one embodiment of the present disclosure, when the generation module 42 generates a second video live stream corresponding to the target terminal device according to the control information, it is specifically used to: obtain the spatial observation range of the observation point in the three-dimensional live broadcast room according to the control information sent by the target terminal device; perform image acquisition on the three-dimensional live broadcast room based on the spatial observation range to generate the second video live stream.

[0122] In one embodiment of the present disclosure, when the generation module 42 generates a second video live stream corresponding to a target terminal device according to control information, it is specifically used to: obtain a target display direction of the first target image according to the control information, wherein an angle between the target display direction and the direction of a position vector is less than an angle threshold, and the position vector is composed of a first spatial position corresponding to the first target image and an observation position corresponding to the control information; generate a second video live stream according to the target display direction.

[0123] In one embodiment of the present disclosure, a three-dimensional live broadcast room includes at least one first spatial position and / or at least one second spatial position, wherein the first spatial position is used to display a first target image, and the second spatial position is used to display a virtual object, and the first spatial position is determined based on first request information of a host user entering the three-dimensional live broadcast room, and the second spatial position is determined based on second request information of an audience user entering the three-dimensional live broadcast room.

[0124] In one embodiment of the present disclosure, the generation module 42 is further used to: obtain first request information of a target audience user entering the three-dimensional live broadcast room; obtain the target appearance of the corresponding target virtual object based on the first request information; and generate the target virtual object based on the target appearance.

[0125] In one embodiment of the present disclosure, the generation module 42 is also used to: obtain action information corresponding to the target audience user in response to the action request sent by the second terminal device; generate a target action of the target virtual object corresponding to the target audience user based on the action information; and control the movement of the target virtual object in the three-dimensional live broadcast room based on the target action.

[0126] In one embodiment of the present disclosure, the generation module 42 is further used to: obtain a target screen of a host user corresponding to the host terminal device; and generate a second target image in the three-dimensional live broadcast room based on the target screen of the host user, wherein the second target image represents a virtual object corresponding to the host user.

[0127] In one embodiment of the present disclosure, after creating a three-dimensional live broadcast room, the transceiver module 42 is also used to: send an invitation message to the first terminal device, the invitation message is used to invite the first terminal device to enter the three-dimensional live broadcast room; after receiving the response message sent by the first terminal device, receive the first video live stream sent by the first terminal device.

[0128] The creation module 41, the generation module 42, and the transceiver module 43 are connected in sequence. The multi-person video live broadcast device 4 provided in this embodiment can execute the technical solution of the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated in this embodiment.

[0129] Fig.13 This is a structural block diagram of another multi-person video live broadcast device provided by an embodiment of the present disclosure, which is applied to a first terminal device. For ease of explanation, only the parts related to the embodiment of the present disclosure are shown. Fig.13 , the multi-person video live broadcast device 5 comprises:

[0130] Processing module 51, used for entering a three-dimensional live broadcast room;

[0131] The transceiver module 52 is used to send the first video live stream to the host terminal device that creates the three-dimensional live room, so as to create a first target image in the three-dimensional live room, wherein the first target image represents the live room screen of the two-dimensional live room corresponding to the first video live stream;

[0132] The playing module 53 is used to receive the second video live stream corresponding to the three-dimensional live room and play the second video live stream.

[0133] In one embodiment of the present disclosure, the transceiver module 52 is also used to: send control information, the control information represents the observation position and / or observation angle of the observation point in the three-dimensional live broadcast room, and the observation point is used to obtain the image in the three-dimensional live broadcast room; the playback module 53 is specifically used to: receive the second video live stream generated based on the control information corresponding to the three-dimensional live broadcast room, and play the second video live stream generated based on the control information.

[0134] Fig.14 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure is shown in FIG. Fig.14 As shown, the electronic device 6 includes:

[0135] A processor 61, and a memory 62 communicatively connected to the processor 61;

[0136] The memory 62 stores computer executable instructions;

[0137] The processor 61 executes the computer execution instructions stored in the memory 62 to implement the following Figure 2-Figure 11 The multi-person video live broadcast method in the illustrated embodiment.

[0138] Optionally, the processor 61 and the memory 62 are connected via a bus 63 .

[0139] For related instructions, please refer to Figure 2-Figure 11 The relevant descriptions and effects corresponding to the steps in the corresponding embodiments can be understood, and no further elaboration is made here.

[0140] The present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, which are used to implement the present invention when executed by a processor. Figure 2-Figure 11 A method for multi-person video live broadcast provided by any one of the corresponding embodiments.

[0141] The present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements Figure 2-Figure 11 The multi-person video live broadcast method in the illustrated embodiment.

[0142] refer to Fig.15 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure, and the electronic device 900 may be a terminal device or a server. The terminal device may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.15 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0143] like Fig.15As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0144] Typically, the following devices may be connected to the I / O interface 905: input devices 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 908 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig.15 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0145] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0146] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0147] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0148] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0149] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0150] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0151] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a unit does not limit the unit itself in some cases. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".

[0152] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0153] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0154] In a first aspect, according to one or more embodiments of the present disclosure, a multi-person video live broadcast method is provided, comprising:

[0155] Create a three-dimensional live broadcast room; create a first target image in the three-dimensional live broadcast room based on a first video live stream sent by a first terminal device, wherein the first terminal device corresponds to an anchor user, and the first target image represents a live broadcast room screen of a two-dimensional live broadcast room corresponding to the first video live stream; send a second video live stream corresponding to the three-dimensional live broadcast room to a target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to an audience user.

[0156] According to one or more embodiments of the present disclosure, the first target image is created in the three-dimensional live broadcast room based on the first video live stream sent by the first terminal device, including: determining a target area of ​​the live image frame in the first video live stream, the target area being the area where the anchor image is located in the live image frame; dividing the live image frame based on the target area to generate the first target image; and setting the first target image in the three-dimensional live broadcast room.

[0157] According to one or more embodiments of the present disclosure, the method also includes: receiving control information sent by the target terminal device, the control information representing the observation position and / or observation angle of the observation point in the three-dimensional live broadcast room, and the observation point is used to obtain the image in the three-dimensional live broadcast room; generating the second video live stream according to the control information.

[0158] According to one or more embodiments of the present disclosure, generating the second video live stream according to the control information includes: obtaining the spatial observation range of the observation point in the three-dimensional live broadcast room according to the control information sent by the target terminal device; and performing image acquisition on the three-dimensional live broadcast room based on the spatial observation range to generate the second video live stream.

[0159] According to one or more embodiments of the present disclosure, generating the second video live stream according to the control information includes: obtaining a target display direction of the first target image according to the control information, wherein an angle between the target display direction and a direction of a position vector is less than an angle threshold, and the position vector is composed of a first spatial position corresponding to the first target image and an observation position corresponding to the control information; generating the second video live stream according to the target display direction.

[0160] According to one or more embodiments of the present disclosure, the three-dimensional live broadcast room includes at least one first spatial position and / or at least one second spatial position, wherein the first spatial position is used to display the first target image, and the second spatial position is used to display a virtual object, and the first spatial position is determined based on first request information of a host user entering the three-dimensional live broadcast room, and the second spatial position is determined based on second request information of an audience user entering the three-dimensional live broadcast room.

[0161] According to one or more embodiments of the present disclosure, the method further includes: obtaining first request information of a target audience user entering the three-dimensional live broadcast room; based on the first request information, obtaining a target appearance of a corresponding target virtual object; and based on the target appearance, generating the target virtual object.

[0162] According to one or more embodiments of the present disclosure, the method also includes: obtaining action information corresponding to the target audience user in response to the action request sent by the second terminal device; generating a target action of the target virtual object corresponding to the target audience user based on the action information; and controlling the target virtual object to move within the three-dimensional live broadcast room based on the target action.

[0163] According to one or more embodiments of the present disclosure, the method also includes: obtaining a target screen of a hosting user corresponding to a host terminal device; and generating a second target image in the three-dimensional live broadcast room based on the target screen of the hosting user, wherein the second target image represents a virtual object corresponding to the hosting user.

[0164] According to one or more embodiments of the present disclosure, after creating a three-dimensional live broadcast room, it also includes: sending an invitation message to the first terminal device, wherein the invitation message is used to invite the first terminal device to enter the three-dimensional live broadcast room; after receiving the response message sent by the first terminal device, receiving the first video live stream sent by the first terminal device.

[0165] In a second aspect, according to one or more embodiments of the present disclosure, a method for live broadcasting of a video is provided, comprising:

[0166] Enter a three-dimensional live broadcast room; send a first video live stream to a host terminal device that creates the three-dimensional live broadcast room to create a first target image in the three-dimensional live broadcast room, wherein the first terminal device corresponds to an anchor user, and the first target image represents a live broadcast room screen of a two-dimensional live broadcast room corresponding to the first video live stream; receive a second video live stream corresponding to the three-dimensional live broadcast room, and play the second video live stream.

[0167] According to one or more embodiments of the present disclosure, the method also includes: sending control information, wherein the control information represents an observation position and / or an observation angle of an observation point in the three-dimensional live broadcast room, and the observation point is used to obtain an image in the three-dimensional live broadcast room; receiving a second video live stream corresponding to the three-dimensional live broadcast room, and playing the second video live stream, including: receiving a second video live stream generated based on the control information corresponding to the three-dimensional live broadcast room, and playing the second video live stream generated based on the control information.

[0168] In a third aspect, according to one or more embodiments of the present disclosure, a multi-person video live broadcast device is provided, comprising:

[0169] Creation module, used to create a three-dimensional live broadcast room;

[0170] A generating module, configured to create a first target image in the three-dimensional live broadcast room based on a first video live broadcast stream sent by a first terminal device, wherein the first terminal device corresponds to a host user, and the first target image represents a live broadcast room screen of the two-dimensional live broadcast room corresponding to the first video live broadcast stream;

[0171] The transceiver module is used to send the second video live stream corresponding to the three-dimensional live room to the target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to the audience user.

[0172] According to one or more embodiments of the present disclosure, the generation module is specifically used to: determine a target area of ​​a live image frame in the first video live stream, the target area being the area where the anchor image is located in the live image frame; segment the live image frame based on the target area to generate the first target image; and set the first target image in the three-dimensional live broadcast room.

[0173] According to one or more embodiments of the present disclosure, the generation module is also used to: receive control information sent by the target terminal device, the control information represents the observation position and / or observation angle of the observation point in the three-dimensional live broadcast room, and the observation point is used to obtain the image in the three-dimensional live broadcast room; generate the second video live stream according to the control information.

[0174] According to one or more embodiments of the present disclosure, when the generation module generates the second video live stream according to the control information, it is specifically used to: obtain the spatial observation range of the observation point in the three-dimensional live broadcast room according to the control information sent by the target terminal device; and perform image acquisition on the three-dimensional live broadcast room based on the spatial observation range to generate the second video live stream.

[0175] According to one or more embodiments of the present disclosure, when the generation module generates the second video live stream according to the control information, it is specifically used to: obtain a target display direction of the first target image according to the control information, wherein an angle between the target display direction and a direction of a position vector is less than an angle threshold, and the position vector is composed of a first spatial position corresponding to the first target image and an observation position corresponding to the control information; generate the second video live stream according to the target display direction.

[0176] According to one or more embodiments of the present disclosure, the three-dimensional live broadcast room includes at least one first spatial position and / or at least one second spatial position, wherein the first spatial position is used to display the first target image, and the second spatial position is used to display a virtual object, and the first spatial position is determined based on first request information of a host user entering the three-dimensional live broadcast room, and the second spatial position is determined based on second request information of an audience user entering the three-dimensional live broadcast room.

[0177] According to one or more embodiments of the present disclosure, the generation module is further used to: obtain first request information of a target audience user entering the three-dimensional live broadcast room; based on the first request information, obtain the target appearance of the corresponding target virtual object; and based on the target appearance, generate the target virtual object.

[0178] According to one or more embodiments of the present disclosure, the generation module is also used to: obtain action information corresponding to the target audience user in response to the action request sent by the second terminal device; generate a target action of the target virtual object corresponding to the target audience user based on the action information; and control the movement of the target virtual object in the three-dimensional live broadcast room based on the target action.

[0179] According to one or more embodiments of the present disclosure, the generation module is also used to: obtain a target screen of a host user corresponding to a host terminal device; and generate a second target image in the three-dimensional live broadcast room based on the target screen of the host user, wherein the second target image represents a virtual object corresponding to the host user.

[0180] According to one or more embodiments of the present disclosure, after creating a three-dimensional live broadcast room, the transceiver module is also used to: send an invitation message to the first terminal device, wherein the invitation message is used to invite the first terminal device to enter the three-dimensional live broadcast room; after receiving the response message sent by the first terminal device, receive the first video live stream sent by the first terminal device.

[0181] In a fourth aspect, according to one or more embodiments of the present disclosure, a multi-person video live broadcast device is provided, comprising:

[0182] A processing module for entering a three-dimensional live broadcast room;

[0183] A transceiver module is used to send a first video live stream to a host terminal device that creates the three-dimensional live broadcast room, so as to create a first target image in the three-dimensional live broadcast room, wherein the first target image represents a host image screen in the first video live stream;

[0184] The playback module is used to receive the second video live stream corresponding to the three-dimensional live broadcast room and play the second video live stream.

[0185] According to one or more embodiments of the present disclosure, the transceiver module is further used to: send control information, wherein the control information represents the observation position and / or observation angle of the observation point in the three-dimensional live broadcast room, and the observation point is used to obtain the image in the three-dimensional live broadcast room; the playback module is specifically used to: receive the second video live stream generated based on the control information corresponding to the three-dimensional live broadcast room, and play the second video live stream generated based on the control information.

[0186] In a fifth aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: a processor, and a memory communicatively connected to the processor;

[0187] The memory stores computer-executable instructions;

[0188] The processor executes the computer-executable instructions stored in the memory to implement the multi-person video live broadcast method as described in the first aspect and various possible designs of the first aspect, or to implement the multi-person video live broadcast method as described in the second aspect and various possible designs of the second aspect.

[0189] In a sixth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer execution instructions. When a processor executes the computer execution instructions, the multi-person video live broadcast method as described in the first aspect and various possible designs of the first aspect is implemented, or the multi-person video live broadcast method as described in the second aspect and various possible designs of the second aspect is implemented.

[0190] In the seventh aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the multi-person video live broadcast method as described in the first aspect and various possible designs of the first aspect, or implements the multi-person video live broadcast method as described in the second aspect and various possible designs of the second aspect.

[0191] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0192] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0193] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A multi-person video live broadcast method, characterized in that: include: Create a 3D live broadcast room; Based on the first video live stream sent by the first terminal device, a first target image is created in the three-dimensional live studio, wherein the first terminal device corresponds to the anchor user, and the first target image represents the live studio screen of the two-dimensional live studio corresponding to the first video live stream; A second video live stream corresponding to the three-dimensional live broadcast room is sent to a target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to an audience user.

2. The method according to claim 1, characterized in that The step of creating a first target image in the three-dimensional live broadcast room based on the first video live broadcast stream sent by the first terminal device includes: Determine a target area of ​​a live image frame in the first live video stream, where the target area is an area where a host image is located in the live image frame; Segment the live image frame based on the target area to generate the first target image; The first target image is set in the three-dimensional live broadcast room.

3. The method according to claim 1, characterized in that: The method further comprises: Receiving control information sent by the target terminal device; Generate the second video live stream according to the control information.

4. The method according to claim 3, characterized in that The step of generating the second video live stream according to the control information includes: The three-dimensional live broadcast room is imaged according to the control information sent by the target terminal device to generate the second video live stream.

5. The method according to claim 3, characterized in that: The step of generating the second video live stream according to the control information includes: Obtaining a target display direction of the first target image according to the control information; Generate the second video live stream according to the target display direction.

6. The method according to claim 1, characterized in that The three-dimensional live broadcast room includes at least one first spatial position and / or at least one second spatial position, wherein the first spatial position is used to display the first target image, and the second spatial position is used to display a virtual object. The first spatial position is determined based on the first request information of the anchor user entering the three-dimensional live broadcast room, and the second spatial position is determined based on the second request information of the audience user entering the three-dimensional live broadcast room.

7. The method according to claim 6, characterized in that The method further comprises: Acquire first request information of a target audience user entering the three-dimensional live broadcast room; Based on the first request information, obtaining a target appearance of a corresponding target virtual object; Based on the target appearance, the target virtual object is generated.

8. The method according to claim 6, characterized in that The method further comprises: In response to the action request sent by the second terminal device, obtaining action information corresponding to the target audience user; Based on the action information, generating a target action of a target virtual object corresponding to the target audience user; Control the target virtual object to move in the three-dimensional live broadcast room based on the target action.

9. The method according to claim 1, characterized in that: The method further comprises: Obtain the target screen of the host user corresponding to the host terminal device; Based on the target screen of the host user, a second target image is generated in the three-dimensional live broadcast room, and the second target image represents the virtual object corresponding to the host user.

10. The method according to claim 1, characterized in that After creating a 3D live broadcast room, it also includes: Sending an invitation message to the first terminal device, where the invitation message is used to invite the first terminal device to enter the three-dimensional live broadcast room; After receiving the response information sent by the first terminal device, receive the first video live stream sent by the first terminal device.

11. A method for multi-person video live broadcast, characterized in that: include: Enter the 3D live broadcast room; Sending a first video live stream to a host terminal device that creates the three-dimensional live broadcast room to create a first target image in the three-dimensional live broadcast room, wherein the first target image represents a host image screen in the first video live stream; Receive a second video live stream corresponding to the three-dimensional live broadcast room, and play the second video live stream.

12. The method according to claim 11, characterized in that The method further comprises: Send control information; The receiving a second video live stream corresponding to the three-dimensional live broadcast room and playing the second video live stream includes: Receive a second video live stream generated based on the control information corresponding to the three-dimensional live room, and play the second video live stream generated based on the control information.

13. A multi-person video live broadcast device, characterized in that: include: Creation module, used to create a three-dimensional live broadcast room; A generating module, configured to create a first target image in the three-dimensional live broadcast room based on a first video live broadcast stream sent by a first terminal device, wherein the first terminal device corresponds to a host user, and the first target image represents a live broadcast room screen of the two-dimensional live broadcast room corresponding to the first video live broadcast stream; The transceiver module is used to send the second video live stream corresponding to the three-dimensional live room to the target terminal device, wherein the target terminal device includes the first terminal device and / or the second terminal device, and the second terminal device corresponds to the audience user.

14. A multi-person video live broadcast device, characterized in that: include: A processing module for entering a three-dimensional live broadcast room; A transceiver module is used to send a first video live stream to a host terminal device that creates the three-dimensional live broadcast room, so as to create a first target image in the three-dimensional live broadcast room, wherein the first target image represents a host image screen in the first video live stream; The playback module is used to receive the second video live stream corresponding to the three-dimensional live broadcast room and play the second video live stream.

15. An electronic device, characterized in that: include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the multi-person video live broadcast method as described in any one of claims 1 to 12.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions. When the processor executes the computer-executable instructions, the multi-person video live broadcast method as described in any one of claims 1 to 12 is implemented.

17. A computer program product, characterized in that It comprises a computer program, which, when executed by a processor, implements the multi-person video live broadcast method described in any one of claims 1 to 12.

Images