Live content display method, device, medium and electronic equipment

Abstract

The present disclosure relates to a method, device, storage medium and electronic device for displaying live content, the method comprising: receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room; determining an access path corresponding to the access request according to information carried by the access request; generating first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path; sending the first live broadcast data to the target terminal so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, the three-dimensional live broadcast room including a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene. The method can improve the user viewing experience and support users to access the three-dimensional live broadcast room through different access paths.

Description

Technical Field

[0001] The present disclosure relates to the field of live broadcast technology, and in particular, to a live broadcast content display method, device, medium and electronic device. Background Art

[0002] Nowadays, watching live broadcasts has become a common form of entertainment. However, the live broadcast methods in the related art cannot meet the diversified experience needs of users, which reduces the viewing experience of users watching live broadcasts. Summary of the invention

[0003] This summary is provided to introduce concepts in a brief form that will be described in detail in the detailed description below. This summary is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] In a first aspect, the present disclosure provides a method for displaying live content, the method comprising:

[0005] Receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room;

[0006] Determine, according to the information carried in the access request, an access path corresponding to the access request;

[0007] Generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path;

[0008] The first live broadcast data is sent to the target terminal, so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, and the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0009] In a second aspect, the present disclosure provides a live content display device, the device comprising:

[0010] A receiving module, used for receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room;

[0011] A determination module, configured to determine an access path corresponding to the access request according to information carried in the access request;

[0012] A generating module, configured to generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path;

[0013] A sending module is used to send the first live broadcast data to the target terminal so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data. The three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0014] In a third aspect, the present disclosure provides a computer-readable medium having a computer program stored thereon, which implements the steps of the method described in the first aspect when the program is executed by a processing device.

[0015] In a fourth aspect, the present disclosure provides an electronic device, including:

[0016] a storage device having a computer program stored thereon;

[0017] A processing device is used to execute the computer program in the storage device to implement the steps of the method in the first aspect.

[0018] Through the above technical solution, by receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room, according to the information carried by the access request, the access path corresponding to the access request is determined, and based on the preset live broadcast room framework and the framework entity data corresponding to the access path, the first live broadcast data is generated, and the first live broadcast data is sent to the target terminal, so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, and the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene. Different from the traditional two-dimensional live broadcast room that displays the live broadcast picture in a two-dimensional manner, the embodiment of the present disclosure can create a panoramic scene and display the two-dimensional live broadcast picture in the created panoramic scene, thereby bringing an immersive viewing experience to the user, and the three-dimensional live broadcast room of the embodiment of the present disclosure adapts different framework entity data to generate live broadcast data for different access paths to support users to access through different access paths, thereby lowering the access threshold of the three-dimensional live broadcast room and increasing the applicable scenarios of the three-dimensional live broadcast room.

[0019] Other features and advantages of the present disclosure will be described in detail in the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale. In the drawings:

[0021] Figure 1 It is a schematic diagram of a display effect of a first live broadcast room according to an exemplary embodiment of the present disclosure.

[0022] Figure 2 The figure is a flowchart of a method for displaying live content according to an exemplary embodiment of the present disclosure.

[0023] Figure 3a It is a schematic diagram of the display effect of a second live broadcast room under a viewing angle according to an exemplary embodiment of the present disclosure.

[0024] Figure 3b It is a schematic diagram of the display effect of a second live broadcast room under another viewing angle according to an exemplary embodiment of the present disclosure.

[0025] Figure 3c It is a schematic diagram of the display effect of a second live broadcast room under another viewing angle according to an exemplary embodiment of the present disclosure.

[0026] Figure 4 The block diagram of a live content display device according to an exemplary embodiment of the present disclosure is shown.

[0027] Figure 5 It is a schematic structural diagram of an electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0028] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0029] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0030] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0031] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0032] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0033] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0034] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0035] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0036] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0037] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0038] At the same time, it is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0039] refer to Figure 1 , Figure 1 The figure shows a schematic diagram of the display effect of a traditional two-dimensional live broadcast room, that is, the current live broadcast room usually presents a left-right structure, that is, the live video is played on the left and the bullet screen is displayed on the right. It can be seen that the live broadcast display method of the live broadcast room in the related art is displayed in a flat form, which cannot create an immersive viewing experience. In addition, the live broadcast room in the related art only supports browser access, and the access form is single.

[0040] In view of this, the present disclosure provides a live broadcast method, device, storage medium and electronic device to provide users with an immersive viewing and interactive experience with multiple access paths, thereby improving the user's experience of watching live broadcasts.

[0041] Figure 2 is a flowchart of a method for displaying live content according to an exemplary embodiment of the present disclosure. The method for displaying live content can be applied to a server, referring to Figure 2 , the live content display method comprises the following steps:

[0042] S210, receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room.

[0043] In the disclosed embodiment, when watching a live broadcast, a user can choose to watch a 3D live broadcast room, which is different from a traditional 2D live broadcast room. Specifically, the user can send an access request for accessing the 3D live broadcast room to the server through a terminal, so as to watch the 3D live broadcast room. Through the 3D live broadcast room, the user can have an immersive interactive experience.

[0044] The user can enter the 3D live broadcast room by creating a new 3D live broadcast room, or join a 3D live broadcast room already created by other users. Optionally, when joining a 3D live broadcast room already created by other users, the server can authenticate the identity of the user joining the 3D live broadcast room, and after the identity authentication is successful, perform the subsequent steps S220-S240, that is, the user information carried by the access request can be verified first.

[0045] S220: Determine an access path corresponding to the access request according to the information carried in the access request.

[0046] In the disclosed embodiment, the access request may carry UA (User-Agent) information, so that the server can identify the hardware information and related models of the terminal used by the client based on the UA information carried in the access request, that is, identify the access path, as well as the terminal's operating system and version, CPU type, rendering engine, language, plug-in, etc.

[0047] Optionally, the access path corresponding to the access request may include access through a terminal browser and access through a virtual reality device. Since multiple access paths are supported to access the 3D live broadcast room, the access threshold of the 3D live broadcast room is lowered and the applicable scenarios of the 3D live broadcast room are increased. In addition, by adding a virtual reality device to access the 3D live broadcast room, the immersive viewing experience of users accessing the 3D live broadcast room is further improved.

[0048] In some implementations, in order to support access through a terminal browser and through a virtual reality device, the preset live studio framework can be built in three dimensions based on the online virtual reality webXR technology. Optionally, the aFrame framework can be used to perform layered rendering of the three-dimensional engine, wherein the model building and animation addition and debugging are implemented by blender. The aFrame framework is a web development framework for building virtual reality applications, and blender is a three-dimensional graphics software.

[0049] S230, generating first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path.

[0050] In the disclosed embodiment, the same live broadcast room framework can be pre-built on the server. For example, in some implementations, the built three-dimensional live broadcast room framework can include a panoramic scene layer, a two-dimensional live broadcast screen layer, and a three-dimensional interactive layer.

[0051] In the disclosed embodiment, the specific entities used in the live broadcast room framework may be different for different access paths, and the viewing angle display method and user operation habits of different access paths may be adapted. Therefore, after the server determines the access path corresponding to the access request, it can obtain the framework entity data corresponding to the access path. Thus, the server can further generate the first live broadcast data corresponding to the three-dimensional live broadcast room based on the pre-built live broadcast room framework and the framework entity data corresponding to the access path.

[0052] S240, sending the first live broadcast data to the target terminal, so that the target terminal renders and displays a three-dimensional live broadcast room according to the first live broadcast data, where the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0053] In the disclosed embodiment, after generating the first live broadcast data, the server can send the first live broadcast data to the target terminal, so that the target terminal can render and display the three-dimensional live broadcast room according to the first live broadcast data. Since the three-dimensional live broadcast room includes a panoramic scene, and a two-dimensional live broadcast picture is displayed in the panoramic scene, the function of displaying the original live broadcast content while constructing the three-dimensional live broadcast room is realized, that is, the original live broadcast content can be displayed in an immersive way.

[0054] In some embodiments, the displayed 2D live room screen may include a 2D live streaming screen or a 2D on-demand streaming screen. In addition, in other embodiments, the 2D live streaming screen may include a comment screen, a like, and a gift effect, etc. in addition to the 2D live streaming screen or the 2D on-demand streaming screen. The layout of the comment screen, the like, and the gift effect, etc. with the 2D live streaming screen or the 2D on-demand streaming screen may be the same as the layout of a traditional 2D live room.

[0055] In the above manner, by receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room, according to the information carried in the access request, the access path corresponding to the access request is determined, and based on the preset live broadcast room framework and the framework entity data corresponding to the access path, the first live broadcast data is generated, and the first live broadcast data is sent to the target terminal, so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, and the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene. Different from the traditional two-dimensional live broadcast room that displays the live picture in a two-dimensional manner, the embodiment of the present disclosure can create a panoramic scene and display the two-dimensional live broadcast picture in the created panoramic scene, thereby bringing an immersive viewing experience to the user, and the three-dimensional live broadcast room of the embodiment of the present disclosure adapts different framework entity data to generate live broadcast data for different access paths to support users to access through different access paths, thereby lowering the access threshold of the three-dimensional live broadcast room and increasing the applicable scenarios of the three-dimensional live broadcast room.

[0056] In some embodiments, the constructed live broadcast room framework includes a panoramic scene layer, a two-dimensional live broadcast screen layer, and a three-dimensional interactive layer. Based on the preset live broadcast room framework and the framework entity data corresponding to the access path, generating the first live broadcast data may include the following steps:

[0057] Generate first live broadcast data corresponding to the browser based on the panoramic scene layer data corresponding to the browser, the two-dimensional live broadcast picture layer data corresponding to the browser, and the three-dimensional interactive layer data corresponding to the browser;

[0058] Based on the panoramic scene layer data corresponding to the virtual reality device, the two-dimensional live picture layer data corresponding to the virtual reality device, and the three-dimensional interactive layer data corresponding to the virtual reality device, the first live data corresponding to the virtual reality device is generated.

[0059] In combination with the above content, it can be known that there may be different viewing angle display modes and user operation habits for browsers and virtual reality devices, and these differences may lead to differences in the live broadcast room frames corresponding to the browser and the virtual reality device. Therefore, in the embodiment of the present disclosure, corresponding to the browser access, there may be panoramic scene layer data corresponding to the browser, two-dimensional live screen layer data corresponding to the browser, and three-dimensional interactive layer data corresponding to the browser.

[0060] Thus, the server can generate the first live broadcast data corresponding to the browser based on the panoramic scene layer data corresponding to the browser, the two-dimensional live broadcast picture layer data corresponding to the browser, and the three-dimensional interactive layer data corresponding to the browser. Similarly, corresponding to the access through the virtual reality device, there may be panoramic scene layer data corresponding to the virtual reality device, two-dimensional live broadcast picture layer data corresponding to the virtual reality device, and three-dimensional interactive layer data corresponding to the virtual reality device. Thus, the server can generate the first live broadcast data corresponding to the virtual reality device based on the panoramic scene layer data corresponding to the virtual reality device, the two-dimensional live broadcast picture layer data corresponding to the virtual reality device, and the three-dimensional interactive layer data corresponding to the virtual reality device.

[0061] In some implementations, the panoramic scene layer data may be a static environment map or a panoramic video.

[0062] It can be understood that, considering that the same two-dimensional live broadcast picture is displayed to browser users and virtual reality device users, in some embodiments, the two-dimensional live broadcast picture layer data corresponding to the browser and can be the same data stream, that is, the two-dimensional live broadcast picture layer data corresponding to the browser and the two-dimensional live broadcast picture layer data corresponding to the virtual reality device can be the same.

[0063] In some embodiments, when the access path is through a browser, the three-dimensional interactive layer data is used by the target terminal to render and display a viewing angle auxiliary cursor in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the viewing angle auxiliary cursor is used to assist in viewing angle movement and assist in triggering interactive controls in the three-dimensional live broadcast room;

[0064] When the access method is through a virtual reality device, the three-dimensional interactive layer data is used by the target terminal to render and display the handle pointing pointer in the three-dimensional live broadcast room according to the three-dimensional interactive layer data. The handle pointing pointer is used to assist in triggering the interactive controls in the three-dimensional live broadcast room.

[0065] In the embodiments of the present disclosure, considering that the corresponding operation methods are different when accessed through a browser and when accessed through a virtual reality device, the corresponding three-dimensional interactive layer data may be different when accessed through a browser and when accessed through a virtual reality device.

[0066] Specifically, when accessed through a browser, the three-dimensional interactive layer data may include data for rendering and displaying a perspective auxiliary cursor in a three-dimensional live broadcast room, so that users accessing through a browser can use the perspective auxiliary cursor to assist in triggering interactive controls in the three-dimensional live broadcast room, and use the perspective auxiliary cursor to assist in perspective movement.

[0067] Specifically, corresponding to access through a virtual reality device, the three-dimensional interactive layer data may include data for rendering and displaying the handle pointing to a pointer in the three-dimensional live broadcast room, so that users accessing through the virtual reality device can use the handle pointing to the pointer to assist in triggering the interactive controls in the three-dimensional live broadcast room.

[0068] In addition, in order to render and display interactive controls in the 3D live studio, in some embodiments, the 3D interactive layer data also includes data for rendering and displaying interactive controls, so that the target terminal can render and display interactive controls in the 3D live studio according to the data for rendering and displaying interactive controls. In some embodiments, the interactive controls displayed in the browser and in the virtual reality device can be the same, so the data for rendering and displaying interactive controls corresponding to the browser and the data for rendering and displaying interactive controls corresponding to the virtual reality device can be the same.

[0069] In some implementations, when there are interactive controls in the three-dimensional live broadcast room, the live broadcast content display method of the embodiment of the present disclosure may further include the following steps:

[0070] In response to a request for triggering an interactive control in the three-dimensional live broadcast room initiated by any terminal accessing the three-dimensional live broadcast room, third live broadcast data corresponding to the access path is sent to each terminal accessing the three-dimensional live broadcast room, and the third live broadcast data is used by the corresponding terminal to render and display the screen after the interactive control is triggered in the three-dimensional live broadcast room.

[0071] In the disclosed embodiment, the three-dimensional live broadcast room can be rendered and displayed on the terminal of each user in the three-dimensional live broadcast room. The rendered and displayed three-dimensional live broadcast room includes a panoramic scene, a two-dimensional live broadcast picture displayed in the panoramic scene, and can also include interactive controls displayed in the panoramic scene. In this case, any user in the three-dimensional live broadcast room can initiate a request for triggering the interactive control in the three-dimensional live broadcast room to the server through the terminal used by himself, so that the server can respond to the request for triggering the interactive control in the three-dimensional live broadcast room and send the third live broadcast data corresponding to the access path to each terminal accessing the three-dimensional live broadcast room, so that each terminal in the three-dimensional live broadcast room renders and displays the picture after the interactive control is triggered in the three-dimensional live broadcast room. In other words, any user in the three-dimensional live broadcast room can interact through the interactive control, and the interaction situation is displayed on each user terminal.

[0072] In some embodiments, the third live broadcast data may be generated based on a preset live broadcast room framework and framework entity data corresponding to the access path.

[0073] In some embodiments, when the access path is through a browser, the request initiated to trigger the interactive controls in the three-dimensional live broadcast room can be triggered by manipulating the perspective auxiliary cursor in the aforementioned embodiment; when the access path is through a virtual reality device, the request initiated to trigger the interactive controls in the three-dimensional live broadcast room can be triggered by manipulating the handle pointing pointer in the aforementioned embodiment.

[0074] In some implementations, when the terminal accessed through the browser is a computer, a function of controlling the movement of the viewing angle through the keyboard can be added to perform spatial movement in the panoramic scene.

[0075] In some implementations, the interactive controls may include interactive controls for likes, interactive controls for controlling voice collection, and interactive controls for posting barrage comments.

[0076] Among them, after the interactive control for likes is triggered, the like effect can be displayed in the three-dimensional live broadcast room.

[0077] After the interactive control for controlling voice collection is triggered, the voice collection function of the corresponding user can be turned on or off in the three-dimensional live broadcast room. By adding the voice collection function, users in the three-dimensional live broadcast room can interact with each other in real time.

[0078] Among them, after the interactive control for posting barrage comments is triggered, the corresponding barrage comments can be displayed in the three-dimensional live broadcast room.

[0079] Please refer to Figure 3a , 3b 3c shows a schematic diagram of a three-dimensional live broadcast room under three viewing angles, expressing a panoramic scene through different viewing angles. Figure 3a , 3b As shown in 3c, a panoramic scene and a two-dimensional live screen 304 are displayed in the three-dimensional live broadcast room. In addition, the three-dimensional live broadcast room also displays an interactive control 301 for likes, an interactive control 302 for controlling voice collection, and an interactive control 303 for posting barrage comments.

[0080] In some implementations, the live content display method of the embodiment of the present disclosure may further include the following steps:

[0081] In response to a request for switching the panoramic scene initiated by any terminal accessing the 3D live broadcast room, second live broadcast data corresponding to the access path is sent to each terminal accessing the 3D live broadcast room, and the second live broadcast data is used by the corresponding terminal to render and display a new panoramic scene in the 3D live broadcast room.

[0082] In the disclosed embodiment, in order to provide a diverse immersive viewing experience, after opening the 3D live broadcast room, the user can switch the panoramic scene displayed in the 3D live broadcast room to render and display a new panoramic scene. In this case, any user in the 3D live broadcast room can initiate a request to switch the panoramic scene to the server through the terminal used by the user, so that the server can respond to the request to switch the panoramic scene and send the second live broadcast data corresponding to the access path to each terminal accessing the 3D live broadcast room, so that each terminal in the 3D live broadcast room can render and display the new panoramic scene in the 3D live broadcast room. In other words, any user in the 3D live broadcast room can switch the panoramic scene and display the switched panoramic scene on each user terminal.

[0083] In some embodiments, the second live broadcast data may be generated based on a preset live broadcast room framework and framework entity data corresponding to the access path. The framework entity data corresponding to the access path includes new panoramic scene layer data corresponding to the browser and new panoramic scene layer data corresponding to the virtual reality device. In addition, if the two-dimensional live screen layer data and the three-dimensional interactive layer data are both real-time data streams, the framework entity data corresponding to the access path also includes two-dimensional live screen layer data corresponding to the browser and two-dimensional live screen layer data corresponding to the virtual reality device, and includes two-dimensional live screen layer data corresponding to the browser and two-dimensional live screen layer data corresponding to the virtual reality device.

[0084] In some implementations, the three-dimensional live broadcast room rendered and displayed by the target terminal includes virtual objects corresponding to each user entering the three-dimensional live broadcast room. In this case, the live broadcast content display method of the embodiment of the present disclosure may further include the following steps:

[0085] In response to a request initiated by the target terminal for clicking on any virtual object, fourth live broadcast data corresponding to its access path is sent to the target terminal, and the fourth live broadcast data is used by the target terminal to render and display the clicked virtual object in the three-dimensional live broadcast room to perform a preset action.

[0086] In the disclosed embodiment, the three-dimensional live broadcast room can be rendered and displayed on the terminal of each user in the three-dimensional live broadcast room. The rendered and displayed three-dimensional live broadcast room includes a panoramic scene, a two-dimensional live broadcast screen displayed in the panoramic scene, and can also include virtual objects corresponding to each user entering the three-dimensional live broadcast room. In this case, any user in the three-dimensional live broadcast room can initiate a request for clicking on any virtual object to the server through the terminal used by himself, so that the server can respond to the request for clicking on any virtual object and send the fourth live broadcast data corresponding to its access path to each terminal accessing the three-dimensional live broadcast room, so that each terminal in the three-dimensional live broadcast room renders and displays the clicked virtual object in the three-dimensional live broadcast room to perform a preset action. In other words, any user in the three-dimensional live broadcast room can click on the virtual object in the three-dimensional live broadcast room, thereby controlling the clicked virtual object to perform a preset action. By setting virtual objects and interacting with virtual objects, the immersive viewing experience of users in the three-dimensional live broadcast room can be further deepened.

[0087] In some embodiments, the preset action performed by the virtual object may be a turning-back action of the virtual object. Optionally, after the turning-back action is performed, identification information of the corresponding user may be displayed above the turning-back virtual object.

[0088] In addition, the 3D live broadcast room of the embodiment of the present disclosure may be a small private live broadcast room, so that some users cannot enter the 3D live broadcast room, for example, they cannot enter the 3D live broadcast room due to the number of people in the second live broadcast room. Therefore, in order to enable users outside the 3D live broadcast room to have an immersive viewing experience, in some embodiments, the live broadcast content display method of the embodiment of the present disclosure may also include the following steps:

[0089] The 3D live broadcast room picture rendered and displayed by the target terminal is collected, and the 3D live broadcast room picture is used for playback by users outside the 3D live broadcast room.

[0090] In the disclosed embodiment, each terminal can record and capture the 3D live broadcast room picture rendered and displayed by itself, and send it to the server. Therefore, the server can push the 3D live broadcast room picture to users outside the 3D live broadcast room, so that users outside the 3D live broadcast room can choose to watch the 3D live broadcast room picture displayed by any terminal, so that users outside the 3D live broadcast room can also have the live broadcast effect from the perspective of users in the 3D live broadcast room, so that more users can achieve an immersive viewing experience.

[0091] It should be noted that Figure 1 , Figure 3a , Figure 3b as well as Figure 3c The unclear text in the text does not affect the understanding of the relevant technical solutions provided by the embodiments of the present disclosure by those skilled in the art.

[0092] Figure 4 is a block diagram of a live content display device according to an exemplary embodiment of the present disclosure, referring to Figure 4 , the live content display device 400 includes:

[0093] The receiving module 410 is used to receive an access request initiated by a target terminal for accessing a three-dimensional live broadcast room;

[0094] A determination module 420, configured to determine an access path corresponding to the access request according to information carried in the access request;

[0095] A generating module 430, configured to generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path;

[0096] The sending module 440 is used to send the first live broadcast data to the target terminal so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data. The three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0097] Optionally, the access path includes accessing through a browser and accessing through a virtual reality device.

[0098] Optionally, the live broadcast room framework includes a panoramic scene layer, a two-dimensional live broadcast screen layer and a three-dimensional interactive layer, and the generation module 430 includes:

[0099] A first generating submodule, for generating first live broadcast data corresponding to the browser based on the panoramic scene layer data corresponding to the browser, the two-dimensional live broadcast picture layer data corresponding to the browser, and the three-dimensional interactive layer data corresponding to the browser;

[0100] The second generating submodule is used to generate first live broadcast data corresponding to the virtual reality device based on the panoramic scene layer data corresponding to the virtual reality device, the two-dimensional live broadcast picture layer data corresponding to the virtual reality device, and the three-dimensional interactive layer data corresponding to the virtual reality device.

[0101] Optionally, when the access path is access through a browser, the three-dimensional interactive layer data is used by the target terminal to render and display a viewing angle auxiliary cursor in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the viewing angle auxiliary cursor is used to assist viewing angle movement and assist in triggering interactive controls in the three-dimensional live broadcast room;

[0102] When the access method is through a virtual reality device, the three-dimensional interactive layer data is used by the target terminal to render and display the handle pointing to a pointer in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the handle pointing to a pointer is used to assist in triggering the interactive controls in the three-dimensional live broadcast room.

[0103] Optionally, the apparatus 400 further includes:

[0104] The first response module is used to respond to a request for switching the panoramic scene initiated by any terminal accessing the three-dimensional live broadcast room, and send second live broadcast data corresponding to its access path to each terminal accessing the three-dimensional live broadcast room, and the second live broadcast data is used by the corresponding terminal to render and display a new panoramic scene in the three-dimensional live broadcast room.

[0105] Optionally, the apparatus 400 further includes:

[0106] The second response module is used to respond to a request initiated by any terminal accessing the three-dimensional live broadcast room to trigger an interactive control in the three-dimensional live broadcast room, and send third live broadcast data corresponding to the access path to each terminal accessing the three-dimensional live broadcast room, and the third live broadcast data is used by the corresponding terminal to render and display the screen after the interactive control is triggered in the three-dimensional live broadcast room.

[0107] Optionally, the three-dimensional live broadcast room rendered and displayed by the target terminal includes virtual objects corresponding to each user entering the three-dimensional live broadcast room, and the device 400 further includes:

[0108] The third response module is used to respond to a request initiated by the target terminal for clicking on any of the virtual objects, and send fourth live broadcast data corresponding to its access path to the target terminal, and the fourth live broadcast data is used by the target terminal to render and display the clicked virtual object in the three-dimensional live broadcast room to perform a preset action.

[0109] Reference below Figure 5 , which shows a schematic diagram of the structure of an electronic device 500 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to a mobile phone, a tablet computer, a notebook, and a virtual reality device. Figure 5 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0110] like Figure 5As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0111] Typically, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 5 The electronic device 500 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0112] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0113] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0114] In some embodiments, the electronic device can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0115] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0116] The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device: receives an access request initiated by a target terminal for accessing a three-dimensional live broadcast room; determines an access path corresponding to the access request according to information carried by the access request; generates first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path; and sends the first live broadcast data to the target terminal so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, wherein the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0117] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0118] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0119] The modules involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a module does not, in some cases, limit the module itself.

[0120] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0121] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0122] According to one or more embodiments of the present disclosure, Example 1 provides a method for displaying live content, the method comprising:

[0123] Receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room;

[0124] Determine, according to the information carried in the access request, an access path corresponding to the access request;

[0125] Generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path;

[0126] The first live broadcast data is sent to the target terminal, so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, and the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0127] According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, wherein the access path includes accessing through a browser and accessing through a virtual reality device.

[0128] According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 2, wherein the live broadcast room framework includes a panoramic scene layer, a two-dimensional live broadcast screen layer, and a three-dimensional interactive layer, and the first live broadcast data is generated based on the preset live broadcast room framework and the framework entity data corresponding to the access path, including:

[0129] Generate first live broadcast data corresponding to the browser based on the panoramic scene layer data corresponding to the browser, the two-dimensional live broadcast picture layer data corresponding to the browser, and the three-dimensional interactive layer data corresponding to the browser;

[0130] Based on the panoramic scene layer data corresponding to the virtual reality device, the two-dimensional live picture layer data corresponding to the virtual reality device, and the three-dimensional interactive layer data corresponding to the virtual reality device, first live data corresponding to the virtual reality device is generated.

[0131] According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 3, wherein when the access path is access through a browser, the three-dimensional interactive layer data is used by the target terminal to render and display a viewing angle auxiliary cursor in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the viewing angle auxiliary cursor is used to assist viewing angle movement and assist in triggering interactive controls in the three-dimensional live broadcast room;

[0132] When the access method is through a virtual reality device, the three-dimensional interactive layer data is used by the target terminal to render and display the handle pointing to a pointer in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the handle pointing to a pointer is used to assist in triggering the interactive controls in the three-dimensional live broadcast room.

[0133] According to one or more embodiments of the present disclosure, Example 5 provides the method of Example 1, wherein the method further includes:

[0134] In response to a request for switching the panoramic scene initiated by any terminal accessing the three-dimensional live broadcast room, second live broadcast data corresponding to the access path is sent to each terminal accessing the three-dimensional live broadcast room, and the second live broadcast data is used by the corresponding terminal to render and display a new panoramic scene in the three-dimensional live broadcast room.

[0135] According to one or more embodiments of the present disclosure, Example 6 provides the method of Example 1, wherein the method further includes:

[0136] In response to a request for triggering an interactive control in the three-dimensional live broadcast room initiated by any terminal accessing the three-dimensional live broadcast room, third live broadcast data corresponding to the access path is sent to each terminal accessing the three-dimensional live broadcast room, and the third live broadcast data is used by the corresponding terminal to render and display the screen after the interactive control is triggered in the three-dimensional live broadcast room.

[0137] According to one or more embodiments of the present disclosure, Example 7 provides the method of Example 1, wherein the three-dimensional live broadcast room rendered and displayed by the target terminal includes virtual objects corresponding to each user entering the three-dimensional live broadcast room, and the method further includes:

[0138] In response to a request initiated by the target terminal for clicking on any of the virtual objects, fourth live broadcast data corresponding to its access path is sent to the target terminal, and the fourth live broadcast data is used by the target terminal to render and display the clicked virtual object in the three-dimensional live broadcast room to perform a preset action.

[0139] According to one or more embodiments of the present disclosure, Example 8 provides a live content display device, the device comprising:

[0140] A receiving module, used for receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room;

[0141] A determination module, configured to determine an access path corresponding to the access request according to information carried in the access request;

[0142] A generating module, configured to generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path;

[0143] A sending module is used to send the first live broadcast data to the target terminal so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data. The three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene.

[0144] According to one or more embodiments of the present disclosure, Example 9 provides a computer-readable medium having a computer program stored thereon, which implements the steps of any of the methods described in Examples 1-7 when executed by a processing device.

[0145] According to one or more embodiments of the present disclosure, Example 10 provides an electronic device, including:

[0146] a storage device having a computer program stored thereon;

[0147] A processing device is used to execute the computer program in the storage device to implement the steps of any one of the methods described in Examples 1-7.

[0148] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0149] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0150] Although the subject matter has been described in language specific to structural features and / or method logic actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims. Regarding the device in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Claims

1. A method for displaying live content, characterized in that: The method comprises: Receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room; Determine, according to the information carried in the access request, an access path corresponding to the access request; Generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path; The first live broadcast data is sent to the target terminal, so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, wherein the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene, and each target terminal in the three-dimensional live broadcast room can move the viewing angle in the three-dimensional live broadcast room; Receive the 3D live broadcast room pictures rendered and displayed by the target terminals collected by each target terminal entering the 3D live broadcast room, and push the 3D live broadcast room pictures to users outside the 3D live broadcast room for playback, so that the users outside the 3D live broadcast room can choose to watch the 3D live broadcast room pictures displayed by any target terminal.

2. The method according to claim 1, characterized in that The access methods include access through a browser and access through a virtual reality device.

3. The method according to claim 2, characterized in that The live broadcast room framework includes a panoramic scene layer, a two-dimensional live broadcast picture layer and a three-dimensional interactive layer. The first live broadcast data is generated based on the preset live broadcast room framework and the framework entity data corresponding to the access path, including: Generate first live broadcast data corresponding to the browser based on the panoramic scene layer data corresponding to the browser, the two-dimensional live broadcast picture layer data corresponding to the browser, and the three-dimensional interactive layer data corresponding to the browser; Based on the panoramic scene layer data corresponding to the virtual reality device, the two-dimensional live picture layer data corresponding to the virtual reality device, and the three-dimensional interactive layer data corresponding to the virtual reality device, first live data corresponding to the virtual reality device is generated.

4. The method according to claim 3, characterized in that When the access path is access through a browser, the three-dimensional interactive layer data is used by the target terminal to render and display a viewing angle auxiliary cursor in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the viewing angle auxiliary cursor is used to assist in viewing angle movement and assist in triggering interactive controls in the three-dimensional live broadcast room; When the access method is through a virtual reality device, the three-dimensional interactive layer data is used by the target terminal to render and display the handle pointing to a pointer in the three-dimensional live broadcast room according to the three-dimensional interactive layer data, and the handle pointing to a pointer is used to assist in triggering the interactive controls in the three-dimensional live broadcast room.

5. The method according to claim 1, characterized in that The method further comprises: In response to a request for switching the panoramic scene initiated by any terminal accessing the three-dimensional live broadcast room, second live broadcast data corresponding to the access path is sent to each terminal accessing the three-dimensional live broadcast room, and the second live broadcast data is used by the corresponding terminal to render and display a new panoramic scene in the three-dimensional live broadcast room.

6. The method according to claim 1, characterized in that The method further comprises: In response to a request for triggering an interactive control in the three-dimensional live broadcast room initiated by any terminal accessing the three-dimensional live broadcast room, third live broadcast data corresponding to the access path is sent to each terminal accessing the three-dimensional live broadcast room, and the third live broadcast data is used by the corresponding terminal to render and display the screen after the interactive control is triggered in the three-dimensional live broadcast room.

7. The method according to claim 1, characterized in that The three-dimensional live broadcast room rendered and displayed by the target terminal includes virtual objects corresponding to each user entering the three-dimensional live broadcast room, and the method further includes: In response to a request initiated by the target terminal for clicking on any of the virtual objects, fourth live broadcast data corresponding to its access path is sent to the target terminal, and the fourth live broadcast data is used by the target terminal to render and display the clicked virtual object in the three-dimensional live broadcast room to perform a preset action.

8. A live content display device, characterized in that: The device comprises: A receiving module, used for receiving an access request initiated by a target terminal for accessing a three-dimensional live broadcast room; A determination module, configured to determine an access path corresponding to the access request according to information carried in the access request; A generating module, configured to generate first live broadcast data based on a preset live broadcast room framework and framework entity data corresponding to the access path; a sending module, configured to send the first live broadcast data to the target terminal, so that the target terminal renders and displays the three-dimensional live broadcast room according to the first live broadcast data, wherein the three-dimensional live broadcast room includes a panoramic scene and a two-dimensional live broadcast picture displayed in the panoramic scene, and each target terminal in the three-dimensional live broadcast room can move the viewing angle in the three-dimensional live broadcast room; The receiving module is also used to receive the 3D live broadcast room pictures rendered and displayed by the target terminals collected by each target terminal entering the 3D live broadcast room. The 3D live broadcast room pictures are used to push to users outside the 3D live broadcast room for playback, so that the users outside the 3D live broadcast room can choose to watch the 3D live broadcast room pictures displayed by any target terminal.

9. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processing device, the steps of the method described in any one of claims 1 to 7 are implemented.

10. An electronic device, characterized in that: include: a storage device having a computer program stored thereon; A processing device, configured to execute the computer program in the storage device to implement the steps of the method according to any one of claims 1 to 7.

Images