3D rendering method, device, terminal and medium based on live broadcast scene

Abstract

The present invention provides a 3D rendering method, system, terminal and computer storage medium based on a live broadcast scene; wherein the method comprises: in response to a trigger instruction of a live broadcast gift giving, obtaining the current user perspective of the user terminal; based on the gift identifier in the trigger instruction, selecting corresponding gift data in a virtual gift set; detecting whether the gift data is 2D data, if so, superimposing and displaying the gift data with the live broadcast data stream at a forward perspective, if not, superimposing and displaying the gift data with the live broadcast data stream at the current gift perspective; the present invention can realize adaptive 3D rendering display of 2D data under different user perspectives, effectively saving the manufacturing cost of 3D gift data, and reducing the occupation of network and content resources by gift data during the live broadcast, thereby improving the user's live broadcast experience.

Description

Technical Field

[0001] The present invention relates to the field of Internet technology, and in particular to a 3D rendering method, device, terminal and computer storage medium based on a live broadcast scene. Background Art

[0002] In order to enhance the interactivity between the host and the audience, there is usually a gift-giving and gift-receiving session during the live broadcast, that is, the audience gives the selected virtual gifts to the host, and the gift-giving process is displayed on the audience side and the host side so that both the audience and the host can see the gift-giving process.

[0003] At present, in order to improve the user experience in live broadcasting, more and more live broadcasting platforms have begun to provide virtual or virtual-real live broadcasting services. By adopting 3D live broadcasting scenes and virtual anchors, an immersive user live broadcasting experience is achieved. The gift data in the live broadcasting also needs to be displayed with a 3D rendering effect. Based on this, the existing processing method is usually to design each gift data into a three-dimensional data format. This method often requires a lot of time and energy to produce the corresponding three-dimensional data, which increases the operating cost of the live broadcasting platform. Moreover, the gift files produced in the three-dimensional data format are often large in size and will occupy a large amount of network traffic and memory resources during the live broadcasting process. In addition, for the two-dimensional gift images (2D) already on the platform, if the two-dimensional data needs to be converted into three-dimensional data, a lot of manpower and economic costs will be consumed. Summary of the Invention

[0004] In view of the shortcomings of the prior art described above, the purpose of the present invention is to provide a 3D rendering method, system, terminal and medium based on a live broadcast scene, which is used to solve the problems of insufficient utilization of existing 2D gift data in the existing live broadcast gift-giving process, resulting in high production costs of 3D gift data and large network traffic and memory resources occupied during use.

[0005] In order to solve the above technical problems, the present invention provides a 3D rendering method based on a live broadcast scene in a first aspect, which is applicable to a user terminal, and the method includes: in response to a trigger instruction of a live broadcast gift giving, obtaining the current user perspective of the user terminal; wherein the trigger instruction includes a gift identifier; based on the gift identifier, selecting corresponding gift data in a virtual gift set; the virtual gift set is a collection of pre-stored gift data; each gift data is associated with the gift identifier; detecting whether the gift data is 2D data, if so, the gift data is superimposed and displayed with the live broadcast data stream in a forward perspective, if not, the gift data is superimposed and displayed with the live broadcast data stream in the current gift perspective; wherein the current gift perspective is the angle at which the user terminal views the gift data when the gift data is displayed in the current live broadcast scene; the current live broadcast scene is the live broadcast scene data displayed under the current user perspective.

[0006] In an embodiment of the first aspect, a perspective collector is provided in the user terminal, and the method for obtaining the user perspective includes: based on the trigger instruction of live gift giving, using the perspective collector to collect the current user perspective information of the user terminal.

[0007] In an embodiment of the first aspect, the method for obtaining the current gift perspective includes: determining the current gift perspective of the gift data based on the current user perspective, the initial scene perspective and the initial gift perspective; wherein, the initial scene perspective is the perspective corresponding to the scene displayed when the live scene data is first loaded in the user terminal; the initial gift perspective is the perspective corresponding to the gift displayed when the gift data is loaded in the live scene.

[0008] Furthermore, the method for obtaining the current gift perspective includes: determining the current scene perspective of the live broadcast scene on the user side based on the initial scene perspective of the live broadcast scene data and the current user perspective; and determining the current gift perspective of the gift data on the user side based on the current scene perspective and the initial gift perspective of the gift data.

[0009] In an embodiment of the first aspect, the implementation method of detecting whether the gift data is 2D data includes: obtaining type information of the gift data, and determining whether the current gift data is 2D data or 3D data based on the type information; or detecting whether there is corresponding data for the gift data under the current gift perspective, and if so, determining that the gift data is 3D data, and if not, determining that the gift data is 2D data.

[0010] In an embodiment of the first aspect, after obtaining the current user perspective of the user terminal, the method further includes: sending the current user perspective to the anchor terminal to return live broadcast data corresponding to the user perspective.

[0011] In an embodiment of the first aspect, the 2D data includes a pre-constructed picture or animation with a perspective effect.

[0012] In a second aspect, the present invention provides a terminal comprising: a processor and a memory, wherein the memory is communicatively connected to the processor; the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the terminal executes the 3D rendering method based on the live broadcast scene as described above.

[0013] In a third aspect, the present invention provides a computer storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the above-mentioned 3D rendering method based on a live broadcast scene.

[0014] As described above, the 3D rendering method, device, terminal and computer storage medium based on the live broadcast scene provided by the present invention obtain the user perspective of the user terminal during the live broadcast of gift giving to determine the current gift perspective of the gift data based on the user perspective; by detecting whether the gift data is 2D data, different display perspectives are used for rendering and display, that is, when the gift data is 2D data, the forward perspective containing the gift information is used for rendering and display, thereby realizing adaptive 3D rendering and display of 2D data under different user perspectives, which not only improves the utilization rate of 2D gift data in the live broadcast scene, but also effectively saves the manufacturing cost of 3D gift data, reduces the occupation of network and content resources by gift data during the live broadcast, and greatly improves the user's live broadcast experience.

[0015] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present invention. The purposes and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 The figure shows the 3D rendering effect of a 2D image in the present invention under a forward viewing angle;

[0017] Figure 2 FIG2 is a flow chart of a 3D rendering method based on a live broadcast scene according to an embodiment of the present invention;

[0018] Figure 3FIG. 1 is a flow chart of step S300 in an embodiment of the present invention;

[0019] Figure 4 FIG2 is a flow chart of another embodiment of the 3D rendering method based on a live broadcast scene according to the present invention;

[0020] Figure 5 FIG2 is a schematic structural diagram of a terminal according to an embodiment of the present invention. DETAILED DESCRIPTION

[0021] The following describes the embodiments of the present invention through specific examples. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments. The details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other unless they conflict.

[0022] It should be noted that the illustrations provided in the following embodiments are merely schematic illustrations of the basic concept of the present invention. Therefore, the illustrations only show components related to the present invention and are not drawn according to the number, shape, and size of components in actual implementation. In actual implementation, the type, quantity, and proportion of each component may be changed arbitrarily, and the component layout may also be more complex.

[0023] It should also be noted that if the embodiments of the present invention include descriptions of "first," "second," etc., these descriptions are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of the technical features indicated. Therefore, features specified as "first" or "second" may explicitly or implicitly include at least one of these features.

[0024] To facilitate the explanation and understanding of the technical content of this application, the following names in this application are explained, including:

[0025] Forward viewing angle: the viewing angle from the forward direction of the object, facing the object;

[0026] Left perspective: the perspective from the left side of the object, facing the object;

[0027] Right perspective: the perspective from the right side of the object, facing the object;

[0028] Backward perspective: the perspective from the back of the object, looking towards the object.

[0029] In order to solve the technical problems existing in the prior art, the present invention provides a gift rendering method, device, terminal and computer storage medium based on a live broadcast scene, which is applicable to each user terminal, so as to realize adaptive 3D rendering display of 2D gift data when the user terminal sends gifts to the anchor terminal during live broadcast; wherein, the 2D data is a pre-constructed picture or animation with a perspective effect; the adaptive 3D rendering display is based on different user perspectives of the user terminal, and can achieve a naked-eye 3D rendering effect.

[0030] In one embodiment, the adaptive 3D rendering displays Figure 1 As shown, it shows a 3D rendering effect of a 2D image (ring gift box) in a forward perspective.

[0031] See also Figure 2 , showing a flow chart of the gift rendering method based on the live broadcast scenario provided in an embodiment of the present invention.

[0032] like Figure 2 As shown, the method includes the following steps:

[0033] S100, in response to a trigger instruction for live gift giving, obtaining a current user perspective of a user terminal;

[0034] The user perspective is the perspective from which the user watches the live broadcast scene;

[0035] Specifically, the live broadcast platform is provided with a perspective collector in the user terminal, and based on the trigger instruction of the live broadcast gift giving, the perspective collector is used to collect the current user perspective information of the user terminal.

[0036] S200, extracting a gift identifier from the trigger instruction; and selecting corresponding gift data from a virtual gift set based on the gift identifier;

[0037] Among them, the virtual gift set is a collection of pre-stored gift data; the gift data is data for rendering and displaying live gifts, including 2D data and 3D data; each gift data is associated with the gift identifier, so that based on the gift identifier, the gift data corresponding to the gift identifier can be retrieved.

[0038] Specifically, after receiving the gift-giving trigger instruction, each user terminal extracts the gift identifier in the instruction; based on the gift identifier, the virtual gift set of the client is retrieved to obtain the corresponding gift data in the virtual gift set.

[0039] Optionally, each gift data is provided with a corresponding rendering time, i.e., the duration of the gift giving process; in other embodiments, when executing step S200, further comprising:

[0040] Based on the gift identifier, a rendering time of the gift data is determined.

[0041] S300, detecting whether the gift data is 2D data, if so, superimposing the gift data with the live data stream at a forward perspective, if not, superimposing the gift data with the live data stream at a current gift perspective.

[0042] Among them, the current gift perspective is the angle at which the user terminal views the gift data when the gift data is displayed in the current live broadcast scene; the current live broadcast scene is the scene information displayed from the current user perspective.

[0043] In this embodiment, when step S300 is executed, Figure 3 As shown, including:

[0044] S301, determining a current gift perspective of the gift data based on the current user perspective, the initial scene perspective, and the initial gift perspective;

[0045] Among them, the initial scene perspective is the perspective corresponding to the scene displayed when the live scene data is first loaded in the user terminal; the initial gift perspective is the perspective corresponding to the gift displayed when the gift data is loaded in the live scene.

[0046] Specifically, based on the initial scene perspective of the live scene data and the current user perspective, the current scene perspective of the live scene in the user end is determined; based on the current scene perspective and the initial gift perspective of the gift data, the current gift perspective of the gift data in the user end is determined.

[0047] In a specific embodiment, when the initial scene display perspective of the live broadcast scene on the user side is a backward perspective and the current user perspective is a left perspective, the scene display perspective of the live broadcast scene on the user side is determined to be a right perspective; when the initial gift perspective of the gift data in the live broadcast scene is a forward perspective, combined with the scene display perspective being a right perspective, the gift perspective of the gift data on the user side is determined to be a right perspective.

[0048] S302, detecting whether the gift data is 2D data, if so, setting the 2D data corresponding to the gift data in the forward viewing angle as the current rendering data; if not, setting the data of the gift data in the current gift viewing angle as the current rendering data;

[0049] Specifically, obtaining type information of the gift data, and determining whether the current gift data is 2D data or 3D data according to the type information;

[0050] When it is detected that the current gift data is 2D data, the picture / animation of the gift data at the normal viewing angle is used as the current rendering data; when it is detected that the current gift data is 3D data, the picture / animation of the gift data at the current gift viewing angle is obtained as the current rendering data.

[0051] In another embodiment, the method of detecting whether the gift data is 2D data also includes: detecting whether there is corresponding data for the gift data under the current gift viewing angle; if so, determining that the gift data is 3D data; if not, determining that the gift data is 2D data.

[0052] It should be noted that for each of the gift data, 3D data storage methods are used for storage, that is, for gift data in 2D data format, 3D data storage methods are also used for storage, and 2D pictures or animations are all stored as pictures or animations under a forward perspective.

[0053] S303, superimposing and displaying the current rendering data of the gift data and the live broadcast data stream received within the rendering time period.

[0054] Specifically, a gift display area is pre-set in the live broadcast interface; the current rendering data is displayed in the display area within the rendering time period; and the live broadcast data stream received within the rendering time is synchronously displayed, so that the user end can superimpose the 3D rendering effect of the gift data while broadcasting live.

[0055] In order to solve the technical problems existing in the prior art, the embodiment of the present invention also provides another gift rendering method for a live broadcast scene; Figure 4 As shown, in this embodiment, the method is Figure 2 The method shown is basically the same, except that when executing step S100, the method is:

[0056] S100', in response to a trigger instruction for live gift giving, obtaining a current user perspective of the user terminal; sending the current user perspective to the host terminal, so as to return live broadcast data corresponding to the current user perspective;

[0057] Specifically, after obtaining the current user perspective, the user end sends the user perspective information to the anchor end. After receiving the user perspective information, the anchor end obtains the live broadcast data under the user perspective and returns the live broadcast data, thereby making the display perspective of the live broadcast scene compatible with the observation perspective of the user end, improving the coordination between the live broadcast gift and the surrounding scene, and further enhancing the user's live broadcast experience.

[0058] In a specific embodiment, the live broadcast data is a video stream data, including live broadcast scene information and anchor information collected in each frame of video.

[0059] In order to solve the technical problems existing in the prior art, an embodiment of the present invention further provides a terminal. Please refer to 5, which shows a schematic diagram of the structure of the terminal of the present invention; Figure 5 As shown, the terminal 6 includes a memory 61 and a processor 62 connected to each other; the memory 61 is used to store computer programs, and the processor 62 is used to execute the computer programs stored in the memory, so that when the terminal executes, it can implement any of the steps in the 3D rendering method based on the live scene as described above.

[0060] Optionally, the number of the memories may be one or more, and the number of the processors may be one or more.

[0061] Optionally, the processor in the terminal follows the Figure 2 The steps in the 3D rendering method based on the live broadcast scene shown are to load one or more instructions corresponding to the application process into the memory, and the processor runs the application stored in the memory, thereby realizing the various functions in the 3D rendering method based on the live broadcast scene, which will not be repeated here.

[0062] It should be noted that the memory includes, but is not limited to, random access memory (RAM), and may also include non-volatile memory (NVM), such as at least one disk storage. Similarly, the processor may also be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0063] In addition, the present invention also provides a computer-readable storage medium on which a computer program is stored. When the program is called by a processor, each step in the 3D rendering method of the live broadcast scene as described above is implemented.

[0064] Among them, a computer-readable storage medium can be a tangible device that can hold and store instructions used by an instruction execution device. The computer-readable storage medium can be, for example, (but not limited to) an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, and a mechanical encoding device.

[0065] The computer-readable program described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.

[0066] In summary, the 3D rendering method, device, terminal and computer storage medium based on the live broadcast scene provided by the present invention obtain the user perspective of the user terminal during the live broadcast of gift giving, so as to determine the current gift perspective of the gift data based on the user perspective; by detecting the gift data, when it is detected that the gift data is 2D data, the gift data is superimposed and displayed with the live broadcast data stream at a forward perspective; when it is detected that the gift data is 3D data, the gift data is superimposed and displayed with the live broadcast data stream at the current gift perspective, thereby realizing 3D gift data rendering and display while also realizing adaptive 3D rendering and display of 2D data under different user perspectives, which not only improves the utilization rate of 2D gift data in the live broadcast scene, but also effectively saves the manufacturing cost of 3D gift data, reduces the occupation of network and content resources by gift data during the live broadcast, and greatly improves the user's live broadcast experience.

[0067] Although the embodiments disclosed herein are as described above, the contents described herein are merely embodiments for facilitating understanding of the present invention and are not intended to limit the present invention. Any person skilled in the art may make any modifications and variations in the form and details of the embodiments without departing from the spirit and scope of the present invention. However, the scope of protection of the present invention shall remain subject to the scope defined by the appended claims.

Claims

1. A 3D rendering method based on a live broadcast scene, characterized in that: Applicable to a user terminal, the method includes: In response to a trigger instruction for live gift giving, obtaining a current user perspective of the user terminal; wherein the trigger instruction includes a gift identifier; Based on the gift identifier, corresponding gift data is selected from a virtual gift set; the virtual gift set is a collection of pre-stored gift data; each gift data is associated with the gift identifier; Detect whether the gift data is 2D data. If so, display the gift data in a superimposed manner with the live data stream at a forward viewing angle. If not, display the gift data in a superimposed manner with the live data stream at a current gift viewing angle. The method for obtaining the current gift perspective includes: Determine the current gift perspective of the gift data based on the current user perspective, the initial scene perspective, and the initial gift perspective; wherein the initial scene perspective is the perspective corresponding to the scene displayed when the live scene data is first loaded in the user terminal; the initial gift perspective is the perspective corresponding to the gift displayed when the gift data is loaded in the live scene; Determining a current scene perspective of the live scene at a user terminal according to the initial scene perspective of the live scene data and the current user perspective; Determine the current gift perspective of the gift data in the user terminal based on the current scene perspective and the initial gift perspective of the gift data; Among them, the current gift perspective is the angle at which the user terminal views the gift data when the gift data is displayed in the current live broadcast scene; the current live broadcast scene is the live broadcast scene data displayed from the current user perspective.

2. The 3D rendering method based on a live broadcast scene according to claim 1, characterized in that: The user terminal is provided with a perspective collector, and the method for obtaining the user perspective includes: Based on the trigger instruction of the live broadcast gift giving, the perspective collector is used to collect the current user perspective information of the user terminal.

3. The 3D rendering method based on a live broadcast scene according to claim 1, characterized in that: The method for detecting whether the gift data is 2D data includes: Obtaining type information of the gift data, and determining whether the current gift data is 2D data or 3D data according to the type information; or Detect whether there is corresponding data for the gift data under the current gift viewing angle. If so, determine that the gift data is 3D data; if not, determine that the gift data is 2D data.

4. The 3D rendering method based on a live broadcast scene according to claim 1, characterized in that: After obtaining the current user perspective of the user terminal, the method further includes: The current user perspective is sent to the anchor end to return the live broadcast data corresponding to the user perspective.

5. The 3D rendering method based on live broadcast scene according to claim 1, characterized in that: The 2D data includes pre-built pictures or animations with perspective effects.

6. A terminal, characterized in that: include: a processor and a memory, wherein the memory is communicatively connected to the processor; The memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the terminal performs the 3D rendering method based on a live broadcast scene as described in any one of claims 1 to 5.

7. A computer storage medium storing a computer program, wherein: When the computer program is executed by a processor, the 3D rendering method based on a live broadcast scene as described in any one of claims 1 to 5 is implemented.

Images