Live broadcast display method and device

Abstract

The embodiment of the invention provides a live broadcast display method, and the method comprises the steps: displaying a virtual live broadcast room interface in a three-dimensional space, and enabling the virtual live broadcast room interface to comprise a 3D browsing control; in response to the selected 3D browsing control, determining a target material and obtaining a 3D model file corresponding to the target material; and generating a 3D model of the target material based on the 3D model file, and controlling the 3D model of the target material to gradually emerge from the virtual live broadcast room interface to the three-dimensional space. According to the technical scheme provided by the embodiment of the invention, three-dimensional display of the live broadcast material can be realized, an omnibearing view angle and vivid texture can be provided, the display effect of the material is effectively improved, and shielding of an anchor picture or excessive occupation of a live broadcast room interface can be avoided, so that the live broadcast experience is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of live broadcast technology, and in particular, to a live broadcast display method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the rapid popularization of Internet technology, online live broadcasting is being accepted and loved by more and more people. Online live broadcasting involves: live broadcasting platform, anchor terminal and audience terminal. The anchor terminal can provide multimedia content (such as video and audio) to the audience terminal through the live broadcasting platform, and can also receive multimedia content (such as bullet screen and gifts) provided by the audience terminal through the live broadcasting platform, so as to achieve the effect of live broadcast and interaction.

[0003] In the live broadcast room, the anchor can display various materials (such as clothing, teaching equipment, paintings, sculptures, etc.), and can also use multiple pictures to better introduce the materials. However, this display method may have the following problems: pictures are stacked, too small or have limited angles, which affects the audience's understanding of the materials and even blocks the anchor's screen, resulting in a poor actual live broadcast experience.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the invention

[0005] The embodiments of the present application provide a live broadcast display method, apparatus, computer equipment, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.

[0006] One aspect of an embodiment of the present application provides a live broadcast display method for a head-mounted display device, the method comprising: Displaying a virtual live studio interface in a three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control; In response to selecting the 3D browsing control, determining a target material and acquiring a 3D model file corresponding to the target material; A 3D model of the target material is generated based on the 3D model file, and the 3D model of the target material is controlled to gradually emerge from the virtual live studio interface to the three-dimensional space.

[0007] Optionally, generating a 3D model of the target material based on the 3D model file includes: Parsing the 3D model file to obtain geometric data and material information of the target material; A 3D model of the target material is generated according to the geometric data and the material information.

[0008] Optionally, controlling the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space includes: Acquire an initialization rule, wherein the initialization rule includes: an initial size, an initial direction, and an initial position, wherein the initial position is located in the three-dimensional space; Based on the initialization rule, the 3D model of the target material is controlled to gradually emerge from the virtual live studio interface to the three-dimensional space, and is displayed at the initial position according to the initial size and the initial direction.

[0009] Optionally, the live broadcast display method further includes: Acquire gesture data, eye movement data or control data through an interface; The size, direction or position of the 3D model of the target material in the three-dimensional space is adjusted according to the gesture data, the eye movement data or the control data.

[0010] Optionally, in response to selecting the 3D browsing control, determining a target material and acquiring a 3D model file corresponding to the target material includes: Acquiring gesture data, eye movement data or control data through an interface to determine whether a click event for the 3D browsing control occurs; In response to a click event on the 3D browsing control, determining a target material; Obtaining an identifier of the target material, and generating a data request based on the identifier of the target material; The data request is sent to a server to download and cache the 3D model file of the target material.

[0011] Another aspect of an embodiment of the present application provides a live broadcast display method for an anchor terminal, the method comprising: Display the target material in the live broadcast room and generate a live stream; Obtaining a 3D model file corresponding to the target material; The 3D model file corresponding to the target material and the live stream are pushed to the server.

[0012] Another aspect of an embodiment of the present application provides a live broadcast display method for a server, the method comprising: Cache the live stream provided by the anchor terminal and the 3D model file corresponding to the target material; Receiving a data request from a head mounted display device, wherein the data request carries an identifier of the target material; Based on the identifier of the target material, obtaining a 3D model file corresponding to the target material; The live stream and the 3D model file corresponding to the target material are sent to the head display device, so as to display the live broadcast room and the 3D model of the target material in a three-dimensional space through the head display device.

[0013] Another aspect of an embodiment of the present application provides a live broadcast display device for a head-mounted display device, the device comprising: A display module, used to display a virtual live studio interface in a three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control; An acquisition module, configured to determine a target material and acquire a 3D model file corresponding to the target material in response to selecting the 3D browsing control; A control module is used to generate a 3D model of the target material based on the 3D model file, and control the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space.

[0014] Another aspect of an embodiment of the present application provides a live broadcast display device for an anchor terminal, the device comprising: The display module is used to display the target material in the live broadcast room and generate a live broadcast stream; An acquisition module, used to acquire a 3D model file corresponding to the target material; The push module is used to push the 3D model file corresponding to the target material and the live stream to the server.

[0015] Another aspect of an embodiment of the present application provides a live broadcast display device for a server, the device comprising: A cache module is used to cache the live stream provided by the anchor terminal and the 3D model file corresponding to the target material; A receiving module, configured to receive a data request from a head mounted display device, wherein the data request carries an identifier of the target material; An acquisition module, configured to acquire a 3D model file corresponding to the target material based on the identifier of the target material; The sending module is used to send the live broadcast stream and the 3D model file corresponding to the target material to the head display device, so as to display the live broadcast room and the 3D model of the target material in a three-dimensional space through the head display device.

[0016] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0017] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0018] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the method described above when executed by a processor.

[0019] The above technical solution adopted in the embodiment of the present application may have the following advantages: A virtual live studio interface with built-in 3D browsing controls is displayed in three-dimensional space through a head-mounted display device. When the 3D browsing control is selected, the target material is determined and the corresponding 3D model file is obtained. A 3D model of the target material is generated based on the 3D model file, and the 3D model of the target material is controlled to float from the virtual live studio interface to the three-dimensional space. It can be seen that the embodiment of the present application can realize the three-dimensional display of live broadcast materials, can provide a full range of viewing angles and realistic textures, effectively improve the display effect of the materials, and can also avoid blocking the host screen or occupying too much of the live studio interface, thereby improving the live broadcast experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0021] Figure 1 The following schematically shows an operating environment diagram of the live broadcast display method according to the first embodiment of the present application; Figure 2 The flowchart of the live broadcast display method according to the first embodiment of the present application is schematically shown; Figure 3 Schematically shows Figure 2 Flow chart of sub-steps of step S202; Figure 4 Schematically shows Figure 2 Flow chart of sub-steps of step S204; Figure 5 Schematically shows Figure 2 Flow chart of sub-steps of step S204; Figure 6 The newly added flow chart of the live broadcast display method according to the first embodiment of the present application is schematically shown; Figure 7 The flowchart of the live broadcast display method according to the second embodiment of the present application is schematically shown; Figure 8 The flowchart of the live broadcast display method according to the third embodiment of the present application is schematically shown; Fig. 9 A block diagram of a live broadcast display device according to Embodiment 4 of the present application is schematically shown; Fig.10 A block diagram schematically shows a live broadcast display device according to Embodiment 5 of the present application Fig.11 A block diagram of a live broadcast display device according to Embodiment 6 of the present application is schematically shown; and Fig.12 The hardware architecture diagram of the computer device according to the seventh embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0023] It should be noted that the descriptions involving "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0024] In the description of the present application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed, but are only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as a limitation on the present application.

[0025] First, the following terms are explained: OBJ (Object File Format): A three-dimensional (3D) model file format, mainly used to store the geometric data of 3D models.

[0026] FBX (Filmbox): A 3D model file format used to store the geometry data, animation data, materials, textures, lights, cameras, etc. of 3D models.

[0027] API (Application Programming Interface): Application programming interface.

[0028] Secondly, in order to facilitate those skilled in the art to understand the technical solutions provided in the embodiments of the present application, the relevant technologies are described below: In the live broadcast room, the anchor can display various materials (such as clothing, teaching equipment, paintings, sculptures, etc.), and can also use multiple pictures to better introduce the materials.

[0029] However, the applicant understands that the above-mentioned display method may have the following problems: image stacking, small size or limited angle, which affects the audience's understanding of the material and even blocks the host's screen, resulting in a poor actual live broadcast experience.

[0030] To this end, the embodiment of the present application provides a live broadcast display technology solution. In this technical solution: (1) the 3D model of the material can be floated to the visual space layer to achieve a three-dimensional display of the material; (2) the audience can interact with the 3D model of the material through gestures, sight or controller (adjust the display state), such as pinching to zoom in, zoom out or move operations, to improve the live broadcast experience; (3) the application scenarios are wide, such as: three-dimensional display of teaching objects during teaching, and when shopping in e-commerce, the audience can simultaneously view the 3D model of the product. See below for details.

[0031] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0032] like Figure 1 As shown, the operating environment diagram includes: service platform 2, anchor terminals (4A, 4B, ..., 4M), and audience terminals (6A, 6B, ..., 6N). In the live broadcast scenario, the anchor terminal (4A, 4B, ..., 4M) logs in to the service platform 2, and the service platform 2 pushes the live broadcast data to the audience terminal (6A, 6B, ..., 6N) in real time.

[0033] Service platform 2 can provide live broadcast service, which can be a single server, a server cluster or a cloud computing service center.

[0034] The anchor terminal (4A, 4B, ..., 4M) is used to generate live broadcast data in real time and perform streaming operations on the live broadcast data. The live broadcast data may include audio data or video data. The anchor terminal may be an electronic device such as a smart phone or a tablet computer. Of course, the anchor terminal may be a virtual computing instance in the service platform 2.

[0035] The audience terminal (6A, 6B, ..., 6N) can be configured to receive the live broadcast data of the anchor terminal in real time. The audience terminal (6A, 6B, ..., 6N) can be a head display device. Among them, the head display device can include a virtual display head display device (VR), an augmented reality head display device (AR) and a mixed reality head display device (MR, such as Apple Vision Pro). The audience terminal (6A, 6B, ..., 6N) can have a built-in browser or a special program, and receive the live broadcast data through the browser or the special program to output content to the user. The content may include video, audio, comments, text data and / or the like.

[0036] The audience terminal (6A, 6B, ..., 6N) may include a player. The player outputs (e.g., displays, presents) content to the user. The content may include video, audio, comments, text data and / or the like. The audience terminal (6A, 6B, ..., 6N) may include an interface, which may include an input element (touch screen). For example, the input element may be configured to receive user instructions, and the user instructions may enable the audience terminal (6A, 6B, ..., 6N) to perform various operations, such as sending a bullet screen, entering a comment, giving a gift, etc.

[0037] The anchor terminals (4A, 4B, ..., 4M), the audience terminals (6A, 6B, ..., 6N) and the service platform 2 may be connected via a network. The network may include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls and / or proxy devices, etc. The network may include physical links, such as coaxial cable links, twisted pair cable links, optical fiber links, combinations thereof and / or the like. The network may include wireless links, such as cellular links, satellite links, Wi-Fi links and / or the like.

[0038] The following uses the viewer terminal 4A as the execution subject to introduce the technical solution of the present application through multiple embodiments. It should be noted that these embodiments can be implemented in a variety of different forms and should not be interpreted as being limited to the embodiments described here.

[0039] Embodiment 1 Figure 2 The flowchart of the live broadcast display method according to the first embodiment of the present application is schematically shown.

[0040] like Figure 2 As shown, the live broadcast display method can be used for a head display device, and specifically may include steps S200 to S204, wherein: Step S200, displaying a virtual live studio interface in a three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control.

[0041] Step S202, in response to selecting the 3D browsing control, determining a target material and acquiring a 3D model file corresponding to the target material.

[0042] Step S204, generating a 3D model of the target material based on the 3D model file, and controlling the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space.

[0043] The live broadcast display method provided in this embodiment displays a virtual live broadcast room interface with a built-in 3D browsing control in a three-dimensional space through a head display device. When the 3D browsing control is selected, the target material is determined and the corresponding 3D model file is obtained. A 3D model of the target material is generated based on the 3D model file, and the 3D model of the target material is controlled to float from the virtual live broadcast room interface to the three-dimensional space. It can be seen that the embodiment of the present application can realize the three-dimensional display of live broadcast materials, can provide a full range of viewing angles and realistic textures, effectively improve the display effect of the materials, and can also avoid blocking the anchor screen or occupying too much of the live broadcast room interface, thereby improving the live broadcast experience.

[0044] The following combination Figure 2 , each step in steps S200~S204 and other optional steps are explained in detail.

[0045] The live broadcast display method provided in the embodiment of the present application is applicable to various types of head-mounted display devices, including AR, VR and MR. The following will take MR (mixed reality head-mounted display device) as an example to exemplarily introduce the live broadcast display method.

[0046] Step S200 , displaying a virtual live studio interface in three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control.

[0047] For example, the audience can wear a head-mounted display device to view the virtual live studio interface displayed in a three-dimensional space through the head-mounted display device. The three-dimensional space can be a virtual three-dimensional space constructed by the head-mounted display device (for example, a future city, a dinosaur world, or a medieval castle), or it can be the real three-dimensional space where the audience is currently located (such as an office or a family living room). The virtual live studio interface can be presented in a variety of ways, including a two-dimensional plane, a curved surface, a panoramic view, etc. The virtual live broadcast interface can include a host screen, an interactive area, an information panel, and controls. Among them, the controls can include a 3D browsing control for starting a three-dimensional display.

[0048] Step S202 In response to selecting the 3D browsing control, a target material is determined and a 3D model file corresponding to the target material is obtained.

[0049] Materials can be the content displayed by the anchor during the live broadcast, and the types are not limited, such as clothing, teaching equipment, paintings, sculptures, etc. The virtual live broadcast room interface can set up a specific area to display one or more pictures of the materials. The materials can also be displayed by the anchor in person on the anchor screen, or placed in the background of the screen. Of course, the materials can also be displayed through information panels, interactive areas, pop-ups, floating cards, etc.

[0050] The head-mounted display device can monitor in real time whether there is a click event for the 3D browsing control. The audience can select the 3D browsing control in the virtual live studio interface through gestures, eye movements, or controllers. The head-mounted display device can capture this event and trigger the corresponding functional logic, that is, determine the target material and obtain the 3D model file corresponding to the target material. Exemplarily, the target material can be quickly identified based on the content of the virtual live studio interface, and the corresponding 3D model file can be requested to load from the server. An exemplary solution is provided below.

[0051] In an optional embodiment, if Figure 3 As shown, step S202 may include: Step S300: acquiring gesture data, eye movement data or control data through an interface to determine whether a click event for the 3D browsing control occurs.

[0052] Step S302: determining a target material in response to a click event on the 3D browsing control.

[0053] Step S304: obtaining the identifier of the target material, and generating a data request based on the identifier of the target material.

[0054] Step S306: sending the data request to a server to download and cache the 3D model file of the target material.

[0055] The head-mounted display device can capture the audience's gestures, track eye movements (line of sight direction) or obtain control data from the matching controller in real time through an interface (API) to determine whether a click event for the 3D browsing control occurs. When a click event for the 3D browsing control is detected, the material being displayed in the virtual live studio interface can be determined as the target material, or a list of materials can be provided for the audience to select, thereby determining the target material. After determining the target material, the identifier of the target material can be quickly found, and a data request can be generated based on the identifier of the target material. The head-mounted display device can send a data request to the server to obtain a 3D model file of the target material pre-uploaded by the anchor terminal from the server. In some embodiments, the data request can also carry other relevant parameters, such as: timestamp, request type, request format (such as OBJ, FBX), etc.

[0056] In this embodiment, the API is used to monitor the viewer's operations, quickly respond when the viewer selects the 3D browsing control, determine the target material and request the server to load the corresponding 3D model file, so as to achieve efficient interaction and further enhance the live broadcast experience.

[0057] Step S204 , generate a 3D model of the target material based on the 3D model file, and control the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space.

[0058] The head-mounted display device can download and cache 3D model files in the background. After the download is complete, the 3D model file can be parsed using a 3D graphics library (such as SceneKit, RealityKit, or Metal) and converted into a renderable 3D object to obtain the 3D model of the target material. An exemplary solution is provided below.

[0059] In an optional embodiment, if Figure 4 As shown, step S204 may include: Step S400: parsing the 3D model file to obtain geometric data and material information of the target material.

[0060] Step S402: Generate a 3D model of the target material according to the geometric data and the material information.

[0061] Exemplarily, by parsing the 3D model file, the geometric data and material information of the target material can be determined, and the texture and skeletal animation information of the target material can also be determined. Based on the above information, the 3D model of the target material can be rendered.

[0062] In this embodiment, the geometric data and material information of the 3D model file are extracted and converted, so that a correct 3D model can be constructed, and appropriate materials and textures are applied to the 3D model, so that the 3D model has a good display effect in three-dimensional space, enhances rendering realism and details, and improves the viewing experience.

[0063] The head display device can control the 3D model of the target material to appear directly at a predetermined position in the three-dimensional space, or it can control the 3D model of the target material to gradually emerge from the virtual live broadcast interface into the three-dimensional space to achieve the three-dimensional display of the target material. Of course, display methods such as layer-by-layer loading, explosion display, and transparency gradient can also be used. Exemplarily, the 3D model of the target material can be controlled to float up to the visual space layer, and the visual space layer can be the space area between the virtual live broadcast room interface and the head display device (audience), so as to facilitate the audience to interact with the 3D model. Of course, the target material can be controlled to be displayed at any position in the three-dimensional space, for example, separated from the virtual live broadcast room interface to reduce the occlusion of the live broadcast content and further optimize the live broadcast experience.

[0064] Several exemplary control schemes are provided below.

[0065] In an optional embodiment, if Figure 5 As shown, step S204 may include: Step S500, obtaining an initialization rule, wherein the initialization rule includes: an initial size, an initial direction, and an initial position, wherein the initial position is located in the three-dimensional space.

[0066] Step S502, based on the initialization rule, control the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space, and display it at the initial position according to the initial size and the initial direction.

[0067] Exemplarily, the 3D model of the target material can be initialized in the three-dimensional space to ensure the correct display and placement of the model. To this end, initialization rules can be set in advance, such as setting the properties of the 3D model such as the position, size and direction to appropriate initial values. Based on the initialization rules, the 3D model of the target material can be controlled to gradually emerge from the virtual live studio interface into the three-dimensional space, and displayed at the initial position according to the set initial size and initial direction.

[0068] In this embodiment, initializing the 3D model according to the rules can ensure that the model can be correctly displayed and placed in the three-dimensional space, avoid the model overlapping with other objects or generating errors when loading, and improve the visual experience of the 3D model.

[0069] In some embodiments, virtual light sources and cameras can also be pre-configured. For example, the intensity, position, color, and attenuation coefficient of the virtual light source can be configured so that the 3D model has good light and shadow effects in the three-dimensional space, enhancing the realism of the three-dimensional display, thereby optimizing the visual experience. The type, position, and parameters of the camera can also be configured to ensure that the audience can view the 3D model from a better angle.

[0070] The above embodiment exemplifies how to display a 3D model of a target material in a three-dimensional space. The following will further exemplify how to interact with the 3D model.

[0071] In an optional embodiment, if Figure 6 As shown, the live broadcast display method may further include: Step S600, acquiring gesture data, eye movement data or control data through an interface.

[0072] Step S602: adjusting the size, direction or position of the 3D model of the target material in the three-dimensional space according to the gesture data, the eye movement data or the control data.

[0073] Exemplarily, the head-mounted display device can capture the audience's gesture data, track eye movement data (to achieve direction) and obtain control data in real time through the interface. Based on the gesture data, eye movement data, control data or predetermined logic, the head-mounted display device can use 3D engines such as SceneKit and RealityKit to dynamically adjust the 3D model of the target material in three-dimensional space. For example, the Z-axis (depth) coordinate of the 3D model can be adjusted by dragging the 3D model to make it more prominent and enhance the visual effect. The position of the 3D model in all directions, including the X-axis, Y-axis and Z-axis coordinates, can also be adjusted to ensure that the 3D model can be within the audience's line of sight. Of course, the size, direction and position of the 3D model in three-dimensional space can also be adjusted by rotating and / or scaling.

[0074] In this embodiment, the audience can interact with the 3D model through gestures, sight or controllers, and dynamically adjust the display status of the 3D model, thereby further enhancing the effect of the three-dimensional display and improving the live broadcast experience.

[0075] In order to make the present application easier to understand, an exemplary application is provided below.

[0076] S1: The audience puts on the head-mounted display device and can watch the virtual live broadcast room interface in three-dimensional space through the head-mounted display device. The virtual live broadcast room interface provides 3D browsing controls.

[0077] S2: The head display device monitors a click event on the 3D browsing control, and in response to the click event, triggers a functional logic: determining a target material, and obtaining an identifier of the target material for generating a data request.

[0078] S3: Send a data request to the server to obtain a 3D model file of the target material, wherein the 3D model file of the target material can be pre-uploaded by the anchor terminal.

[0079] S4: Parse the 3D model file to obtain the geometric data, material, texture, skeletal animation, etc. of the target material for loading the 3D model.

[0080] S5: Control the 3D model of the target material to float up to the three-dimensional space (such as the visual space layer) to achieve three-dimensional display of the target material.

[0081] S6: Acquire the audience's gesture data, eye movement data or control data through the interface, and dynamically adjust the display state of the 3D model based on the aforementioned data, such as rotating, scaling or dragging the 3D model.

[0082] In this exemplary application: (1) the 3D model of the material can be floated to the visual space layer to achieve a three-dimensional display of the material; (2) the audience can interact with the 3D model of the material through gestures, sight or controllers (adjust the display status), such as pinching to zoom in, zoom out or move operations, to improve the live broadcast experience; (3) the application scenarios are wide-ranging, such as: three-dimensional display of teaching objects during teaching, and when shopping in e-commerce, the audience can simultaneously view the 3D model of the product.

[0083] Embodiment 2 Figure 7 The flowchart of the live broadcast display method according to the first embodiment of the present application is schematically shown.

[0084] like Figure 7 As shown, the live broadcast display method can be used for the anchor terminal, and specifically may include steps S700 to S704, wherein: Step S700, display the target material in the live broadcast room and generate a live broadcast stream.

[0085] Step S702: Obtain a 3D model file corresponding to the target material.

[0086] Step S704: Push the 3D model file corresponding to the target material and the live stream to the server.

[0087] The live broadcast display method provided in this embodiment allows the anchor to display the target material in the live broadcast room and generate a live broadcast stream and a 3D model file corresponding to the target material. The live broadcast stream and the 3D model file corresponding to the target material are provided to the server so that the audience terminal can obtain the 3D model file through the server to realize the three-dimensional display of the target material, thereby improving the anchor's live broadcast effect.

[0088] Embodiment 3 Figure 8 The flowchart of the live broadcast display method according to the first embodiment of the present application is schematically shown.

[0089] like Figure 8 As shown, the live broadcast display method can be used in a server, and can specifically include steps S800 to S806, wherein: Step S800: caching the live stream provided by the anchor terminal and the 3D model file corresponding to the target material.

[0090] Step S802: receiving a data request from a head mounted display device, wherein the data request carries an identifier of the target material.

[0091] Step S804: based on the identifier of the target material, obtain a 3D model file corresponding to the target material.

[0092] Step S806: Send the live broadcast stream and the 3D model file corresponding to the target material to the head display device, so as to display the live broadcast room and the 3D model of the target material in a three-dimensional space through the head display device.

[0093] The live broadcast display method provided in this embodiment is as follows: the server caches the live broadcast stream and the 3D model file corresponding to the target material provided by the anchor terminal. When receiving a data request from the head display device, the server can quickly obtain the corresponding 3D model file according to the identifier of the target material in the data request. The server can send the live broadcast stream and the 3D model file corresponding to the target material to the head display device, so that the head display device can realize the three-dimensional display of the target material based on the 3D model file, effectively improve the display effect of the material, and avoid blocking the anchor screen or occupying too much of the live broadcast room interface, thereby improving the live broadcast experience.

[0094] Embodiment 4 Fig. 9 The block diagram of the live broadcast display device according to the fourth embodiment of the present application is schematically shown. The device can be used for a head-mounted display device and can also be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig. 9 As shown, the device 900 may include: a display module 910, an acquisition module 920 and a control module 930, wherein: A display module 910 is used to display a virtual live studio interface in a three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control; An acquisition module 920, configured to determine a target material and acquire a 3D model file corresponding to the target material in response to selecting the 3D browsing control; The control module 930 is used to generate a 3D model of the target material based on the 3D model file, and control the 3D model of the target material to gradually emerge from the virtual live broadcast room interface to the three-dimensional space.

[0095] As an optional embodiment, generating the 3D model of the target material based on the 3D model file includes: Parsing the 3D model file to obtain geometric data and material information of the target material; A 3D model of the target material is generated according to the geometric data and the material information.

[0096] As an optional embodiment, controlling the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space includes: Acquire an initialization rule, wherein the initialization rule includes: an initial size, an initial direction, and an initial position, wherein the initial position is located in the three-dimensional space; Based on the initialization rule, the 3D model of the target material is controlled to gradually emerge from the virtual live studio interface to the three-dimensional space, and is displayed at the initial position according to the initial size and the initial direction.

[0097] As an optional embodiment, the device 900 is further used for: Acquire gesture data, eye movement data or control data through an interface; The size, direction or position of the 3D model of the target material in the three-dimensional space is adjusted according to the gesture data, the eye movement data or the control data.

[0098] As an optional embodiment, in response to selecting the 3D browsing control, determining a target material and acquiring a 3D model file corresponding to the target material includes: Acquiring gesture data, eye movement data or control data through an interface to determine whether a click event for the 3D browsing control occurs; In response to a click event on the 3D browsing control, determining a target material; Obtaining an identifier of the target material, and generating a data request based on the identifier of the target material; The data request is sent to a server to download and cache the 3D model file of the target material.

[0099] Embodiment 5 Fig.10 The block diagram of the live broadcast display device according to the fifth embodiment of the present application is schematically shown. The device can be used for the anchor terminal and can also be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig.10 As shown, the device 1000 may include: a display module 1010, an acquisition module 1020 and a push module 1030, wherein: The display module 1010 is used to display the target material in the live broadcast room and generate a live broadcast stream; An acquisition module 1020 is used to acquire a 3D model file corresponding to the target material; The push module 1030 is used to push the 3D model file corresponding to the target material and the live stream to the server.

[0100] Embodiment 6 Fig.11 The block diagram of the live broadcast display device according to the sixth embodiment of the present application is schematically shown. The device can be used for a server and can also be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Fig.11 As shown, the device 1100 may include: a cache module 1110, a receiving module 1120, an acquisition module 1130 and a sending module 1140, wherein: The cache module 1110 is used to cache the live stream provided by the anchor terminal and the 3D model file corresponding to the target material; The receiving module 1120 is configured to receive a data request from a head mounted display device, wherein the data request carries an identifier of the target material; An acquisition module 1130 is used to acquire a 3D model file corresponding to the target material based on the identifier of the target material; The sending module 1140 is used to send the live broadcast stream and the 3D model file corresponding to the target material to the head display device, so as to display the live broadcast room and the 3D model of the target material in a three-dimensional space through the head display device.

[0101] Embodiment 7 Fig.12 The hardware architecture diagram of a computer device 10000 suitable for implementing a live broadcast display method according to Embodiment 7 of the present application is schematically shown. In some embodiments, the computer device 10000 may be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle-mounted terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Fig.12 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other through a system bus. Among them: The memory 10010 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 10010 can be an internal storage module of the computer device 10000, such as a hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 can also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 10010 can also include both the internal storage module of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed in the computer device 10000, such as the program code of the live broadcast display method, etc. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0102] In some embodiments, the processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data.

[0103] The network interface 10030 may include a wireless network interface or a wired network interface, and the network interface 10030 is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0104] It should be pointed out that Fig.12 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.

[0105] In this embodiment, the live broadcast display method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0106] Embodiment 8 An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, wherein when the computer program is executed by a processor, the steps of the live broadcast display method in the embodiment are implemented.

[0107] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of a computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device. Of course, the computer-readable storage medium may also include both an internal storage unit of a computer device and an external storage device thereof. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on a computer device, such as the program code of the live broadcast display method in the embodiment, etc. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.

[0108] Embodiment 9 An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0109] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented by general-purpose computer devices, they can be concentrated on a single computer device, or distributed on a network composed of multiple computer devices, optionally, they can be implemented by executable program codes of computer devices, so that they can be stored in a storage device and executed by the computer device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0110] It should be noted that the above are only preferred embodiments of the present application, and the patent protection scope of the present application is not limited thereto. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A live broadcast display method, characterized in that: For a head mounted display device, the method comprises: Displaying a virtual live studio interface in a three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control; In response to selecting the 3D browsing control, determining a target material and acquiring a 3D model file corresponding to the target material; A 3D model of the target material is generated based on the 3D model file, and the 3D model of the target material is controlled to gradually emerge from the virtual live studio interface to the three-dimensional space.

2. The method according to claim 1, characterized in that Generating a 3D model of the target material based on the 3D model file includes: Parsing the 3D model file to obtain geometric data and material information of the target material; A 3D model of the target material is generated according to the geometric data and the material information.

3. The method according to claim 1, characterized in that Controlling the 3D model of the target material to gradually emerge from the virtual live studio interface to the three-dimensional space includes: Acquire an initialization rule, wherein the initialization rule includes: an initial size, an initial direction, and an initial position, wherein the initial position is located in the three-dimensional space; Based on the initialization rule, the 3D model of the target material is controlled to gradually emerge from the virtual live studio interface to the three-dimensional space, and is displayed at the initial position according to the initial size and the initial direction.

4. The method according to claim 1, characterized in that: Also includes: Acquire gesture data, eye movement data or control data through an interface; The size, direction or position of the 3D model of the target material in the three-dimensional space is adjusted according to the gesture data, the eye movement data or the control data.

5. The method according to any one of claims 1 to 4, characterized in that: In response to selecting the 3D browsing control, determining a target material and acquiring a 3D model file corresponding to the target material includes: Acquiring gesture data, eye movement data or control data through an interface to determine whether a click event for the 3D browsing control occurs; In response to a click event on the 3D browsing control, determining a target material; Obtaining an identifier of the target material, and generating a data request based on the identifier of the target material; The data request is sent to a server to download and cache the 3D model file of the target material.

6. A live broadcast display method, characterized in that: For an anchor terminal, the method includes: Display the target material in the live broadcast room and generate a live stream; Obtaining a 3D model file corresponding to the target material; The 3D model file corresponding to the target material and the live stream are pushed to the server.

7. A live broadcast display method, characterized in that: For a server, the method comprises: Cache the live stream provided by the anchor terminal and the 3D model file corresponding to the target material; Receiving a data request from a head mounted display device, wherein the data request carries an identifier of the target material; Based on the identifier of the target material, obtaining a 3D model file corresponding to the target material; The live stream and the 3D model file corresponding to the target material are sent to the head display device, so as to display the live broadcast room and the 3D model of the target material in a three-dimensional space through the head display device.

8. A live broadcast display device, characterized in that: For a head-mounted display device, the device comprises: A display module, used to display a virtual live studio interface in a three-dimensional space, wherein the virtual live studio interface includes a 3D browsing control; An acquisition module, configured to determine a target material and acquire a 3D model file corresponding to the target material in response to selecting the 3D browsing control; A control module is used to generate a 3D model of the target material based on the 3D model file, and control the 3D model of the target material to gradually emerge from the virtual live broadcast room interface to the three-dimensional space.

9. A live broadcast display device, characterized in that: For a host terminal, the device includes: The display module is used to display the target material in the live broadcast room and generate a live broadcast stream; An acquisition module, used to acquire a 3D model file corresponding to the target material; The push module is used to push the 3D model file corresponding to the target material and the live stream to the server.

10. A live broadcast display device, characterized in that: For a server, the device comprises: A cache module is used to cache the live stream provided by the anchor terminal and the 3D model file corresponding to the target material; A receiving module, configured to receive a data request from a head mounted display device, wherein the data request carries an identifier of the target material; An acquisition module, configured to acquire a 3D model file corresponding to the target material based on the identifier of the target material; The sending module is used to send the live broadcast stream and the 3D model file corresponding to the target material to the head display device, so as to display the live broadcast room and the 3D model of the target material in a three-dimensional space through the head display device.

11. A computer device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

13. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 7 are implemented.

Images