Method and system for realizing live broadcast based on augmented reality through user interface

Abstract

The invention provides a method and a system for realizing live broadcast based on augmented reality through a user interface. The method comprises the following steps of: receiving selection of an option displayed on a display by a user; and when a selection of a first interface displayed on the display and used for realizing live broadcast based on augmented reality or one of the at least one second interface is received, respectively enabling the display to display the first interface or the second interface in the at least one second interface, each of the at least one second interface includes at least one control module, and when a selection of one of the at least one control module is received, the display is caused to display a menu about the currently selected control module, the menu about the currently selected control module includes an option for adding the currently selected control module to the first interface, and when a selection of the option for adding the currently selected control module to the first interface is received, the currently selected control module is added to the first interface.

Description

Technical Field

[0001] The present application belongs to the field of communications, and more specifically, to a method and system for generating extended reality (XR) video through a user interface, an electronic device, and a computer-readable storage medium. Background Art

[0002] Extended reality (XR) refers to the use of modern high-tech means with computers as the core to create a digital environment that combines the real and virtual worlds, as well as a new mode of human-computer interaction, to bring the experiencer an immersive feeling of seamless transition between the virtual world and the real world. It is a general term for multiple technologies such as augmented reality (AR), virtual reality (VR), and mixed reality (MR).

[0003] There are many live broadcast platforms in China, but large Internet companies only provide related interface services and basic live broadcast services. From a service perspective, these platforms only provide basic live broadcast functions, such as push streaming, pull streaming, IM instant messaging, comments and other basic functions. The single model of traditional live broadcast rooms can no longer meet the needs of the public, and it has been replaced by various novel live broadcast technologies, such as XR-based live broadcast. Summary of the invention

[0004] The present disclosure provides a method and system for data parsing, as well as an electronic device and a computer-readable storage medium, to at least solve the problems in the above-mentioned related technologies, or may not solve any of the above-mentioned problems.

[0005] According to a first aspect of the present disclosure, a method for implementing live broadcast based on extended reality (XR) through a user interface executed by a processor is provided, wherein the user interface includes a display, and the method may include: receiving a user's selection of an option displayed on the display; when receiving a selection of a first interface for implementing live broadcast based on XR or one of at least one second interface displayed on the display, causing the display to display the first interface or the second interface of the at least one second interface, respectively, wherein each of the at least one second interface includes at least one control module, wherein the control module in the at least one second interface includes an input module for acquiring at least one video signal, a rendering module for rendering a virtual three-dimensional scene to output live broadcast content, and an online streaming module for implementing live broadcast, wherein the video signal includes character information of the live broadcast, wherein when receiving a selection of one of the at least one control module, causing the display to display a menu about the currently selected control module, the menu about the currently selected control module includes an option for adding the currently selected control module to the first interface, wherein when receiving a selection of the option for adding the currently selected control module to the first interface, the currently selected control module is added to the first interface.

[0006] Optionally, when the display is caused to display the first interface or the second interface among the at least one second interface, a preview window of the output live content is displayed in the displayed first interface or the second interface among the at least one second interface.

[0007] Optionally, the method may further include: acquiring an input for moving or scaling the preview window; and moving or scaling the preview window according to the input for moving or scaling the preview window.

[0008] Optionally, when a selection of a control module in the first interface is received, the display is caused to display a menu about the currently selected control module in the first interface, the menu about the currently selected control module in the first interface includes an option for deleting the currently selected control module from the first interface, and when a selection of the option for deleting the currently selected control module from the first interface is received, the currently selected control module is deleted from the first interface.

[0009] Optionally, the at least one second interface may include a camera interface, an input interface, a visual effect control interface and a rendering interface, wherein the control module of the input interface may include the input module, and the control module of the rendering interface includes the rendering module and the streaming module.

[0010] Optionally, the input module of the input interface may include an option for creating a new input source and an option for deleting an input source, wherein when a selection of the option for creating a new input source is received, a first sub-input module is displayed in the input interface, the first sub-input module including at least one of an option for selecting an input device, an option for selecting a resolution of an input video, and an option for selecting a frame rate of an input video, and when a selection of the first sub-input module is received and a selection of the option for deleting an input source is received, the first sub-input module is deleted from the input interface.

[0011] Optionally, the method may also include: causing the display to display at least one character layer module corresponding to the first sub-input module displayed in the input interface, and when a selection of one of the at least one character layer modules is received, displaying a character layer setting menu in the input interface, wherein the character layer setting menu includes at least one of the following: a character's name input item or name option, a signal source option, a coordinate display item, an option for making the character land automatically, an option for adjusting the character's height coordinates, an option for making the character face the virtual camera, an option for making the character display in at least one path of the virtual camera, an option for whether to enable lighting, an option for whether to activate color correction, and a menu for color correction.

[0012] Optionally, the control module of the camera interface may include at least one of the following: a preview setting module, a camera selection module for selecting a virtual camera, a camera path module for selecting a path of the virtual camera, and a camera path editing module for editing the path of the virtual camera.

[0013] Optionally, the preview setting module may include a free view option, a camera view option, a stop option, a pause option and a play option. When a selection of the free view option is received, the operation of the virtual lens of the live content in the preview window is identified. If a move operation and / or a rotation operation of the virtual lens of the preview window is identified, the live content corresponding to the moved and / or rotated virtual lens is displayed in the preview window accordingly. When it is detected that the free view option is selected, the stop option, the pause option and the play option, and any options in the camera selection module, the camera path module and the camera path editing module are not selectable. When a selection of the camera view option is received, the stop option, the pause option and the play option, and any options in the camera selection module, the camera path module and the camera path editing module are selectable.

[0014] Optionally, the camera path module may include a play setting option, a switch setting option and a path option, and the switch setting option is used to set a switching method when switching from the live content of a previous path to the first frame of the live content of a subsequent path.

[0015] Optionally, the camera path editing module may include a speed curve option for selecting a path speed and a path point option for editing points on the path.

[0016] Optionally, the control module of the visual effect control interface may include at least one of an event trigger module, a channel switching module, a virtual screen module and a sequence frame module. The event trigger module can be used to create, import or select virtual events in live content. The event trigger module may include a new event option, a delete event option, and an event box option for creating, importing, previewing or selecting events. The channel switching module can be used to display live content or display preset videos or preset images in the entire preview window, and may include a new event option, a delete event option, and a video box option for creating, importing, previewing or selecting live content or videos or images to be displayed in the entire preview window. The virtual screen module is used to display a virtual screen in the live content, and includes a new virtual screen panel option, a delete virtual screen panel option, and a virtual screen video box option for creating, importing, previewing or selecting videos or images to be played on the virtual screen. The sequence frame module is used to overlay and display preset sequence frames on the live content.

[0017] Optionally, the control module of the rendering interface may include the rendering module, and the rendering module may include a start rendering option and / or a stop rendering option.

[0018] Optionally, the control module of the rendering interface may further include the online streaming module, which may include a start streaming option and / or a stop streaming option. When a selection of the start streaming option is received, the live streaming content is streamed online.

[0019] According to a second aspect of the present disclosure, a system for implementing live broadcast based on extended reality (XR) through a user interface is provided. The user interface may include a display. The system may include: a receiving unit configured to receive a user's selection of an option displayed on the display; an interface display unit configured to, upon receiving a selection of a first interface for implementing live broadcast based on XR or one of the at least one second interfaces displayed on the display, respectively cause the display to display the first interface or the second interface in the at least one second interface, wherein each of the at least one second interface includes at least one control module, wherein the control module in the at least one second interface includes a control module for obtaining An input module for receiving at least one video signal, a rendering module for rendering a virtual three-dimensional scene to output live content, and a streaming module for implementing live broadcast, wherein the video signal includes character information of the live broadcast, and wherein the interface display unit is further configured to: when a selection of one of the at least one control module is received, cause the display to display a menu about the currently selected control module, wherein the menu about the currently selected control module includes an option for adding the currently selected control module to the first interface, and when a selection of the option for adding the currently selected control module to the first interface is received, add the currently selected control module to the first interface.

[0020] According to a third aspect of the present disclosure, an electronic device is provided, which may include: at least one processor; at least one memory storing computer-executable instructions, wherein the computer-executable instructions, when executed by at least one of the processors, prompt at least one of the processors to execute the method of implementing live broadcast based on extended reality XR through a user interface executed by the processor.

[0021] According to a fourth aspect of the present disclosure, a computer-readable storage medium storing instructions is provided, characterized in that when the instructions are executed by at least one processor, at least one of the processors is prompted to execute the method of implementing live broadcast based on extended reality XR through a user interface executed by the processor.

[0022] According to the exemplary embodiments of the present disclosure, the method of implementing live broadcast based on extended reality XR through the user interface executed by the processor provides a convenient use environment for the live broadcast personnel (users), making it easier for users to understand and operate, promoting the realization of the functions of live broadcast based on extended reality XR, and allowing users to complete all operations in the live broadcast process conveniently and smoothly. In addition, for the design of the first interface, users can add at least one module in the second interface to the first interface as needed, thereby personalizing the first interface, improving the user experience, and allowing users to no longer be restricted by operations during use, so as to better realize the function of live broadcast.

[0023] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 is a flowchart illustrating a method for implementing XR-based live broadcast through a user interface, performed by a processor, according to an example embodiment of the present disclosure;

[0025] Figure 2 is an example diagram showing an input interface according to an example embodiment of the present disclosure;

[0026] Figure 3 is an example diagram illustrating a camera interface according to an example embodiment of the present disclosure;

[0027] Figure 4 is an example diagram showing a visual effect control interface according to an example embodiment of the present disclosure;

[0028] Figure 5 is an example diagram illustrating a rendering interface according to an example embodiment of the present disclosure;

[0029] Figure 6 is an example diagram showing a first interface according to an example embodiment of the present disclosure;

[0030] Figure 7 is a schematic block diagram showing a system for implementing live broadcast based on extended reality XR through a user interface according to an example embodiment of the present disclosure;

[0031] Figure 8 is a schematic block diagram illustrating an electronic device according to an example embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0033] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The implementation methods described in the following examples do not represent all implementation methods consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the attached claims.

[0034] It should be noted that “at least one of the several items” appearing in the present disclosure refers to three types of parallel situations: “any one of the several items”, “a combination of any multiple of the several items”, and “all of the several items”. For example, “including at least one of A and B” includes the following three parallel situations: (1) including A; (2) including B; (3) including A and B. Another example is “executing at least one of step one and step two”, which means the following three parallel situations: (1) executing step one; (2) executing step two; (3) executing step one and step two. “A and / or B” and “A and / or B” appearing in the present disclosure refer to the following three parallel situations: only A; only B; both A and B.

[0035] Figure 1 is a flowchart illustrating a method for implementing XR-based live broadcast through a user interface, performed by a processor, according to an example embodiment of the present disclosure.

[0036] At step 110, a user selection of an option displayed on the display may be received.

[0037] In step 120, when a selection of a first interface or a second interface of at least one second interface displayed on a display for implementing XR-based live broadcast is received, the display is respectively made to display the first interface or the second interface of the at least one second interface. Each of the at least one second interface may include at least one control module, wherein the control module in the at least one second interface may include an input module for acquiring at least one video signal, a rendering module for rendering a virtual three-dimensional scene to output live broadcast content, and an online streaming module for implementing live broadcast. The video signal may include character information of the live broadcast. The video signal may be multiple, and may include real-time signals and / or signals in local files, and the video signal format may be automatically identified.

[0038] When the display is respectively made to display the first interface or the second interface of the at least one second interface, a preview window of the output live content is displayed in the displayed first interface or the second interface of the at least one second interface. Thus, the behind-the-scenes personnel of the live broadcast can conveniently view the live content. In addition, the preview window can also be closed. In the present disclosure, an input for moving or scaling the preview window can also be obtained; according to the input for moving or scaling the preview window, the preview window is moved or scaled.

[0039] As an example only, the at least one second interface may include a camera interface, an input interface, a visual effect control interface, and a rendering interface. Here, the control module of the input interface may include the above-mentioned input module, and the control module of the rendering interface may include the above-mentioned rendering module and the above-mentioned streaming module.

[0040] Below, the input interface, camera interface, visual effect control interface and rendering interface will be described in detail with reference to the accompanying drawings.

[0041] Figure 2 is an example diagram illustrating an input interface according to an example embodiment of the present disclosure.

[0042] like Figure 2 As shown, the input module of the input interface may include an option for creating a new input source and an option for deleting an input source. When a selection of the option for creating a new input source is received, a first sub-input module (e.g., Figure 2 The first sub-input module may include at least one of an option for selecting an input device, an option for selecting a resolution of an input video, and an option for selecting a frame rate of an input video. For example, an input device such as an SDI signal or a local video may be selected from a drop-down menu. Figure 2 As shown, when a selection of the option for creating a new input source is received, a second sub-input module (for example, Figure 2 When a selection of the first sub-input module is received and a selection of the option for deleting the input source is received, the first sub-input module can be deleted in the input interface.

[0043] According to an exemplary embodiment of the present disclosure, the display may also display at least one character layer module (eg, Figure 2 3 character layers are displayed), when a selection of one of the at least one character layer modules is received, for example, Figure 2As shown, in the case of using a mouse to implement user input, the character layer can be clicked with the left button of the mouse, and then the display can display detailed settings for the character layer next to the character layer. In the present disclosure, after receiving a selection of a character layer module in the at least one character layer module, a character layer setting menu can be displayed in the input interface, wherein the character layer setting menu includes at least one of the following: a character name input item or name option, a signal source option, a coordinate display item, an option for automatically landing the character, an option for adjusting the height coordinates of the character, an option for making the character face the virtual camera, an option for making the character display a path in at least one path of the virtual camera, an option for whether to enable lighting, an option for whether to activate color correction, and a menu for color correction. For example, the position of the character can be manually adjusted through "coordinates", and in addition, "automatic landing" can be selected to automatically detect the height of the character layer and let the character layer land automatically. Optionally, the "height" can also be adjusted to correct the error of automatic landing. The character layer can always face the selected camera (virtual) through "Look at the camera", for example, a drop-down menu will appear for the user to select a camera by clicking with the left button of the mouse. "Show in" can be used to make the character layer only appear in the camera path checked by the user, for example, a drop-down menu will appear when the mouse is clicked. At this time, if "All" is selected, the character layer will be displayed in any camera, in which case "Path" is not selectable. If any camera is selected, "Path" becomes selectable, and several paths (for example, 16 paths) can be checked arbitrarily. At this time, the character layer is only displayed in the checked camera path. In addition, if "Lighting" is selected as on, the character layer is affected by the scene lighting. If "Lighting" is selected as off, the character layer is not affected by the scene lighting. In addition, the color correction function can also be activated by activating the color correction option, and the user can set the color according to the color correction menu. For example, if Figure 2 As shown, set white balance, tint, sharpening, etc.

[0044] However, those skilled in the art will appreciate that Figure 2 The manner or order of displaying various options / modules is only an example, and the present disclosure is not limited thereto. For example, a detailed setting menu of a character layer may be displayed horizontally below the corresponding character layer, and the arrangement order of various options may be changed.

[0045] Figure 3 is an example diagram illustrating a camera interface according to an example embodiment of the present disclosure.

[0046] The control module of the camera interface may include at least one of the following: a preview setting module, a camera selection module for selecting a virtual camera, a camera path module for selecting a path of the virtual camera, and a camera path editing module for editing the path of the virtual camera.

[0047] like Figure 3 As shown, the preview setting module may include a free view option, a camera view option, a stop option, a pause option, and a play option. When the selection of the free view option is received, the operation of the virtual lens of the live content in the preview window is identified. If the moving operation and / or rotation operation of the virtual lens of the preview window is identified, the live content corresponding to the moved and / or rotated virtual lens is displayed in the preview window accordingly. When it is detected that the free view option is selected, the stop option, the pause option and the play option, as well as any option in the camera selection module, the camera path module, and the camera path editing module cannot be selected. That is to say, for example, when the mouse is used for selection, the scene can be freely browsed by the mouse. When the selection of the camera view option is received, the stop option, the pause option and the play option, as well as any option in the camera selection module, the camera path module, and the camera path editing module can be selected. The free view option and the camera view option are mutually exclusive logics, and only one can be selected. If the user does not make a selection, the camera view is the default. The camera view is the premise of all subsequent operations. Only after it is selected can the lens be previewed and edited. In addition, the stop option, pause option and play option are mutually exclusive logic, and only one can be selected, and the default is "play". When the stop option is selected, the path playback can be stopped and the perspective returns to the first frame of the current path; when the pause option is selected, the path playback can be paused and the perspective is paused at the current position; when the play option is selected, the path can be continued from the current position.

[0048] In the present disclosure, the camera options in the camera selection module are mutually exclusive logic, and only one can be selected. For example, if the button Camera 1 is selected, it switches to the corresponding camera 1, and the camera path module (panel) can synchronously switch to the corresponding camera 1. For example, if the button Camera 2 is selected, it switches to the corresponding camera 2, and the camera path module can synchronously switch to the corresponding camera 2.

[0049] like Figure 3As shown, the camera path module may include a play setting option, a switch setting option, and a path option. The switch setting option can be used to set the switching mode when switching from the live content of the previous path to the first frame of the live content of the next path, including fade-in and fade-out, black transition, white transition, water ripples, or the view immediately moves to the starting point of the next shot. The various options in the switch setting option are mutually exclusive logic, and only one can be selected. After the option is selected, it can be deselected if it is selected again. By default, no switching mode is selected, and the two paths are switched by hard cutting. The path option is mutually exclusive logic, and only one can be selected. If one of the buttons 1-16 is selected, the lens of the corresponding path is switched. The play setting option is mutually exclusive logic, and only one can be selected. After selecting it, it can be deselected if it is selected again. By default, the play setting option is not checked. If "Continuous Next" is checked, the next shot will be played after the shot of path 1-16 is played. If "Loop Play" is checked, the shots of path 1-16 will be played in an infinite loop in the manner of starting point, end point, and starting point, that is, they will be played in a loop in the order of 1-16-1.

[0050] The camera path editing module may include a speed curve option for selecting the path speed and a path point option for editing points on the path. Figure 3 As shown, the camera path can be from A to B to C. In addition, the path points (viewing points) can be changed and the new viewing angles can be automatically saved. The "Copy", "Paste" and "Delete" options are used to copy, paste and delete the corresponding path points. Each line in the speed curve option corresponds to a different switching speed.

[0051] In addition, if Figure 3 As shown, when the camera path module is selected, the display can display the corresponding detailed setting menu, which may include master speed, path speed, main smoothing, smooth path and other transition effect durations. The master speed is used to control the speed of all paths of the camera. The parameter is "0-1", the default is 0.5, and the upper and lower limits of the adjustment are five times the speed adjustment. The path speed represents the number of seconds between adjacent path points, the default is 5, that is, AB is 5 seconds, BC is 5 seconds. The main smoothing is the duration used for "the viewpoint moves immediately to the starting point of the next shot", the unit can be seconds, and the default is 1. The smooth path is the duration of the viewpoint moving to the starting point of the corresponding path when switching between paths, the unit can be seconds, the default is 1, and it can be multiplied by the "main smoothing" coefficient to control the corresponding duration.

[0052] However, those skilled in the art will appreciate that Figure 3 The manner or order in which the various options / modules are displayed is merely an example and the present disclosure is not limited thereto.

[0053] Figure 4 is an example diagram illustrating a visual effect control interface according to an example embodiment of the present disclosure.

[0054] The control module of the visual effect control interface may include at least one of an event trigger module, a channel switching module, a virtual screen module, and a sequence frame module.

[0055] like Figure 4 As shown, the event trigger module can be used to create, import or select virtual events in live content, and may include a new event option, a delete event option, and an event box option for creating, importing, previewing or selecting events. You can also name the event and add a thumbnail so that the display shows the thumbnail in the event box.

[0056] The channel switching module can be used to display live content or preset videos or preset images in the entire preview window, and includes a new event option, a delete event option, and a video frame option for creating, importing, previewing, or selecting live content or videos or images to be displayed in the entire preview window. Figure 4 As shown, if the Live video box option is selected, the screen is output online, and if the video thumbnail is selected, it is switched to the corresponding local video. In addition, the channel switching module may also include an audio option for controlling the switch of the audio of the video switched by the channel, which is turned on by default.

[0057] The virtual screen module can be used to display a virtual screen in live content, and includes a new virtual screen panel option, a delete virtual screen panel option, and a virtual screen video frame option for creating, importing, previewing, or selecting videos or images to be played on the virtual screen. By default, it is "off", that is, the virtual screen is turned off and the virtual screen does not display content. If you select a thumbnail in the virtual screen video frame, you can switch to the local video and the virtual screen can display content. The virtual screen module can also include an audio option, a switch for controlling the audio of the video on the virtual screen, which is off by default. Just as an example, Figure 4 Two virtual screens are shown in FIG. 1 , but the present disclosure is not limited thereto, and multiple virtual screens may also be shown.

[0058] The Sequence Frame module can be used to overlay preset sequence frames on live content, such as the anchor's opening introduction subtitles, brand logo exposure, etc. The default selection is "Off", which means that the sequence frame content is not displayed. If you select a thumbnail in the Sequence Frame box, the corresponding sequence frame can be played, and then if you click "Off", the sequence frame can be faded out.

[0059] Figure 5 is an example diagram illustrating a rendering interface according to an example embodiment of the present disclosure.

[0060] The control module of the rendering interface may include a rendering module, and the rendering module may include a start rendering option and / or a stop rendering option. Figure 5 As shown, the rendering module belongs to local rendering, however, the present disclosure is not limited thereto and may also include cloud rendering. If "Start Rendering" is selected, rendering starts, and if "Start Rendering" is selected again, rendering ends. If the rendering module is selected, the display may display a corresponding detailed setting menu, which may include at least one of the rendering name, output path, resolution, video format, video bit rate, video frame rate, audio format, and audio bit rate. Figure 5 As shown, video formats include H.264 / AVI, H.265 / MP4, etc., video frame rates include 24, 25, 60, etc., audio formats include AAC(2), WMA(4), etc., and audio bit rates include 64, 128, 256, etc.

[0061] In addition, the control module of the rendering interface may also include an online streaming module, which may include a start streaming option and / or a stop streaming option. When a selection of the start streaming option is received, the live content is streamed online, and if "start streaming" is selected again, the streaming is stopped. If the online streaming module is selected, the display may display a corresponding detailed setting menu, which may include the name of the streaming, the corresponding server, and the streaming key, etc.

[0062] Figure 6 is an example diagram showing a first interface according to an example embodiment of the present disclosure. The first interface may be named "main control panel", and if it has never been used, the main control panel is empty. When a selection of one of the at least one control modules in the at least one second interface (e.g., a camera interface, an input interface, a visual effect control interface, and a rendering interface) is received, the display may display a menu about the currently selected control module, and the menu about the currently selected control module may include an option for adding the currently selected control module to the first interface. In addition, the menu about the currently selected control module may also include at least one of a reset setting option, a restore setting option, a copy setting option, and a paste setting option. In addition, for the character layer module, the menu about the currently selected control module may also include a delete option for deleting the character layer.

[0063] When a selection of the option for adding the currently selected control module to the first interface (main control panel) is received, the currently selected control module is added to the first interface (main control panel).

[0064] Just as an example, Figure 6As shown, a rendering module, an online streaming module, a channel switching module, a camera module, a camera path module, an event trigger module, and a virtual screen module are added to the main control panel. In addition, the menu of the currently selected control module in the first interface includes an option for deleting the currently selected control module from the first interface. When a selection is received for deleting the currently selected control module from the first interface, the currently selected control module can be deleted from the main control panel.

[0065] When live streaming, users can customize and add various control modules to the main control panel according to the situation, and click Start Rendering and Start Pushing. They can play the pre-prepared opening video in "Channel Switching" (for example, a combination of empty shots and music), and then switch to online playback Live, or they can start online playback directly. Users can switch camera settings and paths according to actual conditions, and can also trigger various events in conjunction with the host's performance (for example, building growth, virtual screen rise, etc.). In addition, other needs such as the transformation of virtual screen content can be completed in coordination. Finally, you can choose to end rendering and pushing.

[0066] In the above examples, the at least one second interface may include a camera interface, an input interface, a visual effect control interface, and a rendering interface. However, those skilled in the art should understand that the present disclosure is not limited thereto. For example, the at least one second interface may be only one interface, which includes all modules of the camera interface, input interface, visual effect control interface, and rendering interface. For another example, the at least one second interface may be 2, 3, 5, etc. interfaces, and the developer may set various modules in the corresponding interface according to the situation.

[0067] Figure 7 7 is a schematic block diagram showing a system 700 for implementing live broadcast based on extended reality XR through a user interface according to an example embodiment of the present disclosure. The user interface includes a display. The system 700 may include a receiving unit 710 and an interface display unit 720. The system 700 may be installed in various electronic devices to implement live broadcast based on extended reality XR, or various modules in the system 700 may implement corresponding functions in a separate manner, or the system 700 may be distributed online or in the cloud for use by users.

[0068] The receiving unit 710 may receive a user's selection of an option displayed on the display. When a selection of a first interface or one of at least one second interface for implementing XR-based live broadcast displayed on the display is received, the interface display unit 720 may respectively cause the display to display the first interface or the second interface of the at least one second interface. Each of the at least one second interface includes at least one control module, wherein the control module in the at least one second interface may include an input module for acquiring at least one video signal, a rendering module for rendering a virtual three-dimensional scene to output live broadcast content, and a push stream module for implementing live broadcast, wherein the video signal may include live character information.

[0069] When a selection of one of the at least one control modules is received, the interface display unit 720 may cause the display to display a menu about the currently selected control module, wherein the menu about the currently selected control module may include an option for adding the currently selected control module to the first interface.

[0070] When receiving a selection of the option for adding the currently selected control module to the first interface, the interface display unit 720 may add the currently selected control module to the first interface.

[0071] Figure 8 is a schematic block diagram illustrating an electronic device according to an example embodiment of the present disclosure.

[0072] According to an exemplary embodiment of the present disclosure, an electronic device 800 may also be provided, and the electronic device 800 may include a processor 810 and a memory 820 storing computer executable instructions. When the computer executable instructions are executed by the processor 810, the processor 810 is prompted to execute the method for implementing a live broadcast based on extended reality XR through a user interface according to an exemplary embodiment of the present disclosure.

[0073] According to an embodiment of the present disclosure, a computer-readable storage medium storing instructions may also be provided, wherein when the instructions are executed by at least one processor, the at least one processor is prompted to execute a method for implementing live broadcast based on extended reality XR through a user interface according to an exemplary embodiment of the present disclosure. Examples of computer-readable storage media here include: read-only memory (ROM), random access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD+R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD+R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or optical disk storage, hard disk drive (HDD), solid state drive (SSD), card storage (such as, multimedia card, secure digital (SD) card or extreme digital (XD) card), magnetic tape, floppy disk, magneto-optical data storage device, optical data storage device, hard disk, solid state disk and any other device, any other device is configured to store computer programs and any associated data, data files and data structures in a non-transitory manner and provide the computer programs and any associated data, data files and data structures to a processor or computer so that the processor or computer can execute the computer program. The computer program in the above-mentioned computer-readable storage medium can be run in an environment deployed in a computer device such as a client, a host, an agent device, a server, etc. In addition, in one example, the computer program and any associated data, data files and data structures are distributed on a networked computer system, so that the computer program and any associated data, data files and data structures are stored, accessed and executed in a distributed manner by one or more processors or computers.

[0074] According to an embodiment of the present disclosure, a computer program product may also be provided. Instructions in the computer program product may be executed by at least one processor in an electronic device to perform the method according to the exemplary embodiment of the present disclosure.

[0075] According to the example embodiments of the present disclosure, the method of implementing live broadcast based on extended reality XR through a user interface executed by the processor provides a convenient use environment for the live broadcast behind-the-scenes personnel (users), making it easier for users to understand and operate, and promoting the realization of the functions of live broadcast based on extended reality XR, so that users can conveniently and smoothly complete all operations during the live broadcast process. In addition, for the design of the first interface, the user can add at least one module in the second interface to the first interface as needed, so that the first interface becomes personalized, the user experience is improved, and the user is no longer restricted by the operation during use, so as to better realize the function of live broadcast. In general, it not only improves the user experience, but also better realizes the function of live broadcast based on XR.

[0076] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.

[0077] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the claims.

Claims

1. A method for implementing live broadcast based on extended reality (XR) through a user interface, performed by a processor, wherein: The user interface includes a display, and the method includes: receiving a user selection of an option displayed on the display; When a selection of a first interface or one of at least one second interface for implementing XR-based live broadcasting displayed on a display is received, the display is respectively caused to display the first interface or the second interface of the at least one second interface, Each of the at least one second interface includes at least one control module, wherein the control module in the at least one second interface includes an input module for acquiring at least one video signal, a rendering module for rendering a virtual three-dimensional scene to output live content, and an online streaming module for implementing live broadcast, wherein the video signal includes live character information, wherein, when a selection of one of the at least one control module is received, a menu about the currently selected control module is displayed on the display, wherein the menu about the currently selected control module includes an option for adding the currently selected control module to the first interface; When a selection of the option for adding the currently selected control module to the first interface is received, the currently selected control module is added to the first interface.

2. The method of claim 1, wherein: When the display is respectively made to display the first interface or the second interface among the at least one second interface, a preview window of the output live content is displayed in the displayed first interface or the second interface among the at least one second interface.

3. The method of claim 1, wherein: When a selection of a control module in the first interface is received, the display is caused to display a menu about the currently selected control module in the first interface, wherein the menu about the currently selected control module in the first interface includes an option for deleting the currently selected control module from the first interface, When a selection of the option for deleting the currently selected control module from the first interface is received, the currently selected control module is deleted from the first interface.

4. The method of claim 2, wherein: The at least one second interface includes a camera interface, an input interface, a visual effect control interface and a rendering interface, Among them, the control module of the input interface includes the input module, and the control module of the rendering interface includes the rendering module and the streaming module.

5. The method of claim 4, wherein: The input module of the input interface includes an option for creating a new input source and an option for deleting an input source, wherein: When a selection of the option for creating a new input source is received, a first sub-input module is displayed in the input interface, wherein the first sub-input module includes at least one of an option for selecting an input device, an option for selecting a resolution of an input video, and an option for selecting a frame rate of an input video. When a selection of the first sub-input module is received and a selection of the option for deleting an input source is received, the first sub-input module is deleted in the input interface.

6. The method of claim 5, further comprising: causing the display to display at least one character layer module corresponding to the displayed first sub-input module in the input interface, When a selection of a character layer module among the at least one character layer modules is received, a character layer setting menu is displayed in the input interface, wherein the character layer setting menu includes at least one of the following: a character name input item or name option, a signal source option, a coordinate display item, an option for automatically landing the character, an option for adjusting the height coordinates of the character, an option for making the character face the virtual camera, an option for making the character appear in at least one path of the virtual camera, an option for whether to enable lighting, an option for whether to activate color correction, and a menu for color correction.

7. The method of claim 4, wherein: The control module of the visual effect control interface includes at least one of an event trigger module, a channel switching module, a virtual screen module and a sequence frame module. The event trigger module is used to create, import or select virtual events in live content. The event trigger module includes a new event option, a delete event option, and an event box option for creating, importing, previewing or selecting events. The channel switching module is used to display live content or preset video or preset image in the entire preview window, and includes a new event option, a delete event option, and a video frame option for creating, importing, previewing or selecting live content or video or image to be displayed in the entire preview window. The virtual screen module is used to display a virtual screen in the live content, and includes a new virtual screen panel option, a delete virtual screen panel option, and a virtual screen video frame option for creating, importing, previewing, or selecting a video or image to be played on the virtual screen. The sequence frame module is used to overlay and display preset sequence frames on the live content.

8. A system for implementing live broadcast based on extended reality (XR) through a user interface, wherein the user interface includes a display, and the system includes: a receiving unit configured to receive a user's selection of an option displayed on the display; The interface display unit is configured to, when receiving a selection of a first interface or one of the at least one second interface for implementing XR-based live broadcast displayed on the display, respectively cause the display to display the first interface or the second interface of the at least one second interface, Each of the at least one second interface includes at least one control module, wherein the control module in the at least one second interface includes an input module for acquiring at least one video signal, a rendering module for rendering a virtual three-dimensional scene to output live content, and a streaming module for implementing live broadcast, wherein the video signal includes live character information, Wherein, the interface display unit is further configured as: When a selection of one of the at least one control module is received, causing the display to display a menu about the currently selected control module, wherein the menu about the currently selected control module includes an option for adding the currently selected control module to the first interface, When a selection of the option for adding the currently selected control module to the first interface is received, the currently selected control module is added to the first interface.

9. Electronic equipment, including: at least one processor; at least one memory storing computer executable instructions, Wherein, when the computer executable instructions are executed by at least one of the processors, the at least one processor is prompted to perform the method as claimed in any one of claims 1 to 7.

10. A computer-readable storage medium storing instructions, characterized in that: When the instructions are executed by at least one processor, the at least one processor is prompted to perform the method according to any one of claims 1 to 7.

Images