Virtual scene processing method and device, storage medium, and electronic device

Abstract

The present disclosure belongs to the field of live broadcast technology, and relates to a method and device for processing a virtual scene, a storage medium, and an electronic device. The method includes: providing a live broadcast interface through the anchor terminal, the live broadcast interface includes a video display area, and the video display area displays a virtual scene; providing a component function area in the live broadcast interface, and providing a live broadcast component in the component function area; responding to a trigger operation acting on the live broadcast component, and updating the virtual scene according to the live broadcast component. The present disclosure provides a problem-solving entry for updating the virtual scene through a fusion display by providing a component function area and a corresponding live broadcast component on the live broadcast interface. Furthermore, the virtual scene can be updated through a trigger operation acting on the live broadcast component, and a "picture-in-picture" function based on virtual live broadcast is provided, which meets the business scenario demands of virtual live broadcast, and at the same time will not affect the user's normal viewing of the live broadcast, thereby optimizing the user's live broadcast viewing experience.

Description

Technical Field

[0001] The present disclosure relates to the field of live broadcast technology, and in particular to a method for processing a virtual scene, a device for processing a virtual scene, a computer-readable storage medium, and an electronic device. Background Art

[0002] In live streaming scenarios, the live video screen is a key touchpoint in the user viewing experience, capturing at least 80% of their attention. Carrying more business gameplay information within the live video stream will more effectively reach users and drive actual business conversions.

[0003] However, in current virtual or real-life live broadcasts, background images are typically pre-designed virtual scenes or decorative elements of real scenes, which not only take up a large amount of storage space but also serve no other purpose besides viewing. Even if these are imposed on the live broadcast screen via client-side UI (User Interface) elements, they will still significantly affect the user's normal viewing of the live broadcast due to the inability of the UI elements to integrate with the live broadcast screen, thus degrading the user experience.

[0004] In view of this, there is an urgent need in this field to develop a new method and device for processing virtual scenes.

[0005] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to ordinary technicians in the field. Summary of the Invention

[0006] The purpose of the present disclosure is to provide a virtual scene processing method, a virtual scene processing device, a computer-readable storage medium and an electronic device, thereby overcoming, at least to a certain extent, the technical problem of poor virtual scene display effect caused by the limitations of related technologies.

[0007] Other features and advantages of the present disclosure will become apparent from the following detailed description, or may be learned in part by practice of the present disclosure.

[0008] According to a first aspect of an embodiment of the present invention, a method for processing a virtual scene is provided. A host terminal provides a live broadcast interface, the live broadcast interface includes a video display area, and the video display area displays the virtual scene. The method includes:

[0009] Providing a component function area in the live broadcast interface, wherein the component function area provides a live broadcast component;

[0010] In response to a trigger operation acting on the live broadcast component, the virtual scene is updated according to the live broadcast component.

[0011] In an exemplary embodiment of the present invention, responding to a trigger operation on the live broadcast component and updating the virtual scene according to the live broadcast component includes:

[0012] In response to a trigger operation acting on the live broadcast component, obtaining a component identifier of the live broadcast component;

[0013] Acquire scene element parameters in the virtual scene, and update the virtual scene according to the component identifier and the scene element parameters.

[0014] In an exemplary embodiment of the present invention, the acquiring of scene element parameters in the virtual scene includes:

[0015] Acquiring virtual element parameters of an initial virtual element in the virtual scene;

[0016] A virtual camera parameter of a virtual camera in the virtual scene is acquired, and the virtual element parameter and the virtual camera parameter are determined to be scene element parameters.

[0017] In an exemplary embodiment of the present invention, the virtual camera parameters include: a virtual camera position and a virtual camera angle.

[0018] In an exemplary embodiment of the present invention, updating the virtual scene according to the component identifier and the scene element parameter includes:

[0019] generating a target grid in the virtual scene according to the virtual camera angle;

[0020] In response to the trigger operation ceasing to act, the live broadcast component is displayed in the virtual scene according to the target grid and the component identifier to update the virtual scene.

[0021] In an exemplary embodiment of the present invention, generating a target grid in the virtual scene according to the virtual camera angle includes:

[0022] Using the virtual camera position to filter the initial virtual elements to obtain target virtual elements, and adjusting the virtual scene according to the virtual camera angle to obtain a current scene plane;

[0023] Performing grid processing on the current scene plane to obtain grid indicator lines of the virtual scene, and determining placement conditions of the target virtual element according to the virtual element parameters to obtain a placement determination result;

[0024] A grid culling process is performed on the grid indicator line according to the placement determination result to obtain a target grid in the virtual scene.

[0025] In an exemplary embodiment of the present invention, the virtual element parameters include: element attributes.

[0026] In an exemplary embodiment of the present invention, the element attributes include: placeable elements and non-placeable elements.

[0027] In an exemplary embodiment of the present invention, the step of determining a placement condition of the target virtual element according to the virtual element parameters to obtain a placement determination result includes:

[0028] classifying the target virtual element according to the virtual element parameter to obtain an element classification result;

[0029] A placement condition determination is performed on the element classification result to obtain a placement determination result.

[0030] In an exemplary embodiment of the present invention, after filtering the initial virtual element using the virtual camera position to obtain the target virtual element, the method further includes:

[0031] Obtaining the original element size of the target virtual element;

[0032] A display size calculation is performed on the virtual camera angle and the original element size to obtain a target element size of the target virtual element, and the target virtual element is displayed in the virtual scene according to the target element size.

[0033] In an exemplary embodiment of the present invention, the live broadcast component includes: a video screen component, an effect playback component and a gameplay logic component.

[0034] In an exemplary embodiment of the present invention, displaying the live broadcast component in the virtual scene according to the target grid and the component identifier includes:

[0035] When the live broadcast component is the video screen component, obtaining screen setting parameters of the video screen component;

[0036] Acquire video data corresponding to the picture setting parameters, and perform video decoding processing on the video data to obtain a video picture;

[0037] Scene rendering processing is performed in the video screen according to the target grid and the component identifier to obtain the live broadcast component displayed in the virtual scene.

[0038] In an exemplary embodiment of the present invention, displaying the live broadcast component in the virtual scene according to the target grid and the component identifier includes:

[0039] When the live broadcast component is an effect playback component, obtaining playback effect parameters of the effect playback component;

[0040] Acquire preset material data, and generate an effect screen for the preset material data according to the playback effect parameters to obtain an effect succession screen;

[0041] The live broadcast component displayed in the virtual scene is obtained by performing scene rendering processing in the effect taking-over picture according to the target grid and the component identifier.

[0042] In an exemplary embodiment of the present invention, displaying the live broadcast component in the virtual scene according to the target grid and the component identifier includes:

[0043] When the live broadcast component is the gameplay logic component, obtaining text data corresponding to the gameplay logic component;

[0044] Obtaining a display effect template corresponding to the gameplay logic component, and performing template drawing processing on the text data and the display effect template to obtain a gameplay display screen;

[0045] The live broadcast component displayed in the virtual scene is obtained by performing scene rendering processing in the gameplay display screen according to the target grid and the component identifier.

[0046] According to a second aspect of an embodiment of the present invention, a device for processing a virtual scene is provided. A host terminal provides a live broadcast interface, wherein the live broadcast interface includes a video display area. The video display area displays the virtual scene, including:

[0047] An area providing module is configured to provide a component function area in the live broadcast interface, wherein the component function area provides a live broadcast component;

[0048] The scene update module is configured to respond to a trigger operation acting on the live broadcast component and update the virtual scene according to the live broadcast component.

[0049] According to a third aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a processor and a memory; wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the method for processing a virtual scene in any of the above exemplary embodiments is implemented.

[0050] According to a fourth aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for processing a virtual scene in any of the above exemplary embodiments is implemented.

[0051] As can be seen from the above technical solutions, the virtual scene processing method, virtual scene processing device, computer storage medium, and electronic device in the exemplary embodiments of the present disclosure have at least the following advantages and positive effects:

[0052] The method and apparatus provided in the exemplary embodiments of the present disclosure provide a solution for updating the virtual scene through a fusion display by providing component function areas and corresponding live broadcast components on the live broadcast interface. Furthermore, triggering operations on the live broadcast components can update the virtual scene, providing a "picture-in-picture" function based on virtual live broadcast, meeting the business scenarios of virtual live broadcast without affecting the user's normal viewing of the live broadcast, thereby optimizing the user's live broadcast viewing experience.

[0053] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0055] Figure 1 A flowchart schematically illustrates a method for processing a virtual scene in an exemplary embodiment of the present disclosure;

[0056] Figure 2 Schematically illustrates a screen diagram after a virtual live broadcast is started in an exemplary embodiment of the present disclosure;

[0057] Figure 3 A flowchart schematically illustrating a method for responding to a trigger operation in an exemplary embodiment of the present disclosure is provided;

[0058] Figure 4 A schematic diagram schematically illustrates a flow chart of a method for obtaining scene element parameters in an exemplary embodiment of the present disclosure;

[0059] Figure 5 A flowchart schematically illustrating a method for updating a virtual scene in an exemplary embodiment of the present disclosure is provided;

[0060] Figure 6 A schematic diagram schematically illustrates a flow chart of a method for generating a target grid in an exemplary embodiment of the present disclosure;

[0061] Figure 7 A flowchart schematically illustrates a method for displaying a target virtual element in an exemplary embodiment of the present disclosure;

[0062] Figure 8 A flowchart schematically illustrates a method for determining placement conditions in an exemplary embodiment of the present disclosure;

[0063] Figure 9 A flowchart schematically illustrates a first method for displaying a live broadcast component in an exemplary embodiment of the present disclosure;

[0064] Figure 10 A flowchart schematically illustrates a second method for displaying a live broadcast component in an exemplary embodiment of the present disclosure;

[0065] Figure 11 A schematic diagram schematically illustrates a screen showing a false window effect of a display effect-continuing screen in an exemplary embodiment of the present disclosure;

[0066] Figure 12 A flowchart schematically illustrates a third method for displaying a live broadcast component in an exemplary embodiment of the present disclosure;

[0067] Figure 13 A schematic diagram schematically illustrates a virtual scene displaying a gameplay demonstration screen in an exemplary embodiment of the present disclosure;

[0068] Figure 14 A schematic diagram schematically illustrates the structure of a virtual scene processing device in an exemplary embodiment of the present disclosure;

[0069] Figure 15 Schematically illustrates an electronic device for implementing a method for processing a virtual scene in an exemplary embodiment of the present disclosure;

[0070] Figure 16 A computer-readable storage medium for implementing a method for processing a virtual scene in an exemplary embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0071] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present disclosure will be more comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or that other methods, components, devices, steps, etc. may be employed. In other cases, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0072] The terms "a", "an", "the" and "said" are used in this specification to indicate the presence of one or more elements / components / etc.; the terms "including" and "having" are used to express open-ended inclusion and mean that additional elements / components / etc. may exist in addition to the listed elements / components / etc.; the terms "first" and "second" etc. are used only as labels and are not intended to limit the quantity of their objects.

[0073] In addition, the accompanying drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. Identical reference numerals in the drawings represent identical or similar parts, and thus repeated descriptions thereof will be omitted. Some of the blocks shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically separate entities.

[0074] In live streaming scenarios, the live video screen is a key touchpoint in the user viewing experience, capturing at least 80% of their attention. Carrying more business gameplay information within the live video stream will more effectively reach users and drive actual business conversions.

[0075] However, in current virtual or real-life live broadcasts, the background image is typically a pre-designed virtual scene or real-life decorative element, which not only takes up a large amount of storage space but also serves no purpose other than viewing. Conversely, imposing client-side UI elements on the live broadcast screen, such as notification overlays or treasure chest icons, can significantly impact the user's ability to watch the live broadcast, degrading the user experience because the UI elements cannot blend in with the live broadcast screen.

[0076] In response to the problems existing in the related art, the present disclosure proposes a method for processing virtual scenes, which provides a live broadcast interface through the anchor terminal, and the live broadcast interface includes a video display area, and the video display area displays the virtual scene. Figure 1 A flowchart of a method for processing a virtual scene is shown, Figure 1 As shown, the method for processing a virtual scene includes at least the following steps:

[0077] Step S110. Provide a component function area in the live broadcast interface, and provide a live broadcast component in the component function area.

[0078] Step S120: In response to the triggering operation on the live broadcast component, the virtual scene is updated according to the live broadcast component.

[0079] In the exemplary embodiments of the present disclosure, by providing component function areas and corresponding live broadcast components on the live broadcast interface, a solution is provided for updating the virtual scene through a fusion display. Furthermore, triggering operations on the live broadcast components can update the virtual scene, providing a "picture-in-picture" function based on virtual live broadcast, meeting the business needs of virtual live broadcast without affecting the user's normal viewing of the live broadcast, thus optimizing the user's live broadcast viewing experience.

[0080] The following describes in detail the various steps of the virtual scene processing method.

[0081] In step S110, a component function area is provided in the live broadcast interface, and a live broadcast component is provided in the component function area.

[0082] In an exemplary embodiment of the present disclosure, the host can complete the virtual live broadcast start process through the virtual broadcast start function of the live broadcast software at the host end.

[0083] Figure 2 Schematic diagram of the screen after the virtual live broadcast starts is shown in FIG. Figure 2 As shown, the host sits in front of the green screen and clicks "Start Broadcast." The virtual broadcast process begins in the background. Furthermore, the host selects the UE (Unreal Engine) virtual background to preview the keyed effect in real time, and adjusts the camera angle and other parameters. The virtual broadcast is completed after clicking "Start Broadcast." The host is now in the virtual broadcast state.

[0084] Correspondingly, when the user terminal enters the live broadcast room of the anchor who is in the virtual broadcast, he can watch the live broadcast normally, and can also watch the virtual scene updated after the anchor adds components.

[0085] It is worth noting that the host's update of the virtual scene based on the live broadcast component can be implemented before the broadcast starts, or can be adjusted during the broadcast process. This exemplary embodiment does not specifically limit this.

[0086] In addition to the video display area, the live broadcast interface used by the host through the broadcast client can also provide a component function area. This component function area can be a settings panel, and this settings panel can be a function panel named "Decoration Toolbox". In addition, it can also be a function panel with other names, and this exemplary embodiment does not specifically limit this.

[0087] Furthermore, this exemplary embodiment does not impose any special restrictions on the size, shape, and display position of the software function area on the live broadcast interface.

[0088] Furthermore, a variety of live broadcast components can be provided in the component function area where the function panel of the "decoration toolbox" is located.

[0089] In an optional embodiment, the live broadcast component includes: a video screen component, an effect playback component and a gameplay logic component.

[0090] The video screen component may be a live video stream screen component. The live video stream screen component may be used to carry the real-time video streams of other anchors or the historical live video streams of the current anchor, and may be used to display the opposing screens of other anchors in a PK (Player Killing) scenario or to implement a "picture-in-picture" function for the current anchor.

[0091] Whether to display the real-time video stream of other anchors or the historical live video stream of the current anchor through the video screen component can be determined by the video stream link filled in by the current anchor, or by the option selected by the current anchor. This exemplary embodiment does not make any special restrictions on which video stream to display, nor does it make any special restrictions on the method of determining the video stream.

[0092] The effect playback component may be a nested effect playback component, which may be used to play pre-prepared animations or other decorative elements.

[0093] The gameplay logic component can be a gameplay logic event visualization component. The gameplay logic event visualization component is used to visually display common gameplay logic events in the live broadcast scene, such as activity rankings or the names of gift-giving users.

[0094] In step S120, in response to the triggering operation acting on the live broadcast component, the virtual scene is updated according to the live broadcast component.

[0095] In an exemplary embodiment of the present disclosure, the update of the virtual scene can be achieved through the trigger operation of the anchor acting on the live broadcast component.

[0096] In an alternative embodiment, Figure 3 A flow chart showing a method for responding to a trigger operation is shown in FIG. Figure 3 As shown, the method includes at least the following steps: in step S310, in response to a trigger operation acting on the live broadcast component, the component identifier of the live broadcast component is obtained.

[0097] For example, a host can drag a live broadcast component from the "Decoration Toolbox" function panel, and the live broadcast platform, that is, the host's end, can record the currently selected component identifier. This component identifier can be a component ID (Identity Document) or other data that uniquely identifies the live broadcast component, which is not specifically limited in this exemplary embodiment.

[0098] Furthermore, the host identifier may be sent to the host-side UE instance.

[0099] In step S320, the scene element parameters in the virtual scene are obtained, and the virtual scene is updated according to the component identifier and the scene element parameters.

[0100] After the host UE instance receives the component identifier, it can obtain the scene element parameters of the currently selected virtual scene.

[0101] In an alternative embodiment, Figure 4 A flow chart of a method for obtaining scene element parameters is shown in FIG. Figure 4 As shown, the method at least includes the following steps: in step S410, obtaining virtual element parameters of the initial virtual element in the virtual scene.

[0102] The initial virtual elements may be all virtual elements in the currently selected virtual scene.

[0103] In an optional embodiment, the virtual element parameters include: element attributes.

[0104] The corresponding virtual element parameters may be parameters such as element attributes of each virtual element, and may also include size, position coordinates and other parameters, which are not particularly limited in this exemplary embodiment.

[0105] In an optional embodiment, the element attributes include: placeable elements and non-placeable elements.

[0106] The initial virtual elements may be classified according to their element attributes and divided into placeable elements and non-placeable elements.

[0107] Non-placeable elements include rigid body elements, luminous elements, and key decorative elements. Specifically, rigid body elements have collision properties, and live broadcast components cannot be placed. Luminous elements have luminous properties. When placing live broadcast components, they may block the effective light source in the virtual scene, affecting the scene effect, and therefore cannot be placed. Key decorative elements are virtual elements that play an important role in creating the current virtual scene effect. If live broadcast components are placed, they will affect the overall visual effect of the virtual scene, and therefore cannot be placed.

[0108] For example, in games, the Rigidbody element enables game objects to be controlled by the physics engine, enabling realistic physical performance through the thrust and torque they receive. All game objects must contain a Rigidbody element to implement gravity, apply forces through scripts, or interact with other objects.

[0109] Except for rigid body elements, luminous elements and key decorative elements included in non-placeable elements, other virtual elements will not play a decisive role in the virtual scene. Therefore, live broadcast components can be placed on the surface and can be placeable elements.

[0110] In step S420, virtual camera parameters of the virtual camera in the virtual scene are acquired, and the virtual element parameters and the virtual camera parameters are determined to be scene element parameters.

[0111] The host UE instance can also obtain the virtual camera parameters of the virtual camera in the virtual scene.

[0112] In an optional embodiment, the virtual camera parameters include: a virtual camera position and a virtual camera angle.

[0113] In addition to obtaining the parameters of the virtual camera angle, other attribute parameters may also be obtained according to actual needs, and this exemplary embodiment does not impose any special limitation on this.

[0114] After the virtual element parameters and the virtual camera parameters are acquired, the virtual element parameters and the virtual camera parameters may be determined as scene element parameters.

[0115] In this exemplary embodiment, the virtual element parameters and the virtual camera parameters are obtained and determined as the scene element parameters. The acquisition method is simple and effective, and provides a data basis for subsequent virtual scene updates.

[0116] After obtaining the component identification and scene element parameters, the virtual scene can be updated according to the component identification and scene element parameters.

[0117] In an alternative embodiment, Figure 5 A flow chart of a method for updating a virtual scene is shown in FIG. Figure 5 As shown, the method at least includes the following steps: in step S510, a target grid in a virtual scene is generated according to a virtual camera angle.

[0118] In an alternative embodiment, Figure 6 A flow chart of a method for generating a target grid is shown in FIG. Figure 6 As shown, the method includes at least the following steps: in step S610, the initial virtual elements are screened and filtered using the virtual camera position to obtain the target virtual elements, and the virtual scene is adjusted according to the virtual camera angle to obtain the current scene plane.

[0119] Specifically, the virtual camera position may be a coordinate set of the virtual camera's current visible area. Therefore, the filtering process may involve comparing the initial virtual element's position coordinates with the coordinate set. If the initial virtual element's position coordinates fall within the coordinate set, the initial virtual coordinates may be determined as the target virtual coordinates. If the initial virtual element's position coordinates do not fall within the coordinate set, the initial virtual coordinates may be filtered out.

[0120] Therefore, the target virtual element within the visible area of the virtual camera can be obtained through screening and filtering.

[0121] Furthermore, the display effect of the virtual scene is adjusted according to the virtual camera angle to obtain the current scene plane under the virtual camera angle.

[0122] For example, when the virtual camera angle is 60°, the virtual scene may be tilted 60°, so that the current display effect of the virtual scene after tilting 60° is determined as the current scene plane.

[0123] Correspondingly, the display effect of the target virtual element at this time can also be adjusted according to the virtual camera angle.

[0124] In an alternative embodiment, Figure 7 A flowchart of a method for displaying a target virtual element, such as Figure 7 As shown, the method at least includes the following steps: In step S710, the original element size of the target virtual element is obtained.

[0125] The original element size may be the length or width of the target virtual element, or other size information representing the target virtual element, which is not particularly limited in this exemplary embodiment.

[0126] In step S720 , a display size calculation is performed on the virtual camera angle and the original element size to obtain a target element size of the target virtual element, and the target virtual element is displayed in the virtual scene according to the target element size.

[0127] After obtaining the original element size, the projection size at the current viewing angle of the virtual camera, ie, the target element size, can be calculated according to the virtual camera angle and the original element size.

[0128] For example, when the virtual camera angle is 60° and the original width of the target virtual element is 10 cm, the target width of the target virtual element can be calculated to be 5 cm. That is, the width of the target virtual element is correspondingly reduced by half.

[0129] After obtaining the target element size, the target virtual element may be displayed in the current virtual scene according to the target element size, so as to meet the effect of displaying the virtual element in the virtual scene according to the virtual camera angle.

[0130] In this exemplary embodiment, the target element size for displaying the target virtual element can be obtained by calculating the original element size and the virtual camera angle. The calculation method is simple, which makes the display effect of the virtual scene and the virtual elements therein unified, and optimizes the picture display effect of the virtual scene.

[0131] In step S620, the current scene plane is gridded to obtain grid indicator lines of the virtual scene, and placement conditions of the target virtual element are determined based on the virtual element parameters to obtain a placement determination result.

[0132] After obtaining the current scene plane, the host-side UE instance can perform grid processing on the current scene image captured by the current virtual camera.

[0133] Specifically, the current scene image may be gridded according to a 20 cm x 20 cm grid to obtain grid indicator lines for the currently displayed virtual scene. In addition, gridding may be performed according to other sizes based on actual conditions, and this exemplary embodiment does not impose any particular limitation thereto.

[0134] After the processing is completed, the grid indicator lines for subsequent placement of live broadcast components for interactive adsorption can be displayed in the preview pane of the current virtual scene.

[0135] In an alternative embodiment, Figure 8 A flow chart of a method for determining placement conditions is shown, as shown in FIG. Figure 8 As shown, the method at least includes the following steps: in step S810, the target virtual element is classified according to the virtual element parameters to obtain an element classification result.

[0136] Since the target virtual elements can be rigid elements, luminous elements, key decorative elements and other elements, and rigid elements, luminous elements and key decorative elements are non-placeable elements, while other elements can be non-placeable elements, the target virtual elements can be divided into placeable elements and non-placeable elements according to the virtual element parameters to obtain element classification results.

[0137] In step S820, a placement condition determination is performed on the element classification result to obtain a placement determination result.

[0138] Since the element classification result divides the target virtual elements into placeable elements and non-placeable elements, the placement determination result can be determined as non-placeable for target virtual elements that do not meet the placement preconditions in the current viewing angle according to the element classification result. Correspondingly, the placement determination result for placeable elements can be determined as placeable.

[0139] In this exemplary embodiment, placement conditions of target virtual elements are determined based on virtual element parameters, providing a data basis and theoretical support for further mesh culling processing.

[0140] In step S630 , a grid culling process is performed on the grid indicator line according to the placement determination result to obtain a target grid in the virtual scene.

[0141] After obtaining the placement determination result, the grid indicator line where the placement determination result is located can be further determined. In addition, the grid indicator line coordinates corresponding to the placement determination result that cannot be placed are sent to the live broadcast platform start end.

[0142] After the live broadcast platform receives the coordinates of the grid indicator lines corresponding to the placement determination result that cannot be placed, these grid indicator lines can be subjected to grid culling processing to obtain the target grid determined by the remaining grid indicator lines.

[0143] Furthermore, the grid indicator line in this part is marked red in the preview window, and the anchor is restricted from dragging the live broadcast component there. In addition, there may be other ways to display this part of the grid indicator line in a differentiated manner, such as reducing the size, etc., which is not specifically limited in this exemplary embodiment.

[0144] In this exemplary embodiment, the placement determination result is used to determine the target grid within the virtual scene, which closely matches the virtual element parameters of the target virtual element, providing a visual position indication for the host to place the live broadcast component in the virtual scene, and optimizing the way the host updates the virtual scene.

[0145] In step S520, in response to the trigger operation ceasing to act, the live broadcast component is displayed in the virtual scene according to the target grid and the component identifier to update the virtual scene.

[0146] After obtaining the target grid, the anchor can freely drag the live broadcast component in the selectable target grid to change the intended placement position of the selected live broadcast component.

[0147] When a triggering action, such as a drag operation, stops working, the live broadcast component can be placed in the corresponding target grid. Alternatively, a confirmation button can be set. When the host clicks the confirmation button to start the live broadcast, the live broadcast platform can generate the corresponding component creation instruction and send it to the host's UE instance.

[0148] After receiving the component creation instruction, the host UE instance can generate a base model corresponding to the live component at the corresponding coordinates in the virtual scene based on the coordinate position of the target grid where the live component is currently located and the component identifier. This base model can be a blank model corresponding to the live component, serving as a "placeholder" for the live component to be generated at that location.

[0149] After the host completes the component placement in the preview window, the host can enter the process of displaying the live broadcast component in the virtual scene according to the current live broadcast component and the host's setting details to update the virtual scene.

[0150] In an alternative embodiment, Figure 9 A flow chart showing a first method of displaying a live broadcast component is shown in FIG. Figure 9 As shown, the method includes at least the following steps: in step S910, when the live broadcast component is a video screen component, the screen setting parameters of the video screen component are obtained.

[0151] Among them, the video screen component can be a live video stream screen component. The live video stream screen component can be used to carry the real-time video stream of other anchors or the historical live video stream of the current anchor, etc., and can be used to display the opponent's screen of other anchors in a PK scene, or to realize the "picture-in-picture" function of the current anchor. Specifically, whether the real-time video stream of other anchors or the historical live video stream of the current anchor is displayed through the video screen component can be determined by the video stream link filled in by the current anchor, or it can be determined by the option selected by the current anchor. This exemplary embodiment does not specifically limit which video stream is specifically displayed, nor does it specifically limit the method of determining the video stream.

[0152] The "Picture in Picture" function uses digital technology to display two sets of pictures on the same screen. That is, one or more compressed sub-pictures are inserted into the main picture for normal viewing, so that you can monitor other channels while enjoying the main picture.

[0153] The live broadcast platform's broadcasting end can obtain the host's settings for the video screen component, namely the screen setting parameters. The screen setting parameters determine whether to read the current host's own historical video stream or read other hosts' real-time video streams in gameplay scenarios such as PK.

[0154] In step S920, video data corresponding to the picture setting parameters is acquired, and video decoding processing is performed on the video data to obtain a video picture.

[0155] After obtaining the screen setting parameters of the video screen component, a data request corresponding to the screen setting parameters can be sent to the live broadcast platform server. After receiving the data request, the live broadcast platform server can pull the corresponding video data and send the video data to the live broadcast platform start end.

[0156] After receiving the video data, the live broadcast platform can send it to the host UE instance. The host UE instance decodes the video data to obtain a video image. The video image can be in the form of a video slice.

[0157] For example, video decoding processing can involve expanding compressed video data based on the type of entropy coding to obtain converted coded data. This data includes motion vectors, residual quantization coefficients, and predictive coding parameters. Residual data is then obtained based on the residual quantization coefficients. Furthermore, based on a reference frame, these motion vectors are applied to generate a predicted frame. Finally, the residual data is superimposed on the predicted frame to obtain the current frame. Other video decoding processing methods may also be used, and this exemplary embodiment does not specifically limit this.

[0158] In step S930, scene rendering processing is performed in the video screen according to the target grid and component identifier to obtain the live broadcast component displayed in the virtual scene.

[0159] Since the basic model of the corresponding live broadcast component has been generated at the corresponding position of the target grid according to the target identifier, after obtaining the video screen, the video screen can be filled into the basic model to obtain the live broadcast component that displays the video screen in the virtual scene.

[0160] In this exemplary embodiment, the corresponding video data can be displayed in the virtual scene through the video screen component, thereby realizing a "picture-in-picture" function for the virtual scene.

[0161] In an alternative embodiment, Figure 10 A flow chart of a second method for displaying a live broadcast component is shown. Figure 10 As shown, the method includes at least the following steps: in step S1010, when the live broadcast component is an effect playback component, the playback effect parameters of the effect playback component are obtained.

[0162] The effect playback component may be a nested effect playback component, which may be used to play pre-prepared animations or other decorative elements.

[0163] The host platform can obtain the host's settings for the effect playback component, that is, the playback effect parameters. The playback effect parameters can include the playback effect type and detailed attribute parameters corresponding to the playback effect type.

[0164] The play effect types may include single play, loop play, or segment play, etc., which are not specifically limited in this exemplary embodiment.

[0165] In step S1020, preset material data is acquired, and an effect screen is generated for the preset material data according to the playback effect parameters to obtain an effect succession screen.

[0166] After obtaining the playback effect parameters, a data request corresponding to the playback effect parameters can be sent to the live broadcast platform server. After receiving the data request corresponding to the playback effect parameters, the live broadcast platform server can pull the preset material data for testing the effect and send the preset material data to the live broadcast platform start end.

[0167] After receiving the preset material data, the live broadcast platform can send it to the host UE instance. After receiving the preset material data, the host UE instance can generate the corresponding effect connection screen according to the playback effect parameters set by the host, such as the playback effect type.

[0168] The effect succession picture may be a static picture, a sequence of frames played in a loop, or an effect video played with words, etc. This exemplary embodiment does not impose any special limitation on this.

[0169] In step S1030, scene rendering processing is performed in the effect taking-over picture according to the target grid and component identification to obtain the live broadcast component displayed in the virtual scene.

[0170] Since the basic model of the corresponding live broadcast component has been generated at the corresponding position of the target grid according to the target identifier, after obtaining the effect succession screen, the effect succession screen can be filled into the basic model to obtain the live broadcast component that displays the effect succession screen in the virtual scene.

[0171] Figure 11 A schematic diagram of a screen showing a false window effect of a display effect taking over a screen is shown, as shown in FIG. Figure 11 As shown, the table and chairs in the image are virtual scenes, while the Mars scene in the window is a nested effect frame. This effect frame is nested within the virtual scene. Furthermore, the fake window without the Mars scene can be understood as the base model of the effect playback component, which is filled with the Mars scene.

[0172] In this exemplary embodiment, the corresponding effect succession screen can be displayed in the virtual scene through the effect playback component, and the nested display "picture-in-picture" function can be realized in the virtual scene, which enriches the display form of the "picture-in-picture" function in the virtual scene and optimizes the user's live viewing experience.

[0173] Figure 12 A flow chart of a third method for displaying a live broadcast component is shown. Figure 12 As shown, the method includes at least the following steps: in step S1210, when the live broadcast component is a gameplay logic component, obtain text data corresponding to the gameplay logic component.

[0174] The gameplay logic component may be a gameplay logic event visualization component that is used to visually display common gameplay logic events in a live broadcast scene, such as an activity list or the name of a gift-giving user.

[0175] The live broadcast platform start end can obtain the host's settings for the gameplay logic component, that is, text data. This text data may include gameplay rankings or other information fields of the live broadcast platform, such as user nicknames and support votes, etc. This exemplary embodiment does not specifically limit this.

[0176] After obtaining the host's settings for the gameplay logic component, a data request corresponding to the settings can be sent to the live broadcast platform server. After receiving the data request for text data, the live broadcast platform server can obtain text data for testing the effect and send the text data to the live broadcast platform start end.

[0177] In step S1220, a display effect template corresponding to the gameplay logic component is obtained, and template drawing processing is performed on the text data and the display effect template to obtain a gameplay display screen.

[0178] After receiving the text data, the live broadcast platform can send it to the host UE instance. After receiving the text data, the host UE instance can obtain the corresponding display effect template based on the gameplay logic component.

[0179] The display effect template may include a light board for displaying the audience ID, or may be other effect templates, which is not particularly limited in this exemplary embodiment.

[0180] After the display effect template is determined, the text data can be written into the corresponding display effect template to obtain a gameplay display screen.

[0181] In step S1230, scene rendering processing is performed in the gameplay display screen according to the target grid and component identifier to obtain the live broadcast component displayed in the virtual scene.

[0182] Since the basic model of the corresponding live broadcast component has been generated at the corresponding position of the target grid according to the target identifier, after obtaining the gameplay display screen, the gameplay display screen can be filled into the basic model to obtain the live broadcast component that displays the gameplay display screen in the virtual scene.

[0183] Figure 13 A schematic diagram of a virtual scene showing a gameplay display screen is shown. Figure 13 As shown, the text data can be "Best Support XXXXX," and the corresponding display effect template can be a light board. Furthermore, writing the "Best Support XXXXX" text data into the corresponding light board can produce a gameplay display screen, i.e., a light board filled with the corresponding text data. Then, the light board filled with the corresponding text data is added to the basic model of the gameplay logic component, resulting in a virtual scene with the light board filled with the corresponding text data displayed in the lower left corner.

[0184] In this exemplary embodiment, the corresponding amount of video data can be displayed in the virtual scene through the gameplay logic component, and the "picture-in-picture" function of integrating the display UI elements can be realized in the virtual scene, which enriches the display form of the "picture-in-picture" function in the virtual scene and optimizes the user's live viewing experience.

[0185] After the live broadcast component is displayed in the virtual scene, the corresponding preview effect can be shown to the anchor.

[0186] After the host completes the placement and preview of the live broadcast components in the preview window, they can click Start Broadcast or Update Scene to have the host's UE instance push the updated virtual scene to the audience through the live broadcast platform server. The audience can now view the updated virtual scene.

[0187] After the host-side UE instance completes the update of the virtual scene, the live broadcast platform server can monitor the data interaction events involving the relevant live broadcast components in the current host's live broadcast room.

[0188] The business logic contained in this data interaction event corresponds to the live broadcast component, and can include the current anchor competing with other anchors via a live broadcast. Specifically, a food picture component placed in the virtual scene directly displays the video stream of the live broadcaster in the current virtual scene.

[0189] The business logic contained in the data interaction event may also include participating in gameplay activities. Specifically, the gameplay logic component placed in the virtual scene directly displays the real-time gameplay rankings or other business-related text data in the current virtual scene.

[0190] The business logic contained in this data interaction event can also include the host setting other visual effects. Specifically, the effect playback component placed in the virtual scene directly displays the video image or other picture-in-picture effects that the host needs to present to the user end, such as a fake window effect.

[0191] When it is detected that the anchor or user triggers the relevant business logic, the live broadcast platform backend server will send the relevant data presented in the required live broadcast component to the anchor's broadcast end, and then the anchor's broadcast end will forward the relevant data to the anchor's UE instance.

[0192] After receiving the data, the host UE instance can use different live broadcast components Figure 9 、 Figure 10 and Figure 12 The display mode of the live broadcast component shown in the figure corresponds to the execution of different processing flows. Specifically, the processing flow is the same as Figure 9 、 Figure 10 and Figure 12 Similar, no further description is given here.

[0193] It is worth noting that at this time Figure 9 、 Figure 10 and Figure 12 The processing flow shown here uses real data, such as real video data, material data, and text data.

[0194] Specifically, when the real data is video data, the live streaming platform server, upon receiving a data request corresponding to the screen setting parameters, can pull the real video data from other live streams or the real video data from the current streamer's past live broadcasts. Furthermore, the real video data is sent to the live streaming platform's broadcasting end, so that the live streaming component populated with the real video data is displayed in the virtual scene.

[0195] When the real data is material data, the live broadcast platform server can pull the material data for real display after receiving the data request corresponding to the playback effect parameters. Further, the material data to be displayed is sent to the live broadcast platform start end, so that the live broadcast component filled with the real material data is displayed in the virtual scene.

[0196] When the real data is text data, the live broadcast platform server can pull the text data for real display after receiving the data request corresponding to the gameplay logic component. For example, when filling text data into the display effect template of the light board, the obtained text data must be a real user nickname. Or in other scenarios, the user's real number of support votes is obtained, etc. This exemplary embodiment does not specifically limit this. Further, the text data to be displayed in reality is sent to the live broadcast platform start end to display the live broadcast component filled with real text data in the virtual scene.

[0197] The host UE instance follows Figure 9 、 Figure 10 or Figure 12After the processing flow shown completes the update of the virtual scene, it can be pushed to the client on the user side through the live broadcast platform server, thereby realizing the "picture-in-picture" function based on virtual live broadcast and carrying the demands of the business scenario.

[0198] In the virtual scene processing method, through the pre-process of virtual broadcasting, the anchor can normally start the virtual live broadcast, so that the audience can enter the virtual live broadcast room to watch the live broadcast.

[0199] Furthermore, through the toolbox component placement detection and processing process, that is, the screening and filtering of the initial virtual elements and the determination of the placement conditions of the target virtual elements, the host-side UE instance can mesh the size or position of the current virtual scene and live broadcast components after the host opens the "Decoration Toolbox", and perform grid detection on the projection direction of the virtual camera, so as to determine whether the required live broadcast components can be placed in the virtual scene for use in subsequent processes.

[0200] Then, in the toolbox component data intercommunication and effect preview process, after the live broadcast component is placed, the anchor end UE instance, the live broadcast platform start end and the live broadcast device end can generate corresponding elements in the virtual scene according to the type of live broadcast component and transmit simulation data. The anchor start segment can preview and make secondary adjustments to the generated effect of the live broadcast component.

[0201] Finally, in the component's corresponding business scenario processing and presentation process, when the virtual scene is updated, the live broadcast component can obtain other live broadcast content data and gameplay logic events based on the corresponding gameplay or related business logic, and present the corresponding data in the virtual scene, thereby realizing the "picture-in-picture" function based on the virtual live broadcast room.

[0202] Therefore, the virtual scene processing method is based on the virtual live broadcast room. Through data interaction between the live broadcast platform start end, the host end UE instance and the live broadcast platform server end, according to the virtual scene matching interaction method corresponding to the provided "decoration toolbox" machine, the host is allowed to freely place controllable playback elements, other pre-set video stream images and other gameplay logic event visualization components in the virtual scene. When the host starts broadcasting, other video streams, gameplay visualization elements or other visual effect elements can be flexibly presented in the virtual broadcast scene, thereby realizing the "picture-in-picture" function of the host's video stream image, meeting the demands of business scenarios such as host PK.

[0203] The virtual scene processing method in the exemplary embodiment of the present disclosure provides a problem-solving entry point for updating the virtual scene through a fusion display by providing component function areas and corresponding live broadcast components on the live broadcast interface. Furthermore, triggering operations on the live broadcast components can update the virtual scene, providing a "picture-in-picture" function based on virtual live broadcast, meeting the business scenarios of virtual live broadcast without affecting the user's normal viewing of the live broadcast, thereby optimizing the user's live broadcast viewing experience.

[0204] In addition, in an exemplary embodiment of the present disclosure, a virtual scene processing device is also provided, which provides a live broadcast interface through the anchor terminal, and the live broadcast interface includes a video display area, and the video display area displays the virtual scene. Figure 14 A schematic diagram of the structure of a virtual scene processing device is shown in FIG. Figure 14 As shown, the virtual scene processing device 1400 may include: an area providing module 1410 and a scene updating module 1420.

[0205] The area providing module 1410 is configured to provide a component function area in the live broadcast interface, and provide a live broadcast component in the component function area; the scene updating module 1420 is configured to respond to the trigger operation acting on the live broadcast component and update the virtual scene according to the live broadcast component.

[0206] In an exemplary embodiment of the present invention, responding to a trigger operation on the live broadcast component and updating the virtual scene according to the live broadcast component includes:

[0207] In response to a trigger operation acting on the live broadcast component, obtaining a component identifier of the live broadcast component;

[0208] Acquire scene element parameters in the virtual scene, and update the virtual scene according to the component identifier and the scene element parameters.

[0209] In an exemplary embodiment of the present invention, the acquiring of scene element parameters in the virtual scene includes:

[0210] Acquiring virtual element parameters of an initial virtual element in the virtual scene;

[0211] A virtual camera parameter of a virtual camera in the virtual scene is acquired, and the virtual element parameter and the virtual camera parameter are determined to be scene element parameters.

[0212] In an exemplary embodiment of the present invention, the virtual camera parameters include: a virtual camera position and a virtual camera angle.

[0213] In an exemplary embodiment of the present invention, updating the virtual scene according to the component identifier and the scene element parameter includes:

[0214] generating a target grid in the virtual scene according to the virtual camera angle;

[0215] In response to the trigger operation ceasing to act, the live broadcast component is displayed in the virtual scene according to the target grid and the component identifier to update the virtual scene.

[0216] In an exemplary embodiment of the present invention, generating a target grid in the virtual scene according to the virtual camera angle includes:

[0217] Using the virtual camera position to filter the initial virtual elements to obtain target virtual elements, and adjusting the virtual scene according to the virtual camera angle to obtain a current scene plane;

[0218] Performing grid processing on the current scene plane to obtain grid indicator lines of the virtual scene, and determining placement conditions of the target virtual element according to the virtual element parameters to obtain a placement determination result;

[0219] A grid culling process is performed on the grid indicator line according to the placement determination result to obtain a target grid in the virtual scene.

[0220] In an exemplary embodiment of the present invention, the virtual element parameters include: element attributes.

[0221] In an exemplary embodiment of the present invention, the element attributes include: placeable elements and non-placeable elements.

[0222] In an exemplary embodiment of the present invention, the step of determining a placement condition of the target virtual element according to the virtual element parameters to obtain a placement determination result includes:

[0223] classifying the target virtual element according to the virtual element parameter to obtain an element classification result;

[0224] A placement condition determination is performed on the element classification result to obtain a placement determination result.

[0225] In an exemplary embodiment of the present invention, after filtering the initial virtual element using the virtual camera position to obtain the target virtual element, the method further includes:

[0226] Obtaining the original element size of the target virtual element;

[0227] A display size calculation is performed on the virtual camera angle and the original element size to obtain a target element size of the target virtual element, and the target virtual element is displayed in the virtual scene according to the target element size.

[0228] In an exemplary embodiment of the present invention, the live broadcast component includes: a video screen component, an effect playback component and a gameplay logic component.

[0229] In an exemplary embodiment of the present invention, displaying the live broadcast component in the virtual scene according to the target grid and the component identifier includes:

[0230] When the live broadcast component is the video screen component, obtaining screen setting parameters of the video screen component;

[0231] Acquire video data corresponding to the picture setting parameters, and perform video decoding processing on the video data to obtain a video picture;

[0232] Scene rendering processing is performed in the video screen according to the target grid and the component identifier to obtain the live broadcast component displayed in the virtual scene.

[0233] In an exemplary embodiment of the present invention, displaying the live broadcast component in the virtual scene according to the target grid and the component identifier includes:

[0234] When the live broadcast component is an effect playback component, obtaining playback effect parameters of the effect playback component;

[0235] Acquire preset material data, and generate an effect screen for the preset material data according to the playback effect parameters to obtain an effect succession screen;

[0236] The live broadcast component displayed in the virtual scene is obtained by performing scene rendering processing in the effect taking-over picture according to the target grid and the component identifier.

[0237] In an exemplary embodiment of the present invention, displaying the live broadcast component in the virtual scene according to the target grid and the component identifier includes:

[0238] When the live broadcast component is the gameplay logic component, obtaining text data corresponding to the gameplay logic component;

[0239] Obtaining a display effect template corresponding to the gameplay logic component, and performing template drawing processing on the text data and the display effect template to obtain a gameplay display screen;

[0240] The live broadcast component displayed in the virtual scene is obtained by performing scene rendering processing in the gameplay display screen according to the target grid and the component identifier.

[0241] The specific details of the above-mentioned virtual scene processing device 1400 have been described in detail in the corresponding virtual scene processing method, so they are not repeated here.

[0242] It should be noted that although several modules or units of the virtual scene processing device 1400 are mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in a single module or unit. Conversely, the features and functions of a single module or unit described above can be further divided and embodied by multiple modules or units.

[0243] In addition, in an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0244] Refer to the following Figure 15 15. An electronic device 1500 according to such an embodiment of the present invention is described. Figure 15 The electronic device 1500 shown is merely an example and should not limit the functions and scope of use of the embodiments of the present invention.

[0245] like Figure 15 As shown, electronic device 1500 is implemented as a general-purpose computing device. Components of electronic device 1500 may include, but are not limited to, the aforementioned at least one processing unit 1510, the aforementioned at least one storage unit 1520, a bus 1530 connecting various system components (including storage unit 1520 and processing unit 1510), and a display unit 1540.

[0246] The storage unit stores program codes, which can be executed by the processing unit 1510, so that the processing unit 1510 performs the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.

[0247] The storage unit 1520 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 1521 and / or a cache memory unit 1522 , and may further include a read-only memory unit (ROM) 1523 .

[0248] The storage unit 1520 may also include a program / utility 1524 having a set (at least one) of program modules 1525, such program modules 1525 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.

[0249] Bus 1530 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0250] Electronic device 1500 can also communicate with one or more external devices 1700 (e.g., a keyboard, pointing device, Bluetooth device, etc.), one or more devices that enable a user to interact with electronic device 1500, and / or any device that enables electronic device 1500 to communicate with one or more other computing devices (e.g., a router, modem, etc.). Such communication can occur via input / output (I / O) interface 1550. Furthermore, electronic device 1500 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via network adapter 1560. As shown, network adapter 1560 communicates with other modules of electronic device 1500 via bus 1530. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with electronic device 1500, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0251] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0252] In exemplary embodiments of the present disclosure, a computer-readable storage medium is also provided, storing a program product capable of implementing the aforementioned methods of this specification. In some possible embodiments, various aspects of the present invention may also be implemented in the form of a program product comprising program code. When the program product is executed on a terminal device, the program code is configured to cause the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the "Exemplary Methods" section of this specification.

[0253] refer to Figure 16 As shown, a program product 1600 for implementing the above method according to an embodiment of the present invention is described. The program product 1600 may be a portable compact disk read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0254] The program product may be implemented in any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0255] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transfer a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0256] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0257] The program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, and the like, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0258] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow from the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.

Claims

1. A method for processing a virtual scene, characterized in that: The host terminal provides a live broadcast interface, wherein the live broadcast interface includes a video display area, and the video display area displays a virtual scene. The method includes: A component function area is provided in the live broadcast interface, and a live broadcast component is provided in the component function area; the live broadcast component includes: a video screen component, an effect playback component, and a gameplay logic component. The video screen component is used to carry the real-time video stream of other anchors or the anchor's historical live video stream. The effect playback component is a nested effect playback component used to play pre-configured animations or other decorative elements. The gameplay logic component is used to visually display gameplay logic events. In response to the trigger operation acting on the live broadcast component, scene rendering processing is performed in the display screen corresponding to the live broadcast component to obtain the live broadcast component that displays the display screen in the virtual scene, so as to be integrated with the virtual scene for display and obtain an updated virtual scene.

2. The method for processing a virtual scene according to claim 1, characterized in that: The method further comprises: In response to a triggering operation on the live broadcast component, obtaining a component identifier of the live broadcast component; Acquire scene element parameters in the virtual scene, and update the virtual scene according to the component identifier and the scene element parameters.

3. The method for processing a virtual scene according to claim 2, wherein: The obtaining of scene element parameters in the virtual scene includes: Acquiring virtual element parameters of an initial virtual element in the virtual scene; A virtual camera parameter of a virtual camera in the virtual scene is acquired, and the virtual element parameter and the virtual camera parameter are determined to be scene element parameters.

4. The method for processing a virtual scene according to claim 3, wherein: The virtual camera parameters include: virtual camera position and virtual camera angle.

5. The method for processing a virtual scene according to claim 4, characterized in that: The updating of the virtual scene according to the component identifier and the scene element parameter includes: generating a target grid in the virtual scene according to the virtual camera angle; In response to the trigger operation ceasing to act, the live broadcast component is displayed in the virtual scene according to the target grid and the component identifier to update the virtual scene.

6. The method for processing a virtual scene according to claim 5, characterized in that: Generating a target grid in the virtual scene according to the virtual camera angle includes: Using the virtual camera position to filter the initial virtual elements to obtain target virtual elements, and adjusting the virtual scene according to the virtual camera angle to obtain a current scene plane; Performing grid processing on the current scene plane to obtain grid indicator lines of the virtual scene, and determining placement conditions of the target virtual element according to the virtual element parameters to obtain a placement determination result; A grid culling process is performed on the grid indicator line according to the placement determination result to obtain a target grid in the virtual scene.

7. The method for processing a virtual scene according to claim 6, characterized in that: The virtual element parameters include: element attributes.

8. The method for processing a virtual scene according to claim 7, characterized in that: The element attributes include: placeable elements and non-placeable elements.

9. The method for processing a virtual scene according to claim 8, characterized in that: The determining the placement condition of the target virtual element according to the virtual element parameters to obtain a placement determination result includes: classifying the target virtual element according to the virtual element parameter to obtain an element classification result; A placement condition determination is performed on the element classification result to obtain a placement determination result.

10. The method for processing a virtual scene according to claim 6, characterized in that: After the initial virtual element is filtered using the virtual camera position to obtain a target virtual element, the method further includes: Obtaining the original element size of the target virtual element; A display size calculation is performed on the virtual camera angle and the original element size to obtain a target element size of the target virtual element, and the target virtual element is displayed in the virtual scene according to the target element size.

11. The method for processing a virtual scene according to claim 5, characterized in that: The displaying of the live broadcast component in the virtual scene according to the target grid and the component identifier includes: When the live broadcast component is the video screen component, obtaining screen setting parameters of the video screen component; Acquire video data corresponding to the picture setting parameters, and perform video decoding processing on the video data to obtain a video picture; Scene rendering processing is performed in the video screen according to the target grid and the component identifier to obtain the live broadcast component displayed in the virtual scene.

12. The method for processing a virtual scene according to claim 5, characterized in that: The displaying of the live broadcast component in the virtual scene according to the target grid and the component identifier includes: When the live broadcast component is an effect playback component, obtaining playback effect parameters of the effect playback component; Acquire preset material data, and generate an effect screen for the preset material data according to the playback effect parameters to obtain an effect succession screen; The live broadcast component displayed in the virtual scene is obtained by performing scene rendering processing in the effect taking-over picture according to the target grid and the component identifier.

13. The method for processing a virtual scene according to claim 5, characterized in that: The displaying of the live broadcast component in the virtual scene according to the target grid and the component identifier includes: When the live broadcast component is the gameplay logic component, obtaining text data corresponding to the gameplay logic component; Obtaining a display effect template corresponding to the gameplay logic component, and performing template drawing processing on the text data and the display effect template to obtain a gameplay display screen; The live broadcast component displayed in the virtual scene is obtained by performing scene rendering processing in the gameplay display screen according to the target grid and the component identifier.

14. A virtual scene processing device, characterized in that: The host terminal provides a live broadcast interface, which includes a video display area. The video display area displays a virtual scene, including: An area providing module is configured to provide a component function area in the live broadcast interface, wherein the component function area provides a live broadcast component; the live broadcast component includes: a video screen component, an effect playback component, and a gameplay logic component; the video screen component is used to carry the real-time video stream of other anchors or the anchor's historical live video stream; the effect playback component is a nested effect playback component used to play pre-configured animations or other decorative elements; and the gameplay logic component is used to visually display gameplay logic events; The scene update module is configured to respond to a trigger operation acting on the live broadcast component, perform scene rendering processing in the display screen corresponding to the live broadcast component, obtain a live broadcast component that displays the display screen in the virtual scene, and display it in integration with the virtual scene to obtain an updated virtual scene.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for processing a virtual scene according to any one of claims 1 to 13 is implemented.

16. An electronic device, characterized in that: include: processor; a memory for storing executable instructions of the processor; The processor is configured to execute the virtual scene processing method according to any one of claims 1 to 13 by executing the executable instructions.

Images