Virtual live performance design method and device, electronic equipment and storage medium

Abstract

The present disclosure provides a virtual live performance stage design configuration method and device, electronic equipment and storage medium. The virtual live performance stage design configuration method comprises: providing a first window for configuring virtual live performance stage design effects; obtaining first stage design configuration information generated by user operation on a stage design component and a timeline setting area; generating a first stage design component sequence according to the first stage design configuration information, the first stage design component sequence containing a stage design component selected by the user and the stage design components being sorted according to their timeline positions; obtaining first stage design saving information generated by user operation on a save button; under the triggering of the first stage design saving information, generating first stage design data and a first switch corresponding to the first stage design data using the first stage design component sequence, the first switch being used to trigger output of the first stage design data so as to simultaneously present corresponding stage design effects in the virtual live performance process. The present disclosure can realize asynchronous control of stage design and virtual character performance, and improve the stage design effects and viewing experience of virtual live performance.

Description

Technical Field

[0001] This disclosure relates to a method, apparatus, electronic device, and storage medium for setting up a stage for virtual live streaming. Background Technology

[0002] In live streaming scenarios featuring virtual characters, if users need to set specific stage effects, lighting effects, sound effects, camera movement effects, or other additional effects, they need to manually operate the camera to simulate movement in order to complete the settings, or they need to pre-render a fixed video offline and then play it during the live stream. Neither of these methods can achieve coordinated changes between the virtual character and the additional effects, and the operation is cumbersome and difficult to apply easily during live streaming of virtual characters. Summary of the Invention

[0003] To address at least one of the aforementioned technical problems, this disclosure provides a method, apparatus, electronic device, and storage medium for configuring stage design in virtual live streaming.

[0004] According to one aspect of this disclosure, a method for configuring stage design for virtual live streaming is provided, comprising:

[0005] A first window is provided for configuring virtual live streaming stage effects. The first window includes a stage component selection area, a timeline setting area, and a save button. The stage component selection area is provided with stage components that can be selected by the user.

[0006] Obtain the initial stage design configuration information generated by user operations on the stage design components and timeline settings area;

[0007] A first stage design component sequence is generated based on the first stage design configuration information. The first stage design component sequence includes the stage design components selected by the user and the stage design components are sorted according to their timeline positions.

[0008] Obtain the first stage design saving information generated by the user's operation on the save button;

[0009] Triggered by the first stage design information, the first stage design data and the corresponding first switch are generated using the first stage design component sequence. The first switch is used to trigger the output of the first stage design data so that the corresponding stage design effects can be presented simultaneously during the virtual live broadcast.

[0010] In some embodiments, the first window further includes: a preview area, wherein the preview area is provided with a play button and / or a pause button; the method further includes: acquiring preview playback information generated by user operation on the play button in the preview area, and, triggered by the preview playback information, playing the first stage design data while playing the real-time video of the virtual character in the preview area; and / or, acquiring preview pause information generated by user operation on the pause button in the preview area, and, triggered by the preview pause information, pausing the playback of the first stage design data while playing the real-time video of the virtual character in the preview area.

[0011] In some implementations, the preview area is further provided with a record button and / or a file button; the method further includes: obtaining recording start information generated by user operation on the record button in the preview area; triggering the recording start information; recording the virtual character video and stage effects played in real time in the preview area; and saving the recorded video data to a specified storage space according to pre-configured default path information or video save path information generated by user operation on the file button.

[0012] In some embodiments, the stage design components include at least one camera movement component, at least one audio component, and / or at least one lighting component; the stage design component sequence includes: a camera movement component sequence, a lighting component sequence, and / or a background music sequence.

[0013] In some implementations, a first stage design component sequence is generated based on the first stage design configuration information, including:

[0014] When the first stage design configuration information includes information on two or more camera movement components with overlapping timeline positions, the two or more camera movement components are added to the camera movement component sequence, and the order of the two or more camera movement components is determined according to their selection time and timeline position. The duration of each camera movement component in the camera movement component sequence is fixed; and / or,

[0015] When the first stage design configuration information contains information about two or more light effect components with overlapping timeline positions, the two or more light effect components are added to the light effect component sequence, and the order of the two or more light effect components is determined according to their selection time and timeline position; and / or,

[0016] When the time axis position interval of two or more light effect components in the first stage design configuration information is less than a first predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to their time axis positions, while preserving the gaps between the light effect components; and / or,

[0017] When the time axis position interval of two or more light effect components in the first stage design configuration information is less than the second predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, and light effects of the second predetermined duration are filled between adjacent light effect components.

[0018] The duration of each light effect component in the light effect component sequence is the user-defined duration or default duration in the first stage design configuration information, and the duration of each light effect component is not less than the second predetermined duration.

[0019] In some implementations, the method further includes: generating visualization data of the first stage component sequence, and outputting the visualization data of the first stage component sequence through the time axis setting area, so as to present the visualization graphics of the first stage component sequence in the time axis setting area.

[0020] In some embodiments, the first window further includes a reset button; the method further includes: acquiring first stage design reset information generated by user operation on the reset button; and deleting the first stage design component sequence when triggered by the first stage design reset information.

[0021] According to a second aspect of this disclosure, a stage setup device for virtual live streaming is provided, comprising:

[0022] A providing unit is used to provide a first window for configuring virtual live streaming stage effects. The first window includes a stage component selection area, a timeline setting area, and a save button. The stage component selection area is provided with stage components that can be selected by the user.

[0023] The first acquisition unit is used to acquire first stage design configuration information generated by user operations on the stage design components and timeline setting area; and to acquire first stage design save information generated by user operations on the save button.

[0024] A stage design component sequence unit is used to generate a first stage design component sequence based on the first stage design configuration information. The first stage design component sequence includes stage design components selected by the user and the stage design components are sorted according to their timeline positions.

[0025] The stage design data acquisition unit is used to generate first stage design data and a first switch corresponding to the first stage design data by utilizing the first stage design component sequence when triggered by the first stage design information. The first switch is used to trigger the output of the first stage design data so that the corresponding stage design effects can be presented simultaneously during the virtual live broadcast.

[0026] According to a third aspect of this disclosure, an electronic device is provided, comprising:

[0027] Memory, the memory storing execution instructions; and

[0028] The processor executes the execution instructions stored in the memory, causing the processor to execute the aforementioned virtual live streaming stage configuration method.

[0029] According to a fourth aspect of this disclosure, a readable storage medium is provided, wherein executable instructions are stored therein, which, when executed by a processor, are used to implement the aforementioned stage design configuration method for virtual live streaming.

[0030] According to the embodiments of this disclosure, users can complete the stage design configuration for virtual live streaming by manipulating the stage design components and timeline, realizing asynchronous control of stage design and virtual character performance. During the virtual live streaming, users can add their own configured stage design effects to the virtual character performance through the first switch, which can effectively simplify the user configuration operation of virtual live streaming stage design effects, greatly reduce the difficulty for users to create virtual animations, and improve the stage design effect and viewing experience of virtual live streaming. Attached Figure Description

[0031] The accompanying drawings illustrate exemplary embodiments of the present disclosure and, together with the description thereof, serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0032] Figure 1 This is an example architecture diagram of a virtual live streaming system to which this disclosure applies.

[0033] Figure 2 This is a flowchart illustrating a method for configuring the stage for virtual live streaming according to one embodiment of the present disclosure.

[0034] Figure 3 This is an example diagram of a first window according to one embodiment of the present disclosure.

[0035] Figure 4 This is an example diagram of the interface for selecting the stage components in the first window according to one embodiment of this disclosure.

[0036] Figure 5 This is an example diagram of the preview area in the first window according to one embodiment of the present disclosure.

[0037] Figure 6 This is an example diagram of the interface of the timeline setting area in the first window according to an embodiment of the present disclosure.

[0038] Figure 7 This is an example diagram of a virtual live streaming stage setup device that employs a hardware implementation of a processing system according to one embodiment of the present disclosure. Detailed Implementation

[0039] The present disclosure will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of the disclosure. Furthermore, it should be noted that, for ease of description, only the parts relevant to the present disclosure are shown in the accompanying drawings.

[0040] It should be noted that, where there is no conflict, the embodiments and features described in this disclosure can be combined with each other. The technical solutions of this disclosure will now be described in detail with reference to the accompanying drawings and embodiments.

[0041] Unless otherwise stated, the exemplary implementations / embodiments shown are to be understood as providing exemplary features of various details that provide ways in which the technical concepts of this disclosure can be implemented in practice. Therefore, unless otherwise stated, the features of various implementations / embodiments may be additionally combined, separated, interchanged and / or rearranged without departing from the technical concepts of this disclosure.

[0042] The use of crosshairs and / or shading in the accompanying drawings is generally used to clarify the boundaries between adjacent components. Thus, unless otherwise stated, the presence or absence of crosshairs or shading does not convey or indicate any preference or requirement for the specific material, material properties, dimensions, proportions, commonalities between the illustrated components, or any other characteristics, properties, etc., of the components. Furthermore, in the accompanying drawings, the dimensions and relative dimensions of components may be exaggerated for clarity and / or descriptive purposes. When exemplary embodiments can be implemented differently, a specific process sequence may be performed in a different order than that described. For example, two consecutively described processes may be performed substantially simultaneously or in the reverse order of their description. Furthermore, the same reference numerals denote the same components.

[0043] When a component is referred to as being "on" or "above" another component, "connected to," or "joined to" another component, the component may be directly on, directly connected to, or directly joined to the other component, or there may be intermediate components. However, when a component is referred to as being "directly on" another component, "directly connected to," or "directly joined to" another component, there are no intermediate components. Therefore, the term "connection" can refer to a physical connection, an electrical connection, etc., and may or may not have intermediate components.

[0044] The terminology used herein is for the purpose of describing particular embodiments and is not intended to be limiting. As used herein, unless the context clearly indicates otherwise, the singular forms “a” and “the” are intended to include the plural forms as well. Furthermore, when the terms “comprising” and / or “including” and variations thereof are used in this specification, it indicates the presence of the stated features, integrals, steps, operations, parts, components, and / or groups thereof, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, parts, components, and / or groups thereof. It should also be noted that, as used herein, the terms “substantially,” “about,” and other similar terms are used as approximate terms rather than as terms of degree, thus explaining the inherent biases in measurements, calculated values, and / or provided values ​​that would be recognized by one of ordinary skill in the art.

[0045] Figure 1 A schematic diagram of the network structure of a virtual live streaming system 100 to which embodiments of this disclosure apply is shown. Figure 1 As shown, the virtual live streaming system 100 to which this disclosure applies may include: a terminal 110, a server 120, a driving engine 130, and a database 140. The terminal 110 can interact with the user through a webpage, application, or other type of interface to obtain information or instructions input by the user, and initiate requests to the server 120 based on the information or instructions input by the user.

[0046] Server 120 can be used to provide a virtual character live streaming viewing interface and a virtual character live streaming control interface to the terminal according to the terminal's request. The virtual character live streaming viewing interface allows users such as viewers to watch virtual character videos broadcast live by users such as the broadcaster, while the virtual character live streaming control interface allows users such as the broadcaster to control the virtual character's actions and / or expressions in real time to achieve their desired virtual character live stream. The first window of this disclosure can be configured in the virtual character live streaming control interface.

[0047] The driving engine 130 is used to build, render and drive virtual characters to display specified actions, pre-defined expressions and set 3D images of virtual characters in a specified scene. The driving engine can provide images and other data of virtual characters to the terminal 110 through the interface JSON of the server 120, so that the terminal 110 can play the video of virtual characters in real time in user interfaces such as the virtual character live viewing interface and the virtual character live control interface.

[0048] Database 140 can be used to store data for building, rendering, and / or driving virtual characters, configuration data for the virtual character live streaming viewing interface, configuration data for the virtual character live streaming control interface, etc. In addition, database 140 can also be used to store configuration data for the first window of this disclosure, stage design data for various stage design components, etc.

[0049] It should be noted that, Figure 1 This is merely an exemplary architecture for the system to which this disclosure applies. In specific applications, it can be flexibly adjusted according to actual needs, application scenarios, and other factors.

[0050] Figure 2 A flowchart illustrating a method for configuring the stage for virtual live streaming according to some embodiments of this disclosure is shown. Figure 2 The stage design configuration method shown can be implemented using devices such as server 120.

[0051] like Figure 2 As shown in this embodiment, the stage design configuration method for virtual live streaming may include the following steps S202 to S208:

[0052] Step S202: Provide a first window for configuring virtual live streaming stage effects;

[0053] Specifically, server 120 can generate a visual interface of the first window using the visual data of the first window pre-stored in database 140, and push the visual interface of the first window to terminal 110 so that terminal 110 can display the visual interface of the first window to the user.

[0054] In some implementations, the push and display of the first window can be triggered by user operation. For example, users such as the live streamer can operate buttons such as stage design configuration on the virtual character live streaming control interface displayed on terminal 110. Terminal 110 can then respond to this user operation by sending a request for the first window to server 120. After receiving the request from terminal 110, server 120 can push the visual interface of the first window to terminal 110. Then, terminal 110 can display the visual interface of the first window to the user so that the user can make personalized stage design configurations for the virtual live stream.

[0055] In some implementations, the first window can support operations such as scaling, maximizing, minimizing, and closing. The scaling of the first window can be proportional scaling, meaning it supports scaling while maintaining a limited aspect ratio.

[0056] Figure 3 An exemplary partition diagram of the first window is shown. The first window may include a stage component selection area, a timeline setting area, and a save button. The stage component selection area contains stage components that the user can select.

[0057] In some implementations, the stage design components may include at least one camera movement component, at least one audio component, and / or at least one lighting component.

[0058] Figure 4 An example screenshot of the interface for selecting stage components is shown. Figure 4 As shown, the stage design component selection area provides stage design components for users to choose from. The visualization data of the stage design components and their corresponding stage design data can be pre-configured through server 120, and the visualization data of the stage design components and their stage design data can be stored in server 120 or database 130.

[0059] The stage design data for each stage design component is used to present the corresponding stage design effect. For example, for a camera movement component representing "pull in," its corresponding stage design data is camera movement data, which is used to present the live broadcast effect of the camera pulling in a virtual character within the time period indicated by the timeline position of the camera movement component. For a certain lighting effect component, its corresponding stage design data is lighting effect data, which is used to present a specific lighting effect within the time period indicated by the timeline position of the lighting effect component.

[0060] The visualization data for stage design components may include, but is not limited to, information such as the component's icon, name, and tags. The tags of stage design components indicate their categories. Each tag corresponds to a tag display page, and tags have selected and unselected states. Selecting a tag allows access to the tag display page to choose the stage design component corresponding to that tag's category. The icon, name, and other details of the stage design components can be freely set during configuration.

[0061] by Figure 4 For example, the labels for stage design components can include, but are not limited to, "camera movement" and "lighting effects." The stage design component selection area displays the labels for the stage design components and the label display page for the selected label. The label display page has options for the corresponding category of stage design components. The visual graphic of each option includes the icon and name of the stage design component. Users can select a stage design component and set its timeline position by dragging one or more stage design component options from the option display page to a position in the timeline setting area. Users can also switch to the option display page for camera movement components by selecting the label "camera movement," and users can switch to the option display page for lighting effects components by selecting the label "lighting effects."

[0062] Step S204: Obtain the first stage design configuration information generated by user operations on the stage design components and timeline setting area;

[0063] Specifically, after a user drags one or more stage design components from the options display page to a specific location in the timeline setting area to select a stage design component and set its timeline position, terminal 110 responds to this user operation by obtaining the corresponding first stage design configuration information and sending a configuration request carrying that first stage design configuration information to server 120. Server 120 can obtain the first stage design configuration information by parsing the configuration request. The first stage design configuration information may include, but is not limited to, information about the stage design component selected by the user, the timeline position of the stage design component, and the selection time of the stage design component. The timeline position of the stage design component can indicate the playback period information of the stage design component.

[0064] Step S206: Generate a first stage design component sequence based on the first stage design configuration information. The first stage design component sequence includes the stage design components selected by the user and the stage design components are sorted according to their timeline positions.

[0065] In some implementations, the stage design sequence may include: a camera movement sequence, a lighting effect sequence, and / or a background music sequence.

[0066] The sequence of camera movement components may include camera movement components indicated by the first set design information, and these camera movement components are ordered according to their timeline positions.

[0067] In some implementations, the duration of each camera movement component is fixed. That is, the playback period of each camera movement component is a preset fixed duration. For example, the duration of the camera movement component can be set to a fixed value, which can be, but is not limited to, 2 seconds, 3 seconds, etc.

[0068] For example, if a user drags a camera movement component to a position in the timeline setting area, the time period occupied by that camera movement component on the timeline is determined according to the set duration of the camera movement component.

[0069] In some implementations, when the first stage design information includes information on two or more camera movement components with overlapping timeline positions, the two or more camera movement components are added to the camera movement component sequence, and the order of the two or more camera movement components is determined according to the selection time of the camera movement component and its timeline position.

[0070] For example, if a user drags camera movement component A to a position in the timeline setting area that overlaps with the timeline position of an existing camera movement component B, then camera movement component A will be automatically added to the camera movement component sequence and sorted after the existing camera movement component B.

[0071] For example, if a user drags camera movement component A and camera movement component B to the same position 'a' in the timeline setting area, camera movement component A and camera movement component B will be automatically added to the camera movement component sequence. The order of camera movement component A, which is dragged first, corresponds to position 'a' in the timeline setting area, while camera movement component B is arranged sequentially after camera movement component A.

[0072] The sequence of light effect components includes the light effect components indicated by the first stage design information, and these light effect components are ordered according to their timeline positions.

[0073] In some implementations, the duration of each light effect component is adjustable. That is, the playback period of each light effect is adjustable. Users can adjust the duration of a light effect component by setting its timeline position. For example, using... Figure 4 Taking the timeline visualization as an example, when a user drags a light effect component to a certain position in the timeline setting area, the default duration of the light effect component on the timeline is the first predetermined duration. If the duration of the light effect component needs to be adjusted, the user can lengthen and / or shorten the duration of the light effect component by dragging the start time segment and / or end time segment of the light effect component, and at the same time reset the timeline position of the light effect component.

[0074] In some implementations, the duration of the light effect component is not less than a second predetermined duration, which can be set to, but is not limited to, a fixed value such as 1 second.

[0075] In some implementations, when the first stage design configuration information includes information on two or more light effect components with overlapping timeline positions, the two or more light effect components are added to the light effect component sequence and the order of the two or more light effect components is determined according to the selection time of the light effect components and their timeline positions.

[0076] For example, if the user drags the light effect component C to a position in the timeline setting area that overlaps with the timeline position of an existing camera movement component D, then the light effect component C will be automatically added to the camera movement component sequence and will be arranged sequentially after the existing light effect component D.

[0077] In some implementations, when the time axis position interval of two or more light effect components in the first stage design configuration information is less than a first predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, while retaining the gap between the light effect components.

[0078] For example, if the time interval t1 between two consecutive light effect components is less than the second predetermined duration (e.g., 3 seconds), then the two light effect components are automatically added to the light effect component sequence according to their time axis positions, and the time interval t1 between these two light effect components is also considered.

[0079] In some implementations, when the time axis position interval of two or more light effect components in the first stage design configuration information is less than the second predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components. At the same time, light effects of the second predetermined duration can be filled between adjacent light effect components.

[0080] For example, if the time interval t2 between two light effect components selected by the user is less than the second predetermined duration (e.g., 1 second), the user-selected previous light effect component is automatically added to the light effect component sequence according to its time axis position. After the previous light effect component is filled with a unit light effect component with a duration of the second predetermined duration, the user-selected next light effect component is added to the light effect component sequence after the unit light effect component filled in.

[0081] The duration of each light effect component in the light effect component sequence is the user-defined duration or default duration in the first stage design configuration information, and the duration of each light effect component is not less than the second predetermined duration.

[0082] In some implementations, step S206 or after step S206 may further include: generating visualization data of the first stage component sequence, and outputting the visualization data of the first stage component sequence through the time axis setting area, so as to present the visualization graphics of the first stage component sequence in the time axis setting area.

[0083] Figure 5 This image shows a sample interface diagram of the timeline settings area. Figure 5 It also shows an example diagram of the visualization of the first stage component sequence in the timeline setting area. Figure 5 In the example, the first set design component sequence includes a camera movement component sequence and a lighting effect component sequence. Adjacent camera movement components in the camera movement component sequence are distinguished by different colors, and the names of each camera movement component are displayed on the corresponding track in sorted order. Similarly, adjacent lighting effect components in the lighting effect component sequence are distinguished by different colors, and the names of each lighting effect component are displayed on the corresponding track in sorted order.

[0084] Figure 5 In the example, the timeline is displayed at the top of the timeline settings area. The timeline also has a zoom scroll bar, which users can use to zoom in or out of the timeline. For example, the timeline length can be set to 1 minute, or it can be set to 10 seconds.

[0085] Figure 5In the example, the timeline features timestamp markers. Moving these timestamp markers allows you to view the stage effects of the current frame in the preview area of ​​the first window without affecting the playback of the virtual character's video. A line runs through the timeline setting area below the timestamp markers.

[0086] Figure 5 In the example, users can add an audio component by clicking the plus sign in the background music component sequence in the timeline settings area. This audio component will play from 0 seconds on the timeline.

[0087] Step S208: Obtain the first stage design saving information generated by the user's operation on the save button;

[0088] Specifically, after the user completes the stage design settings, they click the save button in the first window. Terminal 110 responds to this user action by obtaining the corresponding first stage design save information and sending a request carrying this first stage design save information to server 120. Server 120 can obtain the first stage design save information by parsing the request from terminal 120. The first stage design save information may be, but is not limited to, instruction information representing stage design data for generating the first stage design component sequence.

[0089] Step S210: Under the trigger of the first stage design saving information, the first stage design data and the first switch corresponding to the first stage design data are generated using the first stage design component sequence. The first switch is used to trigger the output of the first stage design data so that the corresponding stage design effects can be presented simultaneously during the virtual live broadcast.

[0090] Specifically, after obtaining the first stage design information, server 120 obtains the stage design data of each stage design component in the first stage design component sequence, and concatenates this stage design data according to the order of the stage design components to form stage design time sequence data, which is the first stage design data. At the same time, server 120 generates a first switch corresponding to the first stage design data and pushes the first switch to terminal 110. Terminal 110 displays the visual control of the first switch at a designated position on the virtual character live broadcast control interface. Users can activate the stage design effects of the corresponding first stage design data by operating the visual control of the first switch.

[0091] In practical applications, users can configure multiple stage design component sequences according to steps S202 to S210. Correspondingly, a visual control of a switch corresponding to each of the multiple stage design component sequences will be displayed at a designated location on the virtual character live streaming control interface. Users can selectively activate a stage design effect by operating the visual control of a switch as needed.

[0092] like Figure 3As shown, in some embodiments, the first window may also include a preview area and / or a reset button. The preview area is used for users to preview the stage design content they have edited, and the reset button allows users to easily reset the edited stage design content.

[0093] In some implementations, the stage design configuration method for virtual live streaming may further include: acquiring first stage design reset information generated by a user's operation on the reset button; and deleting a first stage design component sequence triggered by the first stage design reset information. This allows users to easily reset edited stage design content as needed. In specific applications, this step can be performed by server 120.

[0094] In some implementations, a play button and / or a pause button are provided in the preview area.

[0095] In some implementations, the stage design configuration method for virtual live streaming may further include: acquiring preview playback information generated by user operations on the play button in the preview area; and, triggered by the preview playback information, playing the real-time video of the virtual character in the preview area while simultaneously playing the first stage design data. In specific applications, the terminal 110 may acquire the first stage design data from the server 120 and execute this step.

[0096] In some implementations, the stage design configuration method for virtual live streaming may further include: acquiring preview pause information generated by user operation of the pause button in the preview area; and, triggered by the preview pause information, pausing the playback of the first stage design data while playing the real-time video of the virtual character in the preview area. In specific applications, the terminal 110 can obtain the first stage design data from the server 120 and perform this step.

[0097] In some implementations, a record button and / or a file button may also be provided in the preview area.

[0098] In some implementations, the stage design configuration method for virtual live streaming may further include: acquiring recording start information generated by user operation on the record button in the preview area; triggering the recording start information; recording the virtual character video and stage effects played in real time in the preview area; and saving the recorded video data to a designated storage space according to pre-configured default path information or video save path information generated by user operation on the file button. In specific applications, this step can be executed jointly by terminal 110 and server 120. Terminal 110 can send video data to server 120 in real time or periodically, and server 120 can save the video data to the designated storage space.

[0099] This allows users to easily preview the stage effects of their edited stage content as needed, and also makes it convenient for users to record virtual character videos that include stage effects, thereby realizing personalized creation of virtual animation works.

[0100] The above processing of the preview area can be implemented through terminal 110. Terminal 110 obtains the first stage design reset information, preview pause information, preview playback information and / or recording start information and executes the corresponding actions. The method of obtaining the first stage design configuration information is the same as described above, and will not be repeated here.

[0101] Figure 6 An example screenshot of the preview area is shown. Figure 6 In the example, This is the play button, used to play pre-configured camera movement / lighting effects; This is the pause button, used to pause only the camera movement / lighting effects, without pausing the digital human's real-time actions; This is the record button, used to record the current screen content to create a video file for local storage. After the user clicks the record button, a countdown of 3, 2, 1 will be displayed, and then the video will continue to play automatically. The pause function cannot be used during recording. This is the file button, used to open the path where the recorded video is saved.

[0102] The virtual live streaming stage design configuration method of this disclosure allows users to configure the stage design for virtual live streaming by manipulating stage design components and timelines, achieving asynchronous control between stage design and virtual character performance. During the virtual live streaming process, users can add their own configured stage design effects to the virtual character performance through a first switch. This effectively simplifies the user configuration operation of virtual live streaming stage design effects, reduces the learning cost of stage design effects in virtual live streaming, significantly reduces the difficulty for users to create virtual animations, and enhances the stage design effects and viewing experience of virtual live streaming.

[0103] Figure 7 An example diagram of a virtual live streaming stage setup device using a hardware implementation of a processing system is shown.

[0104] The apparatus may include corresponding modules that perform one or more steps in the flowchart above. Therefore, each or more steps in the flowchart above can be performed by a corresponding module, and the apparatus may include one or more of these modules. A module may be one or more hardware modules specifically configured to perform a corresponding step, or implemented by a processor configured to perform a corresponding step, or stored in a computer-readable medium for implementation by a processor, or implemented through some combination thereof.

[0105] This hardware architecture can be implemented using a bus architecture. The bus architecture can include any number of interconnect buses and bridges, depending on the specific application and overall design constraints of the hardware. Bus 800 connects various circuits, including one or more processors 900, memory 1000, and / or hardware modules. Bus 800 can also connect various other circuits 1100, such as peripherals, voltage regulators, power management circuits, external antennas, etc.

[0106] Bus 800 can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, this diagram uses only one connection line, but this does not imply that there is only one bus or one type of bus.

[0107] Any process or method description in the flowcharts or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process, and the scope of the preferred embodiments of this disclosure includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of this disclosure pertain. The processor performs the various methods and processes described above. For example, the method embodiments of this disclosure may be implemented as software programs tangibly contained in a machine-readable medium, such as memory. In some embodiments, part or all of the software program may be loaded and / or installed via memory and / or a communication interface. When the software program is loaded into memory and executed by the processor, one or more steps of the methods described above may be performed. Alternatively, in other embodiments, the processor may be configured to perform one of the methods described above by any other suitable means (e.g., by means of firmware).

[0108] The logic and / or steps represented in the flowchart or otherwise described herein may be specifically implemented in any readable storage medium for use by, or in conjunction with, an instruction execution system, apparatus or device (such as a computer-based system, a processor-included system or other system that can fetch and execute instructions from, an instruction execution system, apparatus or device).

[0109] For the purposes of this specification, a "readable storage medium" can be any means capable of containing, storing, communicating, propagating, or transmitting a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and portable read-only memory (CDROM). Furthermore, a readable storage medium can even be paper or other suitable media on which a program can be printed, since a program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in memory.

[0110] It should be understood that various parts of this disclosure can be implemented in hardware, software, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0111] Those skilled in the art will understand that all or part of the steps of the methods described above can be implemented by a program instructing related hardware, and the program can be stored in a readable storage medium. When executed, the program includes one or a combination of the steps of the method implementation.

[0112] Furthermore, the functional units in the various embodiments of this disclosure can be integrated into a single processing module, or each unit can exist physically separately, or two or more units can be integrated into a single module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a readable storage medium. The storage medium can be a read-only memory, a disk, or an optical disk, etc.

[0113] Figure 7 This is a schematic diagram of a virtual live streaming stage setup device according to one embodiment of the present disclosure. Figure 7 As shown, the virtual live streaming stage setup device 700 according to this disclosure may include:

[0114] Unit 702 is provided to provide a first window for configuring virtual live streaming stage effects. The first window includes a stage component selection area, a timeline setting area, and a save button. The stage component selection area has stage components that can be selected by the user.

[0115] The first acquisition unit 704 is used to acquire first stage design configuration information generated by user operations on the stage design components and timeline setting area; and to acquire first stage design save information generated by user operations on the save button.

[0116] Stage design component sequence unit 706 is used to generate a first stage design component sequence based on the first stage design configuration information. The first stage design component sequence includes the stage design components selected by the user and the stage design components are sorted according to their timeline positions.

[0117] The stage design data acquisition unit 708 is used to generate first stage design data and a first switch corresponding to the first stage design data using the first stage design component sequence when the first stage design information is saved. The first switch is used to trigger the output of the first stage design data so that the corresponding stage design effects can be presented simultaneously during the virtual live broadcast.

[0118] In some implementations, the first window further includes a preview area, which has a play button and / or a pause button;

[0119] The virtual live streaming stage design configuration device 700 may further include: a second acquisition unit 710 and a playback control unit 712; wherein, the second acquisition unit 710 may be used to acquire preview playback information generated by user operation of the play button in the preview area and / or acquire preview pause information generated by user operation of the pause button in the preview area; the playback control unit 712 may be used to play the first stage design data while playing the real-time video image of the virtual character in the preview area when triggered by the preview playback information; and / or may also be used to pause the playback of the first stage design data while playing the real-time video image of the virtual character in the preview area when triggered by the preview pause information.

[0120] In some embodiments, a record button and / or a file button are also provided in the preview area; the virtual live streaming stage design configuration device 700 may further include: a recording unit 714; the second acquisition unit 710 may also be used to acquire recording start information generated by user operation on the record button in the preview area; the recording unit 714 may be used to record the virtual character video and stage effects played in real time in the preview area when triggered by the recording start information, and save the recorded video data to a specified storage space according to the pre-configured default path information or the video save path information generated by user operation on the file button.

[0121] In some implementations, the stage design component sequence unit 706 is specifically used for:

[0122] When the first stage design configuration information contains information about two or more camera movement components with overlapping timeline positions, the two or more camera movement components are added to the camera movement component sequence, and the order of the two or more camera movement components is determined according to the selected time and timeline position of the camera movement components. The duration of each camera movement component in the camera movement component sequence is fixed; and / or,

[0123] When the first stage design configuration information contains information about two or more light effect components with overlapping timeline positions, add the two or more light effect components to the light effect component sequence and determine the order of the two or more light effect components according to the selection time and timeline position of the light effect components;

[0124] When the time axis position interval of two or more light effect components in the first stage design configuration information is less than a first predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to their time axis positions, while preserving the gaps between the light effect components; and / or

[0125] or,

[0126] When the time axis position interval of two or more light effect components in the first stage design configuration information is less than the second predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, while filling the space between adjacent light effect components with light effects of the second predetermined duration.

[0127] The duration of each light effect component in the light effect component sequence is the user-defined duration or default duration in the first stage design configuration information, and the duration of each light effect component is not less than the second predetermined duration.

[0128] In some embodiments, the virtual live streaming stage design configuration device 700 may further include: the providing unit 702 may also be used to generate visualization data of the first stage design component sequence, and output the visualization data of the first stage design component sequence through the time axis setting area, so as to present the visualization graphics of the first stage design component sequence in the time axis setting area.

[0129] In some implementations, the first window also includes a reset button; the first acquisition unit 704 can also be used to acquire first stage design reset information generated by user operation on the reset button, and the stage design component sequence unit 706 can also be used to delete the first stage design component sequence when triggered by the first stage design reset information.

[0130] For example, the providing unit 702, the first acquisition unit 704, the stage component sequence unit 706, and the stage data acquisition unit 708 can be set on the server side, while the second acquisition unit 710, the playback control unit 712, and the recording unit 714 can be set on the terminal side.

[0131] This disclosure also provides an electronic device, including: a memory storing execution instructions; and a processor or other hardware module executing the execution instructions stored in the memory, causing the processor or other hardware module to execute the aforementioned virtual live streaming stage configuration method.

[0132] This disclosure also provides a readable storage medium storing execution instructions, which, when executed by a processor, are used to implement the aforementioned stage design configuration method for virtual live streaming.

[0133] In the description of this specification, the references to terms such as "one embodiment / mode," "some embodiments / modes," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment / mode or example is included in at least one embodiment / mode or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment / mode or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments / modes or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments / modes or examples described in this specification, as well as the features of different embodiments / modes or examples.

[0134] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0135] Those skilled in the art should understand that the above embodiments are merely for illustrating the present disclosure and are not intended to limit the scope of the disclosure. Those skilled in the art can make other changes or modifications based on the above disclosure, and these changes or modifications still fall within the scope of the present disclosure.

Claims

1. A method for configuring stage design for virtual live streaming, characterized in that, include: A first window is provided for configuring virtual live streaming stage effects. The first window includes a stage component selection area, a timeline setting area, and a save button. The stage component selection area is provided with stage components that can be selected by the user. Obtain the initial stage design configuration information generated by user operations on the stage design components and timeline settings area; A first stage design component sequence is generated based on the first stage design configuration information. The first stage design component sequence includes the stage design components selected by the user and the stage design components are sorted according to their timeline positions. Obtain the first stage design saving information generated by the user's operation on the save button; Triggered by the first stage design information, the first stage design data and the corresponding first switch are generated using the first stage design component sequence. The first switch is used to trigger the output of the first stage design data so that the corresponding stage design effects can be presented simultaneously during the virtual live broadcast. A first stage design component sequence is generated based on the first stage design configuration information, including: When the first stage design configuration information contains information about two or more camera movement components with overlapping timeline positions, the two or more camera movement components are added to the camera movement component sequence and the order of the two or more camera movement components is determined according to the selection time and timeline position of the camera movement components. The duration of each camera movement component in the camera movement component sequence is fixed. When the first stage design configuration information contains information about two or more light effect components with overlapping timeline positions, the two or more light effect components are added to the light effect component sequence and the order of the two or more light effect components is determined according to the selection time and timeline position of the light effect components. When the time axis position interval of two or more light effect components in the first stage design configuration information is less than the first predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, while retaining the gap between the light effect components. When the time axis position interval of two or more light effect components in the first stage design configuration information is less than the second predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, and light effects of the second predetermined duration are filled between adjacent light effect components. The duration of each light effect component in the light effect component sequence is the user-defined duration or default duration in the first stage design configuration information, and the duration of each light effect component is not less than the second predetermined duration.

2. The stage design configuration method for virtual live streaming according to claim 1, characterized in that, The first window further includes a preview area, wherein a play button and / or a pause button are provided in the preview area; The method further includes: Obtain preview playback information generated by user interaction with the play button in the preview area; and, triggered by the preview playback information, simultaneously play the real-time video of the virtual character in the preview area while playing the first stage design data; and / or, Obtain preview pause information generated by user operation of the pause button in the preview area, and when triggered by the preview pause information, pause the playback of the first stage design data while playing the real-time video of the virtual character in the preview area.

3. The stage design configuration method for virtual live streaming according to claim 2, characterized in that, The preview area also includes a record button and / or a file button; The method further includes: obtaining recording start information generated by user operation of the record button in the preview area; triggering the recording start information; recording the virtual character video and stage effects played in real time in the preview area; and saving the recorded video data to a specified storage space according to the pre-configured default path information or the video save path information generated by user operation of the file button.

4. The stage design configuration method for virtual live streaming according to claim 1, characterized in that, The stage design components include at least one camera movement component, at least one audio component, and / or at least one lighting component; the stage design component sequence includes: a camera movement component sequence, a lighting component sequence, and / or a background music sequence.

5. The stage design configuration method for virtual live streaming according to claim 1 or 4, characterized in that, Also includes: Visual data of the first stage component sequence is generated and output through the time axis setting area to present the visual graphics of the first stage component sequence in the time axis setting area.

6. The stage design configuration method for virtual live streaming according to claim 1 or 4, characterized in that, The first window also includes a reset button; the method further includes: obtaining first stage design reset information generated by user operation on the reset button; and deleting the first stage design component sequence when triggered by the first stage design reset information.

7. A stage setup device for virtual live streaming, characterized in that, include: A providing unit is used to provide a first window for configuring virtual live streaming stage effects. The first window includes a stage component selection area, a timeline setting area, and a save button. The stage component selection area is provided with stage components that can be selected by the user. The first acquisition unit is used to acquire the first stage design configuration information generated by user operations on the stage design components and timeline setting area; And, for obtaining first stage design saving information generated by user operation on the save button; A stage design component sequence unit is used to generate a first stage design component sequence based on the first stage design configuration information. The first stage design component sequence includes stage design components selected by the user and the stage design components are sorted according to their timeline positions. The stage design data acquisition unit is used to generate first stage design data and a first switch corresponding to the first stage design data using the first stage design component sequence when triggered by the first stage design saved information. The first switch is used to trigger the output of the first stage design data so as to present the corresponding stage design effects simultaneously during the virtual live broadcast. A first stage design component sequence is generated based on the first stage design configuration information, including: When the first stage design configuration information contains information about two or more camera movement components with overlapping timeline positions, the two or more camera movement components are added to the camera movement component sequence and the order of the two or more camera movement components is determined according to the selection time and timeline position of the camera movement components. The duration of each camera movement component in the camera movement component sequence is fixed. When the first stage design configuration information contains information about two or more light effect components with overlapping timeline positions, the two or more light effect components are added to the light effect component sequence and the order of the two or more light effect components is determined according to the selection time and timeline position of the light effect components. When the time axis position interval of two or more light effect components in the first stage design configuration information is less than the first predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, while retaining the gap between the light effect components. When the time axis position interval of two or more light effect components in the first stage design configuration information is less than the second predetermined duration, the two or more light effect components are added to the light effect component sequence and sorted according to the time axis position of the light effect components, and light effects of the second predetermined duration are filled between adjacent light effect components. The duration of each light effect component in the light effect component sequence is the user-defined duration or default duration in the first stage design configuration information, and the duration of each light effect component is not less than the second predetermined duration.

8. An electronic device, characterized in that, include: The memory stores execution instructions; as well as A processor that executes execution instructions stored in the memory, causing the processor to perform the virtual live streaming stage configuration method as described in any one of claims 1 to 6.

9. A readable storage medium, characterized in that, The readable storage medium stores execution instructions, which, when executed by a processor, are used to implement the stage design configuration method for virtual live streaming as described in any one of claims 1 to 6.

Images