Directing control method and device, computer equipment and storage medium

Abstract

The invention provides a director control method and device, computer equipment and a storage medium, and the method comprises the steps: obtaining live broadcast sub-data controlled by a plurality of groups of virtual director stations in a virtual role live broadcast process; each group of virtual director stations corresponds to one broadcast control dimension, and the broadcast control dimensions comprise a role broadcast control dimension, an audio and video signal broadcast control dimension and a scene broadcast control dimension; converging the live broadcast sub-data to obtain live broadcast data; and playing a live broadcast picture based on the live broadcast data. Therefore, compared with the mode that only one virtual director station is used for playing control, the mode that the multiple sets of virtual director stations are arranged to conduct playing control on the live broadcast sub-data under different playing control dimensions is adopted, the director pressure of a single virtual director station can be relieved, it can be ensured that virtual role live broadcast is normally conducted under the scene that the instant director requirement is complex, and user experience is improved. Therefore, richer live broadcast links can be carried out in the virtual character live broadcast process, so that the live broadcast effect in the virtual character live broadcast process is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a director control method, device, computer equipment and storage medium. Background Art

[0002] With the development of virtual reality and augmented reality technologies, virtual live broadcast technology using virtual characters for live broadcast has emerged. During the virtual character live broadcast process, the virtual character driven by the virtual character control object can replace the real anchor to show his talent.

[0003] In the related technology, in order to enrich the live broadcast effect of virtual character live broadcast, a virtual director's desk can be used to control the live broadcast data of the virtual character live broadcast. However, the broadcast control functions that can be realized by the virtual director's desk are relatively complicated. Therefore, how to use the virtual director's desk to control the live broadcast data generated in the virtual character live broadcast to improve the live broadcast effect during the virtual character live broadcast has become a technical problem that needs to be solved urgently in this field. Summary of the invention

[0004] The embodiments of the present disclosure at least provide a director control method, device, computer equipment and storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides a broadcast director control method, including:

[0006] During the live broadcast of the virtual character, the live broadcast sub-data of the broadcast control of multiple groups of virtual director stations are obtained; each group of virtual director stations in the multiple groups of virtual director stations corresponds to a broadcast control dimension; the broadcast control dimension includes the role broadcast control dimension, the audio and video signal broadcast control dimension, and the scene broadcast control dimension;

[0007] The live broadcast sub-data of the plurality of groups of virtual director stations are merged to obtain live broadcast data;

[0008] Live screen playback is performed based on the live data.

[0009] In a possible implementation manner, the broadcast control dimension further includes an interactive broadcast control dimension for broadcasting and controlling the live broadcast interactive data generated in the live broadcast;

[0010] The live interactive data includes at least one of the following data:

[0011] Barrage data, scene interaction data corresponding to the live broadcast scene, and split-screen live broadcast interaction data corresponding to the live broadcast split-screen operation; wherein the live broadcast split-screen operation is used to display the split-screen live broadcast interaction data in the split-screen area corresponding to the live broadcast screen.

[0012] In a possible implementation, the target virtual director station group in the multiple groups of virtual director stations includes multiple target virtual director stations corresponding to different broadcast control devices, and the broadcast control devices corresponding to the target virtual director stations include the target broadcast control devices corresponding to the virtual character control terminals.

[0013] In a possible implementation manner, the broadcast control dimension corresponding to the target virtual director station group includes a role broadcast control dimension;

[0014] The live broadcast sub-data of the target broadcast control device corresponding to the virtual character control terminal includes at least one of the following data:

[0015] The costume data of the virtual character, the prop data of the virtual character, and the special effects data of the virtual character.

[0016] In a possible implementation manner, the multiple groups of virtual director stations are broadcast controlled by at least one broadcast control device, and each broadcast control device is used to implement a broadcast control function under at least one broadcast control dimension;

[0017] The method further includes determining a target broadcast control device for implementing each broadcast control dimension according to the following steps:

[0018] According to the broadcast control level of the current live broadcast scene, determine the number of broadcast control devices corresponding to the broadcast control level; wherein different broadcast control levels correspond to different numbers of broadcast control devices;

[0019] According to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, the target broadcast control devices for realizing each broadcast control dimension are determined, so that the multiple groups of virtual director stations can be used in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension.

[0020] In a possible implementation manner, the method further includes determining the broadcast control level of the current live broadcast scene according to the following steps:

[0021] Obtaining a parameter value of a broadcast control busy parameter used to characterize the broadcast control busyness in the current live broadcast scene; wherein the broadcast control busy parameter includes at least one of the number of virtual characters in the current live broadcast scene, the number of audiences in the current live broadcast scene, the number of live broadcast links in the current live broadcast scene, the number of background stages in the current live broadcast scene, and the number of background music in the current live broadcast scene;

[0022] The broadcast control level of the current live broadcast scene is determined according to the parameter value of each of the broadcast control busy parameters.

[0023] In a possible implementation manner, determining the broadcast control level of the current live broadcast scene according to the parameter value of each of the broadcast control busy parameters includes:

[0024] Outputting the parameter values ​​of each of the broadcast control busy parameters to a pre-trained broadcast control level determination model to determine the confidence information that the current live broadcast scene belongs to each preset broadcast control level;

[0025] Based on the confidence information that the current live broadcast scene belongs to each preset broadcast control level, the broadcast control level of the current live broadcast scene is determined.

[0026] In a second aspect, an embodiment of the present disclosure further provides a broadcast director control device, including:

[0027] An acquisition module is used to acquire live broadcast sub-data of multiple groups of virtual director stations during the live broadcast of the virtual character; each group of virtual director stations in the multiple groups of virtual director stations corresponds to a broadcast control dimension; the broadcast control dimension includes a role broadcast control dimension, an audio and video signal broadcast control dimension, and a scene broadcast control dimension;

[0028] A confluence module, used for confluence processing of the live broadcast sub-data of the plurality of groups of virtual director stations to obtain live broadcast data;

[0029] The live broadcast module is used to play the live broadcast image based on the live broadcast data.

[0030] In a possible implementation manner, the broadcast control dimension further includes an interactive broadcast control dimension for broadcasting and controlling the live broadcast interactive data generated in the live broadcast;

[0031] The live interactive data includes at least one of the following data:

[0032] Barrage data, scene interaction data corresponding to the live broadcast scene, and split-screen live broadcast interaction data corresponding to the live broadcast split-screen operation; wherein the live broadcast split-screen operation is used to display the split-screen live broadcast interaction data in the split-screen area corresponding to the live broadcast screen.

[0033] In a possible implementation, the target virtual director station group in the multiple groups of virtual director stations includes multiple target virtual director stations corresponding to different broadcast control devices, and the broadcast control devices corresponding to the target virtual director stations include the target broadcast control devices corresponding to the virtual character control terminals.

[0034] In a possible implementation manner, the broadcast control dimension corresponding to the target virtual director station group includes a role broadcast control dimension;

[0035] The live broadcast sub-data of the target broadcast control device corresponding to the virtual character control terminal includes at least one of the following data:

[0036] The costume data of the virtual character, the prop data of the virtual character, and the special effects data of the virtual character.

[0037] In a possible implementation manner, the multiple groups of virtual director stations are broadcast controlled by at least one broadcast control device, and each broadcast control device is used to implement a broadcast control function under at least one broadcast control dimension;

[0038] The acquisition module is further used to determine the target broadcast control device for realizing each broadcast control dimension according to the following steps:

[0039] According to the broadcast control level of the current live broadcast scene, determine the number of broadcast control devices corresponding to the broadcast control level; wherein different broadcast control levels correspond to different numbers of broadcast control devices;

[0040] According to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, the target broadcast control devices for realizing each broadcast control dimension are determined, so that the multiple groups of virtual director stations can be used in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension.

[0041] In a possible implementation manner, the acquisition module is further configured to determine the broadcast control level of the current live broadcast scene according to the following steps:

[0042] Obtaining a parameter value of a broadcast control busy parameter used to characterize the broadcast control busyness in the current live broadcast scene; wherein the broadcast control busy parameter includes at least one of the number of virtual characters in the current live broadcast scene, the number of audiences in the current live broadcast scene, the number of live broadcast links in the current live broadcast scene, the number of background stages in the current live broadcast scene, and the number of background music in the current live broadcast scene;

[0043] The broadcast control level of the current live broadcast scene is determined according to the parameter value of each of the broadcast control busy parameters.

[0044] In a possible implementation manner, when determining the broadcast control level of the current live broadcast scene according to the parameter value of each of the broadcast control busy parameters, the acquisition module is used to:

[0045] Outputting the parameter values ​​of each of the broadcast control busy parameters to a pre-trained broadcast control level determination model to determine the confidence information that the current live broadcast scene belongs to each preset broadcast control level;

[0046] Based on the confidence information that the current live broadcast scene belongs to each preset broadcast control level, the broadcast control level of the current live broadcast scene is determined.

[0047] In a third aspect, an embodiment of the present disclosure further provides a computer device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the above-mentioned first aspect, or any possible implementation of the first aspect are performed.

[0048] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned first aspect or any possible implementation of the first aspect are executed.

[0049] The director control method, device, computer equipment and storage medium provided by the embodiments of the present disclosure can perform confluence processing on the live broadcast sub-data obtained from the broadcast control of each group of virtual directors during the live broadcast of the virtual character by setting up multiple groups of virtual directors' desks including at least three broadcast control dimensions, namely, the character broadcast control dimension, the audio and video signal broadcast control dimension and the scene broadcast control dimension, so as to obtain the live broadcast data for live streaming, so as to play the live screen based on the live broadcast data. In this way, compared with using only one virtual director's desk to broadcast and control the live broadcast data under multiple broadcast control dimensions, by setting up multiple groups of virtual directors' desks to respectively broadcast and control the live broadcast sub-data under different broadcast control dimensions, the directing pressure of a single virtual director's desk can be reduced, and the normal live broadcast of the virtual character can be ensured in scenarios with more complex real-time directing requirements, so that more abundant live broadcast links can be performed during the live broadcast of the virtual character, thereby improving the live broadcast effect during the live broadcast of the virtual character.

[0050] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.

[0052] Figure 1 A flow chart of a broadcast director control method provided by some embodiments of the present disclosure is shown;

[0053] Figure 2 A schematic diagram showing a broadcast control page of a target broadcast control device corresponding to a virtual character control terminal in a broadcast director control method provided in some embodiments of the present disclosure is shown;

[0054] Figure 3 A schematic diagram showing a broadcast control page of a broadcast control device corresponding to a broadcast director's control terminal in a broadcast director control method provided in some embodiments of the present disclosure is shown;

[0055] Figure 4 A schematic diagram of the architecture of a director control device provided by some embodiments of the present disclosure is shown;

[0056] Figure 5 A schematic structural diagram of a computer device provided in some embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0057] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0058] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0059] The term "and / or" herein only describes an association relationship, indicating that three relationships may exist. For example, A and / or B may represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C may represent including any one or more elements selected from the set consisting of A, B, and C.

[0060] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0061] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0062] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0063] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0064] Through research, it is found that in order to enrich the live broadcast effect of virtual character live broadcast, a virtual director's desk can be used to control the live broadcast data of the virtual character live broadcast. However, the broadcast control functions that can be realized by the virtual director's desk are relatively complicated. Therefore, how to use the virtual director's desk to control the live broadcast data generated in the virtual character live broadcast to improve the live broadcast effect of the virtual character live broadcast has become a technical problem that needs to be solved urgently in this field.

[0065] Based on the above research, the present disclosure provides a director control method, device, computer equipment and storage medium. By setting up multiple groups of virtual director desks including at least three broadcast control dimensions, namely, character broadcast control dimension, audio and video signal broadcast control dimension and scene broadcast control dimension, the acquired live broadcast sub-data of each group of virtual director desks can be merged during the live broadcast of the virtual character, and the obtained live broadcast data for live broadcast streaming can be obtained, so that the live broadcast screen can be played based on the live broadcast data. In this way, compared with using only one virtual director desk to broadcast and control the live broadcast data under multiple broadcast control dimensions, by setting up multiple groups of virtual director desks to broadcast and control the live broadcast sub-data under different broadcast control dimensions respectively, the directing pressure of a single virtual director desk can be reduced, and the normal live broadcast of the virtual character can be ensured in the scenario with more complex real-time directing requirements, so that more abundant live broadcast links can be carried out during the live broadcast of the virtual character, thereby improving the live broadcast effect during the live broadcast of the virtual character.

[0066] To facilitate understanding of this embodiment, a director control method disclosed in an embodiment of the present disclosure is first introduced in detail. The execution subject of the director control method provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities, and the computer device includes, for example: a terminal device or a server or other processing device, and the terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the director control method can be implemented by a processor calling a computer-readable instruction stored in a memory.

[0067] See also Figure 1 FIG. 1 is a flowchart of a broadcast director control method provided by an embodiment of the present disclosure, wherein the method includes S101 to S103, wherein:

[0068] S101: During the live broadcast of the virtual character, the live broadcast sub-data of multiple groups of virtual director's desks are obtained; each group of virtual director's desks in the multiple groups of virtual director's desks corresponds to a broadcast control dimension; the broadcast control dimensions include the character broadcast control dimension, the audio and video signal broadcast control dimension, and the scene broadcast control dimension.

[0069] S102: The live broadcast sub-data of the plurality of groups of virtual director stations are merged to obtain live broadcast data.

[0070] S103: Playing live images based on the live data.

[0071] The following is a detailed description of the above steps.

[0072] The process of obtaining live sub-data for S101:

[0073] Here, the character broadcast control dimension is used to broadcast and control the data related to the virtual character generated in the live broadcast, the audio and video signal broadcast control dimension is used to broadcast and control the live video data and live audio data generated in the live broadcast, and the scene broadcast control dimension is used to broadcast and control the scene data related to the live scene in the live broadcast; a group of virtual directors can include at least one virtual director, and through a group of virtual directors, at least one live sub-data under a broadcast control dimension can be broadcast and controlled to achieve corresponding broadcast control functions; the broadcast control dimension can also include an interactive broadcast control dimension for broadcasting and controlling live interactive data generated in the live broadcast.

[0074] The live interactive data may include at least one of the following data:

[0075] 1. Barrage data

[0076] Here, the barrage data may be live broadcast data displayed in the form of barrage, and the barrage data may include live broadcast barrage data, eye-catching message data, etc.

[0077] 2. Scene interaction data

[0078] Here, the scene interaction data may include score data, voting data, and other scene-related interaction data during the live broadcast of the virtual character.

[0079] 3. Split-screen live broadcast interactive data

[0080] Here, the live broadcast split-screen operation is used to display the split-screen live broadcast interactive data in the split-screen area corresponding to the live broadcast screen. The live broadcast split-screen operation can be used to divide the current live broadcast screen into multiple display areas. Different display areas can be used to display different content. For example, virtual character 1 is displayed in area 1 after the split screen, and virtual character 2 is displayed in area 2 after the split screen. This allows different virtual characters to be displayed in different areas, thereby achieving interactive effects such as live broadcast battles between virtual characters, thereby enhancing the fun and interactivity of virtual character live broadcasts.

[0081] In a possible implementation, the target virtual director station group in the multiple groups of virtual director stations includes multiple target virtual director stations corresponding to different broadcast control devices, and the broadcast control devices corresponding to the target virtual director stations include the target broadcast control devices corresponding to the virtual character control terminals.

[0082] In actual applications, there are broadcast control requirements for virtual characters during the live broadcast of the virtual characters, such as changing the virtual characters' clothes, changing the virtual characters' expressions, etc., and the real-time requirements for the broadcast control requirements for the virtual characters are relatively high. If the broadcast control is performed by the director's control terminal, it may not be able to meet the high real-time broadcast control requirements.

[0083] Therefore, the broadcast control dimension corresponding to the target virtual director station group may include the role broadcast control dimension, so that the virtual character control terminal can broadcast and control the live broadcast sub-data under the role broadcast control dimension in real time, thereby improving the real-time interaction of the virtual character during the live broadcast process, and further ensuring the live broadcast effect of the virtual character during the live broadcast process; wherein the live broadcast sub-data broadcast and controlled by the target broadcast control device corresponding to the virtual character control terminal includes at least one of the following data:

[0084] 1. Virtual character clothing data

[0085] Here, the same virtual character may correspond to multiple sets of clothing data, such as virtual clothing of different styles, different virtual hair accessories, etc. By controlling the broadcast of the virtual character's clothing data, the clothing corresponding to the virtual character may be adjusted to enrich the live broadcast effect of the virtual character during the live broadcast.

[0086] 2. Props data of virtual characters

[0087] Here, the prop data of the virtual character may include virtual weapons, virtual microphones, etc. in the hands of the virtual character. By displaying virtual props corresponding to the prop data, the live broadcast effect of the virtual character during the live broadcast can be enriched.

[0088] 3. Special effects data of virtual characters

[0089] Here, the special effect data of the virtual character may be special effect data corresponding to when switching to display clothing data, special effect data corresponding to when switching to display props data, and the like.

[0090] For example, when the virtual character switches to display virtual clothing, special effect data corresponding to the change of virtual clothing can be displayed, so that the effect of the virtual character switching to display virtual clothing is richer.

[0091] For example, the schematic diagram of the broadcast control page of the target broadcast control device corresponding to the virtual character control terminal can be as follows: Figure 2 As shown, Figure 2 In the broadcast control page, the broadcast control page includes the virtual character, clothing data, props data, etc. currently controlled by the virtual character control terminal. By triggering the corresponding button, the broadcast control functions such as adjusting the clothing corresponding to the virtual character, displaying virtual props, and displaying special effect data can be realized. The schematic diagram of the broadcast control page of the broadcast control device corresponding to the director control terminal can be as follows: Figure 3 As shown, Figure 3 The broadcast control page includes multiple virtual characters (virtual character 1 to virtual character 4) in the current live broadcast scene, clothing data and props data corresponding to each virtual character, and broadcast control functions such as adjusting the clothing corresponding to any virtual character, displaying virtual props, and displaying special effect data can be realized by triggering the corresponding buttons. That is, the broadcast control page corresponding to the director's control end can realize the broadcast control of each virtual character, and the broadcast control page corresponding to the virtual character broadcast control end can realize the broadcast control of the controlled virtual character.

[0092] In a possible implementation, the multiple groups of virtual director stations can be controlled by at least one broadcast control device, and each broadcast control device is used to implement a broadcast control function under at least one broadcast control dimension. The target broadcast control device for implementing each broadcast control dimension can be determined by following the steps A1 to A2:

[0093] A1: According to the broadcast control level of the current live broadcast scene, determine the number of broadcast control devices corresponding to the broadcast control level; wherein different broadcast control levels correspond to different numbers of broadcast control devices.

[0094] Here, the broadcast control level of the current live broadcast scene is used to characterize the level of broadcast control demand (that is, the busyness of broadcast control). The higher the broadcast control level, the higher the current broadcast control demand (the busier the broadcast control), and the lower the broadcast control level, the lower the current broadcast control demand (the easier the broadcast control). That is, the number of broadcast control devices required for different broadcast control levels is different. The higher the broadcast control level, the more broadcast control devices are required to reduce the live broadcast control pressure of a single broadcast control device.

[0095] Specifically, when determining the number of broadcast control devices corresponding to the broadcast control level of the current live broadcast scene, the number of broadcast control devices corresponding to the broadcast control level of the current live broadcast scene can be determined based on the mapping relationship between the preset broadcast control level and the number of broadcast control devices.

[0096] In a possible implementation manner, when determining the broadcast control level of the current live broadcast scene, the following steps B1 to B2 may be used:

[0097] B1: Obtain the parameter value of the broadcast control busy parameter used to characterize the busyness of the broadcast control in the current live broadcast scene; wherein the broadcast control busy parameter includes at least one of the number of virtual characters in the current live broadcast scene, the number of audiences in the current live broadcast scene, the number of live broadcast links in the current live broadcast scene, the number of background stages in the current live broadcast scene, and the number of background music in the current live broadcast scene.

[0098] Here, the more virtual characters there are in the current live scene, the more live camera positions may need to be switched in the current live scene, so the number of virtual characters in the current live scene can be positively correlated with the busyness of the broadcast control. The more viewers there are in the current live scene, the busier the operations such as audience live connection and barrage data selection may be in the current live scene, so the number of viewers in the current live scene can be positively correlated with the busyness of the broadcast control; the more live links, background stages, and background music there are in the current live scene, the busier the link switching, stage switching, and background music switching operations may be in the current live scene, so the number of live links, background stages, and background music in the current live scene can be positively correlated with the busyness of the broadcast control.

[0099] B2: Determine the broadcast control level of the current live broadcast scene according to the parameter value of each of the broadcast control busy parameters.

[0100] In a possible implementation, when determining the broadcast control level of the current live scene according to the parameter values ​​of each of the broadcast control busy parameters, the parameter values ​​of each of the broadcast control busy parameters can be output to a pre-trained broadcast control level determination model to determine the confidence information that the current live scene belongs to each preset broadcast control level, and the broadcast control level of the current live scene is determined based on the confidence information that the current live scene belongs to each preset broadcast control level. Wherein, the broadcast control level determination model can be a neural network model, and its type can be a convolutional neural network (CNN), a deep residual network (ResNet), a recurrent neural network (RNN), a Transformer model, etc. When training the broadcast control level determination model, a supervised training method can be adopted, using sample parameter values ​​and the label broadcast control level corresponding to the sample parameter values, determining a first loss value used to characterize the difference between the sample broadcast control level obtained by inputting the sample parameter value into the broadcast control level determination model to be trained and the label broadcast control level corresponding to the sample parameter value, and adjusting the model parameters of the broadcast control level determination model based on the first loss value.

[0101] Specifically, when determining the broadcast control level of the current live broadcast scene based on the broadcast control level determination model and the parameter values ​​of each of the broadcast control busy parameters, feature extraction can be first performed on the parameter values ​​of each of the broadcast control busy parameters input into the broadcast control level determination model to obtain a broadcast control busy feature for characterizing the degree of broadcast control busyness, and the broadcast control busy feature can be feature processed and then classified to determine the confidence information that the broadcast control busy feature belongs to each preset broadcast control level, and based on the confidence information that the broadcast control busy feature belongs to each preset broadcast control level, the preset broadcast control level whose corresponding confidence information meets the preset requirements is selected as the output result of the broadcast control level determination model.

[0102] Among them, the confidence information that meets the preset requirements can be the highest confidence, and the feature processing can include convolution processing for extracting deep features, feature pyramid network (FPN) processing and other processing methods. The embodiment of the present disclosure does not limit the model type and internal structure of the broadcast control level determination model, which is subject to implementation.

[0103] In another possible implementation, when determining the broadcast control level of the current live broadcast scene, the live video frames within a preset time period before the current live broadcast moment can be used as input data and input into a pre-trained video frame analysis model to obtain the broadcast control level of the current live broadcast scene predicted by the video frame analysis model.

[0104] Among them, the video frame analysis model can be a neural network model with image processing capabilities, and its type can be a convolutional neural network CNN, a Vision Transformer model, etc.; when training the video frame analysis model, a supervised training method can be adopted, using sample video frames and the label broadcast control levels corresponding to the sample video frames, to determine a second loss value used to characterize the difference between the sample broadcast control level obtained by inputting the sample video frame into the video frame analysis model to be trained and the label broadcast control level corresponding to the sample video frame, and adjust the model parameters of the video frame analysis model based on the second loss value.

[0105] A2: According to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, determine the target broadcast control devices for realizing each broadcast control dimension, so as to use the multiple groups of virtual director stations in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension.

[0106] Here, when determining the target broadcast control device for realizing each broadcast control dimension according to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, the following situations can be considered:

[0107] Case 1: The number of broadcast control devices is greater than the number of the broadcast control dimensions.

[0108] At this time, a corresponding number of target broadcast control devices may be allocated to each broadcast control dimension according to the preset broadcast control priority and the number of broadcast control devices corresponding to each broadcast control dimension.

[0109] For example, taking the number of broadcast control devices as 6, the broadcast control dimensions as character broadcast control dimension, audio and video signal broadcast control dimension, and scene broadcast control dimension, and the preset broadcast control priorities between the broadcast control dimensions are from high to low as role broadcast control dimension-audio and video signal broadcast control dimension-scene broadcast control dimension, then 3, 2, and 1 broadcast control devices can be allocated to the role broadcast control dimension, the audio and video signal broadcast control dimension, and the scene broadcast control dimension, respectively.

[0110] Case 2: The number of broadcast control devices is equal to the number of the broadcast control dimensions.

[0111] At this time, since the number of broadcast control devices is equal to the number of the broadcast control dimensions, a broadcast control device can be allocated to each broadcast control dimension to achieve independent broadcast control of each broadcast control device.

[0112] Case 3: The number of broadcast control devices is less than the number of the broadcast control dimensions.

[0113] At this time, the broadcast control dimensions may be allocated to each broadcast control device according to the preset broadcast control priorities corresponding to each broadcast control dimension and the number of the broadcast control devices.

[0114] Exemplarily, taking the number of broadcast control devices as 2, the assignable broadcast control devices as broadcast control device 1 and broadcast control device 2, the broadcast control dimensions as character broadcast control dimension, audio and video signal broadcast control dimension, and scene broadcast control dimension, and the preset broadcast control priorities among the broadcast control dimensions are, from high to low, character broadcast control dimension - audio and video signal broadcast control dimension - scene broadcast control dimension. For example, the character broadcast control dimension with the highest priority can be assigned to broadcast control device 1, and the broadcast control audio and video signal broadcast control dimension and the scene broadcast control dimension can be assigned to broadcast control device 2, so as to realize the broadcast control functions under the corresponding broadcast control dimensions in the corresponding broadcast control devices.

[0115] In this way, according to the broadcast control level of the current live broadcast scene, the number of broadcast control devices corresponding to the broadcast control level is determined, and according to the number of broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director desks, the target broadcast control devices for realizing each broadcast control dimension are determined, so that the multiple groups of virtual director desks can be used in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension, which can realize orderly broadcast control under different broadcast control busyness levels, thereby ensuring the orderly progress of the live broadcast of virtual characters.

[0116] The live data confluence and live screen playback process of S102 and S103:

[0117] Here, when the live broadcast sub-data of the multiple groups of virtual director stations are merged to obtain the live broadcast data, the live broadcast sub-data of the multiple groups of virtual director stations can be mixed at the audio data level and the video data level respectively to obtain one channel of audio and video data for live broadcast (that is, the live broadcast data), thereby achieving the mixing of multiple channels of live broadcast sub-data into one channel of live broadcast data that can be used for live broadcast streaming.

[0118] Specifically, when playing the live screen based on the live data, the live data may be sent to a live server, so that the live data is pushed to a live client based on the live server, and the live screen corresponding to the live data is displayed on the live client.

[0119] The live broadcast server may be a server in a content delivery network (CDN). By sending the live broadcast data to the server in the CDN, the transmission stability of the live broadcast data may be improved.

[0120] The director control method provided by the disclosed embodiment can perform confluence processing on the live broadcast sub-data acquired by each group of virtual director stations during the live broadcast of the virtual character by setting up multiple groups of virtual director stations including at least three broadcast control dimensions, namely, character broadcast control dimension, audio and video signal broadcast control dimension, and scene broadcast control dimension, so as to obtain live broadcast data for live streaming, so as to play the live screen based on the live broadcast data. In this way, compared with using only one virtual director station to broadcast and control the live broadcast data under multiple broadcast control dimensions, by setting up multiple groups of virtual director stations to respectively broadcast and control the live broadcast sub-data under different broadcast control dimensions, the directing pressure of a single virtual director station can be reduced, and the normal live broadcast of the virtual character can be ensured in scenarios with more complex real-time directing requirements, so that more abundant live broadcast links can be performed during the live broadcast of the virtual character, thereby improving the live broadcast effect during the live broadcast of the virtual character.

[0121] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0122] Based on the same inventive concept, a director control device corresponding to the director control method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned director control method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0123] Reference Figure 4 , which is a schematic diagram of the architecture of a broadcast director control device provided by an embodiment of the present disclosure, the device includes: an acquisition module 401, a confluence module 402, and a live broadcast module 403; wherein:

[0124] The acquisition module 401 is used to acquire the live broadcast sub-data of multiple groups of virtual director stations during the live broadcast of the virtual character; each group of virtual director stations in the multiple groups of virtual director stations corresponds to a broadcast control dimension; the broadcast control dimension includes a role broadcast control dimension, an audio and video signal broadcast control dimension, and a scene broadcast control dimension;

[0125] A merging module 402 is used to merge the live broadcast sub-data of the multiple groups of virtual director stations to obtain live broadcast data;

[0126] The live broadcast module 403 is used to play the live broadcast image based on the live broadcast data.

[0127] In a possible implementation manner, the broadcast control dimension further includes an interactive broadcast control dimension for broadcasting and controlling the live broadcast interactive data generated in the live broadcast;

[0128] The live interactive data includes at least one of the following data:

[0129] Barrage data, scene interaction data corresponding to the live broadcast scene, and split-screen live broadcast interaction data corresponding to the live broadcast split-screen operation; wherein the live broadcast split-screen operation is used to display the split-screen live broadcast interaction data in the split-screen area corresponding to the live broadcast screen.

[0130] In a possible implementation, the target virtual director station group in the multiple groups of virtual director stations includes multiple target virtual director stations corresponding to different broadcast control devices, and the broadcast control devices corresponding to the target virtual director stations include the target broadcast control devices corresponding to the virtual character control terminals.

[0131] In a possible implementation manner, the broadcast control dimension corresponding to the target virtual director station group includes a role broadcast control dimension;

[0132] The live broadcast sub-data of the target broadcast control device corresponding to the virtual character control terminal includes at least one of the following data:

[0133] The costume data of the virtual character, the prop data of the virtual character, and the special effects data of the virtual character.

[0134] In a possible implementation manner, the multiple groups of virtual director stations are broadcast controlled by at least one broadcast control device, and each broadcast control device is used to implement a broadcast control function under at least one broadcast control dimension;

[0135] The acquisition module 401 is further used to determine the target broadcast control device for implementing each broadcast control dimension according to the following steps:

[0136] According to the broadcast control level of the current live broadcast scene, determine the number of broadcast control devices corresponding to the broadcast control level; wherein different broadcast control levels correspond to different numbers of broadcast control devices;

[0137] According to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, the target broadcast control devices for realizing each broadcast control dimension are determined, so that the multiple groups of virtual director stations can be used in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension.

[0138] In a possible implementation manner, the acquisition module 401 is further configured to determine the broadcast control level of the current live broadcast scene according to the following steps:

[0139] Obtaining a parameter value of a broadcast control busy parameter used to characterize the broadcast control busyness in the current live broadcast scene; wherein the broadcast control busy parameter includes at least one of the number of virtual characters in the current live broadcast scene, the number of audiences in the current live broadcast scene, the number of live broadcast links in the current live broadcast scene, the number of background stages in the current live broadcast scene, and the number of background music in the current live broadcast scene;

[0140] The broadcast control level of the current live broadcast scene is determined according to the parameter value of each of the broadcast control busy parameters.

[0141] In a possible implementation manner, when determining the broadcast control level of the current live broadcast scene according to the parameter value of each of the broadcast control busy parameters, the acquisition module 401 is used to:

[0142] Outputting the parameter values ​​of each of the broadcast control busy parameters to a pre-trained broadcast control level determination model to determine the confidence information that the current live broadcast scene belongs to each preset broadcast control level;

[0143] Based on the confidence information that the current live broadcast scene belongs to each preset broadcast control level, the broadcast control level of the current live broadcast scene is determined.

[0144] The director control device provided by the disclosed embodiment can perform confluence processing on the live broadcast sub-data acquired by each group of virtual director stations during the live broadcast of the virtual character by setting up multiple groups of virtual director stations including at least three broadcast control dimensions, namely, character broadcast control dimension, audio and video signal broadcast control dimension, and scene broadcast control dimension, so as to obtain live broadcast data for live streaming, so as to play the live screen based on the live broadcast data. In this way, compared with using only one virtual director station to broadcast and control the live broadcast data under multiple broadcast control dimensions, by setting up multiple groups of virtual director stations to respectively broadcast and control the live broadcast sub-data under different broadcast control dimensions, the directing pressure of a single virtual director station can be reduced, and the normal live broadcast of the virtual character can be ensured in scenarios with more complex real-time directing requirements, so that more abundant live broadcast links can be performed during the live broadcast of the virtual character, thereby improving the live broadcast effect during the live broadcast of the virtual character.

[0145] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0146] Based on the same technical concept, the embodiment of the present disclosure also provides a computer device. Figure 5 As shown, it is a schematic diagram of the structure of a computer device 500 provided in an embodiment of the present disclosure, including a processor 501, a memory 502, and a bus 503. Among them, the memory 502 is used to store execution instructions, including a memory 5021 and an external memory 5022; the memory 5021 here is also called an internal memory, which is used to temporarily store the operation data in the processor 501, and the data exchanged with the external memory 5022 such as a hard disk. The processor 501 exchanges data with the external memory 5022 through the memory 5021. When the computer device 500 is running, the processor 501 communicates with the memory 502 through the bus 503, so that the processor 501 executes the following instructions:

[0147] During the live broadcast of the virtual character, the live broadcast sub-data of the broadcast control of multiple groups of virtual director stations are obtained; each group of virtual director stations in the multiple groups of virtual director stations corresponds to a broadcast control dimension; the broadcast control dimension includes the role broadcast control dimension, the audio and video signal broadcast control dimension, and the scene broadcast control dimension;

[0148] The live broadcast sub-data of the plurality of groups of virtual director stations are merged to obtain live broadcast data;

[0149] Live screen playback is performed based on the live data.

[0150] In a possible implementation manner, in the instruction of the processor 501, the broadcast control dimension further includes an interactive broadcast control dimension for broadcasting and controlling the live broadcast interactive data generated in the live broadcast;

[0151] The live interactive data includes at least one of the following data:

[0152] Barrage data, scene interaction data corresponding to the live broadcast scene, and split-screen live broadcast interaction data corresponding to the live broadcast split-screen operation; wherein the live broadcast split-screen operation is used to display the split-screen live broadcast interaction data in the split-screen area corresponding to the live broadcast screen.

[0153] In a possible implementation, in the instructions of the processor 501, the target virtual director station group in the multiple groups of virtual director stations includes multiple target virtual director stations corresponding to different broadcast control devices, and the broadcast control devices corresponding to the target virtual director stations include the target broadcast control devices corresponding to the virtual character control terminal.

[0154] In a possible implementation manner, in the instruction of the processor 501, the broadcast control dimension corresponding to the target virtual director station group includes a role broadcast control dimension;

[0155] The live broadcast sub-data of the target broadcast control device corresponding to the virtual character control terminal includes at least one of the following data:

[0156] The costume data of the virtual character, the prop data of the virtual character, and the special effects data of the virtual character.

[0157] In a possible implementation manner, in the instructions of the processor 501, the multiple groups of virtual director stations are broadcast controlled by at least one broadcast control device, and each broadcast control device is used to implement a broadcast control function under at least one broadcast control dimension;

[0158] The method also includes determining the target broadcast control device for implementing each broadcast control dimension according to the following steps:

[0159] According to the broadcast control level of the current live broadcast scene, determine the number of broadcast control devices corresponding to the broadcast control level; wherein different broadcast control levels correspond to different numbers of broadcast control devices;

[0160] According to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, the target broadcast control devices for realizing each broadcast control dimension are determined, so that the multiple groups of virtual director stations can be used in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension.

[0161] In a possible implementation manner, the instructions of the processor 501 further include determining the broadcast control level of the current live broadcast scene according to the following steps:

[0162] Obtaining a parameter value of a broadcast control busy parameter used to characterize the broadcast control busyness in the current live broadcast scene; wherein the broadcast control busy parameter includes at least one of the number of virtual characters in the current live broadcast scene, the number of audiences in the current live broadcast scene, the number of live broadcast links in the current live broadcast scene, the number of background stages in the current live broadcast scene, and the number of background music in the current live broadcast scene;

[0163] The broadcast control level of the current live broadcast scene is determined according to the parameter value of each of the broadcast control busy parameters.

[0164] In a possible implementation manner, in the instruction of the processor 501, determining the broadcast control level of the current live broadcast scene according to the parameter value of each of the broadcast control busy parameters includes:

[0165] Outputting the parameter values ​​of each of the broadcast control busy parameters to a pre-trained broadcast control level determination model to determine the confidence information that the current live broadcast scene belongs to each preset broadcast control level;

[0166] Based on the confidence information that the current live broadcast scene belongs to each preset broadcast control level, the broadcast control level of the current live broadcast scene is determined.

[0167] The embodiment of the present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the director control method described in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0168] The embodiments of the present disclosure also provide a computer program product, which carries a program code. The instructions included in the program code can be used to execute the steps of the director control method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0169] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0170] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0171] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0172] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0173] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0174] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A broadcast control method, characterized in that: include: During the live broadcast of the virtual character, the live broadcast sub-data of the broadcast control of multiple groups of virtual director stations are obtained; each group of virtual director stations in the multiple groups of virtual director stations corresponds to a broadcast control dimension; the broadcast control dimension includes the role broadcast control dimension, the audio and video signal broadcast control dimension, and the scene broadcast control dimension; The live broadcast sub-data of the plurality of groups of virtual director stations are merged to obtain live broadcast data; Live screen playback is performed based on the live data.

2. The method according to claim 1, characterized in that The broadcast control dimension also includes an interactive broadcast control dimension for broadcasting and controlling the live broadcast interactive data generated in the live broadcast; The live interactive data includes at least one of the following data: Barrage data, scene interaction data corresponding to the live broadcast scene, and split-screen live broadcast interaction data corresponding to the live broadcast split-screen operation; wherein the live broadcast split-screen operation is used to display the split-screen live broadcast interaction data in the split-screen area corresponding to the live broadcast screen.

3. The method according to claim 1, characterized in that The target virtual director station group in the multiple groups of virtual director stations includes multiple target virtual director stations corresponding to different broadcast control devices, and the broadcast control devices corresponding to the target virtual director stations include the target broadcast control devices corresponding to the virtual character control terminals.

4. The method according to claim 3, characterized in that The broadcast control dimension corresponding to the target virtual director station group includes the role broadcast control dimension; The live broadcast sub-data of the target broadcast control device corresponding to the virtual character control terminal includes at least one of the following data: The costume data of the virtual character, the prop data of the virtual character, and the special effects data of the virtual character.

5. The method according to claim 1, characterized in that The multiple groups of virtual director stations are broadcast controlled by at least one broadcast control device, and each broadcast control device is used to implement a broadcast control function under at least one broadcast control dimension; The method further includes determining a target broadcast control device for implementing each broadcast control dimension according to the following steps: According to the broadcast control level of the current live broadcast scene, determine the number of broadcast control devices corresponding to the broadcast control level; wherein different broadcast control levels correspond to different numbers of broadcast control devices; According to the number of the broadcast control devices and the multiple broadcast control dimensions included in the multiple groups of virtual director stations, the target broadcast control devices for realizing each broadcast control dimension are determined, so that the multiple groups of virtual director stations can be used in each target broadcast control device to realize the broadcast control function under the corresponding broadcast control dimension.

6. The method according to claim 5, characterized in that The method further comprises determining the broadcast control level of the current live broadcast scene according to the following steps: Obtaining a parameter value of a broadcast control busy parameter used to characterize the broadcast control busyness in the current live broadcast scene; wherein the broadcast control busy parameter includes at least one of the number of virtual characters in the current live broadcast scene, the number of audiences in the current live broadcast scene, the number of live broadcast links in the current live broadcast scene, the number of background stages in the current live broadcast scene, and the number of background music in the current live broadcast scene; The broadcast control level of the current live broadcast scene is determined according to the parameter value of each of the broadcast control busy parameters.

7. The method according to claim 6, characterized in that Determining the broadcast control level of the current live broadcast scene according to the parameter value of each of the broadcast control busy parameters includes: Outputting the parameter values ​​of each of the broadcast control busy parameters to a pre-trained broadcast control level determination model to determine the confidence information that the current live broadcast scene belongs to each preset broadcast control level; Based on the confidence information that the current live broadcast scene belongs to each preset broadcast control level, the broadcast control level of the current live broadcast scene is determined.

8. A broadcast director control device, characterized in that: include: An acquisition module is used to acquire live broadcast sub-data of multiple groups of virtual director stations during the live broadcast of the virtual character; each group of virtual director stations in the multiple groups of virtual director stations corresponds to a broadcast control dimension; the broadcast control dimension includes a role broadcast control dimension, an audio and video signal broadcast control dimension, and a scene broadcast control dimension; A confluence module, used for confluence processing of the live broadcast sub-data of the plurality of groups of virtual director stations to obtain live broadcast data; The live broadcast module is used to play the live broadcast image based on the live broadcast data.

9. A computer device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the director control method as described in any one of claims 1 to 7 are performed.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the director control method as described in any one of claims 1 to 7 are executed.

Images