Live broadcast control method and device, computer equipment and storage medium

By determining the task type and shooting area in the virtual live broadcast, selecting and guiding the control of the virtual camera group, the problem of multi-camera control in the virtual live broadcast is solved, and rich live broadcast effects and stable live broadcast process are achieved.

CN119729142AActive Publication Date: 2025-03-28BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202311262979.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-27
Publication Date
2025-03-28
Estimated Expiration
2043-09-27

AI Technical Summary

Technical Problem

In virtual live broadcast scenarios, how to effectively control multiple virtual cameras to ensure the richness and stability of live broadcast effects.

Method used

By determining the task type and shooting area of ​​the live broadcast task, select the corresponding virtual camera group, and conduct direct control of the virtual camera group according to the task type's mirror trajectory.

Benefits of technology

It realizes the selection of appropriate virtual cameras based on the task type and shooting area, enriches the live viewing angle, improves the stability of the live broadcast effect and the viewing experience of the audience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119729142A_ABST
    Figure CN119729142A_ABST
Patent Text Reader

Abstract

The invention provides a live broadcast control method and device, computer equipment and a storage medium, and the method comprises the steps: responding to a received live broadcast task, and determining a task type and a shooting region corresponding to the live broadcast task; selecting a virtual camera group corresponding to the task type according to the task type; and according to the mirror moving track corresponding to the task type, performing director control on each virtual camera in the virtual camera group. In this way, virtual camera selection and program director control are carried out according to the task type and the shooting area, and it can be determined that the virtual camera used in the live broadcast process can meet the live broadcast requirements corresponding to the task type and the shooting area; and on the other hand, the virtual camera group comprises a plurality of virtual cameras with different shooting poses, so that the live broadcast pictures under different shooting view angles can be broadcast and controlled in the live broadcast process, the live broadcast watching experience of live broadcast audiences is enriched, and the live broadcast effect when the virtual role is used for virtual live broadcast is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of live broadcast technology, and in particular to a live broadcast control method, device, computer equipment and storage medium. Background Art

[0002] With the rapid development of Internet technology, watching live broadcasts has gradually become one of the ways for people to shop, entertain, and relax. In the virtual live broadcast scenario, real people can control virtual characters to perform related actions to broadcast live through virtual characters.

[0003] In the related art, in order to enrich the visual effects of live broadcast, multiple cameras can be used for virtual live broadcast. Therefore, how to control multiple virtual cameras during the live broadcast process to ensure the live broadcast effect of virtual live broadcast has become a technical problem that needs to be solved urgently in this field. Summary of the invention

[0004] The embodiments of the present disclosure at least provide a live broadcast control method, apparatus, computer equipment and storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides a live broadcast control method, including:

[0006] In response to receiving a live broadcast task, determining a task type and a shooting area corresponding to the live broadcast task;

[0007] According to the task type, a virtual camera group corresponding to the task type is selected; wherein the virtual camera group includes a plurality of virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures;

[0008] According to the camera movement trajectory corresponding to the task type, each virtual camera in the virtual camera group is directed and controlled.

[0009] In a possible implementation manner, the camera movement trajectory includes a preset first camera movement trajectory;

[0010] The performing broadcast control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type includes:

[0011] In response to the fact that there are multiple preset first camera movement tracks corresponding to the task type, a target first camera movement track is selected from the multiple first camera movement tracks according to the camera movement modes and camera movement rates respectively corresponding to the multiple first camera movement tracks, and performance status information of each virtual character during the live broadcast, and broadcast control is performed on each virtual camera in the virtual camera group;

[0012] Among them, the performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0013] In a possible implementation manner, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras;

[0014] The performing broadcast control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type includes:

[0015] In the process of performing director control on the virtual camera according to the first camera movement trajectory, in response to receiving the director control operation of the first user, switching to play the shooting picture of the virtual camera corresponding to the second camera movement trajectory.

[0016] In a possible implementation manner, the first user includes a director control user or a virtual character control user;

[0017] The switching and playing of the shooting picture of the virtual camera corresponding to the second camera movement track includes:

[0018] In response to an abnormality in the current output shooting picture of the first virtual camera corresponding to the first camera movement trajectory, the shooting picture of the second virtual camera is switched to be played according to the second virtual camera switched by the first user.

[0019] In a possible implementation manner, the first user includes a virtual character control user; the virtual character control user is used to output control information through a motion capture device worn by the user, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area;

[0020] The switching and playing of the shooting picture of the virtual camera corresponding to the second camera movement track includes:

[0021] In response to a shooting control operation of the virtual character controlling user on a handheld third virtual camera, determining target control information corresponding to the shooting control operation;

[0022] Control and display the shooting action corresponding to the target virtual character and the target control information, and switch to play the shooting picture of the third virtual camera.

[0023] In a possible implementation manner, selecting a virtual camera group corresponding to the task type according to the task type includes:

[0024] Determine a plurality of virtual cameras to be screened corresponding to the shooting area;

[0025] According to the task type, a virtual camera having a target shooting attribute is selected from the multiple virtual cameras to be screened to form a virtual camera group corresponding to the task type.

[0026] In a possible implementation manner, selecting a virtual camera group corresponding to the task type according to the task type includes:

[0027] Determine a plurality of virtual camera groups to be screened corresponding to the shooting area;

[0028] According to the task type, a virtual camera group corresponding to the task type is selected from the multiple groups of virtual camera groups to be screened.

[0029] In a possible implementation manner, determining the shooting area includes:

[0030] According to the task type and the size of the scene area of ​​the real scene where each virtual character controls the user, a shooting area matching the task type in the virtual scene is determined; the size of the shooting area matches the size of the scene area of ​​the real scene.

[0031] In a second aspect, the embodiment of the present disclosure further provides a live broadcast control device, including:

[0032] A determination module, configured to determine, in response to receiving a live broadcast task, a task type and a shooting area corresponding to the live broadcast task;

[0033] A selection module, configured to select a virtual camera group corresponding to the task type according to the task type; wherein the virtual camera group includes a plurality of virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures;

[0034] The director module is used to perform director control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

[0035] In a possible implementation manner, the camera movement trajectory includes a preset first camera movement trajectory;

[0036] The directing module, when performing directing control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type, is used to:

[0037] In response to the fact that there are multiple preset first camera movement tracks corresponding to the task type, a target first camera movement track is selected from the multiple first camera movement tracks according to the camera movement modes and camera movement rates respectively corresponding to the multiple first camera movement tracks, and performance status information of each virtual character during the live broadcast, and broadcast control is performed on each virtual camera in the virtual camera group;

[0038] Among them, the performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0039] In a possible implementation manner, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras;

[0040] The directing module, when performing directing control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type, is used to:

[0041] In the process of performing director control on the virtual camera according to the first camera movement trajectory, in response to receiving the director control operation of the first user, switching to play the shooting picture of the virtual camera corresponding to the second camera movement trajectory.

[0042] In a possible implementation manner, the first user includes a director control user or a virtual character control user;

[0043] The director module is used to switch and play the shooting picture of the virtual camera corresponding to the second camera movement track:

[0044] In response to an abnormality in the current output shooting picture of the first virtual camera corresponding to the first camera movement trajectory, the shooting picture of the second virtual camera is switched to be played according to the second virtual camera switched by the first user.

[0045] In a possible implementation manner, the first user includes a virtual character control user; the virtual character control user is used to output control information through a motion capture device worn by the user, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area;

[0046] The director module is used to switch and play the shooting picture of the virtual camera corresponding to the second camera movement track:

[0047] In response to a shooting control operation of the virtual character controlling user on a handheld third virtual camera, determining target control information corresponding to the shooting control operation;

[0048] Control and display the shooting action corresponding to the target virtual character and the target control information, and switch to play the shooting picture of the third virtual camera.

[0049] In a possible implementation manner, when the selection module selects the virtual camera group corresponding to the task type according to the task type, it is configured to:

[0050] Determine a plurality of virtual cameras to be screened corresponding to the shooting area;

[0051] According to the task type, a virtual camera having a target shooting attribute is selected from the multiple virtual cameras to be screened to form a virtual camera group corresponding to the task type.

[0052] In a possible implementation manner, when the selection module selects the virtual camera group corresponding to the task type according to the task type, it is configured to:

[0053] Determine a plurality of virtual camera groups to be screened corresponding to the shooting area;

[0054] According to the task type, a virtual camera group corresponding to the task type is selected from the multiple groups of virtual camera groups to be screened.

[0055] In a possible implementation manner, the determining module, when determining the shooting area, is used to:

[0056] According to the task type and the size of the scene area of ​​the real scene where each virtual character controls the user, a shooting area matching the task type in the virtual scene is determined; the size of the shooting area matches the size of the scene area of ​​the real scene.

[0057] In a third aspect, an embodiment of the present disclosure further provides a computer device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the above-mentioned first aspect, or any possible implementation of the first aspect are performed.

[0058] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned first aspect or any possible implementation of the first aspect are executed.

[0059] The live broadcast control method, device, computer equipment and storage medium provided by the embodiments of the present disclosure can determine the task type and shooting area corresponding to the received live broadcast task, so that the virtual camera group corresponding to the task type can be selected according to the determined task type, and the director control of each virtual camera in the virtual camera group can be performed according to the camera movement trajectory corresponding to the task type. In this way, by selecting and directing the virtual camera according to the task type and the shooting area, it can be determined that the virtual camera used in the live broadcast process can meet the live broadcast requirements corresponding to the task type and the shooting area; on the other hand, since the virtual camera group contains multiple virtual cameras with different shooting postures, the live broadcast images under different shooting angles can be broadcast and controlled during the live broadcast process, thereby enriching the live viewing experience of the live audience and ensuring the live broadcast effect when using virtual characters for virtual live broadcasts.

[0060] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0061] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.

[0062] Figure 1 A flowchart of a live broadcast control method provided by some embodiments of the present disclosure is shown;

[0063] Figure 2a A schematic diagram showing a method for controlling the live broadcast provided in some embodiments of the present disclosure, in which a shooting area matching the task type is divided in a virtual scene according to a task area division rule;

[0064] Figure 2b Another schematic diagram of dividing a shooting area matching the task type in a virtual scene according to a task area division rule in the live broadcast control method provided by some embodiments of the present disclosure is shown;

[0065] Figure 3 A schematic diagram of the architecture of a live broadcast control device provided by some embodiments of the present disclosure is shown;

[0066] Figure 4A schematic structural diagram of a computer device provided in some embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0068] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0069] The term "and / or" herein only describes an association relationship, indicating that three relationships may exist. For example, A and / or B may represent the following three situations: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C may represent including any one or more elements selected from the set consisting of A, B, and C.

[0070] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0071] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0072] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0073] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet the relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0074] Research has found that in the virtual live broadcast scenario, real people can control virtual characters to perform related actions to broadcast live through virtual characters. In related technologies, in order to enrich the live broadcast effect, multiple cameras can be used for virtual live broadcast. Therefore, how to control multiple virtual cameras during the live broadcast process to ensure the live broadcast effect of virtual live broadcast has become a technical problem that needs to be solved urgently in this field.

[0075] Based on the above research, the present disclosure provides a live broadcast control method, device, computer equipment and storage medium. By determining the task type and shooting area corresponding to the received live broadcast task, a virtual camera group corresponding to the task type can be selected according to the determined task type, and each virtual camera in the virtual camera group can be directed and controlled according to the camera movement trajectory corresponding to the task type. In this way, by selecting and directing virtual cameras according to the task type and shooting area, it can be determined that the virtual camera used in the live broadcast process can meet the live broadcast requirements corresponding to the task type and shooting area; on the other hand, since the virtual camera group contains multiple virtual cameras with different shooting postures, the live broadcast images under different shooting angles can be controlled during the live broadcast process, thereby enriching the live broadcast viewing experience of the live broadcast audience and ensuring the live broadcast effect when using virtual characters for virtual live broadcasts.

[0076] To facilitate understanding of this embodiment, a live broadcast control method disclosed in the embodiment of the present disclosure is first introduced in detail. The execution subject of the live broadcast control method provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities, and the computer device includes, for example: a terminal device or a server or other processing device, and the terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the live broadcast control method can be implemented by a processor calling a computer-readable instruction stored in a memory.

[0077] See also Figure 1As shown, it is a flowchart of the live broadcast control method provided by the embodiment of the present disclosure, and the method includes S101 to S103, wherein:

[0078] S101: In response to receiving a live broadcast task, determining a task type and a shooting area corresponding to the live broadcast task.

[0079] S102: According to the task type, select a virtual camera group corresponding to the task type; wherein the virtual camera group includes multiple virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures.

[0080] S103: Performing broadcast control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

[0081] The following is a detailed description of the above steps.

[0082] The process of determining the task type and shooting area corresponding to the live broadcast task of S101:

[0083] Here, the task type and shooting area corresponding to the live broadcast task can be specified before the live broadcast starts, and the task type and shooting area corresponding to the live broadcast task can be obtained by parsing the live broadcast task; wherein, the task type may include interview tasks, dance tasks, etc., and the shooting area may be an interview area, a dance area, etc.

[0084] In one possible implementation, when determining the shooting area, the shooting area that matches the task type in the virtual scene can be determined based on the task type and the size of the scene area of ​​the real scene where the user of each virtual character controls the user; wherein the size of the shooting area matches the size of the scene area of ​​the real scene.

[0085] Here, the virtual character control user is a user who controls the virtual character in the virtual scene, and is used to output control information through the motion capture device worn by the user, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area, thereby realizing the live broadcast of the virtual character in the virtual scene; the real scene is the scene in which the virtual character control user is active during the live broadcast, and the real scene can be the motion capture room where the virtual character control user is located, etc.

[0086] Specifically, when determining the shooting area that matches the task type in the virtual scene based on the task type and the size of the scene area of ​​the real scene where each virtual character controls the user, the task area division rule that matches the task type can be first determined based on the task type, and then the shooting area that matches the task type can be divided in the virtual scene based on the task area division rule; wherein the task area division rule may include a shooting area division ratio for characterizing the area ratio of the shooting area in the scene area of ​​the real scene, and a shooting area division method for characterizing the shooting area divided from the scene area of ​​the real scene.

[0087] Exemplarily, taking the task type of dance task as an example, the task area division rules matching the task type "dance task" may include a shooting area division ratio of "80%" used to characterize the area ratio of the shooting area in the scene area of ​​the real scene, and a shooting area division method for dividing the shooting area from the scene area of ​​the real scene "starting from the direction of the virtual camera corresponding to the dance task in the scene area of ​​the real scene, and the shape of the divided shooting area is a rectangle".

[0088] Following the above example, according to the task area division rule, a schematic diagram of dividing the shooting area matching the task type in the virtual scene can be as follows: Figure 2a and Figure 2b As shown, Figure 2a In the figure, the scene area of ​​the real scene where the virtual character controls the user is composed of the dark area and the white area in the figure. At this time, the virtual camera corresponding to the dance task is located on the left side of the figure, and the dark area representing the shooting area is also located on the left side of the figure. The dark area represents the shooting area divided according to the direction of the virtual camera corresponding to the dance task (the dark area in the figure is a rectangular area in the top view); Figure 2b In the figure, the scene area of ​​the real scene where the virtual character controls the user is composed of the dark area and the white area in the figure. At this time, the virtual camera corresponding to the dance task is located on the right side of the figure, and the dark area representing the shooting area is also located on the right side of the figure. The dark area represents the shooting area divided according to the direction of the virtual camera corresponding to the dance task (the dark area in the figure is a rectangular area in the top view).

[0089] In this way, when determining the shooting area corresponding to the live broadcast task, the area specified before the live broadcast starts can be used as the shooting area; or, the task area division rule matching the task type can be determined first, and then the shooting area is divided from the scene area corresponding to the real scene in real time according to the shooting posture of the virtual camera corresponding to the live broadcast task in the real scene and the task area division rule, and the size of the shooting area matches the scene area size of the real scene, so that the shooting area divided in real time can be more in line with the actual shooting situation in the real scene at the current moment, so that the virtual character controlling user can interact with the live broadcast more conveniently.

[0090] The selection process of the virtual camera group for S102:

[0091] Here, the virtual camera is a camera used to shoot virtual characters for live broadcast. The virtual camera can be a camera that exists in a virtual scene, or it can also be a camera that exists in a real scene. Different virtual cameras have different shooting attributes. The shooting attributes may include the shooting posture, shooting type, etc. of the virtual camera. The shooting type may include panoramic camera shooting with a fixed camera position, jib camera shooting that can be moved in multiple directions, track camera shooting that can be moved along a fixed track, close-up camera shooting with a fixed camera position, etc. Virtual cameras of different shooting types have different corresponding shooting functions and shooting effects. The control buttons corresponding to each virtual camera in the director device may be different. For example, virtual camera 1 corresponds to control button 1, virtual camera 2 corresponds to control button 2, and so on.

[0092] Wherein, when selecting a virtual camera group corresponding to the task type according to the task type, at least one of the following methods may be used:

[0093] Method 1: Select virtual cameras according to the task type to form a virtual camera group

[0094] In a possible implementation manner, when selecting a virtual camera according to a task type to form a virtual camera group, the following steps A1 to A2 may be performed:

[0095] A1: Determine a plurality of virtual cameras to be screened corresponding to the shooting area.

[0096] Here, when determining a plurality of virtual cameras to be screened corresponding to the shooting area, a plurality of virtual cameras to be screened that cover the shooting area within a corresponding shooting range can be determined from a virtual camera library corresponding to the real scene area.

[0097] A2: According to the task type, a virtual camera having a target shooting attribute is selected from the multiple virtual cameras to be screened to form a virtual camera group corresponding to the task type.

[0098] Here, the target shooting attributes may be shooting attributes corresponding to the task type. Taking the task type being a dance task as an example, the target shooting attributes corresponding to the dance task may be panoramic camera shooting, jib camera shooting that can move in multiple directions, track camera shooting that can move along a fixed track, close-up camera shooting with a fixed camera, and the like. By selecting a virtual camera with target shooting attributes corresponding to the dance task, a virtual camera group suitable for shooting the dance task can be selected.

[0099] Method 2: Select a virtual camera group from the multiple virtual camera groups to be screened according to the task type.

[0100] In a possible implementation manner, when selecting a virtual camera group from the plurality of virtual camera groups to be screened according to the task type, the following steps B1 to B2 may be performed:

[0101] B1: Determine a plurality of virtual camera groups to be screened corresponding to the shooting area.

[0102] Here, multiple groups of virtual camera groups to be screened may be preset for different shooting areas to meet different shooting requirements in the corresponding shooting areas.

[0103] Specifically, when determining the multiple groups of virtual camera groups to be screened corresponding to the shooting area, the multiple groups of virtual camera groups to be screened corresponding to the shooting area may be determined according to a preset mapping relationship between the shooting area and the virtual camera groups to be screened.

[0104] B2: According to the task type, a virtual camera group corresponding to the task type is selected from the multiple groups of virtual camera groups to be screened.

[0105] Here, the types of tasks to be screened corresponding to different virtual camera groups to be screened may be different. For example, the type of task to be screened corresponding to virtual camera group 1 to be screened may be slow-paced dance shooting, and the type of task to be screened corresponding to virtual camera group 2 to be screened may be fast-paced dance shooting.

[0106] Specifically, when selecting a virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened according to the task type, the virtual camera group corresponding to the task type to be screened in the multiple groups of virtual camera groups to be screened and matching the task type can be determined according to the task type and the task types to be screened respectively corresponding to the multiple groups of virtual camera groups to be screened.

[0107] In this way, by setting up corresponding multiple groups of camera groups to be screened according to the task requirements of different task types in the shooting area in advance, after determining the shooting area and task type, the virtual camera group corresponding to the task type can be selected from the multiple groups of virtual camera groups to be screened, thereby quickly completing the selection of the virtual camera and conducting live broadcast more quickly.

[0108] For S103,

[0109] Here, the camera movement trajectory may include a preset first camera movement trajectory, and / or a second camera movement trajectory controlled by a first user; different camera movement trajectories may use different virtual cameras, for example, the first camera movement trajectory may use a virtual camera whose shooting attribute is a track camera that moves along a fixed track, and the second camera movement trajectory may use a virtual camera whose shooting attribute is a jib camera that can move in multiple directions.

[0110] Among them, the preset first camera movement trajectory is the camera movement trajectory corresponding to the task type. For example, a preset first camera movement trajectory may correspond to a dance task, so that the shooting of the dance task can be completed through the first camera movement trajectory and the virtual camera; the first user may include a director controlling the user or a virtual character controlling the user, and the second camera movement trajectory controlled by the first user can achieve more flexible live shooting, thereby obtaining richer shooting effects.

[0111] In a possible implementation, when directing control is performed on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, in response to the fact that the preset first camera movement trajectories corresponding to the task type include multiple camera movement trajectories, a target first camera movement trajectory can be selected from the multiple first camera movement trajectories according to the camera movement modes and camera movement rates respectively corresponding to the multiple first camera movement trajectories, and the performance status information of each virtual character during the live broadcast, to perform directing control on each virtual camera in the virtual camera group.

[0112] Among them, the performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates may be different. The performance states of the virtual characters may include fast-paced dance state, slow-paced dance state, interview state, etc.

[0113] In this way, by setting different camera movement methods and / or different camera movement rates for different performance states, the first camera movement trajectory that is more in line with the performance state of the virtual character can be selected during the director control stage of the live broadcast, thereby improving the live broadcast effect.

[0114] In another possible implementation, when director control is performed on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, during the process of director control of the virtual camera according to the first camera movement trajectory, in response to receiving the director control operation of the first user, the playback of the shooting image of the virtual camera corresponding to the second camera movement trajectory can be switched.

[0115] Here, the director control operation is used to switch the camera movement trajectory. By executing the director control operation, the camera movement trajectory can be converted from the current camera movement trajectory to the second camera movement trajectory.

[0116] In this way, by receiving the director control operation during the process of director controlling the virtual camera according to the first camera movement trajectory, the currently used preset first camera movement trajectory can be switched to the second camera movement trajectory controlled by the first user, so that the camera movement trajectory during the live broadcast process can be flexibly switched to meet different live broadcast requirements during the live broadcast process.

[0117] In one possible implementation, when switching to play the shooting picture of the virtual camera corresponding to the second camera movement trajectory, in response to an abnormality in the current output shooting picture of the first virtual camera corresponding to the first camera movement trajectory, the shooting picture of the second virtual camera can be switched to play according to the second virtual camera triggered by the first user.

[0118] Here, the abnormality of the currently output shooting picture may be that a virtual camera that generates the currently output shooting picture has a fault, and the fault may be, for example, that the virtual camera fails to generate a corresponding shooting picture according to a preset first camera movement trajectory; or, the abnormality of the currently output shooting picture may be that the virtual camera that generates the currently output shooting picture has a picture content that does not meet the picture content requirements.

[0119] In this way, if the virtual camera fails or the captured image content does not meet the image content requirements, the second virtual camera can be triggered in time according to the first user to switch to play the captured image of the second virtual camera, so that the live broadcast image content can be adjusted in time to ensure the normal progress of the live broadcast.

[0120] In another possible implementation manner, the following steps C1 to C2 may be used to switch and play the shooting picture of the virtual camera corresponding to the second camera movement track:

[0121] C1: In response to a shooting control operation of the virtual character controlling user on a handheld third virtual camera, target control information corresponding to the shooting control operation is determined.

[0122] C2: Control and display the shooting action corresponding to the target virtual character and the target control information, and switch to play the shooting picture of the third virtual camera.

[0123] In this way, the target virtual character corresponding to the shooting control operation can be displayed at close range in the shooting picture of the third virtual camera, thereby highlighting the target virtual character, so that the user can more intuitively interact with the target virtual character in live broadcast, thereby improving the user's live broadcast interaction experience.

[0124] The live broadcast control method provided by the disclosed embodiment can determine the task type and shooting area corresponding to the received live broadcast task, so that the virtual camera group corresponding to the task type can be selected according to the determined task type, and the director control of each virtual camera in the virtual camera group can be performed according to the camera movement trajectory corresponding to the task type. In this way, by selecting and directing the virtual camera according to the task type and the shooting area, it can be determined that the virtual camera used in the live broadcast process can meet the live broadcast requirements corresponding to the task type and the shooting area; on the other hand, since the virtual camera group contains multiple virtual cameras with different shooting postures, the live broadcast images under different shooting angles can be broadcast and controlled during the live broadcast process, thereby enriching the live broadcast viewing experience of the live audience and ensuring the live broadcast effect when using virtual characters for virtual live broadcasts.

[0125] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0126] Based on the same inventive concept, a live broadcast control device corresponding to the live broadcast control method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned live broadcast control method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0127] Reference Figure 3 , which is a schematic diagram of the architecture of a live broadcast control device provided by an embodiment of the present disclosure, the device comprises: a determination module 301, a selection module 302, and a broadcast director module 303; wherein,

[0128] A determination module 301 is used to determine a task type and a shooting area corresponding to the live broadcast task in response to receiving the live broadcast task;

[0129] A selection module 302 is used to select a virtual camera group corresponding to the task type according to the task type; wherein the virtual camera group includes multiple virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures;

[0130] The director module 303 is used to perform director control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

[0131] In a possible implementation manner, the camera movement trajectory includes a preset first camera movement trajectory;

[0132] The directing module 303, when performing directing control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type, is used to:

[0133] In response to the fact that there are multiple preset first camera movement tracks corresponding to the task type, a target first camera movement track is selected from the multiple first camera movement tracks according to the camera movement modes and camera movement rates respectively corresponding to the multiple first camera movement tracks, and performance status information of each virtual character during the live broadcast, and broadcast control is performed on each virtual camera in the virtual camera group;

[0134] Among them, the performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0135] In a possible implementation manner, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras;

[0136] The directing module 303, when performing directing control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type, is used to:

[0137] In the process of performing director control on the virtual camera according to the first camera movement trajectory, in response to receiving the director control operation of the first user, switching to play the shooting picture of the virtual camera corresponding to the second camera movement trajectory.

[0138] In a possible implementation manner, the first user includes a director control user or a virtual character control user;

[0139] The director module 303, when switching to play the shooting picture of the virtual camera corresponding to the second camera movement track, is used to:

[0140] In response to an abnormality in the current output shooting picture of the first virtual camera corresponding to the first camera movement trajectory, the shooting picture of the second virtual camera is switched to be played according to the second virtual camera switched by the first user.

[0141] In a possible implementation manner, the first user includes a virtual character control user; the virtual character control user is used to output control information through a motion capture device worn by the user, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area;

[0142] The director module 303, when switching to play the shooting picture of the virtual camera corresponding to the second camera movement track, is used to:

[0143] In response to a shooting control operation of the virtual character controlling user on a handheld third virtual camera, determining target control information corresponding to the shooting control operation;

[0144] Control and display the shooting action corresponding to the target virtual character and the target control information, and switch to play the shooting picture of the third virtual camera.

[0145] In a possible implementation manner, the selection module 302, when selecting the virtual camera group corresponding to the task type according to the task type, is configured to:

[0146] Determine a plurality of virtual cameras to be screened corresponding to the shooting area;

[0147] According to the task type, a virtual camera having a target shooting attribute is selected from the multiple virtual cameras to be screened to form a virtual camera group corresponding to the task type.

[0148] In a possible implementation manner, the selection module 302, when selecting the virtual camera group corresponding to the task type according to the task type, is configured to:

[0149] Determine a plurality of virtual camera groups to be screened corresponding to the shooting area;

[0150] According to the task type, a virtual camera group corresponding to the task type is selected from the multiple groups of virtual camera groups to be screened.

[0151] In a possible implementation manner, the determining module 301, when determining the shooting area, is used to:

[0152] According to the task type and the size of the scene area of ​​the real scene where each virtual character controls the user, a shooting area matching the task type in the virtual scene is determined; the size of the shooting area matches the size of the scene area of ​​the real scene.

[0153] The live broadcast control device provided by the disclosed embodiment can determine the task type and shooting area corresponding to the received live broadcast task, so as to select the virtual camera group corresponding to the task type according to the determined task type, and perform director control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type. In this way, by selecting and directing the virtual camera according to the task type and the shooting area, it can be determined that the virtual camera used in the live broadcast process can meet the live broadcast requirements corresponding to the task type and the shooting area; on the other hand, since the virtual camera group contains multiple virtual cameras with different shooting postures, the live broadcast images under different shooting angles can be controlled during the live broadcast process, thereby enriching the live broadcast viewing experience of the live broadcast audience and ensuring the live broadcast effect when using virtual characters for virtual live broadcast.

[0154] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0155] Based on the same technical concept, the embodiment of the present disclosure also provides a computer device. Figure 4 As shown, it is a schematic diagram of the structure of a computer device 400 provided in an embodiment of the present disclosure, including a processor 401, a memory 402, and a bus 403. Among them, the memory 402 is used to store execution instructions, including a memory 4021 and an external memory 4022; the memory 4021 here is also called an internal memory, which is used to temporarily store the operation data in the processor 401, and the data exchanged with the external memory 4022 such as a hard disk. The processor 401 exchanges data with the external memory 4022 through the memory 4021. When the computer device 400 is running, the processor 401 communicates with the memory 402 through the bus 403, so that the processor 401 executes the following instructions:

[0156] In response to receiving a live broadcast task, determining a task type and a shooting area corresponding to the live broadcast task;

[0157] According to the task type, a virtual camera group corresponding to the task type is selected; wherein the virtual camera group includes a plurality of virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures;

[0158] According to the camera movement trajectory corresponding to the task type, each virtual camera in the virtual camera group is directed and controlled.

[0159] In a possible implementation manner, in the instruction of the processor 401, the camera movement trajectory includes a preset first camera movement trajectory;

[0160] The performing broadcast control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type includes:

[0161] In response to the fact that there are multiple preset first camera movement tracks corresponding to the task type, a target first camera movement track is selected from the multiple first camera movement tracks according to the camera movement modes and camera movement rates respectively corresponding to the multiple first camera movement tracks, and performance status information of each virtual character during the live broadcast, and broadcast control is performed on each virtual camera in the virtual camera group;

[0162] Among them, the performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0163] In a possible implementation manner, in the instruction of the processor 401, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras;

[0164] The performing broadcast control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type includes:

[0165] In the process of performing director control on the virtual camera according to the first camera movement trajectory, in response to receiving the director control operation of the first user, switching to play the shooting picture of the virtual camera corresponding to the second camera movement trajectory.

[0166] In a possible implementation manner, in the instruction of the processor 401, the first user includes a director control user or a virtual character control user;

[0167] The switching and playing of the shooting picture of the virtual camera corresponding to the second camera movement track includes:

[0168] In response to an abnormality in the current output shooting picture of the first virtual camera corresponding to the first camera movement trajectory, the shooting picture of the second virtual camera is switched to be played according to the second virtual camera switched by the first user.

[0169] In a possible implementation manner, in the instruction of the processor 401, the first user includes a virtual character control user; the virtual character control user is used to output control information through a motion capture device worn by the user, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area;

[0170] The switching and playing of the shooting picture of the virtual camera corresponding to the second camera movement track includes:

[0171] In response to a shooting control operation of the virtual character controlling user on a handheld third virtual camera, determining target control information corresponding to the shooting control operation;

[0172] Control and display the shooting action corresponding to the target virtual character and the target control information, and switch to play the shooting picture of the third virtual camera.

[0173] In a possible implementation manner, in the instruction of the processor 401, selecting a virtual camera group corresponding to the task type according to the task type includes:

[0174] Determine a plurality of virtual cameras to be screened corresponding to the shooting area;

[0175] According to the task type, a virtual camera having a target shooting attribute is selected from the multiple virtual cameras to be screened to form a virtual camera group corresponding to the task type.

[0176] In a possible implementation manner, in the instruction of the processor 401, selecting a virtual camera group corresponding to the task type according to the task type includes:

[0177] Determine a plurality of virtual camera groups to be screened corresponding to the shooting area;

[0178] According to the task type, a virtual camera group corresponding to the task type is selected from the multiple groups of virtual camera groups to be screened.

[0179] In a possible implementation manner, in the instruction of the processor 401, determining the shooting area includes:

[0180] According to the task type and the size of the scene area of ​​the real scene where each virtual character controls the user, a shooting area matching the task type in the virtual scene is determined; the size of the shooting area matches the size of the scene area of ​​the real scene.

[0181] The embodiment of the present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the live broadcast control method described in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0182] The present disclosure also provides a computer program product that carries a program code. The program code includes instructions that can be used to execute the steps of the live broadcast control method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0183] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0184] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0185] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0186] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0187] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0188] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A live broadcast control method, characterized in that: include: In response to receiving a live broadcast task, determining a task type and a shooting area corresponding to the live broadcast task; According to the task type, a virtual camera group corresponding to the task type is selected; wherein the virtual camera group includes a plurality of virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures; According to the camera movement trajectory corresponding to the task type, each virtual camera in the virtual camera group is directed and controlled.

2. The method according to claim 1, characterized in that The camera movement trajectory includes a preset first camera movement trajectory; The performing broadcast control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type includes: In response to the fact that there are multiple preset first camera movement tracks corresponding to the task type, a target first camera movement track is selected from the multiple first camera movement tracks according to the camera movement modes and camera movement rates respectively corresponding to the multiple first camera movement tracks, and performance status information of each virtual character during the live broadcast, and broadcast control is performed on each virtual camera in the virtual camera group; Among them, the performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates are different.

3. The method according to claim 1, characterized in that The camera movement track includes a preset first camera movement track and a second camera movement track controlled by a first user; different camera movement tracks correspond to different virtual cameras; The performing broadcast control on each virtual camera in the virtual camera group according to the camera movement track corresponding to the task type includes: In the process of performing director control on the virtual camera according to the first camera movement trajectory, in response to receiving the director control operation of the first user, switching to play the shooting picture of the virtual camera corresponding to the second camera movement trajectory.

4. The method according to claim 3, characterized in that The first user includes a director control user or a virtual character control user; The switching and playing of the shooting picture of the virtual camera corresponding to the second camera movement track includes: In response to an abnormality in the current output shooting picture of the first virtual camera corresponding to the first camera movement trajectory, the shooting picture of the second virtual camera is switched to be played according to the second virtual camera switched by the first user.

5. The method according to claim 3, characterized in that: The first user includes a virtual character control user; the virtual character control user is used to output control information through a motion capture device worn by the user, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area; The switching and playing of the shooting picture of the virtual camera corresponding to the second camera movement track includes: In response to a shooting control operation of the virtual character controlling user on a handheld third virtual camera, determining target control information corresponding to the shooting control operation; Control and display the shooting action corresponding to the target virtual character and the target control information, and switch to play the shooting picture of the third virtual camera.

6. The method according to claim 1, characterized in that The step of selecting a virtual camera group corresponding to the task type according to the task type includes: Determine a plurality of virtual cameras to be screened corresponding to the shooting area; According to the task type, a virtual camera having a target shooting attribute is selected from the multiple virtual cameras to be screened to form a virtual camera group corresponding to the task type.

7. The method according to claim 1, characterized in that The step of selecting a virtual camera group corresponding to the task type according to the task type includes: Determine a plurality of virtual camera groups to be screened corresponding to the shooting area; According to the task type, a virtual camera group corresponding to the task type is selected from the multiple groups of virtual camera groups to be screened.

8. The method according to claim 1, characterized in that: Determining the shooting area includes: According to the task type and the size of the scene area of ​​the real scene where each virtual character controls the user, a shooting area matching the task type in the virtual scene is determined; the size of the shooting area matches the size of the scene area of ​​the real scene.

9. A live broadcast control device, characterized in that: include: A determination module, configured to determine, in response to receiving a live broadcast task, a task type and a shooting area corresponding to the live broadcast task; A selection module, configured to select a virtual camera group corresponding to the task type according to the task type; wherein the virtual camera group includes a plurality of virtual cameras selected from virtual cameras corresponding to the shooting area, and different virtual cameras have different shooting postures; The director module is used to perform director control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

10. A computer device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor and the memory communicate via the bus, and when the machine-readable instructions are executed by the processor, the steps of the live broadcast control method as described in any one of claims 1 to 8 are performed.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed by a processor, executes the steps of the live broadcast control method as described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Game live streaming control method and device, computer storage medium and electronic equipment

    CN111277845A

  • Control method and device of virtual camera in virtual studio, implementation method of virtual studio, virtual studio system, computer readable storage medium and electronic equipment

    CN111698390A

  • Intelligent live broadcast method and live broadcast Internet of Things system

    CN113315980A

  • Scene shooting method and device, storage medium and electronic equipment

    CN114222067A

  • Virtual video program loading method

    CN114915855A