A live broadcast control method and device, computer equipment and storage medium

Abstract

The present disclosure provides a live broadcast control method and device, computer equipment and a storage medium, wherein the method comprises: in response to receiving a live broadcast task, determining a task type and a shooting area corresponding to the live broadcast task; according to the task type, selecting a virtual camera group corresponding to the task type; and according to a camera track corresponding to the task type, conducting director control on each virtual camera in the virtual camera group. In this way, according to the task type and the shooting area, the selection and director control of the virtual camera can be determined, so that the virtual camera used in the live broadcast process can meet the live broadcast demand corresponding to the task type and the shooting area. On the other hand, since the virtual camera group includes multiple virtual cameras with different shooting poses, the live broadcast picture under different shooting angles can be controlled in the live broadcast process, thereby enriching the live broadcast viewing experience of the live broadcast audience and ensuring the live broadcast effect when using virtual characters for virtual live broadcast.

Description

Technical Field

[0001] This disclosure relates to the field of live streaming technology, and more specifically, to a live streaming control method, apparatus, computer equipment, and storage medium. Background Technology

[0002] With the rapid development of internet technology, watching live streams has gradually become one of the ways people shop, entertain themselves, and relax. In the context of virtual live streaming, real people can control virtual characters to perform related actions in order to conduct live streaming through virtual characters.

[0003] In related technologies, multiple cameras can be used for virtual live streaming to enrich the visual effects of the live stream. Therefore, how to control multiple virtual cameras during the live stream to ensure the live streaming effect has become an urgent technical problem to be solved in this field. Summary of the Invention

[0004] This disclosure provides at least one live streaming control method, apparatus, computer device, and storage medium.

[0005] In a first aspect, embodiments of this disclosure provide a live streaming control method, including:

[0006] In response to receiving a live streaming task, determine the task type and shooting area corresponding to the live streaming task;

[0007] According to the task type, select a virtual camera group corresponding to the task type; wherein, the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of different virtual cameras are different;

[0008] Based on the camera movement trajectory corresponding to the task type, the director controls each virtual camera in the virtual camera group.

[0009] In one possible implementation, the camera movement trajectory includes a preset first camera movement trajectory;

[0010] The step of performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type includes:

[0011] In response to the fact that there are multiple preset first camera movements corresponding to the task type, and based on the camera movement method and camera movement rate corresponding to the multiple first camera movements respectively, as well as the performance status information of each virtual character during the live broadcast, a target first camera movement is selected from the multiple first camera movements to perform broadcast control on each virtual camera in the virtual camera group.

[0012] The performance states of each virtual character are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0013] In one possible implementation, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras.

[0014] The step of performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type includes:

[0015] During the process of directing the virtual camera according to the first camera movement trajectory, in response to receiving the directing control operation from the first user, the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory is switched.

[0016] In one possible implementation, the first user includes a director control user or a virtual character control user;

[0017] The switching and playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory includes:

[0018] In response to an anomaly in the current output footage of the first virtual camera corresponding to the first camera movement trajectory, the system switches to play the footage from the second virtual camera triggered by the first user.

[0019] In one possible implementation, the first user includes a virtual character control user; the virtual character control user is used to output control information through a worn motion capture device, the control information being used to control the behavior of the corresponding target virtual character in the shooting area;

[0020] The switching and playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory includes:

[0021] In response to the shooting control operation of the virtual character control user on the handheld third virtual camera, target control information corresponding to the shooting control operation is determined;

[0022] The system controls and displays the shooting actions corresponding to the target virtual character and the target control information, and switches to play the shooting footage from the third virtual camera.

[0023] In one possible implementation, selecting a virtual camera group corresponding to the task type includes:

[0024] Identify multiple virtual cameras to be screened that correspond to the shooting area;

[0025] Based on the task type, select virtual cameras with target shooting attributes from the plurality of virtual cameras to be screened, and form a virtual camera group corresponding to the task type.

[0026] In one possible implementation, selecting a virtual camera group corresponding to the task type includes:

[0027] Identify multiple groups of virtual cameras to be screened that correspond to the shooting area;

[0028] Based on the task type, select the virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened.

[0029] In one possible implementation, determining the shooting area includes:

[0030] Based on the task type and the size of the real-world scene area where each virtual character controls the user, a shooting area matching the task type is determined in the virtual scene; the size of the shooting area matches the size of the real-world scene area.

[0031] Secondly, embodiments of this disclosure also provide a live streaming control device, comprising:

[0032] The determination module is used to determine the task type and shooting area corresponding to the received live streaming task in response to receiving the live streaming task.

[0033] The selection module is used to select a virtual camera group corresponding to the task type according to the task type; wherein, the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of the different virtual cameras are different;

[0034] The directing module is used to perform directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

[0035] In one possible implementation, the camera movement trajectory includes a preset first camera movement trajectory;

[0036] The directing module, when performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, is used for:

[0037] In response to the fact that there are multiple preset first camera movements corresponding to the task type, and based on the camera movement method and camera movement rate corresponding to the multiple first camera movements respectively, as well as the performance status information of each virtual character during the live broadcast, a target first camera movement is selected from the multiple first camera movements to perform broadcast control on each virtual camera in the virtual camera group.

[0038] The performance states of each virtual character are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0039] In one possible implementation, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras.

[0040] The directing module, when performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, is used for:

[0041] During the process of directing the virtual camera according to the first camera movement trajectory, in response to receiving the directing control operation from the first user, the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory is switched.

[0042] In one possible implementation, the first user includes a director control user or a virtual character control user;

[0043] The directing module, when switching to play the footage captured by the virtual camera corresponding to the second camera movement trajectory, is used for:

[0044] In response to an anomaly in the current output footage of the first virtual camera corresponding to the first camera movement trajectory, the system switches to play the footage from the second virtual camera triggered by the first user.

[0045] In one possible implementation, the first user includes a virtual character control user; the virtual character control user is used to output control information through a worn motion capture device, the control information being used to control the behavior of the corresponding target virtual character in the shooting area;

[0046] The directing module, when switching to play the footage captured by the virtual camera corresponding to the second camera movement trajectory, is used for:

[0047] In response to the shooting control operation of the virtual character control user on the handheld third virtual camera, target control information corresponding to the shooting control operation is determined;

[0048] The system controls and displays the shooting actions corresponding to the target virtual character and the target control information, and switches to play the shooting footage from the third virtual camera.

[0049] In one possible implementation, the selection module, when selecting a virtual camera group corresponding to the task type based on the task type, is used to:

[0050] Identify multiple virtual cameras to be screened that correspond to the shooting area;

[0051] Based on the task type, select virtual cameras with target shooting attributes from the plurality of virtual cameras to be screened, and form a virtual camera group corresponding to the task type.

[0052] In one possible implementation, the selection module, when selecting a virtual camera group corresponding to the task type based on the task type, is used to:

[0053] Identify multiple groups of virtual cameras to be screened that correspond to the shooting area;

[0054] Based on the task type, select the virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened.

[0055] In one possible implementation, the determining module, when determining the shooting area, is used to:

[0056] Based on the task type and the size of the real-world scene area where each virtual character controls the user, a shooting area matching the task type is determined in the virtual scene; the size of the shooting area matches the size of the real-world scene area.

[0057] Thirdly, embodiments of this disclosure also provide a computer device, including: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the computer device is running, the processor communicates with the memory via the bus, and when the machine-readable instructions are executed by the processor, the steps of the first aspect above, or any possible implementation of the first aspect, are performed.

[0058] Fourthly, embodiments of this disclosure also provide a computer-readable storage medium storing a computer program that, when executed by a processor, performs the steps of the first aspect or any possible implementation of the first aspect.

[0059] The live streaming control method, apparatus, computer equipment, and storage medium provided in this disclosure determine the task type and shooting area corresponding to the received live streaming task. This allows for the selection of a virtual camera group corresponding to the determined task type, and the control of each virtual camera in the virtual camera group based on the camera movement trajectory corresponding to the task type. By selecting and controlling the virtual cameras according to the task type and shooting area, it is possible to ensure that the virtual cameras used during the live stream meet the live streaming requirements corresponding to the task type and shooting area. Furthermore, since the virtual camera group contains multiple virtual cameras with different shooting poses, the live stream can be controlled from different shooting angles, enriching the live streaming viewing experience for viewers and ensuring the effectiveness of virtual live streaming using virtual characters.

[0060] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0061] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. These drawings are incorporated in and constitute a part of this specification. They illustrate embodiments conforming to this disclosure and, together with the specification, serve to explain the technical solutions of this disclosure. It should be understood that the following drawings only show some embodiments of this disclosure and should not be considered as limiting the scope. Those skilled in the art can obtain other related drawings based on these drawings without creative effort.

[0062] Figure 1 A flowchart of a live streaming control method provided by some embodiments of this disclosure is shown;

[0063] Figure 2a The illustration shows a schematic diagram of a live streaming control method provided in some embodiments of the present disclosure, in which a shooting area matching the task type is divided in a virtual scene according to a task area division rule;

[0064] Figure 2b This illustration shows another method of live streaming control provided by some embodiments of the present disclosure, in which a shooting area matching the task type is divided in a virtual scene according to a task area division rule;

[0065] Figure 3 This diagram illustrates the architecture of a live streaming control device provided in some embodiments of the present disclosure;

[0066] Figure 4A schematic diagram of the structure of a computer device provided in some embodiments of this disclosure is shown. Detailed Implementation

[0067] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0068] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0069] In this document, the term "and / or" merely describes a relationship, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0070] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0071] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0072] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, where the prompt message can be presented in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0073] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0074] Research has shown that in virtual live streaming scenarios, real people can control virtual characters to perform related actions, thus enabling live streaming through these virtual characters. To enrich the visual effects of live streams, multiple cameras can be used for virtual broadcasting. Therefore, how to control multiple virtual cameras during the live stream to ensure optimal broadcast quality has become a pressing technical problem in this field.

[0075] Based on the above research, this disclosure provides a live streaming control method, apparatus, computer equipment, and storage medium. By determining the task type and shooting area corresponding to the received live streaming task, a virtual camera group corresponding to the determined task type can be selected, and the virtual cameras in the virtual camera group can be controlled according to the camera movement trajectory corresponding to the task type. In this way, by selecting and controlling the virtual cameras according to the task type and shooting area, it can be ensured that the virtual cameras used during the live stream meet the live streaming requirements corresponding to the task type and shooting area. Furthermore, since the virtual camera group contains multiple virtual cameras with different shooting poses, the live stream can be controlled from different shooting angles during the live stream, thereby enriching the live streaming viewing experience for viewers and ensuring the live streaming effect when using virtual characters for virtual live streaming.

[0076] To facilitate understanding of this embodiment, a live streaming control method disclosed in this disclosure will first be described in detail. The execution entity of the live streaming control method provided in this disclosure is generally a computer device with a certain computing capability. This computer device may include, for example, a terminal device, a server, or other processing devices. The terminal device may be a user equipment (UE), mobile device, user terminal, terminal, handheld device, computing device, vehicle-mounted device, wearable device, etc. In some possible implementations, this live streaming control method can be implemented by a processor calling computer-readable instructions stored in memory.

[0077] See Figure 1The diagram shows a flowchart of a live streaming control method provided in an embodiment of this disclosure. The method includes steps S101 to S103, wherein:

[0078] S101: In response to receiving a live streaming task, determine the task type and shooting area corresponding to the live streaming task.

[0079] S102: Select a virtual camera group corresponding to the task type according to the task type; wherein the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of different virtual cameras are different.

[0080] S103: Perform directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

[0081] The following is a detailed explanation of the steps described above.

[0082] The process of determining the task type and shooting area for the live broadcast mission of S101:

[0083] Here, the task type and shooting area corresponding to the live streaming task can be specified before the live stream starts. The task type and shooting area corresponding to the live streaming task can be obtained by parsing the live streaming task. The task type can include interview tasks, dance tasks, etc., and the shooting area can be interview areas, dance areas, etc.

[0084] In one possible implementation, when determining the shooting area, the shooting area in the virtual scene that matches the task type can be determined based on the task type and the size of the scene area in the real scene where each virtual character controls the user; wherein the size of the shooting area matches the size of the scene area in the real scene.

[0085] Here, the virtual character control user is the user who controls a virtual character in a virtual scene. The user outputs control information through a motion capture device they wear. The control information is used to control the behavior of the corresponding target virtual character in the shooting area, thereby realizing live streaming of the virtual character in the virtual scene. The real scene is the scene in which the virtual character control user is active during the live stream. The real scene can be the motion capture room where the virtual character control user is located, etc.

[0086] Specifically, when determining the shooting area in the virtual scene that matches the task type based on the task type and the size of the scene area in the real-world scene where each virtual character controls the user, the task area division rule that matches the task type can be determined first, and then the shooting area that matches the task type can be divided in the virtual scene according to the task area division rule. The task area division rule can include a shooting area division ratio that represents the area ratio of the shooting area in the scene area of ​​the real-world scene, and a shooting area division method that represents the shooting area divided from the scene area of ​​the real-world scene.

[0087] For example, taking a dance task as an example, the task area division rules matching the task type "dance task" may include a shooting area division ratio of "80%" to represent the area ratio of the shooting area in the scene area of ​​the real scene, and a shooting area division method to divide the shooting area from the scene area of ​​the real scene: "starting from the direction of the virtual camera corresponding to the dance task in the scene area of ​​the real scene, and the shape of the divided shooting area is rectangular."

[0088] Following the previous example, based on the task area division rules, a schematic diagram illustrating the division of the shooting area in the virtual scene that matches the task type can be shown as follows: Figure 2a and Figure 2b As shown, Figure 2a In the diagram, the scene area where the virtual character controls the user's real-world environment consists of dark and white areas. At this time, the virtual camera corresponding to the dance task is located on the left side of the diagram, so the dark area representing the shooting area is also located on the left side of the diagram. The dark area represents the shooting area divided according to the direction of the virtual camera corresponding to the dance task (the dark area in the diagram is a rectangular area in the top view). Figure 2b In the diagram, the scene area where the virtual character controls the user's real-world environment consists of dark and white areas. At this time, the virtual camera corresponding to the dance task is located on the right side of the diagram, so the dark area representing the shooting area is also located on the right side of the diagram. The dark area represents the shooting area divided according to the direction of the virtual camera corresponding to the dance task (the dark area in the diagram is a rectangular area in the top view).

[0089] In this way, when determining the shooting area corresponding to the live streaming task, the area specified before the live stream starts can be used as the shooting area; or, a task area division rule matching the task type can be determined first, and then the shooting area can be divided from the scene area corresponding to the real scene in real time according to the shooting pose of the virtual camera corresponding to the live streaming task in the real scene, and the task area division rule. The size of the shooting area matches the size of the scene area of ​​the real scene, so that the shooting area divided in real time can better match the actual shooting situation in the real scene at the current moment, thereby enabling the virtual character to control the user to more conveniently conduct live streaming interaction.

[0090] The selection process for the virtual camera group for S102:

[0091] Here, the virtual camera is a camera used to film virtual characters for live streaming. The virtual camera can exist in a virtual scene or in a real scene. Different virtual cameras have different shooting attributes, which can include the shooting pose, shooting type, etc. The shooting type can include panoramic shooting from a fixed position, jib camera shooting that can move in multiple directions, track camera shooting that can move along a fixed track, close-up shooting from a fixed position, etc. The shooting functions and effects of virtual cameras with different shooting types are different. The control buttons corresponding to each virtual camera in the broadcasting equipment can be different. For example, virtual camera 1 corresponds to control button 1, virtual camera 2 corresponds to control button 2, etc.

[0092] When selecting a virtual camera group corresponding to the task type, at least one of the following methods can be used:

[0093] Method 1: Select virtual cameras according to the task type to form a virtual camera group.

[0094] In one possible implementation, when selecting virtual cameras and forming a virtual camera group according to the task type, the following steps A1 to A2 can be followed:

[0095] A1: Identify multiple virtual cameras to be screened that correspond to the shooting area.

[0096] Here, when determining multiple virtual cameras to be screened corresponding to the shooting area, multiple virtual cameras to be screened that cover the shooting area can be determined from the virtual camera library corresponding to the real scene area.

[0097] A2: Based on the task type, select virtual cameras with target shooting attributes from the plurality of virtual cameras to be screened, and form a virtual camera group corresponding to the task type.

[0098] Here, the target shooting attribute can be a shooting attribute corresponding to the task type. Taking the task type as a dance task as an example, the target shooting attribute corresponding to the dance task can be a panoramic camera position, a jib camera position that can move in multiple directions, a track camera position that can move along a fixed track, a close-up camera position with a fixed position, and other shooting types. By selecting a virtual camera with a target shooting attribute corresponding to the dance task, a virtual camera group suitable for shooting the dance task can be selected.

[0099] Method 2: Select a virtual camera group from the multiple groups of virtual camera groups to be screened, based on the task type.

[0100] In one possible implementation, when selecting a virtual camera group from the multiple groups of virtual camera groups to be screened according to the task type, the following steps B1 to B2 can be used:

[0101] B1: Identify multiple groups of virtual cameras to be screened that correspond to the shooting area.

[0102] Here, multiple virtual camera groups can be preset for different shooting areas to meet different shooting needs in the corresponding shooting areas.

[0103] Specifically, when determining multiple sets of virtual camera groups to be screened corresponding to the shooting area, multiple sets of virtual camera groups to be screened corresponding to the shooting area can be determined according to the preset mapping relationship between the shooting area and the virtual camera groups to be screened.

[0104] B2: Based on the task type, select the virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened.

[0105] Here, different virtual camera groups to be screened can correspond to different task types. For example, the task type to be screened for virtual camera group 1 can be slow-paced dance shooting, while the task type to be screened for virtual camera group 2 can be fast-paced dance shooting.

[0106] Specifically, when selecting a virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened, the virtual camera group whose task type matches the task type can be determined based on the task type and the task types corresponding to the multiple groups of virtual camera groups to be screened.

[0107] In this way, by setting up multiple sets of virtual camera groups to be screened in advance according to the task requirements of different task types in the shooting area, after determining the shooting area and task type, the virtual camera group corresponding to the task type can be selected from the multiple sets of virtual camera groups to be screened, thereby quickly completing the selection of virtual cameras and making live streaming more efficient.

[0108] For S103,

[0109] Here, the camera movement trajectory may include a preset first camera movement trajectory and / or a second camera movement trajectory controlled by a first user; different camera movement trajectories may correspond to different virtual cameras. For example, the first camera movement trajectory may use a virtual camera with shooting attributes of moving along a fixed track, while the second camera movement trajectory may use a virtual camera with shooting attributes of being able to move in multiple directions using a jib camera.

[0110] The preset first camera movement trajectory is a camera movement trajectory corresponding to the task type. For example, there can be a preset first camera movement trajectory for a dance task, so that the dance task can be filmed through the first camera movement trajectory and a virtual camera. The first user can include a director control user or a virtual character control user. The second camera movement trajectory controlled by the first user can achieve more flexible live shooting, thereby obtaining richer shooting effects.

[0111] In one possible implementation, when performing broadcast control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, in response to the fact that there are multiple preset first camera movements corresponding to the task type, a target first camera movement trajectory can be selected from the multiple first camera movements trajectory based on the camera movement method and camera movement rate corresponding to the multiple first camera movements trajectory respectively, as well as the performance status information of each virtual character during the live broadcast, to perform broadcast control on each virtual camera in the virtual camera group.

[0112] The performance states of the virtual characters are different, and the corresponding camera movement methods and / or camera movement rates may be different. The performance states of the virtual characters may include fast-paced dance states, slow-paced dance states, interview states, etc.

[0113] In this way, by setting different camera movement methods and / or different camera movement rates for different performance states, the first camera movement trajectory that is more in line with the performance state of the virtual character can be selected during the live broadcast director control stage, thereby improving the live broadcast effect.

[0114] In another possible implementation, when performing broadcast control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, the shooting footage of the virtual camera corresponding to the second camera movement trajectory can be switched and played in response to receiving the broadcast control operation of the first user during the process of performing broadcast control on the virtual camera according to the first camera movement trajectory.

[0115] Here, the director control operation is used to switch the camera movement trajectory. By executing the director control operation, the camera movement trajectory can be changed from the current camera movement trajectory to the second camera movement trajectory.

[0116] In this way, by receiving the director control operation during the process of directing the virtual camera according to the first camera movement trajectory, the currently used preset first camera movement trajectory can be switched to the second camera movement trajectory controlled by the first user, thereby flexibly switching the camera movement trajectory during the live broadcast to meet different live broadcast needs.

[0117] In one possible implementation, when switching the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory, in response to an anomaly in the current output footage captured by the first virtual camera corresponding to the first camera movement trajectory, the playback of the footage captured by the second virtual camera can be switched according to the second virtual camera switched by the first user.

[0118] Here, the abnormality of the current output shooting image may be due to a malfunction of the virtual camera that generates the current output shooting image. For example, the virtual camera may not generate the corresponding shooting image according to the preset first camera movement trajectory. Alternatively, the abnormality of the current output shooting image may also be due to the virtual camera that generates the current output shooting image capturing an image that does not meet the image content requirements.

[0119] In this way, if the virtual camera malfunctions or the captured content does not meet the requirements, the second virtual camera can be switched in a timely manner based on the first user's trigger, and the captured content of the second virtual camera can be played. This allows for timely adjustment of the live broadcast content and ensures the normal operation of the live broadcast.

[0120] In another possible implementation, the following steps C1-C2 can be used to switch the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory:

[0121] C1: In response to the shooting control operation of the virtual character control user on the handheld third virtual camera, determine the target control information corresponding to the shooting control operation.

[0122] C2: Controls and displays the shooting actions corresponding to the target virtual character and the target control information, and switches to play the shooting screen of the third virtual camera.

[0123] In this way, the target virtual character corresponding to the shooting control operation can be displayed up close in the shooting screen of the third virtual camera, so as to highlight the target virtual character and enable users to interact with the target virtual character more intuitively during live broadcast, thereby improving the user's live broadcast interaction experience.

[0124] The live streaming control method provided in this disclosure determines the task type and shooting area corresponding to the received live streaming task. It then selects a virtual camera group corresponding to the determined task type and performs directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type. By selecting and controlling the virtual cameras based on the task type and shooting area, it ensures that the virtual cameras used during the live stream meet the live streaming requirements corresponding to the task type and shooting area. Furthermore, since the virtual camera group contains multiple virtual cameras with different shooting poses, it allows for broadcast control of live stream footage from different shooting angles, thereby enriching the live streaming viewing experience for viewers and ensuring the effectiveness of virtual live streaming using virtual characters.

[0125] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0126] Based on the same inventive concept, this disclosure also provides a live streaming control device corresponding to the live streaming control method. Since the principle of the device in this disclosure for solving the problem is similar to the above-mentioned live streaming control method in this disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0127] Reference Figure 3 The diagram shown is an architectural schematic of a live broadcast control device provided in an embodiment of this disclosure. The device includes: a determining module 301, a selecting module 302, and a directing module 303; wherein,

[0128] The determination module 301 is used to determine the task type and shooting area corresponding to the live streaming task in response to receiving the live streaming task.

[0129] Selection module 302 is used to select a virtual camera group corresponding to the task type according to the task type; wherein, the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of different virtual cameras are different;

[0130] The directing module 303 is used to perform directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type.

[0131] In one possible implementation, the camera movement trajectory includes a preset first camera movement trajectory;

[0132] The directing module 303, when performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, is used for:

[0133] In response to the fact that there are multiple preset first camera movements corresponding to the task type, and based on the camera movement method and camera movement rate corresponding to the multiple first camera movements respectively, as well as the performance status information of each virtual character during the live broadcast, a target first camera movement is selected from the multiple first camera movements to perform broadcast control on each virtual camera in the virtual camera group.

[0134] The performance states of each virtual character are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0135] In one possible implementation, the camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras.

[0136] The directing module 303, when performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type, is used for:

[0137] During the process of directing the virtual camera according to the first camera movement trajectory, in response to receiving the directing control operation from the first user, the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory is switched.

[0138] In one possible implementation, the first user includes a director control user or a virtual character control user;

[0139] The directing module 303, when switching to play the footage captured by the virtual camera corresponding to the second camera movement trajectory, is used for:

[0140] In response to an anomaly in the current output footage of the first virtual camera corresponding to the first camera movement trajectory, the system switches to play the footage from the second virtual camera triggered by the first user.

[0141] In one possible implementation, the first user includes a virtual character control user; the virtual character control user is used to output control information through a worn motion capture device, the control information being used to control the behavior of the corresponding target virtual character in the shooting area;

[0142] The directing module 303, when switching to play the footage captured by the virtual camera corresponding to the second camera movement trajectory, is used for:

[0143] In response to the shooting control operation of the virtual character control user on the handheld third virtual camera, target control information corresponding to the shooting control operation is determined;

[0144] The system controls and displays the shooting actions corresponding to the target virtual character and the target control information, and switches to play the shooting footage from the third virtual camera.

[0145] In one possible implementation, the selection module 302, when selecting a virtual camera group corresponding to the task type based on the task type, is used to:

[0146] Identify multiple virtual cameras to be screened that correspond to the shooting area;

[0147] Based on the task type, select virtual cameras with target shooting attributes from the plurality of virtual cameras to be screened, and form a virtual camera group corresponding to the task type.

[0148] In one possible implementation, the selection module 302, when selecting a virtual camera group corresponding to the task type based on the task type, is used to:

[0149] Identify multiple groups of virtual cameras to be screened that correspond to the shooting area;

[0150] Based on the task type, select the virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened.

[0151] In one possible implementation, the determining module 301, when determining the shooting area, is used to:

[0152] Based on the task type and the size of the real-world scene area where each virtual character controls the user, a shooting area matching the task type is determined in the virtual scene; the size of the shooting area matches the size of the real-world scene area.

[0153] The live streaming control device provided in this embodiment determines the task type and shooting area corresponding to the received live streaming task. It then selects a virtual camera group corresponding to the determined task type and performs directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type. By selecting and controlling the virtual cameras based on the task type and shooting area, it ensures that the virtual cameras used during the live stream meet the live streaming requirements corresponding to the task type and shooting area. Furthermore, since the virtual camera group contains multiple virtual cameras with different shooting poses, it allows for broadcast control of live stream footage from different shooting angles during the live stream, thereby enriching the live streaming viewing experience for viewers and ensuring the effectiveness of virtual live streaming using virtual characters.

[0154] The processing flow of each module in the device and the interaction flow between each module can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.

[0155] Based on the same technical concept, this disclosure also provides a computer device. (See also...) Figure 4 The diagram shows the structure of a computer device 400 provided in this embodiment, including a processor 401, a memory 402, and a bus 403. The memory 402 stores execution instructions and includes main memory 4021 and external memory 4022. The main memory 4021, also called internal memory, is used to temporarily store computational data in the processor 401 and data exchanged with external memory 4022 such as a hard disk. The processor 401 exchanges data with the external memory 4022 through the main memory 4021. When the computer device 400 is running, the processor 401 and the memory 402 communicate through the bus 403, causing the processor 401 to execute the following instructions:

[0156] In response to receiving a live streaming task, determine the task type and shooting area corresponding to the live streaming task;

[0157] According to the task type, select a virtual camera group corresponding to the task type; wherein, the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of different virtual cameras are different;

[0158] Based on the camera movement trajectory corresponding to the task type, the director controls each virtual camera in the virtual camera group.

[0159] In one possible implementation, the instructions of the processor 401 include a preset first camera movement trajectory.

[0160] The step of performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type includes:

[0161] In response to the fact that there are multiple preset first camera movements corresponding to the task type, and based on the camera movement method and camera movement rate corresponding to the multiple first camera movements respectively, as well as the performance status information of each virtual character during the live broadcast, a target first camera movement is selected from the multiple first camera movements to perform broadcast control on each virtual camera in the virtual camera group.

[0162] The performance states of each virtual character are different, and the corresponding camera movement methods and / or camera movement rates are different.

[0163] In one possible implementation, the instructions of the processor 401 include a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movements correspond to different virtual cameras.

[0164] The step of performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type includes:

[0165] During the process of directing the virtual camera according to the first camera movement trajectory, in response to receiving the directing control operation from the first user, the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory is switched.

[0166] In one possible implementation, the instructions of the processor 401 include a director control user or a virtual character control user.

[0167] The switching and playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory includes:

[0168] In response to an anomaly in the current output footage of the first virtual camera corresponding to the first camera movement trajectory, the system switches to play the footage from the second virtual camera triggered by the first user.

[0169] In one possible implementation, in the instructions of the processor 401, the first user includes a virtual character control user; the virtual character control user is used to output control information through a worn motion capture device, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area;

[0170] The switching and playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory includes:

[0171] In response to the shooting control operation of the virtual character control user on the handheld third virtual camera, target control information corresponding to the shooting control operation is determined;

[0172] The system controls and displays the shooting actions corresponding to the target virtual character and the target control information, and switches to play the shooting footage from the third virtual camera.

[0173] In one possible implementation, the instruction of the processor 401, the step of selecting a virtual camera group corresponding to the task type according to the task type, includes:

[0174] Identify multiple virtual cameras to be screened that correspond to the shooting area;

[0175] Based on the task type, select virtual cameras with target shooting attributes from the plurality of virtual cameras to be screened, and form a virtual camera group corresponding to the task type.

[0176] In one possible implementation, the instruction of the processor 401, the step of selecting a virtual camera group corresponding to the task type according to the task type, includes:

[0177] Identify multiple groups of virtual cameras to be screened that correspond to the shooting area;

[0178] Based on the task type, select the virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened.

[0179] In one possible implementation, the instructions of the processor 401, determining the shooting area, includes:

[0180] Based on the task type and the size of the real-world scene area where each virtual character controls the user, a shooting area matching the task type is determined in the virtual scene; the size of the shooting area matches the size of the real-world scene area.

[0181] This disclosure also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the live broadcast control method described in the above-described method embodiments. The storage medium may be a volatile or non-volatile computer-readable storage medium.

[0182] This disclosure also provides a computer program product carrying program code. The program code includes instructions that can be used to execute the steps of the live broadcast control method described in the above method embodiments. For details, please refer to the above method embodiments, which will not be repeated here.

[0183] The aforementioned computer program product can be implemented through hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied in a computer storage medium; in another optional embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0184] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division; in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces; the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.

[0185] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0186] In addition, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0187] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0188] Finally, it should be noted that the above-described embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. A live streaming control method, characterized in that, include: In response to receiving a live streaming task, determine the task type and shooting area corresponding to the live streaming task; According to the task type, select a virtual camera group corresponding to the task type; wherein, the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of different virtual cameras are different; Based on the camera movement trajectory corresponding to the task type, directing control is performed on each virtual camera in the virtual camera group. The designated shooting areas include: Based on the task type and the size of the real-world scene area where each virtual character controls the user, a shooting area matching the task type is determined within the virtual scene; the size of the shooting area matches the size of the real-world scene area. The real-world scenario refers to the situation where the virtual character controls the user's activities during the live stream.

2. The method according to claim 1, characterized in that, The camera movement trajectory includes a preset first camera movement trajectory; The step of performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type includes: In response to the fact that there are multiple preset first camera movements corresponding to the task type, and based on the camera movement method and camera movement rate corresponding to the multiple first camera movements respectively, as well as the performance status information of each virtual character during the live broadcast, a target first camera movement is selected from the multiple first camera movements to perform broadcast control on each virtual camera in the virtual camera group. The performance states of each virtual character are different, and the corresponding camera movement methods and / or camera movement rates are different.

3. The method according to claim 1, characterized in that, The camera movement trajectory includes a preset first camera movement trajectory and a second camera movement trajectory controlled by a first user; different camera movement trajectories correspond to different virtual cameras. The step of performing directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type includes: During the process of directing the virtual camera according to the first camera movement trajectory, in response to receiving the directing control operation from the first user, the playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory is switched.

4. The method according to claim 3, characterized in that, The first user includes a director control user or a virtual character control user; The switching and playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory includes: In response to an anomaly in the current output footage of the first virtual camera corresponding to the first camera movement trajectory, the system switches to play the footage from the second virtual camera triggered by the first user.

5. The method according to claim 3, characterized in that, The first user includes a virtual character control user; the virtual character control user is used to output control information through a motion capture device he wears, and the control information is used to control the behavior of the corresponding target virtual character in the shooting area; The switching and playback of the footage captured by the virtual camera corresponding to the second camera movement trajectory includes: In response to the shooting control operation of the virtual character control user on the handheld third virtual camera, target control information corresponding to the shooting control operation is determined; The system controls and displays the shooting actions corresponding to the target virtual character and the target control information, and switches to play the shooting footage from the third virtual camera.

6. The method according to claim 1, characterized in that, The step of selecting a virtual camera group corresponding to the task type includes: Identify multiple virtual cameras to be screened that correspond to the shooting area; Based on the task type, select virtual cameras with target shooting attributes from the plurality of virtual cameras to be screened, and form a virtual camera group corresponding to the task type.

7. The method according to claim 1, characterized in that, The step of selecting a virtual camera group corresponding to the task type includes: Identify multiple groups of virtual cameras to be screened that correspond to the shooting area; Based on the task type, select the virtual camera group corresponding to the task type from the multiple groups of virtual camera groups to be screened.

8. A live streaming control device, characterized in that, include: The determination module is used to determine the task type and shooting area corresponding to the received live streaming task in response to receiving the live streaming task. The selection module is used to select a virtual camera group corresponding to the task type according to the task type; wherein, the virtual camera group includes multiple virtual cameras selected from each virtual camera corresponding to the shooting area, and the shooting poses of the different virtual cameras are different; The directing module is used to perform directing control on each virtual camera in the virtual camera group according to the camera movement trajectory corresponding to the task type. The designated shooting areas include: Based on the task type and the size of the real-world scene area where each virtual character controls the user, a shooting area matching the task type is determined within the virtual scene; the size of the shooting area matches the size of the real-world scene area. The real-world scenario refers to the situation where the virtual character controls the user's activities during the live stream.

9. A computer device, characterized in that, include: The computer device includes a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the computer device is running, the processor communicates with the memory via the bus. When the machine-readable instructions are executed by the processor, they perform the steps of the live broadcast control method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the steps of the live broadcast control method as described in any one of claims 1 to 7.

Images