A method, system, electronic device and medium for live broadcast director control

Abstract

The embodiment of the present invention discloses a method, system, electronic device and medium for live broadcast director control. Specifically, the following methods are included: a central control machine groups multiple cameras, multiple lighting systems, multiple audio systems and multiple sensors; the central control machine receives sensor data acquired by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and the central control machine adjusts the corresponding camera parameters and lighting parameters; the central control machine receives and processes images and multi-channel videos sent by the camera in each scene and receives multi-channel audio sent by the audio system in each scene, and each scene is rendered into a different small window by the central control machine and displayed through a live broadcast interactive machine; one or more scenes are selected on the live broadcast interactive machine, and then pushed to the server through the Internet. This application solves the problem that the live broadcast system in the prior art has relatively scattered functions, is not intelligent enough, and does not have functions such as automatic lighting configuration and self-adaptation.

Description

Technical Field

[0001] The present invention relates to the field of live broadcast technology, and in particular to a method, system, electronic equipment and medium for live broadcast director control. Background Art

[0002] There are two types of "online live broadcasts". One type is to provide TV signals for viewing online, such as live broadcasts of various sports games and cultural activities. The principle of this type of live broadcast is to collect TV (analog) signals, convert them into digital signals, input them into computers, and upload them to websites in real time for people to watch, which is equivalent to "online TV". The other type is the "online live broadcast" that people are familiar with: setting up independent signal collection equipment (audio + video) on site to import them into the director terminal (director equipment or platform), and then uploading them to the server through the Internet, and publishing them to the website for people to watch. However, the live broadcast system functions of the existing "online live broadcast" are relatively scattered, and not intelligent enough, and there are no functions such as automatic lighting configuration and self-adaptation.

[0003] To sum up, the current live broadcast system has scattered functions, is not intelligent enough, and lacks functions such as automatic lighting configuration and adaptation. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a method, system, electronic device and medium for live broadcast director control, so as to solve the problems that the live broadcast system in the prior art has relatively scattered functions, is not intelligent enough, and does not have functions such as automatic lighting configuration and adaptation.

[0005] To achieve the above object, an embodiment of the present invention provides a method for controlling a live broadcast director, the method comprising the following steps:

[0006] Step 1: The central control machine groups multiple cameras, multiple lighting systems, multiple audio systems, and multiple sensors in a pre-configured manner, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group;

[0007] Step 2: The central control machine receives the sensor data obtained by the sensor according to the position and brightness of the lighting system and the image data transmitted by the camera. The central control machine configures the corresponding control algorithm for each group and adjusts the corresponding camera parameters and lighting parameters.

[0008] Step 3: The central control machine receives and processes the images and multi-channel videos sent by the camera in each scene, and receives the multi-channel audio sent by the audio system in each scene, forming a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed through the live interactive machine;

[0009] Step 4: The central control machine controller or host selects one or more scenes on the live interactive machine, and further integrates the selected scenes through the central control machine to form a video stream, which is then pushed to the server via the Internet.

[0010] Furthermore, in step 2, the central control machine receives sensor data acquired by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and according to the corresponding control algorithm configured by the central control machine for each group, the central control machine adjusts the corresponding camera parameters and lighting parameters;

[0011] Using a control algorithm to process sensor data and / or extract image features from camera image data and output the results;

[0012] The camera system parameters include white balance value, focus value and distortion correction value;

[0013] Light parameters include color temperature and brightness.

[0014] Furthermore, in step 2, the central control machine receives sensor data acquired by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and according to the corresponding control algorithm configured by the central control machine for each group, the central control machine adjusts the corresponding camera parameters and lighting parameters;

[0015] The specific process of the central control machine adjusting the corresponding camera parameters and lighting parameters includes: when the brightness of the lighting system received by the sensor is low, the central control machine adjusts the brightness of the light; when the shadow effect of the object photographed by the camera is not good, the central control machine automatically adjusts the illumination angle of the lighting system and automatically adjusts the illumination brightness of each light in the lighting system; when the camera recognizes that the object or person is overexposed, the central control machine adjusts the brightness and color temperature of the lighting system.

[0016] Furthermore, in step 3, the central control machine receives and processes the images and multi-channel videos sent by the camera in each scene and receives the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine;

[0017] The central control machine performs image processing and multi-layer fusion on images, and multi-channel video processing and fusion on multi-channel videos;

[0018] Perform multi-channel audio playback processing and fusion as well as multi-channel audio recording processing and fusion.

[0019] A system for live broadcast director control, the system comprising:

[0020] The allocation unit is used for the central control machine to group the multiple cameras, the multiple lighting systems, the multiple audio systems and the multiple sensors in a pre-configured manner, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group;

[0021] The adjustment unit is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts the corresponding camera parameters and lighting parameters;

[0022] The processing unit is used to receive and process the images and multi-channel videos sent by the camera in each scene and receive the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine. The processing unit is also used to switch scenes according to the scene data corresponding to each scene.

[0023] The execution unit is used to select one or more scenes on the live interactive machine, and further integrate the selected scenes through the central control machine to form a video stream, and then push the stream to the server through the Internet.

[0024] Further, the adjustment unit is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts corresponding camera parameters and lighting parameters;

[0025] Using a control algorithm to process sensor data and / or extract image features from camera image data and output the results;

[0026] The camera system parameters include white balance value, focus value and distortion correction value;

[0027] Light parameters include color temperature and brightness.

[0028] Further, the adjustment unit is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts corresponding camera parameters and lighting parameters;

[0029] The specific process of the central control machine adjusting the corresponding camera parameters and lighting parameters includes: when the brightness of the lighting system received by the sensor is low, the central control machine adjusts the brightness of the light; when the shadow effect of the object photographed by the camera is not good, the central control machine automatically adjusts the illumination angle of the lighting system and automatically adjusts the illumination brightness of each light in the lighting system; when the camera recognizes that the object or person is overexposed, the central control machine adjusts the brightness and color temperature of the lighting system.

[0030] Furthermore, the processing unit is used to receive and process the images and multi-channel videos sent by the camera in each scene and receive the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine. The processing unit is also used to switch scenes according to the scene data corresponding to each scene.

[0031] The central control machine performs image processing and multi-layer fusion on images, and multi-channel video processing and fusion on multi-channel videos;

[0032] Perform multi-channel audio playback processing and fusion as well as multi-channel audio recording processing and fusion.

[0033] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the steps of the method are implemented when the processor executes the computer program.

[0034] A non-transitory computer-readable storage medium stores a computer program, which implements the steps of the method when executed by a processor.

[0035] The embodiments of the present invention have the following advantages:

[0036] The present invention uses a pre-configured mode, wherein the central control machine groups multiple cameras, multiple lighting systems, multiple audio systems and multiple sensors, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures corresponding control algorithms for each group; the central control machine receives sensor data acquired by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and according to the corresponding control algorithms configured by the central control machine for each group, the central control machine adjusts the corresponding camera parameters and lighting parameters; the central control machine receives and processes the images and multi-channel videos sent by the camera in each scene and receives the multi-channel audio sent by the audio system in each scene, forming a scene audio and video stream, and each scene is rendered into different small windows by the central control machine and displayed by the live interactive machine; the central control machine controls the personnel or the host to select one or more scenes on the live interactive machine, and further fuses the selected scenes through the central control machine to form a video stream, and then pushes the stream to the server through the Internet. The problem that the live broadcast system of the prior art has relatively scattered functions, is not intelligent enough, and does not have functions such as automatic configuration and self-adaptation of lighting is solved. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.

[0038] The structures, proportions, sizes, etc. illustrated in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with the technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantial technical significance. Any structural modification, change in proportion or adjustment of size shall still fall within the scope of the technical contents disclosed in the present invention without affecting the effects and purposes that can be achieved by the present invention.

[0039] Figure 1 A method flow chart of a method for live broadcast director control provided by an embodiment of the present invention; Figure 2 A framework diagram of a system for live broadcast director control provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0040] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0041] Example 1

[0042] Combination Figure 1 This embodiment is described. This embodiment is a method for controlling a live broadcast director. The method includes the following steps:

[0043] Step 1: The central control machine groups multiple cameras, multiple lighting systems, multiple audio systems, and multiple sensors in a pre-configured manner, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group;

[0044] Step 2: The central control machine receives the sensor data obtained by the sensor according to the position and brightness of the lighting system and the image data transmitted by the camera. The central control machine configures the corresponding control algorithm for each group and adjusts the corresponding camera parameters and lighting parameters.

[0045] Step 3: The central control machine receives and processes the images and multi-channel videos sent by the camera in each scene, and receives the multi-channel audio sent by the audio system in each scene, forming a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed through the live interactive machine;

[0046] Step 4: The central control machine controller or host selects one or more scenes on the live interactive machine, and further integrates the selected scenes through the central control machine to form a video stream, which is then pushed to the server via the Internet.

[0047] In this embodiment, the central control machine groups multiple cameras, multiple lighting systems, multiple audio systems and multiple sensors by pre-configuration, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group; the central control machine receives the sensor data obtained by the sensor according to the position and brightness of the lighting system and receives the image data transmitted by the camera, and adjusts the corresponding camera parameters and lighting parameters according to the corresponding control algorithm configured by the central control machine for each group; the central control machine receives and processes the image and multi-channel video sent by the camera in each scene and receives the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream, and each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine; the central control machine controls the personnel or the host to select one or more scenes on the live interactive machine, and further integrates the selected scenes through the central control machine to form a video stream, and then pushes the stream to the server through the Internet. The problem that the live broadcast system of the prior art has relatively scattered functions, is not intelligent enough, and does not have functions such as automatic configuration and self-adaptation of lighting is solved.

[0048] In this embodiment, the live broadcast interactive machine interacts with the central control machine through wifi, usb, HDMI, Ethernet and Audio IN / OUT, thereby enabling the host to control the entire live broadcast system.

[0049] In this embodiment, the live interactive machine is a display screen or a device with an independent system (including a display screen, a touch screen, sound input and output, a camera system, buttons, etc., with interfaces such as WiFi, USB, HDMI, Ethernet and Bluetooth).

[0050] In the preferred embodiment, in step 2 of this embodiment, the central control machine receives sensor data acquired by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and according to the corresponding control algorithm configured by the central control machine for each group, the central control machine adjusts the corresponding camera parameters and lighting parameters;

[0051] Using a control algorithm to process sensor data and / or extract image features from camera image data and output the results;

[0052] The camera system parameters include white balance value, focus value and distortion correction value;

[0053] Light parameters include color temperature and brightness.

[0054] In this embodiment, various control algorithms work in the form of plug-ins, and sensor data and / or camera image data are used as inputs of algorithm plug-ins. The output of an algorithm plug-in can be used as input of other algorithm plug-ins, and layers of plug-ins are connected in series or in parallel.

[0055] In a preferred embodiment, in step 2, the central control machine receives sensor data acquired by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and according to the corresponding control algorithm configured by the central control machine for each group, the central control machine adjusts the corresponding camera parameters and lighting parameters;

[0056] The specific process of the central control machine adjusting the corresponding camera parameters and lighting parameters includes: when the brightness of the lighting system received by the sensor is low, the central control machine adjusts the brightness of the light; when the shadow effect of the object photographed by the camera is not good, the central control machine automatically adjusts the illumination angle of the lighting system and automatically adjusts the illumination brightness of each light in the lighting system; when the camera recognizes that the object or person is overexposed, the central control machine adjusts the brightness and color temperature of the lighting system.

[0057] In a preferred embodiment, in step 3, the central control machine receives and processes the images and multi-channel videos sent by the camera in each scene and receives the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine.

[0058] The central control machine performs image processing and multi-layer fusion on images, and multi-channel video processing and fusion on multi-channel videos;

[0059] Perform multi-channel audio playback processing and fusion as well as multi-channel audio recording processing and fusion.

[0060] In this embodiment, the image processing includes functions such as cutout, and the multi-channel video processing and fusion includes functions such as picture-in-picture.

[0061] Example 2

[0062] Combination Figure 2 This embodiment is described. This embodiment is a system for live broadcast director control, and the system includes:

[0063] The allocation unit 10 is used for the central control machine to group the multiple cameras, the multiple lighting systems, the multiple audio systems and the multiple sensors in a pre-configured manner, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group;

[0064] The adjustment unit 20 is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts corresponding camera parameters and lighting parameters;

[0065] The processing unit 30 is used to receive and process the images and multi-channel videos sent by the camera in each scene and receive the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine. The processing unit is also used to switch scenes according to the scene data corresponding to each scene.

[0066] The execution unit 40 is used to select one or more scenes on the live interactive machine, and further integrate the selected scenes through the central control machine to form a video stream, and then push the stream to the server through the Internet.

[0067] In this embodiment, the central control machine groups multiple cameras, multiple lighting systems, multiple audio systems and multiple sensors by pre-configuration, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures corresponding control algorithms for each group; the central control machine receives sensor data obtained by the sensor according to the position and brightness of the lighting system and receives image data transmitted by the camera, and adjusts corresponding camera parameters and lighting parameters according to the corresponding control algorithms configured by the central control machine for each group; the central control machine receives and processes images and multiple-channel videos sent by the camera in each scene and receives multiple-channel audio sent by the audio system in each scene to form a scene audio and video stream, and each scene is rendered into different small windows by the central control machine and displayed by the live interactive machine; the central control machine controls the personnel or host to select one or more scenes on the live interactive machine, and further integrates the selected scenes through the central control machine to form a video stream, and then pushes the stream to the server through the Internet. The problem that the live broadcast system in the prior art has relatively scattered functions, is not intelligent enough, and does not have functions such as automatic configuration and self-adaptation of lighting is solved.

[0068] In a preferred embodiment, the adjustment unit is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and receive image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts corresponding camera parameters and lighting parameters;

[0069] Using a control algorithm to process sensor data and / or extract image features from camera image data and output the results;

[0070] The camera system parameters include white balance value, focus value and distortion correction value;

[0071] Light parameters include color temperature and brightness.

[0072] In a preferred embodiment, the adjustment unit is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and receive image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts corresponding camera parameters and lighting parameters;

[0073] The specific process of the central control machine adjusting the corresponding camera parameters and lighting parameters includes: when the brightness of the lighting system received by the sensor is low, the central control machine adjusts the brightness of the light; when the shadow effect of the object photographed by the camera is not good, the central control machine automatically adjusts the illumination angle of the lighting system and automatically adjusts the illumination brightness of each light in the lighting system; when the camera recognizes that the object or person is overexposed, the central control machine adjusts the brightness and color temperature of the lighting system.

[0074] In a preferred embodiment, the processing unit is used to receive and process the images and multi-channel videos sent by the camera in each scene and receive the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine. The processing unit is also used to switch scenes according to the scene data corresponding to each scene.

[0075] The central control machine performs image processing and multi-layer fusion on images, and multi-channel video processing and fusion on multi-channel videos;

[0076] Perform multi-channel audio playback processing and fusion as well as multi-channel audio recording processing and fusion.

[0077] Example 3

[0078] An electronic device according to the present embodiment includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the method when executing the computer program.

[0079] Example 4

[0080] A non-transitory computer-readable storage medium of this embodiment stores a computer program thereon, wherein the computer program implements the steps of the method described when executed by a processor.

[0081] Although the present invention has been described in detail above by general description and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.

Claims

1. A method for controlling live broadcast director, characterized in that: The method comprises the following steps: Step 1: The central control machine groups multiple cameras, multiple lighting systems, multiple audio systems, and multiple sensors in a pre-configured manner, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group; Step 2: The central control machine receives the sensor data obtained by the sensor according to the position and brightness of the lighting system and the image data transmitted by the camera. The central control machine configures the corresponding control algorithm for each group and adjusts the corresponding camera parameters and lighting parameters. Step 3: The central control machine receives and processes the images and multi-channel videos sent by the camera in each scene, and receives the multi-channel audio sent by the audio system in each scene, forming a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed through the live interactive machine; Step 4: The central control machine controller or host selects one or more scenes on the live interactive machine, and further integrates the selected scenes through the central control machine to form a video stream, which is then pushed to the server through the Internet; In step 2, a control algorithm is used to process the sensor data and / or extract image features from the camera image data and output the result; The camera system parameters include white balance value, focus value and distortion correction value; Lighting parameters include color temperature and brightness values; The specific process of the central control machine adjusting the corresponding camera parameters and lighting parameters includes: when the brightness of the lighting system received by the sensor is low, the central control machine adjusts the brightness of the light; when the shadow effect of the object photographed by the camera is not good, the central control machine automatically adjusts the illumination angle of the lighting system and the illumination brightness of each light of the lighting system; when the camera recognizes that the object or person is overexposed, the central control machine adjusts the brightness and color temperature of the lighting system; Step 3: The central control machine performs image processing and multi-layer fusion on the image and performs multi-channel video processing and fusion on the multi-channel videos; Performing multi-channel audio playback processing and fusion as well as multi-channel audio recording processing and fusion on multi-channel audio; the image processing includes a cutout function; the multi-channel video processing and fusion includes a picture-in-picture function; The live interactive machine interacts with the central control machine via wifi, usb, HDMI, Ethernet and Audio IN / OUT.

2. A system for live broadcast director control, characterized in that: The system comprises: The allocation unit is used for the central control machine to group the multiple cameras, the multiple lighting systems, the multiple audio systems and the multiple sensors in a pre-configured manner, wherein each group corresponds to a scene, and each group includes at least one camera and one lighting system, and the central control machine configures a corresponding control algorithm for each group; The adjustment unit is used to receive sensor data acquired by the sensor according to the position and brightness of the lighting system and image data transmitted by the camera, and the central control machine configures corresponding control algorithms for each group, and the central control machine adjusts the corresponding camera parameters and lighting parameters; The processing unit is used to receive and process the images and multi-channel videos sent by the camera in each scene and receive the multi-channel audio sent by the audio system in each scene to form a scene audio and video stream. Each scene is rendered into a different small window by the central control machine and displayed by the live interactive machine. The processing unit is also used to switch scenes according to the scene data corresponding to each scene. The execution unit is used to select one or more scenes on the live interactive machine, and further integrate the selected scenes through the central control machine to form a video stream, and then push the stream to the server through the Internet; The adjustment unit is also used to process the sensor data and / or extract image features from the camera image data using a control algorithm and output the result; the camera system parameters include white balance value, focus value and deformity correction value; the lighting parameters include color temperature value and brightness value; The specific process of the central control machine adjusting the corresponding camera parameters and lighting parameters includes: when the brightness of the lighting system received by the sensor is low, the central control machine adjusts the brightness of the light; when the shadow effect of the object photographed by the camera is not good, the central control machine automatically adjusts the illumination angle of the lighting system and the illumination brightness of each light of the lighting system; when the camera recognizes that the object or person is overexposed, the central control machine adjusts the brightness and color temperature of the lighting system; The central control machine performs image processing and multi-layer fusion on images and multi-channel video processing and fusion on multi-channel videos; performs multi-channel audio playback processing and fusion on multi-channel audio and multi-channel audio recording processing and fusion on multi-channel audio; the image processing includes a cutout function; the multi-channel video processing and fusion includes a picture-in-picture function; The live interactive machine interacts with the central control machine via wifi, usb, HDMI, Ethernet and Audio IN / OUT.

3. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to claim 1 are implemented.

4. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to claim 1 are implemented.

Images