Picture acquisition method, recording and broadcasting equipment and storage medium

Abstract

The invention provides a picture acquisition method, recording and broadcasting equipment and a storage medium, the method is applied to the recording and broadcasting equipment in a recording and broadcasting system, the recording and broadcasting system further comprises a plurality of external camera units, and the recording and broadcasting equipment is in bridge connection with each external camera unit in the plurality of external camera units in a bridge connection mode; the method comprises the following steps: acquiring a first shooting picture corresponding to each external camera shooting unit based on a serial data processing mode, wherein the first shooting picture corresponding to each external camera shooting unit is obtained by shooting a target scene by each external camera shooting unit; and calling the first shooting picture corresponding to each external shooting unit, and executing a preset multi-picture processing task to obtain a target picture of the target scene. Based on the scheme of the invention, the multi-picture processing effect of the recording and broadcasting equipment can be improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular, to a method for obtaining a picture, a recording and playing device, and a storage medium. Background Art

[0002] A recording and playing device is a device that supports audio and video collection and playing functions and can be used in various scenarios. In the related art, it is difficult for a recording and playing device to collect multiple shooting pictures in some scenarios, and external devices need to be used to collect the shooting pictures. After the external device collects the corresponding shooting pictures, a series of processes are required to transmit the corresponding shooting pictures to the recording and playing device, resulting in a relatively high latency for some of the shooting pictures obtained by the recording and playing device, which is not conducive to the multi-picture processing of the recording and playing device. Summary of the Invention

[0003] This application provides a method for obtaining a picture, a recording and playing device, and a storage medium. This method can reduce the latency of the recording and playing device for obtaining shooting pictures and improve the multi-picture processing effect of the recording and playing device.

[0004] In a first aspect, a method for obtaining a picture is provided, which is applied to a recording and playing device in a recording and playing system. The recording and playing system further includes a plurality of external camera units, and the recording and playing device is bridged to each of the plurality of external camera units respectively in a bridging manner;

[0005] The method includes:

[0006] Obtaining first shooting pictures corresponding to the external camera units based on a serial data processing method, where the first shooting pictures corresponding to the external camera units are obtained by the external camera units shooting a target scene;

[0007] Invoking the first shooting pictures corresponding to the external camera units and executing a preset multi-picture processing task to obtain a target picture of the target scene.

[0008] In a second aspect, a method for obtaining a picture is provided, which is applied to a recording and playing device in a recording and playing system. The recording and playing system further includes a plurality of external camera units, and the recording and playing device includes a main control unit and a bridging unit. The main control unit is bridged to each of the plurality of external camera units respectively through the bridging unit;

[0009] The method includes:

[0010] The bridging unit obtains first shooting pictures corresponding to the external camera units based on a serial data processing method, where the first shooting pictures corresponding to the external camera units are obtained by the external camera units shooting a target scene;

[0011] The bridging unit transmits the first captured images corresponding to each external camera unit to the main control unit, and the first captured images corresponding to each external camera unit are used to provide the main control unit to execute a preset multi-image processing task to obtain the target image of the target scene.

[0012] In a third aspect, a recording and broadcasting device is provided. The recording and broadcasting device is arranged in a recording and broadcasting system, and the recording and broadcasting system further includes a plurality of external camera units. The recording and broadcasting device includes a main control unit and a bridging unit. The main control unit is bridged to each external camera unit among the plurality of external camera units through the bridging unit;

[0013] The bridging unit is configured to obtain the first captured images corresponding to each external camera unit based on a serial data processing method. The first captured images corresponding to each external camera unit are obtained by each external camera unit capturing the target scene;

[0014] The bridging unit is further configured to transmit the first captured images corresponding to each external camera unit to the main control unit, and the first captured images corresponding to each external camera unit are used to provide the main control unit to execute a preset multi-image processing task to obtain the target image of the target scene.

[0015] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is executed, the above-mentioned image acquisition method of any one of the above is implemented.

[0016] The beneficial effects brought by the technical solutions provided in some embodiments of the present application at least include: The recording and broadcasting device obtains the first captured images corresponding to each external camera unit based on a serial data processing method, and then calls the first captured images corresponding to each external camera unit to execute a preset multi-image processing task to obtain the target image of the target scene. Among them, the recording and broadcasting device obtains the captured images of the external camera units based on the serial data processing method, and the serial data processing is implemented at the physical layer, which directly completes the encapsulation and transmission of the captured images in the form of a continuous bit stream without going through the complex encapsulation and decapsulation processing of the network layer and above the network layer, thereby simplifying the data transmission process, reducing the delay of the recording and broadcasting device for obtaining the captured images, and effectively improving the multi-image processing effect of the recording and broadcasting device. Description of the Drawings

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0018] Figure 1 It is a schematic diagram of a recording and broadcasting scene provided by an embodiment of the present application;

[0019] Figure 2 is a schematic flowchart of a method for obtaining a picture provided by an embodiment of the present application;

[0020] Figure 3 is an example schematic diagram of multi-picture fusion provided by an embodiment of the present application;

[0021] Figure 4 is an example schematic diagram of multi-picture switching provided by an embodiment of the present application;

[0022] Figure 5 is a schematic structural diagram of a recording and playing system provided by an embodiment of the present application;

[0023] Figure 6a is an example schematic diagram of a deserialization bridging unit built into a main control unit provided by an embodiment of the present application;

[0024] Figure 6b is an example schematic diagram of a deserialization bridging unit external to a main control unit provided by an embodiment of the present application;

[0025] Figure 6c is an example schematic diagram of a deserialization bridging unit built into a main control unit provided by an embodiment of the present application;

[0026] Figure 6d is an example schematic diagram of a deserialization bridging unit external to a main control unit provided by an embodiment of the present application;

[0027] Figure 7a is an example schematic diagram of an external bridging chip for an image sensor provided by an embodiment of the present application;

[0028] Figure 7b is a schematic diagram of an image sensor integrated with a bridging function provided by an embodiment of the present application;

[0029] Figure 8 is an example schematic diagram of a recording and playing device integrated with multiple interface functions provided by an embodiment of the present application;

[0030] Figure 9 is a layout schematic diagram of a recording and playing device in a classroom scenario provided by an embodiment of the present application;

[0031] Figure 10 is a layout schematic diagram of a recording and playing device and a binocular imaging device in a classroom scenario provided by an embodiment of the present application;

[0032] Figure 11 is a schematic flowchart of a method for obtaining a picture provided by an embodiment of the present application. Detailed implementation manners

[0033] To make the features and advantages of this application more obvious and understandable, the following will clearly and completely describe the technical solutions in the embodiments of this application in combination with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of this application.

[0034] When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. On the contrary, they are merely examples of devices and methods consistent with some aspects of this application as detailed in the appended claims.

[0035] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features.

[0036] The following will be described in detail respectively. It should be noted that the description order of the following embodiments does not limit the preferred order of the embodiments.

[0037] A recording and playback device is a device that supports audio and video collection and playback functions and is widely used in various scenarios such as classrooms, meeting rooms, and live broadcast sites. In the related art, a recording and playback device can integrate a certain number of image sensors for collecting shooting images in the scene. However, the image sensor of the recording and playback device is usually connected to the main control unit of the recording and playback device in a direct connection manner. Although this direct connection method can meet the shooting requirements to a certain extent, since the physical position of the image sensor is limited by the position of the main body of the recording and playback device, its extension distance is limited and it is difficult to cover the omnidirectional shooting requirements in some complex scenarios. It should be noted that the direct connection method has an advantage in data transmission speed, but its transmission distance is usually short and cannot meet the long-distance shooting requirements. Therefore, in order to expand the shooting range of the recording and playback device, the related art adopts a method of cooperating the recording and playback device with an external device.

[0038] Please refer to Figure 1 for a schematic diagram of a recording and playback scenario provided by an embodiment of this application. As Figure 1Taking the classroom scenario shown as an example, assume that the main body of the recording and broadcasting device is set above the blackboard. Although the image sensor of the recording and broadcasting device can be set outside the main body of the recording and broadcasting device through an extended cable, its extension distance is still limited and cannot cover the side of the classroom scenario far from the blackboard. Therefore, it is difficult for the recording and broadcasting device to capture the shooting images of the blackboard or the teacher. To solve this problem, the related technology adopts a method of cooperation between the recording and broadcasting device and an external device. Specifically, the recording and broadcasting device is responsible for capturing some shooting images in the scenario, while the external device is responsible for capturing other shooting images in the scenario that cannot be covered by the recording and broadcasting device. The shooting images captured by the external device will be sent to the recording and broadcasting device through a specific transmission link to meet the multi-image processing requirements of the recording and broadcasting device.

[0039] However, this method of using an external device to assist in capturing shooting images has the defect of high latency. Specifically, the Open Systems Interconnection (OSI) architecture layer divides communication into seven layers, which are, from bottom to top, the physical layer, the data link layer, the network layer, the transport layer, the session layer, the presentation layer, and the application layer. Each layer is responsible for different functions, and data needs to be encapsulated and decapsulated layer by layer during the transmission process, which inevitably introduces additional processing latency. The higher the layer, the more complex the encapsulation and decapsulation processes are, and the more protocol processing and data verification are involved, so the latency is also higher. The external device includes its own main control unit and image sensor. After the image sensor in the external device completes the capture of the shooting image, it will transmit the captured shooting image to the main control unit in the external device. During this process, the main control unit in the external device will perform encapsulation processing above the network layer on the shooting image, and then transmit the encapsulated data to the main control unit of the recording and broadcasting device. Correspondingly, the main control unit of the recording and broadcasting device needs to perform decapsulation on the received encapsulated data to obtain the shooting image. In short, the external device and the recording and broadcasting device need to perform encapsulation and decapsulation processing above the network layer to achieve the transmission of the shooting image, resulting in a relatively high latency.

[0040] For the above reasons, although the method of cooperation between the recording and broadcasting device and the external device in the related technology can extend the shooting range of the recording and broadcasting device to a certain extent, it has the defect of high latency, which affects the multi-image processing efficiency and quality of the recording and broadcasting device.

[0041] To overcome the above problems, the solution provided in this application mainly includes: introducing a serial data processing function into the recording and broadcasting device, and the recording and broadcasting device obtains the first shooting images corresponding to each external camera unit based on the serial data processing method. The first shooting images corresponding to each external camera unit are used to provide the recording and broadcasting device to execute a preset multi-image processing task to obtain the target image of the target scenario.

[0042] On the one hand, the recording and broadcasting device obtains the captured images of the external camera unit based on the serial data processing method. The serial data processing is implemented at the physical layer, which directly completes the encapsulation and transmission of the captured images in the form of a continuous bit stream without going through the complex encapsulation and decapsulation processes of the network layer and above, reducing the latency of the recording and broadcasting device in obtaining the captured images.

[0043] On the other hand, compared with the short-distance transmission limitation of the direct connection method, the recording and broadcasting device combined with the serial data processing method can achieve long-distance data transmission. Specifically, the serial data processing method can support a longer transmission distance through data conversion at the physical layer. This long-distance data transmission ability enables the external camera unit to be flexibly deployed in long-distance scenarios that cannot be covered by the recording and broadcasting device, thereby further expanding the shooting range of the recording and broadcasting device. For example, in a classroom scenario, the external camera unit can be deployed at the back of the classroom far from the blackboard, and the recording and broadcasting device can obtain the captured images of the external camera unit to ensure that the recording and broadcasting device can capture the panoramic image of the classroom.

[0044] Therefore, the solution of this application not only reduces the transmission latency of the captured images, but also significantly improves the scene coverage ability of the recording and broadcasting device through the long-distance data transmission ability, effectively improving the multi-image processing effect of the recording and broadcasting device.

[0045] Based on Figure 1 the scene schematic shown below, the method for obtaining images provided in the embodiments of this application will be introduced in detail in combination with Figure 2 - Figure 4 to the recording and broadcasting device in the recording and broadcasting system. The recording and broadcasting system further includes a plurality of external camera units, and the recording and broadcasting device is bridged to each of the external camera units in the plurality of external camera units through a bridging method; the method of this embodiment may include the following steps S1101-S1102.

[0046] Please refer to Figure 2 which is a schematic flowchart of a method for obtaining images provided in an embodiment of this application. As Figure 2 shown, the method of this embodiment of the application is applied to a recording and broadcasting device in a recording and broadcasting system. The recording and broadcasting system further includes a plurality of external camera units, and the recording and broadcasting device is bridged to each of the external camera units in the plurality of external camera units through a bridging method; the method of this embodiment may include the following steps S1101-S1102.

[0047] S1101, obtain the first captured images corresponding to each external camera unit based on the serial data processing method, and the first captured images corresponding to each external camera unit are obtained by each external camera unit shooting a target scene.

[0048] Specifically, in some possible implementation manners, if the external camera unit supports the concatenation function, then the recording and playing device may only support the de-concatenation function. Specifically, after the external camera unit captures a target scene to obtain a corresponding first captured image, it can directly perform concatenation processing on the corresponding first captured image to obtain corresponding first captured image concatenated data, and transmit the corresponding first captured image concatenated data to the recording and playing device. The recording and playing device only needs to perform de-concatenation processing on the first captured image concatenated data corresponding to the external camera unit to obtain the first captured image corresponding to the external camera unit.

[0049] In some possible implementation manners, if the external camera unit does not support the concatenation function, then the recording and playing device may support both the concatenation function and the de-concatenation function. Specifically, after the external camera unit captures a target scene to obtain a corresponding first captured image, it transmits the corresponding first captured image to the recording and playing device. The recording and playing device includes a cable of a certain length. The recording and playing device first performs concatenation processing on the first captured image corresponding to the external camera unit to obtain the first captured image concatenated data corresponding to the external camera unit. Then, the first captured image concatenated data corresponding to the external camera unit is transmitted a certain distance in the cable of the recording and playing device, specifically from the side close to the external camera unit in the cable of the recording and playing device to the side close to the recording and playing device. Further, the recording and playing device performs de-concatenation processing on the first captured image concatenated data corresponding to the external camera unit to obtain the first captured image corresponding to the external camera unit.

[0050] S1102, call the first captured image corresponding to each external camera unit and execute a preset multi-image processing task to obtain a target image of the target scene.

[0051] Specifically, the preset multi-image processing task refers to the recording and playing device performing operations such as multi-image synthesis, multi-image switching, or other operations involving multi-image processing based on the first captured image corresponding to each external camera unit, and its purpose is to generate a target image of the target scene.

[0052] Regarding the process in which the recording and playing device calls the first captured image corresponding to each external camera unit and executes a preset multi-image processing task to obtain a target image of the target scene, in some possible implementation manners, the recording and playing device determines at least two captured images to be fused in the first captured image corresponding to each external camera unit; the recording and playing device performs fusion processing on the at least two captured images to be fused to obtain a target image of the target scene, and each captured image to be fused in the at least two captured images to be fused is fused and displayed in the target image.

[0053] In some possible implementation manners, the recording and playing device determines at least two to-be-switched shooting images in the first shooting images corresponding to each external camera unit; the recording and playing device performs switching processing on the at least two to-be-switched shooting images to obtain a target image of a target scene, and each to-be-switched shooting image among the at least two to-be-switched shooting images is switched and displayed in the target image.

[0054] It can be understood that by introducing the serial data processing function, the recording and playing device effectively solves the problem of high latency in obtaining shooting images through external devices in the related art. The recording and playing device obtains the shooting images of the external camera units based on the serial data processing method. The serial data processing is implemented at the physical layer, and it directly completes the encapsulation and transmission of the shooting images in the form of a continuous bit stream without going through complex encapsulation and de-encapsulation processing above the network layer, reducing the latency of the recording and playing device in obtaining shooting images.

[0055] It can be understood that by introducing the serial data processing function, the recording and playing device realizes the extension of the shooting distance and the full coverage of complex scenes. For example, in a classroom scenario, the main body of the recording and playing device is usually set near the blackboard. The recording and playing device supports obtaining shooting images based on the serial data processing method. The serial data processing method can support a longer transmission distance through data conversion at the physical layer. This long-distance data transmission capability enables the external camera units to be deployed at the back of the classroom far from the blackboard, thus breaking through the physical location limitation of the recording and playing device and ensuring that the recording and playing device can capture the panoramic image of the classroom.

[0056] In this embodiment, the recording and playing device obtains the shooting images of the external camera units based on the serial data processing method, thereby simplifying the data transmission process, reducing the latency of the recording and playing device in obtaining shooting images, and effectively improving the multi-image processing effect of the recording and playing device. At the same time, long-distance data transmission is realized based on the serial data processing method, significantly improving the scene coverage ability of the recording and playing device and effectively improving the multi-image processing effect of the recording and playing device.

[0057] In an embodiment, the method of the embodiment of the present application may include the following steps S1201 - S1202, and steps S1201 - S1202 may be used as refinement steps of Figure 2 step S1101 shown in the embodiment.

[0058] S1201, receiving the first shooting image plus serial data corresponding to each external camera unit, where the first shooting image plus serial data corresponding to each external camera unit is obtained by each external camera unit shooting the target scene and adding serial data;

[0059] S1202, performing de-serialization processing on the first shooting image plus serial data corresponding to each external camera unit to obtain the first shooting image corresponding to each external camera unit.

[0060] Specifically, the external camera unit involved in this embodiment has the function of adding serialization, so the recording and playing device only needs to support the deserialization function.

[0061] The recording and playing device supporting the deserialization function means that the recording and playing device can perform deserialization processing on the serialized data added to the first captured image corresponding to the external camera unit and restore it to the original captured image. For example, assuming that the serialized data added to the captured image corresponding to the external camera unit is in the MIPI A-PHY format, then the recording and playing device performs deserialization on it to obtain the captured image corresponding to the external camera unit, and the captured image corresponding to the external camera unit is in the MIPI D-PHY format.

[0062] The recording and playing device receiving the serialized data added to the first captured image corresponding to each external camera unit means that the recording and playing device establishes an independent communication channel with each external camera unit through a cable to achieve the transmission of the serialized data added to the first captured image. Specifically, after each external camera unit captures the target scene to obtain the corresponding first captured image, each external camera unit performs serialization processing on the corresponding first captured image to obtain the corresponding serialized data added to the first captured image, and transmits the corresponding serialized data added to the first captured image to the recording and playing device through a cable.

[0063] The recording and playing device performing deserialization processing on the serialized data added to the first captured image corresponding to each external camera unit means that the recording and playing device calls the corresponding deserialization algorithm or hardware module according to the serialization format of the serialized data added to the first captured image corresponding to each external camera unit, and performs deserialization and restoration on the serialized data added to the first captured image corresponding to each external camera unit to obtain the first captured image corresponding to each external camera unit.

[0064] In this embodiment, the external camera unit has the function of adding serialization, can perform serialization processing on the captured first captured image, generate the serialized data added to the first captured image, and transmit the serialized data added to the first captured image to the recording and playing device through a cable. This implementation method can effectively reduce the data transmission delay and improve the multi-image processing efficiency of the recording and playing device. At the same time, the efficient deserialization processing of the recording and playing device can quickly restore the first captured image corresponding to each external camera unit, providing data support for subsequent multi-image processing tasks.

[0065] In one embodiment, the method of this application embodiment may include the following steps S1301-S1302, and steps S1301-S1302 may be used as the refinement steps of Figure 2 the steps S1101 shown in the embodiment.

[0066] S1301, receiving the first captured image corresponding to each external camera unit, and performing serialization processing on the first captured image corresponding to each external camera unit to obtain the serialized data added to the first captured image corresponding to each external camera unit;

[0067] S1302, perform deserialization processing on the serialized data of the first captured images corresponding to each external camera unit to obtain the first captured images corresponding to each external camera unit.

[0068] Specifically, the external camera units involved in this embodiment do not have the serialization function. Therefore, the recording and broadcasting device needs to support the serialization function and the deserialization function.

[0069] The serialization function of the recording and broadcasting device refers to the function used to perform serialization processing on the first captured images corresponding to each external camera unit. Its function is to serialize the first captured images corresponding to each external camera unit into the serialized data of the corresponding first captured images.

[0070] The recording and broadcasting device receiving the first captured images corresponding to each external camera unit means that the recording and broadcasting device establishes an independent communication channel with each external camera unit through a cable to achieve the transmission of the first captured images. Specifically, after each external camera unit captures the target scene, it obtains the corresponding first captured image and transmits the corresponding first captured image to the recording and broadcasting device through a cable. The recording and broadcasting device performing serialization processing on the first captured images corresponding to each external camera unit means that the recording and broadcasting device calls the corresponding serialization algorithm or hardware module according to the preset serialization format to perform serialization processing on the first captured images corresponding to each external camera unit, generating the serialized data of the first captured images corresponding to each external camera unit.

[0071] Furthermore, the recording and broadcasting device transmits the serialized data of the first captured images corresponding to each external camera unit through a cable. Specifically, it is transmitted from the part responsible for serialization in the recording and broadcasting device to the part responsible for deserialization. The above cable is the cable inside the recording and broadcasting device used to transmit serialized data.

[0072] The recording and broadcasting device performing deserialization processing on the serialized data of the first captured images corresponding to each external camera unit means that the recording and broadcasting device calls the corresponding deserialization algorithm or hardware module according to the serialization format of the serialized data of the first captured images corresponding to each external camera unit to perform deserialization restoration on the serialized data of the first captured images corresponding to each external camera unit, obtaining the first captured images corresponding to each external camera unit.

[0073] In this embodiment, although the external camera units do not have the serialization function, the recording and broadcasting device can cooperate to achieve serialization and deserialization of the captured images by supporting the serialization function and the deserialization function, so that the first captured images corresponding to each external camera unit can be quickly transmitted to the part responsible for deserialization in the recording and broadcasting device subsequently. This implementation method can effectively reduce the data transmission delay and improve the multi-image processing efficiency of the recording and broadcasting device. At the same time, it reduces the functional requirements for the external camera units, enabling the recording and broadcasting device to be compatible with external camera units without the serialization function and improving the compatibility of the recording and broadcasting device.

[0074] In one embodiment, the method of the embodiments of the present application may include the following steps S1401 - S1403, and steps S1401 - S1403 may be executed Figure 2 before the steps S1101 of the embodiment shown.

[0075] S1401, obtaining the second captured images corresponding to each external camera unit based on a serial data processing method;

[0076] S1402, determining the shooting objects corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit;

[0077] S1403, performing motion control on each external camera unit according to the shooting objects corresponding to each external camera unit, so that each external camera unit captures the corresponding shooting object to obtain the corresponding first captured image.

[0078] Specifically, the first captured images and the second captured images corresponding to each external camera unit involved in this embodiment are both one of the captured images corresponding to each external camera unit. Therefore, for the implementation process of step S1401, please refer to Figure 2 the relevant explanations of step S1101 of the embodiment shown, which will not be elaborated here.

[0079] Furthermore, the recording and broadcasting device determines the shooting objects corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit. Among them, the shooting object refers to a dynamic element or a static element in the target scene, such as a teacher, a student, a blackboard, etc. in a classroom scene. The recording and broadcasting device analyzes the second captured images corresponding to each external camera unit through an image recognition algorithm, an audio recognition algorithm, or a combination of the two to determine the shooting objects corresponding to each external camera unit.

[0080] Furthermore, the recording and broadcasting device performs motion control on each external camera unit according to the shooting objects corresponding to each external camera unit. Specifically, the recording and broadcasting device may generate control parameters for the motion control units corresponding to each external camera unit according to the shooting objects corresponding to each external camera unit; then, the recording and broadcasting device controls the motion control units corresponding to each external camera unit to drive each external camera unit towards the corresponding shooting object according to the control parameters of the motion control units corresponding to each external camera unit, so that each external camera unit captures the corresponding shooting object to obtain the corresponding first captured image.

[0081] In this embodiment, the recording and broadcasting device obtains the second captured images corresponding to each external camera unit based on the serial data processing method, realizing the preliminary acquisition of the captured images of each external camera unit. Based on the second captured images corresponding to each external camera unit, the recording and broadcasting device determines the shooting objects corresponding to each external camera unit in the target scene, which can accurately identify dynamic or static elements in the target scene and provide a basis for subsequent shooting control. The recording and broadcasting device performs motion control on each external camera unit according to the shooting objects corresponding to each external camera unit. By generating the control parameters of the motion control unit corresponding to each external camera unit and controlling the motion control unit corresponding to each external camera unit to drive each external camera unit towards the corresponding shooting object, it ensures that each external camera unit can capture the key elements in the target scene, thereby obtaining a high-quality first captured image and enhancing the accuracy of the first captured image acquisition.

[0082] In one embodiment, the recording and broadcasting system further includes a microphone array. Further refining the steps of the above embodiment S1402 may include the following steps:

[0083] Determining the shooting objects corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit includes:

[0084] Obtaining the target audio signal in the target scene collected by the microphone array;

[0085] Based on the second captured images corresponding to each external camera unit and the target audio signal in the target scene collected by the microphone array, determining the target speaker corresponding to each external camera unit in the target scene;

[0086] Determining the target speaker corresponding to each external camera unit as the shooting object corresponding to each external camera unit.

[0087] Specifically, the recording and broadcasting device obtains the target audio signal in the target scene collected by the microphone array. The microphone array is composed of multiple microphones and can collect and locate the audio signal in the target scene through spatial positioning technology. The target audio signal refers to the audio signal containing the voice of the target speaker collected by the microphone array in the target scene. The recording and broadcasting device establishes a communication connection with the microphone array through a relevant audio interface to receive the target audio signal in the target scene collected by the microphone array. In some possible implementation manners, after receiving the target audio signal collected by the microphone array, the recording and broadcasting device can also perform preprocessing on it, such as noise reduction, enhancement, etc., to improve the quality and clarity of the audio signal.

[0088] The recording and broadcasting device determines the target speaker corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit and the target audio signal in the target scene collected by the microphone array, where the target speaker refers to the person speaking in the target scene. Specifically, the recording and broadcasting device first performs image analysis on the second captured images corresponding to each external camera unit to identify the people and their positions in the target scene; then performs audio analysis on the target audio signal collected by the microphone array to identify the speaker and their position in the target scene; finally, determines the target speaker corresponding to each external camera unit through the matching of images and audio.

[0089] The recording and broadcasting device determines the target speaker corresponding to each external camera unit as the shooting object corresponding to each external camera unit. Among them, the shooting object corresponding to each external camera unit can be stored in the recording and broadcasting device in the form of shooting object information. During subsequent motion control, the recording and broadcasting device can accurately control each external camera unit according to the stored shooting object information to ensure that each external camera unit can accurately capture the corresponding target speaker.

[0090] Further, the recording and broadcasting device determines the target speaker corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit and the target audio signal in the target scene collected by the microphone array, specifically including the following steps: the recording and broadcasting device performs image analysis on the second captured images corresponding to each external camera unit to identify the people and their positions in the target scene; the recording and broadcasting device performs audio analysis on the target audio signal collected by the microphone array to identify the speaker and their position in the target scene; the recording and broadcasting device determines the target speaker corresponding to each external camera unit through the matching of images and audio.

[0091] In this embodiment, the recording and broadcasting device first obtains the target audio signal in the target scene collected by the microphone array, and then determines the target speaker corresponding to each external camera unit based on the second captured images corresponding to each external camera unit and the target audio signal collected by the microphone array; finally, the recording and broadcasting device determines the target speaker corresponding to each external camera unit as the shooting object corresponding to each external camera unit. Through the above steps, automatic identification and tracking of the target speaker are realized, and the intelligent level and shooting effect of the recording and broadcasting system are improved.

[0092] In one embodiment, the steps of step S1402 in the above embodiment can be further refined, and can include the following steps:

[0093] Construct a semantic map of the target scene based on the second captured images corresponding to each external camera unit;

[0094] Determine the shooting area corresponding to each external camera unit in the target scene based on the semantic map;

[0095] Determine the shooting area corresponding to each external camera unit as the shooting object corresponding to each external camera unit.

[0096] Specifically, the recording and broadcasting device constructs a semantic map of the target scene based on the second shooting images corresponding to each external camera unit. Here, the semantic map refers to a map that semantically describes at least one of the people, objects, and their spatial relationships in the target scene. The recording and broadcasting device performs image analysis on the second shooting images corresponding to each external camera unit, identifies at least one of the people and objects in the target scene, and combines the geometric structure and spatial layout of the scene to generate a semantic map of the target scene. The semantic map can include the following two situations: one is a semantic map containing people and objects, that is, the recording and broadcasting device identifies the distribution and mutual relationship of people and objects; the other is a semantic map containing only objects, that is, the recording and broadcasting device identifies the distribution and spatial layout of objects.

[0097] The recording and broadcasting device determines the shooting area corresponding to each external camera unit in the target scene based on the semantic map. Here, the shooting area refers to the area in the target scene that needs to be focused on by each external camera unit. Specifically, when the semantic map contains people and objects, the recording and broadcasting device first determines the area where people gather or are active frequently in the target scene according to the people distribution information in the semantic map; then combines the object distribution information in the semantic map to determine the key objects or important areas in the target scene; finally, combines the positions, viewing angles, and shooting capabilities of each external camera unit to allocate the corresponding shooting areas to each external camera unit to ensure that the key areas in the target scene can be fully covered. When the semantic map contains only objects, the recording and broadcasting device determines the key objects or important areas in the target scene according to the object distribution information in the semantic map, and combines the positions, viewing angles, and shooting capabilities of each external camera unit to allocate the corresponding shooting areas to each external camera unit.

[0098] Exemplarily, in a conference room scenario, the recording and broadcasting device can identify areas such as the podium, projector, and audience seats according to the semantic map, and allocate corresponding shooting areas to different external camera units. For example, one external camera unit is responsible for shooting the podium, and another external camera unit is responsible for shooting the audience seats.

[0099] Exemplarily, in a classroom scenario, the recording and broadcasting device can identify areas such as the podium, blackboard, student seating area, and multimedia devices based on the semantic map, and allocate corresponding shooting areas to different external camera units. Specifically, one external camera unit can be responsible for shooting the podium and blackboard areas to ensure that the teaching activities of the teacher and the content of the blackboard writing can be clearly captured; another external camera unit can be responsible for shooting the student seating area to record the students' classroom participation and interaction performance; in addition, if there are multimedia devices in the classroom, such as projectors or electronic whiteboards, the recording and broadcasting device can also allocate an external camera unit to specifically shoot the display content of the multimedia device.

[0100] The recording and broadcasting device determines the shooting areas corresponding to each external camera unit as the shooting objects corresponding to each external camera unit. Among them, the shooting objects corresponding to each external camera unit can be stored in the recording and broadcasting device in the form of shooting object information, and the shooting object information includes parameters such as the position, range, and priority of the shooting area. In the subsequent motion control process, the recording and broadcasting device can accurately control each external camera unit according to the stored shooting object information to ensure that each external camera unit can accurately shoot the corresponding shooting area.

[0101] In this embodiment, the recording and broadcasting device first constructs a semantic map of the target scene based on the second shooting pictures corresponding to each external camera unit; then, based on the semantic map, determines the shooting areas corresponding to each external camera unit in the target scene; finally, the recording and broadcasting device determines the shooting areas corresponding to each external camera unit as the shooting objects corresponding to each external camera unit. Through the above steps, the intelligent division and allocation of shooting areas in the target scene are realized, the shooting coverage rate and shooting effect are improved, and at the same time, the multi-picture processing requirements of the recording and broadcasting device in complex scenes are met.

[0102] In one embodiment, the recording and broadcasting system further includes a microphone array, and the multiple external camera units are composed of at least one speaker camera unit and at least one area camera unit. Further refining the steps of the above embodiment S1402 may include the following steps:

[0103] Obtain the target audio signal in the target scene collected by the microphone array;

[0104] Based on the second shooting pictures corresponding to each speaker camera unit in at least one speaker camera unit, the second shooting pictures corresponding to each area camera unit in at least one area camera unit, and the target audio signal in the target scene collected by the microphone array, determine the target speakers corresponding to each speaker camera unit in the target scene;

[0105] Determine the target speakers corresponding to each speaker camera unit as the shooting objects corresponding to each speaker camera unit;

[0106] Construct a semantic map of the target scene based on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit.

[0107] Based on the semantic map, determine the shooting areas corresponding to each area camera unit in the target scene.

[0108] Determine the shooting areas corresponding to each area camera unit as the shooting objects corresponding to each area camera unit.

[0109] Specifically, regarding the recording device obtaining the target audio signal in the target scene collected by the microphone array, relevant explanations have been given in the above embodiments and will not be elaborated here.

[0110] Further, based on the second captured images corresponding to each speaker camera unit in at least one speaker camera unit, the second captured images corresponding to each area camera unit in at least one area camera unit, and the target audio signal in the target scene collected by the microphone array, the recording device determines the target speakers corresponding to each speaker camera unit in the target scene, where the target speaker refers to the person speaking in the target scene. Specifically, the recording device first performs image analysis on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit to identify the people and their positions in the target scene; then performs audio analysis on the target audio signal collected by the microphone array to identify the speakers and their positions in the target scene; finally, determines the target speakers corresponding to each speaker camera unit through the matching of images and audio.

[0111] The recording device determines the target speakers corresponding to each speaker camera unit as the shooting objects corresponding to each speaker camera unit. Among them, the shooting objects corresponding to each speaker camera unit are stored in the recording device in the form of shooting object information, and the recording device controls each speaker camera unit according to the stored shooting object information during subsequent motion control to ensure that each speaker camera unit can accurately shoot the corresponding target speaker.

[0112] The recording device constructs a semantic map of the target scene based on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit, where the semantic map refers to a map that semantically describes at least one of the people, objects, and their spatial relationships in the target scene. The recording device performs image analysis on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit to identify at least one of the people and objects in the target scene, and combines the geometric structure and spatial layout of the scene to generate a semantic map of the target scene.

[0113] Based on the semantic map, the recording and broadcasting device determines the shooting areas corresponding to the camera units in each area in the target scene. Here, the shooting area refers to the area in the target scene that needs to be focused on by the camera units in each area. Specifically, the recording and broadcasting device determines the areas where people gather, areas with frequent activities, or areas with key objects in the target scene according to the person distribution information and object distribution information in the semantic map, and combines the positions, perspectives, and shooting capabilities of the camera units in each area to allocate corresponding shooting areas to the camera units in each area to ensure that the key areas in the target scene can be fully covered.

[0114] The recording and broadcasting device determines the shooting areas corresponding to the camera units in each area as the shooting objects corresponding to the camera units in each area. Among them, the shooting objects corresponding to the camera units in each area are stored in the recording and broadcasting device in the form of shooting object information, and the shooting object information includes parameters such as the position, range, and priority of the shooting area. During the subsequent motion control process, the recording and broadcasting device controls the camera units in each area according to the stored shooting object information to ensure that the camera units in each area can accurately shoot the corresponding shooting areas.

[0115] Furthermore, the recording and broadcasting device constructs a semantic map of the target scene based on the second shooting images corresponding to the speaker camera units and the second shooting images corresponding to the camera units in each area, which specifically includes the following steps: The recording and broadcasting device performs image analysis on the second shooting images corresponding to the speaker camera units and the second shooting images corresponding to the camera units in each area to identify at least one of the people and objects in the target scene; the recording and broadcasting device combines the geometric structure and spatial layout of the scene to generate a semantic map of the target scene.

[0116] Furthermore, the recording and broadcasting device determines the shooting areas corresponding to the camera units in each area in the target scene based on the semantic map, which specifically includes the following steps: The recording and broadcasting device determines the areas where people gather or areas with frequent activities in the target scene according to the person distribution information in the semantic map; the recording and broadcasting device determines the key objects or important areas in the target scene according to the object distribution information in the semantic map; the recording and broadcasting device combines the positions, perspectives, and shooting capabilities of the camera units in each area to allocate corresponding shooting areas to the camera units in each area.

[0117] Exemplarily, in a conference room scene, the recording and broadcasting device can identify areas such as the podium, projector, and audience seats according to the semantic map and allocate corresponding shooting objects to different camera units. Specifically, the recording and broadcasting device can determine the podium area as the area where the target speaker is located and allocate the podium area as the shooting object corresponding to the speaker camera unit to ensure that the speaker camera unit can accurately capture the speaker's speech image; at the same time, the recording and broadcasting device can allocate the audience seat area and the projector area as the shooting areas corresponding to the camera units in each area to ensure that the camera units in each area can fully cover the audience's reactions and the display of the projection content.

[0118] Exemplarily, in a classroom scenario, the recording and broadcasting device can identify areas such as the podium, blackboard, student seating area, and multimedia device according to the semantic map, and assign corresponding shooting objects to different camera units. Specifically, the recording and broadcasting device can determine that the podium area is the area where the target speaker is located, and assign the podium area as the shooting object corresponding to the speaker camera unit to ensure that the speaker camera unit can accurately capture the teaching activities and speech pictures of the teacher; at the same time, the recording and broadcasting device can assign the blackboard area, student seating area, and multimedia device area as the shooting areas corresponding to the area camera unit to ensure that the area camera unit can respectively record the blackboard writing content, the students' classroom participation, and the display content of the multimedia device.

[0119] In this embodiment, the recording and broadcasting device first obtains the target audio signal in the target scene collected by the microphone array, and then determines the target speaker corresponding to each speaker camera unit based on the second shooting pictures corresponding to each speaker camera unit, the second shooting pictures corresponding to each area camera unit, and the target audio signal collected by the microphone array; then, the recording and broadcasting device determines the target speaker corresponding to each speaker camera unit as the shooting object corresponding to each speaker camera unit; subsequently, the recording and broadcasting device constructs a semantic map of the target scene based on the second shooting pictures corresponding to each speaker camera unit and the second shooting pictures corresponding to each area camera unit; then, the recording and broadcasting device determines the shooting areas corresponding to each area camera unit in the target scene based on the semantic map; finally, the recording and broadcasting device determines the shooting areas corresponding to each area camera unit as the shooting objects corresponding to each area camera unit. Through the above steps, automatic identification and tracking of the target speaker are achieved, as well as intelligent division and allocation of the shooting areas in the target scene, improving the intelligent level and shooting effect of the recording and broadcasting system, and at the same time meeting the multi-screen processing requirements of the recording and broadcasting device in complex scenarios.

[0120] In one embodiment, the recording and broadcasting system further includes a plurality of motion control units, and any one of the plurality of external camera units is movably connected to the corresponding motion control unit among the plurality of motion control units. Further refining the steps of the above embodiment S1403 may include the following steps:

[0121] Generate control parameters for the motion control units corresponding to each external camera unit according to the shooting objects corresponding to each external camera unit;

[0122] According to the control parameters of the motion control units corresponding to each external camera unit, control the motion control units corresponding to each external camera unit to drive each external camera unit towards the corresponding shooting object, so that each external camera unit shoots the corresponding shooting object to obtain the corresponding first shooting picture.

[0123] Specifically, the recording and broadcasting device generates control parameters for the motion control units corresponding to each external camera unit according to the shooting objects corresponding to each external camera unit. Here, the control parameters refer to specific instructions or data used to control the motion control unit to drive the external camera unit to move, such as parameters like the target position, target angle, motion speed, and motion trajectory of the external camera unit. The recording and broadcasting device generates the control parameters for the motion control units corresponding to each external camera unit by analyzing information such as the position, range, and priority of the shooting objects corresponding to each external camera unit, and combining parameters such as the current position and viewing angle of each external camera unit, so as to ensure that each external camera unit can accurately face the corresponding shooting object for shooting.

[0124] The recording and broadcasting device controls the motion control units corresponding to each external camera unit to drive each external camera unit to face the corresponding shooting object according to the control parameters of the motion control units corresponding to each external camera unit, so that each external camera unit shoots the corresponding shooting object to obtain the corresponding first shooting image. Specifically, the recording and broadcasting device establishes a connection with the motion control unit corresponding to each external camera unit through a communication interface, and sends the generated control parameters to the corresponding motion control unit; the motion control unit drives the external camera unit to move according to the received control parameters, such as translation, rotation, pitching, etc., so that the lens of the external camera unit faces the corresponding shooting object; after the movement of the external camera unit is completed, it shoots the corresponding shooting object to obtain the corresponding first shooting image.

[0125] Exemplarily, in a classroom scenario, the shooting area corresponding to a certain area camera unit is the student seating area. The recording and broadcasting device can generate control parameters for the motion control unit corresponding to this area camera unit according to the position information of the shooting area corresponding to this area camera unit, such as the target position, target angle, motion trajectory, etc.; the recording and broadcasting device sends the control parameters to the motion control unit corresponding to this area camera unit, and the motion control unit corresponding to this area camera unit drives this area camera unit to face the student seating area according to the corresponding control parameters, so that the lens range of the area camera unit can be aligned with the student seating area; after the movement of this area camera unit is completed, it shoots the student seating area to obtain the corresponding first shooting image.

[0126] In this embodiment, the recording and broadcasting device first generates control parameters for the motion control units corresponding to the external camera units according to the shooting objects corresponding to the external camera units; then, the recording and broadcasting device controls the motion control units corresponding to the external camera units to drive the external camera units towards the corresponding shooting objects according to the control parameters of the motion control units corresponding to the external camera units, so that the external camera units capture the corresponding shooting objects to obtain corresponding first shooting images. Through the above steps, the automatic motion control of the external camera units and the accurate capture of the shooting objects are realized, the intelligent level and shooting effect of the recording and broadcasting system are improved, and the multi-screen processing requirements of the recording and broadcasting device in complex scenarios are met at the same time.

[0127] In one embodiment, the method of the embodiment of the present application may include the following steps S1501-S1502, and steps S1501-S1502 may be used as the refinement steps of Figure 2 step S1102 of the illustrated embodiment.

[0128] S1501, determine at least two shooting images to be fused in the first shooting images corresponding to the external camera units;

[0129] S1502, perform fusion processing on at least two shooting images to be fused to obtain a target image of the target scene, and each shooting image to be fused in the at least two shooting images to be fused is fused and displayed in the target image.

[0130] Specifically, first, the recording and broadcasting device determines at least two shooting images to be fused in the first shooting images corresponding to the external camera units, where the shooting images to be fused refer to the first shooting images that need to be fused. The recording and broadcasting device screens out at least two shooting images to be fused from the first shooting images corresponding to the external camera units based on a pre-determined configuration or an operation instruction of the operator of the recording and broadcasting device.

[0131] The recording and broadcasting device performs fusion processing on at least two shooting images to be fused to obtain a target image of the target scene, where the target image refers to the final image generated after fusion processing and is used to comprehensively display the content of the target scene. The recording and broadcasting device fuses at least two shooting images to be fused through relevant image processing algorithms, so that each shooting image to be fused is fused and displayed in the target image, thereby realizing the multi-angle and multi-content coverage of the target scene.

[0132] In a possible implementation, the above fusion processing method can be embedded fusion. Specifically, embedded fusion means determining a main screen and an embedded screen in at least two captured screens to be fused, and then embedding the embedded screen into the main screen to form a target screen. The recording and broadcasting device first determines the main screen and the embedded screen. Among them, the main screen is a more important screen in the target scene, and the embedded screen is a secondary but necessary screen to be shown in the target scene. The recording and broadcasting device determines the position and size of the embedded screen according to the layout requirements of the target screen, and embeds the embedded screen into the main screen to form the target screen.

[0133] In a possible implementation, the above fusion processing method can be splicing fusion. Specifically, splicing fusion means splicing at least two captured screens to be fused together according to certain rules to form a target screen. The recording and broadcasting device determines the splicing position and splicing method of each captured screen to be fused according to the layout requirements of the target screen, and splices each captured screen to be fused together to form the target screen.

[0134] Exemplarily, please refer to Figure 3 , which is an example schematic diagram of multi-screen fusion provided by an embodiment of the present application. Among them, at least two captured screens to be fused include captured screen 1 (blackboard), captured screen 2 (teacher close-up), and captured screen 3 (student close-up).

[0135] Assume that captured screen 1, captured screen 2, and captured screen 3 are fused by the embedded fusion method. In the target screen obtained by the embedded fusion, captured screen 1 is the main screen, while captured screen 2 and captured screen 3 are the embedded screens embedded in the main screen.

[0136] Assume that captured screen 1, captured screen 2, and captured screen 3 are fused by the splicing fusion method. In the target screen obtained by the splicing fusion, captured screen 1, captured screen 2, and captured screen 3 are distributed at different positions.

[0137] In this embodiment, the recording and broadcasting device first determines at least two captured screens to be fused in the first captured screens corresponding to each external camera unit; then, fuses the at least two captured screens to be fused to obtain the target screen of the target scene. Through the above steps, the comprehensive coverage of multiple angles and multiple contents of the target scene is realized, the screen display effect of the recording and broadcasting system is improved, and at the same time, the multi-screen processing requirements of the recording and broadcasting device in complex scenes are met.

[0138] In an embodiment, the method of the embodiment of the present application may include the following steps S1601 - S1602, and steps S1601 - S1602 can be used as the refinement steps of Figure 2 the steps S1102 shown in the embodiment.

[0139] S1601. Determine at least two shooting pictures to be switched in the first shooting pictures corresponding to each external camera unit;

[0140] S1602. Perform switching processing on at least two shooting pictures to be switched to obtain the target picture of the target scene, and each shooting picture to be switched among the at least two shooting pictures to be switched is switched and displayed in the target picture.

[0141] Specifically, first, the recording and broadcasting device determines at least two shooting pictures to be switched in the first shooting pictures corresponding to each external camera unit. Among them, the shooting picture to be switched refers to the shooting picture that needs to be switched. The recording and broadcasting device filters out at least two shooting pictures to be switched from the first shooting pictures corresponding to each external camera unit based on the pre-determined configuration or the operation instruction of the recording and broadcasting device operator.

[0142] The recording and broadcasting device performs switching processing on at least two shooting pictures to be switched to obtain the target picture of the target scene. Among them, the target picture refers to the final picture generated after switching processing and is used to dynamically display the content of the target scene. The recording and broadcasting device switches at least two shooting pictures to be switched through relevant image processing algorithms, so that each shooting picture to be switched is switched and displayed in the target picture, thereby realizing the multi-angle and multi-content dynamic display of the target scene.

[0143] In a possible implementation manner, the above switching processing method may be full-screen switching. Specifically, full-screen switching means that a certain shooting picture to be switched among at least two shooting pictures to be switched is displayed in the target picture in a full-screen manner, and according to the preset switching rule or trigger condition, it is switched to the next shooting picture to be switched. The recording and broadcasting device determines the switching order and switching time interval of each shooting picture to be switched according to the requirements of the target scene, and successively displays each shooting picture to be switched in the target picture in a full-screen manner according to the determined order and time interval.

[0144] In a possible implementation manner, the above switching processing method may be partial switching. Specifically, partial switching means that a certain shooting picture to be switched among at least two shooting pictures to be switched is displayed in the target picture in a partial manner, and according to the preset switching rule or trigger condition, the shooting picture to be switched is switched to the next shooting picture to be switched. The recording and broadcasting device determines the partial display position and display size of each shooting picture to be switched according to the layout requirements of the target picture, and switches and displays the partial content of each shooting picture to be switched according to the preset switching rule or trigger condition.

[0145] Exemplarily, please refer to Figure 4, which is an example schematic diagram of multi - screen switching provided by the embodiments of the present application. Among them, at least two shooting screens to be switched include shooting screen 1 (blackboard), shooting screen 2 (teacher close - up), and shooting screen 3 (student close - up).

[0146] Assume that the shooting screens 1, 2, and 3 are switched in a full - screen switching manner. In the target screen obtained by full - screen switching, from time T0 to time T1, shooting screen 2 is fully displayed on the screen, and from time T1 to time T2, shooting screen 3 is fully displayed on the screen.

[0147] Assume that the shooting screens 1, 2, and 3 are switched in a partial - screen switching manner. From time T0 to time T1, shooting screen 2 is partially displayed (shooting screen 2 is embedded in shooting screen 1), and from time T1 to time T2, shooting screen 3 is partially displayed (shooting screen 3 is embedded in shooting screen 1).

[0148] In this embodiment, the recording and broadcasting device first determines at least two shooting screens to be switched in the first shooting screens corresponding to each external camera unit; then, performs switching processing on at least two shooting screens to be switched to obtain the target screen of the target scene. Through the above steps, the dynamic display of multiple angles and multiple contents of the target scene is realized, the picture display effect of the recording and broadcasting system is improved, and at the same time, the multi - screen processing requirements of the recording and broadcasting device in complex scenes are met.

[0149] Based on Figure 1 the scene schematic shown below, the recording and broadcasting device provided by the embodiments of the present application will be introduced in detail in combination with Figure 5 - Figure 10 ,

[0150] Please refer to Figure 5 , which is a schematic structural diagram of a recording and broadcasting device provided by the embodiments of the present application. This recording and broadcasting device is set in a recording and broadcasting system. The recording and broadcasting system also includes multiple external camera units. The recording and broadcasting device includes a main control unit and a bridging unit. The main control unit is bridged to each external camera unit in multiple external camera units through the bridging unit;

[0151] The bridging unit is used to obtain the first shooting screen corresponding to each external camera unit based on the serial data processing method. The first shooting screen corresponding to each external camera unit is obtained by each external camera unit shooting the target scene;

[0152] The bridging unit is also used to transmit the first shooting screen corresponding to each external camera unit to the main control unit. The first shooting screen corresponding to each external camera unit is used to provide the main control unit to execute a preset multi - screen processing task to obtain the target screen of the target scene.

[0153] Specifically, the target scenarios involved in this embodiment can be scenarios such as classrooms, meeting rooms, live broadcast sites, etc. The target scenarios may contain multiple shooting objects to be collected, such as teachers, students, blackboards, speakers, audiences, display screens, etc., as well as other dynamic or static elements in the scenarios.

[0154] The recording and broadcasting system refers to a system that can implement functions such as audio and video collection, processing, storage, and playback in the target scenario. The recording and broadcasting system at least includes a recording and broadcasting device and multiple external camera units. Among them, the external camera unit refers to a camera unit independently set from the main body of the recording and broadcasting device, and is used to collect some first shooting pictures in the target scenario.

[0155] The recording and broadcasting device includes a main control unit and a bridging unit. The main control unit of the recording and broadcasting device refers to the core processing module of the recording and broadcasting device, which is responsible for controlling the overall operation of the recording and broadcasting device, including functions such as audio and video data collection, processing, storage, and playback. Exemplarily, the main control unit can be a system-on-chip (SOC).

[0156] The main control unit is bridged to each external camera unit among the multiple external camera units through the bridging unit, which means that the main control unit establishes an independent connection channel with each external camera unit through the bridging unit to achieve the efficient transmission of the first shooting pictures. The bridging unit can configure corresponding interfaces and transmission protocols according to the number and type of external camera units to ensure that the first shooting pictures of each external camera unit can be obtained by the main control unit.

[0157] It should be noted that the bridging unit of the recording and broadcasting device can be implemented based on relevant chips, cables, integrated circuit modules, programmable logic devices, multi-protocol converters, signal processors, data interface controllers, etc., and this embodiment does not limit this.

[0158] The following will introduce the working processes of the components in the recording and broadcasting device:

[0159] The bridging unit obtains the first shooting pictures corresponding to the external camera units based on the serial data processing method. The first shooting pictures corresponding to the external camera units are obtained by the external camera units shooting the target scenario. The serial data processing method is a method of realizing data encapsulation and transmission through the physical layer, and can include one-way or two-way data conversion processing. In some cases, the serial data processing method can only include deserialization processing; in some cases, the serial data processing method can include both serialization processing and deserialization processing.

[0160] In some possible implementation manners, if the external camera unit supports the serialization function, then the bridging unit may only support the deserialization function. Specifically, after the external camera unit captures a target scene to obtain a corresponding first captured image, it may directly perform serialization processing on the corresponding first captured image to obtain corresponding serialized data of the first captured image, and transmit the corresponding serialized data of the first captured image to the bridging unit. The bridging unit only needs to perform deserialization processing on the corresponding serialized data of the first captured image of the external camera unit to obtain the corresponding first captured image of the external camera unit.

[0161] In some possible implementation manners, if the external camera unit does not support the serialization function, then the bridging unit may support both the serialization function and the deserialization function. Specifically, after the external camera unit captures a target scene to obtain a corresponding first captured image, it transmits the corresponding first captured image to the bridging unit. The bridging unit includes a cable of a certain length. The bridging unit first performs serialization processing on the corresponding first captured image of the external camera unit to obtain corresponding serialized data of the first captured image of the external camera unit. Then, the corresponding serialized data of the first captured image of the external camera unit is transmitted a certain distance in the cable of the bridging unit, specifically from the side of the cable of the bridging unit close to the external camera unit to the side close to the main control unit. Further, the bridging unit performs deserialization processing on the corresponding serialized data of the first captured image of the external camera unit to obtain the corresponding first captured image of the external camera unit.

[0162] Further, the bridging unit transmits the corresponding first captured image of each external camera unit to the main control unit. Correspondingly, the main control unit acquires the corresponding first captured image of each external camera unit transmitted by the bridging unit, and executes a preset multi-image processing task based on the corresponding first captured image of each external camera unit to obtain a target image of the target scene. Specifically, the preset multi-image processing task refers to that the main control unit performs operations such as multi-image synthesis, multi-image switching or other operations involving multi-image processing based on the corresponding first captured image of each external camera unit, and its purpose is to generate a target image of the target scene.

[0163] Further, the main control unit may also store the target image in a relevant storage medium in the recording and broadcasting device; or, the video output unit of the recording and broadcasting device is connected to a display device, and the main control unit may output the target image to the display device through the video output unit of the recording and broadcasting device so that the display device displays the target image; or, the network unit of the recording and broadcasting device is connected to a server, and the main control unit may send the target image to the server through the network unit of the recording and broadcasting device. In addition, the recording and broadcasting device may also implement various functions based on the target image, which will not be listed one by one here.

[0164] It can be understood that by introducing a bridging unit, the recording and playback device effectively solves the problem of high latency in obtaining captured images through external devices in related technologies. The bridging unit obtains the captured images of the external imaging unit based on the serial data processing method. The serial data processing is implemented at the physical layer, which directly completes the encapsulation and transmission of the captured images in the form of a continuous bit stream, without going through complex encapsulation and decapsulation processing at the network layer and above, reducing the latency of the recording and playback device in obtaining the captured images.

[0165] It can be understood that by introducing a bridging unit, the recording and playback device effectively solves the problem of limited physical location of the image sensor built into the recording and playback device in related technologies, realizing the extension of the shooting distance and the full coverage of complex scenes. In related technologies, the image sensor built into the recording and playback device is connected to the main control unit in a direct connection manner. The direct connection method has a fast data transmission speed but is limited by signal attenuation, and the extension distance of the image sensor is short, making it difficult to meet the requirements of long-distance shooting. For example, in a classroom scenario, the main body of the recording and playback device is usually set near the blackboard, and the direct connection method cannot cover the student seating area far from the blackboard or the dynamic area at the back of the classroom. The bridging unit supports obtaining captured images based on the serial data processing method. The serial data processing method can support a longer transmission distance through data conversion at the physical layer. This long-distance data transmission ability enables the external imaging unit to be deployed at the back of the classroom far from the blackboard, thus breaking through the physical location limitation of the recording and playback device and transmitting the captured images to the recording and playback device through the bridging unit, ensuring that the recording and playback device can capture the panoramic image of the classroom.

[0166] In this embodiment, a bridging unit is introduced into the recording and playback device. The bridging unit is used to obtain the first captured images corresponding to each external imaging unit based on the serial data processing method, and transmit the first captured images corresponding to each external imaging unit to the main control unit. The first captured images corresponding to each external imaging unit are used to provide the main control unit to execute a preset multi-image processing task to obtain the target image of the target scene. Among them, the bridging unit obtains the captured images of the external imaging unit based on the serial data processing method, thereby simplifying the data transmission process, reducing the latency of the recording and playback device in obtaining the captured images, and effectively improving the multi-image processing effect of the recording and playback device. At the same time, long-distance data transmission is realized based on the serial data processing method, significantly improving the scene coverage ability of the recording and playback device and effectively improving the multi-image processing effect of the recording and playback device.

[0167] In one embodiment, based on Figure 5 the structure of the recording and playback device shown, the bridging unit includes a deserialization bridging unit, and the deserialization bridging unit is communicatively connected to each external imaging unit through a cable;

[0168] The deserialization bridging unit is built into the main control unit; or,

[0169] The deserialization bridging unit is externally disposed relative to the main control unit and communicatively connected to the main control unit.

[0170] Specifically, the deserialization bridging unit involved in this embodiment refers to a unit for performing deserialization processing on the serialized data (including the serialized data of the first captured image and other possible captured image serialized data) corresponding to the externally disposed imaging unit, and its function is to restore the serialized data corresponding to the externally disposed imaging unit to the original captured image. Exemplarily, the deserialization bridging unit can be implemented based on relevant chips, deserializers, or a combination thereof, and supports deserialization processing of multiple serialization formats.

[0171] The deserialization bridging unit is communicatively connected to each externally disposed imaging unit through a cable. Specifically: the deserialization bridging unit establishes an independent communication link with each externally disposed imaging unit through the cable to implement the transmission of the serialized data of the first captured image. Among them, the type of the cable can include but is not limited to coaxial cables, optical fiber cables, twisted pairs, etc., to support long-distance data transmission.

[0172] In some possible implementation manners, the deserialization bridging unit is disposed inside the main control unit. Please refer to Figure 6a , the deserialization bridging unit is integrated in the main control unit and performs data interaction with other functional modules of the main control unit through the internal bus or interface of the main control unit. This implementation manner can reduce the number of external connection cables, reduce the system complexity, and at the same time improve the efficiency and reliability of data transmission. In addition, the deserialization bridging unit disposed inside the main control unit can share computing resources such as memory, cache, and processor with other functional modules of the main control unit.

[0173] In some possible implementation manners, the deserialization bridging unit is externally disposed relative to the main control unit and communicatively connected to the main control unit. Please refer to Figure 6b , the deserialization bridging unit is an independent hardware module and performs data interaction with the main control unit through a relevant communication interface. This implementation manner can improve the flexibility and scalability of the recording and playing device, and facilitate adjusting the configuration and quantity of the deserialization bridging unit in the recording and playing device according to actual requirements.

[0174] In this embodiment, by disposing the deserialization bridging unit inside or outside the main control unit, the hardware configuration can be flexibly selected according to the actual application scenario to meet the performance requirements and cost constraints in different scenarios. The deserialization bridging unit communicates directly with each externally disposed imaging unit through a cable, reducing the data transmission delay and improving the multi-image processing efficiency of the recording and playing device.

[0175] In one embodiment, in combination with Figure 6a , when the deserialization bridging unit is disposed inside the main control unit, the first communication interface of the deserialization bridging unit is communicatively connected to the first communication interface of each externally disposed imaging unit through a cable.

[0176] Specifically, the first communication interface refers to a communication interface for transmitting the first captured image plus serial data, which is suitable for long-distance data transmission. The first communication interface of the deserialization bridge unit establishes a connection with the first communication interface of each external camera unit through a cable, and the type of the cable may include but is not limited to a coaxial cable, an optical fiber cable, a twisted pair, etc., to support long-distance data transmission.

[0177] For example, the first communication interface may be a mobile industry processor interface A-PHY (Mobile Industry Processor Interface A-PHY) interface, a low voltage differential signal (Low-Voltage Differential Signaling, LVDS) interface, a flat panel display link (Flat Panel Display Link, FPD-Link) interface, a serializer / deserializer (Serializer / Deserializer, SerDes) interface, etc. In addition to the above-mentioned types of communication interfaces, the first communication interface may also be other types of communication interfaces, which are not limited.

[0178] In some possible implementations, a communication interface whose maximum effective transmission distance is greater than a preset first threshold value may be determined as the first communication interface. The maximum effective transmission distance of the first communication interface refers to the maximum physical distance at which the first communication interface can achieve stable transmission through a cable under the premise of ensuring signal integrity; the preset first threshold value refers to a length threshold value set according to the deployment requirements of the recording and broadcasting device in the target scene, for example, the preset first threshold value may be the maximum wiring length of the recording and broadcasting device in the target scene, so as to ensure that the physical extension range of the cable matches the spatial layout of the recording and broadcasting device in the target scene, while maintaining the transmission performance indicators of the first communication interface in accordance with the multi-screen processing requirements of the recording and broadcasting device.

[0179] The first communication interface of the deserializing bridge unit establishes an independent communication channel with the first communication interface of each external camera unit through a cable to realize the transmission of the first shooting picture plus string data. After each external camera unit shoots the target scene, it obtains the corresponding first shooting picture, and performs string processing on the corresponding first shooting picture to obtain the corresponding first shooting picture plus string data, and then transmits the corresponding first shooting picture plus string data to the first communication interface of the deserializing bridge unit through the first communication interface of each external camera unit. The deserializing bridge unit receives the first shooting picture plus string data corresponding to each external camera unit through its first communication interface, and performs deserial processing on it to obtain the first shooting picture corresponding to each external camera unit.

[0180] In this embodiment, by connecting the first communication interface of the deserialization bridging unit to the first communication interfaces of the external camera units, efficient transmission of the first captured video and concatenated data is achieved. Meanwhile, the first communication interface enables long-distance transmission based on cables, ensuring that the external camera units can be flexibly deployed at positions far from the recording and broadcasting device, thereby expanding the shooting range of the recording and broadcasting device. In addition, the deserialization bridging unit is built into the main control unit, reducing the number of external connection cables, lowering the system complexity, and improving the efficiency and reliability of data transmission.

[0181] In one embodiment, in combination with Figure 6b , when the deserialization bridging unit is external to the main control unit and communicatively connected to the main control unit, the first communication interface of the deserialization bridging unit is communicatively connected to the first communication interfaces of the external camera units through cables, and the second communication interface of the deserialization bridging unit is communicatively connected to the second communication interface of the main control unit.

[0182] Specifically, for the definition of the first communication interface in this embodiment, please refer to the above embodiment and will not be elaborated here.

[0183] The second communication interface refers to the communication interface through which the deserialization bridging unit performs data transmission with the main control unit and is suitable for short-distance data transmission. For example, the second communication interface can be a Mobile Industry Processor Interface D-PHY (Mobile Industry Processor Interface D-PHY) interface, a Peripheral Component Interconnect Express (PCIe) interface, a Universal Serial Bus (USB) interface, a High-Definition Multimedia Interface (HDMI) interface, etc., which are suitable for short-distance data transmission. In addition to the above types of communication interfaces, the second communication interface can also be other types of communication interfaces, which are not limited herein.

[0184] In some possible implementation manners, a communication interface with a maximum effective transmission distance less than a preset second threshold can be determined as the second communication interface. The maximum effective transmission distance of the second communication interface refers to the maximum physical distance at which the second communication interface can achieve stable transmission through cables while ensuring signal stability; the preset second threshold refers to a length threshold set according to the connection requirements between the main control unit and the deserialization bridging unit. For example, the preset second threshold can be the maximum allowable wiring length between the main control unit and the deserialization bridging unit, so as to adapt to the compact layout requirements between the internal modules of the device and ensure that the data transmission rate of the second communication interface meets the real-time requirements of the main control unit for the transmission of the deserialization bridging unit.

[0185] The first communication interface of the deserialization bridging unit establishes independent communication channels with the first communication interfaces of each external camera unit through cables to achieve the transmission of the first captured image plus serialized data. After each external camera unit captures the target scene to obtain the corresponding first captured image, it performs serialization processing on the corresponding first captured image to obtain the corresponding first captured image plus serialized data, and then transmits the corresponding first captured image plus serialized data to the first communication interface of the deserialization bridging unit through the first communication interface of each external camera unit. The deserialization bridging unit receives the corresponding first captured image plus serialized data of each external camera unit through its first communication interface and performs deserialization processing on it to obtain the corresponding first captured image of each external camera unit.

[0186] The second communication interface of the deserialization bridging unit establishes a communication channel with the second communication interface of the main control unit through cables or circuit board traces to achieve the transmission of the deserialized first captured image. After the deserialization bridging unit completes the deserialization processing of the first captured image plus serialized data corresponding to each external camera unit, it transmits the deserialized first captured image to the second communication interface of the main control unit through its second communication interface. The main control unit receives the deserialized first captured image through its second communication interface and transmits it to other functional modules of the main control unit for subsequent multi-image processing tasks.

[0187] In this embodiment, by connecting the first communication interface of the deserialization bridging unit to the first communication interfaces of each external camera unit and connecting the second communication interface of the deserialization bridging unit to the second communication interface of the main control unit, the efficient transmission of the first captured image and the first captured image plus serialized data is achieved. At the same time, based on the characteristic of the first communication interface to achieve long-distance transmission through cables, it ensures that the external camera units can be flexibly deployed at positions far from the recording and broadcasting equipment, thereby expanding the shooting range of the recording and broadcasting equipment.

[0188] In one embodiment, based on Figure 5 the structure of the recording and broadcasting equipment shown, the bridging unit includes a serialization bridging unit and a deserialization bridging unit. The serialization bridging unit is communicatively connected to each external camera unit, and the serialization bridging unit is communicatively connected to the deserialization bridging unit through a cable;

[0189] the deserialization bridging unit is built into the main control unit; or,

[0190] the deserialization bridging unit is external to the main control unit and communicatively connected to the main control unit.

[0191] Specifically, the string-adding bridging unit involved in this embodiment refers to a unit used for performing string-adding processing on the captured images corresponding to the external camera units (including the first captured image and other possible captured images), and its function is to convert the captured images corresponding to the external camera units into string-added image data (including the string-added data of the first captured image and the string-added data of other possible captured images). The string-decoding bridging unit involved in this embodiment refers to a unit used for performing string-decoding processing on the string-added image data corresponding to the external camera units (including the string-added data of the first captured image and the string-added data of other possible captured images), and its function is to restore the string-added image data corresponding to the external camera units to the original captured images. Exemplarily, the string-adding bridging unit can be implemented based on relevant chips, string-adding devices, or their combinations, and supports string-adding processing of multiple string-adding formats; the string-decoding bridging unit can be implemented based on relevant chips, string-decoding devices, or their combinations, and supports string-decoding processing of multiple string-adding formats.

[0192] The string-adding bridging unit is communicatively connected to each external camera unit. Specifically: the string-adding bridging unit establishes an independent communication link with each external camera unit through relevant communication interfaces to achieve the transmission of the first captured image. It can be understood that the relevant communication interfaces between the string-adding bridging unit and the external camera units are generally suitable for short-distance data transmission and can meet the high-efficiency communication requirements between the external camera units and the string-adding bridging unit.

[0193] Exemplarily, the string-adding bridging unit is communicatively connected to each external camera unit through the MIPI D-PHY interface, and the MIPI D-PHY interface can meet the transmission requirements of the first captured image with high resolution and high frame rate.

[0194] The string-adding bridging unit is communicatively connected to the string-decoding bridging unit through a cable. After performing string-adding processing on the first captured image corresponding to the external camera unit, the string-adding bridging unit obtains the string-added data of the first captured image corresponding to the external camera unit, and transmits the string-added data of the first captured image corresponding to the external camera unit to the string-decoding bridging unit through the cable. After receiving the string-added data of the first captured image corresponding to the external camera unit, the string-decoding bridging unit performs string-decoding processing on it and restores it to the first captured image corresponding to the external camera unit. Subsequently, the string-decoding bridging unit transmits the first captured images corresponding to each external camera unit to the main control unit. It should be noted that the communication protocol between the string-adding bridging unit and the string-decoding bridging unit is a serial communication protocol, such as MIPI A-PHY, LVDS, FPD-Link, SerDes, etc.

[0195] In some possible implementation manners, the string-decoding bridging unit is built into the main control unit. Please refer to Figure 6c , the string-decoding bridging unit is integrated in the main control unit and performs data interaction with other functional modules of the main control unit through the internal bus or interface of the main control unit.

[0196] In some possible implementation manners, the deserialization bridging unit is disposed outside the main control unit and communicatively connected to the main control unit. Please refer to Figure 6d , and the deserialization bridging unit, as an independent hardware module, performs data interaction with the main control unit through an external interface.

[0197] In this embodiment, by integrating the deserialization bridging unit into the main control unit or disposing it outside the main control unit, the hardware configuration can be flexibly selected according to the actual application scenario to meet the performance requirements and cost constraints in different scenarios. The serialization bridging unit and the deserialization bridging unit communicate directly through a cable, reducing the data transmission delay and improving the multi-view processing efficiency of the recording and broadcasting device. In addition, the serialization bridging unit and the deserialization bridging unit also support multiple serialization formats and communication protocols, enhancing the compatibility and expandability of the recording and broadcasting device and facilitating the connection with different types of external camera units.

[0198] In one embodiment, in combination with Figure 6c , when the deserialization bridging unit is integrated into the main control unit, the first communication interface of the serialization bridging unit is communicatively connected to the first communication interface of the deserialization bridging unit through a cable, and the third communication interface of the serialization bridging unit is communicatively connected to the third communication interfaces of the respective external camera units.

[0199] Specifically, for the definition of the first communication interface in this embodiment, please refer to the above embodiment, and details are not described herein.

[0200] The third communication interface refers to the communication interface through which the serialization bridging unit is used to perform data transmission with the respective external camera units and is applicable to short-distance data transmission. For example, the third communication interface may be an MIPI D-PHY interface, a PCIe interface, a USB interface, an HDMI interface, etc. In addition to the above types of communication interfaces, the third communication interface may also be other types of communication interfaces, and no limitation is imposed thereon.

[0201] In some possible implementation manners, a communication interface with a maximum effective transmission distance less than a preset third threshold may be determined as the third communication interface. The maximum effective transmission distance of the third communication interface refers to the maximum physical distance at which the third communication interface can achieve stable transmission through a cable on the premise of ensuring signal stability; the preset third threshold refers to a length threshold set according to the connection requirements between the serialization bridging unit and the external camera units. For example, the preset third threshold may be the maximum allowable wiring length between the serialization bridging unit and the external camera units, so as to adapt to the deployment characteristics of the serialization bridging unit and the external camera units while ensuring that the transmission bandwidth of the third communication interface meets the processing requirements of the external camera units for the data stream transmitted by the serialization bridging unit.

[0202] The third communication interface of the adding and stringing bridging unit establishes a communication channel with the third communication interfaces of each external camera unit through a cable or a connector to achieve the transmission of the first captured image. After each external camera unit captures the target scene to obtain the corresponding first captured image, the corresponding first captured image is then transmitted to the third communication interface of the adding and stringing bridging unit through the third communication interface of each external camera unit. Correspondingly, the adding and stringing bridging unit receives the corresponding first captured images of each external camera unit through its third communication interface.

[0203] The first communication interface of the adding and stringing bridging unit establishes a communication channel with the first communication interface of the de-stringing bridging unit through a cable to achieve the transmission of the adding and stringing data of the first captured image. The adding and stringing bridging unit performs adding and stringing processing on the corresponding first captured images of each external camera unit to obtain the corresponding adding and stringing data of the first captured image, and then transmits the corresponding adding and stringing data of the first captured image to the first communication interface of the de-stringing bridging unit through the first communication interface of the adding and stringing bridging unit. The de-stringing bridging unit receives the corresponding adding and stringing data of the first captured image of the adding and stringing bridging unit through its first communication interface and performs de-stringing processing on it to obtain the corresponding first captured images of each external camera unit.

[0204] In this embodiment, by connecting the first communication interface of the adding and stringing bridging unit to the first communication interface of the de-stringing bridging unit and connecting the third communication interface of the adding and stringing bridging unit to the third communication interfaces of each external camera unit, the efficient transmission of the first captured image and the adding and stringing data of the first captured image is achieved. At the same time, based on the characteristic of the first communication interface to achieve long-distance transmission through a cable, it ensures that the external camera units can be flexibly deployed at positions far from the recording and broadcasting device, thereby expanding the shooting range of the recording and broadcasting device. In addition, the de-stringing bridging unit is built into the main control unit, reducing the number of external connection cables, lowering the system complexity, and improving the efficiency and reliability of data transmission.

[0205] In one embodiment, in combination with Figure 6d , when the de-stringing bridging unit is external to the main control unit and communicatively connected to the main control unit, the first communication interface of the adding and stringing bridging unit is communicatively connected to the first communication interface of the de-stringing bridging unit through a cable, the second communication interface of the de-stringing bridging unit is communicatively connected to the second communication interface of the main control unit, and the third communication interface of the adding and stringing bridging unit is communicatively connected to the third communication interfaces of each external camera unit.

[0206] Specifically, for the definitions of the first communication interface, the second communication interface, and the third communication interface in this embodiment, please refer to the above embodiments and will not be elaborated here.

[0207] The third communication interface of the addition and serialization bridging unit establishes a communication channel with the third communication interfaces of each external camera unit through a cable or a connector to achieve the transmission of the first captured image. After each external camera unit captures the target scene to obtain the corresponding first captured image, the corresponding first captured image is then transmitted to the third communication interface of the addition and serialization bridging unit through the third communication interface of each external camera unit. Correspondingly, the addition and serialization bridging unit receives the corresponding first captured images of each external camera unit through its third communication interface.

[0208] The first communication interface of the addition and serialization bridging unit establishes a communication channel with the first communication interface of the deserialization and bridging unit through a cable to achieve the transmission of the addition and serialization data of the first captured image. The addition and serialization bridging unit performs addition and serialization processing on the corresponding first captured images of each external camera unit to obtain the corresponding addition and serialization data of the first captured image, and then transmits the corresponding addition and serialization data of the first captured image to the first communication interface of the deserialization and bridging unit through the first communication interface of the addition and serialization bridging unit. Correspondingly, the deserialization and bridging unit receives the corresponding addition and serialization data of the first captured image of the addition and serialization bridging unit through its first communication interface and performs deserialization processing on it to obtain the corresponding first captured images of each external camera unit.

[0209] The second communication interface of the deserialization and bridging unit establishes a communication channel with the second communication interface of the main control unit through a cable or circuit board trace to achieve the transmission of the deserialized first captured image. After the deserialization and bridging unit completes the deserialization processing of the addition and serialization data of the corresponding first captured images of each external camera unit, it transmits the deserialized first captured image to the second communication interface of the main control unit through its second communication interface. The main control unit receives the deserialized first captured image through its second communication interface and transmits it to other functional modules of the main control unit for subsequent multi-image processing tasks.

[0210] In this embodiment, by connecting the first communication interface of the addition and serialization bridging unit to the first communication interface of the deserialization and bridging unit, connecting the second communication interface of the deserialization and bridging unit to the second communication interface of the main control unit, and connecting the third communication interface of the addition and serialization bridging unit to the third communication interfaces of each external camera unit, the efficient transmission of the first captured image and the addition and serialization data of the first captured image is achieved. At the same time, based on the characteristic that the first communication interface can achieve long-distance transmission through a cable, it ensures that the external camera units can be flexibly deployed at positions far from the recording and broadcasting device, thus expanding the shooting range of the recording and broadcasting device.

[0211] In one embodiment, based on Figure 5 the structure of the recording and broadcasting device shown, the recording and broadcasting system further includes a microphone array;

[0212] The main control unit is communicatively connected to each microphone in the microphone array.

[0213] Specifically, the pickup array involved in this embodiment refers to an array structure composed of multiple pickups, which is used to collect audio signals in a target scenario. Each pickup in the pickup array can independently collect audio signals and transmit the collected audio signals to the main control unit or the audio processing unit for processing. The arrangement method of the pickup array can be a linear array, a circular array, a planar array, etc., and the pickups in the pickup array can be microphones or other types of audio acquisition devices.

[0214] The main control unit is communicatively connected to each pickup in the pickup array, which means that the main control unit establishes an independent communication link with each pickup to achieve the transmission of audio signals.

[0215] In some possible implementation manners, the recording and broadcasting device further includes an audio processing unit; the audio processing unit is communicatively connected to each pickup in the pickup array, and the main control unit is communicatively connected to the audio processing unit. Among them, the audio processing unit is a hardware module for processing audio signals, and its functions can include filtering, noise reduction, mixing, equalization, compression, etc. of audio signals.

[0216] The audio processing unit is communicatively connected to each pickup in the pickup array, which means that the audio processing unit establishes an independent communication link with each pickup through an interface to achieve the transmission of audio signals. The main control unit is communicatively connected to the audio processing unit, which means that the main control unit establishes a communication link with the audio processing unit through an interface to achieve the transmission of audio data and the interaction of control instructions.

[0217] In this embodiment, the cooperation between the main control unit and each pickup in the pickup array realizes the efficient acquisition, transmission, and processing of audio signals in the target scenario, effectively improving the efficiency and audio quality of the recording and broadcasting system in audio processing tasks.

[0218] In one embodiment, based on Figure 5 the structure of the recording and broadcasting device shown, the recording and broadcasting system further includes multiple motion control units;

[0219] Any one of the multiple external camera units is movably connected to the corresponding motion control unit among the multiple motion control units;

[0220] The main control unit is communicatively connected to each motion control unit among the multiple motion control units.

[0221] Specifically, the motion control unit involved in this embodiment is a hardware module for controlling the movement of the external camera unit, and its function can be to control the external camera unit to achieve movements such as translation, pitching, and rotation. The type of the motion control unit can be a pan-tilt head, a robotic arm, a slide rail, etc. The motion control unit cooperates with the external camera unit through a movable connection to achieve the flexible movement and multi-angle shooting of the external camera unit in the target scenario.

[0222] The master control unit is communicatively connected to each of the multiple motion control units. The communication connection method can be a wired communication connection or a wireless communication connection. A wired communication connection refers to a communication method that realizes data transmission through a cable, and its advantages are stable transmission, strong anti-interference ability, high transmission rate, etc. A wireless communication connection refers to a communication method that realizes data transmission through wireless signals, and its advantages are flexible wiring, convenient installation, strong adaptability, etc.

[0223] When the master control unit is wirelessly communicatively connected to each of the multiple motion control units, specifically: the master control unit establishes an independent communication link with each motion control unit through the wireless communication module of the recording and broadcasting device to realize the transmission of control instructions and the interaction of motion state information. Among them, the types of wireless communication modules can include but are not limited to Wireless Local Area Network (WLAN), Bluetooth, ZigBee, etc. The wireless communication protocols between the master control unit and each motion control unit can include but are not limited to wireless local area network protocols, Bluetooth protocols, ZigBee protocols, etc. It can be understood that the wireless communication module and protocol are applicable to medium-short distance and medium-high rate data transmission scenarios and can meet the high-efficiency communication requirements between the master control unit and the motion control unit.

[0224] In this embodiment, the coordinated work of the master control unit and each of the multiple motion control units realizes the efficient control of the movement of the external camera unit, thereby improving the flexibility and adaptability of the recording and broadcasting system in the shooting task. In addition, by adopting a wired or wireless communication connection method, the communication requirements in different scenarios can be met, and the compatibility and expandability of the recording and broadcasting system are enhanced.

[0225] In one embodiment, for the convenience of understanding the external camera unit supporting the string addition function in the above recording and broadcasting device embodiment, please refer to Figure 7a and Figure 7b .

[0226] As Figure 7a shown, it is an example schematic diagram of an external bridging chip for an image sensor provided by an embodiment of the present application. Among them, the external camera unit includes an image sensor, a lens, and a bridging chip, and the bridging chip is externally disposed to the image sensor. The image sensor is used to convert the optical signal collected by the lens into a captured image and transmit the captured image to the bridging chip. The bridging chip is used to perform string addition processing on the captured image output by the image sensor to obtain captured image string addition data and send the captured image string addition data to the bridging unit of the recording and broadcasting device.

[0227] When the bridging unit only includes a deserialization bridging unit, the image sensor is an external bridging chip and the deserialization bridging unit is built into the main control unit, the bridging chip of the external camera unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface. The deserialization bridging unit is built into the main control unit and performs data interaction with other functional modules of the main control unit through an internal bus. The image sensor of the external camera unit converts the optical signal into a captured image and transmits it to the bridging chip. The bridging chip performs serialization processing on the captured image to generate serialized captured image data and transmits it to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the serialized captured image data to restore it to the captured image and transmits it to the main control unit through the internal bus.

[0228] When the bridging unit only includes a deserialization bridging unit, the image sensor is an external bridging chip and the deserialization bridging unit is external to the main control unit, the bridging chip of the external camera unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface. The deserialization bridging unit is connected to the second communication interface of the main control unit through its second communication interface. The image sensor of the external camera unit converts the optical signal into a captured image and transmits it to the bridging chip. The bridging chip performs serialization processing on the captured image to generate serialized captured image data and transmits it to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the serialized captured image data to restore it to the captured image and transmits it to the main control unit through its second communication interface.

[0229] When the bridging unit includes a serialization bridging unit and a deserialization bridging unit, the image sensor is an external bridging chip and the serialization bridging unit and the deserialization bridging unit are built into the main control unit, the bridging chip of the external camera unit is connected to the third communication interface of the serialization bridging unit through its third communication interface. The serialization bridging unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface. The deserialization bridging unit is built into the main control unit and performs data interaction with other functional modules of the main control unit through an internal bus. The image sensor of the external camera unit converts the optical signal into a captured image and transmits it to the bridging chip. The bridging chip performs serialization processing on the captured image to generate serialized captured image data and transmits it to the serialization bridging unit through its third communication interface. The serialization bridging unit further processes the serialized captured image data and transmits it to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the serialized captured image data to restore it to the captured image and transmits it to the main control unit through the internal bus.

[0230] When the bridging unit includes a serial addition bridging unit and a deserialization bridging unit, the bridging chip of the external camera unit is outside the image sensor, and the serial addition bridging unit and the deserialization bridging unit are outside the main control unit, the bridging chip of the external camera unit is connected to the third communication interface of the serial addition bridging unit through its third communication interface. The serial addition bridging unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface. The deserialization bridging unit is connected to the second communication interface of the main control unit through its second communication interface. The image sensor of the external camera unit converts the optical signal into a captured image and transmits it to the bridging chip. The bridging chip performs serial addition processing on the captured image to generate captured image serial addition data and transmits it to the serial addition bridging unit through its third communication interface. The serial addition bridging unit further processes the captured image serial addition data and transmits it to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the captured image serial addition data to restore it to the captured image and transmits it to the main control unit through its second communication interface.

[0231] As Figure 7b shown, it is an example schematic diagram of integrating the bridging function of an image sensor provided by an embodiment of the present application. Among them, the external camera unit includes an image sensor and a lens, but does not include a bridging chip. The image sensor integrates the bridging function, which is used to convert the optical signal collected by the lens into a captured image, perform serial addition processing on the captured image to obtain captured image serial addition data, and send the captured image serial addition data to the bridging unit of the recording and broadcasting device.

[0232] When the bridging unit only includes a deserialization bridging unit, the image sensor integrates the bridging function and the deserialization bridging unit is built into the main control unit, the image sensor of the external camera unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface. The deserialization bridging unit is built into the main control unit and performs data interaction with other functional modules of the main control unit through an internal bus. The image sensor of the external camera unit converts the optical signal into a captured image and performs serial addition processing on the captured image to generate captured image serial addition data. The image sensor transmits the captured image serial addition data to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the captured image serial addition data to restore it to the captured image and transmits it to the main control unit through the internal bus.

[0233] When the bridging unit only includes a deserialization bridging unit, the image sensor integrates the bridging function and the deserialization bridging unit is external to the main control unit, the image sensor of the external camera unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface, and the deserialization bridging unit is connected to the second communication interface of the main control unit through its second communication interface. The image sensor of the external camera unit converts the optical signal into a captured image and performs serialization processing on the captured image to generate serialized captured image data. The image sensor transmits the serialized captured image data to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the serialized captured image data to restore it to the captured image and transmits it to the main control unit through its second communication interface.

[0234] When the bridging unit includes a serialization bridging unit and a deserialization bridging unit, the image sensor integrates the bridging function and the serialization bridging unit and the deserialization bridging unit are built into the main control unit, the image sensor of the external camera unit is connected to the third communication interface of the serialization bridging unit through its third communication interface, the serialization bridging unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface, and the deserialization bridging unit is built into the main control unit and performs data interaction with other functional modules of the main control unit through the internal bus. The image sensor of the external camera unit converts the optical signal into a captured image and performs serialization processing on the captured image to generate serialized captured image data. The image sensor transmits the serialized captured image data to the serialization bridging unit through its third communication interface. The serialization bridging unit further processes the serialized captured image data and transmits it to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the serialized captured image data to restore it to the captured image and transmits it to the main control unit through the internal bus.

[0235] When the bridging unit includes a serialization bridging unit and a deserialization bridging unit, the image sensor integrates the bridging function and the serialization bridging unit and the deserialization bridging unit are external to the main control unit, the image sensor of the external camera unit is connected to the third communication interface of the serialization bridging unit through its third communication interface, the serialization bridging unit is connected to the first communication interface of the deserialization bridging unit through its first communication interface, and the deserialization bridging unit is connected to the second communication interface of the main control unit through its second communication interface. The image sensor of the external camera unit converts the optical signal into a captured image and performs serialization processing on the captured image to generate serialized captured image data. The image sensor transmits the serialized captured image data to the serialization bridging unit through its third communication interface. The serialization bridging unit further processes the serialized captured image data and transmits it to the deserialization bridging unit through its first communication interface. The deserialization bridging unit performs deserialization processing on the serialized captured image data to restore it to the captured image and transmits it to the main control unit through its second communication interface.

[0236] In this embodiment, the external camera unit realizes the conversion and serialization of optical signals by means of an external bridging chip for the image sensor or the integrated bridging function of the image sensor.

[0237] In one embodiment, for the convenience of understanding the interface functions of the above recording and playing device, please refer to Figure 8 , which is an example schematic diagram of the integrated multi-interface functions of a recording and playing device provided by an embodiment of the present application.

[0238] As Figure 8 shown, the basic hardware functions of the recording and playing device include video input, video output, audio input and output, local storage, button power on / off, system reset, gigabit network, USB interface, microcontroller unit (MCU) control function, RS422 serial port control function, and multi-camera acquisition function.

[0239] The recording and playing device supports the input of one HDMI ultra-high-definition video signal, where one HDMI supports an embedded audio stream, and one IP network camera (IPNC) video input internal network interface with Power over Ethernet (POE). The video output function supports one HDMI ultra-high-definition video output and one USB2.0 interface, and can realize the output function of a Universal Extended Camera (UXC). The audio input supports one wired microphone, one linear audio mixing, and supports array microphone pickup; the audio output supports two linear audio lines. The recording and playing device has a central control function and supports a three-party central control interface RS422 / RS232. The USB interface supports file export and expansion functions, and the reset button can be used to restore the factory settings. After the recording and playing device performs functions such as encoding and decoding of audio and video data, image analysis, and synthesis, it realizes the function of pushing live video streams to the external network through one LAN port, and at the same time records the audio and video data in a local embedded multimedia card (eMMC) or other storage media.

[0240] The recording and playing device supports video input function. The HDMI input interface supports a maximum input resolution of 3840×2160@30Hz, and HDMI IN supports audio input. The video output function includes one HDM I OUT 1.4, and the output interface supports a maximum output resolution of 3840×2160@30Hz and supports the output of embedded audio stream. In addition, one UXC output uses a USB3.0 interface for docking with third-party conferencing software. The audio input and output functions include supporting one linear stereo audio input, one microphone input, two linear stereo audio outputs, and microphone pickup for 8-array, 10-array, or 16-array microphones. The built-in audio processing subsystem supports audio processing such as Active Noise Cancellation (ANC) and Acoustic Echo Cancellation (AEC). The local storage function is realized by storing the encoded audio and video data in an embedded multimedia card (eMMC) or other storage media. The recording and playing device supports power-on and power-off by keys, is equipped with red and blue status indicators, showing a red light in the power-off state and a blue light in the power-on state. The system reset function is realized by a single reset button for restoring the system default settings.

[0241] The recording and playing device supports gigabit network function, including one gigabit network LAN port and one gigabit network interface supporting Power over Ethernet (POE) function for internal network connection. The USB interface function includes one USB3.0 and two USB2.0 interfaces, and the USB3.0 interface realizes file copying and direct recording functions. The micro control unit (MCU) control function is used for system power-on / off and soft power-off power supply control. The RS422 serial port control function is used for the central control device to control the recording and playing host. RS422 is a serial communication standard supporting full-duplex communication; RS232 is also a serial communication standard commonly used for communication between the central control device and the recording and playing host. The multi-camera acquisition function is realized by the combination of an image sensor and a lens, including the combination of an image sensor and a fixed-focus lens or a zoom lens.

[0242] In this embodiment, based on the above functions, the recording and playing device can efficiently complete the acquisition, processing, storage, and transmission of audio and video data, meeting the requirements of various application scenarios.

[0243] In one embodiment, for the convenience of understanding the layout of the above recording and playing device in the classroom scenario, please refer to Figure 9 and Figure 10 .

[0244] As Figure 9 shown, it is a layout schematic diagram of a recording and playing device provided by an embodiment of the present application in the classroom scenario. Among them, the recording and playing device is bridged to the external camera unit 1, external camera unit 2, external camera unit 3, and external camera unit 4 respectively through a bridging unit.

[0245] The external camera units 1, 2, 3, and 4 can be flexibly arranged at multiple positions in the classroom scenario to achieve shooting of shooting objects such as teachers, students, and blackboards in the classroom scenario.

[0246] As Figure 10 shown, it is a layout schematic diagram of a live recording device and a binocular camera device in a classroom scenario provided by an embodiment of the present application. Among them, the live recording device is respectively bridged to the external camera units 1, 2, 3, and 4 through a bridging unit, and is communicatively connected to the binocular camera device.

[0247] The external camera units 1, 2, 3, and 4 can be arranged at multiple positions in the classroom scenario to achieve shooting of shooting objects such as teachers, students, and blackboards in the classroom scenario.

[0248] The binocular camera device includes an image sensor 1 and an image sensor 2, and the image sensor 1 and the image sensor 2 can be arranged at multiple positions in the classroom scenario. It can be understood that the binocular camera device can be used as a supplement to the above external camera units to provide more comprehensive shooting images in the classroom scenario for the live recording device.

[0249] In this embodiment, the live recording device is bridged to multiple external camera units through a bridging unit, or on this basis, is connected to the binocular camera device, realizing multi-angle and all-round shooting coverage in the classroom scenario. Among them, the external camera units are flexibly arranged and can accurately capture key teaching elements such as teachers, students, and blackboards, ensuring the complete recording of teaching content. The binocular camera device further enhances the three-dimensional sense and detail expression of shooting through the collaborative work of the two image sensors, providing richer image data for the live recording device.

[0250] The above Figure 5 - Figure 10 The live recording device in the embodiment shown is configured to execute the screen acquisition method in the following embodiment.

[0251] Please refer to Figure 11 , which is a schematic flowchart of a screen acquisition method provided by an embodiment of the present application. As Figure 11 shown, the method in the embodiment of the present application is applied to a live recording device in a live recording system. The live recording system further includes multiple external camera units. The live recording device includes a main control unit and a bridging unit. The main control unit is respectively bridged to each external camera unit among the multiple external camera units through the bridging unit. The method in this embodiment may include the following steps S2101-S2102.

[0252] S2101. The bridging unit obtains the first captured images corresponding to the external camera units based on a serial data processing method. The first captured images corresponding to the external camera units are obtained by the external camera units capturing a target scene.

[0253] Specifically, in some possible implementation manners, if the external camera unit supports the serial addition function, then the bridging unit may only support the deserialization function. Specifically, after the external camera unit captures a corresponding first captured image of the target scene, it can directly perform serial addition processing on the corresponding first captured image to obtain the serial addition data of the corresponding first captured image, and transmit the serial addition data of the corresponding first captured image to the bridging unit. The bridging unit only needs to perform deserialization processing on the serial addition data of the first captured image corresponding to the external camera unit to obtain the first captured image corresponding to the external camera unit.

[0254] In some possible implementation manners, if the external camera unit does not support the serial addition function, then the bridging unit may support both the serial addition function and the deserialization function. Specifically, after the external camera unit captures a corresponding first captured image of the target scene, it transmits the corresponding first captured image to the bridging unit. The bridging unit includes a cable of a certain length. The bridging unit first performs serial addition processing on the first captured image corresponding to the external camera unit to obtain the serial addition data of the first captured image corresponding to the external camera unit. Then, the serial addition data of the first captured image corresponding to the external camera unit is transmitted a certain distance in the cable of the bridging unit, specifically from the side of the cable of the bridging unit close to the external camera unit to the side close to the main control unit. Further, the bridging unit performs deserialization processing on the serial addition data of the first captured image corresponding to the external camera unit to obtain the first captured image corresponding to the external camera unit.

[0255] S2102. The bridging unit transmits the first captured images corresponding to the external camera units to the main control unit. The first captured images corresponding to the external camera units are used to provide the main control unit to execute a preset multi-image processing task to obtain a target image of the target scene.

[0256] Specifically, after the bridging unit obtains the first captured images corresponding to the external camera units, it transmits the first captured images corresponding to the external camera units to the main control unit. Correspondingly, the main control unit obtains the first captured images corresponding to the external camera units transmitted by the bridging unit.

[0257] Regarding the process of the main control unit obtaining the first captured images corresponding to the external camera units transmitted by the bridging unit, in some possible implementation manners, if the deserialization bridging part of the bridging unit is built into the main control unit, then the main control unit performs data interaction with the deserialization bridging part through an internal bus or interface to obtain the first captured images corresponding to the external camera units transmitted by the bridging unit.

[0258] In some possible implementations, if the deserialization bridging part of the bridging unit is external to the main control unit, the main control unit performs data interaction with the deserialization bridging part through an external interface to obtain the first captured images corresponding to the external camera units transmitted by the bridging unit.

[0259] In the above two implementations, the main control unit can efficiently obtain the first captured images corresponding to the external camera units by performing data interaction with the deserialization bridging part of the bridging unit through an internal bus or interface, or by performing data interaction with the deserialization bridging part of the bridging unit through an external interface.

[0260] Furthermore, the preset multi-screen processing task refers to the main control unit performing multi-screen synthesis, multi-screen switching, or other operations involving multi-screen processing based on the first captured images corresponding to the external camera units, with the aim of generating the target image of the target scene.

[0261] The first captured images corresponding to the external camera units are used to provide the main control unit to perform the preset multi-screen processing task to obtain the target image of the target scene. Regarding the process of the main control unit performing the preset multi-screen processing task to obtain the target image of the target scene, in some possible implementations, the main control unit determines at least two captured images to be fused in the first captured images corresponding to the external camera units; the main control unit performs fusion processing on the at least two captured images to be fused to obtain the target image of the target scene, and each of the captured images to be fused in the at least two captured images to be fused is fused and displayed in the target image.

[0262] In some possible implementations, the main control unit determines at least two captured images to be switched in the first captured images corresponding to the external camera units; the main control unit performs switching processing on the at least two captured images to be switched to obtain the target image of the target scene, and each of the captured images to be switched in the at least two captured images to be switched is switched and displayed in the target image.

[0263] It can be understood that by introducing the bridging unit, the recording and playback device effectively solves the problem of high latency in obtaining captured images in the related art. The bridging unit obtains the captured images of the external camera units based on the serial data processing method. The serial data processing is implemented at the physical layer, and it directly completes the encapsulation and transmission of the captured images in the form of a continuous bit stream without going through the complex encapsulation and de-encapsulation processing of the network layer and above, reducing the latency of the recording and playback device in obtaining captured images.

[0264] It can be understood that by introducing a bridging unit, the recording and playing device effectively solves the problem of limited physical position of the image sensor built in the recording and playing device in the related art, realizing the extension of the shooting distance and the full coverage of complex scenarios. In the related art, the image sensor built in the recording and playing device is directly connected to the main control unit. The direct connection method has a fast data transmission speed but is limited by signal attenuation. The extension distance of the image sensor is short and it is difficult to meet the long-distance shooting requirements. For example, in a classroom scenario, the main body of the recording and playing device is usually set near the blackboard, and the direct connection method cannot cover the student seat area far from the blackboard or the dynamic area at the back of the classroom. The bridging unit supports obtaining the captured images based on the serial data processing method. The serial data processing method can support a longer transmission distance through data conversion at the physical layer. This long-distance data transmission ability enables the external camera unit to be deployed at the back of the classroom far from the blackboard, thereby breaking through the physical position limitation of the recording and playing device and transmitting the captured image to the recording and playing device through the bridging unit to ensure that the recording and playing device can capture the panoramic image of the classroom.

[0265] In this embodiment, a bridging unit is introduced into the recording and playing device. The bridging unit is used to obtain the first captured images corresponding to the external camera units based on the serial data processing method, and transmit the first captured images corresponding to the external camera units to the main control unit. The first captured images corresponding to the external camera units are used to provide the main control unit to execute a preset multi-image processing task to obtain the target image of the target scene. Among them, the bridging unit obtains the captured images of the external camera units based on the serial data processing method, thereby simplifying the data transmission process, reducing the time delay of the recording and playing device for obtaining the captured images, and effectively improving the multi-image processing effect of the recording and playing device. At the same time, long-distance data transmission is realized based on the serial data processing method, significantly improving the scene coverage ability of the recording and playing device and effectively improving the multi-image processing effect of the recording and playing device.

[0266] In one embodiment, the bridging unit includes a deserialization bridging unit. The method of this application embodiment may include the following steps S2201-S2203. Steps S2201-S2202 may be used as the refinement steps of Figure 11 the steps S2101 shown in the illustrated embodiment, and step S2203 may be used as the refinement step of Figure 11 the steps S2102 shown in the illustrated embodiment.

[0267] S2201, the deserialization bridging unit receives the first captured image plus serial data corresponding to each external camera unit. The first captured image plus serial data corresponding to each external camera unit is obtained by each external camera unit shooting the target scene and adding a serial.

[0268] S2202, the deserialization bridging unit performs deserialization processing on the first captured image plus serial data corresponding to each external camera unit to obtain the first captured image corresponding to each external camera unit;

[0269] In S2203, the deserialization bridging unit transmits the first captured images corresponding to each external camera unit to the main control unit.

[0270] Specifically, the external camera units involved in this embodiment have the function of serial addition, so the bridging unit may only include a deserialization bridging unit.

[0271] The deserialization bridging unit refers to a unit for deserializing the serial addition data of the first captured images corresponding to the external camera units. Its function is to restore the serial addition data of the first captured images corresponding to the external camera units to the original captured images. Exemplarily, the deserialization bridging unit may be implemented based on relevant chips, deserializers, or combinations thereof, and supports deserialization processing of multiple serial addition formats. For example, assuming that the serial addition data of the captured images corresponding to the external camera unit is in the MIPI A-PHY format, then the deserialization bridging unit deserializes it to obtain the captured images corresponding to the external camera unit, and the captured images corresponding to the external camera unit are in the MIPI D-PHY format.

[0272] The deserialization bridging unit receives the serial addition data of the first captured images corresponding to each external camera unit, which means that the deserialization bridging unit establishes an independent communication channel with each external camera unit through a cable to achieve the transmission of the serial addition data of the first captured images. Specifically, after each external camera unit captures the target scene to obtain the corresponding first captured images, each external camera unit performs serial addition processing on the corresponding first captured images to obtain the corresponding serial addition data of the first captured images, and transmits the corresponding serial addition data of the first captured images to the deserialization bridging unit through a cable.

[0273] The deserialization bridging unit performs deserialization processing on the serial addition data of the first captured images corresponding to each external camera unit, which means that the deserialization bridging unit calls the corresponding deserialization algorithm or hardware module according to the serial addition format of the serial addition data of the first captured images corresponding to each external camera unit, and performs deserialization restoration on the serial addition data of the first captured images corresponding to each external camera unit to obtain the first captured images corresponding to each external camera unit. Subsequently, the deserialization bridging unit transmits the first captured images corresponding to each external camera unit to the main control unit.

[0274] Among them, the deserialization bridging unit is built into the main control unit; or, the deserialization bridging unit is external to the main control unit and is communicatively connected to the main control unit.

[0275] In this embodiment, the external camera unit has the function of adding a string, which can perform string addition processing on the first captured image obtained by shooting, generate the first captured image string addition data, and transmit the first captured image string addition data to the de-stringing bridging unit through a cable. This implementation method can effectively reduce the data transmission delay and improve the multi-screen processing efficiency of the recording and broadcasting device. At the same time, the efficient de-stringing processing of the de-stringing bridging unit can quickly restore the first captured images corresponding to each external camera unit, providing data support for subsequent multi-screen processing tasks.

[0276] In one embodiment, the bridging unit includes a string addition bridging unit and a de-stringing bridging unit. The method of the embodiment of the present application may include the following steps S2301 - S2305. Steps S2301 - S2304 can be used as refinement steps for Figure 11 the steps S2101 shown in the embodiment, and step S2305 can be used as a refinement step for Figure 11 the steps S2102 shown in the embodiment.

[0277] S2301, the string addition bridging unit receives the first captured images corresponding to each external camera unit, and performs string addition processing on the first captured images corresponding to each external camera unit to obtain the first captured image string addition data corresponding to each external camera unit;

[0278] S2302, the string addition bridging unit sends the first captured image string addition data corresponding to each external camera unit to the de-stringing bridging unit;

[0279] S2303, the de-stringing bridging unit receives the first captured image string addition data corresponding to each external camera unit;

[0280] S2304, the de-stringing bridging unit performs de-stringing processing on the first captured image string addition data corresponding to each external camera unit to obtain the first captured images corresponding to each external camera unit;

[0281] S2305, the de-stringing bridging unit transmits the first captured images corresponding to each external camera unit to the main control unit.

[0282] Specifically, the external camera unit involved in this embodiment does not have the function of adding a string. Therefore, the bridging unit needs to include a string addition bridging unit and a de-stringing bridging unit.

[0283] The string addition bridging unit refers to a unit used to perform string addition processing on the first captured images corresponding to each external camera unit, and its function is to add the strings of the first captured images corresponding to each external camera unit into the corresponding first captured image string addition data.

[0284] The addition and concatenation bridging unit receives the first captured images corresponding to each external camera unit, which means that the addition and concatenation bridging unit establishes an independent communication channel with each external camera unit through a cable to achieve the transmission of the first captured images. Specifically, after each external camera unit captures the target scene, it obtains the corresponding first captured image and transmits the corresponding first captured image to the addition and concatenation bridging unit through a cable. The addition and concatenation processing of the first captured images corresponding to each external camera unit by the addition and concatenation bridging unit means that the addition and concatenation bridging unit calls the corresponding addition and concatenation algorithm or hardware module according to the preset addition and concatenation format to perform addition and concatenation processing on the first captured images corresponding to each external camera unit, generating the addition and concatenation data of the first captured images corresponding to each external camera unit.

[0285] Further, the addition and concatenation bridging unit sends the addition and concatenation data of the first captured images corresponding to each external camera unit to the de-concatenation bridging unit through a cable, and the de-concatenation bridging unit receives the addition and concatenation data of the first captured images corresponding to each external camera unit through a cable. The above cable is the cable between the addition and concatenation bridging unit and the de-concatenation bridging unit.

[0286] The de-concatenation processing of the addition and concatenation data of the first captured images corresponding to each external camera unit by the de-concatenation bridging unit means that the de-concatenation bridging unit calls the corresponding de-concatenation algorithm or hardware module according to the addition and concatenation format of the addition and concatenation data of the first captured images corresponding to each external camera unit to perform de-concatenation restoration on the addition and concatenation data of the first captured images corresponding to each external camera unit, obtaining the first captured images corresponding to each external camera unit. Subsequently, the de-concatenation bridging unit transmits the first captured images corresponding to each external camera unit to the main control unit.

[0287] Among them, the addition and concatenation bridging unit and the de-concatenation bridging unit are built into the main control unit; or, the addition and concatenation bridging unit and the de-concatenation bridging unit are external to the main control unit and communicatively connected to the main control unit.

[0288] In this embodiment, although the external camera unit does not have the addition and concatenation function, the addition and concatenation bridging unit and the de-concatenation bridging unit in the bridging unit can cooperate to achieve the addition and de-concatenation of the captured images, so that the first captured images corresponding to each external camera unit can be quickly transmitted to the main control unit subsequently. This implementation method can effectively reduce the data transmission delay and improve the multi-screen processing efficiency of the recording and broadcasting device. At the same time, it reduces the functional requirements for the external camera unit, enabling the recording and broadcasting device to be compatible with external camera units without the addition and concatenation function, improving the compatibility of the recording and broadcasting device.

[0289] In one embodiment, the method of this application embodiment may include the following steps S2401 - S2404, and steps S2401 - S2404 may be executed Figure 11 before the steps S2101 shown in the embodiment.

[0290] S2401. The bridging unit obtains the second captured images corresponding to each external camera unit based on the serial data processing method, and transmits the second captured images corresponding to each external camera unit to the main control unit;

[0291] S2402. The main control unit obtains the second captured images corresponding to each external camera unit transmitted by the bridging unit;

[0292] S2403. The main control unit determines the shooting objects corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit;

[0293] S2404. The main control unit performs motion control on each external camera unit according to the shooting objects corresponding to each external camera unit, so that each external camera unit shoots the corresponding shooting object to obtain the corresponding first captured image.

[0294] Specifically, the first captured images and the second captured images corresponding to each external camera unit involved in this embodiment are both one of the captured images corresponding to each external camera unit. Therefore, for the implementation process of steps S2401 - S2402, please refer to Figure 11 the relevant explanations of steps S2101 - S2102 in the illustrated embodiment, which will not be elaborated here.

[0295] Furthermore, the main control unit determines the shooting objects corresponding to each external camera unit in the target scene based on the second captured images corresponding to each external camera unit. Among them, the shooting object refers to a dynamic element or a static element in the target scene, such as teachers, students, blackboards, etc. in a classroom scene. The main control unit analyzes the second captured images corresponding to each external camera unit through an image recognition algorithm, an audio recognition algorithm, or a combination of both to determine the shooting objects corresponding to each external camera unit.

[0296] Furthermore, the main control unit performs motion control on each external camera unit according to the shooting objects corresponding to each external camera unit. Specifically, the main control unit can generate the control parameters of the motion control unit corresponding to each external camera unit according to the shooting objects corresponding to each external camera unit; then, the main control unit controls the motion control unit corresponding to each external camera unit to drive each external camera unit towards the corresponding shooting object according to the control parameters of the motion control unit corresponding to each external camera unit, so that each external camera unit shoots the corresponding shooting object to obtain the corresponding first captured image.

[0297] In this embodiment, the bridging unit obtains the second captured images corresponding to each external camera unit based on the serial data processing method, transmits the second captured images corresponding to each external camera unit to the main control unit, and the main control unit obtains the second captured images corresponding to each external camera unit transmitted by the bridging unit, realizing the preliminary acquisition of the captured images of each external camera unit; based on the second captured images corresponding to each external camera unit, the main control unit determines the captured objects corresponding to each external camera unit in the target scene, can accurately identify dynamic or static elements in the target scene, and provides a basis for subsequent shooting control; the main control unit performs motion control on each external camera unit according to the captured objects corresponding to each external camera unit, by generating control parameters for the motion control units corresponding to each external camera unit, and controlling the motion control units corresponding to each external camera unit to drive each external camera unit towards the corresponding captured object, ensuring that each external camera unit can capture key elements in the target scene, so as to obtain a high-quality first captured image, enhancing the accuracy of the first captured image acquisition.

[0298] In one embodiment, the recording and broadcasting system further includes a microphone array. Further refining step S2403 of the above embodiment may include the following steps:

[0299] The main control unit obtains the target audio signal in the target scene collected by the microphone array;

[0300] Based on the second captured images corresponding to each external camera unit and the target audio signal in the target scene collected by the microphone array, the main control unit determines the target speaker corresponding to each external camera unit in the target scene;

[0301] The main control unit determines the target speaker corresponding to each external camera unit as the captured object corresponding to each external camera unit.

[0302] Specifically, the main control unit obtains the target audio signal in the target scene collected by the microphone array. The microphone array is composed of multiple microphones and can collect and locate the audio signal in the target scene through spatial positioning technology; the target audio signal refers to the audio signal containing the voice of the target speaker collected by the microphone array in the target scene. The main control unit establishes a communication connection with the microphone array through a relevant audio interface to receive the target audio signal in the target scene collected by the microphone array. In some possible implementation manners, after receiving the target audio signal collected by the microphone array, the main control unit may also perform preprocessing on it, such as noise reduction, enhancement, etc., to improve the quality and clarity of the audio signal.

[0303] Based on the second captured images corresponding to each external camera unit and the target audio signals in the target scene collected by the microphone array, the main control unit determines the target speakers corresponding to each external camera unit in the target scene, where the target speaker refers to the person speaking in the target scene. Specifically, the main control unit first performs image analysis on the second captured images corresponding to each external camera unit to identify the people and their positions in the target scene; then performs audio analysis on the target audio signals in the target scene collected by the microphone array to identify the speakers and their positions in the target scene; finally, determines the target speakers corresponding to each external camera unit through the matching of images and audio.

[0304] The main control unit determines the target speakers corresponding to each external camera unit as the shooting objects corresponding to each external camera unit. Among them, the shooting objects corresponding to each external camera unit can be stored in the recording and broadcasting device in the form of shooting object information, and the main control unit can perform precise control on each external camera unit according to the stored shooting object information during the subsequent motion control process to ensure that each external camera unit can accurately shoot the corresponding target speaker.

[0305] Further, based on the second captured images corresponding to each external camera unit and the target audio signals in the target scene collected by the microphone array, the main control unit determines the target speakers corresponding to each external camera unit in the target scene, which specifically includes the following steps: the main control unit performs image analysis on the second captured images corresponding to each external camera unit to identify the people and their positions in the target scene; the main control unit performs audio analysis on the target audio signals in the target scene collected by the microphone array to identify the speakers and their positions in the target scene; the main control unit determines the target speakers corresponding to each external camera unit through the matching of images and audio.

[0306] In this embodiment, the main control unit first obtains the target audio signals in the target scene collected by the microphone array, then determines the target speakers corresponding to each external camera unit based on the second captured images corresponding to each external camera unit and the target audio signals collected by the microphone array; finally, the main control unit determines the target speakers corresponding to each external camera unit as the shooting objects corresponding to each external camera unit. Through the above steps, this solution realizes the automatic identification and tracking of the target speaker, and improves the intelligent level and shooting effect of the recording and broadcasting system.

[0307] In one embodiment, further refining step S2403 of the above embodiment may include the following steps:

[0308] The main control unit constructs a semantic map of the target scene based on the second captured images corresponding to each external camera unit;

[0309] The main control unit determines the shooting areas corresponding to each external camera unit in the target scene based on the semantic map;

[0310] The main control unit determines the shooting areas corresponding to each external camera unit as the shooting objects corresponding to each external camera unit.

[0311] Specifically, the main control unit constructs a semantic map of the target scene based on the second shooting images corresponding to each external camera unit. Here, the semantic map refers to a map that semantically describes at least one of the people, objects, and their spatial relationships in the target scene. The main control unit performs image analysis on the second shooting images corresponding to each external camera unit, identifies at least one of the people and objects in the target scene, and combines the geometric structure and spatial layout of the scene to generate a semantic map of the target scene. The semantic map can include the following two situations: one is a semantic map containing people and objects, that is, the main control unit identifies the distribution and mutual relationship of people and objects; the other is a semantic map containing only objects, that is, the main control unit identifies the distribution and spatial layout of objects.

[0312] The main control unit determines the shooting areas corresponding to each external camera unit in the target scene based on the semantic map. Here, the shooting area refers to the area in the target scene that needs to be focused on by each external camera unit. Specifically, when the semantic map contains people and objects, the main control unit first determines the people gathering area or the area with frequent activities in the target scene according to the people distribution information in the semantic map; then combines the object distribution information in the semantic map to determine the key objects or important areas in the target scene; finally, combines the positions, perspectives, and shooting capabilities of each external camera unit to allocate corresponding shooting areas for each external camera unit to ensure that the key areas in the target scene can be fully covered. When the semantic map contains only objects, the main control unit determines the key objects or important areas in the target scene according to the object distribution information in the semantic map, and combines the positions, perspectives, and shooting capabilities of each external camera unit to allocate corresponding shooting areas for each external camera unit.

[0313] Exemplarily, in a conference room scene, the main control unit can identify areas such as the podium, projector, and audience seats according to the semantic map, and allocate corresponding shooting areas for different external camera units. For example, one external camera unit is responsible for shooting the podium, and another external camera unit is responsible for shooting the audience seats.

[0314] Exemplarily, in a classroom scenario, the master control unit can identify areas such as the podium, blackboard, student seating area, and multimedia devices based on the semantic map, and allocate corresponding shooting areas to different external camera units. Specifically, one external camera unit can be responsible for shooting the podium and blackboard areas to ensure that the teaching activities of the teacher and the content of the blackboard writing can be clearly captured; another external camera unit can be responsible for shooting the student seating area to record the students' classroom participation and interaction performance; in addition, if there are multimedia devices in the classroom, such as projectors or electronic whiteboards, the master control unit can also allocate an external camera unit to specifically shoot the display content of the multimedia device.

[0315] The master control unit determines the shooting areas corresponding to each external camera unit as the shooting objects corresponding to each external camera unit. Among them, the shooting objects corresponding to each external camera unit can be stored in the recording and broadcasting device in the form of shooting object information, and the shooting object information includes parameters such as the position, range, and priority of the shooting area. During subsequent motion control, the master control unit can precisely control each external camera unit according to the stored shooting object information to ensure that each external camera unit can accurately shoot the corresponding shooting area.

[0316] In this embodiment, the master control unit first constructs a semantic map of the target scene based on the second shooting images corresponding to each external camera unit; then, based on the semantic map, determines the shooting areas corresponding to each external camera unit in the target scene; finally, the master control unit determines the shooting areas corresponding to each external camera unit as the shooting objects corresponding to each external camera unit. Through the above steps, the intelligent division and allocation of shooting areas in the target scene are realized, improving the shooting coverage rate and shooting effect, and at the same time meeting the multi-screen processing requirements of the recording and broadcasting device in complex scenarios.

[0317] In one embodiment, the recording and broadcasting system further includes a microphone array, and the multiple external camera units are composed of at least one speaker camera unit and at least one area camera unit. Further refining the steps of the above embodiment S2403 may include the following steps:

[0318] The master control unit acquires the target audio signal in the target scene collected by the microphone array;

[0319] Based on the second shooting images corresponding to each speaker camera unit in at least one speaker camera unit, the second shooting images corresponding to each area camera unit in at least one area camera unit, and the target audio signal in the target scene collected by the microphone array, the master control unit determines the target speakers corresponding to each speaker camera unit in the target scene;

[0320] The master control unit determines the target speakers corresponding to each speaker camera unit as the shooting objects corresponding to each speaker camera unit;

[0321] The main control unit constructs a semantic map of the target scene based on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit;

[0322] The main control unit determines the shooting areas corresponding to each area camera unit in the target scene based on the semantic map;

[0323] The main control unit determines the shooting areas corresponding to each area camera unit as the shooting objects corresponding to each area camera unit.

[0324] Specifically, regarding the main control unit obtaining the target audio signal in the target scene collected by the microphone array, relevant explanations have been given in the above embodiments and will not be elaborated here.

[0325] Furthermore, the main control unit determines the target speakers corresponding to each speaker camera unit in the target scene based on the second captured images corresponding to each speaker camera unit in at least one speaker camera unit, the second captured images corresponding to each area camera unit in at least one area camera unit, and the target audio signal in the target scene collected by the microphone array. Here, the target speaker refers to the person speaking in the target scene. Specifically, the main control unit first performs image analysis on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit to identify the people and their positions in the target scene; then performs audio analysis on the target audio signal collected by the microphone array to identify the speakers and their positions in the target scene; finally, determines the target speakers corresponding to each speaker camera unit through the matching of images and audio.

[0326] The main control unit determines the target speakers corresponding to each speaker camera unit as the shooting objects corresponding to each speaker camera unit. Among them, the shooting objects corresponding to each speaker camera unit are stored in the recording and broadcasting device in the form of shooting object information. The main control unit controls each speaker camera unit according to the stored shooting object information during the subsequent motion control process to ensure that each speaker camera unit can accurately capture the corresponding target speaker.

[0327] The main control unit constructs a semantic map of the target scene based on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit. Here, the semantic map refers to a map that semantically describes at least one of the people, objects, and their spatial relationships in the target scene. The main control unit performs image analysis on the second captured images corresponding to each speaker camera unit and the second captured images corresponding to each area camera unit to identify at least one of the people and objects in the target scene, and combines the geometric structure and spatial layout of the scene to generate the semantic map of the target scene.

[0328] Based on the semantic map, the main control unit determines the shooting areas corresponding to the camera units in each area in the target scenario. Herein, the shooting area refers to the area in the target scenario that needs to be focused on by the camera units in each area. Specifically, the main control unit determines the areas where people gather, the areas with frequent activities, or the areas of key objects in the target scenario according to the people distribution information and object distribution information in the semantic map, and combines the positions, perspectives, and shooting capabilities of the camera units in each area to allocate corresponding shooting areas to the camera units in each area, so as to ensure that the key areas in the target scenario can be comprehensively covered.

[0329] The main control unit determines the shooting areas corresponding to the camera units in each area as the shooting objects corresponding to the camera units in each area. Among them, the shooting objects corresponding to the camera units in each area are stored in the recording and broadcasting device in the form of shooting object information, and the shooting object information includes parameters such as the position, range, and priority of the shooting area. During the subsequent motion control process, the main control unit controls the camera units in each area according to the stored shooting object information to ensure that the camera units in each area can accurately shoot the corresponding shooting areas.

[0330] Furthermore, the main control unit constructs the semantic map of the target scenario based on the second shooting images corresponding to the speaker camera units and the second shooting images corresponding to the camera units in each area, which specifically includes the following steps: The main control unit performs image analysis on the second shooting images corresponding to the speaker camera units and the second shooting images corresponding to the camera units in each area, and identifies at least one of the people and objects in the target scenario; The main control unit generates the semantic map of the target scenario in combination with the geometric structure and spatial layout of the scenario.

[0331] Furthermore, the main control unit determines the shooting areas corresponding to the camera units in each area in the target scenario based on the semantic map, which specifically includes the following steps: The main control unit determines the areas where people gather or the areas with frequent activities in the target scenario according to the people distribution information in the semantic map; The main control unit determines the key objects or important areas in the target scenario according to the object distribution information in the semantic map; The main control unit combines the positions, perspectives, and shooting capabilities of the camera units in each area to allocate corresponding shooting areas to the camera units in each area.

[0332] Exemplarily, in a conference room scenario, the main control unit can identify areas such as the podium, projector, and audience seats according to the semantic map, and allocate corresponding shooting objects to different camera units. Specifically, the main control unit can determine the podium area as the area where the target speaker is located, and allocate the podium area as the shooting object corresponding to the speaker camera unit to ensure that the speaker camera unit can accurately capture the speaker's speech images; At the same time, the main control unit can allocate the audience seat area and the projector area as the shooting areas corresponding to the camera units in each area to ensure that the camera units in each area can comprehensively cover the audience's reactions and the display of the projection content.

[0333] Exemplarily, in a classroom scenario, the master control unit can identify areas such as the podium, blackboard, student seating area, and multimedia devices based on the semantic map, and assign corresponding shooting objects to different camera units. Specifically, the master control unit can determine the podium area as the area where the target speaker is located, and assign the podium area as the shooting object corresponding to the speaker camera unit to ensure that the speaker camera unit can accurately capture the teaching activities and speaking images of the teacher; at the same time, the master control unit can assign the blackboard area, student seating area, and multimedia device area as the shooting areas corresponding to the area camera units to ensure that the area camera units can respectively record the blackboard writing content, students' classroom participation, and the display content of the multimedia devices.

[0334] In this embodiment, the master control unit first obtains the target audio signal in the target scene collected by the microphone array, and then determines the target speaker corresponding to each speaker camera unit based on the second shooting images corresponding to each speaker camera unit, the second shooting images corresponding to each area camera unit, and the target audio signal collected by the microphone array; then, the master control unit determines the target speaker corresponding to each speaker camera unit as the shooting object corresponding to each speaker camera unit; subsequently, the master control unit constructs a semantic map of the target scene based on the second shooting images corresponding to each speaker camera unit and the second shooting images corresponding to each area camera unit; then, the master control unit determines the shooting areas corresponding to each area camera unit in the target scene based on the semantic map; finally, the master control unit determines the shooting areas corresponding to each area camera unit as the shooting objects corresponding to each area camera unit. Through the above steps, the automatic identification and tracking of the target speaker, as well as the intelligent division and allocation of the shooting areas in the target scene, are realized, improving the intelligent level and shooting effect of the recording and broadcasting system, and at the same time meeting the multi-screen processing requirements of the recording and broadcasting equipment in complex scenarios.

[0335] In one embodiment, the recording and broadcasting system further includes a plurality of motion control units, and any one of the plurality of external camera units is movably connected to the corresponding motion control unit among the plurality of motion control units. Further refining the step S2404 of the above embodiment may include the following steps:

[0336] The master control unit generates control parameters for the motion control units corresponding to each external camera unit according to the shooting objects corresponding to each external camera unit;

[0337] The master control unit controls the motion control units corresponding to each external camera unit to drive each external camera unit towards the corresponding shooting object according to the control parameters of the motion control units corresponding to each external camera unit, so that each external camera unit shoots the corresponding shooting object to obtain the corresponding first shooting image.

[0338] Specifically, the main control unit generates control parameters for the motion control units corresponding to each external camera unit according to the shooting objects corresponding to the external camera units. Here, the control parameters refer to the specific instructions or data used to control the motion control unit to drive the external camera unit to move. For example, parameters such as the target position, target angle, movement speed, and movement trajectory of the external camera unit. The main control unit generates control parameters for the motion control units corresponding to each external camera unit by analyzing information such as the position, range, and priority of the shooting objects corresponding to each external camera unit, and combining parameters such as the current position and viewing angle of each external camera unit, so as to ensure that each external camera unit can accurately face the corresponding shooting object for shooting.

[0339] The main control unit controls the motion control units corresponding to each external camera unit to drive each external camera unit to face the corresponding shooting object according to the control parameters of the motion control units corresponding to each external camera unit, so that each external camera unit shoots the corresponding shooting object to obtain a corresponding first shooting image. Specifically, the main control unit establishes a connection with the motion control units corresponding to each external camera unit through a communication interface, and sends the generated control parameters to the corresponding motion control units; the motion control unit drives the external camera unit to move according to the received control parameters, such as translation, rotation, pitching, etc., so that the lens of the external camera unit faces the corresponding shooting object; after the movement of the external camera unit is completed, it shoots the corresponding shooting object to obtain a corresponding first shooting image.

[0340] Exemplarily, in a classroom scenario, the shooting area corresponding to a certain area camera unit is the student seating area. The main control unit can generate control parameters for the motion control unit corresponding to this area camera unit according to the position information of the shooting area corresponding to this area camera unit, such as the target position, target angle, movement trajectory, etc.; the main control unit sends the control parameters to the motion control unit corresponding to this area camera unit, and the motion control unit corresponding to this area camera unit drives this area camera unit to face the student seating area according to the corresponding control parameters, so that the lens range of the area camera unit can be aligned with the student seating area; after the movement of this area camera unit is completed, it shoots the student seating area to obtain a corresponding first shooting image.

[0341] In this embodiment, the main control unit first generates control parameters for the motion control units corresponding to the external camera units according to the shooting objects corresponding to the external camera units; then, the main control unit controls the motion control units corresponding to the external camera units to drive the external camera units to face the corresponding shooting objects according to the control parameters of the motion control units corresponding to the external camera units, so that the external camera units capture the corresponding shooting objects to obtain the corresponding first shooting images. Through the above steps, the automatic motion control of the external camera units and the accurate capture of the shooting objects are realized, the intelligent level and shooting effect of the recording and broadcasting system are improved, and the multi-screen processing requirements of the recording and broadcasting equipment in complex scenarios are met at the same time.

[0342] In one embodiment, the method of the embodiment of the present application may include the following steps S2501 - S2503, and steps S2501 - S2503 may be executed Figure 11 after the steps of the embodiment shown in S2102.

[0343] S2501, the main control unit acquires the first shooting images corresponding to the external camera units transmitted by the bridging unit;

[0344] S2502, the main control unit determines at least two shooting images to be fused in the first shooting images corresponding to the external camera units;

[0345] S2503, the main control unit performs fusion processing on at least two shooting images to be fused to obtain a target image of the target scene, and each shooting image to be fused in the at least two shooting images to be fused is fused and displayed in the target image.

[0346] Specifically, after the bridging unit acquires the first shooting images corresponding to the external camera units, it transmits the first shooting images corresponding to the external camera units to the main control unit. Correspondingly, the main control unit acquires the first shooting images corresponding to the external camera units transmitted by the bridging unit.

[0347] Regarding the process of the main control unit acquiring the first shooting images corresponding to the external camera units transmitted by the bridging unit, in some possible implementation manners, if the deserialization bridging part of the bridging unit is built into the main control unit, then the main control unit performs data interaction with the deserialization bridging part through an internal bus or interface to acquire the first shooting images corresponding to the external camera units transmitted by the bridging unit.

[0348] In some possible implementation manners, if the deserialization bridging part of the bridging unit is external to the main control unit, then the main control unit performs data interaction with the deserialization bridging part through an external interface to acquire the first shooting images corresponding to the external camera units transmitted by the bridging unit.

[0349] In the above two implementation manners, the main control unit can efficiently obtain the first captured images corresponding to each external camera unit by performing data interaction with the deserialization bridging part of the bridging unit through an internal bus or interface, or by performing data interaction with the deserialization bridging part of the bridging unit through an external interface.

[0350] The main control unit determines at least two captured images to be fused in the first captured images corresponding to each external camera unit, where the captured images to be fused refer to the first captured images that need to be fused. The main control unit screens out at least two captured images to be fused from the first captured images corresponding to each external camera unit based on a pre-determined configuration or an operation instruction of an operator of the recording and broadcasting device.

[0351] The main control unit performs a fusion process on at least two captured images to be fused to obtain a target image of the target scene, where the target image refers to the final image generated after the fusion process and is used to comprehensively display the content of the target scene. The main control unit fuses at least two captured images to be fused through relevant image processing algorithms, so that each captured image to be fused is fused and displayed in the target image, thereby achieving multi-angle and multi-content coverage of the target scene.

[0352] In a possible implementation manner, the above fusion process can be inlaid fusion. Specifically, inlaid fusion refers to determining a main image and an embedded image in at least two captured images to be fused, and then embedding the embedded image into the main image to form a target image. The main control unit first determines the main image and the embedded image, where the main image is a relatively important image in the target scene, and the embedded image is a secondary but necessary image to be displayed in the target scene. The main control unit determines the position and size of the embedded image according to the layout requirements of the target image, and embeds the embedded image into the main image to form a target image.

[0353] In a possible implementation manner, the above fusion process can be stitching fusion. Specifically, stitching fusion refers to stitching at least two captured images to be fused together according to a certain rule to form a target image. The main control unit determines the stitching position and stitching method of each captured image to be fused according to the layout requirements of the target image, and stitches each captured image to be fused together to form a target image.

[0354] Exemplarily, please refer to Figure 3 , which is an example schematic diagram of multi-image fusion provided by an embodiment of the present application. Among them, at least two captured images to be fused include captured image 1 (blackboard), captured image 2 (close-up of teacher), and captured image 3 (close-up of student).

[0355] Assume that the shooting images 1, 2, and 3 are fused in an embedded manner. In the target image obtained by the embedded fusion, the shooting image 1 is the main image, while the shooting images 2 and 3 are the embedded images embedded in the main image.

[0356] Assume that the shooting images 1, 2, and 3 are fused in a splicing manner. In the target image obtained by the splicing fusion, the shooting images 1, 2, and 3 are distributed at different positions.

[0357] In this embodiment, the main control unit first determines at least two shooting images to be fused in the first shooting images corresponding to each external camera unit; then, the main control unit performs a fusion process on at least two shooting images to be fused to obtain a target image of the target scene. Through the above steps, a comprehensive coverage of multiple angles and multiple contents of the target scene is achieved, the picture display effect of the recording and broadcasting system is improved, and at the same time, the multi-picture processing requirements of the recording and broadcasting device in complex scenes are met.

[0358] In one embodiment, the method of the embodiment of the present application may include the following steps S2601 - S2603, and steps S2601 - S2603 may be Figure 11 executed after step S2102 shown in the embodiment.

[0359] S2501, the main control unit acquires the first shooting images corresponding to each external camera unit transmitted by the bridging unit;

[0360] S2602, the main control unit determines at least two shooting images to be switched in the first shooting images corresponding to each external camera unit;

[0361] S2603, the main control unit performs a switching process on at least two shooting images to be switched to obtain a target image of the target scene, and each shooting image to be switched in at least two shooting images to be switched is switched and displayed in the target image.

[0362] Specifically, after the bridging unit acquires the first shooting images corresponding to each external camera unit, it transmits the first shooting images corresponding to each external camera unit to the main control unit. Correspondingly, the main control unit acquires the first shooting images corresponding to each external camera unit transmitted by the bridging unit.

[0363] Regarding the process of the main control unit acquiring the first shooting images corresponding to each external camera unit transmitted by the bridging unit, in some possible implementation manners, if the deserialization and bridging part of the bridging unit is built into the main control unit, then the main control unit performs data interaction with the deserialization and bridging part through an internal bus or interface to acquire the first shooting images corresponding to each external camera unit transmitted by the bridging unit.

[0364] In some possible implementation manners, if the deserialization bridging part of the bridging unit is external to the main control unit, the main control unit performs data interaction with the deserialization bridging part through an external interface to obtain the first captured images corresponding to each external camera unit transmitted by the bridging unit.

[0365] In the above two implementation manners, the main control unit performs data interaction with the deserialization bridging part of the bridging unit through an internal bus or interface, or performs data interaction with the deserialization bridging part of the bridging unit through an external interface, both of which can efficiently obtain the first captured images corresponding to each external camera unit.

[0366] The main control unit determines at least two to-be-switched captured images from the first captured images corresponding to each external camera unit, where the to-be-switched captured image refers to a captured image that needs to be switched. The main control unit filters out at least two to-be-switched captured images from the first captured images corresponding to each external camera unit based on a pre-determined configuration or an operation instruction of an operator of the recording and broadcasting device.

[0367] The main control unit performs switching processing on at least two to-be-switched captured images to obtain a target image of the target scene, where the target image refers to the final image generated after the switching processing and is used to dynamically display the content of the target scene. The main control unit switches at least two to-be-switched captured images through relevant image processing algorithms, so that each to-be-switched captured image is switched and displayed in the target image, thereby realizing the multi-angle and multi-content dynamic display of the target scene.

[0368] In a possible implementation manner, the above switching processing manner may be full-screen switching. Specifically, full-screen switching means that a certain to-be-switched captured image among at least two to-be-switched captured images is displayed in the target image in a full-screen manner, and is switched to the next to-be-switched captured image according to a preset switching rule or trigger condition. The main control unit determines the switching order and switching time interval of each to-be-switched captured image according to the requirements of the target scene, and sequentially displays each to-be-switched captured image in the target image in a full-screen manner according to the determined order and time interval.

[0369] In a possible implementation manner, the above switching processing manner may be partial switching. Specifically, partial switching means that a certain to-be-switched captured image among at least two to-be-switched captured images is displayed in the target image in a partial manner, and is switched to the next to-be-switched captured image according to a preset switching rule or trigger condition. The main control unit determines the partial display position and display size of each to-be-switched captured image according to the layout requirements of the target image, and switches and displays the partial content of each to-be-switched captured image according to a preset switching rule or trigger condition.

[0370] Exemplarily, please refer to Figure 4 , which is an example schematic diagram of multi-screen switching provided by an embodiment of the present application. Among them, at least two shooting screens to be switched include shooting screen 1 (blackboard), shooting screen 2 (teacher close-up), and shooting screen 3 (student close-up).

[0371] Assume that shooting screen 1, shooting screen 2, and shooting screen 3 are switched in a full-screen switching manner. In the target screen obtained by full-screen switching, shooting screen 2 is fully displayed from time T0 to time T1, and shooting screen 3 is fully displayed from time T1 to time T2.

[0372] Assume that shooting screen 1, shooting screen 2, and shooting screen 3 are switched in a partial switching manner. Shooting screen 2 is partially displayed from time T0 to time T1 (shooting screen 2 is embedded in shooting screen 1), and shooting screen 3 is partially displayed from time T1 to time T2 (shooting screen 3 is embedded in shooting screen 1).

[0373] In this embodiment, the main control unit first determines at least two shooting screens to be switched in the first shooting screens corresponding to each external camera unit; then, the main control unit performs switching processing on at least two shooting screens to be switched to obtain the target screen of the target scene. Through the above steps, a dynamic display of multiple angles and multiple contents of the target scene is achieved, the screen display effect of the recording and broadcasting system is improved, and at the same time, the multi-screen processing requirements of the recording and broadcasting device in complex scenes are met.

[0374] This embodiment also provides a computer-readable storage medium, in which computer program code is stored. When the computer program code runs on a computer, it causes the computer to execute the above-related method steps to implement a screen acquisition method provided by the above embodiment.

[0375] Among them, the storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, RandomAccess Memory), magnetic disk or optical disk, etc.

[0376] Since the instructions stored in the storage medium can execute the steps in any screen acquisition method provided by the embodiments of the present application, the beneficial effects that can be achieved by any screen acquisition method provided by the embodiments of the present application can be realized. For details, please refer to the previous embodiments and will not be repeated here.

[0377] The above has introduced in detail the screen acquisition method, live recording device, and storage medium provided by the embodiments of the present application. Specific examples are used herein to elaborate on the principle and implementation manner of the present application. The above description of the embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation on the present application.

Claims

1. A method for obtaining a picture, characterized in that, A recording device applied to a recording and broadcasting system, the recording and broadcasting system further includes a plurality of external camera units, and the recording device is respectively bridged to each of the plurality of external camera units in a bridging manner; The method includes: Obtaining first captured images corresponding to each of the external camera units based on a serial data processing method, and the first captured images corresponding to each of the external camera units are obtained by each of the external camera units capturing a target scene; Invoking the first captured images corresponding to each of the external camera units and executing a preset multi-image processing task to obtain a target image of the target scene.

2. The method according to claim 1, wherein The obtaining the first captured images corresponding to each of the external camera units based on a serial data processing method includes: Receiving the first captured image plus serial data corresponding to each of the external camera units, and the first captured image plus serial data corresponding to each of the external camera units is obtained by each of the external camera units capturing the target scene and adding a serial; Performing deserialization processing on the first captured image plus serial data corresponding to each of the external camera units to obtain the first captured images corresponding to each of the external camera units.

3. The method according to claim 1, wherein The obtaining the first captured images corresponding to each of the external camera units based on a serial data processing method includes: Receiving the first captured images corresponding to each of the external camera units, and performing serialization processing on the first captured images corresponding to each of the external camera units to obtain the first captured image plus serial data corresponding to each of the external camera units; Performing deserialization processing on the first captured image plus serial data corresponding to each of the external camera units to obtain the first captured images corresponding to each of the external camera units.

4. The method according to claim 1, wherein Before obtaining the first captured images corresponding to each of the external camera units based on a serial data processing method, it further includes: Obtaining second captured images corresponding to each of the external camera units based on a serial data processing method; Based on the second captured images corresponding to each of the external camera units, determining the shooting objects corresponding to each of the external camera units in the target scene; Performing motion control on each of the external camera units according to the shooting objects corresponding to each of the external camera units, so that each of the external camera units captures the corresponding shooting object to obtain the corresponding first captured image.

5. The method according to claim 4, wherein The recording and broadcasting system further includes a microphone array; The determining the shooting objects corresponding to each of the external camera units in the target scene based on the second captured images corresponding to each of the external camera units includes: Obtaining a target audio signal in the target scene collected by the microphone array; Based on the second captured images corresponding to each of the external camera units and the target audio signal in the target scene collected by the microphone array, determining the target speakers corresponding to each of the external camera units in the target scene; Determining the target speakers corresponding to each of the external camera units as the shooting objects corresponding to each of the external camera units.

6. The method according to claim 4, wherein The determining the shooting objects corresponding to each of the external camera units in the target scene based on the second captured images corresponding to each of the external camera units includes: Constructing a semantic map of the target scene based on the second captured images corresponding to each of the external camera units; Based on the semantic map, determine the shooting areas corresponding to the external camera units in the target scene; Determine the shooting areas corresponding to the external camera units as the shooting objects corresponding to the external camera units.

7. The method according to claim 4, wherein The recording and broadcasting system further includes a microphone array, and the multiple external camera units are composed of at least one speaker camera unit and at least one area camera unit; The determining the shooting objects corresponding to the external camera units in the target scene based on the second shooting images corresponding to the external camera units includes: Obtain the target audio signal in the target scene collected by the microphone array; Based on the second shooting images corresponding to the speaker camera units in the at least one speaker camera unit, the second shooting images corresponding to the area camera units in the at least one area camera unit, and the target audio signal in the target scene collected by the microphone array, determine the target speakers corresponding to the speaker camera units in the target scene; Determine the target speakers corresponding to the speaker camera units as the shooting objects corresponding to the speaker camera units; Based on the second shooting images corresponding to the speaker camera units and the second shooting images corresponding to the area camera units, construct a semantic map of the target scene; Based on the semantic map, determine the shooting areas corresponding to the area camera units in the target scene; Determine the shooting areas corresponding to the area camera units as the shooting objects corresponding to the area camera units.

8. The method according to claim 4, characterized in that The recording and broadcasting system further includes a plurality of motion control units, and any one of the multiple external camera units is movably connected to the corresponding motion control unit in the plurality of motion control units; The performing motion control on the external camera units according to the shooting objects corresponding to the external camera units so that the external camera units shoot the corresponding shooting objects to obtain the corresponding first shooting images includes: Generate the control parameters of the motion control units corresponding to the external camera units according to the shooting objects corresponding to the external camera units; According to the control parameters of the motion control units corresponding to the external camera units, control the motion control units corresponding to the external camera units to drive the external camera units to face the corresponding shooting objects, so that the external camera units shoot the corresponding shooting objects to obtain the corresponding first shooting images.

9. The method according to claim 1, wherein The invoking the first shooting images corresponding to the external camera units and executing a preset multi-image processing task to obtain the target image of the target scene includes: Determine at least two shooting images to be fused in the first shooting images corresponding to the external camera units; Perform a fusion process on at least two of the shooting images to be fused to obtain the target image of the target scene, and each of the shooting images to be fused in the at least two shooting images to be fused is fused and displayed in the target image.

10. The method according to claim 1, wherein The invoking the first shooting images corresponding to the external camera units and executing a preset multi-image processing task to obtain the target image of the target scene includes: Determine at least two to-be-switched shooting pictures in the first shooting picture corresponding to each of the external camera units; Perform switching processing on at least two of the to-be-switched shooting pictures to obtain a target picture of the target scene, and each to-be-switched shooting picture among the at least two to-be-switched shooting pictures is switched and displayed in the target picture.

11. A method for obtaining a picture, characterized in that, Applied to a recording and broadcasting device in a recording and broadcasting system, the recording and broadcasting system further includes a plurality of external camera units, the recording and broadcasting device includes a main control unit and a bridging unit, and the main control unit is bridged to each of the plurality of external camera units through the bridging unit; The method includes: The bridging unit obtains the first shooting picture corresponding to each of the external camera units based on a serial data processing method, and the first shooting picture corresponding to each of the external camera units is obtained by each of the external camera units shooting a target scene; The bridging unit transmits the first shooting picture corresponding to each of the external camera units to the main control unit, and the first shooting picture corresponding to each of the external camera units is used to provide the main control unit to execute a preset multi-picture processing task to obtain the target picture of the target scene.

12. The method according to claim 11, characterized in that, The bridging unit includes a deserialization bridging unit; The bridging unit obtains the first shooting picture corresponding to each of the external camera units based on a serial data processing method, including: The deserialization bridging unit receives the first shooting picture plus serial data corresponding to each of the external camera units, and the first shooting picture plus serial data corresponding to each of the external camera units is obtained by each of the external camera units shooting a target scene and adding a serial; The deserialization bridging unit performs deserialization processing on the first shooting picture plus serial data corresponding to each of the external camera units to obtain the first shooting picture corresponding to each of the external camera units; The bridging unit transmits the first shooting picture corresponding to each of the external camera units to the main control unit, including: The deserialization bridging unit transmits the first shooting picture corresponding to each of the external camera units to the main control unit.

13. The method according to claim 11, wherein The bridging unit includes a serialization bridging unit and a deserialization bridging unit; The bridging unit obtains the first shooting picture corresponding to each of the external camera units based on a serial data processing method, including: The serialization bridging unit receives the first shooting picture corresponding to each of the external camera units, and performs serialization processing on the first shooting picture corresponding to each of the external camera units to obtain the first shooting picture plus serial data corresponding to each of the external camera units; The serialization bridging unit sends the first shooting picture plus serial data corresponding to each of the external camera units to the deserialization bridging unit; The deserialization bridging unit receives the first shooting picture plus serial data corresponding to each of the external camera units; The deserialization bridging unit performs deserialization processing on the first shooting picture plus serial data corresponding to each of the external camera units to obtain the first shooting picture corresponding to each of the external camera units; The bridging unit transmits the first shooting picture corresponding to each of the external camera units to the main control unit, including: The deserialization bridging unit transmits the first shooting picture corresponding to each of the external camera units to the main control unit.

14. The method according to claim 11, wherein Before the bridging unit obtains the first captured images corresponding to the external camera units based on the serial data processing method, it further includes: The bridging unit obtains the second captured images corresponding to the external camera units based on the serial data processing method, and transmits the second captured images corresponding to the external camera units to the main control unit; The main control unit obtains the second captured images corresponding to the external camera units transmitted by the bridging unit; The main control unit determines the shooting objects corresponding to the external camera units in the target scene based on the second captured images corresponding to the external camera units; The main control unit performs motion control on the external camera units according to the shooting objects corresponding to the external camera units, so that the external camera units capture the corresponding shooting objects to obtain the corresponding first captured images.

15. The method according to claim 14, characterized in that, The recording and broadcasting system further includes a microphone array; The main control unit determines the shooting objects corresponding to the external camera units in the target scene based on the second captured images corresponding to the external camera units, including: The main control unit obtains the target audio signal in the target scene collected by the microphone array; The main control unit determines the target speakers corresponding to the external camera units in the target scene based on the second captured images corresponding to the external camera units and the target audio signal in the target scene collected by the microphone array; The main control unit determines the target speakers corresponding to the external camera units as the shooting objects corresponding to the external camera units.

16. The method according to claim 14, wherein The main control unit determines the shooting objects corresponding to the external camera units in the target scene based on the second captured images corresponding to the external camera units, including: The main control unit constructs a semantic map of the target scene based on the second captured images corresponding to the external camera units; The main control unit determines the shooting areas corresponding to the external camera units in the target scene based on the semantic map; The main control unit determines the shooting areas corresponding to the external camera units as the shooting objects corresponding to the external camera units.

17. The method according to claim 14, wherein The recording and broadcasting system further includes a microphone array, and the multiple external camera units are composed of at least one speaker camera unit and at least one area camera unit; The main control unit determines the shooting objects corresponding to the external camera units in the target scene based on the second captured images corresponding to the external camera units, including: The main control unit obtains the target audio signal in the target scene collected by the microphone array; The main control unit determines the target speakers corresponding to the speaker camera units in the target scene based on the second captured images corresponding to the speaker camera units in the at least one speaker camera unit, the second captured images corresponding to the area camera units in the at least one area camera unit, and the target audio signal in the target scene collected by the microphone array; The main control unit determines the target speakers corresponding to the speaker camera units as the shooting objects corresponding to the speaker camera units; The master control unit constructs a semantic map of the target scene based on the second captured images corresponding to each of the speaker camera units and the second captured images corresponding to each of the area camera units; The master control unit determines the shooting areas corresponding to each of the area camera units in the target scene based on the semantic map; The master control unit determines the shooting areas corresponding to each of the area camera units as the shooting objects corresponding to each of the area camera units.

18. The method according to claim 14, wherein The recording and broadcasting system further includes a plurality of motion control units, and any one of the external camera units among the plurality of external camera units is movably connected to the corresponding motion control unit among the plurality of motion control units; The master control unit performs motion control on each of the external camera units according to the shooting objects corresponding to each of the external camera units, so that each of the external camera units shoots the corresponding shooting object to obtain the corresponding first captured image, including: The master control unit generates control parameters for the motion control units corresponding to each of the external camera units according to the shooting objects corresponding to each of the external camera units; The master control unit controls the motion control units corresponding to each of the external camera units to drive each of the external camera units towards the corresponding shooting object according to the control parameters of the motion control units corresponding to each of the external camera units, so that each of the external camera units shoots the corresponding shooting object to obtain the corresponding first captured image.

19. The method according to claim 11, wherein After the bridging unit transmits the first captured images corresponding to each of the external camera units to the master control unit, it further includes: The master control unit acquires the first captured images corresponding to each of the external camera units transmitted by the bridging unit; The master control unit determines at least two captured images to be fused in the first captured images corresponding to each of the external camera units; The master control unit performs fusion processing on at least two of the captured images to be fused to obtain the target image of the target scene, and each of the captured images to be fused in at least two of the captured images to be fused is fused and displayed in the target image.

20. The method according to claim 11, characterized in that, After the bridging unit transmits the first captured images corresponding to each of the external camera units to the master control unit, it further includes: The master control unit acquires the first captured images corresponding to each of the external camera units transmitted by the bridging unit; The master control unit determines at least two captured images to be switched in the first captured images corresponding to each of the external camera units; The master control unit performs switching processing on at least two of the captured images to be switched to obtain the target image of the target scene, and each of the captured images to be switched in at least two of the captured images to be switched is switched and displayed in the target image.

21. A recording and playing device, characterized in that, The recording and broadcasting device is arranged in the recording and broadcasting system, the recording and broadcasting system further includes a plurality of external camera units, the recording and broadcasting device includes a master control unit and a bridging unit, and the master control unit is bridged to each of the external camera units among the plurality of external camera units through the bridging unit; The bridging unit is used to acquire the first captured images corresponding to each of the external camera units based on a serial data processing method, and the first captured images corresponding to each of the external camera units are obtained by each of the external camera units shooting the target scene; The bridging unit is further configured to transmit the first captured images corresponding to the external camera units to the main control unit, and the first captured images corresponding to the external camera units are used to be provided to the main control unit to execute a preset multi-image processing task to obtain a target image of the target scene.

22. The recording and playing device according to claim 21, wherein The bridging unit includes a deserialization bridging unit, and the deserialization bridging unit is communicatively connected to each of the external camera units through a cable; The deserialization bridging unit is built in the main control unit; or, The deserialization bridging unit is external to the main control unit and communicatively connected to the main control unit.

23. The recording and playing device according to claim 22, characterized in that, When the deserialization bridging unit is built in the main control unit, a first communication interface of the deserialization bridging unit is communicatively connected to a first communication interface of each of the external camera units through a cable.

24. The recording and playing device according to claim 22, characterized in that When the deserialization bridging unit is external to the main control unit and communicatively connected to the main control unit, a first communication interface of the deserialization bridging unit is communicatively connected to a first communication interface of each of the external camera units through a cable, and a second communication interface of the deserialization bridging unit is communicatively connected to a second communication interface of the main control unit.

25. The recording and playing device according to claim 21, characterized in that, The bridging unit includes a serialization bridging unit and a deserialization bridging unit, the serialization bridging unit is communicatively connected to each of the external camera units, and the serialization bridging unit is communicatively connected to the deserialization bridging unit through a cable; The deserialization bridging unit is built in the main control unit; or, The deserialization bridging unit is external to the main control unit and communicatively connected to the main control unit.

26. The recording and playing device according to claim 25, characterized in that, When the deserialization bridging unit is built in the main control unit, a first communication interface of the serialization bridging unit is communicatively connected to a first communication interface of the deserialization bridging unit through a cable, and a third communication interface of the serialization bridging unit is communicatively connected to a third communication interface of each of the external camera units.

27. The recording and playing device according to claim 25, characterized in that, When the deserialization bridging unit is external to the main control unit and communicatively connected to the main control unit, a first communication interface of the serialization bridging unit is communicatively connected to a first communication interface of the deserialization bridging unit through a cable, a second communication interface of the deserialization bridging unit is communicatively connected to a second communication interface of the main control unit, and a third communication interface of the serialization bridging unit is communicatively connected to a third communication interface of each of the external camera units.

28. The recording and playing device according to claim 21, wherein The recording and broadcasting system further includes a microphone array; The main control unit is communicatively connected to each microphone in the microphone array.

29. The recording and playing device according to claim 21, wherein The recording and broadcasting system further includes a plurality of motion control units; Any one of the external camera units among the plurality of external camera units is movably connected to a corresponding motion control unit among the plurality of motion control units; The main control unit is communicatively connected to each motion control unit among the plurality of motion control units.

30. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 20 is implemented.

Images