Video generation method, apparatus, and computer-readable storage medium

Abstract

The application provides a video generation method, device and computer readable storage medium. The method is executed by any processor in a video generation device, and the method comprises the following steps: receiving live images collected by corresponding image collectors; segmenting the live images to obtain a plurality of region images corresponding to the live images; acquiring region images subjected to specific processing from other processors through a data transmission loop, wherein the region images subjected to specific processing are region images subjected to processing by the any processor in each of the live images, and each of the region images subjected to specific processing is an image of the same region in each of the live images; and encoding each of the region images subjected to specific processing according to a video encoding protocol to obtain a video stream compression package. By using the method, image trailing interference can be avoided as much as possible in a high-speed scene, so that picture blurring is not prone to occurring.

Description

Technical Field

[0001] This application relates to data processing technology, and more particularly to a video generation method, apparatus, and computer-readable storage medium. Background Technology

[0002] Currently, in some applications, such as security monitoring, image processors primarily operate at a frame rate of 25 frames per second. While this is sufficient to capture object details in low-speed scenarios, it is difficult to avoid image blurring in high-speed scenarios, such as capturing fast-moving cars, motorcycles, trains, and pedestrians. Summary of the Invention

[0003] This application provides a video generation method, apparatus, and computer-readable storage medium to solve the technical problem of blurred images easily occurring in high-speed scenes in the prior art.

[0004] In a first aspect, this application provides a video generation method applied to a video generation device, the video generation device including a multi-core processor, the multi-core processor including multiple processors, each processor being connected to a corresponding image acquisition device, and each image acquisition device acquiring the same scene image;

[0005] For any of the processors described, the following method is performed:

[0006] Receive on-site images acquired by the corresponding image acquisition device;

[0007] The scene image is segmented to obtain multiple region images corresponding to the scene image;

[0008] The specific processed area image is obtained from other processors through a data transmission loop. The specific processed area image is a specific area image in each of the scene images that is processed by any of the processors, and each of the specific processed area images is an image of the same area in each of the scene images.

[0009] The images of each specific processing region are encoded according to the video encoding protocol to obtain a video stream compressed package.

[0010] Secondly, this application provides a video generation device, the device including a multi-core processor, the multi-core processor having multiple processors, each processor being connected to an image acquisition device; the images captured by each image acquisition device are identical;

[0011] Any processor is configured to receive a scene image acquired by a corresponding image acquisition device; segment the scene image to obtain multiple region images corresponding to the scene image; acquire a region image for specific processing from other processors through a data transmission loop, wherein the region image for specific processing is a specific region image in each scene image that is processed by the processor, and each region image for specific processing is an image of the same region in each scene image; and encode each region image for specific processing according to a video encoding protocol to obtain a video stream compressed package.

[0012] Thirdly, this application provides a video generation system, including the video generation device as described in the first aspect and a plurality of image acquisition devices;

[0013] The video generation device is connected to a corresponding image acquisition unit via multiple processors.

[0014] Fourthly, this application provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, are used to implement the method described in the first aspect.

[0015] The video generation method, apparatus, and computer-readable storage medium provided in this application, for any of the processors, perform the following method: receiving a scene image acquired by a corresponding image acquisition device; segmenting the scene image to obtain multiple region images corresponding to the scene image; acquiring specific processed region images from other processors through a data transmission loop, wherein the specific processed region images are specific region images processed by that processor in each of the scene images, and each of the specific processed region images is an image of the same region in each of the scene images; encoding each of the specific processed region images according to a video encoding protocol to obtain a video stream compressed packet. Under the premise that the encoding capability of the processor remains unchanged, by increasing the number of processors through a multi-core processor, multiple processors simultaneously process their respective specific processed region images, that is, they process a portion of the image of each scene image. Therefore, when processing each specific processed region image of any processor according to the video encoding protocol, the processor can provide a frame rate that is a multiple of 25 frames per second. Thus, in high-speed scenes, image ghosting interference can be minimized, and image blurring is less likely to occur. Attached Figure Description

[0016] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0017] Figure 1 A schematic diagram of the structure of the video generation system according to an embodiment of this application;

[0018] Figure 2 This is a schematic diagram illustrating the connection between each processor and its corresponding image acquisition unit in the multi-core processor of this application embodiment;

[0019] Figure 3 This is a flowchart illustrating an embodiment of the video generation method of this application;

[0020] Figure 4 This is a schematic diagram illustrating the process of segmenting any scene image to obtain multiple region images, according to an embodiment of this application.

[0021] Figure 5 This is a focusing diagram of four cameras provided in one embodiment of this application;

[0022] Figure 6 This is a schematic diagram showing the overall connection between each image acquisition unit and the multi-core processor in one embodiment of this application;

[0023] Figure 7 This is a flowchart illustrating the video generation method in another embodiment of this application.

[0024] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0025] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0026] First, let me explain the terms used in this application:

[0027] Frame rate: The number of times per second that an image processor can update.

[0028] To clearly understand the technical solution of this application, the solutions of the prior art will be described in detail first.

[0029] In traditional security monitoring, an image processor (IPC) is typically connected to a single camera. When encoding video according to a video encoding protocol to obtain a video stream, the IPC usually encodes a complete image of the scene captured by the camera. Assuming the image size is W*H, the IPC's encoding capability is W*H*25 FPS, where 25 FPS represents the IPC's frame rate of 25 frames per second. At 25 frames per second, due to the limited number of updates per second, if the IPC is applied to high-speed scenes, such as capturing fast-moving objects, image blurring and motion blur are difficult to avoid.

[0030] Therefore, when faced with the technical problems of existing technologies, the inventors, through creative research, discovered that in certain situations, such as security monitoring, to avoid image ghosting interference and improve the clarity of images captured in high-speed scenes, a multi-core processor is employed in the hardware. This multi-core processor comprises multiple processors, which are interconnected via a data transmission bus to form a data transmission loop. This allows data transmission between processors on the loop; for example, each processor obtains a specific area image from other processors. The processors here can be understood as still using existing image processors, but with an increased number. Each processor is connected to a corresponding image acquisition device, and the images captured by each image acquisition device are identical. To improve the frame rate of each processor and enable each processor to process multiple specific area images, it can be understood that each processor divides the corresponding scene image into multiple area images, and only processes one specific area image. Simultaneously, after other processors have divided the corresponding scene image into multiple area images, it obtains the specific area image from other processors through the data transmission loop. These multiple specific area images are, for the processor, images of the same area in each scene image. In other words, each processor has a specific region image for processing, and each processor's specific region image is an image of a different region within the same scene image. Since the size of each processor's specific region image is W*(H / 4), the frame rate becomes 100FPS while maintaining the same encoding capability (still equal to W*H*25FPS). This minimizes image ghosting interference in high-speed scenes and reduces the likelihood of blurry images.

[0031] like Figure 1As shown in the embodiment of this application, the video generation system 10 is used to generate video streams based on acquired on-site images. It includes a video generation device 101 and multiple image acquisition units 11. The video generation device 101 includes a multi-core processor 1102, which in turn includes multiple processors 103. The video generation device 101 is connected to the corresponding image acquisition unit 11 through the multiple processors 103. The image acquisition units 11 are used to acquire on-site images, and the video generation device 101 processes the on-site images acquired by the image acquisition units 11 to obtain compressed video stream packets. Each compressed video stream packet is obtained by each processor 103 encoding multiple specifically processed area images.

[0032] After the video generation system generates a video stream, it may also include a decoder and a display interface. In this case, each video stream compressed package is decoded by the decoder, and each decoded video stream can be displayed through the display interface. Alternatively, the video generation system can communicate with an external terminal device, which includes a decoder and a display interface. The video generation system sends each video stream to the external terminal device for decoding and displays each decoded video stream through the display interface.

[0033] like Figure 2 The diagram illustrates the connection between a multi-core processor and a corresponding image acquisition device provided in this embodiment. The multi-core processor is described using a 4-core processor, which includes four processors: CPU1, CPU2, CPU3, and CPU4. Each of CPU1 to CPU4 is connected to a corresponding image acquisition device 20. CPU1, CPU2, CPU3, and CPU4 are connected via a MIPI bus, forming a data transmission loop. Specifically, each CPU has two input interfaces (DISPLAY and MIPI0) and one output interface (MIPI1). A MIPI bus connection is established between the MIPI1 output interface of CPU1 and the DISPLAY input interface of CPU2; between the MIPI1 output interface of CPU2 and the DISPLAY input interface of CPU3; between the MIPI1 output interface of CPU3 and the DISPLAY input interface of CPU4; and between the MIPI1 output interface of CPU4 and the DISPLAY input interface of CPU1. This creates a data transmission loop between CPU1, CPU2, CPU3, and CPU4.

[0034] Taking CPU1 as an example, the input interface MIPI0 is used to acquire the scene images acquired by the image acquisition unit 20, and the input interface DISPLAY is used to acquire the specific processing area images of CPU1 from CPU4. MIPI1 is used to transmit the images of all areas in CPU1 other than the specific processing area images to CPU2.

[0035] The MIPI bus uses the MIPI protocol for data transmission, and under ideal conditions, it can achieve a bandwidth of up to 6 GPS, making its data transmission rate highly efficient.

[0036] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0037] Figure 3 This application provides a video generation method according to an embodiment, such as... Figure 3 As shown, the execution entity of the video generation method provided in this embodiment is any processor in a multi-core processor. Therefore, when any processor in the multi-core processor provided in this embodiment executes the video generation method, it includes the following steps:

[0038] Step 101: Receive the on-site images acquired by the corresponding image acquisition device.

[0039] An image acquisition device is a device or component that can acquire images, such as a camera or imaging electronic unit. On-site images are images acquired by an image acquisition device; in the field of security monitoring, on-site images refer to images of the monitored area.

[0040] When the image acquisition device captures images from the scene, the processor can acquire the corresponding scene images in real time. In a multi-core processor, each processor only acquires scene images from its corresponding image acquisition device in real time.

[0041] Step 102: Segment the scene image to obtain multiple region images corresponding to the scene image.

[0042] In this context, "segmenting the scene image" refers to the processor dividing the acquired scene image into multiple parts. For clarity, the segmented scene image is referred to as a region image. Since the image is segmented into multiple parts, multiple corresponding region images are obtained.

[0043] Specific methods for segmenting on-site images include existing methods such as threshold-based segmentation, edge-based segmentation, region-based segmentation, graph theory-based segmentation, and energy functional segmentation, which will not be elaborated upon here.

[0044] When each processor segments the corresponding scene image, the segmentation rules are consistent, that is, multiple corresponding region images are obtained according to the same rules.

[0045] Step 103: Obtain the specific processed area image from other processors through the data transmission loop. The specific processed area image is a specific area image in each field image that is processed by any of the processors, and each specific processed area image is an image of the same area in each field image.

[0046] Among them, the data transmission loop is the transmission loop formed between processors in a multi-core processor through the MIPI bus architecture. It can be used to support the transmission of data between processors on the loop. For example, each processor can obtain a specific region image from other processors.

[0047] Other processors refer to processors in a multi-core processor group other than the processor currently executing the video generation method to obtain the video stream. As mentioned earlier, if the processor currently executing the method is CPU1, then other processors refer to CPU2, CPU3, and CPU4. It's important to note that multiple processors in a multi-core processor group execute the video generation method almost simultaneously. This "almost simultaneous" result from subtle hardware differences between processors, making complete and precise synchronization impossible. However, this "almost simultaneous" time difference is generally in the millisecond range or lower, and is not easily perceptible to the human eye.

[0048] A specific processed region image refers to a region image within each field image that is processed by any one of the processors, and there can be one or more such regions. In a multi-core processor, the specific processed region images are different for each processor; they are region images of different areas within the same field image. Taking the aforementioned quad-core processor, where each processor processes only one region image from the field image, as an example, the specific processed region images for CPU1, CPU2, CPU3, and CPU4 are different. The specific processed region image for CPU1 could be the region image corresponding to region 1 in the field image; the specific processed region image for CPU2 could be the region image corresponding to region 2 in the field image; CPU3 could be the region image corresponding to region 3 in the field image; and CPU4 could be the region image corresponding to region 4 in the field image.

[0049] For this processor, the region image processed by each specific processor is an image of the same region from each field image. As mentioned earlier, the 4-core processor acquires field images from the corresponding image acquisition devices, resulting in a total of 4 field images. Each field image undergoes image segmentation to obtain multiple corresponding region images. Dividing each field image into 4 regions according to the same rule yields 4 region images: region 1, region 2, region 3, and region 4 for each field image. In summary, the 4 field images contain a total of 4 region 1 images, 4 region 2 images, 4 region 3 images, and 4 region 4 images.

[0050] For images of other regions not processed by any of the processors (i.e., images of regions other than the region image to be processed), the processor will package these other region images into MIPI packets and send them to the data transmission loop. The header of the MIPI packet includes the image information, packet size, and sending address. The sending address indicates which processor the data transmission loop will send the MIPI packet to next for processing. Upon receiving the MIPI packet, the next processor first parses it, extracting only the region image to be processed by itself. Then, it writes its own region images (excluding the region image to be processed) obtained from the segmentation of the field image into the MIPI packet, updates the image information, packet size, and sending address of the MIPI packet, and continues to send it to the next processor.

[0051] Taking CPU1 as an example, the specific processing region image of CPU1 is the region image of region 1, the specific processing region image of CPU2 is the region image of region 2, the specific processing region image of CPU3 is the region image of region 3, and the specific processing region image of CPU4 is the region image of region 4. The specific processing region images are obtained from the other processors through the data transmission loop. This can be understood as follows: After CPU1 obtains the region image of region 1 through image segmentation, it packages the region images of region 2, region 3, and region 4 into a MIPI data packet and sends it to the data transmission loop. The sending address in the header of the MIPI data packet points to the address of CPU2. The data transmission loop then transmits the MIPI data packet to CPU2. After receiving the MIPI data packet, CPU2 only extracts the region image of region 2 and writes its own region images of region 1, region 3, and region 4 into the MIPI data packet. At this point, the MIPI data packet includes the region images of region 3 and region 4 from CPU1, as well as the region images of region 1, region 3, and region 4 from CPU2.

[0052] CPU2 updates the MIPI data packet's sending address to point to CPU3. The data transmission loop then transmits the MIPI data packet to CPU3. Upon receiving the MIPI data packet, CPU3 extracts only the region image of region 3 and writes the region images of region 1, region 2, and region 4 from CPU2 into the MIPI data packet. At this point, the MIPI data packet includes the region images of region 4 from CPU1, region 1 and region 4 from CPU2, and region 1, region 2, and region 4 from CPU3. Other regions follow the same logic and will not be elaborated further.

[0053] Step 104: Encode the images of each specific processing area according to the video encoding protocol to obtain a video stream compressed package.

[0054] Here, a video stream compressed package refers to a video stream stored in compressed package form. A video encoding protocol is a standard encoding protocol adopted by a video encoding method. A video encoding method refers to using compression technology to convert a file in an original video format into another video format, such as converting an image into a video stream in this embodiment. Possible video encoding protocols include ITU-T H.261, H.263, H.264, and H.265, etc.

[0055] The specific video encoding protocol encodes the images of each specific processing area. This process can be understood as converting the images of each specific processing area into corresponding video stream compressed packets according to the video encoding protocol.

[0056] In this application, for any processor, the following method is performed: receiving the scene image acquired by the corresponding image acquisition device; segmenting the scene image to obtain multiple region images corresponding to the scene image; acquiring specific processed region images from other processors through a data transmission loop, wherein the specific processed region images are specific region images processed by that processor in each scene image, and each specific processed region image is an image of the same region in each scene image; encoding each specific processed region image according to a video encoding protocol to obtain a video stream compressed packet. Under the premise that the processor's encoding capability remains unchanged, by increasing the number of processors through a multi-core processor, multiple processors simultaneously process their respective specific processed region images, that is, they each process a portion of the image in each scene image. Therefore, when processing each specific processed region image of any processor according to the video encoding protocol, the processor can provide a frame rate that is a multiple of 25 frames per second. Thus, in high-speed scenes, image ghosting interference can be minimized, and image blurring is less likely to occur.

[0057] As an optional implementation of step 102, when segmenting the scene image, the scene image can be segmented from top to bottom according to the height direction to obtain multiple area images corresponding to the scene image.

[0058] The reason why the on-site image needs to be cut from top to bottom according to the height direction is that the processor's memory reads data continuously from top to bottom, line by line.

[0059] like Figure 4 The image shown is a segmentation of a scene image 40, resulting in four region images. From top to bottom along the height direction, these are the region images of region 1, region 2, region 3, and region 4.

[0060] In this embodiment, the scene image is segmented from top to bottom according to the height direction to obtain multiple region images corresponding to the scene image. Since image segmentation is performed according to the nature of data read from the processor's memory, it conforms to the processor's processing logic and is conducive to the normal operation of the processor.

[0061] Before segmenting the scene image to obtain multiple area images corresponding to the scene image, as an optional real-time method, any of the aforementioned processors may also adjust the image display parameters of the scene image to make the image display parameters of the scene image consistent with those of the scene images of other processors. The image display parameters include at least automatic exposure, white balance, and focal length.

[0062] Image display parameters, also known as ISP (Image Signal Processing) parameters, are parameters related to image display. Image display parameters include at least automatic exposure, white balance, and focal length, and may also include gamma correction, etc.

[0063] In a multi-core processor, each processor is connected to its corresponding image acquisition unit, such as... Figure 6 As shown, 60 is a multi-core processor, and 61 is an image acquisition unit. The four image acquisition units 61 capture identical images of the scene. The image acquisition units are in cascaded mode. Although their optical axes, image frames, and scenes are basically the same, taking a camera as an example, if the physical performance of the cameras, such as inconsistent light transmission or installation location, is different, there will still be subtle differences in detail in the final video. If no adjustments are made, obvious image layering will appear after stitching together multiple video streams.

[0064] Specifically, when adjusting the focus, the processor drives the lens to change the focus point along the axis pointing towards the subject, acquiring an image at each focus point, similar to point-by-point scanning. First, the image acquired at each focus point is digitized; the digitized image is actually an integer matrix, which is then passed to the processor. The contrast is then calculated, and the focus point with the highest contrast is selected. The lens is then driven to place the focus on the point with the highest contrast value, thus obtaining the correct focus. The focus is then determined based on the maximum contrast value, indicating that focusing is complete. In the actual displayed image, this is a "hunting" process, from blurry to sharp and back to blurry, finally becoming sharp. This focusing technology is called contrast-based focusing. Taking the aforementioned quad-core processor as an example, based on four cameras, a multi-point transitional focusing method is used for both front and back focusing. Figure 5 As shown, the focal length measurement points for the four cameras are f1-1, f2-1, f2-2, f3-1, f3-2, and f4-1, where f can be any point within the camera's variable focal length range of fmax to fmin. The processor of camera 1 can control its focus from fmax to fmin, and the processor of camera 3 can control its focus from fmax to fmin. Similarly, the processors of camera 2 and 4 can control their focus from fmin to fmax. This focusing method saves half the focusing time. Cameras 2 and 3 each acquire two focal length values ​​f, and the average of these two f values ​​is taken to achieve a relatively smooth transition between multiple lenses.

[0065] In this embodiment, by adjusting the image display parameters of the live image, the image display parameters of the live image and the live images of other processors can be made consistent. As a result, when each processor encodes the corresponding video stream and displays it on the display interface, the screen parameters can be made more consistent, thus improving the continuity of video display.

[0066] As an optional implementation method, such as Figure 7 As shown, in this embodiment, step 104 includes the following steps:

[0067] Step 701: Sort the region images of each specific process of the processor according to the timestamp of each field image to obtain the sorted region images of the specific process.

[0068] The timestamp refers to the point in time when the processor receives the scene image. As mentioned earlier, due to slight differences in the hardware of multi-core processors, the timestamps of the corresponding scene images received by each processor will differ.

[0069] The sorted region images refer to multiple region images obtained by sorting the region images of each specific process in chronological order.

[0070] For this processor, when it receives all the specific processing area images in each field image through the data transmission loop, since each specific processing area image carries the timestamp information of the original field image, the specific processing area images of each specific processing can be sorted according to time sequence based on the timestamp of each field image to obtain the sorted specific processing area images.

[0071] Step 702: Encode the sorted, specifically processed region images according to the video encoding protocol to obtain a video stream compressed package.

[0072] In this process, when encoding the region images of each specific process according to the video encoding protocol, the sorted region images of the specific process are actually encoded according to the video encoding protocol to obtain the video stream compressed package.

[0073] In this embodiment, the region images of each specific process of the processor are sorted according to the timestamps of each of the on-site images to obtain sorted region images of specific processes; the sorted region images of specific processes are then encoded according to a video encoding protocol to obtain a video stream compressed package. By sorting the region images of each specific process according to the timestamps of each on-site image, and then encoding the sorted region images of specific processes to obtain a video stream compressed package, the ability to display / play the video stream in the compressed package in the normal order can be improved.

[0074] Following step 104, as an optional implementation, in this embodiment, the video generation method further includes: sending a video stream compression package to a decoder so that the decoder decodes the video stream compression package and displays the decoded video stream through a display interface.

[0075] The display interface can be either built into the video generation system or an external terminal device connected to the video generation system; there are no specific limitations. The decoder decodes the compressed video stream package, and can use existing video decoding technologies, which will not be elaborated upon.

[0076] This application also provides a video generation device, which includes a multi-core processor with multiple processors, each processor being connected to an image acquisition unit; the images captured by each image acquisition unit are identical.

[0077] Any processor is used to receive the scene images acquired by the corresponding image acquisition device; segment the scene images to obtain multiple region images corresponding to the scene images; acquire the region images of specific processing from other processors through the data transmission loop, wherein the region images of specific processing are specific region images of each scene image processed by the processor, and each region image of specific processing is an image of the same region in each scene image; and encode each region image of specific processing according to the video encoding protocol to obtain a video stream compressed packet.

[0078] As an optional implementation, any processor, when segmenting a scene image to obtain multiple region images corresponding to the scene image, is specifically used to: segment the scene image from top to bottom according to the height direction to obtain multiple region images corresponding to the scene image.

[0079] As an optional implementation, after segmenting the scene image to obtain multiple region images corresponding to the scene image, any processor is further configured to: adjust the image display parameters of the scene image to make the image display parameters of the scene image consistent with those of the scene images of other processors, wherein the image display parameters include at least automatic exposure, white balance and focal length.

[0080] As an optional implementation, when any processor encodes the region images of each specific process according to the video encoding protocol to obtain a video stream compressed package, it specifically performs the following: sorting the region images of each specific process of the processor according to the timestamp of each scene image to obtain sorted region images of the specific process; and encoding the sorted region images of the specific process according to the video encoding protocol to obtain a video stream compressed package.

[0081] As an optional implementation, any processor is further configured to, after encoding the region images of each specific process according to the video encoding protocol to obtain a video stream compressed package, send the video stream compressed package to the decoder so that the decoder can decode the video stream compressed package and display the decoded video stream through the display interface.

[0082] For the limitations of the video generation device in the above embodiments, please refer to the specific description of the video generation method in the above embodiments, which will not be repeated here.

[0083] A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by any processor in a video generation apparatus, enable the processor to perform the aforementioned video processing method.

[0084] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0085] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A video generation method, applied to a video generation device, characterized in that, The video generation device includes a multi-core processor, which includes multiple processors. Each processor is connected to a corresponding image acquisition device, and the images captured by each image acquisition device are identical. For any of the processors described, the following method is performed: Receive on-site images acquired by the corresponding image acquisition device; The image display parameters of the live image are adjusted to make them consistent with those of live images from other processors. The image display parameters include at least automatic exposure, white balance, and focal length. The scene image is segmented from top to bottom along the height direction to obtain multiple region images corresponding to the scene image. The segmentation method is adapted to the data processing logic of the processor memory reading data line by line from top to bottom. Through a shared data transmission loop based on a MIPI bus architecture, the processor sends images of regions it has segmented but not processed to the data transmission loop, and receives images of specific regions it is responsible for processing from other processors. Each processor in the multi-core processor is pre-assigned to process a fixed, different specific region from each field image. Through data exchange in the data transmission loop, each processor obtains and aggregates multiple region images of the same specific region acquired simultaneously from all image acquisition devices. In the data transmission loop, the output interfaces of each processor are sequentially connected to the input interfaces of the next processor via the MIPI bus to form a closed loop. The header of the transmitted MIPI data packets contains the target processor address information, enabling precise directional transmission of region images. Based on the timestamps of each of the on-site images, the images of each region that the processor is responsible for processing are sorted to obtain sorted images of the region to be processed. The sorted images of the region to be processed are then encoded according to a video encoding protocol to obtain a video stream compressed package. Wherein, under the condition that the encoding capability of the processor remains unchanged, by having multiple processors in the multi-core processor process the images of the same region in each on-site image respectively, the frame rate provided by any processor is a multiple of the frame rate of the on-site image.

2. The method according to claim 1, characterized in that, After encoding the sorted, specifically processed region images according to a video encoding protocol to obtain a compressed video stream, the method further includes: The video stream compression package is sent to the decoder so that the decoder can decode the video stream compression package and display the decoded video stream through the display interface.

3. A video generation device, characterized in that, The device includes a multi-core processor, which has multiple processors, each of which is connected to an image acquisition unit; the images captured by each image acquisition unit are identical. Any processor is configured to receive a field image acquired by a corresponding image acquisition device; adjust the image display parameters of the field image to make the image display parameters of the field image consistent with those of field images from other processors, wherein the image display parameters include at least automatic exposure, white balance, and focal length; The scene image is segmented vertically from top to bottom to obtain multiple region images corresponding to the scene image. This segmentation method is adapted to the data processing logic of the processor memory reading line by line from top to bottom. Through a shared data transmission loop based on a MIPI bus architecture, the segmented region images that are not processed by the processor itself are sent to the data transmission loop, and region images of specific regions that the processor is responsible for processing are received from the data transmission loop by other processors. Each processor in the multi-core processor is pre-assigned to process a fixed, different specific region in each scene image. Through data exchange in the data transmission loop, each processor obtains and aggregates multiple region images of the same specific region acquired simultaneously from all image acquisition devices. In the data transmission loop, the output interfaces of each processor and the input interfaces of the next processor are sequentially connected via a MIPI bus to form a closed loop. The header of the transmitted MIPI data packet contains the target processor address information, which is used to achieve directional and precise transmission of regional images. Based on the timestamps of each of the field images, the regional images of the specific area that the processor is responsible for processing are sorted to obtain sorted regional images for specific processing. The sorted regional images for specific processing are encoded according to a video encoding protocol to obtain a video stream compressed packet. Wherein, under the condition that the encoding capability of the processor remains unchanged, by having multiple processors in the multi-core processor process the images of the same area in each field image respectively, the frame rate provided by any processor is a multiple of the frame rate of the field image.

4. The video generation apparatus according to claim 3, characterized in that, The processor is further configured to encode the images of each region of the specific region it is responsible for processing according to the video encoding protocol to obtain a video stream compressed package, and then send the video stream compressed package to the decoder so that the decoder can decode the video stream compressed package and display the decoded video stream through the display interface.

5. A video generation system, characterized in that, Includes the video generation device as described in claim 3 or 4 and multiple image acquisition devices; The video generation device is connected to a corresponding image acquisition unit via multiple processors.

6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in claim 1 or 2.

Images