Pre-monitor echo image specification adjustment method and device, panel controller and storage medium

Abstract

This invention provides a method, apparatus, splicing controller, and storage medium for adjusting the specifications of preview echo images, relating to the field of image processing technology. The method includes: receiving image processing status signals corresponding to each channel of the previous frame; each image processing status signal is determined by an image processing unit after processing each channel of the first preview echo image of the previous frame; based on the image processing status signals corresponding to each channel, determining the image processing result corresponding to each channel of the first preview echo image; the image processing result is used to characterize the remaining image processing performance of the corresponding image processing unit; and if it is determined that the image processing result of the previous frame is incomplete, adjusting the reading specification parameters to match the remaining image processing performance. This invention can achieve matching of reading specification parameters with the remaining image processing performance, fully utilizing the remaining image processing performance while avoiding impacting the performance of large-screen displayed images.

Description

Technical Field

[0001] This invention relates to the field of image processing technology, and in particular to a method, apparatus, splicing controller, and storage medium for adjusting the specifications of a preview and display image. Background Technology

[0002] In a video wall controller, the preview display acts as a screen monitor, allowing users to preview the content displayed on the large screen through a small window, serving as a reference for adjusting the large screen content. Adding the preview display function to the video wall controller requires processing and outputting the preview image, increasing the performance overhead of the image processing and transmission units. However, the image processing and output performance of the video wall controller is limited. Too many preview display image channels can lead to excessive image traffic, thus affecting the performance of the large screen's image transmission.

[0003] In existing technologies, a certain amount of image processing performance is typically reserved for the pre-monitored display image to avoid affecting the performance of the large-screen image. However, this results in a waste of the reserved image processing performance, leading to insufficient utilization of performance. Summary of the Invention

[0004] This invention provides a method, apparatus, splicing controller, and storage medium for adjusting the specifications of a preview and display image, which solves the problem of wasted image processing performance in the prior art, resulting in insufficient performance utilization. It achieves that the read specification parameters match the remaining image processing performance, which can make full use of the remaining image processing performance and avoid affecting the performance of the large-screen image display.

[0005] This invention provides a method for adjusting the specifications of a preview echo image, comprising:

[0006] Receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0007] Based on the image processing status signals corresponding to each of the paths, the image processing results corresponding to the first pre-monitoring echo images of all paths are determined; the image processing results are used to characterize the remaining image processing performance of the image processing unit.

[0008] If it is determined that the image processing result of the previous frame is incomplete, the reading specification parameters are adjusted to match the remaining performance of the image processing.

[0009] According to the preview echo image specification adjustment method provided by the present invention, the reading specification parameters include the number of reading image channels;

[0010] The adjustment of the readout specifications to match the remaining image processing performance includes:

[0011] Get the number of image paths read from the previous frame;

[0012] If the number of read images in the previous frame is greater than a preset threshold, the number of read images in the previous frame is gradually reduced. If the adjusted number of read images matches the remaining performance of the image processing, the adjustment is stopped.

[0013] According to the preview echo image specification adjustment method provided by the present invention, the step of successively reducing the number of read image paths of the previous frame, and stopping the adjustment if the adjusted number of read image paths matches the remaining performance of the image processing, includes:

[0014] S1. Determine the number of image reading paths for the current frame based on the path step size and the number of image reading paths in the previous frame; the number of image reading paths for the current frame is less than the number of image reading paths in the previous frame.

[0015] S2. Obtain the image processing results corresponding to all second preview echo images of the current frame; each second preview echo image is read after adjusting the number of read image channels of the current frame;

[0016] S3. If the image processing result of the current frame is that the processing is complete, determine that the number of image reading paths of the current frame matches the remaining performance of the image processing, and stop adjusting.

[0017] S4. If the image processing result of the current frame is that the processing is not completed, the number of image reading paths of the current frame is determined to be the new number of image reading paths of the previous frame, and steps S1 to S4 are repeated until the image processing result of the current frame is that the processing is completed and the adjustment stops.

[0018] According to the pre-monitoring echo image specification adjustment method provided by the present invention, the read specification parameters further include a block coefficient;

[0019] The method further includes:

[0020] If the number of image reading paths in the current frame after adjustment is the preset threshold for the number of paths, and the image processing result of the current frame is that the processing is not completed, the block coefficient of the previous frame is obtained. If the block coefficient of the previous frame is less than the preset threshold for block processing, the block coefficient of the previous frame is increased successively. If the adjusted image processing result is that the processing is completed, the adjustment is stopped, and it is determined that the adjusted block coefficient is consistent with the remaining performance of the image processing.

[0021] According to the preview echo image specification adjustment method provided by the present invention, the read specification parameters further include a resolution coefficient;

[0022] The method further includes:

[0023] If the adjusted block coefficient is the preset block threshold, and the adjusted image processing result is that the processing is not completed, obtain the resolution coefficient of the previous frame, and if the resolution coefficient of the previous frame is less than the preset resolution threshold, increase the resolution coefficient of the previous frame one by one. If the adjusted image processing result is that the processing is completed, stop adjusting, and determine that the adjusted resolution coefficient is consistent with the remaining performance of the image processing.

[0024] According to the preview echo image specification adjustment method provided by the present invention, the step of determining the image processing result corresponding to the first preview echo image of all channels based on the image processing status signal corresponding to each of the channels includes:

[0025] When all the image processing status signals are processing completion signals, the image processing result corresponding to all the first preview echo images is determined to be processing completion;

[0026] If at least one image processing status signal in the image processing status signals corresponding to each of all paths is a processing incomplete signal, then the image processing result corresponding to the first preview echo image of all paths is determined to be a processing incomplete signal.

[0027] The present invention also provides a preview echo image specification adjustment device, comprising:

[0028] The receiving module is used to receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0029] The determination module is used to determine the image processing result corresponding to the first preview echo image of each of the paths based on the image processing status signal corresponding to each of the paths; the image processing result is used to characterize the remaining image processing performance of the image processing unit.

[0030] An adjustment module is used to adjust the reading specification parameters to match the remaining performance of the image processing when it is determined that the image processing result of the previous frame is incomplete.

[0031] The present invention also provides a splicing controller, comprising: an image acquisition unit, an image buffer unit, an image processing unit, an image output unit, an image allocation unit, and a synchronization unit, wherein:

[0032] The image acquisition unit is connected to the image buffer unit, and the image acquisition unit is used to acquire at least one pre-monitoring and display image.

[0033] The image buffer unit is connected to the image processing unit and the image allocation unit respectively, and the image buffer unit is used to store the at least one pre-monitoring echo image sent by the image acquisition unit;

[0034] The image processing unit is also connected to the image output unit. The image processing unit is used to process the at least one pre-monitoring echo image and determine the image processing status signal corresponding to each pre-monitoring echo image.

[0035] The image output unit is used to output the processed pre-monitoring echo image;

[0036] The image allocation unit is used to perform the pre-monitoring echo image specification adjustment method as described in any of the above items;

[0037] The synchronization unit is used to control the image allocation unit to periodically read the preview echo image from the image cache unit.

[0038] According to the splicing controller provided by the present invention, the image allocation unit includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the preview and echo image specification adjustment method as described above.

[0039] The present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the preview echo image specification adjustment method as described above.

[0040] The present invention provides a method, apparatus, splicing controller, and storage medium for adjusting the specifications of pre-monitoring echo images. It receives image processing status signals corresponding to the processing of each channel of the first pre-monitoring echo image in the previous frame by the image processing unit. Based on the respective image processing status signals of all channels, it determines the image processing results corresponding to all channels of the first pre-monitoring echo images. If the image processing result of the previous frame is incomplete, it indicates that the reserved image processing performance of the previous frame is insufficient. This can be addressed by adjusting the reading specification parameters to match the remaining image processing performance. This fully utilizes the remaining image processing performance, avoids wasting it, and reduces the consumption of image processing performance, thus preventing any impact on the performance of the large-screen image display. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0042] Figure 1 This is a schematic diagram of the structure of a splicing controller provided by existing technology.

[0043] Figure 2 This is one of the flowcharts illustrating the pre-monitoring and echo image specification adjustment method provided in this embodiment of the invention.

[0044] Figure 3 This is the second flowchart of the pre-monitoring echo image specification adjustment method provided in the embodiments of the present invention.

[0045] Figure 4 This is a schematic diagram of the pre-monitoring and echo image specification adjustment device provided in an embodiment of the present invention.

[0046] Figure 5 This is a schematic diagram of the structure of the controller provided in an embodiment of the present invention.

[0047] Figure 6 This is a schematic diagram of the structure of the image allocation unit provided in an embodiment of the present invention. Detailed Implementation

[0048] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0049] Figure 1 This is a structural diagram of a splicing controller provided by existing technology, such as... Figure 1 As shown, the splicing controller includes multiple boards, including image acquisition boards, image display boards, control boards, switching boards, and preview / reflection boards. The splicing controller includes multiple image acquisition boards, each used to acquire external input source images. The control board controls the switching board to forward the input source images acquired by the image acquisition boards to the multiple image display boards. The image display boards process the input source images and display them. Each image display board corresponds to a specific screen, and these screens are spliced ​​together to form a large screen. The preview / reflection board is used to display the images from the large screen on a smaller screen or interface to preview the content of the large screen. Because the content displayed on the large screen is a splicing of multiple images externally, rather than splicing within a single module, it cannot be output to the preview / reflection board by simply scaling it down. Instead, all input source images are collected and displayed on the corresponding small screen of the preview / reflection board according to the arrangement of the screens.

[0050] In existing technologies, a certain amount of image processing performance is reserved for the pre-monitored display image to avoid negatively impacting the performance of the large-screen display image. However, this results in a waste of the reserved image processing performance, leading to insufficient performance utilization.

[0051] To address the aforementioned problems in the prior art, embodiments of the present invention provide a method for adjusting the specifications of a preview echo image. Figure 2 This is one of the flowcharts illustrating the pre-monitoring echo image specification adjustment method provided in this embodiment of the invention, such as... Figure 2 The method includes steps 210 to 230.

[0052] Step 210: Receive the image processing status signals corresponding to each of the channels in the previous frame; each image processing status signal is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0053] Specifically, the pre-monitoring echo image specification adjustment method provided in this embodiment of the invention is applied to the image allocation unit in a video wall controller. The video wall controller also includes an image processing unit. After at least one first pre-monitoring echo image is acquired and transmitted to the image processing unit, the image processing unit can perform image processing on each first pre-monitoring echo image and then display the processed images on a large screen. After processing each first pre-monitoring echo image of the previous frame, the image processing unit generates a corresponding image processing status signal for each image and sends the corresponding image processing status signal to the image allocation unit.

[0054] Optionally, image processing operations may include scaling, enhancement, correction, cropping, brightness adjustment, and chroma adjustment, etc., and the embodiments of the present invention do not limit these operations.

[0055] Step 220: Based on the image processing status signals corresponding to each of the paths, determine the image processing results corresponding to the first preview echo images of all paths; the image processing results are used to characterize the remaining image processing performance of the image processing unit.

[0056] Specifically, after receiving the image processing status signals corresponding to each of the channels, the image allocation unit can determine the image processing sub-results corresponding to the first preview echo images of the previous frame based on the level of each channel's image processing status signal. For example, if the image processing status signal is high, the image processing sub-result of the first preview echo image of the previous frame corresponding to that channel is completed; if the image processing status signal is low, it indicates that the image processing sub-result of the first preview echo image of the previous frame corresponding to that channel is not completed. After determining the image processing sub-results for each channel, the image processing results corresponding to all first preview echo images can be determined, thereby determining the remaining image processing performance of the image processing unit, so as to adaptively adjust the specifications of the current frame's preview echo image based on the remaining image processing performance.

[0057] Further, determining the image processing result corresponding to the first preview echo image of all paths based on the image processing state signals corresponding to each of the paths includes:

[0058] When all the image processing status signals are processing completion signals, the image processing result corresponding to all the first preview echo images is determined to be processing completion;

[0059] If at least one image processing status signal in the image processing status signals corresponding to each of all paths is a processing incomplete signal, then the image processing result corresponding to the first preview echo image of all paths is determined to be a processing incomplete signal.

[0060] For example, taking a high-level signal for processing completion and a low-level signal for processing incomplete, if the image processing status signals for all channels are high-level, it indicates that the first preview echo image of the previous frame for each channel has been processed. Therefore, it is further determined that the image processing result for all channels' first preview echo images is complete. That is, in the previous frame, there was less image processing traffic, and the remaining image processing capacity was sufficient to fully process all channels' first preview echo images. If at least one channel has a low-level image processing status signal, it indicates that at least one channel's first preview echo image processing is incomplete. Therefore, it is further determined that the image processing result for all channels' first preview echo images is incomplete. That is, in the previous frame, there was more image processing traffic, and the remaining image processing capacity was insufficient to fully process all channels' first preview echo images.

[0061] Step 230: If it is determined that the image processing result of the previous frame is incomplete, adjust the reading specification parameters to match the remaining performance of the image processing.

[0062] Specifically, when it is determined that the image processing result of the previous frame is incomplete, it indicates that the image traffic increased in the previous frame, and the image processing and transmission consumed a significant amount of image processing performance, leaving insufficient remaining image processing performance reserved for the preview echo image. In this case, the reading specifications of the second preview echo image in the current frame can be adjusted to match the remaining image processing performance. This avoids affecting the performance of the large-screen image display while making full use of the remaining image processing performance and preventing its waste.

[0063] Furthermore, the reading specification parameters include the number of image channels read.

[0064] It should be noted that the splicing controller also includes an image buffer unit. The image allocation unit is used to read the stored preview echo images from the image buffer unit according to the reading specification parameters, and send the read preview echo images of the corresponding specifications to the image processing unit for processing. The number of image reading channels refers to the number of preview echo images read in a single frame. For example, if the total number of reserved preview echo images is num, and the number of image reading channels is n, And n and num are both positive integers. All images are read through x frames, and num / n can be an integer or a decimal. This indicates rounding up. Furthermore, after adjusting the number of image channels read, the adjusted preview echo image frame rate can be determined as f / x, where f represents the image synchronization frame rate, achieving the goal of reducing the image synchronization frame rate. For example, if the total reserved preview echo image channels num is 7 channels, and the number of image channels read n is 4 channels / frame, then x, rounded up, becomes 2, meaning that it takes two frames to read all the images. The first frame reads 4 channels, and the second frame reads the remaining 3 channels, with no overlap between the preview echo images read in the first and second frames. The preview echo image frame rate is a division of the original image synchronization frame rate by two.

[0065] Furthermore, adjusting the readout specifications to match the remaining image processing performance includes:

[0066] Get the number of image paths read from the previous frame;

[0067] If the number of read images in the previous frame is greater than a preset threshold, the number of read images in the previous frame is gradually reduced. If the adjusted number of read images matches the remaining performance of the image processing, the adjustment is stopped.

[0068] Specifically, Figure 3 This is a second schematic flowchart of the pre-monitoring echo image specification adjustment method provided in this embodiment of the invention, as shown below. Figure 3As shown, when the image processing result for the previous frame is incomplete, it indicates that the remaining image processing performance for the previous frame is insufficient. In this case, the number of read image paths for the previous frame can be obtained. If the number of read image paths for the previous frame is greater than a preset threshold, it indicates that the frame rate can be reduced by decreasing the number of read image paths. That is, the number of read image paths is gradually reduced based on the number of read image paths for the previous frame. Each time it is reduced, it is determined whether the adjusted number of read image paths matches the remaining image processing performance. Specifically, it is determined whether the image processing unit can complete all processing within one frame after reading the second preview echo image of the current frame based on the reduced number of read image paths. If it can complete all processing within one frame, it indicates that the adjusted number of read image paths matches the remaining image processing performance, and the adjustment can be stopped. If the image processing unit cannot complete all processing within one frame, it indicates that the remaining image processing performance is still insufficient, and the number of read image paths can be further reduced. If the adjusted number of read image paths matches the remaining image processing performance, the adjustment can be stopped.

[0069] Optionally, the preset threshold for the number of channels is the minimum number of image reading channels. For example, the preset threshold for the number of channels can be 1 channel.

[0070] Further, the step of successively reducing the number of image reading paths in the previous frame, and stopping the adjustment if the adjusted number of image reading paths matches the remaining image processing performance, includes:

[0071] S1. Determine the number of image reading paths for the current frame based on the path step size and the number of image reading paths in the previous frame; the number of image reading paths for the current frame is less than the number of image reading paths in the previous frame.

[0072] S2. Obtain the image processing results corresponding to all second preview echo images of the current frame; each second preview echo image is read after adjusting the number of read image channels of the current frame;

[0073] S3. If the image processing result of the current frame is that the processing is complete, determine that the number of image reading paths of the current frame matches the remaining performance of the image processing, and stop adjusting.

[0074] S4. If the image processing result of the current frame is that the processing is not completed, the number of image reading paths of the current frame is determined to be the new number of image reading paths of the previous frame, and steps S1 to S4 are repeated until the image processing result of the current frame is that the processing is completed and the adjustment stops.

[0075] For example, such as Figure 3 As shown, taking a step size of 1 for the number of read images in the previous frame as an example, the number of read images in the previous frame is adjusted to match the image processing performance, specifically including the following steps.

[0076] Step S1: Decrease the number of image channels read from the previous frame by 1, resulting in 4 image channels read in the current frame. The 5 channels of the first preview echo image from the previous frame are read over two frames; that is, 4 channels of the second preview echo image are read in the current frame, and 1 channel of the second preview echo image is read in the next frame. After reading the second preview echo image, it is sent to the image processing unit for image processing. It should be noted that after reducing the number of image channels read from the previous frame, the frame rate of the current frame is reduced to half the frame rate of the previous frame.

[0077] Step S2: After the current frame ends, receive the image processing status signals sent by the image processing unit for each of the four second preview echo images of the current frame. If all four image processing status signals are high-level signals, it indicates that the image processing results corresponding to the four second preview echo images are completed. If at least one of the four image processing status signals is low-level, it indicates that the image processing results corresponding to the four second preview echo images are not completed.

[0078] Step S3: If the image processing result corresponding to the 4 channels of the second preview echo image is complete, then it is determined that the number of image channels read in the current frame matches the remaining image processing performance, that is, the remaining image processing performance can currently process 4 channels of the second preview echo image. At this time, the adjustment can be stopped, the number of image channels read in the current frame can be saved, and the second preview echo image of the next frame can be read based on the number of image channels read in the current frame.

[0079] Step S4: If the image processing result corresponding to the 4 channels of the second preview echo image is "processing incomplete", it indicates that the number of read image channels in the current frame still exceeds the remaining image processing capacity. At this time, the number of read image channels in the current frame can be determined as the number of read image channels in the previous frame, and steps S1 to S4 can be repeated. That is, the number of read image channels in the previous frame is reduced by 1 to obtain the new number of read image channels in the current frame, which is 3. The remaining image processing capacity is then used to determine whether it is sufficient to process the 3 channels of the second preview echo image. If the image processing result of the new current frame is "processing completed", the adjustment is stopped.

[0080] It should be noted that the path count step size is the interval at which the number of paths is reduced each time the number of read images from the previous frame is adjusted. This step size is a positive number. Each time the number of read images is reduced, it can be either a constant step size or a non-constant step size. A constant step size indicates that the step size is fixed, while a non-constant step size indicates that the step size is variable. This path count step size can be determined based on the number of unprocessed image paths detected at the end of the frame. If there are many remaining image paths, the path count step size can be set to greater than 1; if there are few remaining image paths, the path count step size can be set to 1.

[0081] Furthermore, the reading specification parameters also include a block coefficient.

[0082] It should be noted that the block coefficient m represents the number of preview echo images read out in one frame (1 / m). m represents the block coefficient; the larger the block coefficient, the smaller the data volume of one frame read out, and the lower the frame rate. In this case, if one preview echo image channel requires m frames to be read completely, then num preview echo images require m frames to be read. Only num frames can be read completely. After adjusting the block coefficients, and assuming the number of image channels n reaches the preset threshold, the adjusted preview echo image frame rate can be determined to be f / (m). (num), to further reduce the frame rate.

[0083] Furthermore, the method also includes:

[0084] If the number of image reading paths in the current frame after adjustment is the preset threshold for the number of paths, and the image processing result of the current frame is that the processing is not completed, the block coefficient of the previous frame is obtained. If the block coefficient of the previous frame is less than the preset threshold for block processing, the block coefficient of the previous frame is increased successively. If the adjusted image processing result is that the processing is completed, the adjustment is stopped, and it is determined that the adjusted block coefficient is consistent with the remaining performance of the image processing.

[0085] Specifically, such as Figure 3 As shown, if the number of image reading paths is gradually reduced until it reaches a preset threshold, but the corresponding image processing result is still incomplete, it indicates that the remaining image processing performance is limited, and it is impossible to further reduce the frame rate by decreasing the number of image reading paths to satisfy the remaining image processing performance. At this point, the block coefficient of the previous frame can be obtained. If the block coefficient of the previous frame is less than the preset block threshold, it indicates that the frame rate can be further reduced by increasing the block coefficient to decrease the amount of data read from the preview echo image in one frame. That is, the block coefficients are increased sequentially based on the previous frame. Each increase reduces the amount of data read from the second preview echo image in the next frame. This allows for a determination of whether the adjusted block coefficients match the remaining image processing performance. Specifically, it determines whether the image processing unit can complete all processing within one frame after reading the second preview echo image of the current frame based on the increased block coefficients. If all processing can be completed within one frame, it indicates that the adjusted block coefficients match the remaining image processing performance, and the adjustment can be stopped. If the image processing unit cannot complete all processing within one frame, it indicates that the remaining image processing performance is still insufficient, and the block coefficients can be increased further. If the adjusted block coefficients match the remaining image processing performance, the adjustment can be stopped.

[0086] It should be noted that the block coefficients can be increased with either equal or unequal step sizes. Equal step sizes mean the block increment is a fixed value, while unequal step sizes mean the block increment is a variable value. The block increment is the interval between each increase in block coefficients during the successive adjustment of the previous frame; this interval is a positive number. This block increment can be determined based on the number of unprocessed image paths detected at the end of the frame.

[0087] It should be noted that the preset threshold for segmentation is the maximum value of the segmentation coefficient, that is, the maximum value of segmenting one channel of the second pre-monitoring echo image. For example, the preset threshold for segmentation can be 8, 9, 10, etc., and the embodiments of the present invention do not limit this.

[0088] Furthermore, the reading specification parameters also include a resolution coefficient.

[0089] It should be noted that the resolution coefficient k indicates that when reading the preview image, the resolution of the preview image is reduced to 1 / k in both the row and column directions. The value of k can be 2, 3, 4, etc. For example, when k is 2, it means that the row and column directions of the preview image are both 1 / 2 of the original preview image. In this case, the adjusted image resolution is 1 / 4 of the original preview image. Similarly, when k is 3, it means that the row and column directions of the preview image are both 1 / 3 of the original preview image. In this case, the adjusted image resolution is 1 / 9 of the original preview image. And when k is 4, it means that the row and column directions of the preview image are both 1 / 4 of the original preview image. In this case, the adjusted image resolution is 1 / 16 of the original preview image.

[0090] Furthermore, the method also includes:

[0091] If the adjusted block coefficient is the preset block threshold, and the adjusted image processing result is that the processing is not completed, obtain the resolution coefficient of the previous frame, and if the resolution coefficient of the previous frame is less than the preset resolution threshold, increase the resolution coefficient of the previous frame one by one. If the adjusted image processing result is that the processing is completed, stop adjusting, and determine that the adjusted resolution coefficient is consistent with the remaining performance of the image processing.

[0092] Specifically, such as Figure 3As shown, in the process of reducing the frame rate by increasing the block coefficient, the frame rate cannot be reduced indefinitely. If the frame rate is too low, the preview image display will exhibit noticeable stuttering, significantly impacting its quality. Therefore, if the adjusted block coefficient reaches the preset block threshold, it indicates that the frame rate has dropped to the preset threshold. At this point, the resolution coefficient of the previous frame can be further obtained. If this resolution coefficient is less than the preset resolution threshold, it indicates that the image resolution of the read preview image can be reduced by increasing the resolution coefficient. This reduces the frame rate, ensuring the quality of the preview image and satisfying the remaining image processing performance. That is, the resolution coefficient is increased successively based on the previous frame. Each time it is increased, the resolution of the second preview echo image read in the next frame decreases. Then it is determined whether the adjusted resolution coefficient matches the remaining image processing performance. That is, it is determined whether the image processing unit can complete all processing within one frame after reading the second preview echo image of the current frame according to the increased resolution coefficient. If it can complete all processing within one frame, it means that the adjusted resolution coefficient matches the remaining image processing performance, and the adjustment can be stopped. If the image processing unit cannot complete all processing within one frame, it means that the remaining image processing performance is still insufficient, and the resolution coefficient can be increased again. If the adjusted resolution coefficient matches the remaining image processing performance, the adjustment can be stopped.

[0093] It should be noted that when increasing the resolution coefficient, the increment can be either constant or non-constant. Constant increments indicate a fixed resolution increment, while non-constant increments indicate a variable resolution increment. The resolution increment is the interval between each resolution increase during the successive adjustment of the previous frame's resolution coefficient; this interval is a positive number. This resolution increment can be determined based on the number of unprocessed image paths detected at the end of the frame.

[0094] It should be noted that increasing or decreasing the resolution can be achieved in two ways. The first is to scale the image to a lower resolution after the pre-monitoring echo image has been fully read, but this method consumes image processing resources. The second is to downsample the image during the reading process, i.e., to extract data at a ratio of 1 / k in both the row and column directions. In this embodiment of the invention, the second downsampling method is preferred for reducing the resolution, as it consumes less image processing resources and allows for more image processing performance to be reserved for image services.

[0095] The preview echo image specification adjustment method provided by this invention receives the image processing status signal corresponding to the processing of each channel of the first preview echo image in the previous frame by the image processing unit. Based on the image processing status signal corresponding to each channel, the image processing result corresponding to each channel of the first preview echo image is determined. If the image processing result of the previous frame is that the processing is not completed, it indicates that the reserved image processing performance of the previous frame is insufficient. The reading specification parameters can be adjusted to match the remaining image processing performance. This can make full use of the remaining image processing performance, avoid the waste of the remaining image processing performance, reduce the consumption of image processing performance, and avoid affecting the performance of the large screen image.

[0096] The preview image specification adjustment device provided by the present invention is described below. The preview image specification adjustment device described below and the preview image specification adjustment method described above can be referred to in correspondence.

[0097] This invention also provides a device for adjusting the specifications of a preview echo image. Figure 4 This is a schematic diagram of the pre-monitoring and echo image specification adjustment device provided in an embodiment of the present invention, as shown below. Figure 4 As shown, the preview and display image specification adjustment device 400 includes: a receiving module 410, a determining module 420, and an adjustment module 430.

[0098] The receiving module 410 is used to receive the image processing status signals corresponding to each of all channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0099] The determining module 420 is used to determine the image processing result corresponding to the first preview echo image of all paths based on the image processing status signal corresponding to each of the paths; the image processing result is used to characterize the remaining image processing performance of the image processing unit.

[0100] The adjustment module 430 is used to adjust the reading specification parameters to match the remaining performance of the image processing when it is determined that the image processing result of the previous frame is incomplete.

[0101] The preview echo image specification adjustment device provided by the present invention receives the image processing status signal corresponding to the processing of each channel of the first preview echo image in the previous frame by the image processing unit. Based on the image processing status signal corresponding to each channel, the device determines the image processing result corresponding to each channel of the first preview echo image. If the image processing result of the previous frame is that the processing is not completed, it indicates that the reserved image processing performance of the previous frame is insufficient. The device can adjust the reading specification parameters to match the remaining image processing performance, which can make full use of the remaining image processing performance, avoid the waste of the remaining image processing performance, reduce the consumption of image processing performance, and avoid affecting the performance of the large screen image.

[0102] Optionally, module 420 is specifically used for:

[0103] When all the image processing status signals are processing completion signals, the image processing result corresponding to all the first preview echo images is determined to be processing completion;

[0104] If at least one image processing status signal in the image processing status signals corresponding to each of all paths is a processing incomplete signal, then the image processing result corresponding to the first preview echo image of all paths is determined to be a processing incomplete signal.

[0105] Optionally, the reading specification parameters include the number of image channels read.

[0106] Optionally, the adjustment module 430 is specifically used for:

[0107] Get the number of image paths read from the previous frame;

[0108] If the number of read images in the previous frame is greater than a preset threshold, the number of read images in the previous frame is gradually reduced. If the adjusted number of read images matches the remaining performance of the image processing, the adjustment is stopped.

[0109] Optionally, the adjustment module 430 is specifically used for:

[0110] S1. Determine the number of image reading paths for the current frame based on the path step size and the number of image reading paths in the previous frame; the number of image reading paths for the current frame is less than the number of image reading paths in the previous frame.

[0111] S2. Obtain the image processing results corresponding to all second preview echo images of the current frame; each second preview echo image is read after adjusting the number of read image channels of the current frame;

[0112] S3. If the image processing result of the current frame is that the processing is complete, determine that the number of image reading paths of the current frame matches the remaining performance of the image processing, and stop adjusting.

[0113] S4. If the image processing result of the current frame is that the processing is not completed, the number of image reading paths of the current frame is determined to be the new number of image reading paths of the previous frame, and steps S1 to S4 are repeated until the image processing result of the current frame is that the processing is completed and the adjustment stops.

[0114] Optionally, the read specification parameters may also include a block coefficient.

[0115] Optionally, the preview echo image specification adjustment device 400 further includes a first amplification module, which is specifically used for:

[0116] If the number of image reading paths in the current frame after adjustment is the preset threshold for the number of paths, and the image processing result of the current frame is that the processing is not completed, the block coefficient of the previous frame is obtained. If the block coefficient of the previous frame is less than the preset threshold for block processing, the block coefficient of the previous frame is increased successively. If the adjusted image processing result is that the processing is completed, the adjustment is stopped, and it is determined that the adjusted block coefficient is consistent with the remaining performance of the image processing.

[0117] Optionally, the reading specification parameters may also include a resolution factor.

[0118] Optionally, the preview echo image specification adjustment device 400 further includes a second enlargement module, which is specifically used for:

[0119] If the adjusted block coefficient is the preset block threshold, and the adjusted image processing result is that the processing is not completed, obtain the resolution coefficient of the previous frame, and if the resolution coefficient of the previous frame is less than the preset resolution threshold, increase the resolution coefficient of the previous frame one by one. If the adjusted image processing result is that the processing is completed, stop adjusting, and determine that the adjusted resolution coefficient is consistent with the remaining performance of the image processing.

[0120] This invention also provides a controller. Figure 5 This is a schematic diagram of the structure of the controller provided in an embodiment of the present invention, as shown below. Figure 5 As shown, the image acquisition unit 510, image buffer unit 520, image processing unit 530, image output unit 540, image distribution unit 550, and synchronization unit 560, wherein:

[0121] The image acquisition unit 510 is connected to the image buffer unit 520, and the image acquisition unit 510 is used to acquire at least one pre-monitoring and display image.

[0122] The image cache unit 520 is connected to the image processing unit 530 and the image allocation unit 550 respectively. The image cache unit 520 is used to store the at least one pre-monitoring echo image sent by the image acquisition unit 510.

[0123] The image processing unit 530 is also connected to the image output unit 540. The image processing unit 530 is used to process the at least one pre-monitoring echo image and determine the image processing status signal corresponding to each pre-monitoring echo image.

[0124] The image output unit 540 is used to output the processed pre-monitoring echo image;

[0125] The image allocation unit 550 is used to perform the pre-monitoring echo image specification adjustment method as described in any of the above-mentioned items;

[0126] The synchronization unit 560 is used to control the image allocation unit 550 to periodically read the preview echo image from the image cache unit 520.

[0127] It should be noted that the splicing controller may include multiple image acquisition units 510, each with a different frame rate and resolution. After acquiring at least one preview echo image, each image acquisition unit 510 can write at least one preview echo image into the image buffer unit 520. Furthermore, to ensure the synchronization of different input sources, i.e., to ensure the synchronization of different image acquisition units 510, the image processing unit 530 performs image processing at the frame rate of the synchronization signal determined by the synchronization unit 560. Specifically, the image allocation unit 550 receives the periodic synchronization signal sent by the synchronization unit 560, and can periodically read the preview echo image from the image buffer unit 520 using the synchronization signal, then send it to the image processing unit 530 for periodic processing. After processing, the image processing unit 530 can periodically send the processed image to the image output unit 540 for display on a large screen.

[0128] Furthermore, after processing, the image processing unit 530 can display the preview image at the same frame rate as the large screen, or display it at a reduced frame rate.

[0129] Figure 6 This is a schematic diagram of the structure of the image allocation unit provided in an embodiment of the present invention, as shown below. Figure 6As shown, the image allocation unit 550 may include: a processor 610, a communication interface 620, a memory 630, and a communication bus 640, wherein the processor 610, the communication interface 620, and the memory 630 communicate with each other through the communication bus 640. The processor 610 can call logical instructions in the memory 630 to execute a preview echo image specification adjustment method, which includes:

[0130] Receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0131] Based on the image processing status signals corresponding to each of the paths, the image processing results corresponding to the first pre-monitoring echo images of all paths are determined; the image processing results are used to characterize the remaining image processing performance of the image processing unit.

[0132] If it is determined that the image processing result of the previous frame is incomplete, the reading specification parameters are adjusted to match the remaining performance of the image processing.

[0133] Furthermore, the logical instructions in the aforementioned memory 630 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0134] On the other hand, the present invention also provides a computer program product, the computer program product comprising a computer program that can be stored on a computer-readable storage medium, wherein when the computer program is executed by a processor, the computer is able to execute the preview echo image specification adjustment method provided by the above methods, the method comprising:

[0135] Receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0136] Based on the image processing status signals corresponding to each of the paths, the image processing results corresponding to the first pre-monitoring echo images of all paths are determined; the image processing results are used to characterize the remaining image processing performance of the image processing unit.

[0137] If it is determined that the image processing result of the previous frame is incomplete, the reading specification parameters are adjusted to match the remaining performance of the image processing.

[0138] In another aspect, the present invention also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the preview echo image specification adjustment method provided by the methods described above, the method comprising:

[0139] Receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame.

[0140] Based on the image processing status signals corresponding to each of the paths, the image processing results corresponding to the first pre-monitoring echo images of all paths are determined; the image processing results are used to characterize the remaining image processing performance of the image processing unit.

[0141] If it is determined that the image processing result of the previous frame is incomplete, the reading specification parameters are adjusted to match the remaining performance of the image processing.

[0142] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0143] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0144] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A pre-monitoring echo image specification adjustment method, characterized by, include: Receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame. Based on the image processing status signals corresponding to each of the paths, determine the image processing results corresponding to the first pre-monitoring echo image of each path; The image processing result is used to characterize the remaining image processing performance of the image processing unit. If the image processing result of the previous frame is determined to be incomplete, the reading specification parameters are adjusted in a stepwise manner until they match the remaining performance of the image processing. The reading specification parameters include at least one of the following: number of image reading paths, block coefficient, and resolution coefficient, and the adjustment priority of the number of image reading paths, the block coefficient, and the resolution coefficient decreases in that order. The stepwise adjustment of the reading specifications until they match the remaining performance of the image processing includes: Obtain the number of read image paths for the previous frame; the number of read image paths is the number of single-frame paths for reading the preview echo image within a single frame; If the number of read images in the previous frame is greater than a preset threshold, the number of read images in the previous frame is gradually reduced. If the adjusted number of read images matches the remaining performance of the image processing, the adjustment is stopped. If the number of image reading paths in the current frame after adjustment is the preset threshold for the number of paths, and the image processing result of the current frame is that the processing is not completed, the block coefficient of the previous frame is obtained, where the block coefficient m represents a frame that reads 1 / m of the pre-monitoring echo image; if the block coefficient of the previous frame is less than the preset threshold for block, the block coefficient of the previous frame is increased successively. If the adjusted image processing result is that the processing is completed, the adjustment is stopped, and it is determined that the adjusted block coefficient is consistent with the remaining performance of the image processing.

2. The pre-monitor echo image specification adjustment method of claim 1, wherein, The process of successively reducing the number of image read paths in the previous frame, and stopping the adjustment if the adjusted number of image read paths matches the remaining image processing performance, includes: S1. Determine the number of image reading paths for the current frame based on the path step size and the number of image reading paths in the previous frame; the number of image reading paths for the current frame is less than the number of image reading paths in the previous frame. S2. Obtain the image processing results corresponding to all second preview echo images of the current frame; each second preview echo image is read after adjusting the number of read image channels of the current frame; S3. If the image processing result of the current frame is that the processing is complete, determine that the number of image reading paths of the current frame matches the remaining performance of the image processing, and stop adjusting. S4. If the image processing result of the current frame is that the processing is not completed, the number of image reading paths of the current frame is determined to be the new number of image reading paths of the previous frame, and steps S1 to S4 are repeated until the image processing result of the current frame is that the processing is completed and the adjustment stops.

3. The pre-monitor echo image specification adjustment method of claim 1, wherein, The method further includes: If the adjusted block coefficient is the preset block threshold, and the adjusted image processing result is that the processing is not completed, obtain the resolution coefficient of the previous frame, and if the resolution coefficient of the previous frame is less than the preset resolution threshold, increase the resolution coefficient of the previous frame one by one. If the adjusted image processing result is that the processing is completed, stop adjusting, and determine that the adjusted resolution coefficient is consistent with the remaining performance of the image processing.

4. The pre-monitor echo image specification adjustment method according to any one of claims 1 to 3, characterized in that, The step of determining the image processing results corresponding to the first preview echo image of all paths based on the image processing status signals corresponding to each of the paths includes: When all the image processing status signals are processing completion signals, the image processing result corresponding to all the first preview echo images is determined to be processing completion; If at least one image processing status signal in the image processing status signals corresponding to each of all paths is a processing incomplete signal, then the image processing result corresponding to the first preview echo image of all paths is determined to be a processing incomplete signal.

5. A pre-monitoring echo image specification adjustment apparatus characterized by comprising: include: The receiving module is used to receive the image processing status signals corresponding to each of the channels in the previous frame; each of the image processing status signals is determined by the image processing unit after processing each of the first preview echo images in the previous frame. The determination module is used to determine the image processing result corresponding to the first preview echo image of all paths based on the image processing status signal corresponding to each of the paths. The image processing result is used to characterize the remaining image processing performance of the image processing unit. An adjustment module is used to perform a stepwise adjustment of the reading specification parameters when it is determined that the image processing result of the previous frame is incomplete, until it matches the remaining performance of the image processing; the reading specification parameters include at least one of the number of image reading paths, the block coefficient, and the resolution coefficient, and the adjustment priority of the number of image reading paths, the block coefficient, and the resolution coefficient decreases in that order; The adjustment module is specifically used for: obtaining the number of image reading paths in the previous frame; the number of image reading paths is the number of paths for reading preview echo images in a single frame; if the number of image reading paths in the previous frame is greater than a preset threshold, the number of image reading paths in the previous frame is gradually decreased, and the adjustment stops if the adjusted number of image reading paths matches the remaining performance of the image processing; if the number of image reading paths in the current frame after adjustment is the preset threshold, and the image processing result of the current frame is that the processing is not completed, the block coefficient of the previous frame is obtained, where the block coefficient m represents the preview echo image read in one frame (1 / m); if the block coefficient of the previous frame is less than a preset threshold, the block coefficient of the previous frame is gradually increased, and the adjustment stops if the adjusted image processing result is that the processing is completed, and the adjusted block coefficient matches the remaining performance of the image processing.

6. A patch panel, comprising: include: The system comprises an image acquisition unit, an image buffer unit, an image processing unit, an image output unit, an image allocation unit, and a synchronization unit, wherein: The image acquisition unit is connected to the image buffer unit, and the image acquisition unit is used to acquire at least one pre-monitoring and display image. The image buffer unit is connected to the image processing unit and the image allocation unit respectively, and the image buffer unit is used to store the at least one pre-monitoring echo image sent by the image acquisition unit; The image processing unit is also connected to the image output unit. The image processing unit is used to process the at least one pre-monitoring echo image and determine the image processing status signal corresponding to each pre-monitoring echo image. The image output unit is used to output the processed pre-monitoring echo image; The image allocation unit is used to perform the preview echo image specification adjustment method as described in any one of claims 1 to 4; The synchronization unit is used to control the image allocation unit to periodically read the preview echo image from the image cache unit.

7. The tileable controller of claim 6, wherein, The image allocation unit includes: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the preview echo image specification adjustment method as described in any one of claims 1 to 4.

8. A computer readable storage medium having stored thereon a computer program, characterized in that, When the computer program is executed by the processor, it implements the preview echo image specification adjustment method as described in any one of claims 1 to 4.

Images