Pre-monitoring echo display method, apparatus and system, and video wall processor and storage medium

Abstract

A pre-monitoring echo display method, apparatus and system, and a video wall processor and a storage medium. The method comprises: determining at least one reference scaling processing resource of an input board in a video wall processor, wherein the reference scaling processing resource is a scaling processing resource that is allocated from a plurality of image scaling processing resources associated with the input board and is used for supporting the execution of a pre-monitoring echo function (S110); alternately arranging target image frames respectively corresponding to a target number of image input channels in the input board, and then transmitting the target image frames to the reference scaling processing resource for sequential processing (S120); and sending, to a pre-monitoring echo board in the video wall processor, pre-monitoring images processed and outputted by the reference scaling processing resource in the input board, such that the pre-monitoring echo board performs a pre-monitoring echo on the pre-monitoring images (S130).

Description

Preview echo display method, device, system, splicing processor and storage medium

[0001] This application claims priority to Chinese Patent Application No. 202411023592.9, filed on July 29, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of image display technology, such as a preview display method, apparatus, system, splicing processor, and storage medium. Background Technology

[0003] Video wall processors support multiple input interfaces and are widely used in various scenarios such as conferences, exhibitions, and command centers. Before projecting the processed image onto a screen, previewing and echoing of the desired image is required. The input boards of the video wall processor primarily utilize Field-Programmable Gate Arrays (FPGAs) to achieve this functionality. However, FPGA resources are limited. Under the premise of meeting real-time business needs, there are almost no extra resources to implement previewing and echoing. This increases the cost of enabling previewing and echoing functions in video wall processors and negatively impacts the user experience. Summary of the Invention

[0004] This application provides a preview echo display method, device, system, splicing processor, and storage medium to solve the problem of insufficient scaling resources of the splicing processor input board to achieve the preview echo function.

[0005] In a first aspect, embodiments of this application provide a method for displaying preview echoes, the method comprising:

[0006] Determine at least one reference scaling processing resource for the input board in the stitching processor, wherein the reference scaling processing resource is a scaling processing resource allocated from the multi-channel image scaling processing resources associated with the input board to support the preview echo function;

[0007] The target images corresponding to each frame of the target number of image input channels in the input board are alternately arranged and transmitted to the reference scaling processing resource for sequential processing.

[0008] The pre-monitoring image output from the reference scaling processing resource in the input board is sent to the pre-monitoring echo board in the stitching processor so that the pre-monitoring echo board can perform pre-monitoring echo of the pre-monitoring image.

[0009] Secondly, embodiments of this application also provide a preview echo display device, configured in a splicing processor, the device comprising:

[0010] The determination module is configured to determine at least one reference scaling processing resource of the input board in the stitching processor, wherein the reference scaling processing resource is a scaling processing resource allocated from the multiple image scaling processing resources associated with the input board to support the preview echo function;

[0011] The transmission module is configured to alternately arrange each frame of target image corresponding to the target number of image input channels in the input board and transmit it to the reference scaling processing resource for sequential processing.

[0012] The sending module is configured to send the pre-monitoring image output from the reference scaling processing resource in the input board to the pre-monitoring echo board in the stitching processor, so that the pre-monitoring echo board can perform pre-monitoring echo of the pre-monitoring image.

[0013] Thirdly, embodiments of this application also provide a preview echo display system, the system comprising: an input board and a preview echo board in a splicing processor;

[0014] The input board is configured to determine at least one reference scaling processing resource in the stitching processor, wherein the reference scaling processing resource is a scaling processing resource allocated from multiple image scaling processing resources associated with the input board to support the preview echo function.

[0015] The input board is configured to alternately arrange each frame of target image corresponding to the target number of image input channels in the input board and then transmit it to the reference scaling processing resource for sequential processing.

[0016] The input board is configured to send the preview image output from the reference scaling processing resources in the input board to the preview echo board in the stitching processor, so that the preview echo board can perform preview echo of the preview image.

[0017] Fourthly, this application also provides a splicing processor, including:

[0018] At least one processor; and

[0019] A memory that is communicatively connected to at least one processor; wherein,

[0020] The memory stores a computer program that can be executed by at least one processor, such that the at least one processor is able to perform the preview echo display method of any of the above embodiments.

[0021] Fifthly, this application also provides a computer-readable medium storing computer instructions that, when executed by a processor, implement the preview echo display method of any of the above embodiments. Attached Figure Description

[0022] Throughout the accompanying drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and the originals and elements are not necessarily drawn to scale.

[0023] Figure 1 is a schematic flowchart of a preview echo display method provided in an embodiment of this application;

[0024] Figure 2A is a schematic diagram of the structure of a splicing processor provided in an embodiment of this application;

[0025] Figure 2B is a schematic diagram of another splicing processor provided in an embodiment of this application;

[0026] Figure 3 is a schematic diagram of the alternating arrangement of scaling processing resources provided in an embodiment of this application;

[0027] Figure 4A is a schematic diagram of time slot allocation for an input board provided in an embodiment of this application;

[0028] Figure 4B is a schematic diagram of data blocking when multiple input boards send image data, as provided in an embodiment of this application;

[0029] Figure 4C is a timing diagram of data blocking that occurs when multiple input boards send image data, as provided in an embodiment of this application.

[0030] Figure 4D is a schematic diagram of image data transmission by allocating time slots for different input boards according to an embodiment of this application;

[0031] Figure 5 is a schematic diagram of multiple input boards sending image data to a pre-monitoring display board according to an embodiment of this application;

[0032] Figure 6 is a schematic diagram of the structure of a preview display device provided in an embodiment of this application;

[0033] Figure 7 is a schematic diagram of the structure of a splicing processor for implementing a preview echo display method provided in an embodiment of this application. Detailed Implementation

[0034] Embodiments of this application will now be described with reference to the accompanying drawings. While some embodiments related to this application are shown in the drawings, it should be understood that this application can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. The drawings and embodiments of this application are for illustrative purposes only.

[0035] The multiple steps described in the method embodiments of this application can be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown.

[0036] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to". The term "based on" means "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Definitions of other terms will be given in the description below.

[0037] The concepts of "first" and "second" mentioned in this application are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0038] The terms “a” and “a plurality” used in this application are illustrative and should be understood by those skilled in the art to mean “one or more” unless otherwise expressly indicated in the context.

[0039] The names of the messages or information exchanged between multiple devices in the embodiments of this application are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0040] Figure 1 is a flowchart illustrating a preview and echo display method provided in an embodiment of this application. This embodiment is applicable to the scenario of previewing and echoing an image that is about to be displayed on a wall after passing through an input board. The method can be executed by a preview and echo display device, which can be implemented in software and / or hardware. Optionally, it can be implemented by a splicing processor, which can be a mobile terminal, a personal computer (PC), or a server, for example, a splicing processor.

[0041] As shown in Figure 1, the display method for preview echo in this embodiment may include the following process:

[0042] S110. Determine at least one reference scaling processing resource of the input board in the splicing processor. The reference scaling processing resource is a scaling processing resource allocated from the multi-channel image scaling processing resources associated with the input board to support the preview echo function.

[0043] Referring to Figure 2A, the video wall processor includes input and output boards. The input boards of the video wall processor can support numerous video input ports, allowing access to multiple video feeds from sources such as computers, conferencing terminals, and converged media. The video wall processor supports using the scaling processing resources of the input boards to process these video feeds before displaying them on the video wall. Before displaying the video feeds on the video wall, pre-monitoring and playback are typically required. The scaling processing resources of the input boards can be implemented using the FPGA within the input boards of the video wall processor.

[0044] In some embodiments, the characters in Figures 2A and 2B represent the following: VID + numbers (i.e., VID1, VID2, VID3, and VID4) are used to distinguish specific video input or output channels; DDR represents Double Data Rate, used for fast data processing; SCALER*8 represents 8 video scalers (SCALERs), used to adjust video size; PCIE_TX represents the transmitter of the Peripheral Component Interconnect Express (PCIE) interface, used to transmit data; PCIE SW represents a PCIE switch, used to connect multiple PCIE devices and switch communication paths; PCIE_RX represents the receiver of the PCIE interface, used to receive data; DA_TX represents Digital-to-Analog Transmit, used to convert digital signals into analog signals and transmit analog signals externally; VPSS represents the Video Processing Sub-System, used for video preprocessing and other operations; VENC represents the Video Encoding Module (Video... ENCoder is used to encode and compress video; GE_TX represents Gigabit Ethernet Transmit, used to transmit the processed video data to other devices via Ethernet.

[0045] The input board of the splicing processor has limited scaling processing resources. Once these resources are sufficient for live operations, there is almost no spare capacity for preview / echo functionality. For example, if the input board has 8 channels of 1080P30 scaling resources, and assuming four image input channels, each requiring 2 channels of 1080P30 scaling processing resources, there are no remaining resources available for preview / echo.

[0046] Referring to Figure 2B, a preview echo board is configured on the splicing processor. The multi-channel scaling processing resources in the splicing processor's input board can be reallocated. At least one reference scaling processing resource is allocated from the multi-channel scaling processing resources associated with the splicing processor's input board. This reference scaling processing resource supports the processing of images from different image input channels connected to the input board before inputting them to the preview echo board for preview echo. The remaining scaling processing resources (excluding the reference scaling processing resource) associated with the splicing processor's input board are then used to support the input to the output board for wall display. By rationally allocating a dedicated reference scaling processing resource from the multi-channel image scaling processing resources associated with the input board in the splicing processor, the preview echo function can be successfully supported without adding additional scaling processing resources.

[0047] Previewing and feedback refers to the function of previewing and monitoring the image before it is officially output to the display screen. Previewing and feedback allows users to preview the image before switching between screens, effectively checking if the signal is normal. When a video wall processor is equipped with previewing and feedback functionality, the content and status of the signal source can be viewed in advance on a separate display area or device, allowing for timely detection and adjustments to avoid displaying problematic images directly on the wall. This feature is useful in environments such as monitoring systems, studios, and conference rooms.

[0048] As an optional implementation, referring to Figure 2B, at least one reference scaling processing resource includes at least one of the following: a scaling processing resource allocated from the multi-channel image scaling processing resources pre-configured on the splicing processor board for supporting preview and echo of an image at a first resolution, or a scaling processing resource allocated from the multi-channel image scaling processing resources pre-configured on the splicing processor board for supporting preview and echo of an image at a second resolution, wherein the first resolution is greater than the second resolution.

[0049] Considering the insufficient scaling processing resources in the input board, the functions to be supported by the multi-channel image scaling processing resources pre-configured in the input board of the splicing processor are reallocated. Scaling processing resources for input to the output board for wall display and scaling processing resources for input to the pre-monitoring and echo board for pre-monitoring and echo are allocated from these scaling processing resources.

[0050] Considering that during preview playback, either high-definition or non-high-definition preview playback may be selected, the scaling processing resources used to support this function can be divided, for example, into one scaling processing resource for preview playback of images at a first resolution and another for preview playback of images at a second resolution. The first resolution may be a specific, higher resolution standard, while the second resolution may be a lower resolution standard. This allows for the use of specially allocated scaling processing resources to address the respective preview playback requirements of images at different resolutions.

[0051] For example, taking an input board in the splicing processor that includes 8 scaling processing resources, 6 scaling processing resources are allocated from the multi-channel image scaling processing resources associated with the input board for use with the output board for wall display, 1 scaling processing resource is allocated from the multi-channel image scaling processing resources associated with the input board for use with the preview and echo board for high-definition preview and echo, and 1 scaling processing resource is allocated from the multi-channel image scaling processing resources associated with the input board for use with the preview and echo board for non-high-definition preview and echo.

[0052] S120. The target images corresponding to each frame of the target number of image input channels in the input board are alternately arranged and transmitted to the reference scaling processing resource for sequential processing.

[0053] In some embodiments, the target images corresponding to each frame of the target number of image input channels in the input board can be alternately arranged and transmitted to the above-mentioned at least one reference scaling processing resource for sequential processing.

[0054] Referring to Figure 2B, after reallocating the multi-channel image scaling processing resources associated with the input board, a reference scaling processing resource for supporting the preview and echo function is determined. However, the input board corresponds to multiple image input channels. To better and faster process the target images corresponding to each of the multiple image input channels, the target images from different image input channels can be alternately arranged. The target images from different image input channels are arranged alternately in a certain order, and then the alternately arranged target images are transmitted to the reference scaling resource for sequential processing. For example, assuming there are three inputs: A, B, and C, the alternating arrangement may be as follows: the first element of A, the first element of B, the first element of C, then the second element of A, the second element of B, the second element of C, and so on.

[0055] For example, referring to Figure 3, taking the input board in the splicing processor as having 8 scaling processing resources as an example, the allocation result of the 30 frames of images that the scaling processing resources need to process is as follows: according to the order of the multiple target images corresponding to each of the different image input channels, each frame of the different image input channels is alternately arranged in turn. The first frame that the reference scaling processing resource needs to process is the first frame target image of the first image input channel. The second frame that the reference scaling processing resource needs to process switches to the first frame target image of the second image input channel, the third frame that needs to process is the first frame target image of the third image input channel, and the fourth frame that needs to process is the first frame target image of the fourth image input channel. Then, starting from the fifth frame that the reference scaling processing resource needs to process, it returns to the second frame target image of the first image input channel. The sixth frame that the reference scaling processing resource needs to process is the second frame target image of the second image input channel, the seventh frame that needs to process is the second frame target image of the third image input channel, the eighth frame that needs to process is the second frame target image of the fourth image input channel, and so on. This arrangement may be used in specific video processing, switching, or display scenarios to achieve specific effects or meet specific needs. In this way, a single 1080P30 scaling processing resource can contain target image information from four image input channels.

[0056] By adopting the above scheme, a variety of combinations and processing methods can be achieved by alternating the inputs of different paths. After the target images corresponding to each frame of different image input channels are arranged in an orderly alternation, they are transmitted to the reference scaling processing resource for sequential processing. This enables the processing of multiple images through one scaling processing resource, achieving the important function of multi-channel image preview and playback with minimal resources.

[0057] In some embodiments, for each frame of target image corresponding to the target number of image input channels within the input board, after alternating arrangement, the processing method can be determined based on the size of the alternating image resources. For example, if the alternating image resources are large (e.g., larger than a first value), the alternating images can be transmitted to all reference scaling processing resources for sequential processing; if the alternating image resources are of medium size (e.g., larger than a second value and smaller than a first value), they can be transmitted to some reference scaling processing resources for sequential processing; if the alternating image resources are small (e.g., smaller than a second value), they can be transmitted to only one reference scaling processing resource for sequential processing. The first, second, and third values ​​can be determined according to actual needs.

[0058] As an optional implementation, the target images are alternately arranged and transmitted to the reference scaling processing resources in multiple frames. The target images of consecutive target numbers belong to the target images of different image input channels in the input board.

[0059] As an optional implementation, the target quantity can be dynamically adjusted, and this dynamic adjustment allows the resolution and frame rate of each target image that can be processed by the reference scaling processing resources in the input board of the stitching processor to be dynamically allocated and adjusted.

[0060] The target number can be dynamically adjusted, meaning the number of image input channels that the reference scaling resource can handle can be flexibly adjusted and set as needed. This means the number of image input channels that the reference scaling resource can handle can be changed according to actual conditions. By dynamically adjusting the target number, the resolution and frame rate of each frame processed by the reference scaling resource can be dynamically allocated. In other words, the number of image input channels that can be processed will change according to the change in the target number, and the supported resolution and frame rate will also change dynamically accordingly.

[0061] Using the above method, dynamic adjustment and allocation can optimize the performance and efficiency of image processing. By dynamically adjusting the number of targets according to the actual situation, reference scaling processing resources can be better utilized, thereby improving the quality and speed of image processing.

[0062] S130. Send the preview image output from the reference scaling processing resource in the input board to the preview echo board in the stitching processor so that the preview echo board can perform preview echo of the preview image.

[0063] Referring to Figure 2B, the preview image, processed by the reference scaling resource, is obtained from the input board. This reference scaling resource scales the image. Then, this processed preview image data is transmitted to the preview display board in the stitching processor. The preview display board receives these preview images and performs a preview display operation, presenting the preview images on a specific display area or interface so that the preview images can be viewed in advance.

[0064] As an optional implementation, the stitching processor includes multiple input boards. The preview image output from the reference scaling processing resources on the input boards is sent to the preview echo board in the stitching processor, including the following steps:

[0065] When sending the preview images output from the reference scaling processing resources of multiple input boards to the same preview echo board, the preview images output from the reference scaling processing resources of each input board are assigned to different time slots corresponding to the same frame and sent sequentially to the preview echo board in the stitching processor.

[0066] Referring to Figure 4A, the images sent by the input board of the splicing processor are transmitted through time slots. The input board is allocated 64 time slots when sending each frame of image. Each time slot represents an image block of data. Therefore, the duration of transmission in each time slot is also different. The image data of the input board is sent to multiple output boards and the preview echo board.

[0067] Referring to Figure 4B, when multiple input cards simultaneously send image data to a single preview echo card, image data congestion occurs, leading to reduced PCIe bandwidth utilization and a longer transmission time to the preview echo card. For example, if the transmission time for all image data from multiple input cards exceeds 33.3 milliseconds, frame dropping will occur, as shown in Figure 4C.

[0068] For example, referring to Figure 4D, the input board of the splicing processor calculates and records the duration of data transmission for each time slot, including the transmission to the output board and the preview echo board. If time slot 2 of input board 1 and time slot 2 of input board 2 are both sent to the preview echo board, then PCIe blocking will occur, resulting in a longer transmission time for time slot 2.

[0069] The preview images output from the reference scaling processing resources of each input board are allocated to different time slots within the same frame. A time slot is a division of time used to allocate resources during communication or transmission. By allocating the preview images output from the reference scaling processing resources of each input board to different time slots, multiple preview images can be transmitted simultaneously within the same frame, improving transmission efficiency. Sending images in different time slots within the same frame allows for the allocation of different time slots within the same image frame to the preview images output from the reference scaling processing resources of different input boards, enabling the preview echo board to receive and display the preview images output from the reference scaling processing resources of each input board in a specific order, thus achieving complete display of the preview images output from the reference scaling processing resources of each input board. By allocating multiple preview images corresponding to the reference scaling processing resources of each input board to different time slots within the same frame, time slot resources can be effectively utilized when multiple input boards simultaneously send preview images, ensuring timely transmission and display of preview images.

[0070] The above solution, through reasonable and effective allocation of time slots, significantly reduces stuttering issues caused by competition between PCIe slots, resulting in smoother data transmission and processing. It effectively minimizes stuttering caused by PCIe contention, thus ensuring system stability and smoothness. By implementing scientific and reasonable allocation of time slots, the solution successfully reduces stuttering issues caused by PCIe contention, effectively improving overall operating efficiency and user experience.

[0071] As an optional implementation, referring to Figure 5, the preview images output from the reference scaling processing resources in each input board are allocated to different time slots corresponding to the same frame and sent sequentially to the preview echo board in the stitching processor, including the following steps B1-B3:

[0072] Step B1: For multiple input boards in the splicing processor, determine the transmission time of the pre-monitoring image corresponding to the input board when sending the pre-monitoring image from the input board to the pre-monitoring echo board.

[0073] Referring to Figure 5, for multiple input boards in the splicing processor, a pre-monitoring display board is needed to determine the time required for each input board to send its corresponding pre-monitoring image when sending pre-monitoring images from each input board to the pre-monitoring display board. For example, when all input boards send pre-monitoring image streams to the pre-monitoring display board, the pre-monitoring display board calculates the duration of each pre-monitoring image stream. For instance, if three input boards send pre-monitoring image streams to the pre-monitoring display board simultaneously, the pre-monitoring display board calculates and records the duration of each pre-monitoring image stream.

[0074] Step B2: Based on the transmission time of the pre-monitoring image corresponding to each input board, allocate time slots from multiple time slots corresponding to the same frame to the pre-monitoring image corresponding to each input board, so that the pre-monitoring images output by the reference scaling processing resources in each input board can be transmitted sequentially in different time slots of the same frame.

[0075] Referring to Figure 5, based on the transmission time of the pre-monitoring image corresponding to each input board, time slots are reasonably allocated within the same frame for each input board's corresponding pre-monitoring image across multiple time slots. This ensures that the same frame can correspond to and support the transmission of the pre-monitoring image output from the reference scaling processing resource in each input board, guaranteeing that each pre-monitoring image can be accurately transmitted within a specific time slot of the same frame. By allocating time slots to the pre-monitoring images obtained from the decomposition of the pre-monitoring image corresponding to each input board, the effect of allowing the pre-monitoring images output from the reference scaling processing resource in each input board to be transmitted sequentially in different time slots within the same frame is achieved.

[0076] Referring to Figure 5, the preview feedback board allocates time slots according to the video stream. The high-definition stream of input board 1 is 0-4 ms, and the non-high-definition stream is 4-5 ms. The high-definition stream of input board 2 is 5-9 ms, and the non-high-definition stream is 9-11 ms. The high-definition stream of input board 3 is 11-15 ms, and the non-high-definition stream is 15-18 ms. The two preview streams of input board 1 are 0-4 ms and 4-5 ms respectively. Based on the time slot allocation of all input boards in Figure 4A, the preview streams are allocated to time slots 2 and 3 respectively. Adding the 3 ms time from time slots 0 and 1, the times for time slots 2 and 3 to be sent to the preview board are 3-7 ms and 7-8 ms respectively. Therefore, the preview stream times for input boards 2 and 3 are 8-12 ms and 12-14 ms, and 14-18 ms and 18-21 ms respectively. Based on the time slot allocation of all input boards, time slots 4 and 5 are assigned to input board 2, with other image time slots allocated later; time slots 6 and 7 are assigned to input board 3. Allocating time slots for each input board according to the above steps can minimize the problem of video stream blockage when sending to the preview echo board.

[0077] Step B3: Send the pre-monitoring images to the pre-monitoring display board in the splicing processor in sequence according to the time slots allocated to the pre-monitoring images corresponding to each input board.

[0078] Referring to Figure 5, each pre-monitoring image is sent sequentially to the pre-monitoring display board in the splicing processor, according to the time slots allocated to each input board. In other words, the pre-monitoring images must be transmitted to the pre-monitoring display board in an orderly manner, strictly following the pre-planned time slot allocation scheme, to achieve effective transmission and display of the pre-monitoring images. This method allows for more efficient management and coordination of the pre-monitoring image transmission process across multiple input boards, avoiding conflicts and confusion, and improving the overall system performance.

[0079] The above scheme first determines the time required for each input board to send the preview image; then, based on this time data, multiple time slots are allocated to the preview image of each input board to ensure that each time slot corresponds to the same preview image data for transmission; finally, the preview images are sent to the preview echo board one by one according to the allocated time slot order to achieve a more orderly and efficient transmission process.

[0080] This application embodiment can rationally allocate reference scaling processing resources specifically for supporting preview and echo functions from the multi-channel image scaling processing resources associated with the input board in the splicing processor. In this way, it can successfully support the preview and echo function without adding new scaling processing resources. Furthermore, for each image frame corresponding to the target number of image input channels in the input board, after the target images corresponding to each frame of each different image input channel are arranged in an orderly alternating manner, they are transmitted to the reference scaling processing resources for sequential processing. This enables the processing of multiple images through one scaling processing resource, achieving the important function of multi-channel image preview and echo with minimal resources. It effectively solves the problem of implementing the preview and echo function when the scaling resources of the splicing processor input board are insufficient.

[0081] Figure 6 is a schematic diagram of a pre-monitoring and feedback display device provided in an embodiment of this application. This embodiment is applicable to the situation of pre-monitoring and feedback of images that are about to be displayed on the wall after passing through the input board. The pre-monitoring and feedback display device can be implemented in the form of software and / or hardware. Optionally, it can be implemented by a splicing processor, which can be a mobile terminal, PC or server, etc.

[0082] As shown in Figure 6, the display device for preview echoing in this embodiment may include the following process:

[0083] The determining module 610 is configured to determine at least one reference scaling processing resource of the input board in the splicing processor, wherein the reference scaling processing resource is a scaling processing resource allocated from the multi-channel image scaling processing resources associated with the input board to support the preview echo function.

[0084] The transmission module 620 is configured to alternately arrange each frame of target image corresponding to the target number of image input channels in the input board and transmit it to the reference scaling processing resource for sequential processing;

[0085] The sending module 630 is configured to send the pre-monitoring image output from the reference scaling processing resource in the input board to the pre-monitoring echo board in the stitching processor, so that the pre-monitoring echo board can perform pre-monitoring echo of the pre-monitoring image.

[0086] Based on the above embodiments, optionally, the at least one reference scaling processing resource includes at least one of the following: a scaling processing resource allocated from the multi-channel image scaling processing resources pre-configured on the splicing processor board for supporting preview and echo of an image at a first resolution, or a scaling processing resource allocated from the multi-channel image scaling processing resources pre-configured on the splicing processor board for supporting preview and echo of an image at a second resolution, wherein the first resolution is greater than the second resolution.

[0087] Based on the above embodiments, optionally, the value of the target quantity can be dynamically adjusted, and the dynamic adjustment of the value of the target quantity can dynamically allocate and adjust the resolution and frame rate of each frame of target image that can be processed by the reference scaling processing resources in the input board.

[0088] Based on the above embodiments, optionally, the multiple target images that are alternately arranged and transmitted to the reference scaling processing resource, the consecutive number of target images belong to the target images of different image input channels in the input board.

[0089] Based on the above embodiments, optionally, the stitching processor includes multiple input boards, and sending the preview image output from the reference scaling processing resources in the input boards to the preview echo board in the stitching processor includes:

[0090] When sending the preview images output from the reference scaling processing resources of multiple input boards to the same preview echo board, the preview images output from the reference scaling processing resources of each input board are assigned to different time slots corresponding to the same frame and sent sequentially to the preview echo board in the stitching processor.

[0091] Based on the above embodiments, optionally, the preview images output from the reference scaling processing resources in each input board are allocated to different time slots corresponding to the same frame and sent sequentially to the preview echo board in the stitching processor, including:

[0092] For the multiple input boards in the splicing processor, the time taken to send the pre-monitoring image corresponding to the input board is determined by the pre-monitoring echo board when sending the pre-monitoring image from the input board to the pre-monitoring echo board.

[0093] Based on the transmission time of the pre-monitoring image corresponding to each input board, a time slot is allocated from multiple time slots corresponding to the same frame to the pre-monitoring image corresponding to each input board, so that the pre-monitoring image output by the reference scaling processing resource in each input board can be transmitted sequentially in different time slots of the same frame.

[0094] Preview images are sent sequentially to the preview display board in the splicing processor according to the time slots allocated to the preview images corresponding to each input board.

[0095] This application embodiment can rationally allocate reference scaling processing resources specifically for supporting preview and echo functions from the multi-channel image scaling processing resources associated with the input board in the splicing processor. In this way, it can successfully support the preview and echo function without adding new scaling processing resources. Furthermore, for each image frame corresponding to the target number of image input channels in the input board, after the target images corresponding to each frame of each different image input channel are arranged in an orderly alternating manner, they are transmitted to the reference scaling processing resources for sequential processing. This enables the processing of multiple images through one scaling processing resource, achieving the important function of multi-channel image preview and echo with minimal resources. It effectively solves the problem of implementing the preview and echo function when the scaling resources of the splicing processor input board are insufficient.

[0096] The preview echo display device provided in this application embodiment can execute the preview echo display method provided in any embodiment of this application, and has the corresponding functional modules and beneficial effects of the execution method.

[0097] The multiple units and modules included in the above device are divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the name of each functional unit is only for easy differentiation between them.

[0098] This application provides a preview and echo display system, applicable to situations where images about to be displayed on a wall after passing through an input board are previewed and echoed. This preview and echo display system can be implemented in software and / or hardware. Specifically, the preview and echo display system in this embodiment may include the following: an input board and a preview and echo display board in the splicing processor;

[0099] The input board is configured to determine at least one reference scaling processing resource in the stitching processor, wherein the reference scaling processing resource is a scaling processing resource allocated from multiple image scaling processing resources associated with the input board to support the preview echo function.

[0100] The input board is configured to alternately arrange each frame of target image corresponding to the target number of image input channels in the input board and then transmit it to the reference scaling processing resource for sequential processing.

[0101] The input board is configured to send the preview image output from the reference scaling processing resources in the input board to the preview echo board in the stitching processor, so that the preview echo board can perform preview echo of the preview image.

[0102] Based on the above embodiments, optionally, the at least one reference scaling processing resource includes at least one of the following: a scaling processing resource allocated from the multi-channel image scaling processing resources pre-configured on the splicing processor board for supporting preview and echo of an image at a first resolution, or a scaling processing resource allocated from the multi-channel image scaling processing resources pre-configured on the splicing processor board for supporting preview and echo of an image at a second resolution, wherein the first resolution is greater than the second resolution.

[0103] Based on the above embodiments, optionally, the value of the target quantity can be dynamically adjusted, and the dynamic adjustment of the value of the target quantity can dynamically allocate and adjust the resolution and frame rate of each frame of target image that can be processed by the reference scaling processing resources in the input board.

[0104] Based on the above embodiments, optionally, the multiple target images that are alternately arranged and transmitted to the reference scaling processing resource, the consecutive number of target images belong to the target images of different image input channels in the input board.

[0105] Optionally, based on the above embodiments, the splicing processor includes multiple input boards;

[0106] The input board is configured to, when sending the preview images output from the reference scaling processing resources of multiple input boards to the same preview echo board, allocate the preview images output from the reference scaling processing resources of each input board to different time slots corresponding to the same frame and send them sequentially to the preview echo board in the stitching processor.

[0107] Based on the above embodiments, optionally, the pre-monitoring echo board is configured to determine the time taken to send the pre-monitoring image corresponding to the input board when sending the pre-monitoring image from the input board to the pre-monitoring echo board for multiple input boards in the splicing processor;

[0108] The input board is configured to allocate time slots from multiple time slots corresponding to the same frame to the pre-monitoring image of each input board according to the transmission time of the pre-monitoring image corresponding to each input board, so that the pre-monitoring image output by the reference scaling processing resource in each input board can be transmitted sequentially in different time slots of the same frame.

[0109] The input board is configured to send the pre-monitoring images to the pre-monitoring echo board in the stitching processor sequentially according to the time slots allocated to the pre-monitoring images corresponding to each input board.

[0110] This application embodiment can rationally allocate reference scaling processing resources specifically for supporting preview and echo functions from the multi-channel image scaling processing resources associated with the input board in the splicing processor. In this way, it can successfully support the preview and echo function without adding new scaling processing resources. Furthermore, for each image frame corresponding to the target number of image input channels in the input board, after the target images corresponding to each frame of each different image input channel are arranged in an orderly alternating manner, they are transmitted to the reference scaling processing resources for sequential processing. This enables the processing of multiple images through one scaling processing resource, achieving the important function of multi-channel image preview and echo with minimal resources. It effectively solves the problem of implementing the preview and echo function when the scaling resources of the splicing processor input board are insufficient.

[0111] The preview echo display system provided in this application embodiment can execute the preview echo display method provided in any embodiment of this application, and has the corresponding functional modules and beneficial effects of the execution method.

[0112] In some embodiments, this application provides a splicing processor, which may include: an input board and a pre-monitoring echo board. Wherein:

[0113] The input board is configured to: determine at least one reference scaling processing resource, which is a scaling processing resource allocated from the multi-channel image scaling processing resources associated with the input board to support the preview echo function; alternately arrange each frame of target images corresponding to the target number of image input channels in the input board and transmit them to the reference scaling processing resource for sequential processing; and send the preview image processed and output by the reference scaling processing resource in the input board to the preview echo board.

[0114] The preview echo board is configured to receive the preview image processed by the reference scaling processing resource from the input board and to preview the preview image.

[0115] In some embodiments, the stitching processor includes multiple input boards, each of which is configured to: when sending the preview image processed by its respective reference scaling processing resources to the same preview echo board, allocate the preview images output by its respective reference scaling processing resources to different time slots corresponding to the same frame, and send them to the same preview echo board in sequence.

[0116] In some embodiments, the pre-monitoring echo board is configured to: determine the transmission time of the pre-monitoring image corresponding to each input board when sending the pre-monitoring image from each input board to the pre-monitoring echo board for multiple input boards in the splicing processor; each input board is configured to: allocate time slots to its respective pre-monitoring image from multiple time slots corresponding to the same frame according to its respective pre-monitoring image transmission time, so that the pre-monitoring image output by the reference scaling processing resource in each input board can be sent sequentially in different time slots of the same frame; and send the pre-monitoring image to the pre-monitoring echo board sequentially according to the time slot allocated to its respective pre-monitoring image.

[0117] In some implementations, multiple input boards in the stitching processor can allocate time slots through a distributed negotiation mechanism. For example, the multiple input boards in the stitching processor can exchange their respective pre-monitoring image transmission time information, determine their respective transmission time slots according to preset time slot allocation rules, such as ranking transmission times from shortest to longest, and transmit the pre-monitoring image to the pre-monitoring echo board according to the allocated time slots. This distributed collaborative method eliminates the need for a dedicated time slot allocation module, relying on multiple input boards to autonomously negotiate and adjust, thus achieving time slot allocation based on transmission time.

[0118] Figure 7 is a schematic diagram of a splicing processor provided in an embodiment of this application. Referring to Figure 7 below, a schematic diagram of a splicing processor (e.g., the terminal device or server in Figure 7) 700 suitable for implementing an embodiment of this application is shown. The terminal device in this application embodiment may include mobile terminals such as mobile phones, laptops, digital broadcast receivers, personal digital assistants (PDAs), portable Android devices (PADs), portable media players (PMPs), and in-vehicle terminals (e.g., in-vehicle navigation terminals), as well as fixed terminals such as digital televisions (TVs) and desktop computers. The splicing processor shown in Figure 7 is an example.

[0119] As shown in Figure 7, the splicing processor 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 702 or a program loaded from storage device 708 into random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the splicing processor 700. The processing device 701, ROM 702, and RAM 703 are interconnected via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0120] Typically, the following devices can be connected to I / O interface 705: input devices 706 including, for example, touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; output devices 707 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 708 including, for example, magnetic tapes, hard disks, etc.; and communication devices 709. Communication device 709 allows the splicing processor 700 to communicate wirelessly or wiredly with other devices to exchange data. Although Figure 7 shows a splicing processor 700 with various devices, it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed alternatively.

[0121] According to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication device 709, or installed from storage device 708, or installed from ROM 702. When the computer program is executed by processing device 701, it performs the functions defined in the methods of embodiments of this application.

[0122] The splicing processor provided in this embodiment and the preview and echo display method provided in the above embodiment belong to the same application concept. For content not described in this embodiment, please refer to the above embodiment. Moreover, this embodiment and the above embodiment have the same beneficial effects.

[0123] This application provides a computer storage medium storing a computer program that, when executed by a processor, implements the preview echo display method provided in the above embodiments.

[0124] The computer-readable medium described in this application can be a computer-readable signal medium, a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. Examples of computer-readable storage media include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc-read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including, for example, wires, optical fibers, radio frequency (RF), or any suitable combination thereof.

[0125] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol, such as Hypertext Transfer Protocol (HTTP), and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include Local Area Networks (LANs), Wide Area Networks (WANs), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0126] The aforementioned computer-readable medium may be included in the aforementioned splicing processor; or it may exist independently and not assembled into the splicing processor.

[0127] The aforementioned computer-readable medium carries at least one program that, when executed by the stitching processor, causes the stitching processor to: determine at least one reference scaling processing resource of an input board in the stitching processor, wherein the reference scaling processing resource is a scaling processing resource allocated from multiple image scaling processing resources associated with the input board for supporting preview echo functionality; alternately arrange and transmit each frame of target images corresponding to the target number of image input channels in the input board to the reference scaling processing resource for sequential processing; and send the preview image output by the reference scaling processing resource in the input board to the preview echo board in the stitching processor, so that the preview echo board performs preview echo of the preview image.

[0128] Computer program code for performing the operations of this application can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, for example, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network, such as a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0130] The units described in the embodiments of this application can be implemented in software or in hardware. The names of the units are not necessarily limiting in some cases; for example, the first acquisition unit can also be described as "a unit that acquires at least two Internet Protocol addresses".

[0131] The functions described above in this document can be performed at least in part by at least one hardware logic component. For example, exemplary types of hardware logic components that can be used include: Field-Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Parts (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), etc.

[0132] In the context of this application, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0133] Although multiple operations are described in a specific order, this should not be construed as requiring these operations to be executed in the specific order shown or in a sequential order. In certain environments, multitasking and parallel processing may be advantageous.

Claims

1. A method for displaying pre-monitoring echo, applied to a stitching processor, the method comprising: determining at least one reference scaling processing resource of an input board card in the stitching processor, the reference scaling processing resource being a scaling processing resource allocated from a plurality of image scaling processing resources associated with the input board card and used to support a pre-monitoring echo function; alternately arranging each frame of target images corresponding to a target number of image input channels in the input board card, and transmitting the alternately arranged target images to the reference scaling processing resource for sequential processing; and transmitting pre-monitoring images output by the reference scaling processing resource of the input board card to a pre-monitoring echo board card in the stitching processor, so that the pre-monitoring echo board card performs pre-monitoring echo on the pre-monitoring images. The at least one reference scaling processing resource comprises at least one of a scaling processing resource allocated from a plurality of image scaling processing resources pre-configured in the input board card of the stitching processor and used to support pre-monitoring echo of an image picture of a first resolution, or a scaling processing resource allocated from the plurality of image scaling processing resources pre-configured in the input board card of the stitching processor and used to support pre-monitoring echo of an image picture of a second resolution, the first resolution being greater than the second resolution. The target number is dynamically adjustable, and dynamic adjustment of the target number enables dynamic allocation and adjustment of resolution and frame rate of each frame of target images that can be processed by the reference scaling processing resource of the input board card. In the plurality of frames of target images transmitted to the reference scaling processing resource after alternately arranging, a continuous target number of target images belong to target images of different image input channels in the input board card.

2. The method of claim 1, wherein, The stitching processor comprises a plurality of input board cards, and the transmitting of the pre-monitoring images output by the reference scaling processing resource of the input board card to the pre-monitoring echo board card in the stitching processor comprises:

3. The method of claim 1, wherein, When the pre-monitoring images output by the reference scaling processing resource of a plurality of input board cards are transmitted to the same pre-monitoring echo board card, the pre-monitoring images output by the reference scaling processing resource of each input board card are respectively allocated to different time slots corresponding to the same frame and sequentially transmitted to the pre-monitoring echo board card in the stitching processor.

4. The method of claim 1, wherein, The transmitting of the pre-monitoring images output by the reference scaling processing resource of each input board card to the pre-monitoring echo board card in the stitching processor comprises:

5. The method of claim 1, wherein, For a plurality of input board cards in the stitching processor, determining, by the pre-monitoring echo board card, a pre-monitoring image transmission time of the input board card corresponding to the pre-monitoring image transmitted from the input board card to the pre-monitoring echo board card; According to the pre-monitoring image transmission time of each input board card, allocating time slots to the pre-monitoring image corresponding to each input board card from a plurality of time slots corresponding to the same frame, so that the pre-monitoring image output by the reference scaling processing resource of each input board card can be sequentially transmitted in different time slots of the same frame; 6. The method of claim 5, wherein, Transmitting the pre-monitoring images to the pre-monitoring echo board card in the stitching processor according to the time slots allocated to the pre-monitoring image corresponding to each input board card. ​ ​ ​ 7. A display device for pre-monitoring echo, configured in a stitching processor, comprising: a determining module configured to determine at least one reference scaling processing resource of an input board card in the stitching processor, the reference scaling processing resource being a scaling processing resource allocated from a plurality of image scaling processing resources associated with the input board card to support a pre-monitoring echo function; a transmitting module configured to transmit each frame of target image corresponding to each of a target number of image input channels in the input board card to the reference scaling processing resource for sequential processing after being alternately arranged; a sending module configured to send a pre-monitoring image output by the reference scaling processing resource in the input board card to a pre-monitoring echo board card in the stitching processor, so that the pre-monitoring echo board card performs pre-monitoring echo on the pre-monitoring image.

8. A pre-monitoring echo display system, the system comprising: an input board card and a pre-monitoring echo board card in a stitching processor; the input board card is configured to determine at least one reference scaling processing resource of the input board card in the stitching processor, the reference scaling processing resource being a scaling processing resource allocated from a plurality of image scaling processing resources associated with the input board card to support a pre-monitoring echo function; the input board card is configured to transmit each frame of target image corresponding to each of a target number of image input channels in the input board card to the reference scaling processing resource for sequential processing after being alternately arranged; the input board card is configured to send a pre-monitoring image output by the reference scaling processing resource in the input board card to a pre-monitoring echo board card in the stitching processor, so that the pre-monitoring echo board card performs pre-monitoring echo on the pre-monitoring image.

9. The system of claim 8, wherein, the at least one reference scaling processing resource comprises at least one of a scaling processing resource allocated from a plurality of image scaling processing resources pre-configured in the input board card in the stitching processor to support a first resolution image for pre-monitoring echo, or a scaling processing resource allocated from a plurality of image scaling processing resources pre-configured in the input board card in the stitching processor to support a second resolution image for pre-monitoring echo, the first resolution being greater than the second resolution.

10. The system of claim 8, wherein, a value of the target number is dynamically adjustable, and dynamic adjustment of the value of the target number enables dynamic allocation and adjustment of a resolution size and a frame rate size of each frame of target image that can be supported by the reference scaling processing resource in the input board card.

11. The system of claim 8, wherein, in the plurality of frames of target image transmitted to the reference scaling processing resource after being alternately arranged, a target number of continuous target images belong to target images of different image input channels in the input board card.

12. A stitching processor comprising an input board card and a pre-monitoring echo board card, wherein: the input board card is configured to determine at least one reference scaling processing resource, the reference scaling processing resource being a scaling processing resource allocated from a plurality of image scaling processing resources associated with the input board card to support a pre-monitoring echo function; each frame of target image corresponding to each of a target number of image input channels in the input board card is alternately arranged and transmitted to the reference scaling processing resource for sequential processing; The input board card sends the pre-monitoring image processed by the reference scaling processing resource to the pre-monitoring echo board card; The pre-monitoring echo board card is configured to receive the pre-monitoring image processed by the reference scaling processing resource from the input board card and perform pre-monitoring echo on the pre-monitoring image.

13. The splicing processor of claim 12, wherein, The splicing processor includes a plurality of input board cards, and each input board card is configured to, when sending the pre-monitoring image processed by the respective reference scaling processing resource to the same pre-monitoring echo board card, respectively assign the pre-monitoring image output by the respective reference scaling processing resource to different time slots corresponding to the same frame and sequentially send to the same pre-monitoring echo board card.

14. The splicing processor of claim 13, wherein, The pre-monitoring echo board card is configured to determine, for the plurality of input board cards in the splicing processor, the respective pre-monitoring image sending time consumption of each input board card when sending the pre-monitoring image to the pre-monitoring echo board card. Each input board card is configured to, according to the respective pre-monitoring image sending time consumption, assign a time slot to the respective pre-monitoring image from a plurality of time slots corresponding to the same frame, so that the pre-monitoring image output by the reference scaling processing resource in each input board card can be sequentially sent in different time slots of the same frame; and sequentially send the pre-monitoring image to the pre-monitoring echo board card according to the time slot assigned to the respective pre-monitoring image.

15. A storage medium containing computer executable instructions for performing the display method of pre-monitoring echo according to any one of claims 1-6 when executed by a computer processor.

Images