Picture motion compensation method, system and storage medium in multi-screen combination

Abstract

The application discloses a picture motion compensation method and system in multi-screen combination and a storage medium, and relates to the field of picture display. The method comprises the following steps: acquiring first picture information and second picture information of different screen blocks respectively; determining distance direction offset and direction offset of picture pixel values of the first picture information and the second picture information based on a cross-correlation algorithm; correcting the distance direction offset and the direction offset until absolute values of the distance direction offset and the direction offset are within a preset threshold; calculating picture display frequencies of the first picture information and the second picture information, adjusting time of a target splicing boundary of the first picture information and the second picture information based on the picture display frequencies; and multiplying a correction result of the distance direction offset and the direction offset and a time adjustment result of the target splicing boundary to obtain an offset compensation amount, and realizing picture motion compensation in multi-screen combination by using the offset compensation amount. The application better solves the problem of misalignment at a screen splicing position.

Description

Technical Field

[0001] This invention relates to the field of screen display, and more specifically to a method, system, and storage medium for screen motion compensation in a multi-screen setup. Background Technology

[0002] In recent years, with the development of digital image processing and computer science technologies, the demand for wide-field-of-view videos has become increasingly strong. However, traditional improvement methods for expanding the video field of view have not been very effective, leading to the emergence of video splicing technology. With the continuous development of LED display technology and the increasing market demand, large LED screens are now ubiquitous in public places such as shopping malls and train stations, used to display images, text, videos, and other information.

[0003] Image stitching technology has always been a research hotspot in computer vision and image / video processing, and the resulting panoramic image stitching technology is playing an increasingly important role in various fields. A panoramic image is a high-resolution image with a wide field of view and high depth of field generated from a series of related images using various techniques. It is a virtual reality technology implemented using image stitching, requiring a moderate amount of data, possessing a certain degree of interactivity, and enhancing scene rendering effects. Although this method has advantages such as mature algorithms, high accuracy, and portability, it still has disadvantages such as requiring significant manual intervention, slow data acquisition, low processing speed, and poor real-time performance of panoramic images. Summary of the Invention

[0004] In view of this, the present invention provides a method, system and storage medium for motion compensation in multi-screen setups to solve the problems existing in the prior art.

[0005] To achieve the above objectives, the present invention adopts the following technical solution:

[0006] A method for motion compensation in a multi-screen setup includes the following steps:

[0007] Obtain the first and second screen information for different screen blocks respectively;

[0008] The distance offset and directional offset of the pixel values ​​of the first and second frame information are determined based on the cross-correlation algorithm.

[0009] The distance offset and direction offset are corrected until their absolute values ​​are within a preset threshold.

[0010] Calculate the display frequency of the first and second screen information, and adjust the time of the target splicing boundary between the first and second screen information based on the display frequency.

[0011] The product of the correction results of distance offset and direction offset and the time adjustment result of the target stitching boundary is the offset compensation amount. The offset compensation amount is used to realize the image motion compensation in multi-screen combination.

[0012] Optionally, the correction for the range offset is performed as follows:

[0013] Based on the constraint of the distance offset, obtain the cross-correlation matrix of a certain pixel in the image, and calculate the offset of the pixel in the distance direction.

[0014] Repeat the above steps to calculate the offset of each pixel in the distance direction and form a pixel offset matrix.

[0015] The correction result is obtained by multiplying the pixel offset matrix of the first screen information and the transpose of the pixel offset matrix of the second screen information.

[0016] Optionally, the correction of the directional offset is specifically performed by: translating the pixel to be corrected based on the preset standard image pixel trajectory direction so that the pixel to be corrected coincides with the standard image pixel; and using the translated pixel to be corrected as the correction result.

[0017] Optionally, after completing motion compensation, the images of different screen blocks are fused using a weighted algorithm.

[0018] Optionally, it also includes acquiring multiple pixels using a color analyzer, performing a difference calculation with the midpoint of the pixels to obtain a light compensation value, and then performing color and brightness uniformity correction based on the light compensation value.

[0019] A motion compensation system for multi-screen setups includes:

[0020] Screen information acquisition module: used to acquire the first screen information and the second screen information of different screen blocks respectively;

[0021] Offset calculation module: used to determine the distance offset and direction offset of the pixel values ​​of the first and second frame information based on the cross-correlation algorithm;

[0022] Pixel correction module: used to correct the distance offset and direction offset until the absolute values ​​of the distance offset and direction offset are within the preset threshold;

[0023] Target boundary stitching module: used to calculate the display frequency of the first screen information and the second screen information, and adjust the timing of the target stitching boundary of the first screen information and the second screen information based on the display frequency;

[0024] The image motion compensation module is used to multiply the correction results of distance offset and direction offset and the time adjustment result of target stitching boundary as the offset compensation amount, and use the offset compensation amount to realize image motion compensation in multi-screen combination.

[0025] A computer storage medium storing a computer program, wherein when the computer program is executed by a processor, the program implements the steps of the screen motion compensation method in any of the following multi-screen combinations.

[0026] As can be seen from the above technical solution, compared with the prior art, the present invention provides a method, system and storage medium for screen motion compensation in multi-screen combinations, which has the following beneficial effects:

[0027] 1. This invention increases the proportion of effective feature points required for stitching and solidifies the transformation matrix according to the system characteristics, thereby reducing the complexity of the image stitching algorithm and improving the efficiency of image stitching processing.

[0028] 2. This invention adjusts the target boundary to compensate for the current frame, thereby facilitating the splicing of the current frame with the boundaries of other current frames through the target boundary. This ensures that the boundaries of the two current frames to be spliced ​​can completely overlap, thereby improving the projection effect of the current frame. Attached Figure Description

[0029] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0030] Figure 1 This is a schematic diagram of the process of the present invention;

[0031] Figure 2 This is a schematic diagram of the structure of the present invention. Detailed Implementation

[0032] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0033] This invention discloses a method for image motion compensation in multi-screen setups, such as... Figure 1 As shown, it includes the following steps:

[0034] S1: Obtain the first and second screen information for different screen blocks respectively;

[0035] S2: Determine the distance offset and directional offset of the pixel values ​​of the first and second image information based on the cross-correlation algorithm;

[0036] S3: Correct the range offset and direction offset until the absolute values ​​of the range offset and direction offset are within the preset threshold.

[0037] S4: Calculate the display frequency of the first screen information and the second screen information, and adjust the time of the target splicing boundary of the first screen information and the second screen information based on the display frequency;

[0038] S5: The product of the correction results of the distance offset and the direction offset and the time adjustment result of the target stitching boundary is the offset compensation amount. The offset compensation amount is used to realize the image motion compensation in multi-screen combination.

[0039] Furthermore, in S3, the correction for the range offset is specifically performed as follows:

[0040] S31: Obtain the cross-correlation matrix of a certain pixel in the image based on the constraint of the distance offset, and calculate the offset of the pixel in the distance direction.

[0041] S32: Repeat the above steps to calculate the offset of each pixel in the distance direction and form a pixel offset matrix.

[0042] S33: Multiply the pixel offset matrix of the first screen information and the transpose of the pixel offset matrix of the second screen information to obtain the correction result.

[0043] The correction of directional offset is specifically performed as follows: based on the preset standard image pixel trajectory direction, the image pixel to be corrected is translated so that the image pixel to be corrected coincides with the standard image pixel; the translated image pixel is used as the correction result.

[0044] This invention also includes fusing images from different screen blocks after completing motion compensation. A weighted algorithm is used to fuse the images, and the specific calculation formula is as follows:

[0045]

[0046] In the formula, I1(x,y) and I2(x,y) are the pixel values ​​at (x,y) in the images to be stitched, respectively; R1 and R2 are the coordinate sets of the images to be stitched; I(x,y) is the fused pixel value; w1 and w2 are weight coefficients, satisfying w1+w2=1, and both w1 and w2 are greater than 0, with the weight being... x1 and x2 are the x-coordinates of the boundary of the overlapping region, x1≤x≤x2, which allows for a smooth transition of the overlapping region.

[0047] Furthermore, this involves collecting multiple pixels using a color analyzer, performing difference calculations with the midpoint of each pixel to obtain a light compensation value, and then correcting the uniformity of color and brightness based on this value. In low-grayscale images, especially with high line scan and high refresh rates, the LED conduction time is extremely short, often only a few hundred nanoseconds or even tens of nanoseconds. Under such conduction times, the parasitic capacitance on LEDs of different colors becomes extremely significant. Worse still, due to process variations, the parasitic capacitance of LEDs of the same color within the same batch can also fluctuate considerably. Compensation for blue and green is necessary in low-grayscale images. The compensation method involves extending the conduction time of both green and blue diodes in low-grayscale images to a certain extent, reducing the degree of color shift. Since green and blue have different degrees of color shift in low-grayscale images, the required compensation levels differ, with green requiring slightly greater compensation and blue slightly less.

[0048] and Figure 1 Corresponding to the method shown, the present invention also discloses a screen motion compensation system for multi-screen combinations. Figure 1 The implementation of the method, specifically its structure, is as follows: Figure 2 As shown, it includes:

[0049] Screen information acquisition module: used to acquire the first screen information and the second screen information of different screen blocks respectively;

[0050] Offset calculation module: used to determine the distance offset and direction offset of the pixel values ​​of the first and second frame information based on the cross-correlation algorithm;

[0051] Pixel correction module: used to correct the distance offset and direction offset until the absolute values ​​of the distance offset and direction offset are within the preset threshold;

[0052] Target boundary stitching module: used to calculate the display frequency of the first screen information and the second screen information, and adjust the timing of the target stitching boundary of the first screen information and the second screen information based on the display frequency;

[0053] The image motion compensation module is used to multiply the correction results of distance offset and direction offset and the time adjustment result of target stitching boundary as the offset compensation amount, and use the offset compensation amount to realize image motion compensation in multi-screen combination.

[0054] This embodiment also discloses a computer storage medium storing a computer program, which, when executed by a processor, implements any of the steps of a screen motion compensation method in a multi-screen setup.

[0055] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since they correspond to the methods disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to the method section.

[0056] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for image motion compensation in a multi-screen setup, characterized in that, Includes the following steps: Obtain the first and second screen information for different screen blocks respectively; The distance offset and directional offset of the pixel values ​​of the first and second frame information are determined based on the cross-correlation algorithm. The distance offset and direction offset are corrected until their absolute values ​​are within a preset threshold. Calculate the display frequency of the first and second screen information, and adjust the time of the target splicing boundary between the first and second screen information based on the display frequency. The product of the correction results of the distance offset and the direction offset and the time adjustment result of the target stitching boundary is the offset compensation amount. The offset compensation amount is used to realize the image motion compensation in multi-screen combination. The correction for the range offset is specifically as follows: Based on the constraint of the distance offset, obtain the cross-correlation matrix of a certain pixel in the image, and calculate the offset of the pixel in the distance direction. Repeat the above steps to calculate the offset of each pixel in the distance direction and form a pixel offset matrix. The correction result is obtained by multiplying the pixel offset matrix of the first frame information and the transpose of the pixel offset matrix of the second frame information. The correction of directional offset is specifically performed as follows: based on the preset standard image pixel trajectory direction, the image pixel to be corrected is translated so that the image pixel to be corrected coincides with the standard image pixel; the translated image pixel is used as the correction result.

2. The method for image motion compensation in a multi-screen setup according to claim 1, characterized in that, It also includes fusing images from different screen blocks after completing motion compensation, using a weighted algorithm to complete the image fusion.

3. The method for image motion compensation in a multi-screen setup according to claim 1, characterized in that, It also includes collecting multiple pixels using a color analyzer, performing a difference calculation with the midpoint of the pixels to obtain a light compensation value, and then correcting the uniformity of color and brightness based on the light compensation value.

4. A motion compensation system for multi-screen setups, characterized in that, include: Screen information acquisition module: used to acquire the first screen information and the second screen information of different screen blocks respectively; Offset calculation module: used to determine the distance offset and direction offset of the pixel values ​​of the first and second frame information based on the cross-correlation algorithm; Pixel correction module: used to correct the distance offset and direction offset until the absolute values ​​of the distance offset and direction offset are within the preset threshold; Target boundary stitching module: used to calculate the display frequency of the first screen information and the second screen information, and adjust the timing of the target stitching boundary of the first screen information and the second screen information based on the display frequency; Image motion compensation module: It is used to multiply the correction results of distance offset and direction offset and the time adjustment result of target stitching boundary as the offset compensation amount, and use the offset compensation amount to realize image motion compensation in multi-screen combination. The correction for the range offset is specifically as follows: Based on the constraint of the distance offset, obtain the cross-correlation matrix of a certain pixel in the image, and calculate the offset of the pixel in the distance direction. Repeat the above steps to calculate the offset of each pixel in the distance direction and form a pixel offset matrix. The correction result is obtained by multiplying the pixel offset matrix of the first frame information and the transpose of the pixel offset matrix of the second frame information. The correction of directional offset is specifically performed as follows: based on the preset standard image pixel trajectory direction, the image pixel to be corrected is translated so that the image pixel to be corrected coincides with the standard image pixel; the translated image pixel is used as the correction result.

5. A computer storage medium, characterized in that, The computer storage medium stores a computer program, which, when executed by a processor, implements the steps of a screen motion compensation method in a multi-screen combination as described in any one of claims 1-3.

Images