Display screen gap correction method, device, equipment, storage medium and program product

Abstract

The application relates to a display screen gap correction method and device, equipment, a storage medium and a program product, and relates to the technical field of computers. The method comprises the following steps: a display screen acquires a plurality of display images collected by a plurality of cameras located at different angles of the display screen; image display data of the plurality of display images is fused to obtain fused display data; according to the fused display data, a gap region of the display screen and gap display parameters of the gap region are determined; according to the gap display parameters and a gap width of the gap region, a correction compensation amount is determined, and the gap region is corrected based on the correction compensation amount. The method can improve correction accuracy.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, device, storage medium, and program product for correcting gaps in a display screen. Background Technology

[0002] With the widespread application of LED displays in advertising, stage performances, and surveillance, their display quality has received increasing attention. LED displays are composed of multiple LED cabinets or display modules (slicing units). Each splicing unit is calibrated before leaving the factory to ensure uniformity. However, in actual splicing, due to limitations in machining and assembly precision, physical seams may exist between splicing units. These seams can cause abnormal spacing between LED dots, resulting in uneven screen display, especially when displaying low-frequency images or large areas of solid color, easily forming noticeable bright or dark lines. As the pixel pitch of LEDs continues to shrink (e.g., in high-resolution displays less than 2mm), the problem of bright and dark lines caused by splicing seams becomes more prominent, severely affecting the screen's display effect.

[0003] Traditional techniques use a single camera to capture image data from the screen to correct for bright and dark lines caused by gaps. However, this single-view acquisition method has limitations, resulting in poor correction effects and low accuracy. Summary of the Invention

[0004] Therefore, it is necessary to provide a display screen gap correction method, apparatus, device, storage medium, and program product that can improve the correction accuracy in response to the above-mentioned technical problems.

[0005] In a first aspect, this application provides a method for correcting gaps in a display screen, the method comprising:

[0006] Multiple display images are acquired by multiple cameras located at different angles on the display screen;

[0007] The image display data of the multiple displayed images are merged to obtain merged display data;

[0008] Based on the fused display data, the gap area of ​​the display screen and the gap display parameters of the gap area are determined;

[0009] Based on the gap display parameters and the gap width of the gap area, a correction compensation amount is determined, and the gap area is corrected based on the correction compensation amount.

[0010] In one embodiment, the image display data includes the first pixel brightness value and the first pixel chromaticity value of each pixel in the displayed image located in the corresponding camera coordinate system; the fused display data includes the fused brightness value and the fused chromaticity value located in the global coordinate system.

[0011] The step of fusing the image display data of the multiple displayed images to obtain fused display data includes:

[0012] For each pixel in each displayed image, the first pixel brightness value of the pixel in the corresponding camera coordinate system is converted into a pixel brightness value in the global coordinate system to obtain the second pixel brightness value corresponding to the pixel in the displayed image. The first pixel chromaticity value of the pixel in the corresponding camera coordinate system is converted into a pixel chromaticity value in the global coordinate system to obtain the second pixel chromaticity value corresponding to the pixel in the displayed image.

[0013] The brightness values ​​of the second pixel corresponding to the same pixel point in the multiple display images are merged to obtain a merged brightness value;

[0014] The second pixel chromaticity values ​​corresponding to the same pixel point in the multiple display images are fused to obtain a fused chromaticity value.

[0015] In one embodiment, the image display data includes the pixel brightness value of each pixel in the displayed image; the blended display data includes the blended brightness value;

[0016] The step of determining the gap area of ​​the display screen based on the fused display data includes:

[0017] Based on the fused brightness value, determine the brightness gradient value of each pixel in the display screen;

[0018] The area corresponding to the pixels in the display screen whose brightness gradient value is greater than a preset gradient threshold is determined as the gap area of ​​the display screen.

[0019] In one embodiment, the step of determining the gap display parameters of the gap region based on the fused display data includes:

[0020] The average of the fused display data corresponding to each pixel in the normal display area of ​​the display screen is calculated to obtain the reference display data corresponding to the gap area;

[0021] Based on the baseline display data and the fused display data corresponding to each pixel in the gap region, the gap display parameters of the gap region are determined.

[0022] In one embodiment, determining the correction compensation amount based on the gap display parameters and the gap width of the gap region includes:

[0023] The compensation factor is determined based on the gap width of the gap region;

[0024] The correction compensation amount is determined based on the gap display parameters and the compensation factor.

[0025] In one embodiment, the image display data includes the pixel brightness value and pixel chromaticity value of each pixel in the displayed image; the fused display data includes the fused brightness value and fused chromaticity value; the gap display parameters include the brightness change intensity value and the chromaticity deviation value; and the correction compensation amount includes the brightness compensation amount and the chromaticity compensation amount.

[0026] The step of correcting the gap region based on the correction compensation amount includes:

[0027] Based on the fused brightness value and the brightness compensation amount, the brightness of each pixel in the gap region is corrected;

[0028] Based on the fused chromaticity value and the chromaticity compensation amount, the chromaticity of each pixel in the gap region is corrected.

[0029] In one embodiment, the method further includes:

[0030] Two edge points of the gap are obtained by selecting one pixel on each side of the gap region.

[0031] For each gap edge point in each displayed image, the first position coordinates of the gap edge point in the corresponding camera coordinate system are converted into position coordinates in the global coordinate system to obtain the second position coordinates corresponding to the gap edge point in the displayed image;

[0032] The second position coordinates corresponding to the same gap edge point in the multiple display images are fused to obtain the fused position coordinates corresponding to each of the two gap edge points;

[0033] The gap width of the gap region is determined based on the difference in the horizontal coordinates of the fusion position coordinates corresponding to the two gap edge points.

[0034] Secondly, this application provides a display screen gap correction device, the device comprising:

[0035] The acquisition module is used to acquire multiple display images captured by multiple cameras located at different angles on the display screen;

[0036] The fusion module is used to fuse the image display data of the multiple display images to obtain fused display data;

[0037] The determining module is used to determine the gap area of ​​the display screen and the gap display parameters of the gap area based on the fused display data; and to determine the correction compensation amount based on the gap display parameters and the gap width of the gap area.

[0038] A correction module is used to correct the gap area based on the correction compensation amount.

[0039] Thirdly, this application provides a display screen, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the various method embodiments of this application.

[0040] Fourthly, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps in the various method embodiments of this application.

[0041] Fifthly, this application provides a computer program product, including a computer program that, when executed by a processor, implements the steps in the various method embodiments of this application.

[0042] The aforementioned display screen gap correction method, apparatus, device, storage medium, and program products involve acquiring multiple display images from multiple cameras located at different angles on the display screen; fusing the image display data of the multiple display images to obtain fused display data; determining the gap area and gap display parameters of the display screen based on the fused display data; determining the correction compensation amount based on the gap display parameters and the gap width of the gap area; and correcting the gap area based on the correction compensation amount. Compared to traditional display screen gap correction methods, this application uses cameras with multiple viewing angles to acquire images of the display content on the display screen, and performs multi-view spatial fusion of the image display data acquired from multiple viewing angles. Because multi-view spatial fusion integrates information from multiple viewing angles, it overcomes the limitations of traditional single-viewpoint methods, improves the accuracy and robustness of gap detection, and can accurately locate the gap area from the screen, comprehensively capture the gap display parameters of the gap area, and thus accurately estimate the correction compensation amount for the gap area to correct the display effect of the gap area. This effectively avoids bright and dark lines on the screen display and improves correction accuracy. Attached Figure Description

[0043] Figure 1 This is an application environment diagram of the display screen gap correction method in one embodiment;

[0044] Figure 2 This is a flowchart illustrating a display screen gap correction method in one embodiment;

[0045] Figure 3This is a structural block diagram of a display screen gap correction device in one embodiment;

[0046] Figure 4 This is a diagram of the internal structure of the display screen in one embodiment. Detailed Implementation

[0047] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0048] The display screen gap correction method provided in this application can be applied to, for example... Figure 1 In the application environment shown, camera 102 communicates with display screen 104 via a network. Specifically, display screen 104 can acquire multiple display images captured by multiple cameras 102 located at different angles on display screen 104. Display screen 104 can fuse the image display data of multiple display images to obtain fused display data. Based on the fused display data, display screen 104 can determine the gap area of ​​display screen 104 and the gap display parameters of the gap area. Based on the gap display parameters and the gap width of the gap area, display screen 104 can determine the correction compensation amount and correct the gap area based on the correction compensation amount.

[0049] Traditional display screen gap correction methods involve using a single camera to capture image data of the screen from a single angle, and then using this data to correct the gaps in the screen. However, this single-view acquisition method has limitations; it cannot comprehensively and accurately capture the optical characteristics of the gap area, resulting in poor correction effects and low correction accuracy.

[0050] In the display screen gap correction method of this application, the display screen acquires multiple display images captured by multiple cameras located at different angles of the display screen; the image display data of the multiple display images are fused to obtain fused display data; based on the fused display data, the gap area of ​​the display screen and the gap display parameters of the gap area are determined; based on the gap display parameters and the gap width of the gap area, a correction compensation amount is determined, and the gap area is corrected based on the correction compensation amount. Compared with traditional display screen gap correction methods, this application uses cameras with multiple viewing angles to acquire images of the display content of the display screen, and performs multi-view spatial fusion of the image display data acquired from multiple viewing angles. Since multi-view spatial fusion integrates information from multiple viewing angles, it overcomes the limitations of traditional single-viewpoint methods, improves the accuracy and robustness of gap detection, and can accurately locate the gap area from the screen, comprehensively capture the gap display parameters of the gap area, and thus accurately estimate the correction compensation amount for the gap area to correct the display effect of the gap area. This can effectively avoid bright and dark lines on the screen display and improve the correction accuracy.

[0051] In one embodiment, such as Figure 2 As shown, a method for correcting gaps in a display screen is provided. This embodiment uses the application of this method to a display screen as an example for illustration, and includes the following steps:

[0052] Step 202: Acquire multiple display images captured by multiple cameras located at different angles on the display screen.

[0053] Specifically, multiple cameras positioned at different angles are placed in front of the display screen. While the screen is displaying an image, the cameras capture images of the displayed scene, resulting in multiple display images. Each camera can send its captured image to the display screen, which can then receive the multiple images captured by the cameras.

[0054] In one embodiment, the camera used to acquire and display images can be an area scan camera. It is understood that area scan cameras have higher resolution, higher frame rate, and higher sensitivity than ordinary cameras, making them more suitable for precise measurement and high-precision imaging.

[0055] Step 204: Merge the image display data of multiple displayed images to obtain merged display data.

[0056] In one embodiment, the image display data may include at least one of pixel luminance values ​​and pixel chrominance values ​​for each pixel in the displayed image. Accordingly, the blended display data may include at least one of blended luminance values ​​and blended chrominance values.

[0057] In one embodiment, fusing image display data from multiple display images to obtain fused display data includes: averaging the image display data corresponding to the same pixel in the multiple display images, and using the average value of the multiple image display data as the fused display data for the corresponding pixel.

[0058] In one embodiment, the image display data includes the pixel brightness value and pixel chromaticity value of each pixel in the displayed image; the fused display data includes the fused brightness value and fused chromaticity value. Specifically, the display screen can fuse the pixel brightness values ​​of multiple displayed images to obtain a fused brightness value. The display screen can also fuse the pixel chromaticity values ​​of multiple displayed images to obtain a fused chromaticity value.

[0059] In one embodiment, the image display data includes the pixel brightness value and pixel chromaticity value of each pixel in the displayed image; the fused display data includes the fused brightness value and fused chromaticity value. Specifically, the display screen can average the pixel brightness values ​​corresponding to the same pixel in multiple displayed images, and use the average of the multiple pixel brightness values ​​as the fused brightness value of the corresponding pixel. The display screen can also average the pixel chromaticity values ​​corresponding to the same pixel in multiple displayed images, and use the average of the multiple pixel chromaticity values ​​as the fused chromaticity value of the corresponding pixel.

[0060] Step 206: Based on the fused display data, determine the gap area of ​​the display screen and the gap display parameters of the gap area.

[0061] In one embodiment, the display screen can determine the display data gradient value of each pixel in the display screen based on the fused display data, and determine the area corresponding to the pixel in the display screen whose display data gradient value is greater than a preset gradient threshold as the gap area of ​​the display screen.

[0062] In one embodiment, the display screen can determine the reference display data corresponding to the gap region based on the fused display data corresponding to each pixel in the normal display area of ​​the display screen. The normal display area is the area of ​​the display screen excluding the gap region; it is understood that the normal display area can present a normal display effect without any bright or dark lines. Furthermore, the display screen can determine the gap display parameters of the gap region based on the reference display data and the fused display data corresponding to each pixel in the gap region.

[0063] Step 208: Determine the correction compensation amount based on the gap display parameters and the gap width of the gap area, and correct the gap area based on the correction compensation amount.

[0064] In one embodiment, the display screen can calculate a correction compensation amount based on the gap display parameters and the gap width of the gap area. Then, the display screen can correct the display data of each pixel in the gap area based on the fused display data and the correction compensation amount.

[0065] In one embodiment, the display screen can superimpose the correction compensation amount onto the fused display data to obtain corrected display data, thereby correcting the display data of each pixel in the gap region.

[0066] In the aforementioned display screen gap correction method, the display screen acquires multiple display images captured by multiple cameras located at different angles on the display screen; the image display data of the multiple display images are fused to obtain fused display data; based on the fused display data, the gap area of ​​the display screen and the gap display parameters of the gap area are determined; based on the gap display parameters and the gap width of the gap area, a correction compensation amount is determined, and the gap area is corrected based on the correction compensation amount. Compared with traditional display screen gap correction methods, this application uses cameras with multiple viewing angles to acquire images of the display content of the display screen, and performs multi-view spatial fusion of the image display data acquired from multiple viewing angles. Since multi-view spatial fusion integrates information from multiple viewing angles, it overcomes the limitations of traditional single-viewpoint methods, improves the accuracy and robustness of gap detection, and can accurately locate the gap area from the screen, comprehensively capture the gap display parameters of the gap area, and thus accurately estimate the correction compensation amount for the gap area to correct the display effect of the gap area. This can effectively avoid bright and dark lines on the screen display and improve the correction accuracy.

[0067] In one embodiment, the image display data includes a first pixel luminance value and a first pixel chromaticity value for each pixel in the displayed image located in the corresponding camera coordinate system; the fused display data includes a fused luminance value and a fused chromaticity value located in the global coordinate system; fusing the image display data of multiple displayed images to obtain fused display data includes: for each pixel in each displayed image, converting the first pixel luminance value of the pixel located in the corresponding camera coordinate system to a pixel luminance value located in the global coordinate system to obtain a second pixel luminance value corresponding to the pixel in the displayed image; converting the first pixel chromaticity value of the pixel located in the corresponding camera coordinate system to a pixel chromaticity value located in the global coordinate system to obtain a second pixel chromaticity value corresponding to the pixel in the displayed image; fusing the second pixel luminance values ​​corresponding to the same pixel in multiple displayed images to obtain a fused luminance value; and fusing the second pixel chromaticity values ​​corresponding to the same pixel in multiple displayed images to obtain a fused chromaticity value.

[0068] Specifically, for each pixel in each displayed image, the display screen can convert the first pixel luminance value of that pixel in the camera coordinate system of the camera that captured the displayed image into a pixel luminance value in the global coordinate system (i.e., world coordinate system), thereby obtaining a second pixel luminance value in the global coordinate system corresponding to that pixel in the displayed image. Similarly, the display screen can convert the first pixel chroma value of that pixel in the camera coordinate system of the camera that captured the displayed image into a pixel chroma value in the global coordinate system, thereby obtaining a second pixel chroma value in the global coordinate system corresponding to that pixel in the displayed image. Furthermore, the display screen can fuse the second pixel luminance values ​​corresponding to the same pixel in multiple displayed images in the global coordinate system to obtain a fused luminance value in the global coordinate system, and fuse the second pixel chroma values ​​corresponding to the same pixel in multiple displayed images in the global coordinate system to obtain a fused chroma value in the global coordinate system.

[0069] In one embodiment, N cameras are positioned at different angles of the display screen, and the observation angle of each camera is respectively... The images captured by each camera are displayed in terms of brightness. and chromaticity It means that, among them, here Here is the brightness value of the first pixel. Here, (x, y) represents the chromaticity value of the first pixel, and (x, y) represents the position coordinates of the pixel in the corresponding camera coordinate system. This refers to the camera angle. Among them, This indicates the brightness value of the display screen at various angles. , which are the chromaticity values ​​of the red (R), green (G), and blue (B) channels, respectively. This represents the position coordinates of the display screen at various angles. (This refers to the camera coordinate system.) Convert the data (luminance, chrominance, and position coordinates) to the global coordinate system. The following data can be obtained using the following formula:

[0070] ;

[0071] in, Let be the rotation matrix of the camera, which can be based on It is confirmed that... Let Z be the translation vector of the camera, and Z be the distance between the camera and the display screen.

[0072] In one embodiment, the blended brightness value can be determined by the following formula:

[0073] ;

[0074] Where N represents the number of cameras, in the formula This represents the brightness value of the second pixel obtained after coordinate transformation. This indicates the blended brightness value.

[0075] In one embodiment, the blended chromaticity value can be determined by the following formula:

[0076] ;

[0077] Where N represents the number of cameras, in the formula This represents the chromaticity value of the second pixel obtained after coordinate transformation. This represents the blended chromaticity value.

[0078] In the above embodiments, by converting the first pixel brightness value of the same pixel point located in different camera coordinate systems into a second pixel brightness value located in the same global coordinate system, and then fusing the second pixel brightness values ​​corresponding to the same pixel point in multiple display images in the same global coordinate system, the brightness values ​​of the same pixel point captured by different cameras are aligned in the global coordinate system through coordinate transformation, avoiding errors caused by viewing angle differences, thereby improving the accuracy of brightness fusion. Similarly, by converting the first pixel chroma value of the same pixel point located in different camera coordinate systems into a second pixel chroma value located in the same global coordinate system, and then fusing the second pixel chroma values ​​corresponding to the same pixel point in multiple display images in the same global coordinate system, the chroma values ​​of the same pixel point captured by different cameras are aligned in the global coordinate system through coordinate transformation, avoiding errors caused by viewing angle differences, thereby improving the accuracy of chroma fusion.

[0079] In one embodiment, the image display data includes the pixel brightness value of each pixel in the displayed image; the fused display data includes the fused brightness value; the step of determining the gap region of the display screen based on the fused display data includes: determining the brightness gradient value of each pixel in the display screen based on the fused brightness value; and determining the region corresponding to the pixel whose brightness gradient value is greater than a preset gradient threshold as the gap region of the display screen.

[0080] In one embodiment, the brightness gradient value can be determined by the following formula:

[0081] ;

[0082] Where L represents the blended brightness value in the global coordinate system. This represents the brightness gradient value in the global coordinate system.

[0083] In the above embodiments, the brightness gradient value of each pixel in the display screen is determined by fusing the brightness value, and then the gap area is located from the display screen based on the brightness gradient value. Since the brightness gradient can effectively capture the edge information of the gap area, the positioning of the gap area is more accurate, thereby improving the positioning accuracy of the gap area.

[0084] In one embodiment, the step of determining the gap display parameters of the gap region based on the fused display data includes: averaging the fused display data corresponding to each pixel in the normal display area of ​​the display screen to obtain the reference display data corresponding to the gap region; and determining the gap display parameters of the gap region based on the reference display data and the fused display data corresponding to each pixel in the gap region.

[0085] In one embodiment, the image display data includes the pixel brightness value and pixel chromaticity value of each pixel in the displayed image; the blended display data includes the blended brightness value and blended chromaticity value; and the gap display parameters include the brightness variation intensity value and the chromaticity deviation value. Specifically, the display screen can average the blended brightness values ​​corresponding to each pixel in the normal display area of ​​the display screen to obtain a reference brightness value corresponding to the gap area; and determine the brightness variation intensity value of the gap area based on the reference brightness value and the blended brightness values ​​corresponding to each pixel in the gap area. The display screen can also average the blended chromaticity values ​​corresponding to each pixel in the normal display area of ​​the display screen to obtain a reference chromaticity value corresponding to the gap area; and determine the chromaticity deviation value of the gap area based on the reference chromaticity value and the blended chromaticity values ​​corresponding to each pixel in the gap area.

[0086] In one embodiment, the intensity value of the brightness change can be determined by the following formula:

[0087] ;

[0088] Where n represents the number of pixels contained in the gap region, and k represents the k-th pixel in the gap region. This represents the fused brightness value corresponding to the k-th pixel in the gap region. Indicates the reference brightness value. This represents the intensity of the change in brightness.

[0089] In one embodiment, the chromaticity deviation value can be determined by the following formula:

[0090] ;

[0091] ;

[0092] ;

[0093] ;

[0094] in, , , These represent the chromaticity deviation values ​​for the red (R), green (G), and blue (B) channels, respectively. , , These represent the fused chromaticity values ​​of the k-th pixel in the red (R), green (G), and blue (B) channels, respectively. , , These represent the reference chromaticity values ​​of the k-th pixel in the red (R), green (G), and blue (B) channels, respectively. This indicates the color deviation value.

[0095] In the above embodiments, since the reference display data can accurately reflect the normal display characteristics of the display screen and reduce the impact of noise and error, the accuracy of determining the gap display parameters can be improved by using the reference display data corresponding to the gap area and the fused display data corresponding to each pixel in the gap area to determine the gap display parameters.

[0096] In one embodiment, determining the correction compensation amount based on the gap display parameters and the gap width of the gap area includes: determining a compensation factor based on the gap width of the gap area; and determining the correction compensation amount based on the gap display parameters and the compensation factor.

[0097] In the above embodiments, the compensation factor is determined by the gap width of the gap area, and then the correction compensation amount is determined based on the gap display parameters and the compensation factor. In this way, since the compensation factor can be dynamically adjusted according to the gap width, it ensures that gaps of different widths can be appropriately compensated, thus improving the accuracy of determining the correction compensation amount.

[0098] In one embodiment, the image display data includes pixel brightness values ​​and pixel chromaticity values ​​for each pixel in the displayed image; the fused display data includes fused brightness values ​​and fused chromaticity values; the gap display parameters include brightness variation intensity values ​​and chromaticity deviation values; the correction compensation amount includes brightness compensation amount and chromaticity compensation amount; and the gap region is corrected based on the correction compensation amount, including: correcting the brightness of each pixel in the gap region based on the fused brightness values ​​and brightness compensation amount; and correcting the chromaticity of each pixel in the gap region based on the fused chromaticity values ​​and chromaticity compensation amount.

[0099] In one embodiment, the brightness compensation amount can be calculated using the following formula:

[0100] ;

[0101] in, The compensation factor for the gap width is defined as follows: , where k is an empirical coefficient. This indicates the amount of brightness compensation.

[0102] In one embodiment, the chromaticity compensation amount can be calculated using the following formula:

[0103] ;

[0104] in, This indicates the amount of chromaticity compensation.

[0105] In one embodiment, the corrected luminance and chrominance values ​​of each pixel in the gap region can be calculated using the following formulas:

[0106] ;

[0107] ;

[0108] Among them, in the above formula and These represent the blended brightness and blended chromaticity values ​​of the pixels in the gap region, respectively. and These represent the luminance and chrominance values ​​of the pixels in the gap region after correction, respectively.

[0109] In the above embodiments, the brightness and chromaticity of each pixel in the gap region are corrected simultaneously. Compared with the method of correcting only the brightness or chromaticity, the correction method of this embodiment can further improve the correction effect and accuracy of the gap.

[0110] In one embodiment, the method further includes: selecting one pixel point located at the edge from each side of the gap region to obtain two gap edge points; for each gap edge point in each displayed image, converting the first position coordinates of the gap edge point in the corresponding camera coordinate system into position coordinates in the global coordinate system to obtain the second position coordinates corresponding to the gap edge point in the displayed image; fusing the second position coordinates corresponding to the same gap edge point in multiple displayed images to obtain the fused position coordinates corresponding to the two gap edge points respectively; and determining the gap width of the gap region based on the difference in the horizontal coordinates of the fused position coordinates corresponding to the two gap edge points respectively.

[0111] In one embodiment, the gap width can be calculated using the following formula:

[0112] ;

[0113] in, and These represent the x-coordinates of the fusion positions corresponding to the two gap edge points, respectively. Indicates the width of the gap.

[0114] In one embodiment, after correction, the luminance and chromaticity values ​​of the pixels are collected again to verify the compensation effect. Evaluation metrics include luminance uniformity and chromaticity consistency. Luminance uniformity and chromaticity consistency can be expressed by the following formulas:

[0115] ;

[0116] ;

[0117] Where Var represents variance and Mean represents mean. Indicates brightness uniformity. Indicates color consistency.

[0118] It is understood that higher brightness uniformity and chromaticity consistency of the displayed image acquired from the display screen indicate better image quality, and thus better screen display effect. By calculating the brightness uniformity and chromaticity consistency of the image after gap correction using the display gap correction method of this application, and calculating the brightness uniformity and chromaticity consistency of the image after gap correction using the traditional display gap correction method, and comparing the calculated brightness uniformity and chromaticity consistency of the display gap correction method of this application and the traditional display gap correction method, it can be seen that the brightness uniformity and chromaticity consistency after gap correction using the display gap correction method of this application are superior to those after gap correction using the traditional display gap correction method. Therefore, it can be concluded that the display gap correction method of this application can improve the correction effect and correction accuracy.

[0119] In the above embodiments, by converting the first position coordinates of the same pixel point located in different camera coordinate systems into the second position coordinates located in the same global coordinate system, and then fusing the second position coordinates corresponding to the same pixel point in multiple display images in the same global coordinate system, the position coordinates of the same pixel point captured by different cameras are aligned in the global coordinate system through coordinate transformation, avoiding errors caused by differences in viewing angles, improving the accuracy of pixel position coordinate fusion, and thus improving the accuracy of gap width.

[0120] It should be understood that although the steps in the flowcharts of the above embodiments are shown sequentially, these steps are not necessarily executed in that order. Unless otherwise expressly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some of the steps in the above embodiments may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least a portion of the sub-steps or stages of other steps.

[0121] In one embodiment, such as Figure 3 As shown, a display screen gap correction device 300 is provided, which specifically includes:

[0122] The acquisition module 302 is used to acquire multiple display images captured by multiple cameras located at different angles of the display screen;

[0123] The fusion module 304 is used to fuse the image display data of multiple display images to obtain fused display data;

[0124] The determining module 306 is used to determine the gap area of ​​the display screen and the gap display parameters of the gap area based on the fused display data; and to determine the correction compensation amount based on the gap display parameters and the gap width of the gap area.

[0125] The correction module 308 is used to correct the gap area based on the correction compensation amount.

[0126] In one embodiment, the image display data includes the first pixel brightness value and the first pixel chromaticity value of each pixel in the display image located in the corresponding camera coordinate system; the fused display data includes the fused brightness value and the fused chromaticity value located in the global coordinate system; the fusion module 304 is further configured to, for each pixel in each display image, convert the first pixel brightness value of the pixel located in the corresponding camera coordinate system into a pixel brightness value located in the global coordinate system to obtain the second pixel brightness value corresponding to the pixel in the display image, convert the first pixel chromaticity value of the pixel located in the corresponding camera coordinate system into a pixel chromaticity value located in the global coordinate system to obtain the second pixel chromaticity value corresponding to the pixel in the display image; fuse the second pixel brightness values ​​corresponding to the same pixel in multiple display images to obtain a fused brightness value; fuse the second pixel chromaticity values ​​corresponding to the same pixel in multiple display images to obtain a fused chromaticity value.

[0127] In one embodiment, the image display data includes the pixel brightness value of each pixel in the displayed image; the fused display data includes the fused brightness value; the determining module 306 is further configured to determine the brightness gradient value of each pixel in the display screen based on the fused brightness value; and to determine the area corresponding to the pixel in the display screen whose brightness gradient value is greater than a preset gradient threshold as the gap area of ​​the display screen.

[0128] In one embodiment, the determining module 306 is further configured to average the fused display data corresponding to each pixel in the normal display area of ​​the display screen to obtain the reference display data corresponding to the gap area; and determine the gap display parameters of the gap area based on the reference display data and the fused display data corresponding to each pixel in the gap area.

[0129] In one embodiment, the determining module 306 is further configured to determine a compensation factor based on the gap width of the gap region; and to determine a correction compensation amount based on the gap display parameters and the compensation factor.

[0130] In one embodiment, the image display data includes the pixel brightness value and pixel chromaticity value of each pixel in the displayed image; the fused display data includes the fused brightness value and fused chromaticity value; the gap display parameters include the brightness change intensity value and chromaticity deviation value; the correction compensation amount includes the brightness compensation amount and the chromaticity compensation amount; the correction module 308 is further configured to correct the brightness of each pixel in the gap region based on the fused brightness value and the brightness compensation amount; and to correct the chromaticity of each pixel in the gap region based on the fused chromaticity value and the chromaticity compensation amount.

[0131] In one embodiment, the determining module 306 is further configured to select one pixel located at the edge from each side of the gap region to obtain two gap edge points; for each gap edge point in each displayed image, convert the first position coordinates of the gap edge point in the corresponding camera coordinate system into position coordinates in the global coordinate system to obtain the second position coordinates corresponding to the gap edge point in the displayed image; fuse the second position coordinates corresponding to the same gap edge point in multiple displayed images to obtain the fused position coordinates corresponding to the two gap edge points respectively; and determine the gap width of the gap region based on the difference in the horizontal coordinates of the fused position coordinates corresponding to the two gap edge points respectively.

[0132] The aforementioned display screen gap correction device involves acquiring multiple display images from multiple cameras located at different angles on the display screen; fusing the image display data of the multiple display images to obtain fused display data; determining the gap area and gap display parameters of the display screen based on the fused display data; determining the correction compensation amount based on the gap display parameters and the gap width of the gap area; and correcting the gap area based on the correction compensation amount. Compared to traditional display screen gap correction methods, this application uses cameras with multiple viewing angles to acquire images of the display content on the display screen, and performs multi-view spatial fusion of the image display data acquired from multiple viewing angles. Because multi-view spatial fusion integrates information from multiple viewing angles, it overcomes the limitations of traditional single-viewpoint methods, improves the accuracy and robustness of gap detection, and can accurately locate the gap area from the screen, comprehensively capture the gap display parameters of the gap area, and thus accurately estimate the correction compensation amount for the gap area to correct the display effect of the gap area. This effectively avoids bright and dark lines on the screen display and improves the correction accuracy.

[0133] Each module in the aforementioned display screen gap correction device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor within the display screen in hardware form or independent of it, or stored in the display screen's memory in software form, so that the processor can call and execute the corresponding operations of each module.

[0134] In one embodiment, a display screen is provided, the internal structure of which can be shown as follows: Figure 4As shown, the display screen includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it implements a display screen gap correction method. The display unit of the display screen is used to form a visually visible image. It can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the display screen can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the display screen housing, or external keyboards, touchpads, or mice, etc.

[0135] Those skilled in the art will understand that Figure 4 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the display screen to which the present application is applied. A specific display screen may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0136] In one embodiment, a display screen is also provided, including a memory and a processor, the memory storing a computer program, the processor executing the computer program to implement the steps in the above method embodiments.

[0137] In one embodiment, a computer-readable storage medium is provided storing a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0138] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0139] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.

[0140] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the methods described above. Any references to memory, storage, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, or optical storage, etc. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc.

[0141] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0142] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the invention patent. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this patent application should be determined by the appended claims.

Claims

1. A method for correcting gaps in a display screen, characterized in that, The method includes: Multiple display images are acquired by multiple cameras located at different angles on the display screen; The image display data of the multiple displayed images are merged to obtain merged display data; Based on the fused display data, the gap area of ​​the display screen and the gap display parameters of the gap area are determined; Based on the gap display parameters and the gap width of the gap area, a correction compensation amount is determined, and the gap area is corrected based on the correction compensation amount.

2. The method according to claim 1, characterized in that, The image display data includes the first pixel brightness value and the first pixel chromaticity value of each pixel in the displayed image located in the corresponding camera coordinate system; the fused display data includes the fused brightness value and fused chromaticity value located in the global coordinate system. The step of fusing the image display data of the multiple displayed images to obtain fused display data includes: For each pixel in each displayed image, the first pixel brightness value of the pixel in the corresponding camera coordinate system is converted into a pixel brightness value in the global coordinate system to obtain the second pixel brightness value corresponding to the pixel in the displayed image. The first pixel chromaticity value of the pixel in the corresponding camera coordinate system is converted into a pixel chromaticity value in the global coordinate system to obtain the second pixel chromaticity value corresponding to the pixel in the displayed image. The brightness values ​​of the second pixel corresponding to the same pixel point in the multiple display images are merged to obtain a merged brightness value; The second pixel chromaticity values ​​corresponding to the same pixel point in the multiple display images are fused to obtain a fused chromaticity value.

3. The method according to claim 1, characterized in that, The image display data includes the pixel brightness value of each pixel in the displayed image; The fused display data includes fused brightness values; The step of determining the gap area of ​​the display screen based on the fused display data includes: Based on the fused brightness value, determine the brightness gradient value of each pixel in the display screen; The area corresponding to the pixels in the display screen whose brightness gradient value is greater than a preset gradient threshold is determined as the gap area of ​​the display screen.

4. The method according to claim 1, characterized in that, The step of determining the gap display parameters of the gap region based on the fused display data includes: The average of the fused display data corresponding to each pixel in the normal display area of ​​the display screen is calculated to obtain the reference display data corresponding to the gap area; Based on the baseline display data and the fused display data corresponding to each pixel in the gap region, the gap display parameters of the gap region are determined.

5. The method according to claim 1, characterized in that, The step of determining the correction compensation amount based on the gap display parameters and the gap width of the gap area includes: The compensation factor is determined based on the gap width of the gap region; The correction compensation amount is determined based on the gap display parameters and the compensation factor.

6. The method according to claim 1, characterized in that, The image display data includes the pixel brightness value and pixel chromaticity value of each pixel in the displayed image; the fused display data includes the fused brightness value and fused chromaticity value; the gap display parameters include the brightness change intensity value and chromaticity deviation value. The correction compensation amount includes luminance compensation amount and chromaticity compensation amount; The step of correcting the gap region based on the correction compensation amount includes: Based on the fused brightness value and the brightness compensation amount, the brightness of each pixel in the gap region is corrected; Based on the fused chromaticity value and the chromaticity compensation amount, the chromaticity of each pixel in the gap region is corrected.

7. The method according to any one of claims 1 to 6, characterized in that, The method further includes: Two edge points of the gap are obtained by selecting one pixel on each side of the gap region. For each gap edge point in each displayed image, the first position coordinates of the gap edge point in the corresponding camera coordinate system are converted into position coordinates in the global coordinate system to obtain the second position coordinates corresponding to the gap edge point in the displayed image; The second position coordinates corresponding to the same gap edge point in the multiple display images are fused to obtain the fused position coordinates corresponding to each of the two gap edge points; The gap width of the gap region is determined based on the difference in the horizontal coordinates of the fusion position coordinates corresponding to the two gap edge points.

8. A display screen gap correction device, characterized in that, The device includes: The acquisition module is used to acquire multiple display images captured by multiple cameras located at different angles on the display screen; The fusion module is used to fuse the image display data of the multiple display images to obtain fused display data; The determining module is used to determine the gap area of ​​the display screen and the gap display parameters of the gap area based on the fused display data; and to determine the correction compensation amount based on the gap display parameters and the gap width of the gap area. A correction module is used to correct the gap area based on the correction compensation amount.

9. A display screen, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 7.

Images