Screen brightness correction extraction method and device and storage medium

Abstract

The invention discloses a screen brightness correction extraction method and device and a storage medium, which are used for improving the accuracy of pixel brightness extraction. Performing image acquisition on the standard light source by using a sampling camera to generate a light source shooting image; lightening the screen by using the lightening image, and performing image acquisition by using the sampling camera to generate a screen shooting image; carrying out region segmentation on the light source shooting image and the screen shooting image; using a luminance meter to carry out luminance detection on segmented areas on the light source shooting image and the screen shooting image; calculating gray average data of segmented areas on the light source shooting image and the screen shooting image; generating a correction coefficient according to the brightness data and the gray average data of the segmented region; performing image correction on the screen shot image by using the correction coefficient; pixel point position correction is carried out on the screen shooting image after gray level correction; and carrying out pixel point brightness information extraction on the screen shot image after the position correction is completed, and generating a brightness extraction result image.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of display screen detection, and in particular to a method, device and storage medium for screen brightness correction extraction. Background Art

[0002] In the field of display screen inspection, it is usually necessary to detect different types of defects on the display screen. Defect detection and defect compensation are important production links. When different display screen structures generate the same defect, its manifestation is also different. In order to improve the quality of display screen products, De-Mura is still an indispensable link in the panel process. The De-Mura compensation process is based on the grayscale values ​​of each pattern screen taken by a high-resolution camera. Before starting the algorithm processing, the program will go through a series of image preprocessing so that the grayscale difference of each screen can more realistically restore the mura form of the panel itself. In order to improve the detection accuracy, it is necessary to accurately extract the brightness data of the display screen itself. In the process of existing display screen brightness extraction, high-precision acquisition equipment is usually used to set a good acquisition environment.

[0003] However, there are still many problems in the process of brightness extraction. First of all, in the process of continuous updating and iteration of display screens, many new types of screens such as curved screens and folding screens have appeared. In order to increase the functionality of the display screen, on the basis of adding a PCB structure under the original display screen, a thin-film circuit is added under the pixel layer of the display screen. The thin-film circuit is used to control the structure on the pixel layer. This type of thin-film circuit has a certain reflective ability, which will affect the brightness of the display screen and thus affect the brightness extraction of the display screen. This type of circuit structure is usually set at the bottom edge of the display screen, because the display function of this area can allow a certain brightness error. Secondly, due to the characteristics of the optical FA lens of the acquisition camera, when the display screen product is large, it is easy to have a difference in the brightness of the product center and edge collection, which makes it more difficult to extract the brightness of the edge of the display screen, reducing the accuracy of pixel brightness extraction. Summary of the invention

[0004] The present application discloses a method, device and storage medium for screen brightness correction extraction, which are used to improve the accuracy of pixel brightness extraction.

[0005] In a first aspect, an embodiment of the present application provides a method for screen brightness correction and extraction, comprising: starting a standard light source, using a sampling camera to capture an image of the standard light source, and generating a light source captured image; lighting an image according to a standard light source design, lighting a screen using the lighting image, and using a sampling camera to capture an image of the lit screen, and generating a screen captured image; performing region segmentation on the light source captured image and the screen captured image according to a preset segmentation accuracy, and generating a number of one-to-one corresponding segmented regions on the light source captured image and the screen captured image; using a luminance meter to perform brightness detection on the segmented regions on the light source captured image and the screen captured image; calculating the grayscale mean data of the segmented regions on the light source captured image and the screen captured image; generating a correction coefficient based on the brightness data and grayscale mean data of the segmented regions; using the correction coefficient to perform image correction on the screen captured image; performing pixel position correction on the screen captured image after grayscale correction; extracting pixel brightness information on the screen captured image after position correction, and generating a brightness extraction result graph.

[0006] Optionally, the screen is a curved screen with a thin-film circuit added after the pixel layer, the curved screen including a plane area and a curved surface area, and the thin-film circuit is located on the curved surface portion of the screen body; performing regional segmentation on the light source captured image and the screen captured image according to a preset segmentation accuracy, and generating a number of one-to-one corresponding segmented areas on the light source captured image and the screen captured image, the steps comprising: determining a first plane area and a first curved surface area in the screen captured image; drawing a second plane area and a second curved surface area according to corresponding positions of the first plane area and the first curved surface area on the light source captured image; performing regional segmentation on the first plane area and the second plane area according to a preset first segmentation accuracy, and generating a number of one-to-one corresponding plane segmentation areas; performing regional segmentation on the first curved surface area and the second curved surface area according to a preset second segmentation accuracy, and generating a number of one-to-one corresponding curved surface segmentation areas.

[0007] Optionally, after the step of using a luminance meter to detect the brightness of the segmented areas on the light source captured image and the screen captured image, and before the step of calculating the grayscale mean data of the segmented areas on the light source captured image and the screen captured image, the method also includes: obtaining curvature data and pixel spacing data of the curved surface portion of the screen, and generating vertical scattering data based on the curvature data and the pixel spacing data; obtaining reflectivity data of the thin film circuit; and performing surface brightness correction on the brightness data of the curved surface segmented areas of the screen based on the vertical scattering data and the reflectivity data.

[0008] Optionally, after the step of calculating the grayscale mean data of the segmented areas on the light source captured image and the screen captured image, and before generating the correction coefficient based on the brightness data and grayscale mean data of the segmented areas, the method also includes: correcting the grayscale of the curved surface based on the reflectivity data of the thin film circuit.

[0009] Optionally, the step of correcting the pixel position of the screen captured image after grayscale correction includes: designing a positioning screen, lighting the screen using the positioning screen, setting a positioning point on the positioning image, and the position of the positioning point is determined by the screen type; using a sampling camera to capture an image of the screen to generate a screen positioning image, and there is a positioning point on the screen positioning image; extracting the first coordinate position information of the positioning point on the screen positioning image; calculating the distortion coefficient based on the first coordinate position information of the positioning point on the screen positioning image and the second coordinate position information of the positioning point on the positioning screen; and correcting the pixel position of the screen captured image after grayscale correction based on the distortion coefficient.

[0010] Optionally, the step of extracting pixel brightness information from the position-corrected screen shot image to generate a brightness extraction result map includes: Prepare a mapping picture and use the mapping picture to light up the screen; use a sampling camera to capture images of the screen to generate a screen mapping image; generate an affine transformation matrix based on the corner point coordinate information of the screen mapping image and the target coordinate information of the screen shot image; extract the pixel brightness information of the position-corrected screen shot image through the affine transformation matrix to generate a brightness extraction result map.

[0011] In a second aspect, an embodiment of the present application provides a device for screen brightness correction extraction, including: a first generation unit, used to start a standard light source, use a sampling camera to capture images of the standard light source, and generate a light source captured image; a second generation unit, used to design a lighting image according to the standard light source, use the lighting image to light up the screen, and use the sampling camera to capture images of the lit screen to generate a screen captured image; a segmentation unit, used to perform regional segmentation on the light source captured image and the screen captured image according to a preset segmentation accuracy, and generate a number of one-to-one corresponding segmented areas on the light source captured image and the screen captured image; a brightness detection unit; A first correction unit is used to perform image correction on the screen-captured image using the correction coefficient; a second correction unit is used to perform pixel position correction on the screen-captured image after the grayscale correction; and a fourth generation unit is used to extract pixel brightness information from the screen-captured image after the position correction, and generate a brightness extraction result graph.

[0012] Optionally, the screen is a curved screen with a thin-film circuit added behind the pixel layer, the curved screen including a plane area and a curved surface area, and the thin-film circuit is located on the curved surface portion of the screen body; the segmentation unit includes: determining a first plane area and a first curved surface area in the screen captured image; drawing a second plane area and a second curved surface area according to corresponding positions of the first plane area and the first curved surface area on the light source captured image; performing regional segmentation on the first plane area and the second plane area according to a preset first segmentation accuracy to generate a number of one-to-one corresponding plane segmentation areas; performing regional segmentation on the first curved surface area and the second curved surface area according to a preset second segmentation accuracy to generate a number of one-to-one corresponding curved surface segmentation areas.

[0013] Optionally, after the brightness detection unit and before the calculation unit, the device also includes: a first acquisition unit, used to acquire curvature data and pixel spacing data of the curved surface portion of the screen, and generate vertical scattering data based on the curvature data and the pixel spacing data; a second acquisition unit, used to acquire reflectivity data of the thin film circuit; and a third correction unit, used to perform surface brightness correction on the brightness data of the curved surface segmented area of ​​the screen based on the vertical scattering data and the reflectivity data.

[0014] Optionally, after the calculation unit and before the third generation unit, the device further includes: a fourth correction unit, configured to correct the grayscale of the curved surface according to the reflectivity data of the thin film circuit.

[0015] Optionally, the second correction unit includes: designing a positioning picture, lighting the screen using the positioning picture, setting a positioning point on the positioning image, and the position of the positioning point is determined by the screen type; using a sampling camera to capture an image of the screen to generate a screen positioning image, and there is a positioning point on the screen positioning image; extracting the first coordinate position information of the positioning point on the screen positioning image; calculating the distortion coefficient based on the first coordinate position information of the positioning point on the screen positioning image and the second coordinate position information of the positioning point on the positioning picture; and performing pixel position correction on the grayscale corrected screen captured image based on the distortion coefficient.

[0016] Optionally, the fourth generating unit includes: preparing a mapping picture, and lighting the screen using the mapping picture; using a sampling camera to capture an image of the screen to generate a screen mapping image; generating an affine transformation matrix according to the corner point coordinate information of the screen mapping image and the target coordinate information of the screen captured image; extracting pixel brightness information of the position-corrected screen captured image through the affine transformation matrix to generate a brightness extraction result map.

[0017] In the third aspect, an embodiment of the present application provides a device for screen brightness correction extraction, comprising: a processor, a memory, an input-output unit, and a bus; the processor is connected to the memory, the input-output unit, and the bus; the memory stores a program, and the processor calls the program to execute the first aspect and any optional method of the first aspect.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a program is stored. When the program is executed on a computer, the program executes the first aspect and any optional method of the first aspect.

[0019] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages: The present application first starts the standard light source, uses the sampling camera to capture images of the standard light source, and generates a light source captured image. According to the standard light source design, the image is lit, the screen is lit using the lit image, and the sampling camera is used to capture images of the lit screen to generate a screen captured image. The light source captured image and the screen captured image are segmented according to the preset segmentation accuracy, and a number of one-to-one corresponding segmented areas are generated on the light source captured image and the screen captured image. A luminance meter is used to detect the brightness of the segmented areas on the light source captured image and the screen captured image. The grayscale mean data of the segmented areas on the light source captured image and the screen captured image are calculated. The correction coefficient is generated based on the brightness data and grayscale mean data of the segmented areas. The screen captured image is corrected using the correction coefficient. The pixel position is corrected for the screen captured image after grayscale correction. The pixel brightness information of the screen captured image after position correction is extracted to generate a brightness extraction result graph.

[0020] By lighting up the standard light source and the screen, and then using a sampling camera to shoot, the screen shot image and the light source shot image are generated, and then the screen shot image and the light source shot image are segmented, and then a brightness meter is used to detect the brightness, and the brightness correction is performed in combination with the grayscale detection data to make the brightness of the center and edge of the screen in the screen shot image consistent, and then a partition position correction is performed on the entire screen, and then the brightness of the fully lit pixels is extracted. This method can not only ensure the position accuracy of the extraction, but also avoid multiple search extraction and merging operations, further improving the accuracy of brightness extraction. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0022] Figure 1 A schematic diagram of an embodiment of the method for screen brightness correction extraction of the present application; Figure 2 A schematic diagram of an embodiment of the method for image region segmentation of the present application; Figure 3 A schematic diagram of an embodiment of the method for curved surface brightness correction of the present application; Figure 4 A schematic diagram of an embodiment of the method for grayscale correction of a curved surface of the present application; Figure 5 A schematic diagram of an embodiment of a method for pixel position correction of the present application; Figure 6 A schematic diagram of an embodiment of a method for generating a brightness extraction result map for the present application; Figure 7 A schematic diagram of an embodiment of a device for screen brightness correction extraction of the present application; Figure 8 A schematic diagram of another embodiment of the device for screen brightness correction extraction of the present application; Fig. 9 A schematic diagram of an embodiment of the screen capture screen of the present application; Fig.10 A schematic diagram of an embodiment of a screen positioning image of a flat-panel display screen of the present application; Fig.11 A schematic diagram of an embodiment of an image after positioning processing of a screen positioning image of a flat-panel display screen of the present application; Fig.12 It is a schematic diagram of an embodiment of a brightness extraction result diagram corresponding to a screen shot image of the present application. DETAILED DESCRIPTION

[0023] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0024] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0025] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0026] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0027] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0028] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0029] In the prior art, there are still many problems in the process of brightness extraction. First, in the process of continuous updating and iteration of display screens, many new types of screens such as curved screens and folding screens have appeared. In order to increase the functionality of the display screen, on the basis of adding a PCB structure under the original display screen, a thin-film circuit is added under the pixel layer of the display screen. The thin-film circuit is used to control the structure on the pixel layer. This type of thin-film circuit has a certain reflective ability, which will affect the brightness of the display screen and thus affect the brightness extraction of the display screen. This type of circuit structure is usually set at the bottom edge of the display screen, because the display function of this area can allow a certain brightness error. Secondly, due to the characteristics of the optical FA lens of the acquisition camera, when the display screen product is large, it is easy to have a difference in the brightness of the product center and edge collection, which makes it more difficult to extract the brightness of the edge of the display screen, reducing the accuracy of pixel brightness extraction.

[0030] Based on this, the present application discloses a method, device and storage medium for screen brightness correction extraction, which are used to improve the accuracy of pixel brightness extraction.

[0031] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0032] The method of the present application can be applied to a server, a device, a terminal or other devices with logic processing capabilities, and the present application does not limit this. For the convenience of description, the following description is made by taking the execution subject as an example of a terminal.

[0033] See also Figure 1 The present application provides an embodiment of a method for screen brightness correction extraction, comprising: 101. Start the standard light source, use the sampling camera to collect images of the standard light source, and generate a light source shooting image.

[0034] 102. Design a lighting image according to a standard light source, light up the screen using the lighting image, and use a sampling camera to capture an image of the lit screen to generate a screen shot image.

[0035] 103. Perform region segmentation on the light source captured image and the screen captured image according to a preset segmentation accuracy, and generate a plurality of one-to-one corresponding segmentation regions on the light source captured image and the screen captured image.

[0036] 104. Use a luminance meter to detect the brightness of the divided areas on the light source captured image and the screen captured image.

[0037] 105. Calculate grayscale mean data of the segmented areas on the light source captured image and the screen captured image.

[0038] 106. Generate a correction coefficient based on the brightness data and grayscale mean data of the segmented area.

[0039] 107. Use the correction coefficient to correct the screen captured image.

[0040] 108. Perform pixel position correction on the screen captured image after grayscale correction.

[0041] 109. Extract pixel brightness information from the screen shot image after position correction to generate a brightness extraction result map.

[0042] In the embodiments of the present application, a set of standard light sources is used as a reference system, and a spherical integral light source is usually selected. Use a capture camera to shoot under a standard light source to generate a light source captured image, then light up the screen to display a lit picture, and then use a sampling camera to capture the image of the lit screen to generate a screen captured image. After shooting, set the segmentation accuracy, perform regional segmentation on the light source captured image and the screen captured image according to the preset segmentation accuracy, and generate a number of one-to-one corresponding segmentation areas on the light source captured image and the screen captured image. The segmentation accuracy is generated according to the type of screen, including plane areas, curved areas, folded areas, etc., as well as a number of rectangular areas with the camera center axis as the center point, and also includes the corresponding areas of the thin-film circuits provided in the screen. Because the brightness of different areas is affected differently, different affected areas need to be corrected separately through regional segmentation. Please check Fig. 9 , Fig. 9 This is a schematic diagram of a screen shot. All pixels of the screen are lit up, but the brightness and grayscale of the pixels on the screen shot image will be different.

[0043] Next, the terminal uses a brightness meter as a brightness reference for collection. In this embodiment, a CS2000 brightness meter is used for detection.

[0044] After the terminal takes the light source image and the screen image, it divides the light source image and the screen image into N areas respectively. The two images are divided in the same way. Generally, the curved area, circuit area, etc. are first divided according to the screen image, and then the light source image is divided in the same way according to the division method. The correction coefficient is calculated for each area to find each correction coefficient K. It should be noted that the larger the division area N, the higher the accuracy, but the longer the processing time.

[0045] Next, the terminal calculates the grayscale mean data of the segmented areas on the light source captured image and the screen captured image, and generates correction coefficients based on the brightness data and grayscale mean data of the segmented areas.

[0046]

[0047] in, The brightness value measured by CS2000 for the light source image under the standard light source is The brightness value measured by CS2000 for the screen capture image; The average grayscale of the corresponding unit comparison area in the image taken by the standard light source; It is the average grayscale of the corresponding unit comparison area in the image to be corrected (screen shot image).

[0048] The terminal calculates the correction coefficient K according to the segmentation accuracy, and then corrects the screen shot image. The correction formula is as follows.

[0049]

[0050] I is the screen capture image correction area, is the grayscale of the image after correction.

[0051] The embodiment of the present application first starts the standard light source, uses the sampling camera to capture images of the standard light source, and generates a light source captured image. According to the standard light source design, the image is lit, the screen is lit using the lit image, and the image of the lit screen is captured using the sampling camera to generate a screen captured image. The light source captured image and the screen captured image are segmented according to the preset segmentation accuracy, and a number of one-to-one corresponding segmented areas are generated on the light source captured image and the screen captured image. A luminance meter is used to detect the brightness of the segmented areas on the light source captured image and the screen captured image. The grayscale mean data of the segmented areas on the light source captured image and the screen captured image are calculated. A correction coefficient is generated based on the brightness data and grayscale mean data of the segmented areas. The screen captured image is corrected using the correction coefficient. The pixel position of the screen captured image after grayscale correction is corrected. The pixel brightness information of the screen captured image after position correction is extracted to generate a brightness extraction result graph.

[0052] By lighting up the standard light source and the screen, and then using a sampling camera to shoot, the screen shot image and the light source shot image are generated, and then the screen shot image and the light source shot image are segmented, and then a brightness meter is used to detect the brightness, and the brightness correction is performed in combination with the grayscale detection data to make the brightness of the center and edge of the screen in the screen shot image consistent, and then a partition position correction is performed on the entire screen, and then the brightness of the fully lit pixels is extracted. This method can not only ensure the position accuracy of the extraction, but also avoid multiple search extraction and merging operations, further improving the accuracy of brightness extraction.

[0053] See also Figure 2 The present application provides an embodiment of a method for image region segmentation, wherein the screen is a curved screen with a thin-film circuit added behind a pixel layer, the curved screen includes a flat area and a curved area, and the curved part of the thin-film circuit located on the screen body includes: 201. Determine a first plane area and a first curved surface area in a screen shot image.

[0054] 202. Draw a second plane area and a second curved surface area according to corresponding positions of the first plane area and the first curved surface area on the image captured by the light source.

[0055] 203. Perform region segmentation on the first plane region and the second plane region according to a preset first segmentation accuracy to generate a plurality of one-to-one corresponding plane segmentation regions.

[0056] 204. Perform region segmentation on the first curved surface region and the second curved surface region according to a preset second segmentation accuracy to generate a plurality of one-to-one corresponding curved surface segmentation regions.

[0057] In the embodiment of the present application, a new type of curved screen is applicable. This type of curved screen is provided with a thin circuit, which is different from the conventional setting scheme. A display screen is composed of multiple structural layers stacked together. After the production is completed, the operation of each structural layer on the display screen is controlled by crimping. When the display screen is qualified in all aspects, the display screen can be integrated with structures such as PCB boards to form a device with display function. As one of the layers in the display screen structure, the conventional thin circuit layer is usually arranged below the pixel layer of the flat display screen. In the thin circuit layer, the thin circuit may not occupy the entire layer because there are many metal lines for transmitting electrical signals. Therefore, in order to reduce the influence of the thin circuit, the wave circuit is usually set at the edge of the thin circuit layer. For example: a touch screen used in a mobile phone has a large display area in the middle of the screen, and the bottom edge is usually the key area of ​​the touch screen. Although this area can also display the picture normally, the importance of the display function of this area is not as good as the central display area for the user, that is, the display quality of this area (for the user) can be slightly lower than that of the central area, so the thin circuit is usually set at the lower edge of the thin circuit layer. However, with the emergence of curved screens, the importance of the curved part to real functions for users is obviously lower than the lower edge of the display screen. Therefore, the current strategy is usually to set the thin-film circuit on the curved part of the thin-film circuit layer. However, the curved part of the curved screen requires high-precision pixel point information extraction during the detection process, which requires the use of new technical means for detection.

[0058] In an embodiment of the present application, the terminal first determines the first plane area and the first curved surface area in the screen shot image, that is, divides different correction areas. Then, the second plane area and the second curved surface area are drawn according to the corresponding positions of the first plane area and the first curved surface area on the light source shot image, because the subsequent calculation of the correction parameters needs to be calculated according to the grayscale and brightness of the areas corresponding to the two images. Next, the first plane area and the second plane area are segmented according to the preset first segmentation accuracy to generate a number of one-to-one corresponding plane segmentation areas, and then the first curved surface area and the second curved surface area are segmented according to the preset second segmentation accuracy to generate a number of one-to-one corresponding curved surface segmentation areas. Because the curved area requires higher precision, and the pixels on the flat area can usually be collected by the sampling line camera, while only part of the curved part can be photographed. When the camera shoots vertically from top to bottom, the pixels on the front vertical part can be collected, which is usually located at the edge. In order to capture all the pixels on the curved part, the prism reflection method is usually used for collection, that is, two reflecting prisms are placed on both sides of the curved screen to reflect the pixels on the back into the camera, but this will make the sampling of a part of the curved area farther away from the center of the collection camera, and the subsequent brightness extraction is more susceptible to the influence of the lens and the thin film circuit. Therefore, it is necessary to segment the complete curved part of the screen image (the part collected by the prism reflection method) and perform the same segmentation on the corresponding part of the light source image, so as to increase the accuracy in the subsequent brightness extraction process.

[0059] See also Figure 3 The present application provides an embodiment of a method for curved surface brightness correction, comprising: 301. Obtain curvature data and pixel spacing data of a curved surface portion of a screen, and generate vertical scattering data according to the curvature data and the pixel spacing data.

[0060] 302. Obtain reflectivity data of the thin-film circuit.

[0061] 303. Perform curved surface brightness correction on the brightness data of the curved surface segmented area of ​​the screen according to the vertical scattering data and the reflectivity data.

[0062] In the embodiment of the present application, the terminal needs to calibrate the brightness of the curved portion of the curved screen. Although the brightness of the image is extracted by a brightness meter, it cannot be guaranteed to be the same as what is actually displayed on the display screen, so preliminary brightness correction processing is required.

[0063] The embodiment of the present application discloses a brightness pre-correction method for a curved screen superimposed with a thin circuit layer, which obtains the curvature data and pixel spacing data of the curved surface of the screen, wherein the curvature data represents the curvature degree parameter of the curved surface, which can be set and measured during design. The curvature degree can affect the light emission direction of the pixel point, resulting in differences in the brightness collected by the vertical sampling camera.

[0064] The pixel pitch data refers to the distance between two adjacent pixels in the curved portion. The distance between any two adjacent pixels in the curved area of ​​the curved screen of the embodiment of the present application is consistent, but may be different from that in the flat portion.

[0065] The terminal generates vertical scattering data based on the curvature data and pixel spacing data. The vertical scattering data indicates the degree of loss in the acquisition direction (vertically upward) through the pixel points. First, based on the curvature data and pixel pitch data Look up or calculate the curvature scattering parameters , because different degrees of curvature and pixel spacing bring different brightness changes. Specifically, the curvature scattering parameter can be calculated by collecting the parameters of the curved area brightness and the flat area brightness of different curved screens, as well as the curvature and pixel spacing data, and calculating the curvature scattering parameter by the ratio of the flat area brightness to the curved area brightness. Then, a corresponding query table is generated, and then the curvature scattering parameter only needs to be queried from the table based on the curvature data and pixel spacing data of the curved screen detected later. ,in Greater than 0 and less than 1.

[0066] Next, the terminal obtains the reflectivity data of the thin-film circuit. The thin-film circuit is highly integrated and mainly composed of metal, so there is reflection on the brightness of the pixels on the pixel layer. Therefore, the reflectivity of the thin-film circuit is tested before production to generate corresponding reflectivity data.

[0067] Next, the terminal performs surface brightness correction on the brightness data of the curved surface segmentation area of ​​the screen according to the vertical scattering data and reflectivity data. The surface brightness correction coefficient formula is as follows:

[0068]

[0069] in, is the brightness after surface brightness correction, is the brightness of the surface before brightness correction, The reflectivity data of the thin circuit. This method can accurately calibrate the brightness of the curved surface and the thin circuit. For the normal curved area, the traditional calibration method can be used.

[0070] See also Figure 4 The present application provides an embodiment of a method for curved surface grayscale correction, comprising: 401. Correct the grayscale of the curved surface according to the reflectivity data of the thin film circuit.

[0071] In this embodiment, the surface grayscale is the grayscale mean value of the curved surface area in the grayscale mean data, and only the segmented area where the circuit area exists needs to be adjusted, that is, the area where the curved surface area and the thin circuit area overlap. After obtaining the surface grayscale of this part, the corresponding correction is performed. Since the thin circuit has a greater impact on the surface grayscale, it is necessary to try to use the reflectivity data for correction. The surface grayscale is a grayscale mean, specifically the grayscale mean of the three channels R, G and B, but this application only corrects the grayscale of channel G because this channel has the greatest impact on the human eye.

[0072]

[0073] After the grayscale of the G channel is recalibrated, the grayscales of the three channels R, G and B are averaged. This processing can well cope with the influence of the curved area and the circuit area, making the subsequent correction more accurate.

[0074] See also Figure 5 The present application provides an embodiment of a method for pixel position correction, comprising: 501. Design a positioning picture, use the positioning picture to light up the screen, and set positioning points on the positioning image. The positions of the positioning points are determined by the screen type.

[0075] 502. Use a sampling camera to collect images of the screen to generate a screen positioning image, and there are positioning points on the screen positioning image.

[0076] 503. Extract first coordinate position information of the positioning point on the screen positioning image.

[0077] 504. Calculate the distortion coefficient according to the first coordinate position information of the positioning point on the screen positioning image and the second coordinate position information of the positioning point on the positioning picture.

[0078] 505. Perform pixel position correction on the grayscale-corrected screen captured image according to the distortion coefficient.

[0079] In this embodiment, the terminal designs a positioning picture, uses the positioning picture to light up the screen, and a mark positioning point is set on the positioning image, and the position of the mark positioning point is determined by the screen type.

[0080] The terminal uses a sampling camera to collect images of the screen and generate a screen positioning image. There are positioning points on the screen positioning image. Please refer to Fig.10 , Fig.10 This is a schematic diagram of the screen positioning image of a flat display. The shooting center in the figure is biased to the right. It can be seen that the part at the edge is relatively blurred, the part at the center of the camera is relatively clear, and there is a clear difference in the brightness of the positioning point.

[0081] The terminal extracts the first coordinate position information of the positioning point on the screen positioning image, performs threshold segmentation on the captured screen positioning image, and then disconnects the connected domain of the selected area. By screening the shape and pixel area, the corresponding first coordinate position information is extracted. Please refer to Fig.11 , Fig.11 This is a schematic diagram of an image after positioning processing of the screen positioning image of a flat display screen. The position framed by a red circle is the first coordinate position information after positioning is completed.

[0082] Next, the terminal calculates the distortion coefficient according to the first coordinate position information of the positioning point on the screen positioning image and the second coordinate position information of the positioning point on the positioning picture, and finally performs pixel position correction on the grayscale corrected screen captured image according to the distortion coefficient. The distortion coefficient is calculated, including the expression of radial distortion coefficient and tangential distortion coefficient: The expression of radial distortion coefficient is:

[0083]

[0084] Among them, Xdr and Ydr are the pixel coordinates after distortion, x and y are ideal coordinates, x and y have the following equations, r is the value calculated from the ideal coordinates, is the distance from the target point to the center, and k1, k2, and k3 are radial distortion parameters.

[0085]

[0086] The expression of tangential distortion coefficient is:

[0087]

[0088] Among them, Xdt and Ydt are also the pixel coordinates after distortion, x and y are the ideal coordinates, and p1 and p2 are the tangential distortion parameters.

[0089] It can be seen that five distortion coefficients k1, k2, k3, p1 and p2 need to be solved.

[0090] Solve it by the following polynomial:

[0091]

[0092] Solve the polynomial equation to find the five distortion coefficients k1, k2, k3, p1, and p2.

[0093] Where Delta_x is the ideal column coordinate, Delta_y is the ideal row coordinate, x=grid reference mark column coordinate*MR-actual mark column coordinate, y=grid reference mark row coordinate*MR-actual mark row coordinate. The grid reference mark is the positioning image, the actual image is the screen positioning image, and MR is the number of image pixels that a single screen pixel occupies in the corresponding image.

[0094] See also Figure 6 The present application provides an embodiment of a method for generating a brightness extraction result map, comprising: 601. Prepare a mapping picture, and use the mapping picture to light up the screen.

[0095] 602. Use a sampling camera to collect images of the screen to generate a screen mapping image.

[0096] 603. Generate an affine transformation matrix according to the corner point coordinate information of the screen mapping image and the target coordinate information of the screen capturing image.

[0097] 604. Extract pixel brightness information of the position-corrected screen shot image using an affine transformation matrix to generate a brightness extraction result graph.

[0098] In an embodiment of the present application, the terminal prepares a mapping screen and uses the mapping screen to light up the screen. A sampling camera is used to capture an image of the screen to generate a screen mapping image. An affine transformation matrix is ​​generated based on the corner coordinate information of the screen mapping image and the target coordinate information of the screen shot image. The affine transformation matrix is ​​used to extract the pixel brightness information of the position-corrected screen shot image to generate a brightness extraction result map. Specifically, the terminal needs to perform brightness extraction on the corrected screen shot image into a small image. It is necessary to calculate the mapping matrix from the screen shot image to the small image to obtain the brightness extraction result map after extraction.

[0099] First, create a mapping screen with a resolution equal to the screen resolution and a grayscale of 255, import it into the PG device so that the display screen displays the mapping screen and take a photo with the acquisition camera to obtain the screen mapping image.

[0100] Extract the screen area of ​​the screen mapping image, obtain the corner point coordinate set A, and calculate the required affine transformation matrix C through the corresponding target coordinates B on the screen shooting image.

[0101]

[0102] The matrix is ​​expanded into the following formula:

[0103] Where QX and QY are the target coordinates B, that is, the coordinates of all points in the brightness extraction result map: (0,0), (0,1)...(0,PixelCol), (1,0)...(1,PixelCol)...(PixelRow,PixelCol), PX, PY are the coordinates of the captured image array.

[0104]

[0105] MR represents the number of image pixels a single screen pixel occupies in the image, PixelRow is the resolution in the row direction of the screen, and PixelCol is the resolution in the column direction of the screen.

[0106] After finding the affine transformation matrix C, transform the screen shot image to get the brightness extraction result diagram. Please refer to Fig.12 , Fig.12 This is the brightness extraction result map corresponding to the screen shot image.

[0107] See also Figure 7 The present application provides an embodiment of a device for screen brightness correction extraction, comprising: The first generating unit 701 is used to start the standard light source, use the sampling camera to collect images of the standard light source, and generate a light source shooting image.

[0108] The second generating unit 702 is used to design a lighting image according to a standard light source, light up a screen using the lighting image, and use a sampling camera to collect an image of the lit screen to generate a screen shot image.

[0109] The segmentation unit 703 is used to segment the light source captured image and the screen captured image into regions according to a preset segmentation accuracy, and generate a plurality of one-to-one corresponding segmentation regions on the light source captured image and the screen captured image.

[0110] Optionally, the screen is a curved screen with a thin-film circuit added behind the pixel layer, the curved screen includes a flat area and a curved area, and the thin-film circuit is located on the curved part of the screen body.

[0111] The segmentation unit 703 includes: A first planar area and a first curved area in the screen shot image are determined.

[0112] The second plane area and the second curved surface area are drawn according to corresponding positions of the first plane area and the first curved surface area on the image captured by the light source.

[0113] The first plane region and the second plane region are segmented according to a preset first segmentation accuracy to generate a plurality of one-to-one corresponding plane segmentation regions.

[0114] The first curved surface region and the second curved surface region are segmented according to a preset second segmentation accuracy to generate a plurality of one-to-one corresponding curved surface segmentation regions.

[0115] The brightness detection unit 704 is used to detect the brightness of the divided areas on the light source captured image and the screen captured image using a brightness meter.

[0116] The first acquisition unit 705 is used to acquire curvature data and pixel spacing data of the curved surface portion of the screen, and generate vertical scattering data according to the curvature data and the pixel spacing data.

[0117] The second acquisition unit 706 is used to acquire reflectivity data of the thin film circuit.

[0118] The third correction unit 707 is used to perform curved surface brightness correction on the brightness data of the curved surface segmented area of ​​the screen according to the vertical scattering data and the reflectivity data.

[0119] The calculation unit 708 is used to calculate the grayscale mean data of the segmented areas on the light source shooting image and the screen shooting image.

[0120] The fourth correction unit 709 is used to correct the grayscale of the curved surface according to the reflectivity data of the thin film circuit.

[0121] The third generating unit 710 is used to generate a correction coefficient according to the brightness data and grayscale mean data of the segmented area.

[0122] The first correction unit 711 is used to perform image correction on the screen captured image using the correction coefficient.

[0123] The second correction unit 712 is used to perform pixel position correction on the grayscale-corrected screen captured image.

[0124] Optionally, the second correction unit 712 includes: Design a positioning picture and use it to light up the screen. Positioning points are set on the positioning image, and the positions of the positioning points are determined by the screen type.

[0125] A sampling camera is used to collect images of the screen to generate a screen positioning image, on which there are positioning points.

[0126] Extract the first coordinate position information of the positioning point on the screen positioning image.

[0127] The distortion coefficient is calculated according to the first coordinate position information of the positioning point on the screen positioning image and the second coordinate position information of the positioning point on the positioning picture.

[0128] The pixel position of the screen shot image after grayscale correction is corrected according to the distortion coefficient.

[0129] The fourth generating unit 713 is used to extract the brightness information of the pixels of the screen shot image after the position correction, and generate a brightness extraction result map.

[0130] Optionally, the fourth generating unit 713 includes: Prepare a mapping screen and use the mapping screen to light up the screen.

[0131] A sampling camera is used to capture images of the screen to generate a screen mapping image.

[0132] An affine transformation matrix is ​​generated according to the corner point coordinate information of the screen mapping image and the target coordinate information of the screen capture image.

[0133] The brightness information of pixels in the position-corrected screen shot image is extracted through the affine transformation matrix to generate a brightness extraction result map.

[0134] See also Figure 8 , the present application provides a device for screen brightness correction extraction, comprising: Processor 801 , memory 802 , input-output unit 803 , and bus 804 .

[0135] The processor 801 is connected to the memory 802 , the input and output unit 803 , and the bus 804 .

[0136] The memory 802 stores a program, and the processor 801 calls the program to execute the following steps: Figure 1 , Figure 2 and Figure 3 , Figure 4 , Figure 5 , Figure 6 The method in .

[0137] The present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed on a computer, the program performs the following steps: Figure 1 , Figure 2 and Figure 3 , Figure 4 , Figure 5 , Figure 6 The method in .

[0138] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0139] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0140] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0141] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0142] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, read-only memory), random access memory (RAM, random access memory), disk or optical disk and other media that can store program code.

Claims

1. A method for screen brightness correction extraction, characterized in that: include: Starting a standard light source, using a sampling camera to collect images of the standard light source, and generating a light source shooting image; Design a lighting image according to a standard light source, light up the screen using the lighting image, and use a sampling camera to collect an image of the lit screen to generate a screen shot image; Performing regional segmentation on the light source captured image and the screen captured image according to a preset segmentation accuracy, and generating a plurality of one-to-one corresponding segmentation regions on the light source captured image and the screen captured image; Using a brightness meter to detect the brightness of the divided areas on the light source captured image and the screen captured image; Calculating grayscale mean data of segmented areas on the light source captured image and the screen captured image; Generate correction coefficients based on brightness data and grayscale mean data of the segmented area; Performing image correction on the screen captured image using the correction coefficient; Performing pixel point position correction on the screen captured image after grayscale correction; Pixel brightness information is extracted from the position-corrected screen shot image to generate a brightness extraction result graph.

2. The method according to claim 1, characterized in that The screen is a curved screen with a thin-film circuit added behind the pixel layer, the curved screen includes a flat area and a curved area, and the thin-film circuit is located on the curved surface of the screen body; The step of segmenting the light source captured image and the screen captured image according to a preset segmentation accuracy and generating a plurality of one-to-one corresponding segmentation areas on the light source captured image and the screen captured image comprises: Determining a first plane area and a first curved surface area in the screen shot image; Draw a second plane area and a second curved surface area according to corresponding positions of the first plane area and the first curved surface area on the image captured by the light source; Performing region segmentation on the first plane region and the second plane region according to a preset first segmentation accuracy to generate a plurality of one-to-one corresponding plane segmentation regions; The first curved surface region and the second curved surface region are segmented according to a preset second segmentation accuracy to generate a plurality of one-to-one corresponding curved surface segmentation regions.

3. The method according to claim 2, characterized in that After the step of using a luminance meter to detect the brightness of the segmented areas on the light source captured image and the screen captured image, and before the step of calculating grayscale mean data of the segmented areas on the light source captured image and the screen captured image, the method further includes: Acquire curvature data and pixel spacing data of a curved surface portion of the screen, and generate vertical scattering data according to the curvature data and the pixel spacing data; Obtaining reflectivity data of a thin-film circuit; The curved surface brightness correction is performed on the brightness data of the curved surface segmented area of ​​the screen according to the vertical scattering degree data and the reflectivity data.

4. The method according to claim 3, characterized in that After the step of calculating the grayscale mean data of the segmented areas on the light source captured image and the screen captured image, and before generating the correction coefficients according to the brightness data and grayscale mean data of the segmented areas, the method further includes: The grayscale of the curved surface is corrected according to the reflectivity data of the thin film circuit.

5. The method according to any one of claims 1 to 4, characterized in that The step of performing pixel point position correction on the grayscale-corrected screen captured image comprises: Design a positioning picture, and use the positioning picture to light up the screen. The positioning image is provided with positioning points, and the positions of the positioning points are determined by the screen type; Using a sampling camera to collect images of the screen to generate a screen positioning image, wherein the screen positioning image has positioning points; Extracting first coordinate position information of the positioning point on the screen positioning image; Calculating a distortion coefficient according to first coordinate position information of a positioning point on the screen positioning image and second coordinate position information of a positioning point on the positioning picture; The pixel position of the screen shot image after grayscale correction is corrected according to the distortion coefficient.

6. The method according to any one of claims 1 to 4, characterized in that The step of extracting pixel brightness information from the screen shot image after position correction to generate a brightness extraction result map comprises: Prepare a mapping picture, and use the mapping picture to light up the screen; Use a sampling camera to collect images of the screen and generate a screen mapping image; generating an affine transformation matrix according to the corner point coordinate information of the screen mapping image and the target coordinate information of the screen capturing image; The affine transformation matrix is ​​used to extract the pixel brightness information of the screen shot image after position correction, and a brightness extraction result map is generated.

7. A device for screen brightness correction extraction, characterized in that: include: A first generating unit is used to start a standard light source, use a sampling camera to collect images of the standard light source, and generate a light source shooting image; A second generating unit is used to design a lighting image according to a standard light source, light up a screen using the lighting image, and use a sampling camera to collect an image of the lit screen to generate a screen shot image; a segmentation unit, configured to segment the light source captured image and the screen captured image into regions according to a preset segmentation accuracy, and generate a plurality of one-to-one corresponding segmentation regions on the light source captured image and the screen captured image; a brightness detection unit, configured to use a brightness meter to detect brightness of the divided areas on the light source captured image and the screen captured image; A calculation unit, used for calculating grayscale mean data of segmented areas on the light source captured image and the screen captured image; A third generating unit, used for generating a correction coefficient according to the brightness data and grayscale mean data of the segmented area; A first correction unit, configured to perform image correction on the screen captured image using the correction coefficient; A second correction unit, used for performing pixel point position correction on the screen captured image after grayscale correction; The fourth generating unit is used to extract the brightness information of the pixels of the screen shot image after the position correction, and generate a brightness extraction result map.

8. The device according to claim 7, characterized in that The screen is a curved screen with a thin-film circuit added behind the pixel layer, the curved screen includes a flat area and a curved area, and the thin-film circuit is located on the curved surface of the screen body; The segmentation unit comprises: Determining a first plane area and a first curved surface area in the screen shot image; Draw a second plane area and a second curved surface area according to corresponding positions of the first plane area and the first curved surface area on the image captured by the light source; Performing region segmentation on the first plane region and the second plane region according to a preset first segmentation accuracy to generate a plurality of one-to-one corresponding plane segmentation regions; The first curved surface region and the second curved surface region are segmented according to a preset second segmentation accuracy to generate a plurality of one-to-one corresponding curved surface segmentation regions.

9. The device according to claim 8, characterized in that The device also includes: A first acquisition unit, used to acquire curvature data and pixel spacing data of a curved surface portion of the screen, and generate vertical scattering data according to the curvature data and the pixel spacing data; A second acquisition unit, used to acquire reflectivity data of the thin-sheet circuit; The third correction unit is used to perform curved surface brightness correction on the brightness data of the curved surface segmented area of ​​the screen according to the vertical scattering data and the reflectivity data.

10. A computer-readable storage medium having a program stored thereon, wherein the program, when executed on a computer, performs the method according to any one of claims 1 to 6.

Images