Compensation method and system of display device, electronic equipment and storage medium
By adopting target exposure time and enhanced processing technology on the OLED display, the problem of uneven brightness is solved, the compensation efficiency and brightness uniformity are improved, and the production line efficiency is improved.
Patent Information
- Application Number
- CN202410414423.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-04-07
- Publication Date
- 2025-01-07
- Estimated Expiration
- 2044-04-07
AI Technical Summary
When the prior art deals with the problem of uneven brightness of OLED display screens (Mura phenomenon), the compensation efficiency is low, especially under low brightness conditions. The long automatic exposure time leads to too long shooting time, affecting the production line efficiency.
By using the target exposure time on the OLED display to acquire images less than the automatic exposure time, the shooting time is shortened, and the accuracy and efficiency of the compensated data are improved through enhanced processing and filtering parameter optimization.
It effectively shortens the exposure time of the image acquisition equipment, improves the brightness uniformity and compensation efficiency of the display screen, and improves the production efficiency of the production line.
Smart Images

Figure CN119274483A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of display technology, and in particular, to a compensation method, system, electronic device and storage medium for a display device. Background Art
[0002] Organic light-emitting diode (OLED) displays have uneven screen brightness, which causes various traces, namely, the mura phenomenon.
[0003] At present, the demura compensation method is generally used to compensate for mura, so that the grayscale of the compensated mura area is consistent with that of the standard area. Existing demura compensation methods all require the use of a camera to capture the display screen of the display screen, obtain the display brightness of the display screen, and then determine the mura compensation data based on the display brightness. At present, in the production line, facing a large number of display screens to be compensated, the efficiency of determining the mura compensation data is low, which in turn affects the efficiency of the production line. Summary of the invention
[0004] The embodiments of the present application provide a compensation method, system, electronic device and storage medium for a display device. The electronic device shortens the shooting time and improves the efficiency of the entire production line by reducing the exposure time used when capturing the display image of the display device.
[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0006] In a first aspect, the present application provides a compensation method for a display device, the compensation method comprising:
[0007] When the first display device displays a picture with a first display brightness, the electronic device sends a target exposure time corresponding to the first display brightness to the image acquisition device; the target exposure time is less than the automatic exposure time of the image acquisition device; the electronic device receives a first target image from the image acquisition device, the first target image is an image obtained by the image acquisition device photographing the display picture of the first display device in response to the target exposure time, and the exposure time for photographing the first target image is the target exposure time; the electronic device determines corresponding compensation data based on the first target image; the electronic device sends the compensation data of the first target image to the first display device, triggering the first display device to adjust the display brightness.
[0008] It can be understood that the image acquisition device uses a target exposure time that is shorter than the automatic exposure time to capture the display screen of the first display device. By reducing the exposure time of the image acquisition device, the shooting time is shortened, thereby improving the production efficiency of the entire display device.
[0009] In another possible implementation manner of the first aspect, the electronic device sending the compensation data of the first target image to the first display device may include:
[0010] The electronic device performs enhancement processing on the first target image to obtain the first target image after brightness adjustment; after determining compensation data of the first target image after brightness adjustment, the electronic device sends the compensation data of the first target image after brightness adjustment to the first display device.
[0011] That is, the electronic device performs enhancement processing on the first target image so that the processed first target image can replace the image captured by using the automatic exposure time, thereby making the brightness of the enhanced first target image meet subsequent compensation requirements.
[0012] Since the target exposure time is less than the automatic exposure time, there may be a situation where the image amplitude of the first target image obtained by the image acquisition device using the target exposure time to acquire the display screen of the first display device is significantly different from the image amplitude obtained by using the automatic exposure time. The electronic device can enhance the first target image so that the image amplitude of the enhanced first target image is consistent with the image amplitude obtained by using the automatic exposure time. Further, the compensation accuracy of the display device is improved, thereby improving the brightness uniformity of the display device.
[0013] In another possible implementation manner of the first aspect, the electronic device performs enhancement processing on the first target image to obtain the first target image after brightness adjustment, including:
[0014] The electronic device uses the target filtering parameter corresponding to the first display brightness to perform enhancement processing on the first target image to obtain the first target image after brightness adjustment.
[0015] It can be understood that the electronic device uses the target filtering parameters to enhance the first target image so that the processed first target image can replace the image captured using the automatic exposure time, thereby making the brightness of the enhanced first target image meet subsequent compensation requirements.
[0016] In another possible implementation manner of the first aspect, the compensation method may further include:
[0017] The electronic device receives a plurality of frames of first images from an image acquisition device, wherein the plurality of frames of first images are images obtained by the image acquisition device using different exposure times to shoot a display screen of a second display device, the brightness of the second display device is the first display brightness, and the second display device and the first display device have the same screen type; the electronic device receives a second image from the image acquisition device, wherein the second image is an image obtained by the image acquisition device using an automatic exposure time to shoot a display screen of the second display device; the electronic device determines similarities between the plurality of frames of first images and the second image respectively; the electronic device determines a target exposure time based on the similarities between the plurality of frames of first images and the second image respectively.
[0018] That is to say, the electronic device finds a target exposure time whose shooting effect is close to the automatic exposure time but shorter than the automatic exposure time by comparing the similarity between multiple frames of the first image and the second image, so as to reduce the shooting time in the subsequent brightness compensation process of the screen of the same type of display device.
[0019] In another possible implementation manner of the first aspect, the electronic device determines the target exposure time according to similarities between the plurality of frames of the first image and the second image, including:
[0020] The electronic device determines the first image, whose similarity with the second image is greater than a similarity threshold, as the second target image; and determines the exposure time of the image acquisition device in acquiring the second target image as the target exposure time.
[0021] Here, when the similarity between the first image and the second image is greater than the similarity threshold, the image quality of the first image is acceptable to the user. Thereafter, the quality of the image received by the electronic device from the image acquisition device using the target exposure time meets the compensation requirement.
[0022] In another possible implementation manner of the first aspect, determining the first image, whose similarity to the second image is greater than a similarity threshold, as the second target image includes:
[0023] The electronic device determines the first image whose similarity with the second image is greater than the similarity threshold as the third image, where the third image is multiple frames; the electronic device determines the image with the shortest exposure time used when collecting multiple frames of the third image as the second target image.
[0024] It can be understood that when the electronic device determines that the first image with a similarity greater than a similarity threshold to the second image is multiple frames, the image with the shortest exposure time can be determined as the second target image. In this way, when the subsequent electronic device uses the exposure time corresponding to the second target image to capture an image, the shooting time of the image capture device is saved.
[0025] In another possible implementation manner of the first aspect, determining the first image whose similarity to the second image is greater than a similarity threshold as the second target image further includes:
[0026] The electronic device determines a first image whose similarity with the second image is greater than a similarity threshold as a third image, where the third image is a plurality of frames; the electronic device determines an image amplitude of the third image and an image amplitude of the second image in each frame, where the image amplitude is used to characterize the depth of the image brightness; after comparing the image amplitude of the third image in each frame with the image amplitude of the second image, the electronic device determines the third image having the smallest image amplitude difference with the second image as the second target image.
[0027] It can be understood that the image amplitude of the second target image acquired by the image acquisition device using the target exposure time is slightly different from or has no difference with the image amplitude of the second image acquired using the automatic exposure time. This achieves the goal of shortening the shooting time and improving the efficiency of the entire production line by reducing the exposure time of the image acquisition device without reducing the compensation accuracy of the display screen.
[0028] In another possible implementation manner of the first aspect, determining similarities between the plurality of frames of first images and the second image respectively includes:
[0029] For each frame of the first image, the electronic device determines the similarity between the first image and the second image according to the mutual correlation coefficient between the first image and the second image, where the mutual correlation coefficient is used to characterize the similarity between the first image and the second image.
[0030] It can be understood that the mutual correlation coefficient is a measurement standard for measuring the similarity between two images, and the electronic device can determine the similarity between the first image and the second image according to the mutual correlation coefficient.
[0031] In another possible implementation manner of the first aspect, before determining the similarity according to the mutual correlation coefficient between the first image and the second image, the compensation method may further include:
[0032] The electronic device converts both the first image and the second image into grayscale images to obtain a first grayscale image and a second grayscale image;
[0033] The electronic device determines a mean and a standard deviation of the first grayscale image and the second grayscale image;
[0034] For each pixel position, the electronic device subtracts the mean value of the first grayscale image from the pixel value corresponding to the pixel position of the first grayscale image to obtain a first pixel value; subtracts the mean value of the second grayscale image from the pixel value corresponding to the pixel position of the second grayscale image to obtain a second pixel value; and determines a product value of the first pixel value and the second pixel value;
[0035] The electronic device adds the product values corresponding to all pixel positions, obtains the sum of the product values, and then divides the sum of the product values by the total number of pixels to determine the correlation coefficient.
[0036] In another possible implementation manner of the first aspect, the compensation method may further include:
[0037] The electronic device sends a target exposure time corresponding to a first display brightness to an image acquisition device; the electronic device receives a second target image from the image acquisition device, where the second target image is an image obtained by the image acquisition device shooting a display screen of a second display device using the target exposure time; the electronic device uses at least two preset filtering parameters to perform enhancement processing on the second target image respectively to obtain at least two frames of second target images with adjusted brightness; the electronic device determines the image difference between each frame of the second target image with adjusted brightness and the second image; the electronic device determines the preset filtering parameters corresponding to the second target image with adjusted brightness having the smallest image difference as the target filtering parameters.
[0038] It can be understood that after the electronic device determines a more accurate target filtering parameter, it uses the target filtering parameter to enhance the target image so that the brightness of the processed target image meets the subsequent compensation requirements.
[0039] In another possible implementation manner of the first aspect, determining an image difference between the second target image after brightness adjustment of each frame and the second image includes:
[0040] The electronic device determines the image difference based on the sum of the difference between the second target image after brightness adjustment and all pixel values in the second image; or, the electronic device determines the image difference based on the sum of the square differences between the second target image after brightness adjustment and the pixel values of corresponding pixel points in the second image.
[0041] In another possible implementation manner of the first aspect, performing enhancement processing on the first target image by using the target filtering parameter corresponding to the first display brightness may include:
[0042] The electronic device controls the spatial filter to perform enhancement processing on the first target image using the target filtering parameters.
[0043] In a second aspect, the present application provides a compensation system for a display device, comprising:
[0044] A first display device, used for displaying a picture at a first display brightness;
[0045] An image acquisition device, used to capture a display screen of a first display device using a target exposure time to obtain a first target image; the target exposure time is less than an automatic exposure time of the image acquisition device;
[0046] The electronic device is used for compensating the display brightness of the first display device according to the compensation data of the first target image after determining the compensation data of the first target image.
[0047] In a third aspect, the present application provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the steps of the method described in the first aspect.
[0048] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program / instruction stored thereon, which, when executed by a processor, implements the steps of the method described in the first aspect.
[0049] In a fifth aspect, the present application provides a computer program product, comprising a computer program / instruction, which implements the steps of the method described in the first aspect when executed by a processor.
[0050] It can be understood that the compensation system described in the second aspect, the electronic device described in the third aspect, the computer storage medium described in the fourth aspect, and the computer program product described in the fifth aspect are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0051] Figure 1 An example of the display effect of a portion of the display screen provided in the embodiment of the present application Figure 1 ;
[0052] Figure 2 An example of the display effect of a portion of the display screen provided in the embodiment of the present application Figure 2 ;
[0053] Figure 3 An example of the display effect of a portion of the display screen provided in the embodiment of the present application Figure 3 ;
[0054] Figure 4 A schematic diagram of a compensation scenario provided in an embodiment of the present application;
[0055] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0056] Figure 6 A schematic diagram of a process for determining a target exposure time provided in an embodiment of the present application;
[0057] Figure 7 This is an example diagram of images captured by the image acquisition device provided in the embodiment of the present application using different exposure times;
[0058] Figure 8 An example diagram for determining a target exposure time provided in an embodiment of the present application;
[0059] Fig. 9 A flow chart of a compensation method provided in an embodiment of the present application;
[0060] Fig.10 An example diagram of the amplitude of an image acquired by the image acquisition device provided in an embodiment of the present application using different exposure times;
[0061] Fig.11 A schematic diagram of a flow chart of another compensation method provided in an embodiment of the present application;
[0062] Fig.12 A schematic diagram of a process for enhancing a target image provided in an embodiment of the present application;
[0063] Fig.13 A schematic diagram of a process for determining target filtering parameters provided in an embodiment of the present application. DETAILED DESCRIPTION
[0064] The technical solution in the embodiment of the present application will be described below in conjunction with the drawings in the embodiment of the present application. In the description of the embodiment of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0065] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.
[0066] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0067] As a current-type light-emitting device, OLED has been increasingly used in high-performance displays. OLED is a self-luminous material with advantages such as high contrast, ultra-thinness, and flexibility. Due to the limitations of equipment technology, in low-temperature polysilicon thin-film transistors (LTPS TFTs) made on large-area glass substrates, TFTs at different locations usually have non-uniformity in electrical parameters such as threshold voltage and mobility. This non-uniformity will be converted into current differences and brightness differences in the OLED screen and will be perceived by the human eye, namely the Mura phenomenon.
[0068] Screen brightness (Luminance) refers to the physical quantity of the intensity of light emitted from the surface of a luminous object, measured in nits. Screen brightness is an important indicator used to measure the screen luminous intensity of a display screen. Screen brightness is adjusted by display brightness (DBV), so there is a one-to-one correspondence between screen brightness and display brightness. For example, when the light is strong, the user can increase the DBV value to increase the screen brightness of the display screen to make it easier to see the content displayed on the display screen. When the light is weak, the user can decrease the DBV value to lower the screen brightness of the display screen to avoid the problem of excessive difference in screen brightness between ambient light and the display screen affecting the health of the user's eyes.
[0069] It should be explained that the voltage difference across the LEDs of the display screen determines the DBV value of the display screen, so adjusting the DBV value is actually achieved by adjusting the voltage difference across the LEDs of the display screen. Typically, the DBV dimming mode can include a direct current (DC) dimming mode and a pulse width modulation (PWM) dimming mode.
[0070] The DC dimming mode changes the DBV of the display screen by increasing or decreasing the circuit power. The greater the circuit power, the brighter the screen brightness of the corresponding display screen; the smaller the circuit power, the darker the screen brightness of the corresponding display screen. In the DC dimming mode, when the circuit power is low, the Mura of the display screen will be very serious, and even cause blurring. Therefore, the DC mode is usually suitable for high DBV ranges.
[0071] The PWM dimming mode achieves the effect of continuous display by controlling the display screen to flicker alternately at a certain frequency and utilizing the visual residual effect of the human eye. The faster the display screen flickers alternately, the greater the DBV, and the brighter the corresponding display screen brightness; the slower the display screen flickers alternately, the smaller the DBV, and the darker the corresponding display screen brightness. Low-frequency PWM dimming has a good display effect, so the PWM dimming mode is usually suitable for low DBV ranges.
[0072] In the above two different dimming modes, in the high DBV range and the low DBV range, the brightness of the image obtained by the camera on the display screen is different, and the image brightness is irregular under the same display brightness and the same grayscale. For example, in different DBV ranges, the Mura form of the same grayscale is different. Among them, grayscale refers to the level of tonal depth of the electromagnetic radiation intensity of the ground object on the black and white image. Usually, the screen brightness changes between the brightest and the darkest are divided into 0 to 255 levels to facilitate the control of the screen brightness of the signal input. The form of Mura here refers to the phenomenon of uneven screen brightness when the display screen is displayed.
[0073] For example, Figure 1 An example of the display effect of a portion of the display screen provided in the embodiment of the present application Figure 1 , Figure 1 When the electronic device uses the PWM dimming mode to control the display of the display screen, the electronic device controls the camera to shoot the display screen of the display screen to obtain an image of a partial area of the display screen. Figure 1 (a) is an image of a partial area of the display screen when the DBV is 266, the screen brightness is 0.06n it, and the corresponding grayscale is 32 levels. Figure 1 (b) is an image of a portion of the display screen when the DBV is 1291, the screen brightness is 0.93n it, and the corresponding grayscale is 32 levels. Figure 1 It can be seen that at different screen brightness and the same grayscale, the display effects of some areas of the display screen corresponding to different DBVs are inconsistent. Figure 1 Region A1 in (a) and Figure 1 The area A2 in (b) is a shooting area corresponding to the same area of the display screen, and the brightness of the area A1 is different from that of the area A2.
[0074] Figure 2 An example of the display effect of a portion of the display screen provided in the embodiment of the present application Figure 2 .like Figure 2 (a) is a display effect diagram of a partial area of the display screen when the DBV is 1, the screen brightness is 0.02n it, and the corresponding grayscale is 32 levels. Figure 2(b) is a display effect diagram of a part of the display screen when the DBV is 266, the screen brightness is 0.06n it, and the corresponding grayscale is 32 levels. Figure 2 It can be seen that under the same grayscale, when the DBV is different and the screen brightness is different, the display effect images of some areas of the corresponding display screen are inconsistent. For example, Figure 2 Region B1 in (a) and Figure 2 The area B2 in (b) is a shooting area corresponding to the same area of the display screen, and the brightness of the area B1 is different from that of the area B2.
[0075] Figure 3 An example of the display effect of a portion of the display screen provided in the embodiment of the present application Figure 3 . Figure 3 This is a diagram showing the display effect of a part of the display screen when the DC dimming mode is used to control the display of the display screen. Figure 3 (a) is a display effect diagram of a partial area of the display screen when the DBV is 3515, the screen brightness is 1.3578n it, and the corresponding grayscale is 16 levels. Figure 3 (b) is a display effect diagram of a part of the display screen when the DBV is 3515, the screen brightness is 0.2955n it, and the corresponding grayscale is 8. Figure 3 It can be seen that in the high DBV range, at the same DBV, the display effect diagrams of some areas of the display screen corresponding to different screen brightness are inconsistent. For example, Figure 3 The area C1 in (a) is Figure 3 The area C2 in (b) is a shooting area corresponding to the same area of the display screen, and the brightness of the area C1 is different from that of the area C2.
[0076] That is to say, in the high DBV range, the display effect of the display is predictable, while in the low DBV range, no matter at the same screen brightness or the same grayscale, the display effect of the display has no obvious regularity and is difficult to predict. Therefore, the Demura method of mapping compensation through the grayscale compensation curve is not suitable for the low DBV range. This Demura method has a poor compensation effect for the low DBV range and cannot eliminate the Mura of the display at low DBV.
[0077] It is understandable that the ideal state of a display screen is that the grayscale is consistent under a certain DBV. However, due to the presence of Mura, the grayscale is inconsistent. For example, the display screen displays a completely consistent pure color image in each area. When the screen brightness corresponding to the DBV is 500n it, the grayscale corresponding to each pixel should be 128 levels. However, the actual grayscale corresponding to some pixels in the Mura area may be 32 levels, 64 levels, etc., resulting in the problem of uneven screen brightness of the display screen.
[0078] The Demura method can compensate for Mura externally by sensing the electrical or optical characteristics of pixels through an external driving circuit or device, so that the grayscale of the Mura area is consistent with that of the standard area. External compensation includes electrical compensation and optical compensation. Among them, optical compensation is a commonly used compensation method.
[0079] For example, Figure 4 A schematic diagram of a compensation scenario provided in an embodiment of the present application. Figure 4 As shown, the camera 410 may be a complementary metal oxide semiconductor (CMOS) camera or a charge coupled device (CCD) camera, or may be other cameras, which are not limited in the embodiments of the present application. The display screen 430 may be a display screen to be compensated. The camera 410 is electrically connected to the electronic device 420, and the electronic device 420 is electrically connected to the display screen 430.
[0080] It needs to be explained that Figure 4 The electronic device 420 shown in the figure is a laptop computer and the display screen 430 is a mobile phone screen for only an example, and this is not limited in the embodiments of the present application. For example, the electronic device 420 can also be a desktop computer, a tablet computer, etc., and the display screen 430 can also be a laptop computer display screen, a tablet computer display screen, etc.
[0081] by Figure 4 Taking the optical compensation scenario in as an example, the optical compensation process of the Demura method may include: the electronic device 420 controls the display screen 430 to display a standard image signal so that the image to be tested under a certain DBV is displayed on the display screen 430. The image to be tested can be a grayscale image or an RGB color mode (Red Green Blue Color Mode) image. The electronic device 420 controls the camera 410 to collect image data of the image to be tested at several grayscales, and sends the image data to the electronic device 420. After receiving the image data, the electronic device 420 obtains the grayscale compensation data of the image data through the Demura compensation algorithm, and burns the compensation data into the memory of the display screen to eliminate the Mura of the display screen of the display screen 430. The electronic device 420 controls the camera 410 to re-collect the compensated image data to confirm that the Mura of the display screen has been successfully eliminated.
[0082] Since the camera 410 only collects the Mura pattern of the display screen under a single DBV when collecting images, the compensation for other brightness will be inaccurate. In addition, when the display screen 430 is at low brightness, the camera 410 collects image data of the display screen under low brightness, and the electronic device 420 controls the camera 410 to use the automatic exposure time to shoot the display screen of the display screen. There is a problem that the automatic exposure time of the camera 410 is too long, resulting in a problem that the shooting process takes a lot of time. For example, the automatic exposure time of the camera 410 is as long as several minutes. In the production process of the production line, assuming that the electronic device 420 controls the camera 410 to use the automatic exposure time to shoot the display screen of 500 display screens in sequence, it takes thousands of minutes, and there is a phenomenon of low production capacity of the production line. In order to reduce the image acquisition time, if the camera 410 uses a large aperture to collect images, it will not be able to focus accurately due to the small depth of field, resulting in low quality of the collected image, thereby affecting the subsequent Demura method The compensation effect of the low DBV interval cannot eliminate the Mura of the display screen.
[0083] To this end, an embodiment of the present application proposes a compensation method for a display screen, where, when a first display device displays a picture at a first display brightness, an electronic device sends a target exposure time corresponding to the first display brightness to an image acquisition device; the electronic device receives a first target image from the image acquisition device, and the electronic device determines corresponding compensation data based on the first target image; the electronic device sends the compensation data of the first target image to the first display device, triggering the first display device to adjust the display brightness.
[0084] The first target image is an image obtained by the image acquisition device capturing a display screen of the first display device in response to the target exposure time, and the exposure time for capturing the first target image is the target exposure time;
[0085] Therefore, when capturing images under low brightness, by shortening the exposure time when capturing images, the shooting time is reduced without affecting the image quality, thereby improving the production line efficiency.
[0086] Exemplarily, the display screen compensation method provided in the embodiments of the present application can be applied to electronic devices such as mobile phones, tablet computers, personal computers (PCs), personal digital assistants (PDAs), netbooks, handheld computing devices, industrial computing devices, etc., and the embodiments of the present application do not impose any limitations on this.
[0087] For example, Figure 5 As shown, Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0088] The electronic device 500 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193 and a display screen 194, etc.
[0089] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 500. In other embodiments of the present application, the electronic device 500 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0090] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0091] The controller may be the nerve center and command center of the electronic device 500. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0092] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0093] The wireless communication function of the electronic device 500 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0094] The electronic device 500 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0095] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 500. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0096] The internal memory 121 may be used to store computer executable program codes, where the executable program codes include instructions.
[0097] The electronic device 500 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0098] Combine the following Figures 6 to 13 The compensation method for the display device provided in the embodiment of the present application is introduced in detail. The following description is made by taking the display device as a display screen as an example. Of course, the display device may also be other display devices, which is not limited here.
[0099] In an embodiment of the present application, in the process of the manufacturer producing the display screen, in order to eliminate the Mura of the display screen, the electronic device can use the Demura method to eliminate the Mura of the display screen. In one scenario, when the electronic device determines that the display brightness of the display screen is low, before the production line is officially operated, the electronic device can calibrate the exposure time of the image acquisition device according to the target exposure time corresponding to the display brightness of the display screen, so as to shorten the shooting time and improve the production line efficiency by reducing the exposure time of the image acquisition device.
[0100] It can be understood that the exposure time of the image acquisition device refers to the time interval from the opening to the closing of the shutter in order to project light onto the photosensitive surface of the photographic photosensitive material. When the electronic device determines that the display brightness of the display screen is different, the electronic device controls the image acquisition device to use different exposure times to capture the display screen of the display screen.
[0101] When the electronic device determines that the display brightness of the display screen is low, in order to avoid the problem that the electronic device controls the image acquisition device to use a longer exposure time to capture the display screen of the display screen, resulting in a long shooting time. During the testing phase of the display screen, the electronic device can determine the target exposure time of the image acquisition device at the display brightness 1 based on the similarity between multiple frames of images captured by the image acquisition device at different exposure times when the display screen is at the same display brightness (for example, display brightness 1) and the images captured at the automatic exposure time. During the production process of the production line, when the electronic device determines that the display brightness of the produced display screen is display brightness 1, the electronic device first adjusts the exposure time of the image acquisition device to the target exposure time, and then controls the image acquisition device to capture the display screen of the display screen at the target exposure time, thereby achieving the purpose of reducing the image acquisition time.
[0102] The target exposure time refers to the exposure time used by the image acquisition device when actually acquiring image data of the display screen, and the target exposure time is less than the automatic exposure time of the image acquisition device.
[0103] It should be explained that when the display brightness of the display screen is different, the automatic exposure time of the image acquisition device to acquire the display screen of the display screen is also different. Therefore, when the display screen is at different display brightness, the electronic device can determine the target exposure time corresponding to the image acquisition device at different display brightnesses based on the similarity between the multiple frames of images acquired by the image acquisition device at different exposure times and the images acquired at the automatic exposure time corresponding to the display brightness.
[0104] In some embodiments, since the settings of the image acquisition device itself are crucial for the accurate acquisition of image data, before controlling the image acquisition device to capture the display screen of the display screen with the target exposure time, the image acquisition device may be debugged to avoid the problem that the image acquisition device itself affects the captured image quality. For example, the image acquisition device is calibrated regularly.
[0105] In an embodiment of the present application, since the target exposure time is less than the automatic exposure time, the image acquisition device uses the target exposure time to capture the display screen of the display screen, and the image amplitude of the obtained image 1 may be significantly different from the image amplitude of the image 2 acquired using the automatic exposure time. The electronic device directly uses the compensation data of image 1 to perform brightness compensation on the display screen, which may not completely eliminate the Mura of the display screen. In order to reduce the difference between the image amplitude of image 1 and the image amplitude of image 2, the electronic device can enhance image 1 so that the image amplitude of the enhanced image 1 is the same as the image amplitude of image 2. Thereafter, the electronic device obtains the grayscale compensation data of the enhanced image 1 through the Demura compensation algorithm, and burns the compensation data into the memory of the display screen to completely eliminate the Mura of the display screen.
[0106] The image amplitude is used to characterize the brightness of the image. For example, if the color of a certain area of the image is darker, the image amplitude of the area is larger; if the color of a certain area of the image is lighter, the image amplitude of the area is smaller. Taking the brightness value of the center point of the image as a reference, assuming that the brightness value of area A in the image is 0.7 times the brightness value of the center point of the image, and the brightness value of area B is 2 times the brightness value of the center point of the image, it means that the amplitude of area B is greater than the amplitude of area A.
[0107] The following example takes the display screen in the production stage of the production line as the first display screen and the display screen in the test stage as the second display screen. Figure 6 A detailed introduction is given to the process of the electronic device determining the target exposure time corresponding to the image acquisition device of the second display screen at the first display brightness during the test phase, wherein the first display screen and the second display screen can be the same type of display screens, and the display type is not limited in the embodiment of the present application.
[0108] like Figure 6 As shown, the method may include steps 601 to 606.
[0109] Step 601: an image acquisition device captures a display screen of a second display screen at different exposure times, acquires a plurality of frames of first images, and then sends the plurality of frames of first images to an electronic device; correspondingly, the electronic device receives the plurality of frames of first images sent by the image acquisition device.
[0110] In an embodiment of the present application, during the test phase, when the second display screen remains unchanged at the first display brightness, the electronic device can control the image acquisition device to capture the display screen of the second display screen with different exposure times to acquire multiple frames of first images corresponding to different exposure times.
[0111] For example, assuming that the display brightness of the second display screen is 20, the electronic device can control the image acquisition device to capture the display image of the second display screen using exposure time 1, exposure time 2 and exposure time 3 respectively, so as to acquire 3 frames of first images corresponding to different exposure times.
[0112] It is understandable that, when other shooting parameters of the image acquisition device remain unchanged, the longer the exposure time of the image acquisition device, the better the image quality of the acquired first image. Therefore, the image acquisition device acquires multiple frames of the first image at different exposure times to acquire images of different qualities.
[0113] Step 602: the image acquisition device captures the display screen of the second display screen under the automatic exposure time, obtains the second image, and then sends the second image to the electronic device; correspondingly, the electronic device receives the second image sent by the image acquisition device.
[0114] In the embodiment of the present application, the automatic exposure time of the image acquisition device is greater than the exposure time used by the image acquisition device when acquiring multiple frames of the first image. Therefore, compared with the second image acquired by the image acquisition device, there are differences between the multiple frames of the first image acquired by the image acquisition device. Subsequently, the electronic device can determine the second target image with a smaller image difference with the second image from the multiple frames of the first image based on the similarity between the multiple frames of the first image and the second image.
[0115] Step 603: The electronic device determines similarities between the plurality of frames of the first image and the second image.
[0116] In some embodiments, the electronic device may determine the similarity between the first image and the second image based on a mutual correlation coefficient between the first image and the second image, wherein the mutual correlation coefficient is used to characterize the similarity between the first image and the second image.
[0117] Optionally, the electronic device converts both the first image and the second image into grayscale images, and after obtaining the first grayscale image and the second grayscale image, respectively calculates the mean and standard deviation of the first grayscale image and the second grayscale image. Then, for each pixel position, the electronic device subtracts the mean of the first grayscale image and the second grayscale image from the pixel value at the position to obtain the first pixel value and the second pixel value. For each pixel position, the electronic device calculates the product value of the first pixel value and the second pixel value. The electronic device adds the product values corresponding to all pixel positions to obtain the numerator value of the cross-correlation coefficient, and then divides the numerator value by the total number of pixels to obtain the cross-correlation coefficient.
[0118] Exemplarily, the electronic device may use the following formula (1) to calculate the mutual correlation coefficient between the first image and the second image, so as to determine the similarity between the first image and the second image according to the mutual correlation value.
[0119]
[0120] Where r represents the correlation coefficient between the first image and the second image, is the pixel mean of the first grayscale image corresponding to the first image, is the pixel mean of the second grayscale image of the second image object, and m and n are both positive integers.
[0121] In other embodiments, the electronic device may input each first image in the plurality of first image frames into a trained image similarity detection model together with the second image, so as to determine the similarity between each first image frame and the second image according to the output of the image similarity detection model. The image similarity detection model is pre-trained with a large number of sample images and has the ability to accurately determine the similarity between two image frames.
[0122] In some other embodiments, the electronic device may calculate the cosine similarity between each first image in the multiple first image frames and the second image. Specifically, the electronic device may represent the multiple first image frames and the second image as vectors, and characterize the similarity between the first image and the second image by calculating the cosine distance between the vector of each first image frame and the vector of the second image.
[0123] It should be explained that the method for the above-mentioned electronic device to determine the similarity between multiple frames of first images and the second image is only an example, and other image similarity calculation methods are also applicable to this application, which will not be described in detail one by one in this application.
[0124] Step 604: The electronic device determines the first image, whose similarity to the second image is greater than a similarity threshold, as the second target image.
[0125] The similarity threshold refers to a preset minimum similarity value that the similarity between the first image and the second image satisfies. That is, when the similarity between the first image and the second image is greater than the similarity threshold, the image quality of the first image is acceptable to the user.
[0126] In the embodiment of the present application, after the electronic device determines the similarities between the multiple frames of first images and the second image respectively, the first image whose similarity with the second image is greater than the similarity threshold is determined as the second target image.
[0127] Exemplarily, assuming that the similarity threshold is 95%, after the electronic device determines the similarities between multiple frames of first images and the second image respectively, it determines the first image whose similarity with the second image is greater than 95% as the second target image.
[0128] Step 605: The electronic device determines the exposure time used by the image acquisition device when acquiring the second target image as the target exposure time.
[0129] It can be understood that when the electronic device determines that the first image among the multiple frames of images acquired by the image acquisition device using different exposure times, whose similarity with the second image is greater than the similarity threshold, is determined to be the third image. The number of frames of the third image determined by the electronic device can be one frame or multiple frames. The number of frames of the third image is not limited in the embodiment of the present application.
[0130] In one case, if the electronic device determines that the third image has only one frame, the electronic device determines the exposure time used by the image acquisition device when acquiring the frame of the third image as the target exposure time.
[0131] Exemplarily, it is assumed that the image acquisition device uses exposure time 1, exposure time 2, and exposure time 3 to capture the display screen of the display screen, and acquires first image 1, first image 2, and first image 3. After the electronic device calculates the similarity between the second image and the first image 1, first image 2, and first image 3, respectively, it is determined that the similarity between the first image 1 and the second image is greater than the similarity threshold, and the electronic device determines that the second target image is the first image 1. In this case, the electronic device determines the exposure time 1 used by the image acquisition device when acquiring the first image 1 as the target exposure time.
[0132] In another case, if the electronic device determines that the third image has at least two frames, the electronic device determines the shortest exposure time among the exposure times respectively used by the image acquisition device when acquiring at least two frames of the third image as the target exposure time. It can be seen that the target exposure time determined by the electronic device is the shortest, thereby saving the shooting time of the image acquisition device.
[0133] For example, it is assumed that the image acquisition device acquires multiple frames of first images using different exposure times, such as Figure 7For example, the image acquisition device uses exposure times of 1s, 3s, 5s, 7s, 10s, 20s and 30s to shoot the display screen of the second display screen, and acquires images a to g. The image acquisition device uses an automatic exposure time of 90s to shoot the display screen of the second display screen, and acquires image h. After the electronic device obtains images a to h acquired by the image acquisition device, it calculates the similarity between each frame of images in images a to g and image h. If the electronic device determines that the similarity between image b, image c and image d and image h is greater than the similarity threshold, the electronic device determines that the third image is image b, image c and image d. The electronic device determines that the exposure time distribution used by the image acquisition device when acquiring image b, image c and image d is 3s, 5s and 7s. The electronic device determines that the exposure time used by the image acquisition device when acquiring image b is the shortest, and the electronic device determines that the target exposure time is the exposure time used by the image acquisition device when acquiring image b, that is, the target exposure time is determined to be 3s.
[0134] It should be explained that the closer the exposure time used by the image acquisition device when acquiring an image is to the automatic exposure time, the greater the similarity between the acquired image and the image acquired using the automatic exposure time. For example, the electronic device determines that the exposure time of the image acquisition device to acquire image e is 10s, the electronic device determines that the exposure time of the image acquisition device to acquire image f is 20s, and the electronic device determines that the exposure time of the image acquisition device to acquire image g is 30s. The electronic device determines that the similarity between image e and image h is similarity e, the electronic device determines that the similarity between image f and image h is similarity f, and the electronic device determines that the similarity between image g and image h is similarity g. Similarity e is less than similarity f, and similarity f is less than similarity g. Figure 7 The images a to h captured by the image acquisition device at different exposure times shown in the figure are only used as an example. In the actual shooting process, the images actually captured by the image acquisition device shall prevail. Figure 7 The automatic exposure time of the image acquisition device shown in the figure is 90 seconds, which is only an example. In actual scenarios, the actual automatic exposure time of the image acquisition device shall prevail and is not limited here.
[0135] For example, Figure 8 As shown, after the electronic device calculates the similarity between the first image and the second image obtained by the image acquisition device using different exposure times, the similarity between each frame of the first image and the second image and the exposure time of the first image are determined, and then the similarity between the first image and the second image is obtained. Figure 8 An example diagram from . Figure 8It can be known that the electronic device determines that there are two frames of third images whose similarity is greater than the similarity threshold, and the electronic device can determine the shortest exposure time among the exposure times corresponding to the two frames of third images as the target exposure time.
[0136] In another case, when the electronic device determines that the third image has at least two frames, after determining the image amplitudes corresponding to the at least two frames of the third image and the second image respectively, the electronic device compares the image amplitude of each frame of the third image with the image amplitude of the second image, and determines the exposure time of the third image having the smallest image amplitude difference with the second image as the target exposure time.
[0137] Exemplarily, assuming that the electronic device determines that the third image has three frames, namely third image 1, third image 2 and third image 3, the electronic device determines the image amplitudes of the three frames of the third images and the image amplitude of the second image, compares the image amplitude of each frame of the third image with the image amplitude of the second image, determines that the difference between the image amplitude of the third image 1 and the image amplitude of the second image is the smallest, and the electronic device determines the exposure time used by the image acquisition device when acquiring the third image 1 as the target exposure time.
[0138] It can be understood that the electronic device determines the exposure time of the third image with the smallest image amplitude difference with the second image among the multiple frames of the third image as the target exposure time. It can be seen that the image amplitude of the target image acquired by the image acquisition device using the target exposure time is slightly different from or has no difference with the image amplitude of the second image acquired using the automatic exposure time, which achieves the premise of not reducing the compensation accuracy of the display screen, by reducing the exposure time of the image acquisition device, shortening the shooting time and improving the efficiency of the entire production line.
[0139] 606. The electronic device stores the corresponding relationship between the first display brightness and the target exposure time.
[0140] In the embodiment of the present application, after the electronic device determines that the display brightness of the second display screen is the target exposure time corresponding to the first display brightness, the electronic device can store the correspondence between the first display brightness and the target exposure time. During the production process of the production line, when the electronic device determines that the display brightness of the display screen to be compensated is the first display brightness, the electronic device can determine the target exposure time corresponding to the first display brightness according to the pre-stored correspondence between the first display brightness and the target exposure time, and control the image acquisition device to shoot the display screen of the display screen using the target exposure time.
[0141] It should be explained that the determination of the target exposure time in the above steps 601 to 606 is based on the example of the target exposure time corresponding to the image acquisition device when the electronic device determines that the display brightness of the second display screen is the first display brightness. When the display brightness of the second display screen is at other display brightnesses, for example, when the display brightness of the second display screen is the second display brightness, the electronic device can also use the above steps 601 to 606 to determine the target exposure time, and store the corresponding relationship between the second display brightness and the target exposure time, which will not be described in detail here.
[0142] During the production process of the production line, when the electronic device determines that the display brightness of the display screen to be compensated is the first display brightness, the electronic device can determine the target exposure time corresponding to the first display brightness according to the pre-stored correspondence between the first display brightness and the target exposure time. Then, the electronic device can use the image captured at the target exposure time to compensate for the display brightness of the display screen. Fig. 9 A flow chart of a compensation method for a display screen provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the method may include the following steps 901 to 907.
[0143] Step 901: When a first display screen displays an image at a first display brightness, the electronic device determines a target exposure time corresponding to the first display brightness.
[0144] The target exposure time is less than the automatic exposure time of the image acquisition device.
[0145] It can be understood that the target exposure times corresponding to different display brightnesses are pre-stored in the electronic device. For example, display brightness 1 corresponds to target exposure time 1, display brightness 2 corresponds to target exposure time 2, and so on. When the electronic device determines that the display brightness of the first display screen is the first display brightness, the electronic device determines the target exposure time corresponding to the first display brightness according to the pre-stored correspondence between the display brightness and the target exposure time, and then sends the target exposure time corresponding to the first display brightness to the image acquisition device.
[0146] Step 902: The electronic device sends a target exposure time corresponding to a first display brightness to an image acquisition device; correspondingly, the image acquisition device receives the target exposure time corresponding to the first display brightness.
[0147] Step 903: The image acquisition device uses the target exposure time to shoot the display screen of the first display screen to obtain a first target image.
[0148] Step 904, the image acquisition device sends a first target image to the electronic device;
[0149] Step 905: After receiving the first target image, the electronic device determines compensation data of the first target image.
[0150] Step 906: The electronic device sends the compensation data of the first target image to the first display screen.
[0151] Step 907: The first display screen stores the compensation data of the first target image to compensate for the display brightness of the first display screen.
[0152] In the embodiment of the present application, after the electronic device receives the first target image sent by the image acquisition device, it determines the compensation data of the first target image through the Demura compensation algorithm, and then burns the compensation data of the first target image into the memory of the first display screen, so as to eliminate the Mura of the display screen when the first display screen is displayed. Thus, by reducing the exposure time of the image acquisition device, the shooting time of the image acquisition device is shortened, and the efficiency of the entire production line is improved.
[0153] In one possible case in an embodiment of the present application, if the electronic device determines that the image amplitude of the first target image is consistent with the image amplitude acquired using the automatic exposure time, the electronic device does not need to perform enhancement processing on the first target image, and can use the compensation data of the first target image to perform compensation processing on the first display screen.
[0154] like Fig.10 As shown, assuming Fig.10 The image h in the figure is the image acquired by the image acquisition device using the automatic exposure time, and the image f is the first target image. Fig.10 As can be seen, the brightness difference between the area D3 in the image f and the area D1 in the image h is not large. The electronic device determines that the image amplitudes of the image f and the image h are substantially the same, and the electronic device does not need to perform enhancement processing on the image f.
[0155] In another possible situation in the embodiment of the present application, since the target exposure time is less than the automatic exposure time, there may be a situation where the image acquisition device uses the target exposure time to capture the display screen of the first display screen, and the image amplitude of the first target image obtained is significantly different from the image amplitude of the second image obtained by using the automatic exposure time. In this case, the electronic device can enhance the first target image. Thereafter, the electronic device obtains the compensation data of the enhanced target image through the Demura compensation algorithm, and burns the compensation data into the flash memory to eliminate the Mura of the display screen, further improving the compensation accuracy of the display screen, and thereby improving the brightness uniformity of the display screen.
[0156] Continue with Fig.10 For example, suppose the electronic device determines Fig.10 Image b is the first target image. Fig.10 It can be seen that the image amplitudes of the electronic image b and the image h are greatly different, for example, the brightness difference between the area D2 in the image b and the area D1 in the image h is large. The electronic device can enhance the image b so that the image amplitude of the enhanced image b is consistent with the image amplitude of the image h.
[0157] That is to say, Fig.11 As shown in the above Fig. 9 After step 905, the electronic device determines that the difference between the image amplitudes of the first target image and the second image is greater than the amplitude threshold, and the electronic device can enhance the first target image to compensate the first display screen with the enhanced first target image. The specific process is as follows: step 1101 to step 1105.
[0158] Step 1101 : The electronic device determines whether a difference between an image amplitude of a first target image and an image amplitude of a second image is greater than an amplitude threshold.
[0159] In one case, when the electronic device determines that the difference between the image amplitudes of the first target image and the second image is less than the amplitude threshold, the electronic device determines that the brightness of the first target image is not much different from that of the second image, and the image quality of the first target image is not much different from that of the second image. In this case, the electronic device does not need to perform enhancement processing on the first target image.
[0160] In another case, when the electronic device determines that the difference between the image amplitudes of the first target image and the second image is greater than the amplitude threshold, the electronic device determines that the brightness of the first target image is greatly different from that of the second image, and the image quality of the first target image is also greatly different from that of the second image. In this case, the electronic device can enhance the first target image so that the brightness of the enhanced first target image remains consistent with that of the second image.
[0161] Step 1102: Perform enhancement processing on the first target image to obtain the first target image after brightness adjustment.
[0162] In an embodiment of the present application, target filtering parameters corresponding to different display brightnesses of a display screen are pre-stored in the electronic device. The electronic device determines the target filtering parameters corresponding to the first display brightness according to the first display brightness of the first display screen. The electronic device performs enhancement processing on the first target image according to the target filtering parameters to obtain the first target image after brightness adjustment.
[0163] In the embodiment of the present application, the target filtering parameter may be a filtering parameter corresponding to a filtering magnification, for example, the target filtering parameter may be a filtering parameter corresponding to a filtering magnification of 2.5 times, 2.8 times, 3 times, etc.
[0164] In some embodiments, Fig.12 As shown, the electronic device can use the Fourier transform method to transform the first target image from the spatial domain to the frequency domain, perform enhancement processing in the frequency domain, and then use the inverse Fourier transform to transform the first target image after the enhancement processing in the frequency domain from the frequency domain to the spatial domain to obtain the first target image after brightness adjustment.
[0165] For example, the electronic device may use filters such as spatial filters or homomorphic filters to enhance the first target image. The type of filter is not limited in the embodiments of the present application.
[0166] It should be explained that the above-mentioned electronic device uses a filter to enhance the target image. This is only an example. The electronic device can also use other image enhancement methods to enhance the target image, such as grayscale transformation method, histogram adjustment method, etc. The image enhancement method is not limited in the embodiments of the present application.
[0167] Here, the process of the electronic device determining the target filtering parameters corresponding to different display brightness of the display screen will be described in detail in subsequent embodiments and will not be described in detail here.
[0168] Step 1103: The electronic device determines compensation data of the first target image after brightness adjustment.
[0169] Step 1104 , the electronic device sends compensation data of the first target image after brightness adjustment to the first display screen.
[0170] Step 1105 : The first display screen stores compensation data of the first target image after brightness adjustment to compensate for display brightness of the first display screen.
[0171] After determining the compensation data of the first target image after brightness adjustment, the electronic device sends the first target image after brightness adjustment to the first display screen for storage, so as to compensate the display brightness of the first display screen according to the compensation data of the first target image after brightness adjustment.
[0172] In the embodiment of the present application, the target filtering parameters corresponding to different display brightnesses of the display screen are pre-stored in the electronic device. The following is an example of a process in which the electronic device determines the target filtering parameters corresponding to the display brightness of the second display screen as the first display brightness during the test phase, and stores the target filtering parameters. Fig.13 For detailed information. Fig.13 As shown, the process may include the following steps 1301 to 1304.
[0173] Step 1301: The electronic device uses at least two preset filtering parameters to perform enhancement processing on the second target image respectively, to obtain at least two frames of the second target image after brightness adjustment.
[0174] The second target image is an image corresponding to the target exposure time determined by the electronic device when the display brightness of the second display screen is the first display brightness during the above test phase. When the electronic device determines that the image amplitude difference between the second target image and the second image acquired using the automatic exposure time is large, the electronic device can determine the target filtering parameters used when enhancing the second target image.
[0175] The preset filtering parameters may be filtering parameters pre-set according to the filtering magnification. For example, assuming the filtering magnification is 3, the filtering parameters corresponding to the filtering magnifications of 2.5 times, 2.8 times, and 3 times may be pre-set.
[0176] In some embodiments, the electronic device may use a Fourier transform method to transform the second target image from the spatial domain to the frequency domain, perform enhancement processing in the frequency domain, and then use an inverse Fourier transform to transform the second target image after the enhancement processing in the frequency domain from the frequency domain to the spatial domain to obtain a second target image with brightness adjusted.
[0177] In the embodiment of the present application, the electronic device can use different preset filtering parameters to enhance the second target image respectively to obtain the corresponding second target image after brightness adjustment. The electronic device can use filters such as spatial filters or homomorphic filters to enhance the second target image, and the type of filter is not limited in the embodiment of the present application.
[0178] Step 1302 : The electronic device determines the image difference between the second target image after brightness adjustment of each frame and the second image.
[0179] In some embodiments, the electronic device may determine the image difference between the second target image after brightness adjustment and the second image based on the sum of the difference values of all pixel values in the second target image after brightness adjustment and the second image.
[0180] In other embodiments, the electronic device may also determine the image difference between the brightness-adjusted second target image and the second image based on the sum of square differences of pixel values of corresponding pixels in the brightness-adjusted second target image and the second image.
[0181] Exemplarily, the electronic device may use the following formula (2) to determine the image difference between the second target image after brightness adjustment and the second image.
[0182]
[0183] Among them, the size of S is used to characterize the image difference between the second target image after brightness adjustment and the second image, A(x, y) is the pixel value of the second target image after brightness adjustment, B(x, y) is the pixel value of the second image, and M and N are positive integers.
[0184] Step 1303: The electronic device determines the preset filtering parameters corresponding to the second target image after brightness adjustment with the smallest image difference as the target filtering parameters.
[0185] In an embodiment of the present application, after the electronic device determines the image difference between the second target image after each frame enhancement processing and the second image, the electronic device determines the preset filtering parameters corresponding to the second target image after brightness adjustment with the smallest image difference as the target filtering parameters.
[0186] Exemplarily, the electronic device uses three preset filtering parameters to enhance the second target image respectively, and obtains three frames of second target images after brightness adjustment. For example, the electronic device uses preset filtering parameter 1 to enhance the second target image to obtain target image 1, uses preset filtering parameter 2 to enhance the second target image to obtain target image 2, and uses preset filtering parameter 3 to enhance the second target image to obtain target image 3. The electronic device determines the image difference between the three frames of second target images after brightness adjustment and the second image respectively, and obtains image difference 1, image difference 2, and image difference 3. The electronic device determines that the value corresponding to image difference 1 is the smallest, and the electronic device can determine preset filtering parameter 1 as the target filtering parameter.
[0187] It should be explained that the above-mentioned electronic device uses a filter to enhance the second target image. This is only an example. The electronic device can also use other image enhancement methods to enhance the target image, such as grayscale transformation method, histogram adjustment method, etc. The image enhancement method is not limited in the embodiments of the present application.
[0188] Step 1304: The electronic device stores the correspondence between the first display brightness and the target filtering parameter.
[0189] When the electronic device determines that the display brightness of the second display screen is different, the automatic exposure time when the image acquisition device acquires the second image is also different, and the target exposure time finally determined is also different. Therefore, when the display brightness of the second display screen is different, after the electronic device acquires the corresponding second target image acquired by the image acquisition device using different target exposure times, the filtering parameters used by the electronic device when performing enhancement processing on the target second image acquired at different display brightnesses are also different.
[0190] After the electronic device determines the target filtering parameters corresponding to the second display screen at different display brightnesses, the electronic device stores the corresponding relationship between the display brightness and the target filtering parameters. In the subsequent production process of the production line, after the electronic device determines the display brightness of the display screen to be compensated, it can search for the corresponding target filtering parameters according to the display brightness, and use the searched target filtering parameters to enhance the image captured at the display brightness.
[0191] Exemplarily, when the electronic device determines that the display brightness of the second display screen is display brightness 1, display brightness 2, and display brightness 3, the corresponding target filtering parameters are filtering parameter 1, filtering parameter 2, and filtering parameter 3. In the subsequent production process of the production line, assuming that the electronic device determines that the display brightness of the display screen is display brightness 2, the electronic device uses filtering parameter 2 to enhance the target image captured at display brightness 2.
[0192] In an embodiment of the present application, after the electronic device determines the correspondence between the display brightness-target exposure time-target filtering parameters of the second display screen, the electronic device stores the correspondence between the display brightness-target exposure time-target filtering parameters. In the subsequent actual production line production process, after the electronic device determines the display brightness of the display screen to be compensated, it can determine the corresponding target exposure time according to the display brightness of the display screen, and then the electronic device controls the image acquisition device to acquire the target image using the target exposure time. The electronic device enhances the target image according to the target filtering parameters corresponding to the display brightness of the display screen to obtain the target image after brightness adjustment. After the electronic device obtains the compensation data of the target image after brightness adjustment, it compensates the display brightness of the display screen according to the compensation data of the target image after brightness adjustment.
[0193] It is understandable that, in order to realize the above functions, the above-mentioned electronic devices, etc. include hardware structures and / or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present invention.
[0194] The embodiment of the present application can divide the functional modules of the above-mentioned electronic device etc. according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present invention is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0195] In the case of dividing each functional module according to each function, a possible composition diagram of the electronic device involved in the above embodiment, the electronic device may include: a display unit, a transmission unit and a processing unit, etc. It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here.
[0196] The embodiment of the present application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the above-mentioned related method steps to implement the compensation method of the display screen in the above-mentioned embodiment.
[0197] An embodiment of the present application further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the display screen compensation method in the above-mentioned embodiment.
[0198] An embodiment of the present application further provides a computer program product, which includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the display screen compensation method in the above-mentioned embodiment.
[0199] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the device executes the display screen compensation method executed by the electronic device in the above-mentioned method embodiments.
[0200] Among them, the electronic device, computer-readable storage medium, computer program product or device provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0201] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.
[0202] Each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.
[0203] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.
[0204] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. A compensation method for a display device, characterized in that: The method comprises: When the first display device displays an image at a first display brightness, the electronic device sends a target exposure time corresponding to the first display brightness to the image acquisition device; the target exposure time is less than the automatic exposure time of the image acquisition device; The electronic device receives a first target image from the image acquisition device, where the first target image is an image obtained by the image acquisition device capturing a display screen of the first display device in response to the target exposure time, and the exposure time for capturing the first target image is the target exposure time; The electronic device determines corresponding compensation data according to the first target image; The electronic device sends the compensation data of the first target image to the first display device, triggering the first display device to adjust the display brightness.
2. The method according to claim 1, characterized in that The electronic device sends the compensation data of the first target image to the first display device, including: The electronic device performs enhancement processing on the first target image to obtain the first target image after brightness adjustment; After determining the compensation data of the first target image after the brightness adjustment, the electronic device sends the compensation data of the first target image after the brightness adjustment to the first display device.
3. The method according to claim 2, characterized in that The electronic device performs enhancement processing on the first target image to obtain the first target image after brightness adjustment, including: The electronic device uses the target filtering parameter corresponding to the first display brightness to perform enhancement processing on the first target image to obtain the first target image with adjusted brightness.
4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: The electronic device receives a plurality of frames of first images from the image acquisition device, the plurality of frames of first images being images obtained by the image acquisition device using different exposure times to capture a display screen of a second display device, the brightness of the second display device being the first display brightness, and the second display device and the first display device having the same screen type; The electronic device receives a second image from the image acquisition device, where the second image is an image obtained by the image acquisition device photographing a display screen of the second display device using the automatic exposure time; The electronic device determines the similarities between the plurality of frames of first images and the second image respectively; The electronic device determines the target exposure time according to the similarities between the multiple frames of first images and the second image respectively.
5. The method according to claim 4, characterized in that The electronic device determines the target exposure time according to the similarities between the plurality of frames of first image and the second image respectively, including: The electronic device determines, as the second target image, a first image whose similarity to the second image is greater than a similarity threshold; The electronic device determines the exposure time of the image acquisition device for acquiring the second target image as the target exposure time.
6. The method according to claim 5, characterized in that The step of determining the first image, whose similarity to the second image is greater than a similarity threshold, as the second target image comprises: The electronic device determines, as a third image, a first image whose similarity to the second image is greater than a similarity threshold, wherein the third image is a plurality of frames; The electronic device determines the image with the shortest exposure time when acquiring multiple frames of third images as the second target image.
7. The method according to claim 5, characterized in that The step of determining the first image whose similarity with the second image is greater than a similarity threshold as the second target image further includes: The electronic device determines a first image whose similarity to the second image is greater than a similarity threshold as a third image, wherein the third image is a plurality of frames; The electronic device determines the image amplitude of the third image and the image amplitude of the second image in each frame, wherein the image amplitude is used to represent the depth of the image brightness; After comparing the image amplitude of each frame of the third image with the image amplitude of the second image, the electronic device determines the third image having the smallest image amplitude difference with the second image as the second target image.
8. The method according to any one of claims 4 to 7, characterized in that: The determining the similarities between the plurality of frames of first image and the second image respectively comprises: For each frame of the first image, the electronic device determines the similarity between the first image and the second image according to a mutual correlation coefficient between the first image and the second image, where the mutual correlation coefficient is used to characterize the similarity between the first image and the second image.
9. The method according to claim 8, characterized in that Before determining the similarity according to the mutual correlation coefficient between the first image and the second image, the method further includes: The electronic device converts both the first image and the second image into grayscale images to obtain a first grayscale image and a second grayscale image; The electronic device determines a mean and a standard deviation of the first grayscale image and the second grayscale image; For each pixel position, the electronic device subtracts the mean value of the first grayscale image from the pixel value corresponding to the pixel position of the first grayscale image to obtain a first pixel value; subtracts the mean value of the second grayscale image from the pixel value corresponding to the pixel position of the second grayscale image to obtain a second pixel value; and determines a product value of the first pixel value and the second pixel value; The electronic device adds the product values corresponding to all pixel positions to obtain the sum of the product values, and then divides the sum of the product values by the total number of pixels to determine the mutual correlation coefficient.
10. The method according to any one of claims 4 to 9, characterized in that: The method further comprises: The electronic device sends a target exposure time corresponding to the first display brightness to the image acquisition device; The electronic device receives a second target image from the image acquisition device, where the second target image is an image obtained by the image acquisition device photographing a display screen of the second display device using the target exposure time; The electronic device uses at least two preset filtering parameters to perform enhancement processing on the second target image respectively, so as to obtain at least two frames of the second target image after brightness adjustment; The electronic device determines an image difference between the second target image after brightness adjustment of each frame and the second image; The electronic device determines the preset filtering parameters corresponding to the second target image after brightness adjustment with the smallest image difference as the target filtering parameters.
11. The method according to claim 10, characterized in that The determining of the image difference between the second target image after brightness adjustment of each frame and the second image comprises: The electronic device determines the image difference according to the sum of the difference between the second target image after brightness adjustment and all pixel values in the second image; or, The electronic device determines the image difference according to the sum of square differences of pixel values of corresponding pixel points in the second target image after brightness adjustment and the second image.
12. The method according to any one of claims 3 to 11, characterized in that: The step of performing enhancement processing on the first target image by using the target filtering parameter corresponding to the first display brightness includes: The electronic device controls the spatial filter to perform enhancement processing on the first target image using the target filtering parameters.
13. A compensation system for a display device, characterized in that: include: A first display device, used for displaying a picture at a first display brightness; An image acquisition device, used for capturing a display screen of the first display device using a target exposure time to obtain a first target image; The target exposure time is less than the automatic exposure time of the image acquisition device; The electronic device is used to compensate the display brightness of the first display device according to the compensation data of the first target image after determining the compensation data of the first target image.
14. An electronic device comprising a memory, a processor and a computer program stored in the memory, characterized in that: The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 12.
15. A computer-readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.
16. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 12 are implemented.
Citation Information
Patent Citations
LCD (Liquid Crystal Display) full-grayscale data acquisition method on basis of CCD (Charge Coupled Device) camera
CN103747243A
Intelligent external optical compensation method for brightness unevenness of AMOLED screen
CN108492776A
Exposure control method, apparatus, electronic device, and computer readable storage medium
CN109005369A
Compensation method and device of display panel and display panel
CN111028779A
Method and system for carrying out external optical compensation on camera screen under AMOLED screen
CN111489694A
Cited By
Display compensation method, device and equipment and readable storage medium
CN120220589A
Display compensation method, apparatus, device, and readable storage medium
CN120220589B
Display control method and display equipment
CN121148307A