Brightness compensation method, device, equipment and storage medium

Abstract

The present application discloses a brightness compensation method, apparatus, device and storage medium, relating to the field of display technology, wherein the method is applied to an electronic device, the electronic device comprising a display screen, a waveguide plate and an image sensor, the waveguide plate being arranged between the display screen and the image sensor, and the image sensor being arranged close to the human eye, comprising: controlling the display screen to drive each pixel in the display screen according to a maximum set current value when displaying a first image; acquiring a second image captured by the image sensor, the second image being an image of the first image reaching the human eye through the waveguide plate; determining actual brightness values ​​of different image areas in the second image based on the second image; and for any image area, determining a current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area based on the maximum set current value, the target set current value and the actual brightness value of the image area.

Description

Technical Field

[0001] The present application relates to the field of display technology, and more specifically, to a brightness compensation method, device, equipment and storage medium. Background Art

[0002] With the development of economy and technology, AR (Augmented Reality) devices, such as AR glasses and AR helmets, have been increasingly widely used.

[0003] Displays are a crucial component of AR devices. Due to imperfect crystallization processes, even when the same drive current is supplied to each pixel on the display, the actual drive current varies. This difference in current between pixels translates into brightness differences, resulting in uneven brightness across the pixels. This results in uneven brightness across the display, which degrades the user's viewing experience.

[0004] Therefore, there is an urgent need to provide a method for making the brightness of images displayed on a display screen uniform. Summary of the Invention

[0005] One purpose of this application is to provide a new technical solution for brightness compensation.

[0006] According to a first aspect of the present application, a brightness compensation method is provided, which is applied to an electronic device. The electronic device includes a display screen, a waveguide plate, and an image sensor, wherein the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged close to a human eye. The method includes:

[0007] Controlling the display screen to drive each pixel in the display screen according to a maximum set current value when displaying the first image;

[0008] Acquire a second image captured by the image sensor, where the second image is an image of the first image reaching a human eye through the waveguide;

[0009] determining actual brightness values ​​of different image areas in the second image according to the second image;

[0010] For any image area, a current compensation value is determined based on the maximum set current value, the target set current value and the actual brightness value of the image area to adjust the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area.

[0011] Optionally, determining actual brightness values ​​of different image areas in the second image according to the second image includes:

[0012] According to a set number of regions, dividing the second image into a number of image regions of the set region;

[0013] For any image area, determining the brightness value of each pixel in the image area according to the second image;

[0014] The average value of the brightness values ​​of the pixels in the image area is calculated, and the average value is determined as the actual brightness value of the image area.

[0015] Optionally, the method further includes:

[0016] For any image area, determining an actual current value of the image area according to the target set current value and the current compensation value of the image area;

[0017] The driving current value corresponding to the target set current value in the memory and matching the image area is updated to the actual current value, and the memory stores a set of preset mapping data corresponding to at least one set current value, and the preset mapping data is used to reflect the driving current values ​​corresponding to different image areas under the set current value.

[0018] Optionally, after determining the actual current value of the image area according to the target set current value and the current compensation value of the image area, the method further includes:

[0019] Controlling the display screen to drive corresponding pixels in the display screen according to the actual current value of each image area when the display screen redisplays the first image;

[0020] Acquire a third image captured by the image sensor, where the third image is a redisplayed image of the first image passing through the waveguide plate and reaching the human eye;

[0021] detecting whether there is a bright spot in the third image;

[0022] When the bright spot exists in the third image, determining an image region where the bright spot is located;

[0023] Extracting bright spot areas and non-bright spot areas from the image area where the bright spot is located;

[0024] The current compensation value of the bright spot area is updated to the difference between the current compensation value of the image area where the bright spot is located and the preset current adjustment amount, and the current compensation value of the non-bright spot area is kept unchanged.

[0025] Optionally, after acquiring the third image captured by the image sensor, the method further includes:

[0026] detecting whether there is a dark spot in the third image;

[0027] In a case where the dark spot exists in the third image, determining an image region where the dark spot is located;

[0028] Extracting dark spot areas and non-dark spot areas from the image area where the dark spots are located;

[0029] The current compensation value of the dark spot area is updated to the difference between the current compensation value of the area where the dark spot is located and the preset current adjustment amount, and the current compensation value of the non-dark spot area is kept unchanged.

[0030] According to a second aspect of the present application, a brightness compensation device is provided for use in an electronic device, the electronic device comprising a display screen, a waveguide plate, and an image sensor, the waveguide plate being disposed between the display screen and the image sensor, the image sensor being disposed close to a human eye, the device comprising:

[0031] a first control module, configured to control the display screen to drive each pixel in the display screen according to a maximum set current value when displaying a first image;

[0032] a first acquisition module, configured to acquire a second image captured by the image sensor, where the second image is an image of the first image reaching a human eye through the waveguide;

[0033] a first determining module, configured to determine actual brightness values ​​of different image areas in the second image based on the second image;

[0034] The second determination module is used to determine, for any image area, based on the maximum set current value, the target set current value and the actual brightness value of the image area, a current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area.

[0035] Optionally, the device further comprises:

[0036] a third determining module, configured to determine, for any image region, an actual current value of the image region according to the target set current value and the current compensation value of the image region;

[0037] A first update module is used to update the driving current value corresponding to the target set current value in the memory and matching the image area to the actual current value, wherein the memory stores a set of preset mapping data corresponding to at least one set current value, and the preset mapping data is used to reflect the driving current values ​​corresponding to different image areas under the set current value.

[0038] Optionally, the device further comprises:

[0039] The second control module is further configured to control the display screen to drive corresponding pixels in the display screen according to the actual current value of each image area when the display screen redisplays the first image;

[0040] a second acquisition module, configured to acquire a third image captured by the image sensor, wherein the third image is an image obtained by re-displaying the first image through the waveguide sheet and reaching the human eye;

[0041] a detection module, configured to detect whether there is a bright spot in the third image;

[0042] a fourth determining module, configured to, when the bright spot exists in the third image, determine an image region where the bright spot is located;

[0043] An extraction module, configured to extract a bright spot area and a non-bright spot area from the image area where the bright spot is located;

[0044] The second updating module is configured to update the current compensation value of the bright spot area to the difference between the current compensation value of the image area where the bright spot is located and a preset current adjustment amount, and to keep the current compensation value of the non-bright spot area unchanged.

[0045] According to a third aspect of the present application, an electronic device is provided, comprising a display screen, a waveguide, an image sensor, and the device according to any one of the second aspects;

[0046] Alternatively, it includes a display screen, a waveguide, an image sensor, a memory, and a processor, wherein the memory is used to store computer instructions, and the processor is used to call the computer instructions from the memory to execute any one of the methods described in the first aspect.

[0047] According to a fourth aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method according to any one of the first aspects is implemented.

[0048] The embodiment of the present application provides a brightness compensation method, which is applied to an electronic device, wherein the electronic device includes a display screen, a waveguide plate, and an image sensor, wherein the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged on the side close to the human eye, comprising: controlling the display screen to drive each pixel in the display screen according to a maximum set current value when displaying a first image; obtaining a second image captured by the image sensor, wherein the second image is an image of the first image passing through the waveguide plate and reaching the human eye; determining the actual brightness values ​​of different image areas in the second image based on the second image; for any image area, determining a current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area based on the maximum set current value, the target set current value, and the actual brightness value of the image area. The brightness compensation method provided in the embodiment of the present application takes into account two factors: the crystallization process of the display screen and the changes in the light of the display screen after passing through the waveguide plate. This ensures that when the image is displayed based on the current compensation value obtained by the brightness compensation method provided in the embodiment of the present application, the image brightness viewed by the human eye is uniform. In other words, the embodiment of the present application provides a method for making the brightness of the image displayed on the display screen uniform.

[0049] Other features and advantages of the present application will become apparent from the following detailed description of exemplary embodiments of the present application with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the application and, together with the description, serve to explain the principles of the application.

[0051] Figure 1 This is a block diagram of the hardware configuration of an electronic device that implements a brightness compensation method provided in an embodiment of the present application;

[0052] Figure 2 This is a flowchart of a brightness compensation method provided in an embodiment of the present application.

[0053] Figure 3 This is a schematic diagram of image region division of a second image provided by an embodiment of the present application;

[0054] Figure 4 is a schematic diagram of actual brightness values ​​of different image regions of a second image provided by an embodiment of the present application;

[0055] Figure 5 is a schematic diagram of current compensation values ​​for different image areas provided by an embodiment of the present application;

[0056] Figure 6 is a schematic diagram of another current compensation value for different image areas provided by an embodiment of the present application;

[0057] Figure 7 1 is a schematic structural diagram of a brightness compensation device provided in an embodiment of the present application;

[0058] Figure 8 This is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that unless otherwise specifically stated, the relative arrangements of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present application.

[0060] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0061] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0062] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0063] It should be noted that like reference numerals and letters refer to like items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0064] Figure 1 It is a block diagram of the hardware configuration of an electronic device that implements a brightness compensation method provided in an embodiment of the present application.

[0065] like Figure 1 As shown, the electronic device 1000 may be an AR device or an AR helmet, etc.

[0066] Electronic device 1000 may include, among other things, a processor 1100, a memory 1200, an interface device 1300, a communication device 1400, a display device 1500, an input device 1600, a speaker 1700, a microphone 1800, and an image sensor 1900. Processor 1100 may be a central processing unit (CPU), a microprocessor (MCU), or the like. Memory 1200 may include, for example, ROM (read-only memory), RAM (random access memory), or a non-volatile memory such as a hard disk. Interface device 1300 may include, for example, a USB port or a headphone jack. Communication device 1400 may be capable of wired or wireless communication. Display device 1500 may be, for example, an LCD display or a touchscreen display. Input device 1600 may include, for example, a touchscreen or a keyboard. A user may input and output voice information via speaker 1700 and microphone 1800. Display device 1500 may specifically include a display screen and a waveguide.

[0067] In one example, the display screen may be MicroLED.

[0068] Despite Figure 1 Multiple devices are shown for the electronic device 1000, but the embodiments of the present application may only involve some of the devices, for example, the electronic device 1000 only involves the memory 1200 and the processor 1100.

[0069] In the embodiment of the present application, the memory 1200 of the electronic device 1000 is used to store instructions, which are used to control the processor 1100 to execute the brightness compensation method provided in the embodiment of the present application.

[0070] In the above description, a person skilled in the art can design instructions according to the scheme disclosed in the embodiment. How instructions control the operation of a processor is well known in the art and will not be described in detail here.

[0071] Currently, due to the imperfect crystallization process of display screens and the changes in light passing through the waveguide, even when the same drive current is supplied to each pixel on the display, the actual drive current varies. This difference in current between pixels translates into differences in brightness, resulting in uneven brightness across the pixels. Consequently, when the human eye views the image displayed on the display through the waveguide, it experiences uneven brightness. To address this issue, the applicant has proposed the brightness compensation method provided in the present application.

[0072] Figure 2 This is a flow chart of a brightness compensation method provided in an embodiment of the present application.

[0073] like Figure 2As shown, the brightness compensation method provided in the embodiment of the present application is as follows S2100-S2400:

[0074] S2100 , controlling the display screen to drive each pixel in the display screen according to a maximum set current value when displaying the first image.

[0075] The brightness compensation method provided in the embodiment of the present application is applied to Figure 1 The electronic device 100 shown includes a display screen, a waveguide plate, and an image sensor, wherein the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged close to the human eye.

[0076] The first image is usually a white image, that is, the RGB value of each pixel in the first image is (255, 255, 255), because a white image has less influence on the brightness of the image.

[0077] In the embodiment of the present application, the set current value is the driving current value of each pixel that can be expected for the image to be displayed on the display screen. The maximum set current value is the maximum value among the set current values.

[0078] In one example, the maximum set current value is 50A / cm 2 It should be noted that the unit of the current value mentioned in any embodiment of this application is A / cm 2 , that is, the current value mentioned in any embodiment of the present application is specifically represented by the current density value.

[0079] In the embodiment of the present application, the brightness of the first image can be controlled to be maximum through the above S2100.

[0080] S2200: Acquire a second image captured by an image sensor.

[0081] The second image is the image of the first image reaching the human eye through the waveguide.

[0082] In one embodiment of the present application, the image sensor may be, for example, but not limited to, a CCD (charge coupled device) camera.

[0083] In this embodiment of the present application, an image sensor is used to capture the image of the first image displayed on the display screen as it passes through the waveguide and reaches the human eye, i.e., the second image. Based on this image, the second image is obtained. Due to the display screen's crystallization process and the changes in light from the display screen after passing through the waveguide, the brightness of the second image is uneven. Determining the current compensation value for each image area in the second image through steps S2300 and S2400 below can address this uneven brightness issue.

[0084] S2300: Determine actual brightness values ​​of different image areas in the second image according to the second image.

[0085] In one embodiment of the present application, the above S2300 may be implemented by the following S2310-S2312:

[0086] S2310: Divide the second image into a set number of image regions according to the set number of regions.

[0087] In the embodiment of the present application, the number of set regions is usually specified by the developer. The larger the number of set regions, the better the problem of uneven image brightness seen by the human eye can be solved by determining the current compensation value for each image region.

[0088] In one example of this application, Figure 3 As shown, the number of set areas is set to 9, that is, the second image is divided into 9 equal parts.

[0089] It should be noted that Figure 3 The numbers in represent the numbers of the image areas into which the second image is divided.

[0090] S2311. For any image area, determine the brightness value of each pixel in the image area according to the second image.

[0091] In the embodiment of the present application, taking image area 1 as an example, first, the pixels belonging to image area 1 are extracted from the second image, and then the brightness value of each pixel belonging to image area 1 is calculated.

[0092] In this case, assuming the second image is an a*b image, the calculation process for extracting pixels belonging to image region 1 from the second image can be as follows: extract pixels from the second image whose horizontal coordinates are less than or equal to a / 3 and whose vertical coordinates are less than or equal to b / 3. a is the number of pixels in the second image in the horizontal direction, and b is the number of pixels in the second image in the direction perpendicular to the horizontal direction. The coordinate origin corresponding to the aforementioned horizontal and vertical coordinates is the position of the upper left corner of the second image.

[0093] And, the calculation process of calculating the brightness value of each pixel belonging to the image area 1 can be:

[0094] For any pixel, the brightness value of the pixel is calculated based on the RGB value of the pixel and the following formula 1.

[0095] L=R*0.30+G*0.59+B*0.11 (Formula 1)

[0096] Among them, R represents the R value in the RGB value of the pixel, G represents the G value in the RGB value of the pixel, B represents the B value in the RGB value of the pixel, and L represents the brightness value of the pixel.

[0097] S2312. Calculate the average value of the brightness values ​​of each pixel in the image area, and determine the average value as the actual brightness value of the image area.

[0098] S2400 , for any image area, determine a current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area according to the maximum set current value, the target set current value, and the actual brightness value of the image area.

[0099] The target set current value is: the driving current value of each pixel of the image to be subsequently displayed on the display screen.

[0100] In the embodiment of the present application, the current compensation value for adjusting the actual brightness value of an image region to the minimum actual brightness value among the actual brightness values ​​of the image region is determined because the first image is displayed when the display screen drives each pixel at the maximum set current value. Therefore, for the image region with the minimum actual brightness value, the current value corresponding to the image region cannot be increased. The actual brightness value of each image region can only be adjusted to the minimum actual brightness value based on the minimum actual brightness value. Furthermore, it is sufficient to determine the current compensation value for adjusting the actual brightness value of the image region to the minimum actual brightness value.

[0101] The above S2400 can be realized by the following formula 2:

[0102]

[0103] Wherein, c is the actual brightness value of the image area, d is the minimum actual brightness value, e is the maximum set current value, f is the target set current value, and δ is the current compensation value.

[0104] exist Figure 3 Based on the example shown, the maximum set current value is 50A / cm 2 、The target current value is 40A / cm 2 , the actual brightness values ​​of different image regions of the second image are as follows Figure 4 Based on Figure 4 , it can be determined that the minimum actual brightness value is 80. Further, combined with the above formula 2, it can be determined that the current compensation values ​​of image area 1 to image area 9 are: -3.6A / cm 2 , 0A / cm 2 、-7A / cm 2 , 0A / cm 2, 0A / cm 2 , 0A / cm 2 , 4A / cm 2 , 0A / cm 2 , 10A / cm 2 .

[0105] In one embodiment of the present application, Figure 5 As shown, due to the problem of accuracy, the current compensation value is usually a multiple of 5. Therefore, the current compensation values ​​of image area 1 to image area 9 are determined to be: -5A / cm 2 , 0A / cm 2 、-10A / cm 2 , 0A / cm 2 , 0A / cm 2 , 0A / cm 2 , 5A / cm 2 , 0A / cm 2 , 10A / cm 2 .

[0106] Further, in Figure 3 Based on the example shown, the maximum set current value is 50A / cm 2 、The target current value is 30A / cm 2 , the actual brightness values ​​of different image regions of the second image are as follows Figure 4 Based on Figure 4 , it can be determined that the minimum actual brightness value is 80. Further, combined with the above formula 2, it can be determined that the current compensation values ​​of image area 1 to image area 9 are: 6.3, 10A / cm 2 , 3.3A / cm 2 , 10A / cm 2 , 10A / cm 2 , 10A / cm 2 , 14A / cm 2 , 10A / cm 2 , 20A / cm 2 .

[0107] In one embodiment of the present application, Figure 6 As shown, due to the problem of accuracy, the current compensation value is usually a multiple of 5. Therefore, the current compensation values ​​of image area 1 to image area 9 are determined to be: 5A / cm 2 , 10A / cm 2 , 0A / cm 2 , 10A / cm 2 , 10A / cm 2 , 10A / cm 2 , 15A / cm 2, 10A / cm 2 , 20A / cm 2 .

[0108] When the current compensation value for each image area is determined, for any image area, the current compensation value is increased on the basis of the target set current value, so that the actual brightness value of the corresponding image area reaches the minimum actual brightness value, that is, the brightness of the image viewed by the human eye is consistent.

[0109] The embodiment of the present application provides a brightness compensation method, which is applied to an electronic device, wherein the electronic device includes a display screen, a waveguide plate, and an image sensor, wherein the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged on the side close to the human eye, comprising: controlling the display screen to drive each pixel in the display screen according to a maximum set current value when displaying a first image; obtaining a second image captured by the image sensor, wherein the second image is an image of the first image passing through the waveguide plate and reaching the human eye; determining the actual brightness values ​​of different image areas in the second image based on the second image; for any image area, determining a current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area based on the maximum set current value, the target set current value, and the actual brightness value of the image area. The brightness compensation method provided in the embodiment of the present application takes into account two factors: the crystallization process of the display screen and the changes in the light of the display screen after passing through the waveguide plate. This ensures that when the image is displayed based on the current compensation value obtained by the brightness compensation method provided in the embodiment of the present application, the image brightness viewed by the human eye is uniform. In other words, the embodiment of the present application provides a method for making the brightness of the image displayed on the display screen uniform.

[0110] In one embodiment of the present application, the brightness compensation method provided in the embodiment of the present application further includes the following S2500 and S2600 after the above S2400:

[0111] S2500 : For any image area, determine the actual current value of the image area according to the target set current value and the current compensation value of the image area.

[0112] In the embodiment of the present application, for any image region, the sum of the target set current value and the current compensation value corresponding to the image region is determined as the actual current value of the image region.

[0113] S2600: Update the driving current value corresponding to the target set current value in the memory and matching the image area to the actual current value.

[0114] The memory stores a set of mapping data corresponding to at least one set current value, and the mapping data is used to reflect the driving current values ​​corresponding to different image areas under the set current value.

[0115] The set current value is a driving current value of each pixel that can be expected to display an image on the display screen.

[0116] In one example, the memory in the above S2600 may be a one-time programmable (OTP) memory.

[0117] In the embodiment of the present application, at least one set of mapping data is pre-stored in the memory, each set of mapping data corresponds to a set current value, and the mapping data includes driving current values ​​corresponding to different image areas under the corresponding set current value.

[0118] It is understood that in the initial state, that is, before the brightness compensation method provided by the embodiments of the present application is used, the driving current values ​​corresponding to different image regions in the mapping data are the same as the set current values ​​corresponding to the mapping data. However, after the above-mentioned S2500 and S2600, the driving current values ​​corresponding to different image regions in the mapping data change.

[0119] After S2500 and S2600, when displaying an image, the display screen first reads mapping data from the memory, specifying a set current value corresponding to the expected driving current value for each pixel of the image to be displayed. The image to be displayed is then displayed according to the mapping data. Because the driving current values ​​for different image regions in the mapping data are compensated, the brightness of the image perceived by the human eye is consistent.

[0120] In one embodiment of the present application, due to the accuracy issues mentioned above and the fact that the actual brightness value of the image area is actually an average value rather than a true actual value, when the display screen displays an image and drives the corresponding pixel points in the display screen according to the actual current value compensated by the current compensation value, there may be bright spots or dark spots in the image seen by the human eye.

[0121] To solve the bright spot problem, the brightness compensation method provided in the embodiment of the present application further includes the following steps S2710-S2715 after the above step S2500:

[0122] S2710 , controlling the display screen to drive corresponding pixels in the display screen according to the actual current value of each image area when redisplaying the first image.

[0123] In this embodiment of the present application, the display screen is controlled to display the first image according to the actual current value obtained through compensation. Specifically, for any image region of the first image, the display screen is controlled to drive the corresponding pixels in the image region according to the actual current value corresponding to the image region when displaying the corresponding image region. As a result, the first image displayed on the display screen as seen by the human eye will be a brightness-compensated image.

[0124] S2711. Acquire a third image captured by the image sensor.

[0125] The third image is the redisplayed first image that reaches the human eye through the waveguide.

[0126] Specifically, the third image is an image observed by human eyes after each pixel in the display screen is driven according to the current compensation value determined in S2400 to display the first image.

[0127] S2712: Detect whether there is a bright spot in the third image.

[0128] In one embodiment of the present application, whether there is a bright spot in the third image can be detected using a pre-trained neural network model.

[0129] Specifically, multiple sets of training samples are input into a preset neural network model to train the preset neural network model to obtain the aforementioned pre-trained neural network model. Wherein, a set of training samples includes an image containing a bright spot and the location of the area where the bright spot is located in the image.

[0130] In one example of the present application, the preset neural network model may be a Mask-RCNN model.

[0131] Based on the above, the third image is input into a pre-trained neural network model. If the region position output by the pre-trained neural network model is a valid position, it indicates that there is a bright spot in the third image. Otherwise, it indicates that there is no bright spot in the third image.

[0132] S2713: When a bright spot exists in the third image, determine the image region where the bright spot is located.

[0133] In combination with the above S2712, the area where the bright spot is located can be determined. On this basis, in combination with the image area, the image area where the bright spot is located can be determined.

[0134] S2714 , extracting a bright spot area and a non-bright spot area from the image area where the bright spot is located.

[0135] In the embodiment of the present application, through the above S2714, the image area is divided again into bright spot areas and non-bright spot areas.

[0136] S2715 , updating the current compensation value of the bright spot area to the difference between the current compensation value of the image area where the bright spot is located and the preset current adjustment amount, and keeping the current compensation value of the non-bright spot area unchanged.

[0137] In the embodiment of the present application, the current compensation value corresponding to the bright spot area is too high. In this case, the bright spot can be eliminated by appropriately reducing the corresponding current compensation value. In the embodiment of the present application, the current compensation value corresponding to the bright spot area is reduced by reducing the preset current adjustment amount based on the current compensation value corresponding to the bright spot area. The preset current adjustment brightness difference value can be set based on experience.

[0138] For the non-bright spot area, the corresponding current compensation value is reasonable, so the corresponding current compensation value is kept unchanged.

[0139] Through the above S2710 - S2715 , the current compensation value obtained based on the above S2400 can be detected and adjusted, so that the final current compensation value can be more accurate.

[0140] To solve the dark spot problem, the brightness compensation method provided in the embodiment of the present application further includes the following steps S2716-S2719 after the above step S2711:

[0141] S2716: Detect whether there are dark spots in the third image.

[0142] S2717: When there are dark spots in the third image, determine the image area where the dark spots are located.

[0143] S2718. Extract the dark spot area and the non-dark spot area from the image area where the dark spot is located.

[0144] S2719: Update the current compensation value of the dark spot area to the difference between the current compensation value of the dark spot area and the preset current adjustment amount, and keep the current compensation value of the non-dark spot area unchanged.

[0145] It should be noted that the description of the above S2716-S2718 is similar to the description of the above S2712-S2715, and will not be repeated here.

[0146] Regarding step S2719, the current compensation value corresponding to the dark spot area is too low. In this case, the dark spot can be eliminated by appropriately increasing the corresponding current compensation value. In this embodiment of the present application, the current compensation value corresponding to the dark spot area is increased by adding a preset current adjustment amount to the current compensation value corresponding to the dark spot area. The preset current adjustment brightness difference value can be set based on experience.

[0147] For the non-dark spot area, the corresponding current compensation value is reasonable, so the corresponding current compensation value is kept unchanged.

[0148] Through the above S2716-S2719, the current compensation value obtained based on the above S2400 can be detected and adjusted, so that the final current compensation value can be more accurate.

[0149] This application also provides a brightness compensation device 700, such as Figure 7 As shown, the device 700 is applied to an electronic device, the electronic device including a display screen, a waveguide plate, and an image sensor, the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged close to the human eye. The device 700 includes:

[0150] A first control module 710 is configured to control the display screen to drive each pixel in the display screen according to a maximum set current value when displaying a first image;

[0151] A first acquisition module 720 is configured to acquire a second image captured by the image sensor, where the second image is an image of the first image reaching the human eye through the waveguide.

[0152] A first determining module 730 is configured to determine actual brightness values ​​of different image areas in the second image based on the second image;

[0153] The second determination module 740 is used to determine, for any image area, based on the maximum set current value, the target set current value and the actual brightness value of the image area, a current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area.

[0154] In one embodiment of the present application, the first determining module 730 is specifically configured to divide the second image into a set number of image regions according to the set number of regions;

[0155] For any image area, determining the brightness value of each pixel in the image area according to the second image;

[0156] The average value of the brightness values ​​of the pixels in the image area is calculated, and the average value is determined as the actual brightness value of the image area.

[0157] In one embodiment of the present application, the apparatus 700 further includes:

[0158] a third determining module, configured to determine, for any image region, an actual current value of the image region according to the target set current value and the current compensation value of the image region;

[0159] A first update module is used to update the driving current value corresponding to the target set current value in the memory and matching the image area to the actual current value, wherein the memory stores a set of preset mapping data corresponding to at least one set current value, and the preset mapping data is used to reflect the driving current values ​​corresponding to different image areas under the set current value.

[0160] In one embodiment of the present application, the apparatus 700 further includes:

[0161] The second control module is further configured to control the display screen to drive corresponding pixels in the display screen according to the actual current value of each image area when the display screen redisplays the first image;

[0162] a second acquisition module, configured to acquire a third image captured by the image sensor, wherein the third image is an image obtained by re-displaying the first image through the waveguide sheet and reaching the human eye;

[0163] a detection module, configured to detect whether there is a bright spot in the third image;

[0164] a fourth determining module, configured to, when the bright spot exists in the third image, determine an image region where the bright spot is located;

[0165] An extraction module, configured to extract a bright spot area and a non-bright spot area from the image area where the bright spot is located;

[0166] The second updating module is configured to update the current compensation value of the bright spot area to the difference between the current compensation value of the image area where the bright spot is located and a preset current adjustment amount, and to keep the current compensation value of the non-bright spot area unchanged.

[0167] In one embodiment of the present application, the detection module is further configured to detect whether there are dark spots in the third image;

[0168] The fourth determining module is further configured to determine an image region where the dark spot is located when the dark spot exists in the third image;

[0169] The extraction module is further used to extract the dark spot area and the non-dark spot area from the image area where the dark spot is located;

[0170] The second updating module is further configured to update the current compensation value of the dark spot area to the difference between the current compensation value of the dark spot area and a preset current adjustment amount, and to keep the current compensation value of the non-dark spot area unchanged.

[0171] The brightness compensation device provided in the embodiment of the present application takes into account two factors: the crystallization process of the display screen and the changes in the light of the display screen after passing through the waveguide plate. This ensures that when the image is displayed based on the current compensation value obtained by the brightness compensation device provided in the embodiment of the present application, the brightness of the image viewed by the human eye is uniform.

[0172] An embodiment of the present application further provides an electronic device, the electronic device comprising a display screen, a waveguide, an image sensor, and any one of the brightness compensation devices provided in the above device embodiments;

[0173] Or, as Figure 8 As shown, it includes a display screen 810, a waveguide plate 820, an image sensor 830, a memory 840 and a processor 850, wherein the memory 840 is used to store computer instructions, and the processor 850 is used to call the computer instructions from the memory 840 to execute the brightness compensation method as described in any one of the above method embodiments.

[0174] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method according to any one of the above method embodiments is implemented.

[0175] The present application may be a system, method and / or computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present application.

[0176] A computer-readable storage medium can be a tangible device that can hold and store instructions for use by an instruction execution device. A computer-readable storage medium can be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination thereof. As used herein, a computer-readable storage medium is not to be construed as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through an electrical wire.

[0177] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions to be stored in the computer-readable storage medium in each computing / processing device.

[0178] The computer program instructions for performing the operation of the present application can be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data or source code or object code written in any combination of one or more programming languages, wherein the programming language includes object-oriented programming languages ​​such as Smalltalk, C++, and conventional procedural programming languages ​​such as "C" language or similar programming languages. Computer-readable program instructions can be executed completely on the user's computer, partially on the user's computer, executed as an independent software package, partially on the user's computer and partially on a remote computer, or executed completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer by any type of network including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (such as by using an Internet service provider to connect to the Internet). In certain embodiments, by utilizing the state information of computer-readable program instructions to personalize electronic circuits, such as programmable logic circuits, field programmable gate arrays (FPGAs) or programmable logic arrays (PLAs), the electronic circuits can execute computer-readable program instructions, thereby realizing various aspects of the present application.

[0179] Various aspects of the present application are described herein with reference to flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.

[0180] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device is generated that implements the functions / actions specified in one or more blocks in the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium, where these instructions cause the computer, programmable data processing device, and / or other device to operate in a specific manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing various aspects of the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0181] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more blocks in the flowchart and / or block diagram.

[0182] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a part of a module, program segment or instruction, and the part of the module, program segment or instruction contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented by a dedicated hardware-based system that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions. It is well known to those skilled in the art that implementation by hardware, implementation by software, and implementation by a combination of software and hardware are all equivalent.

[0183] The embodiments of the present application have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles of the embodiments, practical applications, or technical improvements to technologies in the market, or to enable other persons skilled in the art to understand the embodiments disclosed herein. The scope of this application is defined by the appended claims.

Claims

1. A brightness compensation method, characterized in that: Applied to an electronic device, the electronic device includes a display screen, a waveguide plate, and an image sensor, the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged close to the side of the human eye, the method comprising: Controlling the display screen to drive each pixel of the display screen according to a maximum set current value when displaying a first image, where the set current value is a driving current value of each pixel of an image to be subsequently displayed on the display screen, and the maximum set current value is a maximum value among the set current values; Acquire a second image captured by the image sensor, where the second image is an image of the first image reaching a human eye through the waveguide; determining actual brightness values ​​of different image areas in the second image according to the second image; For any image area, determining a current compensation value for adjusting the actual brightness value of the image area to a minimum actual brightness value among the actual brightness values ​​of the image area based on the maximum set current value, the target set current value, and the actual brightness value of the image area, wherein the target set current value is a driving current value for each pixel of an image to be subsequently displayed on the display screen; The current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area is determined based on the maximum set current value, the target set current value, and the actual brightness value of the image area, and is implemented according to the following formula: , where c is the actual brightness value of the image area, d is the minimum actual brightness value, e is the maximum set current value, and f is the target set current value. is the current compensation value.

2. The method according to claim 1, characterized in that The determining, according to the second image, actual brightness values ​​of different image areas in the second image includes: According to a set number of regions, dividing the second image into a number of image regions of the set region; For any image area, determining the brightness value of each pixel in the image area according to the second image; The average value of the brightness values ​​of the pixels in the image area is calculated, and the average value is determined as the actual brightness value of the image area.

3. The method according to claim 1, characterized in that The method further comprises: For any image area, determining an actual current value of the image area according to the target set current value and the current compensation value of the image area; The driving current value corresponding to the target set current value in the memory and matching the image area is updated to the actual current value, and the memory stores a set of preset mapping data corresponding to at least one set current value, and the preset mapping data is used to reflect the driving current values ​​corresponding to different image areas under the set current value.

4. The method according to claim 3, characterized in that After determining the actual current value of the image area according to the target set current value and the current compensation value of the image area, the method further includes: Controlling the display screen to drive corresponding pixels in the display screen according to the actual current value of each image area when the display screen redisplays the first image; Acquire a third image captured by the image sensor, where the third image is a redisplayed image of the first image passing through the waveguide plate and reaching the human eye; detecting whether there is a bright spot in the third image; When the bright spot exists in the third image, determining an image region where the bright spot is located; Extracting bright spot areas and non-bright spot areas from the image area where the bright spot is located; The current compensation value of the bright spot area is updated to the difference between the current compensation value of the image area where the bright spot is located and the preset current adjustment amount, and the current compensation value of the non-bright spot area is kept unchanged.

5. The method according to claim 4, characterized in that After acquiring the third image captured by the image sensor, the method further includes: detecting whether there is a dark spot in the third image; In a case where the dark spot exists in the third image, determining an image region where the dark spot is located; Extracting dark spot areas and non-dark spot areas from the image area where the dark spots are located; The current compensation value of the dark spot area is updated to the difference between the current compensation value of the area where the dark spot is located and the preset current adjustment amount, and the current compensation value of the non-dark spot area is kept unchanged.

6. A brightness compensation device, characterized in that: Applicable to electronic equipment, the electronic equipment includes a display screen, a waveguide plate and an image sensor, the waveguide plate is arranged between the display screen and the image sensor, and the image sensor is arranged close to the human eye. The device includes: a first control module, configured to control the display screen to drive each pixel of the display screen according to a maximum set current value when displaying a first image, wherein the set current value is a driving current value of each pixel of an image to be subsequently displayed on the display screen, and the maximum set current value is a maximum value among the set current values; a first acquisition module, configured to acquire a second image captured by the image sensor, where the second image is an image of the first image reaching a human eye through the waveguide; a first determining module, configured to determine actual brightness values ​​of different image areas in the second image based on the second image; a second determining module, configured to determine, for any image area, a current compensation value for adjusting the actual brightness value of the image area to a minimum actual brightness value among the actual brightness values ​​of the image area based on the maximum set current value, the target set current value, and the actual brightness value of the image area, wherein the target set current value is a driving current value for each pixel of an image to be subsequently displayed on the display screen; The current compensation value for adjusting the actual brightness value of the image area to the minimum actual brightness value among the actual brightness values ​​of the image area is determined based on the maximum set current value, the target set current value, and the actual brightness value of the image area, and is implemented according to the following formula: , where c is the actual brightness value of the image area, d is the minimum actual brightness value, e is the maximum set current value, and f is the target set current value. is the current compensation value.

7. The device according to claim 6, characterized in that The device further comprises: a third determining module, configured to determine, for any image region, an actual current value of the image region according to the target set current value and the current compensation value of the image region; A first update module is used to update the driving current value corresponding to the target set current value in the memory and matching the image area to the actual current value, wherein the memory stores a set of preset mapping data corresponding to at least one set current value, and the preset mapping data is used to reflect the driving current values ​​corresponding to different image areas under the set current value.

8. The device according to claim 7, characterized in that The device further comprises: The second control module is further configured to control the display screen to drive corresponding pixels in the display screen according to the actual current value of each image area when the display screen redisplays the first image; a second acquisition module, configured to acquire a third image captured by the image sensor, wherein the third image is an image obtained by re-displaying the first image through the waveguide sheet and reaching the human eye; a detection module, configured to detect whether there is a bright spot in the third image; a fourth determining module, configured to, when the bright spot exists in the third image, determine an image region where the bright spot is located; An extraction module, configured to extract a bright spot area and a non-bright spot area from the image area where the bright spot is located; The second updating module is configured to update the current compensation value of the bright spot area to the difference between the current compensation value of the image area where the bright spot is located and a preset current adjustment amount, and to keep the current compensation value of the non-bright spot area unchanged.

9. An electronic device, characterized in that: The electronic device comprises a display screen, a waveguide, an image sensor, and a device according to any one of claims 6 to 8; Alternatively, the system comprises a display screen, a waveguide, an image sensor, a memory, and a processor, wherein the memory is used to store computer instructions, and the processor is used to call the computer instructions from the memory to execute the method according to any one of claims 1 to 5.

10. A computer-readable storage medium, characterized in that A computer program is stored thereon, which implements the method according to any one of claims 1 to 5 when executed by a processor.

Images