Light leakage compensation method and device and storage medium

Abstract

The invention discloses a light leakage compensation method and device and a storage medium. The light leakage compensation method comprises the following steps: acquiring a channel value corresponding to a pixel point in screen display content to obtain a first channel value; the distance between the pixel point coordinate position and the under-screen light sensing center position of the screen is determined, an influence factor corresponding to the distance is determined based on the distance, and the influence factor is used for representing the light leakage degree of the screen at the position corresponding to the distance; determining a channel compensation value of the first channel value based on the influence factor, and compensating the first channel value based on the channel compensation value to obtain a second channel value; and taking the second channel value as the channel value of the display content for light leakage compensation. Based on the method, the influence of the non-pure-color image on the light sensation can be mapped into the corresponding pure-color image, the light leakage value prediction precision of the compensation model trained through the pure-color image on the non-pure-color image is improved, and the precision of the under-screen light sensation under the display content of the non-pure-color image is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of artificial intelligence technology, and in particular to a light leakage compensation method, device and storage medium. Background Art

[0002] With the continuous development of smart devices, people are increasingly pursuing the user experience of smart devices. For example, under-screen light sensing is a light sensing solution adopted by many high-end smart devices.

[0003] However, the light perception under the screen will be affected by the screen and cause screen leakage, which affects the user experience. In view of the light perception leakage under the screen, the related technology uses an under-screen light perception compensation algorithm to determine the light perception leakage value and perform light perception compensation based on the light leakage value. Among them, the light leakage compensation algorithm mainly determines the training data set based on the backlight value of the screen and the display content of the screen, and performs model training based on the training data set to predict the light leakage value of the screen through the trained model. However, the accuracy of the current light leakage compensation algorithm in predicting the light leakage value is not very ideal. Summary of the invention

[0004] In order to overcome the problems existing in the related art, the present disclosure provides a data processing method, device and storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a light leakage compensation method is provided, including: obtaining a channel value corresponding to a pixel point in screen display content to obtain a first channel value; determining a distance between the coordinate position of the pixel point and the center position of the light sensing under the screen, and determining an influence factor corresponding to the distance based on the distance, wherein the influence factor is used to characterize the degree of light leakage generated by the screen at the screen position corresponding to the distance; determining a channel compensation value of the first channel value based on the influence factor, and compensating the first channel value based on the channel compensation value to obtain a second channel value; and using the second channel value as the channel value of the display content for light leakage compensation.

[0006] In one embodiment, determining the influence factor based on the distance includes: determining the current position area to which the pixel point coordinate position belongs based on the distance; determining the influence factor corresponding to the current position area based on the correspondence between the position area and the influence factor; and using the influence factor of the current position area as the influence factor corresponding to the distance.

[0007] In one embodiment, the correspondence between the position area and the influencing factor is determined in the following manner: based on the center position of the under-screen light sensing in the screen, the position area where light leakage exists in the screen is divided into multiple position areas according to the channel value detected by the under-screen light sensing; the channel value detected by the under-screen light sensing at each position point in each position area in the multiple position areas is obtained to obtain a channel value set corresponding to each position area, and the position point corresponds to a square display area of ​​a set size in the position area; for each position area in the multiple position areas, the influencing factor corresponding to each position point in the position area is determined, and the influencing factor is the ratio between the channel value at the position point and the maximum channel value in the channel value set, and the correspondence between each position point in the position area and the influencing factor is determined as the correspondence between the position area and the influencing factor.

[0008] In one embodiment, based on the under-screen light sensor at the center position of the screen, the position area where light leakage exists in the screen is divided into multiple position areas according to the channel value detected by the under-screen light sensor, including: determining the position area where light leakage exists in the screen based on the under-screen light sensor at the center position of the screen; controlling the screen to display a first white display area, the first white display area is a first square display area centered at the center position of the under-screen light sensor, and moving the first white display area along the diagonal direction of the first square display area with the center position as the starting point, and reading the channel value detected by the under-screen light sensor until the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, determining a first coordinate distance between a vertex position of the first square display area and the center position, and determining a first position area based on the first coordinate distance, the vertex position of the first square display area is the vertex position of the first square display area away from the center position in the moving direction when the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, and the first position area is a square display area centered at the center position; controlling the screen to display a second white display area, the second white display area is a second square centered at the vertex position of the first square display area display area, the length of the second square display area is greater than the length of the first square display area, and the second white display area is moved along the diagonal direction of the second square display area with the vertex position of the first square display area as the starting point, and the channel value detected by the under-screen light sensor is read until the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, and the second coordinate distance between the vertex position of the second square display area and the center position is determined, and the second position area is determined based on the second coordinate distance, the vertex position of the second square display area is the vertex position of the second square display area away from the vertex position of the first square display area in the moving direction when the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, the second position area is other position areas in the square display area centered on the center position except the first position area, and the vertex position of the second square display area is used as the vertex position of the first square display area; other areas except the first position area and the second position area in the position area with light leakage in the screen are used as the third position area; the first position area, the second position area and the third position area are used as multiple position areas divided according to the channel value detected by the under-screen light sensor.

[0009] In one embodiment, the channel compensation value of the first channel value is determined based on the influencing factor, including: multiplying the product with the influencing factor and determining the number of position points included in the area of ​​the current position area, wherein the position point is a square display area of ​​a set size; and determining the ratio between the product and the number of position points as the channel compensation value of the first channel value.

[0010] In one embodiment, compensating the first channel value based on the channel compensation value to obtain the second channel value includes: determining the first channel cumulative value of each of the multiple position areas, the first channel cumulative value is the cumulative sum of all first channel values ​​included in the position area; determining the used impact factor cumulative value of each of the multiple position areas, the used impact factor cumulative value is the cumulative sum of the impact factors called by the screen display content pixel mapping in the position area; adding the channel compensation value to the first channel cumulative value to obtain a third channel value; weighted summing the third channel values ​​of the multiple position areas to obtain a channel weighted value, and weighted summing the used impact factor cumulative values ​​of the multiple position areas to obtain an impact factor weighted value; using the channel value corresponding to the ratio between the channel weighted value and the impact factor weighted value as the second channel value.

[0011] According to a second aspect of an embodiment of the present disclosure, a light leakage compensation device is provided, comprising: a receiving unit, used to obtain a channel value corresponding to a pixel point in screen display content to obtain a first channel value; a processing unit, used to determine the distance between the coordinate position of the pixel point and the center position of the light sensitivity under the screen, and determine an influence factor corresponding to the distance based on the distance, wherein the influence factor is used to characterize the degree of light leakage generated by the screen at the screen position corresponding to the distance; and a channel compensation value of the first channel value based on the influence factor, and compensate the first channel value based on the channel compensation value to obtain a second channel value; and use the second channel value as the channel value of the display content for light leakage compensation.

[0012] In one embodiment, the processing unit determines the influence factor based on the distance in the following manner: determine the current position area to which the pixel point coordinate position belongs based on the distance; determine the influence factor corresponding to the current position area based on the correspondence between the position area and the influence factor; and use the influence factor of the current position area as the influence factor corresponding to the distance.

[0013] In one embodiment, the processing unit determines the correspondence between the position area and the influence factor in the following manner: based on the center position of the under-screen light sensor in the screen, the position area where light leakage exists in the screen is divided into multiple position areas according to the channel value detected by the under-screen light sensor; the channel value detected by the under-screen light sensor at each position point in each position area in the multiple position areas is obtained to obtain a channel value set corresponding to each position area, and the position point corresponds to a square display area of ​​a set size in the position area; for each position area in the multiple position areas, the influence factor corresponding to each position point in the position area is determined, and the influence factor is the ratio of the channel value at the position point to the maximum channel value in the channel value set, and the correspondence between each position point in the position area and the influence factor is determined as the correspondence between the position area and the influence factor.

[0014] In one embodiment, the processing unit divides the position area where light leakage exists in the screen into a plurality of position areas according to the channel value detected by the under-screen light sensor based on the center position of the screen by the under-screen light sensor: determining the position area where light leakage exists in the screen based on the center position of the under-screen light sensor on the screen; controlling the screen to display a first white display area, the first white display area being a first square display area centered at the center position of the under-screen light sensor, and moving the first white display area along the diagonal direction of the first square display area with the center position as a starting point, and reading the channel value detected by the under-screen light sensor until the channel value detected by the under-screen light sensor is less than or equal to a channel threshold, determining a first coordinate distance between a vertex position of the first square display area and the center position, and determining a first position area based on the first coordinate distance, the vertex position of the first square display area being a vertex position of the first square display area away from the center position in the moving direction when the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, and the first position area being a square display area centered at the center position; controlling the screen to display a second white display area, the second white display area being a first square display area centered at the vertex position of the first square display area The second square display area has a length greater than that of the first square display area, and the second white display area is moved along the diagonal direction of the second square display area with the vertex position of the first square display area as the starting point, and the channel value detected by the light sensor under the screen is read until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, and the second coordinate distance between the vertex position of the second square display area and the center position is determined, and the second position area is determined based on the second coordinate distance, the vertex position of the second square display area is the vertex position of the second square display area away from the vertex position of the first square display area in the moving direction when the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, the second position area is other position areas except the first position area in the square display area centered on the center position, and the vertex position of the second square display area is used as the vertex position of the first square display area; the other areas except the first position area and the second position area in the position area with light leakage in the screen are used as the third position area; the first position area, the second position area and the third position area are used as multiple position areas divided according to the channel value detected by the light sensor under the screen.

[0015] In one embodiment, the processing unit determines the channel compensation value of the first channel value based on the influencing factor in the following manner: multiplying the product with the influencing factor and determining the number of position points included in the area of ​​the current position area, where the position point is a square display area with a set size; and determining the ratio between the product and the number of position points as the channel compensation value of the first channel value.

[0016] In one embodiment, the processing unit compensates the first channel value based on the channel compensation value to obtain a second channel value in the following manner: determine the first channel cumulative value of each of the multiple position areas respectively, the first channel cumulative value is the cumulative sum of all first channel values ​​included in the position area; determine the used impact factor cumulative value of each of the multiple position areas respectively, the used impact factor cumulative value is the cumulative sum of the impact factors called by the screen display content pixel mapping in the position area; add the first channel cumulative value to the channel compensation value to obtain a third channel value; perform weighted summation on the third channel values ​​of the multiple position areas to obtain a channel weighted value, and perform weighted summation on the used impact factor cumulative values ​​of the multiple position areas to obtain an impact factor weighted value; use the channel value corresponding to the ratio between the channel weighted value and the impact factor weighted value as the second channel value.

[0017] According to a third aspect of an embodiment of the present disclosure, another light leakage compensation device is provided, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to: execute the light leakage compensation method described in the first aspect or any one implementation of the first aspect.

[0018] According to a fourth aspect of an embodiment of the present disclosure, a storage medium is provided, in which instructions are stored. When the instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the light leakage compensation method described in the first aspect or any one of the embodiments of the first aspect.

[0019] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: by mapping the influence of non-pure color images on light perception into corresponding pure color images, the prediction accuracy of light leakage values ​​of non-pure color images by a compensation model trained by pure color images is improved, and the accuracy of light perception under the screen when displaying content with non-pure color images is improved, thereby improving the user experience of the automatic brightness function.

[0020] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0022] Figure 1 The figure is a flow chart of a light leakage compensation method according to an exemplary embodiment.

[0023] Figure 2 The figure is a flow chart of a method for determining an impact factor based on distance according to an exemplary embodiment.

[0024] Figure 3 The present invention is a flowchart of a method for determining a corresponding relationship between a location area and an impact factor according to an exemplary embodiment.

[0025] Figure 4 The present invention is a flowchart of a method for dividing a position area where light leakage exists in a screen into a plurality of position areas according to an exemplary embodiment.

[0026] Figure 5 The diagram is an example of a method for dividing a position area where light leakage exists in a screen into a plurality of position areas according to an exemplary embodiment.

[0027] Figure 6 The invention is a flowchart of a method for compensating a first channel value based on a channel compensation value according to an exemplary embodiment.

[0028] Figure 7 The figure is a flowchart of a method for determining a model training data set according to an exemplary embodiment.

[0029] Figure 8 is an exemplary diagram showing a method for obtaining a location area where light leakage exists in a screen according to an exemplary embodiment.

[0030] Fig. 9 is an exemplary diagram showing division into three areas according to an exemplary embodiment.

[0031] Fig.10 A block diagram of a light leakage compensation device.

[0032] Fig.11 The invention is a block diagram showing a device for a light leakage compensation method according to an exemplary embodiment.

[0033] Fig.12 The invention is a block diagram showing a device for a light leakage compensation method according to an exemplary embodiment. DETAILED DESCRIPTION

[0034] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure.

[0035] The light leakage compensation method provided by the present disclosure can be applied to all smart devices that use under-screen light sensors, such as mobile phones or tablet computers.

[0036] When we use smart devices, the light perception under the screen of the smart device will be affected by the screen, resulting in light leakage. In the related art, for light leakage under the screen, an under-screen light perception compensation algorithm is used to determine the light perception leakage value, and light perception compensation is performed based on the light leakage value. However, the accuracy of the current light leakage compensation algorithm in predicting the light leakage value is not very ideal. Therefore, when the screen displays more complex display content, the user experience of the automatic brightness function is reduced.

[0037] The present disclosure provides a light leakage compensation method for realizing accurate prediction of the light leakage value of the screen by a light leakage compensation algorithm, thereby performing better light leakage compensation and improving the user experience of the automatic brightness function.

[0038] The specific implementation of the embodiment of the present disclosure is further explained below in conjunction with the accompanying drawings of the embodiment of the present disclosure.

[0039] Figure 1 is a flow chart of a light leakage compensation method according to an exemplary embodiment. Figure 1 As shown, the method comprises the following steps:

[0040] Step S11, obtaining a channel value corresponding to a pixel point in the screen display content to obtain a first channel value.

[0041] In the disclosed embodiment, the channel values ​​corresponding to the pixels in the screen display content are stored in an array through a screenshot algorithm for easy access. In the disclosed embodiment, for the convenience of description, the initial channel value of the screen display content obtained is referred to as the first channel value, and the channel value after light leakage compensation is referred to as the second channel value.

[0042] In the embodiment of the present disclosure, the channel value corresponding to the pixel point in the screen display content may be an RGB value. The specific corresponding value of the channel value is not limited in the embodiment of the present disclosure.

[0043] Step S12, determining the distance between the pixel point coordinate position and the under-screen light sensing center position of the screen, and determining the influencing factor corresponding to the distance based on the distance.

[0044] In the disclosed embodiment, the distance between the coordinate position of the pixel point and the center position of the light sensing under the screen is the horizontal / vertical distance length between the coordinate position of the pixel point and the coordinate of the center position of the light sensing under the screen.

[0045] In the disclosed embodiment, the impact factor is used to characterize the degree of light leakage generated by the screen at a distance from the corresponding screen position.

[0046] Since the screen's under-screen light sensor is a fixed physical position under the screen, the detectable area is limited. Therefore, the distance between the pixel's coordinate position and the center of the under-screen light sensor determines the degree of influence of the pixel on the under-screen light sensor's light leakage. Generally, the closer the distance between the pixel's coordinate position and the center of the under-screen light sensor, the greater the corresponding influence factor. Conversely, the farther the distance between the pixel's coordinate position and the center of the under-screen light sensor, the smaller the corresponding influence factor.

[0047] Step S13, determining a channel compensation value of the first channel value based on the influencing factor, and compensating the first channel value based on the channel compensation value to obtain a second channel value.

[0048] Step S14: Using the second channel value as the channel value of the light leakage compensation display content.

[0049] The light leakage compensation method provided by the present disclosure obtains the second channel value by performing the above light leakage compensation step on the first channel value based on the influence factor. It can accurately map the influence of complex screen display content on the light perception under the screen into the influence of simple screen display content on the light perception under the screen. This makes the subsequent predicted light leakage value more accurate.

[0050] In the disclosed embodiment, the above-mentioned distance-based determination of the impact factor is performed by obtaining the pixel coordinate position, and determining the current position area and the corresponding impact factor based on the distance between the pixel coordinate position and the coordinate position of the light sensing center under the screen. The following further describes this process in conjunction with the accompanying drawings of an embodiment.

[0051] Figure 2 is a flow chart of a method for determining an impact factor based on distance according to an exemplary embodiment. Figure 2 As shown, the method comprises the following steps:

[0052] Step S21, determining the current position area to which the pixel point coordinate position belongs based on the distance.

[0053] In the disclosed embodiment, the pixel coordinate position is obtained, the distance value from the pixel coordinate position to the center position of the light sensor under the screen is calculated, and the current position area to which the pixel coordinate position belongs is determined based on the calculated distance value.

[0054] Step S22: determining the influence factor corresponding to the current location area based on the corresponding relationship between the location area and the influence factor.

[0055] In the embodiment of the present disclosure, the corresponding relationship between the location area and the impact factor is a mapping relationship, that is, each location area corresponds to the impact factor of the location area.

[0056] Step S23: Using the influence factor of the current location area as the influence factor corresponding to the distance.

[0057] The method for determining the impact factor based on distance provided by the present disclosure determines the position area to which the current pixel belongs by distance, and then determines the impact factor corresponding to the current position area. The method can determine the impact factor corresponding to each pixel, and the impact factor can accurately indicate the degree of light leakage generated at the corresponding screen position of the current pixel coordinate position.

[0058] In the disclosed embodiment, based on the correspondence between the position area and the influencing factor, it can be further calculated based on the channel value set detected by the under-screen light sensor of each position area.

[0059] Figure 3 is a flow chart showing a method for determining a correspondence between a location area and an impact factor according to an exemplary embodiment. Figure 3 As shown, the method comprises the following steps:

[0060] Step S31, dividing the position area where light leakage exists in the screen into multiple position areas according to the channel value of the under-screen light sensing detection.

[0061] In the disclosed embodiment, the location area where light leakage exists in the screen is determined based on the center position of the screen based on the light perception under the screen.

[0062] Step S32, obtaining the channel value detected by the under-screen light sensor at each position point in each position area in multiple position areas, and obtaining a channel value set corresponding to each position area.

[0063] In the implementation of the present disclosure, each location point corresponds to a square display area of ​​a set size within the location area where the location point is located.

[0064] In the disclosed embodiment, the display content of the screen is set to a black display area, and white display areas of different sizes are used to traverse the position areas where light leakage exists in the screen, and the channel values ​​detected by the light sensor under the screen at each position point in each position area in multiple position areas are read to obtain a set of channel values ​​corresponding to each position area.

[0065] Step S33: for each location area among the multiple location areas, determine the impact factor corresponding to each location point in the location area.

[0066] In the disclosed embodiment, the impact factor corresponding to each position point is determined based on the ratio of the channel value of each position point to the maximum channel value in the channel value set, and the corresponding relationship between each position area and the impact factor is recorded.

[0067] Step S34: determining the correspondence between each location point in the location area and the impact factor as the correspondence between the location area and the impact factor.

[0068] For ease of understanding, the following example illustrates the method for determining the correspondence between the position area and the influencing factor. Set the screen display to pure black. Define a pure white square A of 5*5, a pure white square B of 10*10, and a pure white square C of 30*30. Define the innerChannelData array, the middleChannelData array, and the maxChannelData array to store the channel values ​​of the first position area, the second position area, and the third position area, respectively. Define the innerPara array, the middlePara array, and the maxPara array to store the influencing factors corresponding to the first position area, the second position area, and the third position area, respectively. Among them, the channel value can be C channel data.

[0069] In one implementation, square A is used to scan the entire first position area starting from the upper left corner of the first position area of ​​the screen. The C channel data of each position point detected by the light sensor under the screen is read and stored in the array innerChannelData. A variable MaxC is defined to record the maximum value of the C channel data of all position points in the first position area. After the first position area is scanned, the innerChannelData array is traversed, and the channel data of each position point is divided by MaxC, and the obtained data is stored in the array innerPara. That is, the values ​​recorded in the innerPara array are the impact factors corresponding to each position point in the first position area.

[0070] In one implementation, square B is used to scan the second position area in the same way as square A to obtain the array middleChannelData. That is, the array middleChannelData stores the C channel data of all position points in the second position area. Traverse the middleChannelData array, and similarly, divide the channel data of each position point by MaxC, and store the obtained data in the array middlePara. That is, the values ​​recorded in the middlePara array are the impact factors corresponding to each position point in the second position area.

[0071] In one implementation, the third position region is scanned with square C in the same manner as square A to obtain the array maxChannelData. That is, the array maxChannelData stores the C channel data of all position points in the third position region. The array maxPara is obtained in the same manner as the above-mentioned middlePara array. That is, the values ​​recorded in the maxPara array are the impact factors corresponding to each position point in the third position region.

[0072] The method for determining the correspondence between the location area and the impact factor provided by the present disclosure determines the impact factor based on the channel value set corresponding to each location area divided into multiple location areas. Then, the mapping relationship between the location area and the impact factor is determined. Based on the mapping relationship, the impact factor corresponding to the location point can be directly determined.

[0073] In the disclosed embodiment, the position area where light leakage exists in the screen is divided into a plurality of position areas according to the channel value of the light sensing detection under the screen, and specifically, the division is based on the range of channel values ​​that can be detected at the center position of the light sensing under the screen.

[0074] Figure 4 is a flow chart showing a method for dividing a position area with light leakage in a screen into a plurality of position areas according to an exemplary embodiment. Figure 4 As shown, the method comprises the following steps:

[0075] Step S41, control the screen to display the first white display area, read the channel value detected by the light sensor under the screen, until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, determine the first coordinate distance, and determine the first position area based on the first coordinate distance.

[0076] In the disclosed embodiment, the first white display area is a square display area centered on the light under the screen.

[0077] In the disclosed embodiment, the first white display area moves diagonally from the center of the light sense under the screen as a starting point.

[0078] In the embodiment of the present disclosure, the side length value of the first white display area is decreased successively with each movement.

[0079] In the disclosed embodiment, the first coordinate distance is the distance length represented by the absolute value obtained by subtracting the coordinate value of the first white display area farthest from the light sensing center position under the screen from the horizontal or vertical coordinate of the coordinate value of the light sensing center position under the screen.

[0080] Step S42, control the screen to display a second white display area, read the channel value detected by the light sensor under the screen, until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, determine the second coordinate distance, and determine the second position area based on the second coordinate distance.

[0081] In the disclosed embodiment, the second white display area is larger than the first white display area. The second white display area is a square display area centered on the vertex position of the first white display area when the channel value detected by the light sensor under the screen is less than or equal to the channel threshold after the movement. That is, the square display area is centered on the vertex position of the first position area determined based on the first coordinate distance.

[0082] In the disclosed embodiment, the second white display area moves diagonally toward the second white display area starting from the vertex position of the first white display area.

[0083] In the embodiment of the present disclosure, the side length value of the second white display area is decreased successively with each movement.

[0084] In the disclosed embodiment, the second coordinate distance is the distance length represented by the absolute value obtained by subtracting the coordinate value of the vertex position of the second white display area farthest from the first white display area from the horizontal or vertical coordinate of the coordinate value of the light sensing center position under the screen.

[0085] Step S43: The other areas of the position area with light leakage in the screen except the first position area and the second position area are taken as the third position area.

[0086] In the embodiment of the present disclosure, a third position area is obtained based on the position area where light leakage exists in the screen, the determined first position area, and the determined second position area. Specifically, the third position area is an area obtained by subtracting the first position area from the position area where light leakage exists in the screen and then subtracting the second position area.

[0087] In the embodiment of the present disclosure, the third position area is other areas of the position area where light leakage exists in the screen except the first position area and the second position area.

[0088] Step S44: The first position area, the second position area, and the third position area are used as a plurality of position areas divided according to the channel values ​​of the under-screen light sensing detection.

[0089] For ease of understanding, the method of dividing the position area where light leakage exists in the screen into a plurality of position areas is described below by way of example.

[0090] Figure 5 is an example diagram showing a method for dividing a position area with light leakage in a screen into a plurality of position areas according to an exemplary embodiment. Figure 5As shown, the position area where light leakage exists in the screen is divided into three position areas.

[0091] In one implementation, a first position area is determined. Square A is the first white display area centered on the under-screen light sensor a. Set the size of square A to 5*5. Set the coordinates of the under-screen light sensor a to (x, y). Move square A toward the upper left corner with a as the starting point (decrease the coordinate values ​​of all pixels of square A by 5 each time) until the under-screen light sensor cannot detect the brightness value of square A. That is, the channel value detected by the under-screen light sensor is less than or equal to 0. The moved square A at this time is recorded as square A'. And b is recorded as the vertex position of the upper left corner of square A', and the coordinate position of b is recorded (x1, y1). At this time, the distance from the coordinate position of a to the coordinate position of b is the first coordinate distance. That is, the first coordinate distance is the distance length represented by the absolute value of the difference between x and x1. Further, the first position area can be determined based on the first coordinate distance. Among them, the length of the square display area representing the first position area is twice the length of the first coordinate distance.

[0092] In one implementation, the second position area is determined based on the determined first position area. Square B is a second white display area larger than the first white display area centered at the vertex position b of the above-mentioned square A'. Set the size of square B to 10*10. The coordinates of the vertex position b are known to be (x1, y1), and the vertex position b is set as the starting point for the movement of the second white display area. Similarly, based on the moving steps similar to square A, move square B (where the coordinates of all pixel points of square B decrease by 10 each time) to obtain square B'. Record the coordinate position (x2, y2) of the vertex position c of square B' at this time. At this time, the distance from the coordinate position of c to the coordinate position of a is the second coordinate distance. That is, the second coordinate is the distance length represented by the absolute value of the difference between x and x2. Further, the second position area can be determined based on the second coordinate distance. Among them, the square display area with a length twice the length of the second coordinate distance excluding the first position area is the second position area.

[0093] In one implementation, a third position area is determined based on the first position area and the second position area determined above. The third position area is the other area of ​​the position area where light leakage exists in the screen except the first position area and the second position area. It should be noted that the embodiment of the present disclosure does not limit the division of the position area where light leakage exists in the screen into multiple position areas, wherein the third position area may include multiple sub-position areas.

[0094] The present disclosure provides a method for dividing the position area where light leakage exists in the screen into multiple position areas, and determines the edge values ​​of different position areas by the channel value range of white display areas of different sizes read by the light sensor under the screen. Then, the position area where light leakage exists in the screen is divided into multiple position areas. Based on this method, the edge value of each position area can be accurately obtained, so as to perform better division.

[0095] In the embodiment of the present disclosure, in the above light leakage compensation method, the first channel value is compensated based on the channel value to obtain the second channel value. The channel compensation value is accumulated based on the first channel cumulative value to obtain the third channel value. Then, the second channel value is determined based on the ratio of the channel weighted value after the weighted sum of the third channel value and the channel weighted value of the cumulative value of the used impact factor of multiple position areas.

[0096] Figure 6 is a flow chart showing a method for compensating a first channel value based on a channel compensation value according to an exemplary embodiment. Figure 6 As shown, the method comprises the following steps:

[0097] Step S61, determining a first channel cumulative value of each location area in a plurality of location areas.

[0098] In the disclosed embodiment, the location area where light leakage exists in the screen in the display content of the screen is traversed, the distance from the coordinate position of each pixel point in each location point of the display content of the screen to the coordinate position of the light sensing center under the screen is obtained, the location area of ​​each location point is determined, and the first channel value of each location point is read, and the first channel values ​​are accumulated to determine the first channel cumulative value.

[0099] Step S62: determining the accumulated value of the used impact factor of each location area in the plurality of location areas.

[0100] In the implementation of the present disclosure, the impact factors used in the above process are recorded and accumulated to obtain the cumulative value of the used impact factors.

[0101] Step S63, adding the first channel accumulated value to the channel compensation value to obtain a third channel value.

[0102] Step S64, performing weighted summation on the third channel values ​​of the multiple location areas to obtain a channel weighted value, and performing weighted summation on the accumulated values ​​of the used impact factors of the multiple location areas to obtain an impact factor weighted value;

[0103] Step S65: taking the channel value corresponding to the ratio between the channel weighted value and the impact factor weighted value as the second channel value.

[0104] For ease of understanding, the following example illustrates the method of compensating the first channel value based on the channel compensation value. In the specific implementation process, rgbArray is defined to store the channel data of the acquired screen display content. Define r1, r2, r3, b1, b2, b3, g1, g2, g3 to represent the r, g, and b values ​​corresponding to each position point in the first position area, the second position area, and the third position area, respectively. Define 9 variables R1, G1, B1, R2, G2, B2, R3, G3, B3 to represent the R, G, and B values ​​of the first position area, the second area, and the third position area, respectively. Define 3 variables wCnt1, wCnt2, and wCnt3 to store the cumulative sum of the influence factors used in the first position area, the second position area, and the third position area, respectively. It is known that the innerPara array, the middlePara array, and the maxPara array store the influence factors corresponding to the first position area, the second position area, and the third position area, respectively. Define rWeight, gWeight, and bWeight as RGB values ​​representing the screen display content after light leakage compensation.

[0105] In one implementation, if the position point of the screen display content is located in the first position area. Use the R, G, B values ​​of the corresponding position point in the rgbArray array to multiply the corresponding influence factor cnt1 in the innerPara array (the values ​​recorded in the innerPara array are the influence factors corresponding to each position point in the first position area) to obtain a set of data r1, g1, b1. And execute the formula R1=R1+r1, G1=G1+g1, B1=B1+b1, wCnt1=wCnt1+cnt1 to obtain the cumulative value of the first channel value and the cumulative value of the influence factor in the first position area.

[0106] In one implementation, if the position point of the screen display content is located in the second position area. Use the R, G, B values ​​of the corresponding position point in the rgbArray array to multiply the corresponding influence factor cnt2 in the middlePara array (the values ​​recorded in the middlePara array are the influence factors corresponding to each position point in the second position area) and then divide by 4 to obtain a set of data r2, g2, b2. And execute the formula R2=R2+r2, G2=G2+g2, B2=B2+b2, wCnt2=wCnt2+cnt2 to obtain the cumulative value of the first channel value and the cumulative value of the influence factor in the first position area.

[0107] In one implementation, if the position point of the screen display content is located in the third position area. Use the R, G, B values ​​of the corresponding position point in the rgbArray array to multiply the corresponding influence factor cnt3 in the maxPara array (the value recorded in the maxPara array is the influence factor corresponding to each position point in the third position area) and then divide it by 36 to obtain a set of data r3, g3, b3. And execute the formula R3=R3+r3, G3=G3+g3, B3=B3+b3, wCnt3=wCnt3+cnt3 the cumulative value of the first channel value of the third position area and the cumulative value of the influence factor.

[0108] Based on the data values ​​determined above, execute the formula

[0109] rWeight=(R1+R2+R3) / (wCnt1+wCnt2+wCnt3), gWeight=(G1+G2+G3) / (wCnt1+wCnt2+wCnt3), bWeight=(B1+B2+B3) / (wCnt1+wCnt2+wCnt3).

[0110] The obtained RGB values ​​representing the current content displayed on the screen are: rWeight, gWeight, bWeight, that is, the second channel value after channel compensation based on the first channel value is obtained.

[0111] The method for compensating the first channel value based on the channel compensation value provided by the present disclosure obtains the second channel value by executing the corresponding calculation formula through the determined first channel cumulative value and the used impact factor cumulative value, thereby accurately realizing the channel compensation of the first channel value.

[0112] In the application process, the present disclosure provides a method for determining a model training data set. Based on the set screen display content, the position area where light leakage exists in the screen is obtained, and the position area is further divided to obtain the influence factor of each position area. The first data set is parsed into a second data set according to the light leakage compensation method using the above-obtained influence factor. The data set for model training is determined according to the above-mentioned parsing process. The process is further described below.

[0113] Figure 7 is a flowchart of a method for determining a model training data set according to an exemplary embodiment. Figure 7 As shown, the method comprises the following steps:

[0114] Step S71, obtaining the location area where light leakage exists in the screen.

[0115] In the embodiment of the present disclosure, the location area where light leakage exists in the screen is the area of ​​the screen that affects the light perception.

[0116] In the disclosed embodiment, the brightness of the screen needs to be adjusted to the maximum brightness first. And the screen is controlled to display the first black display area. The first black display area is a square display area centered on the center position of the light sensor under the screen. The first black display area is gradually expanded with a set step size. And the channel value detected by the light sensor under the screen is read until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, and the area after the expansion of the first black display area is determined. The expanded area is used as the location area where light leakage exists in the screen.

[0117] The following is an example with diagrams. Figure 8 As shown, set the screen display content to Figure 8 The left picture in the figure shows the display content. Among them, the black square D is the first black color display area centered on the light sensor under the screen. The size of the square D is gradually expanded and the range of the position area where the light leakage exists in the screen is determined according to the channel value detected by the current light sensor under the screen. Figure 8 As shown in the right figure in , square D is expanded to square D1 for the first time, and the channel value detected by the light sensor under the screen after square D is expanded to square D1 is read to determine whether the channel value detected by the light sensor under the screen at this time is less than or equal to 0. If the channel value is less than or equal to 0, the length of square D1 at this time is used as the length of the position area where there is light leakage in the screen. If the channel value is not less than or equal to 0, continue to expand square D1 to square D2. Similarly, read the channel value detected by the light sensor under the screen after expansion and re-judge. If the length of the position area where there is light leakage in the screen is still uncertain, continue to expand square D2 until the channel value detected by the light sensor under the screen is less than or equal to 0. The length of the enlarged square at this time is used as the length of the position area where there is light leakage in the screen, thereby determining the position area where there is light leakage in the screen.

[0118] Step S72: dividing the position area where light leakage exists in the screen into a plurality of position areas.

[0119] Step S73: Obtain the impact factor corresponding to each location area.

[0120] Step S74, obtaining the first channel value of the first data set, and obtaining the second data set based on the impact factor.

[0121] In the disclosed embodiment, the first data set is a pre-generated pure color image data set, and the data obtained through the first data set are the first channel values ​​of all the first data sets and the channel values ​​detected by the light sensor under the screen. The second data set is a data set obtained by parsing the first data set, and the data obtained through the second data set are the second channel values ​​of all the second data sets and the channel values ​​detected by the light sensor under the screen.

[0122] Step S75: Use the second data set as a data set for model training.

[0123] In the disclosed embodiment, data of the second data set is input and a model is trained using a fully connected neural network.

[0124] In the embodiment of the present disclosure, a set of second channel values ​​of screen display content is input, and the model trained based on the second data set can accurately predict the light leakage value of the current screen display content.

[0125] Furthermore, the following is an example of a method for determining a model training data set.

[0126] In one embodiment, the location area where light leakage exists in the screen is obtained by the following specific implementation method. Adjust the brightness of the mobile phone to the maximum brightness, refer to Figure 8 The left picture sets the display content of the mobile phone to: the screen background is pure white, and the small square background is pure black. The small square is centered on the light sensor under the screen. Use the command to read the channel value of the light sensor under the screen, and continuously expand the size of the black square until the channel value reported by the light sensor is close to 0 (that is, the light sensor cannot detect the brightness value, and the color represented by the channel value appears black). The length of the current black square is recorded as Length. That is, determine the area of ​​the screen that affects the light sensor (the location area where there is light leakage in the screen).

[0127] In one embodiment, the position area where light leakage exists in the screen is divided into multiple position areas by the following specific implementation method. Reset the display content of the mobile phone. Set the display content of the mobile phone to: the screen background is pure black, and the small square background is pure white. According to the Length of the area of ​​the screen that affects the light perception obtained above, it is further divided into the following Fig. 9 The three areas shown. A 5*5 white square is used here, starting from the center of the light sensor and moving toward the upper left corner (the coordinates of all the pixels in the white square are subtracted by 5 each time). Use instructions to read the channel value of the light sensor under the screen until the channel value reported by the light sensor is close to 0. At this time, the distance from the coordinates of the pixel point in the upper left corner of the 5*5 white square to the coordinates of the center of the light sensor is multiplied by 2 as the length of the inner area, recorded as len1. Further, starting from the upper left corner of the inner area determined above, a 10*10 white square is used to move toward the upper left corner in sequence (the coordinates of all the pixels in the white square are subtracted by 10 each time). Repeat the above steps to determine the inner area and determine the length of the middle area, recorded as len2. The length of the outer area is Length-len1-len2, recorded as len3.

[0128] In one embodiment, the impact factor corresponding to each position area is obtained by the following specific implementation method. Similarly, the background of the mobile phone is set to pure black. Use 5*5, 10*10, and 30*30 pure white small squares to scan the entire inner area, the middle area, and the outer area, and store the C channel data reported by the light sense of each position in each area in the arrays innerChannelData, middleChannelData, and maxChannelData. Among them, a variable MaxC is maintained to record the maximum value of the C channel data in all positions in the inner area. Traverse the three arrays obtained above, divide each element by MaxC, and store the data obtained in each array in the new arrays innerPara, middlePara, and maxPara. Among them, the data recorded in the innerPara, middlePara, and maxPara arrays are the impact factors corresponding to each position area.

[0129] In one embodiment, the first data set is parsed into the second data set by the following specific implementation method. Set the mobile phone screen to display any set of screen display content, and parse any set of screen display content displayed by the mobile phone into a set of RGB values ​​according to the above-mentioned influence factors. For details, please refer to the process of the above-mentioned method of compensating the first channel value based on the channel compensation value: the screenshot algorithm will store all the current display content in an array rgbArray. Maintain 9 variables R1, G1, B1, R2, G2, B2, R3, G3, B3 to store the R, G, and B values ​​of the inner area, the middle area, and the outer area respectively. Maintain 3 variables wCnt1, wCnt2, and wCnt3 to store the cumulative sum of the influence factors used in the inner area, the middle area, and the outer area respectively. Traverse the entire area that affects the light perception from the upper left corner of the area where the screen affects the light perception obtained above. Calculate the distance from the coordinates of each element to the center position of the light perception, and determine which area the element is located in based on this distance. If the element is located in the peripheral area, use the R, G, B values ​​of the corresponding element in rgbArray multiplied by the corresponding element cnt3 in the maxPara array and then divided by 36 to get a set of data r3, g3, b3, and execute the formula R3=R3+r3, G3=G3+g3, B3=B3+b3, wCnt3=wCnt3+cnt3 / 36. If the element is located in the middle area, use the R, G, B values ​​of the corresponding element in rgbArray multiplied by the corresponding element cnt2 in the middlePara array and then divided by 4 to get a set of data r2, g2, b2. Execute the formula R2=R2+r2, G2=G2+g2, B2=B2+b2, wCnt2=wCnt2+cnt2 / 4. If the element is located in the inner area, use the R, G, B values ​​of the element at the corresponding position in rgbArray multiplied by the corresponding element cnt1 in the innerPara array to get a set of data r1, g1, b1. Execute the formula R1=R1+r1, G1=G1+g1, B1=B1+b1, wCnt1=wCnt1+cnt1. Execute the formula rWeight=(R1+R2+R3) / (wCnt1+wCnt2+wCnt3), gWeight=(G1+G2+G3) / (wCnt1+wCnt2+

[0130] wCnt3), bWeight = (B1 + B2 + B3) / (wCnt1 + wCnt2 + wCnt3), and the obtained R, G, B values ​​representing the current display content of the screen are: rWeight, gWeight, bWeight.

[0131] In one embodiment, the second data set is used as a data set for model training through the following specific implementation method. Use 12,000 pre-generated pure color images as a data set (first data set). Place the mobile phone in a black box, in a dark environment, set the backlight value of the mobile phone screen from 10dbv to 2047dbv, and read the 12,000 pre-generated pure color images in turn. The RGB value of the displayed content and the channel value reported by the current light perception under the screen are parsed by the above method. Use the above collected data (second data set) as input to train a model using a fully connected neural network. Furthermore, in the subsequent application process, the current backlight value and the RGB value of the displayed content of the non-pure color image parsed by the above method are input. Then, the model trained by the pure color image can better predict the non-pure color image and predict the current light leakage value accuracy of the non-pure color image.

[0132] The method for determining the model training data set provided by the present disclosure obtains the parameters that need to be determined before analysis: the influencing factor of the screen. The RGB value data of the display content and the different backlight value data obtained by the above-mentioned analysis method based on the pre-generated data set are used as input to train a light leakage detection model. The light leakage detection model can predict the light leakage of the current screen based on the current backlight value of the screen display content and the RGB value of the display content obtained by executing the above-mentioned analysis method. Furthermore, the light leakage detection model has a good prediction effect on scenes with complex screen display content (such as non-pure color images), which improves the situation where the light leakage detection model trained by the pure color image data set has poor prediction effect on non-pure color images. Thereby achieving a more accurate light leakage compensation effect on the current screen and improving the user experience.

[0133] Based on the same concept, an embodiment of the present disclosure also provides a light leakage compensation device.

[0134] It is understandable that the light leakage compensation device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and algorithm steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0135] Fig.10 is a block diagram of a light leakage compensation device according to an exemplary embodiment. Fig.10 , the device includes a receiving unit 101 and a processing unit 102.

[0136] The receiving unit 101 is used to obtain a channel value corresponding to a pixel point in the screen display content to obtain a first channel value.

[0137] The processing unit 102 is used to determine the distance between the coordinate position of the pixel point and the center position of the light sensitivity under the screen, and determine the influence factor corresponding to the distance based on the distance, the influence factor is used to characterize the degree of light leakage generated by the screen at the screen position corresponding to the distance; and to determine the channel compensation value of the first channel value based on the influence factor, and compensate the first channel value based on the channel compensation value to obtain a second channel value; and use the second channel value as the channel value of the display content for light leakage compensation.

[0138] In one embodiment, the processing unit 102 determines the influence factor based on the distance in the following manner: determine the current position area to which the pixel point coordinate position belongs based on the distance; determine the influence factor corresponding to the current position area based on the correspondence between the position area and the influence factor; and use the influence factor of the current position area as the influence factor corresponding to the distance.

[0139] In one embodiment, the processing unit 102 determines the correspondence between the position area and the influence factor in the following manner: based on the center position of the under-screen light sensor at the screen, the position area where light leakage exists in the screen is divided into multiple position areas according to the channel value detected by the under-screen light sensor; the channel value detected by each position point in each position area of ​​the multiple position areas by the under-screen light sensor is obtained to obtain a channel value set corresponding to each position area, and the position point corresponds to a square display area of ​​a set size in the position area; for each position area in the multiple position areas, the influence factor corresponding to each position point in the position area is determined, the influence factor being the ratio between the channel value at the position point and the maximum channel value in the channel value set, and the correspondence between each position point in the position area and the influence factor is determined as the correspondence between the position area and the influence factor.

[0140] In one embodiment, the processing unit 102 divides the position area where light leakage exists in the screen into multiple position areas according to the channel value detected by the under-screen light sensor based on the center position of the under-screen light sensor at the center of the screen: determining the position area where light leakage exists in the screen based on the under-screen light sensor at the center of the screen; controlling the screen to display a first white display area, the first white display area is a first square display area centered on the center position of the under-screen light sensor, and moving the first white display area along the diagonal direction of the first square display area with the center position as the starting point, and reading the channel value detected by the under-screen light sensor until the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, determining a first coordinate distance between the vertex position and the center position of the first square display area, and determining the first position area based on the first coordinate distance, the vertex position of the first square display area is the vertex position of the first square display area away from the center position in the moving direction when the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, and the first position area is a square display area centered on the center position; controlling the screen to display a second white display area, the second white display area is centered on the vertex position of the first square display area a second square display area, the length of the second square display area is greater than the length of the first square display area, and the second white display area is moved along the diagonal direction of the second square display area with the vertex position of the first square display area as the starting point, and the channel value detected by the light sensor under the screen is read until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, and the second coordinate distance between the vertex position and the center position of the second square display area is determined, and the second position area is determined based on the second coordinate distance, the vertex position of the second square display area is the vertex position of the second square display area away from the vertex position of the first square display area in the moving direction when the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, the second position area is other position areas except the first position area in the square display area centered on the center position, and the vertex position of the second square display area is used as the vertex position of the first square display area; other areas except the first position area and the second position area in the position area with light leakage in the screen are used as the third position area; the first position area, the second position area and the third position area are used as multiple position areas divided according to the channel value detected by the light sensor under the screen.

[0141] In one embodiment, the processing unit 102 determines the channel compensation value of the first channel value based on the influencing factor in the following manner: multiplying the product with the influencing factor, and determining the number of position points included in the area of ​​the current position area, where the position point is a square display area with a set size; and determining the ratio between the product and the number of position points as the channel compensation value of the first channel value.

[0142] In one embodiment, the processing unit 102 compensates the first channel value based on the channel compensation value to obtain the second channel value in the following manner: determine the first channel cumulative value of each position area in a plurality of position areas, the first channel cumulative value is the cumulative sum of all first channel values ​​included in the position area; determine the used impact factor cumulative value of each position area in a plurality of position areas, the used impact factor cumulative value is the cumulative sum of the impact factors called by the pixel mapping of the screen display content in the position area; add the first channel cumulative value to the channel compensation value to obtain a third channel value; perform weighted summation on the third channel values ​​of the plurality of position areas to obtain a channel weighted value, and perform weighted summation on the used impact factor cumulative values ​​of the plurality of position areas to obtain an impact factor weighted value; use the channel value corresponding to the ratio between the channel weighted value and the impact factor weighted value as the second channel value.

[0143] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0144] Fig.11 2 is a block diagram of a device 200 for a light leakage compensation method according to an exemplary embodiment. For example, the device 200 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0145] Reference Fig.11 , the device 200 may include one or more of the following components: a processing component 202 , a memory 204 , a power component 206 , a multimedia component 208 , an audio component 210 , an input / output (I / O) interface 212 , a sensor component 214 , and a communication component 216 .

[0146] The processing component 202 generally controls the overall operation of the device 200, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 202 may include one or more processors 220 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 202 may include one or more modules to facilitate interaction between the processing component 202 and other components. For example, the processing component 202 may include a multimedia module to facilitate interaction between the multimedia component 208 and the processing component 202.

[0147] The memory 204 is configured to store various types of data to support operations on the device 200. Examples of such data include instructions for any application or method operating on the device 200, contact data, phone book data, messages, pictures, videos, etc. The memory 204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0148] The power component 206 provides power to the various components of the device 200. The power component 206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 200.

[0149] The multimedia component 208 includes a screen that provides an output interface between the device 200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 208 includes a front camera and / or a rear camera. When the device 200 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0150] The audio component 210 is configured to output and / or input audio signals. For example, the audio component 210 includes a microphone (MIC), and when the device 200 is in an operation mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 204 or sent via the communication component 216. In some embodiments, the audio component 210 also includes a speaker for outputting audio signals.

[0151] I / O interface 212 provides an interface between processing component 202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0152] The sensor assembly 214 includes one or more sensors for providing various aspects of the status assessment of the device 200. For example, the sensor assembly 214 can detect the open / closed state of the device 200, the relative positioning of components, such as the display and keypad of the device 200, the sensor assembly 214 can also detect the position change of the device 200 or a component of the device 200, the presence or absence of user contact with the device 200, the orientation or acceleration / deceleration of the device 200 and the temperature change of the device 200. The sensor assembly 214 can include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 214 can also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 214 can also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.

[0153] The communication component 216 is configured to facilitate wired or wireless communication between the device 200 and other devices. The device 200 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 216 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 216 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0154] In an exemplary embodiment, the apparatus 200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0155] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 204 including instructions, and the instructions can be executed by the processor 220 of the device 200 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0156] Fig.12 is a block diagram of a device 300 for a light leakage compensation method according to an exemplary embodiment. For example, the device 300 may be provided as a server. Fig.12, the apparatus 300 includes a processing component 322, which further includes one or more processors, and a memory resource represented by a memory 332 for storing instructions, such as an application, that can be executed by the processing component 322. The application stored in the memory 332 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 322 is configured to execute the instructions to perform the above method.

[0157] The device 300 may also include a power supply component 326 configured to perform power management of the device 300, a wired or wireless network interface 350 configured to connect the device 300 to a network, and an input / output (I / O) interface 358. The device 300 may operate based on an operating system stored in the memory 332, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0158] It is to be understood that in the present disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include plural forms, unless the context clearly indicates other meanings.

[0159] It is further understood that the terms "first", "second", etc. are used to describe various information, but such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other, and do not indicate a specific order or degree of importance. In fact, the expressions "first", "second", etc. can be used interchangeably. For example, without departing from the scope of the present disclosure, the first information can also be referred to as the second information, and similarly, the second information can also be referred to as the first information.

[0160] It will be further understood that the terms “center”, “longitudinal”, “lateral”, “front”, “back”, “up”, “down”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present embodiment and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation.

[0161] It can be further understood that, unless otherwise specified, “connection” includes a direct connection without other components between the two, and also includes an indirect connection with other components between the two.

[0162] It is further understood that, although the operations are described in a specific order in the drawings in the embodiments of the present disclosure, it should not be understood as requiring the operations to be performed in the specific order shown or in a serial order, or requiring the execution of all the operations shown to obtain the desired results. In certain environments, multitasking and parallel processing may be advantageous.

[0163] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure.

[0164] It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the scope of the appended claims.

Claims

1. A light leakage compensation method, characterized in that: include: Obtain the channel value corresponding to the pixel point in the screen display content to obtain the first channel value; Determine the distance between the pixel point coordinate position and the center position of the light sensing under the screen of the screen, and determine the influence factor corresponding to the distance based on the distance, wherein the influence factor is used to characterize the degree of light leakage generated by the screen at the screen position corresponding to the distance; Determine a channel compensation value of the first channel value based on the influencing factor, and compensate the first channel value based on the channel compensation value to obtain a second channel value; The second channel value is used as the channel value of the display content for light leakage compensation.

2. The method according to claim 1, characterized in that The determining of the impact factor based on the distance includes: Determine the current position area to which the pixel point coordinate position belongs based on the distance; Determine the impact factor corresponding to the current location area based on the corresponding relationship between the location area and the impact factor; The influence factor of the current location area is used as the influence factor corresponding to the distance.

3. The method according to claim 2, characterized in that The corresponding relationship between the location area and the impact factor is determined in the following way: Based on the center position of the under-screen light sensor of the screen, a position area where light leakage exists in the screen is divided into a plurality of position areas according to a channel value of the under-screen light sensor detection; Acquire the channel value detected by the under-screen light sensor at each position point in each of the multiple position areas to obtain a channel value set corresponding to each position area, wherein the position point corresponds to a square display area of ​​a set size in the position area; For each location area among the multiple location areas, determine the impact factor corresponding to each location point in the location area, the impact factor is the ratio of the channel value at the location point to the maximum channel value in the channel value set, and the correspondence between each location point in the location area and the impact factor is determined as the correspondence between the location area and the impact factor.

4. The method according to claim 3, characterized in that The method divides the position area where light leakage exists in the screen into a plurality of position areas according to the channel value of the under-screen light sensing detection based on the under-screen light sensing at the center position of the screen, including: Determine a location area where light leakage exists in the screen based on the under-screen light sense at the center of the screen; Control the screen to display a first white display area, the first white display area is a first square display area centered at the center position of the light sensor under the screen, and move the first white display area along the diagonal direction of the first square display area with the center position as the starting point, and read the channel value detected by the light sensor under the screen until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, determine the first coordinate distance between the vertex position of the first square display area and the center position, and determine the first position area based on the first coordinate distance, the vertex position of the first square display area is the vertex position of the first square display area away from the center position in the moving direction when the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, and the first position area is a square display area centered at the center position; Controlling the screen to display a second white display area, wherein the second white display area is a second square display area centered on the vertex position of the first square display area, the length of the second square display area is greater than the length of the first square display area, and the second white display area is moved along the diagonal direction of the second square display area with the vertex position of the first square display area as the starting point, and reading the channel value detected by the under-screen light sensor until the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, determining a second coordinate distance between the vertex position of the second square display area and the center position, and determining a second position area based on the second coordinate distance, wherein the vertex position of the second square display area is the vertex position of the second square display area away from the vertex position of the first square display area in the moving direction when the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, and the second position area is other position areas in the square display area centered on the center position except the first position area, and the vertex position of the second square display area is used as the vertex position of the first square display area; Using other areas of the screen where light leakage exists except the first location area and the second location area as third location areas; The first position area, the second position area and the third position area are used as a plurality of position areas divided according to the channel value of the under-screen light sensing detection.

5. The method according to any one of claims 3 to 4, characterized in that Determining a channel compensation value of the first channel value based on the influencing factor includes: and the product of the influence factor, and determining the number of location points included in the area of ​​the current location area, wherein the location point is a square display area with a set size; The ratio between the product and the number of position points is determined as the channel compensation value of the first channel value.

6. The method according to claim 5, characterized in that The compensating the first channel value based on the channel compensation value to obtain a second channel value includes: Determine the first channel cumulative value of each of the plurality of location areas respectively, the first channel cumulative value being the cumulative sum of all first channel values ​​included in the location area; Determine respectively a cumulative value of used impact factors of each of the plurality of position areas, wherein the cumulative value of used impact factors is a cumulative sum of impact factors called by pixel mapping of screen display content in the position area; Add the channel compensation value to the first channel accumulated value to obtain a third channel value; Performing weighted summation on the third channel values ​​of the multiple location areas to obtain a channel weighted value, and performing weighted summation on the accumulated values ​​of the used impact factors of the multiple location areas to obtain an impact factor weighted value; A channel value corresponding to the ratio between the channel weighted value and the impact factor weighted value is used as the second channel value.

7. A light leakage compensation device, characterized in that: include: A receiving unit, used to obtain a channel value corresponding to a pixel point in the screen display content to obtain a first channel value; a processing unit, configured to determine a distance between the coordinate position of the pixel point and a center position of the light sensing under the screen of the screen, and determine an influence factor corresponding to the distance based on the distance, wherein the influence factor is used to characterize a degree of light leakage generated by the screen at a screen position corresponding to the distance; and for determining a channel compensation value of the first channel value based on the influencing factor, and compensating the first channel value based on the channel compensation value to obtain a second channel value; The second channel value is used as the channel value of the display content for light leakage compensation.

8. The light leakage compensation device according to claim 7, characterized in that: The processing unit determines the impact factor based on the distance in the following manner: Determine the current position area to which the pixel point coordinate position belongs based on the distance; Determine the impact factor corresponding to the current location area based on the corresponding relationship between the location area and the impact factor; The influence factor of the current location area is used as the influence factor corresponding to the distance.

9. The light leakage compensation device according to claim 8, characterized in that: The processing unit determines the corresponding relationship between the location area and the impact factor in the following manner: Based on the center position of the under-screen light sensor of the screen, a position area where light leakage exists in the screen is divided into a plurality of position areas according to a channel value of the under-screen light sensor detection; Acquire the channel value detected by the under-screen light sensor at each position point in each of the multiple position areas to obtain a channel value set corresponding to each position area, wherein the position point corresponds to a square display area of ​​a set size in the position area; For each location area among the multiple location areas, determine the impact factor corresponding to each location point in the location area, the impact factor is the ratio of the channel value at the location point to the maximum channel value in the channel value set, and the correspondence between each location point in the location area and the impact factor is determined as the correspondence between the location area and the impact factor.

10. The light leakage compensation device according to claim 9, characterized in that: The processing unit divides the position area where light leakage exists in the screen into a plurality of position areas according to the channel value of the under-screen light sensing detection based on the under-screen light sensing at the center of the screen in the following manner: Determine a location area where light leakage exists in the screen based on the under-screen light sense at the center of the screen; Control the screen to display a first white display area, the first white display area is a first square display area centered at the center position of the light sensor under the screen, and move the first white display area along the diagonal direction of the first square display area with the center position as the starting point, and read the channel value detected by the light sensor under the screen until the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, determine the first coordinate distance between the vertex position of the first square display area and the center position, and determine the first position area based on the first coordinate distance, the vertex position of the first square display area is the vertex position of the first square display area away from the center position in the moving direction when the channel value detected by the light sensor under the screen is less than or equal to the channel threshold, and the first position area is a square display area centered at the center position; Controlling the screen to display a second white display area, wherein the second white display area is a second square display area centered on the vertex position of the first square display area, the length of the second square display area is greater than the length of the first square display area, and the second white display area is moved along the diagonal direction of the second square display area with the vertex position of the first square display area as the starting point, and reading the channel value detected by the under-screen light sensor until the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, determining a second coordinate distance between the vertex position of the second square display area and the center position, and determining a second position area based on the second coordinate distance, wherein the vertex position of the second square display area is the vertex position of the second square display area away from the vertex position of the first square display area in the moving direction when the channel value detected by the under-screen light sensor is less than or equal to the channel threshold, and the second position area is other position areas in the square display area centered on the center position except the first position area, and the vertex position of the second square display area is used as the vertex position of the first square display area; Using other areas of the screen where light leakage exists except the first location area and the second location area as third location areas; The first position area, the second position area and the third position area are used as a plurality of position areas divided according to the channel value of the under-screen light sensing detection.

11. The light leakage compensation device according to any one of claims 9 to 10, characterized in that: The processing unit determines the channel compensation value of the first channel value based on the influencing factor in the following manner: and the product of the influence factor, and determining the number of location points included in the area of ​​the current location area, wherein the location point is a square display area with a set size; The ratio between the product and the number of position points is determined as the channel compensation value of the first channel value.

12. The light leakage compensation device according to claim 11, characterized in that: The processing unit compensates the first channel value based on the channel compensation value to obtain a second channel value in the following manner: Determine the first channel cumulative value of each of the plurality of location areas respectively, the first channel cumulative value being the cumulative sum of all first channel values ​​included in the location area; Determine respectively a cumulative value of used impact factors of each of the plurality of position areas, wherein the cumulative value of used impact factors is a cumulative sum of impact factors called by pixel mapping of screen display content in the position area; Add the channel compensation value to the first channel accumulated value to obtain a third channel value; Performing weighted summation on the third channel values ​​of the multiple location areas to obtain a channel weighted value, and performing weighted summation on the accumulated values ​​of the used impact factors of the multiple location areas to obtain an impact factor weighted value; A channel value corresponding to the ratio between the channel weighted value and the impact factor weighted value is used as the second channel value.

13. A light leakage compensation device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: perform the light leakage compensation as described in any one of claims 1 to 6.

14. A storage medium, characterized in that: The storage medium stores instructions, and when the instructions in the storage medium are executed by a processor of the terminal, the terminal is enabled to execute the method according to any one of claims 1 to 6.

Images