Screen lamp bead coefficient compensation method and device, electronic equipment and storage medium

Abstract

The invention relates to a screen lamp bead coefficient compensation method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a first image containing a first screen, a second image, and a first mapping relation between the row and column positions of lamp beads in the first screen and the coordinates of the lamp beads in the second image, the first image and the second image are images obtained by performing image acquisition on a first screen twice; determining a first coordinate of a lamp bead to be subjected to parameter adjustment in the first image; and determining the row and column positions of the lamp beads to be subjected to parameter adjustment based on the first coordinates and the first mapping relationship under the condition that the spatial relationships between the camera and the first screen are the same in the two times of acquisition, so as to perform coefficient compensation on the lamp beads to be subjected to parameter adjustment. Therefore, the row and column positions of the lamp beads to be subjected to parameter adjustment can be accurately and quickly determined.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a screen lamp coefficient compensation method and device, electronic equipment and storage medium. Background Art

[0002] As the main carrier of information presentation, the display effect of the screen directly affects the user experience. However, due to the influence of various factors such as the usage environment and usage time, the lamp beads in the screen often wear out to varying degrees, resulting in color distortion. This color deviation not only affects the user's visual experience, but may also mislead the communication of information.

[0003] Lamp bead coefficient compensation refers to adjusting the brightness, chromaticity and other parameters of the lamp beads to compensate for performance deviations caused by aging or other factors during use, thereby ensuring consistency and stability of the screen display effect.

[0004] As the screen is used for a longer time, it is necessary to compensate the lamp beads for a certain period of time to ensure the display effect. However, the steps of each coefficient compensation are cumbersome, time-consuming and inefficient. Summary of the invention

[0005] In view of this, the present disclosure proposes a screen lamp coefficient compensation solution.

[0006] According to one aspect of the present disclosure, a method for compensating screen lamp bead coefficients is provided, the method comprising: obtaining a first image and a second image including a first screen, and a first mapping relationship between the row and column positions of the lamp beads in the first screen and the coordinates of the lamp beads in the second image, the first image and the second image being images obtained by respectively capturing the first screen twice; determining the first coordinates of the lamp beads to be adjusted in the first image; and determining the row and column positions of the lamp beads to be adjusted based on the first coordinates and the first mapping relationship when the spatial relationship between the camera and the first screen is the same in the two captures, so as to perform coefficient compensation on the lamp beads to be adjusted.

[0007] In a possible implementation, the method also includes: when the spatial relationship between the camera and the first screen is different in the two acquisitions, determining the transformation matrix between the first image and the second image; based on the first coordinates and the transformation matrix, determining the second coordinates of the lamp bead to be adjusted in the second image; based on the second coordinates and the first mapping relationship, determining the row and column positions of the lamp bead to be adjusted to adjust the parameters of the lamp bead to be adjusted.

[0008] In one possible implementation, determining the transformation matrix between the first image and the second image includes: obtaining the third coordinate of the positioning lamp bead in the first image, and the row and column positions of the positioning lamp bead are known; based on the row and column positions of the positioning lamp bead and the first mapping relationship, determining the fourth coordinate of the positioning lamp bead in the second image; and determining the transformation matrix according to the third coordinate and the fourth coordinate.

[0009] In a possible implementation, the row and column positions of the lamp beads to be adjusted are determined based on the second coordinates and the first mapping relationship, including: obtaining coordinate adjustment parameters; using the coordinate adjustment parameters to adjust the second coordinates to obtain precise second coordinates; determining the target coordinates with the shortest first distance to the precise second coordinates from the first mapping relationship; and using the row and column positions corresponding to the target coordinates in the first mapping relationship as the row and column positions of the lamp beads to be adjusted.

[0010] In one possible implementation, the coordinate adjustment parameters include: the lamp bead coordinates of each lamp bead in the second image, and using the coordinate adjustment parameters to adjust the second coordinates to obtain precise second coordinates, including: determining the lamp bead coordinates with the shortest second distance to the second coordinates, and using the lamp bead coordinates as the precise second coordinates.

[0011] In a possible implementation, the coordinate adjustment parameters include: a preset plurality of directions, a preset radius, and the use of the coordinate adjustment parameters to adjust the second coordinate to obtain an accurate second coordinate includes: on the second image, taking the position indicated by the second coordinate as a base point, and taking a point in each direction whose distance from the base point is the radius as the center of a circle to obtain a plurality of centers of a circle; based on the center of the circle, determining a plurality of areas in each direction according to the radius; and taking the coordinates of the center point of the area with the highest brightness as the accurate second coordinate.

[0012] In a possible implementation, the positioning lamp bead may be a lamp bead located at a vertex of the first screen and / or a lamp bead located at an edge of the first screen.

[0013] According to another aspect of the present disclosure, a screen lamp bead coefficient compensation device is provided, comprising:

[0014] An image and mapping relationship acquisition unit, used to acquire a first image and a second image of a first screen, and a first mapping relationship between row and column positions of lamp beads in the first screen and coordinates of the lamp beads in the second image, wherein the first image and the second image are images obtained by respectively acquiring images of the first screen twice;

[0015] A first coordinate determining unit, used to determine a first coordinate of the lamp bead to be adjusted in the first image;

[0016] The first row and column position determination unit is used to determine the row and column positions of the lamp beads to be adjusted based on the first coordinates and the first mapping relationship when the spatial relationship between the camera and the first screen is the same in the two acquisitions, so as to perform coefficient compensation on the lamp beads to be adjusted.

[0017] In a possible implementation manner, the device further includes:

[0018] a change matrix determining unit, configured to determine a transformation matrix between the first image and the second image when the spatial relationship between the camera and the first screen is different in the two acquisitions;

[0019] A second coordinate determination unit, used to determine the second coordinate of the lamp bead to be adjusted in the second image based on the first coordinate and the transformation matrix;

[0020] The second row and column position determination unit is used to determine the row and column positions of the lamp beads to be adjusted based on the second coordinates and the first mapping relationship, so as to adjust the parameters of the lamp beads to be adjusted.

[0021] In a possible implementation manner, the change matrix determining unit is used to:

[0022] Acquire the third coordinate of the positioning lamp bead in the first image, wherein the row and column positions of the positioning lamp bead are known;

[0023] Based on the row and column positions of the positioning lamp beads and the first mapping relationship, determining a fourth coordinate of the positioning lamp beads in the second image;

[0024] The transformation matrix is ​​determined according to the third coordinate and the fourth coordinate.

[0025] In a possible implementation manner, the second row and column position determining unit is further configured to:

[0026] Get coordinate adjustment parameters;

[0027] Using the coordinate adjustment parameter, adjusting the second coordinate to obtain an accurate second coordinate;

[0028] Determine, from the first mapping relationship, a target coordinate having the shortest first distance to the precise second coordinate;

[0029] The row and column positions corresponding to the target coordinates in the first mapping relationship are used as the row and column positions of the lamp beads to be adjusted.

[0030] In a possible implementation, the coordinate adjustment parameter includes: the lamp bead coordinates of each lamp bead in the second image, and the use of the coordinate adjustment parameter to adjust the second coordinate to obtain the precise second coordinate includes:

[0031] Determine the lamp bead coordinates with the shortest second distance to the second coordinate, and use the lamp bead coordinates as the precise second coordinates.

[0032] In a possible implementation, the coordinate adjustment parameters include: a plurality of preset directions and a preset radius, and the using the coordinate adjustment parameters to adjust the second coordinate to obtain the precise second coordinate includes:

[0033] On the second image, taking the position indicated by the second coordinate as a base point, taking a point in each direction whose distance from the base point is the radius as a circle center, to obtain a plurality of circle centers;

[0034] Based on the center of the circle and according to the radius, a plurality of regions are determined in each of the directions;

[0035] The coordinates of the center point of the area with the maximum brightness are used as the precise second coordinates.

[0036] In a possible implementation, the positioning lamp bead may be a lamp bead located at a vertex of the first screen and / or a lamp bead located at an edge of the first screen.

[0037] According to another aspect of the present disclosure, a display device is provided, comprising the above-mentioned screen lamp bead coefficient compensation device.

[0038] In one possible implementation, the display unit includes a display panel, and the display panel includes at least one of a liquid crystal display panel, a micro light emitting diode display panel, a light emitting diode display panel, a mini light emitting diode display panel, a quantum dot light emitting diode display panel, an organic light emitting diode display panel, a cathode ray tube display panel, a digital light processing display panel, a field emission display panel, a plasma display panel, an electrophoretic display panel, an electrowetting display panel and a small pitch display panel.

[0039] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0040] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.

[0041] According to another aspect of the present disclosure, a computer program product is provided, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0042] In the disclosed embodiment, the first mapping relationship can be determined in advance. Then, each time the coefficient compensation of the lamp beads on the first screen is required in the future, the first image of the screen is acquired. In the process of capturing the first image and the second image twice, as long as the spatial relationship between the camera and the first screen is the same, it means that the coordinates of the lamp beads in the first image and the second image are the same. Therefore, the row and column positions of the lamp beads to be adjusted can be determined based on the first coordinates of the lamp beads to be adjusted and using the first mapping relationship. In this way, there is no need to determine the row and column positions of each lamp bead each time the coefficient compensation is performed, which greatly saves time, and the row and column positions of the lamp beads to be adjusted can be accurately and quickly determined.

[0043] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0045] Figure 1 A flow chart of the screen lamp bead coefficient compensation method provided in an embodiment of the present disclosure.

[0046] Figure 2 A schematic diagram of the structure of the screen lamp bead coefficient compensation device provided in an embodiment of the present disclosure.

[0047] Figure 3 A schematic diagram of the structure of an electronic device for screen lamp coefficient compensation provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0048] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0049] In the description of the present disclosure, it should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship are based on the orientation or position relationship shown in the accompanying drawings, and are only for the convenience of describing the present disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present disclosure.

[0050] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the present disclosure, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0051] In the present disclosure, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.

[0052] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0053] As the screen is used for a longer time, the lamp beads need to be compensated at regular intervals to ensure the display effect.

[0054] When performing automatic coefficient compensation, the device needs to determine the row and column position of the lamp beads to be adjusted on the screen. Therefore, it is necessary to control each lamp bead to light up and turn off separately to determine the row and column position of each lamp bead, as well as the row and column position of the lamp bead with deviations in brightness, chromaticity and other indicators.

[0055] However, a large screen may contain millions or even tens of millions of lamp beads, so it takes a long time to compensate the lamp beads each time, which is inefficient.

[0056] Figure 1 The following is a flow chart of the screen lamp coefficient compensation method provided by the embodiment of the present disclosure. Figure 1 As shown, the method includes:

[0057] S11, obtaining a first image and a second image of a first screen, and a first mapping relationship between the row and column positions of the lamp beads in the first screen and the coordinates of the lamp beads in the second image, wherein the first image and the second image are images obtained by respectively capturing the first screen twice.

[0058] The first image may be an image captured for the first screen when coefficient compensation is currently required for the lamp beads in the first screen. The second image may be an image captured for the first screen when the first screen has met the delivery conditions (parameter correction is completed). Alternatively, the first image may be an image captured for the first screen before the current coefficient compensation. The time when the second image is captured is earlier than the time when the first image is captured.

[0059] The first mapping relationship may be determined based on the second image. For example, the lamp beads may be lit by specifying the row and column positions, and only one lamp bead is lit each time, and each lamp bead in the first screen is lit at least once. The camera is set according to the spatial relationship between the camera and the first screen when the second image is taken, and the camera is used to take a picture of the first screen after each lamp bead is lit, so as to obtain the screen image corresponding to each lamp bead. Moreover, the coordinates of the lit lamp bead can be identified from the screen image. In this way, the corresponding relationship between the coordinates of the lit lamp bead and the row and column positions, i.e., the first mapping relationship, can be obtained. For another example, the camera may be set according to the spatial relationship between the camera and the first screen when the second image is taken, and the camera is used to capture an image containing the first screen. Based on the image, the coordinates of each lamp bead are identified, and the row and column positions of each lamp bead are determined according to the numerical variation law of the coordinates of each lamp bead in the horizontal and vertical directions to obtain the first mapping relationship. The above is only an example, and the embodiment of the present disclosure does not limit the method for determining the first mapping relationship. The compensation coefficient may be compensation for the brightness, chromaticity, color temperature, light effect, etc. of the lamp bead.

[0060] S12, determining the first coordinates of the lamp bead to be adjusted in the first image.

[0061] The lamp beads to be adjusted may be all the lamp beads in the first screen or some of the lamp beads in the first screen. The lamp beads to be adjusted may be adjacent lamp beads or non-adjacent lamp beads. The lamp beads to be adjusted may be lamp beads whose current optical performance (for example, brightness and / or chromaticity) exceeds a first optical performance threshold value compared with the optical performance at the time of leaving the factory, or after the previous coefficient compensation, or after the previous N coefficient compensations. Alternatively, the lamp beads to be adjusted may be lamp beads whose optical performance (for example, brightness and / or chromaticity) exceeds a second optical performance threshold value compared with the optical performance of the lamp beads around them. The disclosed embodiments do not limit the method for selecting the lamp beads to be adjusted.

[0062] The first coordinate may be the image coordinate of the lamp bead to be adjusted in the first image.

[0063] S13, when the spatial relationship between the camera and the first screen is the same in the two acquisitions, the row and column positions of the lamp beads to be adjusted are determined based on the first coordinates and the first mapping relationship to perform coefficient compensation on the lamp beads to be adjusted.

[0064] In the embodiment of the present disclosure, the spatial relationship between the camera and the first screen can represent the distance between the first screen and the camera, and the angle between the line connecting the first screen and the camera and a predefined reference line. The spatial relationship can be recorded when capturing the first image, and then the first screen and the camera can be set according to the spatial relationship to capture the second image.

[0065] If the spatial scenes captured twice are the same, you can also record the position coordinates of the first screen and the camera during the first capture, and directly use the position coordinates of the first screen and the camera during the second capture to set the first screen and camera and perform the second capture.

[0066] Alternatively, the position of the first screen and the position of the camera are fixed, and the positions of the first screen and the camera do not change during the time between two image acquisitions.

[0067] Since the spatial relationship between the camera and the first screen is the same in the two acquisitions, the image coordinates of the same lamp bead in the first image and the second image are the same, that is, the coordinates of the same lamp bead in the first image are the same as those in the second image. Moreover, the row and column positions of the lamp beads in the first screen are fixed after the screen is produced. In this way, when the spatial relationship between the camera and the first screen is the same in the two acquisitions, the first mapping relationship can characterize the correspondence between the row and column positions of the lamp beads in the first screen and the coordinates of the lamp beads in the first screen in the first image. Therefore, when the first coordinates are known, the row and column positions of the lamp beads to be adjusted can be directly determined based on the first mapping relationship. Then, the parameters corresponding to the lamp beads to be adjusted can be adjusted to achieve coefficient compensation.

[0068] In the case where the first mapping relationship is not obtained based on the second image, but is obtained based on the third image including the first screen, then the spatial relationship between the camera and the first screen is the same when the first image, the second image, and the third image are captured.

[0069] In the disclosed embodiment, the first mapping relationship can be determined in advance. Then, each time the coefficient compensation of the lamp beads on the first screen is required in the future, the first image of the screen is acquired. In the process of capturing the first image and the second image twice, as long as the spatial relationship between the camera and the first screen is the same, it means that the coordinates of the lamp beads in the first image and the second image are the same. Therefore, the row and column positions of the lamp beads to be adjusted can be determined based on the first coordinates of the lamp beads to be adjusted and using the first mapping relationship. In this way, there is no need to determine the row and column positions of each lamp bead each time the coefficient compensation is performed, which greatly saves time, and the row and column positions of the lamp beads to be adjusted can be accurately and quickly determined.

[0070] In a possible implementation, the method also includes: when the spatial relationship between the camera and the first screen is different in the two acquisitions, determining the transformation matrix between the first image and the second image; based on the first coordinates and the transformation matrix, determining the second coordinates of the lamp bead to be adjusted in the second image; based on the second coordinates and the first mapping relationship, determining the row and column positions of the lamp bead to be adjusted to adjust the parameters of the lamp bead to be adjusted.

[0071] Sometimes, it is impossible to ensure that the spatial relationship between the camera and the first screen is exactly the same in the two acquisitions; then, the coordinates of the same lamp bead in the first image are different from the coordinates in the second image. If the first mapping relationship is used directly, it may not be possible to find the row and column positions corresponding to the first coordinates, or the wrong row and column positions may be found, affecting the accuracy of determining the row and column positions of the lamp bead to be adjusted. As a result, the parameters of the lamp bead to be adjusted cannot be accurately adjusted.

[0072] In the disclosed embodiment, the transformation matrix between the first image and the second image can be determined. For example: feature point pairs representing the same thing can be found on the first image and the second image; multiple sets of feature point pairs are used to obtain a transformation matrix. The transformation matrix here may include: a rigid body transformation matrix, a similarity transformation matrix, or an affine transformation matrix, etc. The transformation matrix can characterize the mapping relationship between the coordinates in the first image and the coordinates in the second image. In this way, the transformation matrix can be used to determine the second coordinates of the lamp bead to be adjusted according to the first coordinates, that is, to determine the coordinates of the lamp bead to be adjusted in the second image. Then use the first mapping relationship to determine the row and column positions corresponding to the second coordinates according to the second coordinates, that is, the row and column positions of the lamp bead to be adjusted.

[0073] In the embodiment of the present disclosure, even if the spatial relationship between the camera and the first screen changes during the two acquisitions, and the first coordinates cannot be used directly to determine the row and column positions of the lamp beads to be adjusted, the transformation matrix between the first image and the second image can be determined. In this way, the first coordinates are converted into corresponding coordinates on the second image using the transformation matrix to obtain the second coordinates. In this way, the first mapping relationship can continue to be used to accurately and quickly determine the row and column positions of the lamp beads to be adjusted.

[0074] In one possible implementation, determining the transformation matrix between the first image and the second image includes: obtaining the third coordinate of the positioning lamp bead in the first image, and the row and column positions of the positioning lamp bead are known; based on the row and column positions of the positioning lamp bead and the first mapping relationship, determining the fourth coordinate of the positioning lamp bead in the second image; and determining the transformation matrix according to the third coordinate and the fourth coordinate.

[0075] In the embodiment of the present disclosure, a plurality of positioning lamp beads may be pre-set, and the row and column position of each positioning lamp bead may be recorded. The third coordinate of the positioning lamp bead may be obtained from the first image.

[0076] The row and column positions of the positioning lamp beads are known. The first mapping relationship can be used to determine the fourth coordinates of the positioning lamp beads in the second image.

[0077] In one example, the positioning lamp beads may be lamp beads located at the vertices of the first screen, and / or lamp beads located at the edge of the first screen. The lamp beads located at the vertices or edges of the first screen cover the border of the first screen relatively evenly. In this way, the pixel points corresponding to the positioning lamp beads on the image are used as feature points, so that the feature points are evenly distributed, which is conducive to improving the accuracy of the transformation matrix. In addition, on the image, the contrast between the lamp beads located at the vertices or edges of the first screen and the surrounding pixels is obvious, so it is easy to accurately identify and accurately determine the third coordinate from the first image. Therefore, selecting the lamp beads located at the vertices of the first screen, and / or lamp beads located at the edge of the first screen as positioning lamp beads can improve the accuracy of the third coordinate.

[0078] In the embodiment of the present disclosure, the third coordinate and the fourth coordinate of the same positioning lamp bead can be taken as a feature pair, and a transformation matrix can be determined based on the feature point pairs corresponding to each of the multiple positioning lamp beads.

[0079] In the disclosed embodiment, since the row and column positions of the positioning lamp beads in the first screen are known, the fourth coordinates of the positioning lamp beads in the second image can be directly determined based on the first mapping relationship, eliminating the step of identifying the fourth coordinates of the positioning lamp beads from the second image. Combined with the third coordinates of each positioning lamp bead, the transformation matrix is ​​determined, which improves the efficiency of determining the transformation matrix.

[0080] Based on the coordinates of each positioning lamp bead on the first image and the second image respectively, that is, based on the third coordinates and the fourth coordinates of each positioning lamp bead, a transformation matrix can be determined.

[0081] In a possible implementation, the row and column positions of the lamp beads to be adjusted are determined based on the second coordinates and the first mapping relationship, including: obtaining coordinate adjustment parameters; using the coordinate adjustment parameters to adjust the second coordinates to obtain precise second coordinates; determining the target coordinates with the shortest first distance to the precise second coordinates from the first mapping relationship; and using the row and column positions corresponding to the target coordinates in the first mapping relationship as the row and column positions of the lamp beads to be adjusted.

[0082] The coordinate adjustment parameters can be used to eliminate the errors of the second coordinate in the horizontal and vertical directions. The coordinate adjustment parameters may include parameters for adjusting the horizontal coordinates and parameters for adjusting the vertical coordinates. After the second coordinates are adjusted by the coordinate adjustment parameters, the precise second coordinates can be obtained. Ideally, the precise second coordinates should be the same as the coordinates of the lamp bead to be adjusted in the second image. In actual operation, due to system errors, operational errors, etc., there may still be slight differences between the precise second coordinates and the coordinates of the lamp bead to be adjusted in the second image. This slight difference may be smaller than the first difference between the coordinates of any lamp bead other than the lamp bead to be adjusted in the second image and the precise second coordinates. Therefore, multiple first distances can be determined based on the coordinates of each lamp bead in the second image and the precise second coordinates, and the shortest first distance can be determined. The coordinates of the lamp bead (in the second image) corresponding to the shortest first distance are used as the target lamp bead coordinates. The target lamp bead coordinates are the coordinates of the lamp bead to be adjusted in the second image. Based on the target coordinates, according to the first mapping relationship, the row and column positions corresponding to the target coordinates can be determined, and the row and column positions are the row and column positions of the lamp bead to be adjusted.

[0083] In the embodiment of the present disclosure, the second coordinate is adjusted using the coordinate adjustment parameter, which can improve the accuracy of determining the row and column positions. Moreover, the target coordinate with the shortest first distance to the precise second coordinate is determined using the first mapping relationship, and the coordinates of the lamp beads in the second image do not need to be obtained from the image, thereby improving efficiency. Therefore, the method of the embodiment of the present disclosure can further improve the accuracy and efficiency of determining the row and column positions of the lamp beads to be adjusted.

[0084] In one possible implementation, the coordinate adjustment parameters include: the lamp bead coordinates of each lamp bead in the second image, and using the coordinate adjustment parameters to adjust the second coordinates to obtain precise second coordinates, including: determining the lamp bead coordinates with the shortest second distance to the second coordinates, and using the lamp bead coordinates as the precise second coordinates.

[0085] The coordinates of each lamp bead in the second image can be identified from the second image, or obtained from the first mapping relationship. Ideally, the second coordinates and the coordinates of the lamp bead to be adjusted in the second image should be the same. Since there may be errors in the transformation matrix and calculation errors in the process of determining the second coordinates using the change relationship; therefore, there may be differences between the second coordinates and the coordinates of the lamp bead to be adjusted in the second image. Directly using the coordinates of the lamp bead in the second image that is closest to the second coordinate (with the shortest second distance) as the precise second coordinate can accurately eliminate the difference between the second coordinate and the coordinates of the lamp bead to be adjusted in the second image.

[0086] When the coordinate adjustment parameters include the coordinates of each lamp bead in the second image, the first distance may be 0. Multiple first distances may be calculated using the coordinates in the first mapping relationship corresponding to the precise second coordinates, and the coordinates corresponding to the first distance with a value of zero are used as the target coordinates.

[0087] In a possible implementation, the coordinate adjustment parameters include: a preset plurality of directions, a preset radius, and the use of the coordinate adjustment parameters to adjust the second coordinate to obtain an accurate second coordinate includes: on the second image, taking the position indicated by the second coordinate as a base point, and taking a point in each direction whose distance from the base point is the radius as the center of a circle to obtain a plurality of centers of a circle; based on the center of the circle, determining a plurality of areas in each direction according to the radius; and taking the coordinates of the center point of the area with the highest brightness as the accurate second coordinate.

[0088] The preset direction can evenly cover the surrounding area of ​​the position represented by the second coordinate. Exemplarily, the preset direction can be 4 directions, for example: up, down, left, and right. Exemplarily, the preset direction can be 2 directions, for example: up and down, and a direction is determined every 10° between these two directions, and a total of 36 directions are determined. Exemplarily, the preset direction can be 8 directions, for example: up, down, left, right, obliquely left and up, obliquely right and up, obliquely left and down, and obliquely right and down. The above is only an example, and the embodiments of the present disclosure do not limit the specific form of the preset direction.

[0089] In each preset direction, a center is determined. The distance between the coordinates of each center and the second coordinate is the preset radius. Using each center and radius, an area can be determined in each direction. This area is a circular area. In other words, the position indicated by the second coordinate falls on the boundary of each area.

[0090] In the disclosed embodiment, each region can be regarded as a hypothetical lamp bead. If the proportion of the overlap between this region and the real lamp bead in the second image is larger, the brightness of the region is higher, indicating that this region is closer to the real lamp bead. Therefore, the region with the highest brightness among the regions can be regarded as the lamp bead to be adjusted on the second image. The coordinates of the center point of the region with the highest brightness are taken as the second precise coordinates.

[0091] In the case where the coordinate adjustment parameters include multiple preset directions and preset radiuses, it is not necessary to obtain the coordinates of all lamp beads on the second image. Only the center of the circle is determined in the preset direction, and the area is determined in each preset direction based on the center of the circle and the radius. The area with the highest brightness is determined as the lamp bead to be adjusted on the second image, and the coordinates of the center point of the area with the highest brightness are used as the precise second coordinates to complete the adjustment of the second coordinates. The amount of data acquired is reduced, and the calculation of the second distance between each lamp bead on the second image and the lamp bead to be adjusted is avoided, which reduces the amount of calculation. The efficiency of determining the precise second coordinates is improved.

[0092] Figure 2 This is a schematic diagram of the structure of the screen lamp coefficient compensation device provided by the embodiment of the present disclosure. Figure 1 As shown, the device 20 comprises:

[0093] An image and mapping relationship acquisition unit 21 is used to acquire a first image and a second image of a first screen, and a first mapping relationship between the row and column positions of lamp beads in the first screen and the coordinates of the lamp beads in the second image, wherein the first image and the second image are images obtained by respectively capturing the first screen twice;

[0094] A first coordinate determining unit 22, used to determine the first coordinate of the lamp bead to be adjusted in the first image;

[0095] The first row and column position determination unit 23 is used to determine the row and column positions of the lamp beads to be adjusted based on the first coordinates and the first mapping relationship when the spatial relationship between the camera and the first screen is the same in the two acquisitions, so as to perform coefficient compensation on the lamp beads to be adjusted.

[0096] In a possible implementation, the device 20 further includes:

[0097] a change matrix determining unit, configured to determine a transformation matrix between the first image and the second image when the spatial relationship between the camera and the first screen is different in the two acquisitions;

[0098] A second coordinate determination unit, used to determine the second coordinate of the lamp bead to be adjusted in the second image based on the first coordinate and the transformation matrix;

[0099] The second row and column position determination unit is used to determine the row and column positions of the lamp beads to be adjusted based on the second coordinates and the first mapping relationship, so as to adjust the parameters of the lamp beads to be adjusted.

[0100] In a possible implementation manner, the change matrix determining unit is used to:

[0101] Acquire the third coordinate of the positioning lamp bead in the first image, wherein the row and column positions of the positioning lamp bead are known;

[0102] Based on the row and column positions of the positioning lamp beads and the first mapping relationship, determining a fourth coordinate of the positioning lamp beads in the second image;

[0103] The transformation matrix is ​​determined according to the third coordinate and the fourth coordinate.

[0104] In a possible implementation manner, the second row and column position determining unit is further configured to:

[0105] Get coordinate adjustment parameters;

[0106] Using the coordinate adjustment parameter, adjusting the second coordinate to obtain an accurate second coordinate;

[0107] Determine, from the first mapping relationship, a target coordinate having the shortest first distance to the precise second coordinate;

[0108] The row and column positions corresponding to the target coordinates in the first mapping relationship are used as the row and column positions of the lamp beads to be adjusted.

[0109] In a possible implementation, the coordinate adjustment parameter includes: the lamp bead coordinates of each lamp bead in the second image, and the use of the coordinate adjustment parameter to adjust the second coordinate to obtain the precise second coordinate includes:

[0110] Determine the lamp bead coordinates with the shortest second distance to the second coordinate, and use the lamp bead coordinates as the precise second coordinates.

[0111] In a possible implementation, the coordinate adjustment parameters include: a plurality of preset directions and a preset radius, and the using the coordinate adjustment parameters to adjust the second coordinate to obtain the precise second coordinate includes:

[0112] On the second image, taking the position indicated by the second coordinate as a base point, taking a point in each direction whose distance from the base point is the radius as a circle center, to obtain a plurality of circle centers;

[0113] Based on the center of the circle and according to the radius, a plurality of regions are determined in each of the directions;

[0114] The coordinates of the center point of the area with the maximum brightness are used as the precise second coordinates.

[0115] In a possible implementation, the positioning lamp bead may be a lamp bead located at a vertex of the first screen and / or a lamp bead located at an edge of the first screen.

[0116] Exemplarily, the electronic devices in this embodiment include but are not limited to desktop computers, televisions, mobile devices with large screens such as mobile phones, tablet computers, and other common electronic devices that require multiple chips to be cascaded to achieve driving.

[0117] Exemplarily, the electronic device may also be a user equipment (UE), a mobile device, a user terminal, a terminal, a handheld device, a computing device or a vehicle-mounted device, etc. Exemplarily, some examples of terminals are: a display, a smart phone or a portable device, a mobile phone, a tablet computer, a laptop computer, a PDA, a mobile Internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a wireless terminal in industrial control (Industrial Control), a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid (Smart Grid), a wireless terminal in transportation safety (Transportation Safety), a wireless terminal in smart city (Smart City), a wireless terminal in smart home (Smart Home), a wireless terminal in Internet of Vehicles, etc. For example, the server may be a local server or a cloud server.

[0118] Figure 3 A schematic diagram of the structure of an electronic device for screen lamp coefficient compensation provided by an embodiment of the present disclosure. For example, the electronic device 1900 can be provided as a server or a terminal device. Figure 3 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions executable by the processing component 1922, such as an application. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0119] The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

[0120] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to perform the above method.

[0121] The above description is merely an exemplary embodiment of the present invention and is not intended to limit the protection scope of the present invention. The protection scope of the present invention is determined by the appended claims.

[0122] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0123] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of more restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0124] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0125] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A screen lamp bead coefficient compensation method, characterized in that: include: Acquire a first image and a second image of a first screen, and a first mapping relationship between row and column positions of lamp beads in the first screen and coordinates of the lamp beads in the second image, wherein the first image and the second image are images obtained by respectively capturing images of the first screen twice; Determine the first coordinate of the lamp bead to be adjusted in the first image; When the spatial relationship between the camera and the first screen is the same in the two acquisitions, the row and column positions of the lamp beads to be adjusted are determined based on the first coordinates and the first mapping relationship to perform coefficient compensation on the lamp beads to be adjusted.

2. The method according to claim 1, characterized in that The method further comprises: In the case where the spatial relationship between the camera and the first screen is different in the two acquisitions, determining a transformation matrix between the first image and the second image; Based on the first coordinate and the transformation matrix, determine the second coordinate of the lamp bead to be adjusted in the second image; Based on the second coordinate and the first mapping relationship, the row and column positions of the lamp beads to be adjusted are determined to adjust the parameters of the lamp beads to be adjusted.

3. The method according to claim 2, characterized in that The determining a transformation matrix between the first image and the second image comprises: Acquire the third coordinate of the positioning lamp bead in the first image, wherein the row and column positions of the positioning lamp bead are known; Based on the row and column positions of the positioning lamp beads and the first mapping relationship, determining a fourth coordinate of the positioning lamp beads in the second image; The transformation matrix is ​​determined according to the third coordinate and the fourth coordinate.

4. The method according to claim 2, characterized in that: The step of determining the row and column positions of the lamp beads to be adjusted based on the second coordinates and the first mapping relationship includes: Get coordinate adjustment parameters; Using the coordinate adjustment parameter, adjusting the second coordinate to obtain an accurate second coordinate; Determine, from the first mapping relationship, a target coordinate having the shortest first distance to the precise second coordinate; The row and column positions corresponding to the target coordinates in the first mapping relationship are used as the row and column positions of the lamp beads to be adjusted.

5. The method according to claim 4, characterized in that The coordinate adjustment parameters include: the lamp bead coordinates of each lamp bead in the second image, and the use of the coordinate adjustment parameters to adjust the second coordinates to obtain accurate second coordinates includes: Determine the lamp bead coordinates with the shortest second distance to the second coordinate, and use the lamp bead coordinates as the precise second coordinates.

6. The method according to claim 4, characterized in that The coordinate adjustment parameters include: a plurality of preset directions and a preset radius, and the using the coordinate adjustment parameters to adjust the second coordinate to obtain an accurate second coordinate includes: On the second image, taking the position indicated by the second coordinate as a base point, taking a point in each direction whose distance from the base point is the radius as a circle center, to obtain a plurality of circle centers; Based on the center of the circle and according to the radius, a plurality of regions are determined in each of the directions; The coordinates of the center point of the area with the maximum brightness are used as the precise second coordinates.

7. The method according to claim 3, characterized in that The positioning lamp beads may be lamp beads located at the vertices of the first screen and / or lamp beads located at the edges of the first screen.

8. A screen lamp bead coefficient compensation device, characterized in that: include: An image and mapping relationship acquisition unit, used to acquire a first image and a second image of a first screen, and a first mapping relationship between row and column positions of lamp beads in the first screen and coordinates of the lamp beads in the second image, wherein the first image and the second image are images obtained by respectively acquiring images of the first screen twice; A first coordinate determining unit, used to determine a first coordinate of the lamp bead to be adjusted in the first image; The first row and column position determination unit is used to determine the row and column positions of the lamp beads to be adjusted based on the first coordinates and the first mapping relationship when the spatial relationship between the camera and the first screen is the same in the two acquisitions, so as to perform coefficient compensation on the lamp beads to be adjusted.

9. A display device, characterized in that: It comprises a plurality of display units and at least one screen lamp bead coefficient compensation device according to claim 8.

10. The display device according to claim 9, characterized in that The display unit includes a display panel, and the display panel includes at least one of a liquid crystal display panel, a micro light emitting diode display panel, a light emitting diode display panel, a mini light emitting diode display panel, a quantum dot light emitting diode display panel, an organic light emitting diode display panel, a cathode ray tube display panel, a digital light processing display panel, a field emission display panel, a plasma display panel, an electrophoretic display panel, an electrowetting display panel and a small pitch display panel.

11. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method described in any one of claims 1 to 7 when executing the instructions stored in the memory.

12. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images