A method, device, equipment and medium for obtaining a corresponding relationship
By using a binocular camera to capture LED display screen images at a fixed position, identifying brightness and chromaticity, calculating the observation angle, and establishing a corresponding relationship, the low efficiency problem of the existing technology is solved, and efficient brightness and chromaticity information acquisition and display screen correction are achieved.
Patent Information
- Application Number
- CN202111665320.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-31
- Publication Date
- 2025-10-03
- Estimated Expiration
- 2041-12-31
AI Technical Summary
In the prior art, in order to obtain the brightness and chromaticity information of each lamp bead of an LED display screen at different observation angles, it is necessary to move the camera multiple times, resulting in low efficiency in obtaining the corresponding relationship.
A binocular camera is used to capture images of the display screen at a fixed position. The brightness and chromaticity information of the lamp beads are recognized based on the binocular image. The observation angle is calculated through deep processing, and the corresponding relationship between the brightness and chromaticity of the lamp beads and the observation angle is established.
There is no need to move the camera multiple times, which improves the efficiency of obtaining the correspondence, reduces time consumption, and ensures the accuracy and consistency of the brightness and chromaticity information.
Smart Images

Figure CN116416913B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method, apparatus, device, and medium for obtaining a corresponding relationship. Background Art
[0002] LED (Light Emitting Diode) displays display images by controlling the emission of semiconductor diodes. The display contains multiple LEDs, and the intensity of the light emitted by each LED changes as the viewing angle changes. To calibrate the display so that the brightness and chromaticity of each LED are uniform when viewed from different angles, it is necessary to obtain a correspondence between the viewing angle and the brightness and chromaticity information for each LED. This brightness and chromaticity information includes both luminance and chromaticity information.
[0003] In the related art, it is usually necessary to use a camera to capture images of the display screen from different observation angles, and determine the brightness and chromaticity information of the lamp beads based on the above images, so as to obtain the brightness and chromaticity information of the lamp beads at each observation angle.
[0004] In the above scheme, in order to obtain images of the display screen captured by the camera from different observation angles, the camera needs to be moved multiple times. When it is necessary to obtain the brightness and color information of the lamp beads under a large number of observation angles, the time consumption caused by moving the camera is long, resulting in low efficiency in obtaining the corresponding relationship. Summary of the Invention
[0005] The purpose of the embodiments of the present application is to provide a method, apparatus, device, and medium for obtaining a correspondence relationship to improve the efficiency of obtaining the correspondence relationship. The specific technical solution is as follows:
[0006] In a first aspect, an embodiment of the present application provides a method for obtaining a correspondence relationship, the method comprising:
[0007] Obtaining a binocular image obtained by capturing an image of a display screen by a binocular camera at a fixed position;
[0008] Identify brightness and color information of each lamp bead in the display screen based on the binocular image;
[0009] Performing depth processing on the binocular image to obtain the distance between each lamp bead in the display screen and the binocular camera, and calculating the observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance;
[0010] Based on the obtained observation angle and brightness and chromaticity information of each lamp bead, a corresponding relationship between the brightness and chromaticity of the lamp bead and the observation angle is established.
[0011] In one embodiment of the present application, the method further includes:
[0012] Obtaining a target observation angle of a target object relative to the display screen;
[0013] Based on the corresponding relationship, determining the target brightness and chromaticity information corresponding to the target observation angle;
[0014] The target brightness and chromaticity information is used to determine a correction coefficient of the lamp beads in the display screen, and the brightness and chromaticity of the lamp beads in the display screen are corrected according to the correction coefficient.
[0015] In one embodiment of the present application, obtaining a target observation angle of the target object relative to the display screen includes:
[0016] Obtaining a target observation angle of a target object relative to each lamp bead in the display screen;
[0017] The determining, based on the corresponding relationship, target brightness and chromaticity information corresponding to the target observation angle includes:
[0018] Based on the corresponding relationship, determining the target brightness and chromaticity information corresponding to each target observation angle;
[0019] The method of determining a correction coefficient of the lamp beads in the display screen by using the target brightness and chromaticity information, and correcting the brightness and chromaticity of the lamp beads in the display screen according to the correction coefficient, includes:
[0020] For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information corresponding to the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the determined correction coefficient.
[0021] In one embodiment of the present application, for each lamp bead in the display screen, determining a correction coefficient for the lamp bead using target brightness and chromaticity information corresponding to the lamp bead, and correcting the brightness and chromaticity of the lamp bead according to the determined correction coefficient includes:
[0022] Determining the reference brightness and chromaticity supported by each lamp bead based on the target brightness and chromaticity information of each lamp bead in the display screen;
[0023] For each lamp bead in the display screen, a ratio of the reference brightness and chromaticity to the target brightness and chromaticity information of the lamp bead is calculated as a correction coefficient, and the brightness and chromaticity of the lamp bead in the display screen is corrected according to the correction coefficient.
[0024] In one embodiment of the present application, determining the reference brightness and chromaticity supported by each lamp bead based on the target brightness and chromaticity information of each lamp bead in the display screen includes:
[0025] The average value of the target brightness and chromaticity information of each lamp bead in the display screen is counted, and the difference between the average value and the preset brightness and chromaticity redundancy value is calculated as the reference brightness and chromaticity supported by each lamp bead.
[0026] In one embodiment of the present application, for each lamp bead in the display screen, determining a correction coefficient for the lamp bead using target brightness and chromaticity information corresponding to the lamp bead, and correcting the brightness and chromaticity of the lamp bead according to the determined correction coefficient includes:
[0027] For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information of the lamp bead and the luminous parameters of the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the correction coefficient.
[0028] In one embodiment of the present application, obtaining a target observation angle of the target object relative to the display screen includes:
[0029] In the case of multiple target objects, the central observation position of all target objects is determined according to the observation position of each target object;
[0030] The observation angle of the central observation position relative to the display screen is obtained as the target observation angle.
[0031] In one embodiment of the present application, obtaining a binocular image obtained by capturing an image of a display screen by a binocular camera at a fixed position includes:
[0032] When the display screen displays a red image, a green image, and a blue image, respectively, a plurality of binocular images are obtained by capturing the display screen at a fixed position by a binocular camera;
[0033] The method of recognizing the brightness and chromaticity information of each lamp bead in the display screen based on the binocular image includes:
[0034] For each binocular image, identifying the brightness and chromaticity information of each lamp bead of the display screen in the binocular image;
[0035] The brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on each binocular image recognition is fused to obtain the brightness and chromaticity information of each lamp bead of the display screen.
[0036] In one embodiment of the present application, when a display screen displays a red image, a green image, and a blue image, respectively, obtaining a plurality of binocular images obtained by capturing the display screen by a binocular camera at a fixed position includes:
[0037] When a display screen displays a red image, a green image, and a blue image, for each image, a plurality of binocular images are obtained by capturing the display screen at a fixed position with the binocular camera blocked by a first chromaticity filter, a second chromaticity filter, and a third chromaticity filter, respectively.
[0038] In a second aspect, an embodiment of the present application provides a device for obtaining a correspondence relationship, the device comprising:
[0039] An image acquisition module is used to obtain a binocular image obtained by capturing an image of the display screen at a fixed position by a binocular camera;
[0040] A brightness and chromaticity recognition module, configured to recognize the brightness and chromaticity information of each lamp bead in the display screen based on the binocular image;
[0041] a first angle acquisition module, configured to perform depth processing on the binocular image, obtain the distance between each lamp bead in the display screen and the binocular camera, and calculate the observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance;
[0042] The corresponding relationship obtaining module is used to establish the corresponding relationship between the brightness and chromaticity of the lamp beads and the observation angle based on the obtained observation angle and brightness and chromaticity information of each lamp bead.
[0043] In one embodiment of the present application, the device further comprises:
[0044] A second angle obtaining module is used to obtain a target observation angle of a target object relative to the display screen;
[0045] A target brightness and chromaticity determination module is used to determine target brightness and chromaticity information corresponding to the target observation angle based on the corresponding relationship;
[0046] The display screen correction module is used to determine the correction coefficient of the lamp beads in the display screen by using the target brightness and chromaticity information, and correct the brightness and chromaticity of the lamp beads in the display screen according to the correction coefficient.
[0047] In one embodiment of the present application, the second angle obtaining module is specifically configured to:
[0048] Obtaining a target observation angle of a target object relative to each lamp bead in the display screen;
[0049] The target brightness and chromaticity determination module is specifically used to:
[0050] Based on the corresponding relationship, determining the target brightness and chromaticity information corresponding to each target observation angle;
[0051] The display screen correction module is specifically used to:
[0052] For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information corresponding to the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the determined correction coefficient.
[0053] In one embodiment of the present application, the display screen correction module includes:
[0054] A reference brightness and chromaticity obtaining unit, configured to determine a reference brightness and chromaticity supported by each lamp bead based on target brightness and chromaticity information of each lamp bead in the display screen;
[0055] The display screen correction unit is used to calculate the ratio of the reference brightness and chromaticity to the target brightness and chromaticity information of each lamp bead in the display screen as a correction coefficient, and correct the brightness and chromaticity of the lamp bead in the display screen according to the correction coefficient.
[0056] In one embodiment of the present application, the reference brightness and chromaticity obtaining unit is specifically configured to:
[0057] The average value of the target brightness and chromaticity information of each lamp bead in the display screen is counted, and the difference between the average value and the preset brightness and chromaticity redundancy value is calculated as the reference brightness and chromaticity supported by each lamp bead.
[0058] In one embodiment of the present application, the display screen correction module is specifically configured to:
[0059] For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information of the lamp bead and the luminous parameters of the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the correction coefficient.
[0060] In one embodiment of the present application, the second angle obtaining module is specifically configured to:
[0061] In the case of multiple target objects, the central observation position of all target objects is determined according to the observation position of each target object;
[0062] The observation angle of the central observation position relative to the display screen is obtained as the target observation angle.
[0063] In one embodiment of the present application, the image acquisition module is specifically configured to:
[0064] When a display screen displays a red picture, a green picture, and a blue picture respectively, a plurality of binocular images are obtained by acquiring images of the display screen by a binocular camera at a fixed position.
[0065] In one embodiment of the present application, the brightness and chromaticity recognition module is specifically used to:
[0066] For each binocular image, identifying the brightness and chromaticity information of each lamp bead of the display screen in the binocular image;
[0067] The brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on each binocular image recognition is fused to obtain the brightness and chromaticity information of each lamp bead of the display screen.
[0068] In one embodiment of the present application, the image acquisition module is specifically configured to:
[0069] When a display screen displays a red image, a green image, and a blue image, for each image, a plurality of binocular images are obtained by capturing the display screen at a fixed position with the binocular camera blocked by a first chromaticity filter, a second chromaticity filter, and a third chromaticity filter, respectively.
[0070] In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;
[0071] Memory for storing computer programs;
[0072] The processor is configured to implement any of the method steps described in the first aspect when executing a program stored in the memory.
[0073] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, any of the method steps described in the first aspect is implemented.
[0074] An embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute any of the above-described methods for obtaining a corresponding relationship.
[0075] Beneficial effects of the embodiments of the present application:
[0076] In the solution provided by the embodiment of the present application, a binocular image can be obtained by capturing an image of a display screen at a fixed position using a binocular camera; the brightness and chromaticity information of each lamp bead in the display screen can be identified based on the binocular image; the binocular image is subjected to depth processing to obtain the distance of each lamp bead in the display screen relative to the binocular camera, and the observation angle of each lamp bead in the display screen relative to the binocular camera is calculated based on the obtained distance; based on the obtained observation angle and brightness and chromaticity information of each lamp bead, a corresponding relationship between the brightness and chromaticity of the lamp bead and the observation angle is established. In this way, a binocular camera can be used to capture an image of the display screen, and after depth processing of the obtained binocular image, the observation angle of each lamp bead in the display screen can be obtained based on the above binocular image, and then the brightness and chromaticity information of the lamp bead at different observation angles can be obtained. Based on the above information, a corresponding relationship between the brightness and chromaticity of the lamp bead and the observation angle is established, without having to move the binocular camera multiple times, thereby reducing the time consumed by moving the binocular camera. Therefore, it can be seen that the solution provided by the embodiment of the present application can improve the efficiency of obtaining the corresponding relationship. BRIEF DESCRIPTION OF THE DRAWINGS
[0077] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other embodiments can also be obtained based on these drawings.
[0078] Figure 1 A flowchart of a method for obtaining a corresponding relationship provided in an embodiment of the present application;
[0079] Figure 2 A schematic diagram of a binocular camera capturing binocular images provided in an embodiment of the present application;
[0080] Figure 3 A schematic diagram of an observation angle provided in an embodiment of the present application;
[0081] Figure 4 A schematic diagram showing how the light intensity of a lamp bead changes with the observation angle according to an embodiment of the present application;
[0082] Figure 5 A schematic diagram of a corresponding relationship provided in an embodiment of the present application;
[0083] Figure 6 A schematic diagram of collecting binocular images provided in an embodiment of the present application;
[0084] Figure 7 A schematic diagram of a process for obtaining lamp bead image coordinates provided in an embodiment of the present application;
[0085] Figure 8 A schematic diagram of a lamp bead in a view provided in an embodiment of the present application;
[0086] Figure 9 A schematic diagram of calculating the brightness and chromaticity of a lamp bead provided in an embodiment of the present application;
[0087] Figure 10 A top view of a three-dimensional coordinate system provided in an embodiment of the present application;
[0088] Figure 11 A schematic diagram of the angle formed by a lamp bead relative to a binocular camera in a horizontal plane provided in an embodiment of the present application;
[0089] Figure 12 A schematic diagram of the angle formed by a lamp bead relative to a binocular camera in a vertical plane provided in an embodiment of the present application;
[0090] Figure 13 A schematic diagram of a flow chart of a display screen calibration method provided in an embodiment of the present application;
[0091] Figure 14 A schematic diagram of the structure of a device for obtaining a corresponding relationship provided in an embodiment of the present application;
[0092] Figure 15 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0093] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field based on this application are within the scope of protection of this application.
[0094] In order to improve the efficiency of obtaining corresponding relationships, the embodiments of the present application provide a corresponding relationship obtaining method, apparatus, device and medium, which are described in detail below.
[0095] The present application provides a method for obtaining a corresponding relationship, which can be applied to electronic devices such as mobile phones, computers, and servers, including:
[0096] Obtaining a binocular image obtained by capturing an image of a display screen by a binocular camera at a fixed position;
[0097] Recognize the brightness and color information of each lamp bead in the display screen based on binocular image recognition;
[0098] Perform depth processing on the binocular image to obtain the distance between each lamp bead in the display screen and the binocular camera, and calculate the observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance;
[0099] Based on the obtained observation angle and brightness and chromaticity information of each lamp bead, a corresponding relationship between the brightness and chromaticity of the lamp bead and the observation angle is established.
[0100] In the solution provided by the above embodiment, a binocular camera can be used to capture images of the display screen. After depth processing of the obtained binocular image, the observation angle of each lamp bead in the display screen can be obtained based on the binocular image, and then the brightness and chromaticity information of the lamp bead at different observation angles can be obtained. Based on this information, a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established, eliminating the need to move the binocular camera multiple times, thus reducing the time consumed by moving the binocular camera. Therefore, the solution provided by the above embodiment can improve the efficiency of obtaining the correspondence.
[0101] See also Figure 1 , Figure 1 A flowchart of a method for obtaining a corresponding relationship provided in an embodiment of the present application is provided. The method includes the following steps S101-S104:
[0102] S101, obtaining a binocular image obtained by capturing an image of a display screen at a fixed position by a binocular camera.
[0103] Wherein, the display screen is an LED display screen, and the fixed position can be a position directly in front of the display screen, a position to the side of the display screen, etc.
[0104] Specifically, a binocular camera can be used to capture images of the display screen at a fixed position to obtain a binocular image, which includes: a left view captured by the left lens of the binocular camera and a right view captured by the right lens of the binocular camera.
[0105] In one embodiment of the present application, the fixed position is a position in front of the display screen on a central vertical line, where the central vertical line refers to a straight line that is perpendicular to the display screen and passes through the center point of the display screen.
[0106] For example, see Figure 2 , Figure 2 A schematic diagram of a binocular camera capturing binocular images provided in an embodiment of the present application is provided. Figure 2 The camera in the middle represents a binocular camera, and the LED screen represents an LED display screen. It can be seen that the binocular camera is located directly in front of the display screen. At this fixed position, the binocular image of the display screen captured by the binocular camera can be obtained.
[0107] S102, recognizing the brightness and color information of each lamp bead in the display screen based on the binocular image.
[0108] Among them, the display screen contains multiple lamp beads. As the observation angle changes, the intensity of the light emitted by the observed lamp beads will also change, and then the brightness and color of the observed lamp beads will also change.
[0109] The above observation angle refers to the angle between the direction of the observer pointing to the lamp bead and the direction perpendicular to the display screen.
[0110] See also Figure 3 , Figure 3 A schematic diagram of an observation angle provided in an embodiment of the present application, wherein viewer 1, viewer 2, and viewer 3 respectively represent observers at different positions, wherein the angle between viewer 1 and the LED display screen is 45°, that is, the observation angle of viewer 1 observing the lamp beads in the display screen is 45°, correspondingly, the observation angle of viewer 2 observing the lamp beads in the display screen is 0°, and the observation angle of viewer 3 observing the lamp beads in the display screen is 45°.
[0111] See also Figure 4 , Figure 4A schematic diagram of the observed light intensity of a lamp bead changing with the observation angle is provided in an embodiment of the present application, wherein IV represents the ratio of the light intensity of the lamp bead at different observation angles to the light intensity of the lamp bead at an observation angle of 0°. It can be seen that as the observation angle increases, the observed light intensity of the lamp bead decreases, and thus the observed brightness of the lamp bead decreases.
[0112] Specifically, after obtaining the binocular image, lamp bead detection can be performed on the binocular image to detect the pixel points used to describe each lamp bead in the image. For each lamp bead, the brightness and color information of the lamp bead can be identified using the pixel value of the pixel point describing the lamp bead.
[0113] S103, performing depth processing on the binocular image to obtain the distance between each lamp bead in the display screen and the binocular camera, and calculating the observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance.
[0114] The observation angle of each lamp bead relative to the binocular camera refers to the angle between the direction of the binocular camera pointing to the lamp bead in the display screen and the direction perpendicular to the display screen.
[0115] Specifically, based on the principle of depth vision, the above-mentioned binocular image can be depth processed. For each lamp bead, based on the depth processing result, the distance of the lamp bead relative to the binocular camera on the display screen can be obtained, and then the above distance can be used to determine the observation angle of the lamp bead relative to the binocular camera.
[0116] S104: Based on the obtained observation angle and brightness and chromaticity information of each lamp bead, a corresponding relationship between the brightness and chromaticity of the lamp bead and the observation angle is established.
[0117] Specifically, after obtaining the observation angle and brightness and chromaticity information corresponding to each lamp bead, a corresponding relationship between the brightness and chromaticity of the lamp bead at different observation angles can be established.
[0118] In one embodiment of the present application, the brightness and chromaticity information of each lamp bead at different observation angles can be fitted into a curve, and the above curve is used as the correspondence between the brightness and chromaticity of the lamp bead and the observation angle.
[0119] For example, see Figure 5 , Figure 5 This is a schematic diagram of a corresponding relationship provided in an embodiment of the present application. The horizontal axis represents the observation angle, and the vertical axis represents the brightness and chromaticity information. By fitting the brightness and chromaticity information at different observation angles, the following can be obtained: Figure 5 The curve shown can represent the corresponding relationship between the brightness and chromaticity of the lamp beads and the observation angle.
[0120] In the solution provided by the above embodiment, a binocular image can be obtained by capturing an image of a display screen at a fixed position using a binocular camera; the brightness and chromaticity information of each lamp bead in the display screen can be identified based on the binocular image; the binocular image is depth-processed to obtain the distance of each lamp bead in the display screen relative to the binocular camera, and the observation angle of each lamp bead in the display screen relative to the binocular camera is calculated based on the obtained distance; and a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established based on the obtained observation angle and brightness and chromaticity information of each lamp bead. In this way, a binocular camera can be used to capture an image of the display screen. After depth processing of the obtained binocular image, the observation angle of each lamp bead in the display screen can be obtained based on the above binocular image, and then the brightness and chromaticity information of the lamp bead at different observation angles can be obtained. Based on the above information, a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established, without having to move the binocular camera multiple times, thereby reducing the time consumed by moving the binocular camera. Therefore, it can be seen that the solution provided by the above embodiment can improve the efficiency of obtaining the corresponding relationship.
[0121] In one embodiment of the present application, when obtaining the binocular image in the above step S101, multiple binocular images can be obtained by capturing the display screen at a fixed position by a binocular camera when the display screen displays a red image, a green image, and a blue image, respectively.
[0122] In this case, when identifying the brightness and chromaticity information in the above step S102, the brightness and chromaticity information of each lamp bead on the display screen in the binocular image can be identified for each binocular image; the brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on each binocular image recognition is fused to obtain the brightness and chromaticity information of each lamp bead on the display screen.
[0123] Specifically, when the display screen displays an image, each pixel in the image is displayed using three LEDs, one for red, one for green, and one for blue. These three primary colors can form pixels of different colors. Therefore, when capturing binocular images, the binocular camera can capture an image once when displaying a red image, a green image, and a blue image, respectively. This yields a binocular image of the display when displaying red, a binocular image of the display when displaying green, and a binocular image of the display when displaying blue.
[0124] Therefore, when subsequently identifying brightness and chromaticity information, the brightness and chromaticity of each lamp bead in each binocular image can be identified separately, and then the multiple brightness and chromaticity information obtained based on multiple binocular images can be fused to obtain the fused brightness and chromaticity information of each lamp bead in the display screen.
[0125] In the above scheme, based on a variety of different binocular images, the brightness and chromaticity information of the lamp beads used to display red, green, and blue can be obtained respectively, which can avoid the obtained brightness and chromaticity information of the lamp beads being interfered with by the lamp beads used to display other colors, thereby improving the accuracy of the brightness and chromaticity information of each lamp bead obtained.
[0126] In one embodiment of the present application, in order to further improve the accuracy of the obtained brightness and chromaticity information, when obtaining a binocular image, when the display screen displays a red screen, a green screen, and a blue screen, for each screen, a plurality of binocular images are obtained by capturing the display screen at a fixed position with the binocular camera blocked by a first chromaticity filter, a second chromaticity filter, and a third chromaticity filter, respectively.
[0127] The first chromaticity filter, the second chromaticity filter, and the third chromaticity filter may be respectively an X filter, a Y filter, and a Z filter in a CIE-XYZ chromaticity filter.
[0128] Specifically, when the display screen displays a red image, the first chromaticity filter, the second chromaticity filter, and the third chromaticity filter can be used to block the lens of the binocular camera respectively to obtain three different binocular images captured by the binocular camera;
[0129] When the display screen shows a green picture, the first chromaticity filter, the second chromaticity filter, and the third chromaticity filter can be used to block the lens of the binocular camera respectively to obtain three different binocular images captured by the binocular camera;
[0130] When the display screen displays a blue image, the first chromaticity filter, the second chromaticity filter, and the third chromaticity filter can be used to block the lens of the binocular camera respectively to obtain three different binocular images captured by the binocular camera.
[0131] When the brightness and chromaticity information is subsequently identified in step S102 , the brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on the above nine frames of binocular image recognition can be fused to obtain the brightness and chromaticity information of each lamp bead on the display screen.
[0132] In this way, the light emitted by the lamp beads is filtered through different filters to ensure that the obtained binocular image can accurately reflect the brightness and color information of different lamp beads.
[0133] In one embodiment of the present application, for the above-mentioned step S102, when identifying the brightness and chromaticity information of each lamp bead in the display screen, the image coordinates of each lamp bead in each view can be detected separately, and the correspondence between the same lamp beads in the two views of the binocular image can be determined according to the arrangement relationship of the image coordinates of each lamp bead, and the pixel points used to describe the same lamp bead in the two views are obtained. For each lamp bead, the brightness and chromaticity information of the lamp bead can be determined based on the pixel values of the pixel points used to describe the lamp bead in the two views.
[0134] The process of obtaining the image coordinates of the lamp beads in the above solution is described below with reference to specific embodiments.
[0135] See also Figure 6 , Figure 6 This is a schematic diagram of a binocular image acquisition method provided by an embodiment of the present application. The binocular camera includes camera 1 and camera 2. The two cameras correspond to two different lenses, respectively. The two lenses are used to acquire images of the LED display screen, and visual images can be obtained. Figure 1 ,See Figure 2 , for the lamp beads P in the LED display, Figure 1 The image in the image is P1, Figure 2 The middle image is P2.
[0136] See also Figure 7 , Figure 7 A schematic diagram of a lamp bead image coordinate acquisition process provided in an embodiment of the present application. To obtain the image coordinates of each lamp bead in two views, each lamp bead in each view can be identified, and the identified lamp bead can be projected horizontally and vertically, thereby obtaining the Y-axis coordinates Y1, Y2...Y5 and the X-axis coordinates X1, X2...X5 of each lamp bead. To facilitate more accurate identification of each lamp bead in the view, the view can be binarized, and the pixel values used to describe the lamp bead in the view can be set to white, and the other pixel points in the view can be set to black, to obtain a binarized lamp point map.
[0137] In one embodiment of the present application, when determining the image coordinates of the lamp bead, the coordinates of the center point of the lamp bead in the image can be determined as the image coordinates of the lamp bead.
[0138] See also Figure 8 , Figure 8 This is a schematic diagram of a lamp bead in a view provided in an embodiment of the present application. Figure 8 The middle circle represents the lamp bead, and the dark small square represents the center of the circle. The image of the lamp bead in the view is usually circular. In this case, the coordinates of the center of the circle in the view can be determined as the image coordinates of each lamp bead in the view.
[0139] In addition, the coordinates of the edge points of the lamp beads imaged in the view may also be determined as the image coordinates of the lamp beads, which is not limited in this embodiment of the present application.
[0140] In one embodiment of the present application, when determining the brightness and color information of each lamp bead based on each view, multiple pixel points covered by the image of the lamp bead can be determined, and the brightness and color information of the lamp bead can be determined based on the pixel values of the above multiple pixel points.
[0141] Specifically, after determining the multiple pixels covered by the image of the lamp bead, the brightness and chromaticity reflected by the pixel value of each pixel can be determined, and then the mathematical statistics of each brightness and chromaticity can be calculated as the brightness and chromaticity information of the lamp bead in the view. The mathematical statistics can be the minimum value, maximum value, mean value, median value, etc.
[0142] See also Figure 9 , Figure 9 This is a schematic diagram of calculating the brightness and chromaticity of a lamp bead provided in an embodiment of the present application. Figure 9 The medium circle represents the lamp bead, and the light-colored rectangle represents the circumscribed rectangle of the circle. The minimum circumscribed rectangle of the image of the lamp bead in the view can be determined as the coverage range of the lamp bead. The brightness and chromaticity reflected by the pixel value of each pixel point within the above coverage range are determined, and then the average of each brightness and chromaticity is calculated as the brightness and chromaticity information of the lamp bead in the view.
[0143] In addition, the pixel point of the center point of the image formed by the lamp bead can also be determined, and the brightness and color information of the lamp bead can be determined based on the pixel value of the pixel point.
[0144] In one embodiment of the present application, for each lamp bead, the brightness and chromaticity of the lamp bead obtained in any view can be used as the brightness and chromaticity information of the lamp bead, or the mathematical statistical values of the brightness and chromaticity of the lamp bead in two views can be calculated as the brightness and chromaticity information of the lamp bead. The embodiment of the present application is not limited to this.
[0145] In one embodiment of the present application, for the above-mentioned step S103, when obtaining the observation angle corresponding to each lamp bead, a three-dimensional coordinate system can be established based on the binocular camera, and the binocular image can be depth-processed to obtain the distance of each lamp bead in the display screen relative to the binocular camera. The coordinates of each lamp bead in the above-mentioned three-dimensional coordinate system are determined based on the above-mentioned distance, and the observation angle of each lamp bead relative to the binocular camera is calculated using the coordinates of each lamp bead.
[0146] Specifically, assuming the left and right lenses of a binocular camera are located in the same horizontal plane and have the same focal length f, the X-axis of the three-dimensional coordinate system can be set to point from the left lens, Camera L, to the right lens, Camera R. The Y-axis is vertically upward, and the Z-axis is from the binocular camera to the display screen. After determining the three-dimensional coordinate system, the distance between the LEDs and the binocular camera can be determined.
[0147] See also Figure 10 , Figure 10 This is a top view of a three-dimensional coordinate system provided in an embodiment of the present application, where b represents the baseline of the binocular camera, which can be understood as the distance between the two lenses of the binocular camera, P represents the light beads in the display screen, and Z represents the distance of the light beads P relative to the binocular camera. Based on the principle of similar triangles, it can be seen that:
[0148]
[0149] Among them, due to We can get:
[0150]
[0151] Then we can deduce that: Z = f*b / (XL-XR)
[0152] The values of XL–XR can be obtained based on the correspondence between the pixels in the view captured by the left lens and the pixels in the view captured by the right lens.
[0153] See also Figure 11 , Figure 11 This is a schematic diagram of the angle formed by a lamp bead relative to a binocular camera in the horizontal plane provided in an embodiment of the present application. After calculating the distance Z of the lamp bead relative to the binocular camera, the coordinates (Z, X) of the lamp bead in the two-dimensional coordinate system formed by the X-axis and the Z-axis can be obtained. Then, the angle α formed by the lamp bead P relative to the binocular camera in the horizontal plane can be calculated using the following formula:
[0154]
[0155] See also Figure 12 , Figure 12 This is a schematic diagram of the angle between a lamp bead and a binocular camera in a vertical plane provided in an embodiment of the present application. After calculating the distance Z between the lamp bead and the binocular camera, based on the same principle, the coordinate value (Y, Z) of the lamp bead P in the Y-axis direction can be obtained based on the following formula:
[0156]
[0157] Combined with the coordinates of the lamp beads calculated above, trigonometric functions can be used to calculate the angles between the lamp beads and the binocular camera in the horizontal and vertical planes respectively. Then, based on the above angles, the observation angle of the lamp beads relative to the binocular camera can be calculated. I will not go into details here.
[0158] After obtaining the correspondence between the brightness and chromaticity information of the lamp beads and the observation angle based on the above scheme, the display screen can be calibrated using the above correspondence, which is described in detail below.
[0159] See also Figure 13 , Figure 13 A flowchart of a display screen calibration method provided in an embodiment of the present application is provided. The method includes the following steps S1301-S1303:
[0160] S1301: Obtain a target observation angle of a target object relative to a display screen.
[0161] The target object may be an observer, an image acquisition device, an auditorium, or other objects.
[0162] Specifically, the angle between the direction in which the target object points to each lamp bead in the display screen and the direction perpendicular to the display screen can be determined as the target observation angle.
[0163] In one embodiment of the present application, when there are multiple target objects, the central observation position of all target objects can be determined based on the observation position of each target object; and the observation angle of the central observation position relative to the display screen is obtained as the target observation angle.
[0164] Specifically, when there are multiple target objects, the central observation positions of the multiple target objects can be determined, and then the angle between the direction of the central observation position pointing to each lamp bead in the display screen and the direction perpendicular to the display screen is determined as the target observation angle to ensure that after the display screen is subsequently calibrated based on the target observation angle, when multiple target objects observe the calibrated display screen, the brightness and color of the observed display screen are relatively uniform.
[0165] S1302: Determine target brightness and chromaticity information corresponding to the target observation angle based on the corresponding relationship.
[0166] Specifically, after obtaining the target observation angle, the brightness and chromaticity information corresponding to the target observation angle can be found from the above correspondence as the target brightness and chromaticity information. This information can reflect: when the target object observes the display screen, the brightness and chromaticity information of each lamp bead in the display screen observed.
[0167] S1303: Determine the correction coefficients of the lamp beads in the display screen using the target brightness and chromaticity information, and calibrate the brightness and chromaticity of the lamp beads in the display screen according to the correction coefficients.
[0168] Specifically, after obtaining the target brightness and chromaticity information, the correction coefficient of each lamp bead can be determined based on the target brightness and chromaticity information, and then the brightness and chromaticity of each lamp bead can be corrected according to the correction coefficient so that the brightness and chromaticity of each lamp bead observed by the target object are uniform and consistent.
[0169] In one embodiment of the present application, for each lamp bead in the display screen, the target brightness and chromaticity information of the lamp bead and the luminous parameters of the lamp bead can be used to determine the correction coefficient of the lamp bead, and the brightness and chromaticity of the lamp bead can be corrected according to the correction coefficient.
[0170] Among them, the above-mentioned luminescence parameters can characterize the luminescence performance of the lamp beads.
[0171] Specifically, different lamp beads have different luminous properties. When calibrating different lamp beads, the target brightness and chromaticity information and luminous parameters of different lamp beads can be used to determine the correction coefficients of different lamp beads, and the brightness and chromaticity of different lamp beads can be corrected according to the correction coefficients to ensure that different lamp beads can display uniformly based on their own luminous properties.
[0172] In one embodiment of the present application, when obtaining the target observation angle, the target observation angle of the target object relative to each lamp bead in the display screen can be obtained.
[0173] Correspondingly, when obtaining target brightness and chromaticity information, target brightness and chromaticity information corresponding to each target observation angle may be determined based on the corresponding relationship.
[0174] Furthermore, when correcting the brightness and chromaticity of the lamp beads in the display screen, the correction coefficient of each lamp bead in the display screen can be determined using the target brightness and chromaticity information corresponding to the lamp bead, and the brightness and chromaticity of the lamp bead can be corrected according to the determined correction coefficient.
[0175] Specifically, for each lamp bead in the display screen, the observation angle of the target object relative to the lamp bead can be obtained as the target observation angle, and then the brightness and chromaticity information corresponding to the target observation angle is found from the above correspondence, as the target brightness and chromaticity information corresponding to the lamp bead. Based on the above target brightness and chromaticity information, the correction coefficient of the lamp bead is determined, and then the brightness and chromaticity of the lamp bead is corrected according to the correction coefficient.
[0176] In one embodiment of the present application, the reference brightness and chromaticity supported by each lamp bead in the display screen can be determined based on the target brightness and chromaticity information of each lamp bead in the display screen; for each lamp bead in the display screen, the ratio of the reference brightness and chromaticity to the target brightness and chromaticity information of the lamp bead is calculated as a correction coefficient, and the brightness and chromaticity of the lamp bead in the display screen is corrected according to the correction coefficient.
[0177] Among them, the above reference brightness and chromaticity can be understood as: the brightness and chromaticity that all lamp beads can achieve.
[0178] Specifically, the target brightness and chromaticity information of each lamp bead can be used to determine the brightness and chromaticity supported by all lamp beads as the reference brightness and chromaticity. Then, for each lamp bead, the ratio of the reference brightness and chromaticity to the brightness and chromaticity reflected by the target brightness and chromaticity information corresponding to the lamp bead is calculated as the correction coefficient of the lamp bead. The lamp bead can be subsequently corrected using the correction coefficient so that when the target object observes the corrected lamp bead, the observed brightness and chromaticity is the above-mentioned reference brightness and chromaticity, thereby ensuring that when the target object observes the display screen, the brightness and chromaticity of all lamp beads in the display screen observed are the above-mentioned reference brightness and chromaticity, ensuring that the brightness and chromaticity of each lamp bead observed by the target object is uniform and consistent.
[0179] In one embodiment of the present application, when determining the reference brightness and chromaticity, the average of the target brightness and chromaticity information of each lamp bead in the display screen can be counted, and the difference between the average and the preset brightness and chromaticity redundancy value can be calculated as the reference brightness and chromaticity supported by each lamp bead.
[0180] The brightness and chromaticity redundancy values may be manually set redundancy values or experimentally obtained redundancy values.
[0181] Specifically, the average of the target brightness and chromaticity information corresponding to all lamp beads can be calculated, and then the difference between the above average and the preset brightness and chromaticity redundancy value can be calculated as the reference brightness and chromaticity supported by all lamp beads.
[0182] In addition, the minimum value of all target brightness and chromaticity information can also be directly determined as the reference brightness value.
[0183] In the solution provided by the above embodiment, a binocular image can be obtained by capturing an image of a display screen at a fixed position using a binocular camera; the brightness and chromaticity information of each lamp bead in the display screen can be identified based on the binocular image; the binocular image is depth-processed to obtain the distance of each lamp bead in the display screen relative to the binocular camera, and the observation angle of each lamp bead in the display screen relative to the binocular camera is calculated based on the obtained distance; and a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established based on the obtained observation angle and brightness and chromaticity information of each lamp bead. In this way, a binocular camera can be used to capture an image of the display screen. After depth processing of the obtained binocular image, the observation angle of each lamp bead in the display screen can be obtained based on the above binocular image, and then the brightness and chromaticity information of the lamp bead at different observation angles can be obtained. Based on the above information, a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established, without having to move the binocular camera multiple times, thereby reducing the time consumed by moving the binocular camera. Therefore, it can be seen that the solution provided by the above embodiment can improve the efficiency of obtaining the corresponding relationship.
[0184] Corresponding to the above-mentioned method for obtaining a corresponding relationship, an embodiment of the present application further provides a device for obtaining a corresponding relationship, which is described in detail below.
[0185] See also Figure 14 , Figure 14 A schematic diagram of a device for obtaining a corresponding relationship provided in an embodiment of the present application is provided, wherein the device includes:
[0186] An image acquisition module 1401 is configured to acquire a binocular image obtained by capturing an image of a display screen at a fixed position using a binocular camera;
[0187] A brightness and chromaticity recognition module 1402 is configured to recognize the brightness and chromaticity information of each lamp bead in the display screen based on the binocular image;
[0188] A first angle obtaining module 1403 is configured to perform depth processing on the binocular image to obtain a distance between each lamp bead in the display screen and the binocular camera, and calculate an observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance;
[0189] The corresponding relationship obtaining module 1404 is used to establish a corresponding relationship between the brightness and chromaticity of the lamp beads and the observation angle based on the obtained observation angle and brightness and chromaticity information of each lamp bead.
[0190] In one embodiment of the present application, the device further comprises:
[0191] A second angle obtaining module is used to obtain a target observation angle of a target object relative to the display screen;
[0192] A target brightness and chromaticity determination module is used to determine target brightness and chromaticity information corresponding to the target observation angle based on the corresponding relationship;
[0193] The display screen correction module is used to determine the correction coefficient of the lamp beads in the display screen by using the target brightness and chromaticity information, and correct the brightness and chromaticity of the lamp beads in the display screen according to the correction coefficient.
[0194] In one embodiment of the present application, the second angle obtaining module is specifically configured to:
[0195] Obtaining a target observation angle of a target object relative to each lamp bead in the display screen;
[0196] The target brightness and chromaticity determination module is specifically used to:
[0197] Based on the corresponding relationship, determining the target brightness and chromaticity information corresponding to each target observation angle;
[0198] The display screen correction module is specifically used to:
[0199] For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information corresponding to the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the determined correction coefficient.
[0200] In one embodiment of the present application, the display screen correction module includes:
[0201] A reference brightness and chromaticity obtaining unit, configured to determine a reference brightness and chromaticity supported by each lamp bead based on target brightness and chromaticity information of each lamp bead in the display screen;
[0202] The display screen correction unit is used to calculate the ratio of the reference brightness and chromaticity to the target brightness and chromaticity information of each lamp bead in the display screen as a correction coefficient, and correct the brightness and chromaticity of the lamp bead in the display screen according to the correction coefficient.
[0203] In one embodiment of the present application, the reference brightness and chromaticity obtaining unit is specifically configured to:
[0204] The average value of the target brightness and chromaticity information of each lamp bead in the display screen is counted, and the difference between the average value and the preset brightness and chromaticity redundancy value is calculated as the reference brightness and chromaticity supported by each lamp bead.
[0205] In one embodiment of the present application, the display screen correction module is specifically configured to:
[0206] For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information of the lamp bead and the luminous parameters of the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the correction coefficient.
[0207] In one embodiment of the present application, the second angle obtaining module is specifically configured to:
[0208] In the case of multiple target objects, the central observation position of all target objects is determined according to the observation position of each target object;
[0209] The observation angle of the central observation position relative to the display screen is obtained as the target observation angle.
[0210] In one embodiment of the present application, the image acquisition module 1401 is specifically configured to:
[0211] When a display screen displays a red picture, a green picture, and a blue picture respectively, a plurality of binocular images are obtained by acquiring images of the display screen by a binocular camera at a fixed position.
[0212] In one embodiment of the present application, the brightness and chromaticity recognition module 1402 is specifically configured to:
[0213] For each binocular image, identifying the brightness and chromaticity information of each lamp bead of the display screen in the binocular image;
[0214] The brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on each binocular image recognition is fused to obtain the brightness and chromaticity information of each lamp bead of the display screen.
[0215] In one embodiment of the present application, the image acquisition module 1401 is specifically configured to:
[0216] When a display screen displays a red image, a green image, and a blue image, for each image, a plurality of binocular images are obtained by capturing the display screen at a fixed position with the binocular camera blocked by a first chromaticity filter, a second chromaticity filter, and a third chromaticity filter, respectively.
[0217] In the solution provided by the above embodiment, a binocular image can be obtained by capturing an image of a display screen at a fixed position using a binocular camera; the brightness and chromaticity information of each lamp bead in the display screen can be identified based on the binocular image; the binocular image is depth-processed to obtain the distance of each lamp bead in the display screen relative to the binocular camera, and the observation angle of each lamp bead in the display screen relative to the binocular camera is calculated based on the obtained distance; and a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established based on the obtained observation angle and brightness and chromaticity information of each lamp bead. In this way, a binocular camera can be used to capture an image of the display screen. After depth processing of the obtained binocular image, the observation angle of each lamp bead in the display screen can be obtained based on the above binocular image, and then the brightness and chromaticity information of the lamp bead at different observation angles can be obtained. Based on the above information, a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established, without having to move the binocular camera multiple times, thereby reducing the time consumed by moving the binocular camera. Therefore, it can be seen that the solution provided by the above embodiment can improve the efficiency of obtaining the corresponding relationship.
[0218] The present application also provides an electronic device, such as Figure 15 As shown, it includes a processor 1501, a communication interface 1502, a memory 1503 and a communication bus 1504, wherein the processor 1501, the communication interface 1502, and the memory 1503 communicate with each other through the communication bus 1504.
[0219] Memory 1503, used for storing computer programs;
[0220] The processor 1501 is configured to implement the steps of the corresponding relationship obtaining method when executing the program stored in the memory 1503 .
[0221] The communication bus mentioned in the electronic device mentioned above may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.
[0222] The communication interface is used for communication between the above electronic device and other devices.
[0223] The memory may include random access memory (RAM) or non-volatile memory (NVM), such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.
[0224] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.
[0225] In another embodiment provided by the present application, a computer-readable storage medium is further provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned methods for obtaining the corresponding relationship are implemented.
[0226] In another embodiment provided by the present application, a computer program product including instructions is also provided, which, when executed on a computer, enables the computer to execute any one of the corresponding relationship obtaining methods in the above embodiments.
[0227] In the solution provided by the above embodiment, a binocular image can be obtained by capturing an image of a display screen at a fixed position using a binocular camera; the brightness and chromaticity information of each lamp bead in the display screen can be identified based on the binocular image; the binocular image is depth-processed to obtain the distance of each lamp bead in the display screen relative to the binocular camera, and the observation angle of each lamp bead in the display screen relative to the binocular camera is calculated based on the obtained distance; and a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established based on the obtained observation angle and brightness and chromaticity information of each lamp bead. In this way, a binocular camera can be used to capture an image of the display screen. After depth processing of the obtained binocular image, the observation angle of each lamp bead in the display screen can be obtained based on the above binocular image, and then the brightness and chromaticity information of the lamp bead at different observation angles can be obtained. Based on the above information, a correspondence between the brightness and chromaticity of the lamp bead and the observation angle is established, without having to move the binocular camera multiple times, thereby reducing the time consumed by moving the binocular camera. Therefore, it can be seen that the solution provided by the above embodiment can improve the efficiency of obtaining the corresponding relationship.
[0228] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0229] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.
[0230] Each embodiment in this specification is described in a related manner. Similar portions between the various embodiments can be referenced to each other. Each embodiment focuses on the differences from other embodiments. In particular, since the apparatus embodiments, electronic device embodiments, computer-readable storage medium embodiments, and computer program product embodiments are generally similar to the method embodiments, their descriptions are relatively simple. For related portions, reference can be made to the descriptions of the method embodiments.
[0231] The above description is only a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application are included in the scope of protection of the present application.
Claims
1. A method for obtaining a corresponding relationship, characterized in that: The method comprises: Obtaining a binocular image obtained by capturing an image of a display screen by a binocular camera at a fixed position; Identify brightness and color information of each lamp bead in the display screen based on the binocular image; Performing depth processing on the binocular image to obtain the distance between each lamp bead in the display screen and the binocular camera, and calculating the observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance; Based on the obtained observation angle and brightness and chromaticity information of each lamp bead, a corresponding relationship between the brightness and chromaticity of the lamp bead and the observation angle is established; Obtaining a target observation angle of a target object relative to each lamp bead in the display screen; Based on the corresponding relationship, determining the target brightness and chromaticity information corresponding to each target observation angle; Counting the average of the target brightness and chromaticity information of each lamp bead in the display screen, and calculating the difference between the average and the preset brightness and chromaticity redundancy value as the reference brightness and chromaticity supported by each lamp bead; For each lamp bead in the display screen, a ratio of the reference brightness and chromaticity to the target brightness and chromaticity information of the lamp bead is calculated as a correction coefficient, and the brightness and chromaticity of the lamp bead in the display screen is corrected according to the correction coefficient.
2. The method according to claim 1, characterized in that For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information corresponding to the lamp bead, and the brightness and chromaticity of the lamp bead is corrected according to the determined correction coefficient, including: For each lamp bead in the display screen, the correction coefficient of the lamp bead is determined using the target brightness and chromaticity information of the lamp bead and the luminous parameters of the lamp bead, and the brightness and chromaticity of the lamp bead are corrected according to the correction coefficient.
3. The method according to claim 1, characterized in that The obtaining of a target observation angle of the target object relative to each lamp bead in the display screen includes: In the case of multiple target objects, the central observation position of all target objects is determined according to the observation position of each target object; The observation angle of the central observation position relative to the display screen is obtained as the target observation angle.
4. The method according to any one of claims 1 to 3, characterized in that The step of obtaining a binocular image obtained by capturing an image of a display screen by a binocular camera at a fixed position includes: When the display screen displays a red image, a green image, and a blue image, respectively, a plurality of binocular images are obtained by capturing the display screen at a fixed position by a binocular camera; The method of recognizing the brightness and chromaticity information of each lamp bead in the display screen based on the binocular image includes: For each binocular image, identifying the brightness and chromaticity information of each lamp bead of the display screen in the binocular image; The brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on each binocular image recognition is fused to obtain the brightness and chromaticity information of each lamp bead of the display screen.
5. The method according to claim 4, characterized in that The method of obtaining a plurality of binocular images obtained by capturing the display screen at a fixed position by a binocular camera when the display screen displays a red image, a green image, and a blue image respectively includes: When a display screen displays a red image, a green image, and a blue image, for each image, a plurality of binocular images are obtained by capturing the display screen at a fixed position with the binocular camera blocked by a first chromaticity filter, a second chromaticity filter, and a third chromaticity filter, respectively.
6. A device for obtaining a corresponding relationship, characterized in that: The device comprises: An image acquisition module is used to obtain a binocular image obtained by capturing an image of the display screen at a fixed position by a binocular camera; A brightness and chromaticity recognition module, configured to recognize the brightness and chromaticity information of each lamp bead in the display screen based on the binocular image; a first angle acquisition module, configured to perform depth processing on the binocular image, obtain the distance between each lamp bead in the display screen and the binocular camera, and calculate the observation angle of each lamp bead in the display screen relative to the binocular camera based on the obtained distance; A corresponding relationship obtaining module is used to establish a corresponding relationship between the brightness and chromaticity of the lamp beads and the observation angle based on the obtained observation angle and brightness and chromaticity information of each lamp bead; A second angle obtaining module is used to obtain a target observation angle of a target object relative to each lamp bead in the display screen; A target brightness and chromaticity determination module is used to determine target brightness and chromaticity information corresponding to each target observation angle based on the corresponding relationship; Display screen calibration module, including: a reference brightness and chromaticity obtaining unit, configured to calculate the mean of target brightness and chromaticity information of each lamp bead in the display screen, and calculate the difference between the mean and a preset brightness and chromaticity redundancy value as the reference brightness and chromaticity supported by each lamp bead; The display screen correction unit is used to calculate the ratio of the reference brightness and chromaticity to the target brightness and chromaticity information of each lamp bead in the display screen as a correction coefficient, and correct the brightness and chromaticity of the lamp bead in the display screen according to the correction coefficient.
7. The device according to claim 6, characterized in that The display screen correction module is specifically used to: For each lamp bead in the display screen, using the target brightness and chromaticity information of the lamp bead and the luminous parameters of the lamp bead, a correction coefficient of the lamp bead is determined, and the brightness and chromaticity of the lamp bead is corrected according to the correction coefficient; The second angle obtaining module is specifically configured to: In the case of multiple target objects, the central observation position of all target objects is determined according to the observation position of each target object; Obtaining an observation angle of the central observation position relative to the display screen as a target observation angle; The brightness and chromaticity recognition module is specifically used to: For each binocular image, identifying the brightness and chromaticity information of each lamp bead of the display screen in the binocular image; The brightness and chromaticity information of the same lamp bead in the brightness and chromaticity information obtained based on each binocular image recognition is integrated to obtain the brightness and chromaticity information of each lamp bead of the display screen; The image acquisition module is specifically used to: When a display screen displays a red image, a green image, and a blue image, for each image, a plurality of binocular images are obtained by capturing the display screen at a fixed position with the binocular camera blocked by a first chromaticity filter, a second chromaticity filter, and a third chromaticity filter, respectively.
8. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; Memory for storing computer programs; A processor, configured to implement the method steps described in any one of claims 1 to 5 when executing a program stored in a memory.
9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method steps described in any one of claims 1 to 5 are implemented.
Citation Information
Patent Citations
Display screen correction method and device
CN112185299A