Method and apparatus for acquiring optical information of display screen, and nonvolatile storage medium

Abstract

The application discloses a method and device for acquiring optical information of a display screen and a nonvolatile storage medium. The method comprises the following steps: acquiring a position calibration image of the display screen and optical information extraction image of the display screen, wherein the optical information extraction image is used for extracting optical information of the display screen, the position calibration image is used for calibrating the position of a lamp point in the optical information extraction image, or the position calibration image is used for establishing a corresponding relationship between the position of the lamp point in the display screen and the position of the lamp point in the optical information extraction image; and acquiring the optical information of the display screen according to the position calibration image and the optical information extraction image, wherein the optical information comprises at least one of the following: brightness information, chrominance information and luminous flux information. The application solves the technical problem that the optical information extraction is inaccurate due to the inaccurate positioning of the lamp point caused by the influence of the resolution of the display screen, camera error or other factors.

Description

Technical Field

[0001] This application relates to the field of display technology, and more specifically, to a method and apparatus for acquiring optical information of a display screen, and a non-volatile storage medium. Background Technology

[0002] When performing optical processing on a display screen, it is often necessary to acquire the screen's optical information and then perform optical processing based on this information. This optical processing includes various procedures, such as display screen calibration, display screen uniformity evaluation, and display screen defect evaluation.

[0003] Currently, methods for extracting optical information require acquiring images of the display screen. These images are used to extract the screen's optical information, and then the LEDs are located based on these images. The optical information of the display screen is then obtained based on the location of these LEDs. However, due to factors such as display screen resolution, camera errors, or other factors, the LED location may be inaccurate, leading to inaccurate extraction of optical information.

[0004] There is currently no effective solution to the above problems. Summary of the Invention

[0005] This application provides a method and apparatus for acquiring optical information of a display screen, as well as a non-volatile storage medium, to at least solve the technical problem that inaccurate lamp positioning and thus inaccurate extraction of optical information are caused by the influence of display screen resolution, camera error or other factors.

[0006] According to one aspect of the embodiments of this application, a method for obtaining optical information of a display screen is provided, comprising: obtaining a position calibration image of the display screen and an optical information extraction image of the display screen, wherein the optical information extraction image is used to extract optical information of the display screen, the position calibration image is used to calibrate the position of lamp points in the optical information extraction image, or the position calibration image is used to establish a correspondence between the position of lamp points in the display screen and the position of lamp points in the optical information extraction image; obtaining optical information of the display screen based on the position calibration image and the optical information extraction image, wherein the optical information includes at least one of the following: brightness information, chromaticity information, and luminous flux information.

[0007] Unlike traditional methods that only acquire optical extraction images, this application not only acquires optical information extraction images but also additionally acquires position calibration images. Based on the position calibration images, the positions of the light points on the optical extraction images are calibrated, thereby improving the accuracy of light point positioning on the optical extraction images.

[0008] Optionally, the location calibration image includes multiple illuminated areas, with the remaining areas being non-illuminated areas; or the location calibration image includes multiple illuminated areas and multiple non-illuminated areas, with the illuminated and non-illuminated areas alternating; or the location calibration image includes multiple discontinuous illuminated points, with the remaining areas being non-illuminated points.

[0009] The above method provides various types of location calibration images, and the scheme is highly flexible and effective.

[0010] Optionally, the above method further includes: acquiring pattern information of a preset pattern, wherein the position calibration image is an image of the preset pattern displayed on the display screen; determining the position of at least one of the illuminated and unilluminated light points in the display screen based on the pattern information of the preset pattern; obtaining the optical information of the display screen based on the position calibration image and the optical information extraction image, including: calibrating the position of the light points in the optical information extraction image based on the position of at least one of the illuminated and unilluminated light points in the display screen and the position of at least one of the illuminated and unilluminated light points in the position calibration image; and obtaining the optical information of the display screen based on the calibrated positions of the light points and the optical information extraction image.

[0011] The above method can be used to calibrate the position in the light information extraction image, thereby improving the accuracy of determining the position of the light point.

[0012] Optionally, the preset pattern is specifically used to determine the imaging position of some light points in the display screen; or the preset pattern is used to divide the display screen into multiple sub-display areas, and the preset pattern is specifically used to establish the correspondence between the sub-display areas of the display screen and the sub-images of the optical information extraction image, wherein the shape of the sub-display area is rectangular or non-rectangular.

[0013] The above method can improve the accuracy of lamp location in the optical information extraction image, thereby improving the accuracy of the acquired optical information. Furthermore, the display area of ​​the screen can be divided into multiple sub-display areas using the position calibration image, thus achieving the technical effect of extracting the optical information of the screen in different areas.

[0014] Optionally, the position calibration image is an image of a preset pattern displayed on the display screen; wherein, the preset pattern is used to divide the display screen into multiple sub-display areas, and the optical information of the display screen is obtained by extracting images based on the position calibration image and optical information, including: obtaining multiple sub-images of the optical information extraction image based on the position calibration image, wherein the multiple sub-images correspond one-to-one with the multiple sub-display areas; and obtaining the optical information of the display screen based on the optical information of each sub-image among the multiple sub-images.

[0015] By using the above method, and establishing a correspondence between sub-images and sub-display areas through partitioning, the optical information of the display screen can be extracted in different regions, which helps to improve the accuracy of optical information extraction.

[0016] Optionally, the above method further includes: obtaining pattern information of a preset pattern; obtaining the resolution of each sub-display area in the display screen based on the pattern information; obtaining the optical information of the display screen based on the optical information of each sub-image in multiple sub-images, including: sampling the sub-images so that the resolution of the sampled sub-images is equal to the resolution of the corresponding sub-region, so as to obtain the optical information of the display screen.

[0017] By using the above method, since the pixel sizes occupied by the light points in the area are relatively similar, the position of the light points can be obtained more accurately, which can improve the accuracy of determining the position of the light points.

[0018] Optionally, based on the position calibration image, multiple sub-images of the optical information extraction image are obtained, including: obtaining region information of multiple sub-display areas based on the position calibration image; and dividing the optical information extraction image into multiple sub-images based on the region information.

[0019] Using the above method, the optical information is extracted and the image is divided according to the regional information. This scheme is simple to operate and easy to implement.

[0020] Optionally, the above method further includes: obtaining relative position information of multiple sub-display areas based on the position calibration image; obtaining optical information of the display screen based on the optical information of each sub-image in the multiple sub-images, including: stitching the optical information of the sub-images based on the relative position information to obtain the optical information of the display screen.

[0021] The above method can be used to stitch together the optical information extracted from different regions to obtain the optical information of the entire display screen.

[0022] Optionally, the position calibration image includes at least one monochrome image, and the optical information extraction image includes at least one monochrome image. Acquiring the position calibration image and the optical information extraction image displayed on the screen includes: acquiring the position calibration image and the optical information extraction image corresponding to the monochrome image; obtaining the optical information of the screen based on the position calibration image and the optical information extraction image includes: obtaining the optical information of the screen when displaying monochrome based on the position calibration image and the optical information extraction image corresponding to the monochrome image.

[0023] Using the above method, the colors of the position calibration image and the optical information extraction image are consistent, which helps improve the accuracy of the optical information extraction image. For example, for red, green, and blue light points, the positions of the three light points are different. Setting a position calibration image for each color helps improve the accuracy of the acquired optical information.

[0024] Optionally, the position calibration image specifically includes a first monochrome image and a second monochrome image, and the optical information extraction image specifically includes a first monochrome image and a second monochrome image. Acquiring the position calibration image and the optical information extraction image displayed on the screen includes: after acquiring the position calibration image and the optical information extraction image corresponding to the first monochrome image, acquiring the position calibration image and the optical information extraction image corresponding to the second monochrome image.

[0025] The above method allows for the sequential acquisition of position calibration images and optical information extraction images of different colors when the position calibration image and optical information extraction image include multiple colors. This facilitates timely processing of the optical information extraction image.

[0026] Optionally, the above method further includes: performing perspective transformation on the position calibration image and the optical information extraction image to obtain the transformed position calibration image and the transformed optical information extraction image, wherein the transformed position calibration image and the transformed optical information extraction image are both rectangular; obtaining the optical information of the display screen based on the position calibration image and the optical information extraction image, including: obtaining the optical information of the display screen based on the transformed position calibration image and the transformed optical information extraction image.

[0027] By performing perspective transformation processing on the acquired initial position calibration image and optical information extraction image, the accuracy of acquiring optical information from the display screen can be improved.

[0028] Optionally, the imaging of the light spots in the above-mentioned optical information extraction images overlaps.

[0029] The above method, when combined with this approach, yields better results when there is overlap in the optical information extraction images. This is because if there is overlap in the optical information extraction images, it is difficult to accurately extract the optical information without a positional calibration image. Furthermore, the overlap of light points in the optical information extraction images also indicates that the acquisition device can acquire a larger resolution display screen in a single operation.

[0030] Optionally, the overlapping of the imaging of light points in the optical information extraction image specifically includes: the spatial light distribution curve corresponding to the first light point in the optical information extraction image and the spatial light distribution curve corresponding to the second light point in the optical information extraction image overlap, wherein the first light point and the second light point are any two adjacent light points in the optical information extraction image, the horizontal axis of the spatial light distribution curve is used to characterize the position of the light point, and the vertical axis of the spatial light distribution curve is used to characterize the DN value, brightness value, or gray value of the light point; or in the cross-sectional view of the photosensitive element imaging of the optical information extraction image, the curves corresponding to the first light point and the second light point overlap, wherein the first light point and the second light point are any two adjacent light points in the optical information extraction image.

[0031] By using the above method, and by changing the imaging state of the display screen LEDs when the optical acquisition device acquires images, so that the LEDs are somewhat connected, the pixel utilization rate of the optical acquisition device can be improved.

[0032] Optionally, before acquiring the optical information extraction image, the above method further includes: acquiring a test image displayed on the screen in the lit state by the acquisition device, wherein the imaging of the lamp points in the test image overlaps; and determining that the acquisition parameters of the acquisition device have been adjusted after determining that the imaging of the lamp points in the test image meets the preset conditions, wherein the optical information extraction image is acquired by the acquisition device whose acquisition parameters have been adjusted.

[0033] By adjusting the parameters of the acquisition device using the above methods until the preset conditions are met, the accuracy of the acquisition can be greatly improved.

[0034] Optionally, if the imaging of the light points in the test image meets preset conditions, the acquisition parameters of the acquisition device are determined to be adjusted, including: if the overlap of the imaging of the light points in the test image reaches a first preset range, the acquisition parameters of the acquisition device are determined to be adjusted; or if the relationship between the maximum and minimum gray levels of the preset area in the test image is within a second preset range, the acquisition parameters of the acquisition device are determined to be adjusted; or if the relationship between the maximum and minimum brightness of the preset area in the test image is within a third preset range, the acquisition parameters of the acquisition device are determined to be adjusted.

[0035] By adjusting the acquisition parameters of the optical acquisition device, the imaging state of the display screen's LEDs can be changed, thereby achieving a certain degree of adhesion between the LEDs on the display screen.

[0036] According to another aspect of the embodiments of this application, an optical processing method for a display screen is also provided, comprising: receiving first indication information and second indication information, wherein the first indication information is used to instruct the display screen to display a position calibration image, the second indication information is used to instruct the display screen to display an optical information extraction image, the position calibration image is used to calibrate the position of lamp points in the optical information extraction image, or the position calibration image is used to establish a correspondence between the position of lamp points in the display screen and the position of lamp points in the optical information extraction image, and the optical information extraction image is used to extract optical information of the display screen, the optical information including at least one of the following: brightness information, chromaticity information, and luminous flux information; and controlling the display screen to display the position calibration image and the optical information extraction image according to the first indication information and the second indication information.

[0037] Optionally, controlling the display screen to display a position calibration image and an optical information extraction image according to the first instruction information and the second instruction information includes: controlling the display screen to display a position calibration image of a first color and an optical information extraction image of the first color according to the first instruction information and the second instruction information, controlling the display screen to display a position calibration image of a second color and an optical information extraction image of the second color, and controlling the display screen to display a position calibration image of a third color and an optical information extraction image of the third color.

[0038] Using the above method, when the position calibration image and the optical information extraction image include multiple colors, the order in which the control display screen displays position calibration images and optical information extraction images of different colors is limited.

[0039] According to another aspect of the embodiments of this application, an apparatus for acquiring optical information of a display screen is also provided, comprising: an acquisition module, configured to acquire a position calibration image of the display screen and an optical information extraction image of the display screen, wherein the optical information extraction image is used to extract optical information of the display screen, and the position calibration image is used to calibrate the position of the light points in the optical information extraction image, or the position calibration image is used to establish a correspondence between the position of the light points in the display screen and the position of the light points in the optical information extraction image; and a processing module, configured to obtain the optical information of the display screen based on the position calibration image and the optical information extraction image, wherein the optical information includes at least one of the following: brightness information, chromaticity information, and luminous flux information.

[0040] According to another aspect of the embodiments of this application, a non-volatile storage medium is also provided. The non-volatile storage medium includes a stored program, wherein, when the program is running, it controls the device where the non-volatile storage medium is located to execute the above-described method for acquiring optical information of a display screen or the optical processing method of a display screen.

[0041] According to another aspect of the embodiments of this application, a processor is also provided, which is used to run a program stored in a memory, wherein the program executes the above-described method for acquiring optical information of a display screen or the optical processing method of a display screen when it runs.

[0042] In this embodiment, unlike the traditional method of simply acquiring optical extraction images, this application not only needs to acquire optical information extraction images, but also additionally acquires position calibration images. Based on the position calibration images, the positions of the light points on the optical extraction images are calibrated, thereby improving the accuracy of light point positioning on the optical extraction images and solving the technical problem of inaccurate optical information extraction due to inaccurate light point positioning. Attached Figure Description

[0043] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0044] Figure 1 This is a flowchart of a method for acquiring optical information of a display screen according to an embodiment of this application;

[0045] Figure 2 This is a schematic diagram of an optical information extraction image according to an embodiment of this application;

[0046] Figure 3a This is a schematic diagram of another positional calibration image according to an embodiment of this application;

[0047] Figure 3b This is a schematic diagram of another positional calibration image according to an embodiment of this application;

[0048] Figure 3c This is a schematic diagram of another positional calibration image according to an embodiment of this application;

[0049] Figure 3d This is a schematic diagram illustrating the application of a positional calibration image according to an embodiment of this application;

[0050] Figure 3e This is a schematic diagram illustrating the application of another positional calibration image according to an embodiment of this application;

[0051] Figure 4 This is a schematic diagram of a preset pattern application according to an embodiment of this application;

[0052] Figure 5a This is a schematic diagram of an initial position calibration image and an optical information extraction image acquired according to an embodiment of this application;

[0053] Figure 5bAccording to an embodiment of this application, a method of... Figure 5a A schematic diagram of the image after perspective transformation processing;

[0054] Figure 6a A waveform diagram of a display screen image obtained by acquiring the display screen is shown;

[0055] Figure 6b A waveform diagram of another display screen image obtained by capturing the display screen is shown;

[0056] Figure 6c This diagram illustrates another waveform of a display screen image obtained by capturing the display screen.

[0057] Figure 6d This diagram illustrates another waveform of a display screen image obtained by capturing the display screen.

[0058] Figure 7 This is a flowchart of a method for acquiring optical information of a display screen according to an embodiment of this application;

[0059] Figure 8 This is a flowchart of another method for extracting optical information from a display screen according to an embodiment of this application;

[0060] Figure 9 This is a structural block diagram of a device for acquiring optical information of a display screen according to an embodiment of this application. Detailed Implementation

[0061] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0062] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0063] First, some of the nouns or terms that appear in the description of the embodiments of this application can be interpreted as follows:

[0064] Brightness information: can be used to characterize the degree of brightness.

[0065] Chromaticity information: can be used to characterize the hue and / or saturation of a color.

[0066] Luminous flux information: used to characterize the luminous flux per unit area.

[0067] It should be understood that the above explanation is only for understanding this embodiment, and the explanation of the brightness information, chromaticity information, and luminous flux information is also applicable to other interpretations by those skilled in the art.

[0068] It should be understood that the method for obtaining optical information of a display screen in this application can be used in a variety of application scenarios. For example, the optical information obtained by the method of this application can be used for display screen calibration, uniformity evaluation, defect detection of the display screen, etc.

[0069] It should be understood that the display screen in this application can be of various types, such as LED, LCD, OLED, microLED, miniLED, SMD, COB, etc. Any display screen capable of display can employ the method described in this application to extract optical information.

[0070] This application provides an embodiment of a method for acquiring optical information of a display screen. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0071] Figure 1 This is a flowchart illustrating a method for acquiring optical information of a display screen according to an embodiment of this application. Optionally, this method can be executed by a computer device or a device equipped with a processor; this application is not limited thereto. The following description uses a computer executing the method as an example. Figure 1 As shown, the method includes the following steps:

[0072] Step S102: Obtain the position calibration image of the display screen and the optical information extraction image of the display screen. The optical information extraction image is used to extract the optical information of the display screen, and the position calibration image is used to calibrate the positions of the light points in the optical information extraction image, or to establish the correspondence between the positions of the light points on the display screen and the positions of the light points in the optical information extraction image. It should be understood that the position of a light point can be the position of a single light point, the position of multiple light points, or the position of a continuous area of ​​light points (i.e., the position of a region).

[0073] According to an optional embodiment of this application, the optical information extraction image and the position calibration image are images captured by the optical acquisition device when two types of images are displayed on the screen, respectively. In this step, the optical information extraction image and the position calibration image displayed on the screen are captured by an optical acquisition device (e.g., a high-definition camera, an optical camera, an industrial camera, etc.).

[0074] The image extracted by optical information can be a monochrome image displayed on a screen. For example, it can be a red image, a green image, a blue image, or a white image, etc. Optionally, it can be a red, green, and blue three-primary-color image.

[0075] Figure 2 This is a schematic diagram of an optical information extraction image according to an embodiment of this application, such as... Figure 2 As shown, the illuminated light points in the optical information extraction image can be any of the three primary colors.

[0076] Step S104: Extract the image based on the position calibration image and optical information to obtain the optical information of the display screen. The optical information includes at least one of the following: brightness information, chromaticity information, and luminous flux information. Optionally, the optical information of the display screen can be the optical information of each area of ​​the display screen or the optical information of each lamp point in the display screen, which can be flexibly determined according to actual needs.

[0077] Using the above method, the position calibration image is used to calibrate the positions of the light points in the optical information extraction image, or to establish the correspondence between the positions of the light points on the display screen and the positions of the light points in the optical information extraction image. In other words, with the position calibration image, the positions of the light points in the optical information extraction image can be corrected, thereby improving the accuracy of optical information extraction by performing optical information extraction based on the corrected positions.

[0078] Optionally, obtaining the optical information of the display screen by extracting an image based on a position calibration pattern and optical information may include: calibrating the position of the light points in the light information extraction image based on the position calibration image, and sampling the calibrated light information extraction image so that the resolution of the sampled light information extraction image is equal to the resolution of the display screen.

[0079] Typically, multiple pixels in an image are used to represent the imaging of a single light point. Based on this, this application samples the light information extraction image so that the resolution of the sampled light information extraction image is equal to the resolution of the display screen. This mainly refers to downsampling the light information extraction image. However, due to differences in acquisition devices, upsampling is also possible. If it is upsampling, it also falls within the protection scope of this application.

[0080] Optionally, the sampling of images in this application may include various image sampling methods used by those skilled in the art, such as loss of value, mean, and interpolation. Regardless of the sampling method used, the goal is to make the resolution of the sampled optical information extracted image equal to the resolution of the display screen.

[0081] According to an optional embodiment of this application, the location calibration image includes multiple illuminated areas, and the rest are non-illuminated areas; or the location calibration image includes multiple illuminated areas and multiple non-illuminated areas, with the illuminated areas and non-illuminated areas alternating; or the location calibration image includes multiple discontinuous illuminated light points, and the rest are non-illuminated light points.

[0082] Figure 3a This is a schematic diagram of another location calibration image according to an embodiment of this application, such as... Figure 3a As shown, the location calibration image includes multiple illuminated areas ( Figure 3a The black areas in the image are mostly unlit, except for a few lit areas. Figure 3a (The white area in the middle).

[0083] Figure 3b This is a schematic diagram of another location calibration image according to an embodiment of this application, such as... Figure 3b As shown, the location calibration image includes multiple illuminated areas ( Figure 3b The black area in the image) and multiple non-lit areas, lit areas and non-lit areas ( Figure 3b The white areas in the middle are arranged alternately.

[0084] Figure 3c This is a schematic diagram of another location calibration image according to an embodiment of this application, such as... Figure 3c As shown, the location calibration image includes multiple discontinuous lit light points ( Figure 3c The black circular area in the image contains several non-lit light points, with the exception of several discontinuous lit light points. Figure 3c (The white circular area in the image). It should be understood that this illuminated light is a single-color light. For example, only the red light is illuminated.

[0085] It should be understood that the above position calibration images are merely examples. In short, any image that can be used to calibrate the position of light points in an image from which optical information is extracted falls within the scope of this application. The above method provides various types of position calibration images, allowing for flexible determination of the image type based on actual conditions.

[0086] According to an optional embodiment of this application, the method further includes: acquiring pattern information of a preset pattern, wherein the position calibration image is an image of the preset pattern displayed on the display screen; determining the position of at least one of the illuminated and unilluminated light points in the display screen based on the pattern information of the preset pattern; obtaining the optical information of the display screen based on the position calibration image and the optical information extraction image, including: calibrating the position of the light point in the optical information extraction image based on the position of at least one of the illuminated and unilluminated light points in the display screen and the position of at least one of the illuminated and unilluminated light points in the position calibration image; and obtaining the optical information of the display screen based on the calibrated position of the light point and the optical information extraction image.

[0087] In other words, in this application, the computer can obtain pattern information of a preset pattern, and based on the pattern information of the preset pattern, it can determine the correspondence between the position of the light spot on the display screen and the position of the light spot in the image, so as to correct the position of the light spot in the image from the optical information extraction.

[0088] Optionally, the pattern information can be used to characterize the specific details of the preset pattern. For example, it may include at least one of the following: illuminated dot information (which can be used to determine which locations on the display screen are illuminated), illuminated area information (which can be used to determine which areas on the display screen are illuminated, or the size, shape, resolution, etc. of the illuminated areas on the display screen). For example, the pattern information may include: the display screen resolution is 1920*1080, the screen is displayed in a checkerboard pattern, and each checkerboard grid includes 64*60 pixels.

[0089] Furthermore, obtaining the pattern information for the preset pattern can include various methods, such as receiving user instructions or automatic generation by the computer based on the screen resolution. For example, the computer can determine that the preset pattern is an m*n checkerboard pattern based on the screen resolution. The corresponding pattern information for this preset pattern could include: the screen resolution is M*N, the number of row lights in the checkerboard is m, and the number of column lights is n. Based on the pattern information of the position calibration pattern, the computer can determine that the optical information calibration image should be divided into (M*N) / (m*n) regions, with each region containing m*n pixels, thereby completing the calibration of the light point positions in the optical information extraction image.

[0090] According to an optional embodiment of this application, the preset pattern is specifically used to determine the imaging position of some light points in the display screen; or the preset pattern is used to divide the display screen into multiple sub-display areas, and the preset pattern is specifically used to establish the correspondence between the sub-display areas of the display screen and the sub-images of the optical information extraction image, wherein the shape of the sub-display area can be rectangular or non-rectangular.

[0091] The positional calibration image is a preset pattern displayed on the screen. The positional calibration image includes, but is not limited to, checkerboard, crosshairs, Aruco codes, scatter dots, special lines, etc. Any pattern that can divide the area can be used.

[0092] It should be noted that the special lines mentioned above can be several vertical lines. For example, displaying three vertical lines on a screen can divide the display area into four sub-display areas. The Aruco code mentioned above is a binary code, a square code composed of only black and white colors. The scattered dots mentioned above are a pattern composed of multiple dots.

[0093] It should be noted that any pattern that can divide the display area of ​​the screen or determine the position of some light points can be used as a positional calibration image. Optionally, assuming that the preset pattern is used to divide the display area, the preset pattern can be not only a checkerboard, regular lines, or regular light points, as long as the display area can be divided according to the preset pattern.

[0094] Figure 3d This is a schematic diagram illustrating the application of a location calibration image according to an embodiment of this application, such as... Figure 3d As shown, the position calibration image is a grid pattern. After dividing the display screen into multiple sub-display areas using the grid pattern, each sub-display area corresponds to a sub-image of the optical information extraction image, thus establishing the correspondence between each sub-display area and the sub-image of the optical information extraction image.

[0095] Figure 3eThis is a schematic diagram illustrating the application of another location calibration image according to an embodiment of this application. Figure 3e The diagram on the left is a schematic diagram of the actual position coordinates of some of the lights on the display screen. The relative positional relationship between each light in the diagram is fixed. Figure 3e The image on the right is a schematic diagram of the position calibration image, such as... Figure 3e As shown, the location calibration image is a scatter plot consisting of multiple points, with each point in the image corresponding one-to-one with a light point in the left image. It can be seen from the image that the relative positional relationships between the scattered points in the location calibration image have changed relative to the actual positional relationships between the light points.

[0096] As an alternative example, the calibration information of the position calibration image can be determined based on the actual position of the scatter point on the display screen and its position in the position calibration image. The optical information extraction image can be deformed based on the calibration information so that the light points on the optical information extraction image can correspond to the actual light points on the display screen. For example, the optical information extraction image can be stretched.

[0097] Alternatively, calibration information can be obtained by comparing the actual relative positions of the scattered points with the positional relationships between the scattered points in the position calibration image. The positions of the light points in the optical information extraction image can then be corrected based on this calibration information.

[0098] According to an optional embodiment of this application, the multiple sub-display areas are rectangular in shape. Further optionally, the multiple sub-areas can be uniform rectangles of the same size and shape, such as a checkerboard pattern. Further optionally, in some cases, since the display resolution is not divisible by the checkerboard resolution, the last row or column of the checkerboard pattern on the display screen may have a different shape than the preceding checkerboard patterns.

[0099] In some optional embodiments of this application, the position calibration image is an image of a preset pattern displayed on the display screen; wherein, the preset pattern is used to divide the display screen into multiple sub-display areas, and step S104 is performed to extract images based on the position calibration image and optical information to obtain the optical information of the display screen, which is achieved by the following method: based on the position calibration image, multiple sub-images of the optical information extraction image are obtained, and the multiple sub-images correspond one-to-one with multiple sub-display areas; based on the optical information of each sub-image in the multiple sub-images, the optical information of the display screen is obtained.

[0100] Figure 4 This is a schematic diagram illustrating a preset pattern application according to an embodiment of this application, such as... Figure 4 As shown, Figure 4 The image at the top left shows the actual screen displaying the preset pattern. Figure 4 The image at the top right is a location calibration image. Figure 4The lower left corner displays an image of the optically extracted pattern. Figure 4 The lower right corner shows the corresponding optical information extraction image. The image is divided into multiple sub-images based on the location calibration image. Using the location calibration image allows for accurate partitioning of the optical information extraction image, and performing optical information extraction based on each partition reduces errors.

[0101] For example, assuming a display screen has a resolution of 128*128, directly extracting optical information from the optical information extraction image based on the resolution and the fixed spacing L between the light points would result in a large error. However, if the 128*128 display screen is divided into 64 sub-regions, each with 16*16 light points, the optical information extraction image can also be divided into 64 sub-images. Then, the luminous flux of each sub-image can be extracted based on the 16*16 light points (optionally, each sub-image can be sampled so that its resolution is equal to 16*16, thus obtaining the luminous flux of each light point corresponding to the sub-image), which can reduce the error.

[0102] like Figure 4 As shown, taking a checkerboard pattern as an example for position calibration, the optical information extraction image is divided into multiple sub-images using the checkerboard pattern, with each sub-image corresponding to a sub-display area of ​​the screen. By extracting the optical information of each sub-image, the optical information of the entire screen can be obtained.

[0103] The above method can be used to extract optical information from the display screen in different areas, which helps to improve the accuracy of optical information extraction.

[0104] In some optional embodiments of this application, the method further includes: obtaining pattern information of a preset pattern; and obtaining the resolution of each sub-display area in the display screen based on the pattern information. It should be noted that the sum of the resolutions of each sub-display area in the display screen is the same as the resolution of the entire display screen.

[0105] The optical information of the display screen is obtained based on the optical information of each sub-image in multiple sub-images, including the following steps: sampling the sub-images so that the resolution of the sampled sub-images is equal to the resolution of the corresponding sub-region, so as to obtain the optical information of the display screen.

[0106] In this step, each sub-image is sampled until the resolution of the sampled sub-image is the same as the resolution of the corresponding sub-display area. Since the relative positions between the lamp points remain fixed before and after sampling, the sampled data can be directly used as the optical information of the actual lamp points. The sampled data obtained from sampling each sub-image can be directly used as the optical information of the corresponding sub-display area.

[0107] For example, if the display screen has a resolution of 1920x1080, and assuming the screen is evenly divided into 64 sub-display areas, each with a resolution of 240*135, then the corresponding optical information extraction map is divided into 64 sub-images, each containing 240*135 light points. Each sub-image is then sampled so that the resolution of the sampled sub-image is equal to 240*135.

[0108] In an optional embodiment of this application, multiple sub-images of the optical information extraction image are obtained based on the position calibration image. This can also be achieved by: obtaining region information of multiple sub-display areas based on the position calibration image; and dividing the optical information extraction image into multiple sub-images based on the region information.

[0109] Optionally, the area information of the aforementioned sub-display areas includes, but is not limited to, the coordinate data, length, and width of the sub-display areas. In other words, the coordinate data or length and width of each sub-display area can be determined using the positional calibration image, thereby dividing the optical information extraction image into multiple sub-images. Taking a checkerboard pattern as an example of the positional calibration image, the corner points of the checkerboard pattern can be identified, and the outline of each checkerboard pattern can be determined based on the corner point identification results, thus realizing the division of the display area of ​​the screen using the checkerboard pattern. Each sub-display area obtained corresponds to a sub-image of the optical information extraction image.

[0110] In another optional embodiment of this application, the method further includes: obtaining relative position information of multiple sub-display areas based on a position calibration image; and obtaining optical information of the display screen based on the optical information of each sub-image, including: stitching together the optical information of the sub-images based on the relative position information to obtain the optical information of the display screen. In this step, relative position information of each sub-display area can also be obtained based on the position calibration image, and then the optical information corresponding to each sub-display area is stitched together based on the relative position information of each sub-display area to obtain the optical information corresponding to the entire display screen. Through the above method, the technical effect of stitching together the optical information extracted from different regions to obtain the optical information of the entire display screen can be achieved.

[0111] In an optional embodiment, the location calibration image includes at least one monochrome image, and the optical information extraction image includes at least one monochrome image. For example, the optical information extraction image may be a red image, a green image, or a blue image, and the location calibration image may also be a red image, a green image, or a blue image.

[0112] Step S102 involves acquiring the position calibration image and optical information extraction image displayed on the screen, including the following steps: acquiring the position calibration image and optical information extraction image corresponding to monochrome. Step S104 involves obtaining the optical information of the screen based on the position calibration image and optical information extraction image, including obtaining the optical information of the screen when displaying monochrome based on the position calibration image and optical information extraction image corresponding to monochrome. As an optional embodiment, the position calibration image and optical information extraction image displayed on the screen have the same color. For example, if the position calibration image is red, the optical information extraction image is also red, and the obtained optical information of the screen is the optical information when the screen displays a red image; if the position calibration image is green, the optical information extraction image is also green, and the obtained optical information of the screen is the optical information when the screen displays a green image; if the position calibration image is blue, the optical information extraction image is also blue, and the obtained optical information of the screen is the optical information when the screen displays a blue image. By using the above method, the colors of the position calibration image and optical information extraction image are defined, and the colors of the two images displayed on the screen are kept consistent, which helps to improve the accuracy of optical information extraction.

[0113] In some optional embodiments of this application, the position calibration image specifically includes a first monochrome image and a second monochrome image, and the optical information extraction image specifically includes a first monochrome image and a second monochrome image. The position calibration image and the optical information extraction image displayed on the screen are acquired by the following method: after acquiring the position calibration image and the optical information extraction image corresponding to the first monochrome image, the position calibration image and the optical information extraction image corresponding to the second monochrome image are acquired. Optionally, in this application, position calibration images for all colors can be acquired first, followed by optical information extraction images for all colors; alternatively, optical information extraction images and position calibration images can be acquired sequentially according to color. Preferably, after acquiring the optical information extraction image and the position calibration image for one color, the optical information extraction image and the position calibration image for the next color are acquired.

[0114] In an optional embodiment, the location calibration image and the optical information extraction image each include monochrome images of multiple colors. For example, the location calibration image may include a red image, a green image, and a blue image; the optical information extraction image may also include a red image, a green image, and a blue image.

[0115] It should be understood that the order in which the images of different colors are acquired can be changed. However, preferably, the position calibration image and optical information extraction image of the same monochrome can be acquired first, and then the position calibration image and optical information extraction image of another monochrome can be acquired. By acquiring position calibration images and optical information extraction images of different colors in a certain order, the computer processing efficiency can be improved.

[0116] According to an optional embodiment of this application, it is also necessary to perform perspective transformation on the position calibration image and the optical information extraction image to obtain the transformed position calibration image and the transformed optical information extraction image. The transformed position calibration image and the transformed optical information extraction image are both rectangular in shape. Based on the position calibration image and the optical information extraction image, the optical information of the display screen is obtained, including: based on the transformed position calibration image and the transformed optical information extraction image, the optical information of the display screen is obtained.

[0117] Figure 5a This is a schematic diagram of the initial position calibration image and the optical information extraction image, as shown below. Figure 5a As shown, typically, because the acquisition device is not directly facing the display screen, the image is somewhat distorted. Therefore, the image can be straightened to form a straight rectangle, such as... Figure 5b As shown, it is to Figure 5a The image shown is a schematic diagram after perspective transformation processing. In the embodiments provided in this application, the initial position calibration image and the optical information extraction image are respectively stretched into rectangular images without tilting. Then, the optical information of the display screen is obtained by using the position calibration image and the optical information extraction image after perspective transformation processing, which can improve the accuracy of obtaining the optical information of the display screen.

[0118] According to an optional embodiment of this application, the imaging of the light spots in the above-described optical information extraction image overlaps.

[0119] Figure 6a This diagram illustrates a waveform representation of a display screen image obtained by capturing the display screen, such as... Figure 6a As shown, ideally, the LED images in the display screen image do not overlap (or there are dark bands between the LED images), and the corresponding LED image waveforms in the display screen image also do not overlap. In this case, the processor can extract the optical information of each LED based on the independent imaging of each LED.

[0120] Figure 6b This illustrates another waveform diagram of a display screen image obtained by capturing the display screen, such as... Figure 6bAs shown, in the development towards miniLED and microLED, the spacing between LEDs in the display screen is constantly decreasing, while the LED density in the imaging device is constantly increasing, leading to overlapping of LED images in the acquired display screen image. To extract the optical information of each LED in the display screen image, the computer, using existing methods, must independently identify the image (or waveform) corresponding to each LED based on the display screen image. If the LED images overlap in the display screen image, the computer cannot accurately extract the optical information of each LED using existing methods.

[0121] Figure 6c This illustrates another waveform diagram of a display screen image obtained by capturing the display screen, such as... Figure 6c As shown, solid lines represent the waveforms corresponding to the lit LEDs in the display image, while dashed lines represent the waveforms of the unlit LEDs located between two lit LEDs. This allows for the independent identification of the waveform corresponding to each LED in the display image when extracting its optical information. Figure 6c The method shown, which extracts optical information from a display screen by illuminating LEDs at intervals, leads to reduced pixel utilization by the optical acquisition device and lower efficiency in subsequent optical processing. Furthermore, for interval-based acquisition, on the one hand, the low pixel utilization of the acquisition device results in low efficiency; on the other hand, the interval-based images need to be stitched together to form a complete image, but the optical information obtained from interval-based acquisition differs from that obtained from point-by-point acquisition, and the stitched image cannot represent the true optical information of the display screen.

[0122] To address the aforementioned issues, the embodiments provided in this application are beneficial for improving the pixel utilization rate of the acquisition device, increasing acquisition efficiency, and obtaining more realistic optical information.

[0123] Figure 6d This illustrates another waveform diagram of a display screen image obtained by capturing the display screen, such as... Figure 6d As shown, the images of the lamps in the display screen image overlap, that is, the waveforms of the lamps overlap in the display screen image. This 6D image can be the optical information extraction image in this application. Using the method of this application, by acquiring a position calibration image and an optical information extraction image, and correcting the position of the lamps in the optical information extraction image based on the position calibration image, even if the images of the lamps in the display screen image overlap, the optical information of the lamps can be extracted relatively accurately.

[0124] Furthermore, the optical information extraction image is sampled until the resolution of the sampled image is the same as the resolution of the display screen. Since the relative positions between the light points are fixed before and after sampling, the sampled data can be directly used as the optical information of the display screen.

[0125] Unlike traditional methods that require absolute freedom of image formation for LEDs in a display screen, the LED images obtained in this application overlap. Therefore, for the same acquisition device, the method of this application can acquire more pixels at once, improving pixel utilization. For example, existing solutions require 7x7 or 5x5 pixels to represent the image of a single LED, meaning one LED image occupies 7x7 or 5x5 pixels. Using the method of this application, due to the overlapping LED images, the number of pixels occupied by one LED image is less than 5x5 (e.g., 3x3). This means that in this application, fewer than 5x5 pixels can be used to represent the image of one LED, thus improving pixel utilization. For the same acquisition device, the method of this application can acquire higher resolution display images at once, improving acquisition efficiency.

[0126] In an optional embodiment, the overlapping of light points in the optical information extraction image specifically includes: the spatial light distribution curve corresponding to the first light point in the optical information extraction image and the spatial light distribution curve corresponding to the second light point in the optical information extraction image overlap, wherein the first light point and the second light point are any two adjacent light points in the optical information extraction image, the horizontal axis of the spatial light distribution curve is used to characterize the position of the light point, and the vertical axis of the spatial light distribution curve is used to characterize the DN value, brightness value, or grayscale value of the light point; or in the cross-sectional view of the photosensitive element imaging of the optical information extraction image, the curves corresponding to the first light point and the second light point overlap, wherein the first light point and the second light point are any two adjacent light points in the first image. Optionally, in the photosensitive element imaging image, the xy coordinate can be the pixel position, and the z coordinate is the DN (Digital Number) value, brightness value, or grayscale value. Optionally, in the cross-sectional view of the photosensitive element, the horizontal axis is the position of the row / column pixels, and the vertical axis is the DN value, brightness value, or grayscale value. Optionally, the photosensitive element can be CMOS or CCD.

[0127] In an optional embodiment of this application, before acquiring the optical information extraction image, a test image displayed on the screen in a lit state is acquired by the acquisition device, wherein the images of the light points in the test image overlap. If the imaging of the light points in the test image meets preset conditions, the acquisition parameters of the acquisition device are determined to be adjusted successfully. The optical information extraction image is then acquired by the acquisition device with the adjusted acquisition parameters. As an optional embodiment, before acquiring the optical information extraction image, the acquisition parameters of the optical acquisition device need to be adjusted so that the images of the light points in the acquired image appear to overlap. Specifically, a test image is displayed on the acquisition screen, and the acquisition parameters of the optical acquisition device are adjusted to make the images of the light points in the test image overlap. If certain conditions are met, the acquisition parameter adjustment of the optical acquisition device is determined to be successful.

[0128] The acquisition parameters of the acquisition device are determined to be adjusted when the imaging of the light points in the test image meets the following conditions: the overlap of the imaging of the light points in the test image reaches a first preset range; or the relationship between the maximum and minimum gray levels of the preset area in the test image is within a second preset range; or the relationship between the maximum and minimum brightness of the preset area in the test image is within a third preset range.

[0129] Optionally, the first, second, and third preset ranges can be empirical values ​​or values ​​obtained experimentally based on the actual conditions of the acquisition device; this application does not impose any limitations on these values. For example, if the overlap of the light points in the test image reaches 10%-50%, the acquisition parameters of the acquisition device are considered to have been adjusted. As another example, if the difference between the maximum and minimum grayscale values ​​in a preset area of ​​the test image reaches 10%-30%, the acquisition parameters of the acquisition device can be considered to have been adjusted. Yet another example, if the difference between the maximum and minimum brightness values ​​in a preset area of ​​the test image reaches 10%-30%, the acquisition parameters of the acquisition device can be considered to have been adjusted.

[0130] In this application, because the light spot imaging in the obtained optical information extraction image overlaps, the parameters of the acquisition device need to be adjusted according to certain standards when adjusting the acquisition device to ensure that the light spot imaging in the image meets the requirements. In some optional embodiments of this application, before executing step S104 to obtain the optical information extraction image displayed on the screen in the lit state, a real-time image of the screen acquired by the acquisition device can also be displayed on the display interface for adjusting the acquisition parameters of the acquisition device. In this step, displaying the real-time image of the acquired screen on the display interface of the human-computer interaction device helps the user observe the state of the image acquired by the acquisition device, thereby facilitating the user to adjust the acquisition parameters of the acquisition device.

[0131] As an optional embodiment, the parameters of the acquisition device can also be adjusted based on the real-time images of the display screen acquired by the acquisition device; wherein, at least some of the images in the real-time images have overlapping light points. Besides manually adjusting the acquisition parameters of the acquisition device, the acquisition parameters can also be automatically adjusted by the acquisition device. It should be noted that, regardless of whether the adjustment is manual or automatic, the light points in some of the real-time images of the aforementioned display screen will overlap. It should be understood that there may be images in the real-time images where the light point images do not overlap, but in this application, when adjusting the acquisition device, the acquisition device is considered adjusted only when the light point images in the acquired images meet preset requirements.

[0132] Figure 7 This is a flowchart of a method for acquiring optical information of a display screen according to an embodiment of this application. To better understand this application, the above method will be described in detail below with reference to specific embodiments:

[0133] It should be understood that in this application, it is assumed that the acquisition equipment has been adjusted to meet the requirements in advance before the subsequent acquisition is carried out.

[0134] S1: The computer controls the display screen to display a preset pattern, assuming that the preset pattern is used to divide the display screen into areas.

[0135] The second step involves capturing a positional calibration image of the display screen, identifying and dividing the area, and storing the results. This is done by capturing the pattern on the screen, identifying the position and region of each bright and dark area, and then storing the results.

[0136] Step 3: The computer controls the display of the light information extraction pattern on the screen.

[0137] Step 4: Extract the image from the light information collected from the display screen, and extract the optical information of each region using the area divided in Step 2.

[0138] It should be noted that the computer-controlled display screen can show either the position calibration image or the optical information extraction image first. The above is just an example, and the specific order can be adjusted flexibly. Optionally, if red, green, and blue images all need to be acquired, the position calibration image and optical information extraction image of one color can be acquired first, followed by the acquisition of position calibration images and optical information extraction images of the other colors.

[0139] Using the location and region information of each bright and dark area identified in the second step, data is extracted from the corresponding region of the light information extraction image acquired this time, and the optical information of the region is generated from the extracted data.

[0140] Step 5: Based on the physical relative positions between the regions, stitch together the optical information generated in Step 4. In other words, stitch together the optical information based on the positional information between the regions identified in Step 2.

[0141] Step 6: Output the optical information displayed on the screen.

[0142] Step 7: Optical processing of the display screen can be performed based on the optical information. Optionally, the optical processing of the display screen may include: display screen calibration, uniformity evaluation or defect detection.

[0143] The method provided in this application segments the display area on the screen by separately acquiring a pattern for region segmentation. Subsequently, the optical information of the light information extraction image is extracted by region based on the results of pattern segmentation. Within a certain sub-region, the imaging states of the lamp points are similar. This ensures that the extracted optical information corresponds one-to-one with the actual lamp points during point-by-point optical information extraction, thereby improving the accuracy of optical information extraction.

[0144] Figure 8 This is a flowchart of an optical processing method for a display screen according to an embodiment of this application. Figure 8 This can be performed by a display controller, which can be a sending card, a receiving card, a receiving control chip (timecontrol, TCON chip), or other devices that can be used to control the display screen to light up.

[0145] like Figure 8 As shown, the method includes the following steps:

[0146] Step S802: Receive first indication information and second indication information, wherein the first indication information is used to instruct the control display screen to display a position calibration image, and the second indication information is used to instruct the control display screen to display an optical information extraction image. The position calibration image is used to calibrate the position of the light points in the optical information extraction image, or the position calibration image is used to establish a correspondence between the position of the light points in the display screen and the position of the light points in the optical information extraction image. The optical information extraction image is used to extract the optical information of the display screen, and the optical information includes at least one of the following: brightness information, chromaticity information, and luminous flux information.

[0147] Step S804: Control the display screen to display the position calibration image and the optical information extraction image according to the first instruction information and the second instruction information.

[0148] According to an optional embodiment of this application, when performing steps S802 to S804, after the sending card or receiving card receives the first indication information and the second indication information, it controls the display screen to display the position calibration image and the optical information extraction image.

[0149] It should be noted that, Figure 8 Preferred embodiments of the shown examples can be found in the descriptions of the above examples, and will not be repeated here.

[0150] According to another optional embodiment of this application, step S804, which controls the display screen to display a position calibration image and an optical information extraction image based on the first and second instruction information, includes the following steps: controlling the display screen to display a position calibration image of a first color and an optical information extraction image of the first color based on the first and second instruction information; controlling the display screen to display a position calibration image of a second color and an optical information extraction image of the second color; and controlling the display screen to display a position calibration image of a third color and an optical information extraction image of the third color. In specific implementations, the position calibration image and the optical information extraction image displayed on the display screen are the same color. For example, if the position calibration image is red, the optical information extraction image is also red; if the position calibration image is green, the optical information extraction image is also green; and if the position calibration image is blue, the optical information extraction image is also blue.

[0151] Using the above method, when the position calibration image and the optical information extraction image include multiple colors, the order in which the display screen shows position calibration images and optical information extraction images of different colors can be controlled.

[0152] Figure 9 This is a structural block diagram of a device for acquiring optical information of a display screen according to an embodiment of this application. It should be understood that a detailed description of the device can be found above, and for brevity, it will not be repeated here. Figure 9 As shown, the device includes:

[0153] The acquisition module 90 is used to acquire the position calibration image of the display screen and the optical information extraction image of the display screen. The optical information extraction image is used to extract the optical information of the display screen, and the position calibration image is used to calibrate the position of the lamps in the optical information extraction image, or the position calibration image is used to establish the correspondence between the position of the lamps in the display screen and the position of the lamps in the optical information extraction image.

[0154] The processing module 92 is used to extract the image based on the position calibration image and optical information to obtain the optical information of the display screen. The optical information includes at least one of the following: brightness information, chromaticity information and luminous flux information.

[0155] It should be noted that, Figure 9 Preferred embodiments of the shown examples can be found in [reference needed]. Figure 1 The relevant descriptions of the embodiments shown will not be repeated here.

[0156] According to an optional embodiment of this application, the location calibration image includes multiple illuminated areas, and the rest are non-illuminated areas; or the location calibration image includes multiple illuminated areas and multiple non-illuminated areas, with the illuminated areas and non-illuminated areas alternating; or the location calibration image includes multiple discontinuous illuminated light points, and the rest are non-illuminated light points.

[0157] According to another optional embodiment of this application, the above-described apparatus is further configured to acquire pattern information of a preset pattern, wherein the position calibration image is an image of the preset pattern displayed on the display screen; determine the position of at least one of the lit and unlit light points in the display screen based on the pattern information of the preset pattern; the processing module 92 is further configured to calibrate the position of the light points in the optical information extraction image based on the position of at least one of the lit and unlit light points in the display screen and the position of at least one of the lit and unlit light points in the position calibration image; and obtain the optical information of the display screen based on the calibrated position of the light points and the optical information extraction image.

[0158] As an optional embodiment, the preset pattern is specifically used to determine the imaging position of some light points in the display screen; or the preset pattern is used to divide the display screen into multiple sub-display areas, and the preset pattern is specifically used to establish the correspondence between the sub-display areas of the display screen and the sub-images of the optical information extraction image, wherein the shape of the sub-display area is rectangular or non-rectangular.

[0159] In an optional embodiment, the position calibration image is an image of a preset pattern displayed on the display screen; wherein, the preset pattern is used to divide the display screen into multiple sub-display areas, and the processing module 92 is further used to obtain multiple sub-images of the optical information extraction image based on the position calibration image, wherein the multiple sub-images correspond one-to-one with the multiple sub-display areas; and to obtain the optical information of the display screen based on the optical information of each sub-image in the multiple sub-images.

[0160] In another optional embodiment of this application, the above-mentioned device is further configured to acquire pattern information of a preset pattern; obtain the resolution of each sub-display area in the display screen according to the pattern information; and the processing module 92 is further configured to obtain the optical information of the display screen by sampling the sub-image so that the resolution of the sampled sub-image is equal to the resolution of the corresponding sub-area.

[0161] According to an optional embodiment of this application, the processing module 92 is further configured to calibrate the image based on the position to obtain region information of multiple sub-display areas; and to divide the optical information extracted image into multiple sub-images based on the region information.

[0162] According to another optional embodiment of this application, the above-described apparatus is further configured to calibrate the image based on its position to obtain relative position information of multiple sub-display areas; the processing module 92 is further configured to stitch together the optical information of the sub-images based on the relative position information to obtain the optical information of the display screen.

[0163] In some optional embodiments of this application, the position calibration image includes at least one monochrome image, the optical information extraction image includes at least one monochrome image, and the acquisition module 90 is further configured to acquire the position calibration image and the optical information extraction image corresponding to the monochrome image; obtaining the optical information of the display screen based on the position calibration image and the optical information extraction image includes: obtaining the optical information of the display screen when displaying monochrome based on the position calibration image and the optical information extraction image corresponding to the monochrome image.

[0164] In some other optional embodiments of this application, the position calibration image specifically includes a first monochrome image and a second monochrome image, the optical information extraction image specifically includes a first monochrome image and a second monochrome image, and the acquisition module 90 is further configured to acquire the position calibration image and the optical information extraction image corresponding to the first monochrome image after acquiring the position calibration image and the optical information extraction image corresponding to the second monochrome image.

[0165] According to an optional embodiment of this application, the above-described apparatus is further configured to perform perspective transformation on the position calibration image and the optical information extraction image to obtain the transformed position calibration image and the transformed optical information extraction image, both of which are rectangular in shape; the processing module 92 is further configured to obtain the optical information of the display screen based on the transformed position calibration image and the transformed optical information extraction image.

[0166] Optionally, the imaging of the light points in the aforementioned optical information extraction image overlaps. According to an optional embodiment of this application, the overlapping imaging of the light points in the optical information extraction image specifically includes: the spatial light distribution curve corresponding to the first light point in the optical information extraction image and the spatial light distribution curve corresponding to the second light point in the optical information extraction image overlap, wherein the first light point and the second light point are any two adjacent light points in the optical information extraction image, the abscissa of the spatial light distribution curve is used to characterize the position of the light point, and the ordinate of the spatial light distribution curve is used to characterize the DN value, brightness value, or gray value of the light point; or in the cross-sectional view of the photosensitive element imaging of the optical information extraction image, the curve corresponding to the first light point and the curve corresponding to the second light point overlap, wherein the first light point and the second light point are any two adjacent light points in the optical information extraction image.

[0167] According to another optional embodiment of this application, the above-described apparatus is further configured to acquire a test image displayed on the screen in a lit state, acquired by the acquisition device, before acquiring the optical information extraction image, wherein the imaging of the light points in the test image overlaps; and determine that the acquisition parameters of the acquisition device have been adjusted when it is determined that the imaging of the light points in the test image meets the preset conditions, wherein the optical information extraction image is acquired by the acquisition device whose acquisition parameters have been adjusted.

[0168] In an optional embodiment, the above-described apparatus is further configured to determine that the acquisition parameters of the acquisition device have been adjusted when the imaging of the light points in the test image meets the following preset conditions: when the overlap of the imaging of the light points in the test image reaches a first preset range; or when the relationship between the maximum and minimum gray levels of the preset area in the test image is within a second preset range; or when the relationship between the maximum and minimum brightness of the preset area in the test image is within a third preset range.

[0169] This application also provides a non-volatile storage medium, which includes a stored program, wherein, when the program is running, it controls the device where the non-volatile storage medium is located to execute the above-described method for acquiring optical information of the display screen or the optical processing method of the display screen.

[0170] The aforementioned non-volatile storage medium is used to store the method for obtaining optical information of the display screen, as described above. For details, please refer to the above text, which will not be repeated here for the sake of brevity.

[0171] This application also provides a processor for running a program stored in a memory, wherein the program executes the above-described method for acquiring optical information of a display screen. For detailed description, please refer to the above text; for brevity, it will not be repeated here.

[0172] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0173] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0174] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0175] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0176] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0177] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to related technologies, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0178] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A method for acquiring optical information of a display screen, characterized in that, include: Acquire a position calibration image of the display screen and an optical information extraction image of the display screen, wherein the optical information extraction image is used to extract the optical information of the display screen, and the position calibration image is used to calibrate the position of the light points in the optical information extraction image; The optical information of the display screen is obtained by extracting the image based on the position calibration image and the optical information, wherein the optical information includes at least one of the following: brightness information, chromaticity information and luminous flux information; Before acquiring the optical information extraction image, the method further includes: Acquire a test image of the display screen when it is lit, which is acquired by the acquisition device, wherein the images of the light points in the test image overlap. If the imaging of the light points in the test image meets the preset conditions, it is determined that the acquisition parameters of the acquisition device have been adjusted. The optical information extraction image is acquired by the acquisition device whose acquisition parameters have been adjusted.

2. The method according to claim 1, characterized in that, The location calibration image includes multiple illuminated areas, wherein the areas in the location calibration image other than the multiple illuminated areas are non-illuminated areas.

3. The method according to claim 1, characterized in that, The location calibration image includes multiple illuminated areas and multiple unilluminated areas, which are arranged alternately.

4. The method according to claim 1, characterized in that, The location calibration image includes multiple discontinuous lit light points, wherein the area in the location calibration image other than the multiple discontinuous lit light points is a non-lit light point.

5. The method according to claim 1, characterized in that, The method further includes: Obtain pattern information of a preset pattern, wherein the position calibration image is the image of the preset pattern displayed on the display screen; Based on the pattern information of the preset pattern, determine the position of at least one of the illuminated and unilluminated light points in the display screen; The step of extracting the image based on the position calibration image and the optical information to obtain the optical information of the display screen includes: The positions of the light points in the optical information extraction image are calibrated based on the positions of at least one of the lit and unlit light points in the display screen, and the positions of at least one of the lit and unlit light points in the position calibration image. The optical information of the display screen is obtained by extracting the image based on the calibrated position of the light points and the optical information.

6. The method according to claim 5, characterized in that, The preset pattern is specifically used to determine the imaging position of some light points in the display screen; or The preset pattern is used to divide the display screen into multiple sub-display areas. Specifically, the preset pattern is used to establish the correspondence between the sub-display areas of the display screen and the sub-images of the optical information extraction image. The shape of the sub-display area is rectangular or non-rectangular.

7. The method according to claim 1, characterized in that, The position calibration image is an image of a preset pattern displayed on the screen; wherein, the preset pattern is used to divide the screen into multiple sub-display areas, and the step of extracting the image based on the position calibration image and the optical information to obtain the optical information of the screen includes: Based on the location calibration image, multiple sub-images of the optical information extraction image are obtained, and the multiple sub-images correspond one-to-one with the multiple sub-display areas; The optical information of the display screen is obtained based on the optical information of each of the plurality of sub-images.

8. The method according to claim 7, characterized in that, The method further includes: Obtain the pattern information of the preset pattern; Based on the pattern information, the resolution of each sub-display area in the display screen is obtained; The step of obtaining the optical information of the display screen based on the optical information of each of the plurality of sub-images includes: By sampling the sub-image, the resolution of the sampled sub-image is made equal to the resolution of the corresponding sub-region, so as to obtain the optical information of the display screen.

9. The method according to claim 7, characterized in that, The process of obtaining multiple sub-images of the optical information extraction image based on the position-calibrated image includes: Based on the location calibration image, the region information of the plurality of sub-display areas is obtained; The optical information extracted image is divided into multiple sub-images based on the region information.

10. The method according to claim 7, characterized in that, The method further includes: Based on the location calibration image, the relative position information of the plurality of sub-display areas is obtained; Obtaining the optical information of the display screen based on the optical information of each of the plurality of sub-images includes: The optical information of the sub-images is stitched together based on the relative position information to obtain the optical information of the display screen.

11. The method according to claim 1, characterized in that, The position calibration image includes at least one monochrome image, the optical information extraction image includes the at least one monochrome image, and acquiring the position calibration image and the optical information extraction image displayed on the screen includes: Obtain the position calibration image and optical information extraction image corresponding to the monochrome; The step of extracting the image based on the position calibration image and the optical information to obtain the optical information of the display screen includes: Based on the position calibration image and optical information corresponding to the monochrome, the image is extracted to obtain the optical information of the display screen when displaying the monochrome.

12. The method according to claim 11, characterized in that, The position calibration image specifically includes a first monochrome image and a second monochrome image; the optical information extraction image specifically includes the first monochrome image and the second monochrome image; acquiring the position calibration image and the optical information extraction image displayed on the screen includes: After obtaining the position calibration image and optical information extraction image corresponding to the first monochrome, obtain the position calibration image and optical information extraction image corresponding to the second monochrome.

13. The method according to any one of claims 1 to 12, characterized in that, The method further includes: The position calibration image and the optical information extraction image are subjected to perspective transformation to obtain the transformed position calibration image and the transformed optical information extraction image. The transformed position calibration image and the transformed optical information extraction image are both rectangular in shape. The step of extracting the image based on the position calibration image and the optical information to obtain the optical information of the display screen includes: The optical information of the display screen is obtained by extracting the image based on the transformed position calibration image and the transformed optical information.

14. The method according to any one of claims 1 to 12, characterized in that, The imaging of the light spots in the optical information extracted image overlaps.

15. The method according to claim 14, characterized in that, The overlapping of light points in the optical information extraction image specifically includes: The spatial light distribution curves corresponding to the first light point and the second light point in the optical information extraction image overlap. The first and second light points are any two adjacent light points in the optical information extraction image. The horizontal axis of the spatial light distribution curve represents the position of the light point, and the vertical axis represents the DN value, brightness value, or grayscale value of the light point. In the cross-sectional view of the photosensitive element imaging of the optical information extraction image, the curves corresponding to the first light point and the second light point overlap, wherein the first light point and the second light point are any two adjacent light points in the optical information extraction image.

16. The method according to claim 1, characterized in that, The step of determining that the acquisition parameters of the acquisition device have been adjusted after determining that the imaging of the light points in the test image meets the preset conditions includes: If the overlap of the light points in the test image reaches a first preset range, the acquisition parameters of the acquisition device are determined to be adjusted successfully; or If the relationship between the maximum and minimum gray levels in a preset region of the test image is determined to be within a second preset range, then the acquisition parameters of the acquisition device are determined to be adjusted successfully; or If the relationship between the maximum and minimum brightness of the preset area in the test image is determined to be within a third preset range, the acquisition parameters of the acquisition device are determined to be adjusted.

17. An optical processing method for a display screen, characterized in that, include: The system receives a first instruction and a second instruction, wherein the first instruction is used to instruct the control display screen to display a position calibration image, and the second instruction is used to instruct the control display screen to display an optical information extraction image. The position calibration image is used to calibrate the position of the lamp points in the optical information extraction image, and the optical information extraction image is used to extract the optical information of the display screen. The optical information includes at least one of the following: brightness information, chromaticity information, and luminous flux information. The optical information extraction image is acquired by an acquisition device whose acquisition parameters have been adjusted. The acquisition parameters of the acquisition device have been adjusted, meaning that the imaging of the lamp points in the test image meets preset conditions. The test image is obtained based on the image of the display screen displayed in the lit state acquired by the acquisition device, and the imaging of the lamp points in the test image overlaps. The display screen is controlled to display the position calibration image and the optical information extraction image according to the first instruction information and the second instruction information.

18. The method according to claim 17, characterized in that, The step of controlling the display screen to display the position calibration image and the optical information extraction image according to the first indication information and the second indication information includes: Based on the first instruction information and the second instruction information, the display screen is controlled to display a position calibration image of the first color and an optical information extraction image of the first color; the display screen is controlled to display a position calibration image of the second color and an optical information extraction image of the second color; and the display screen is controlled to display a position calibration image of the third color and an optical information extraction image of the third color.

19. A device for acquiring optical information of a display screen, characterized in that, include: The acquisition module is used to acquire a position calibration image of the display screen and an optical information extraction image of the display screen, wherein the optical information extraction image is used to extract the optical information of the display screen, and the position calibration image is used to calibrate the position of the light points in the optical information extraction image; The processing module is used to extract the image based on the position calibration image and the optical information to obtain the optical information of the display screen, wherein the optical information includes at least one of the following: brightness information, chromaticity information and luminous flux information; The device is further configured to acquire a test image of the display screen in the lit state, acquired by the acquisition device, before acquiring the optical information extraction image, wherein the imaging of the light points in the test image overlaps; and determine that the acquisition parameters of the acquisition device have been adjusted when it is determined that the imaging of the light points in the test image meets the preset conditions, wherein the optical information extraction image is acquired by the acquisition device whose acquisition parameters have been adjusted.

20. A non-volatile storage medium, characterized in that, The non-volatile storage medium includes a stored program, wherein, when the program is executed, it controls the device containing the non-volatile storage medium to perform the method for acquiring optical information of the display screen as described in any one of claims 1 to 16 or the optical processing method of the display screen as described in any one of claims 17 to 18.

21. A computer program product, characterized in that, It includes a computer program, which, when executed by a processor, implements the steps of the method for acquiring optical information of a display screen as described in any one of claims 1 to 16 or the optical processing method of a display screen as described in any one of claims 17 to 18.

Images