Screen display calibration auxiliary method and computer-readable storage medium

Abstract

The present invention discloses a screen display calibration assistance method and computer-readable storage medium. The method comprises: obtaining a test chart corresponding to a calibration item of a head-mounted device to be calibrated; sending the test chart to the head-mounted device so that the head-mounted device displays the test chart on its screen; photographing the test chart displayed on the head-mounted device screen using a lens that simulates the optical structure of the human eye to obtain first captured image data; analyzing the first captured image data according to an analysis strategy corresponding to the calibration item to obtain calibration assistance data; and sending the calibration assistance data to the head-mounted device so that the head-mounted device performs screen display calibration according to the calibration assistance data. The present invention implements a screen display calibration assistance solution for a head-mounted device. The calibration assistance data obtained through analysis is used to assist the head-mounted device in performing screen display calibration, thereby improving the display effect of the head-mounted device.

Description

Technical Field

[0001] The present invention relates to the technical field of head-mounted devices, and in particular to a screen display calibration auxiliary method and a computer-readable storage medium. Background Art

[0002] Head-mounted device technology is developing rapidly, and their applications are becoming increasingly widespread. However, since most head-mounted devices on the market, such as AR glasses, use optical waveguide technology for display imaging, the limitations of the optical system itself can lead to poor imaging performance in terms of color, brightness uniformity, and contrast. Summary of the Invention

[0003] The main purpose of the present invention is to provide a screen display calibration assistance method and a computer-readable storage medium, aiming to provide a screen display calibration assistance solution for a head-mounted device. Calibration assistance data is obtained through analysis to assist the head-mounted device in screen display calibration to improve the display effect of the head-mounted device.

[0004] To achieve the above object, the present invention provides a screen display calibration auxiliary method, the screen display calibration auxiliary method comprising the following steps:

[0005] Obtain a test chart corresponding to a calibration item of the head-mounted device to be calibrated;

[0006] Sending the test image card to the head-mounted device, so that the head-mounted device displays the test image card on a screen;

[0007] photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data;

[0008] Analyzing the first captured image data according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data;

[0009] The calibration auxiliary data is sent to the head-mounted device, so that the head-mounted device performs screen display calibration according to the calibration auxiliary data.

[0010] Optionally, when the calibration item includes a display grayscale calibration item, the test chart includes first color charts corresponding to various preset colors, each of the first color charts of the preset colors includes multiple charts with different grayscale values, and the step of obtaining first captured image data by photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye includes:

[0011] Whenever the head-mounted device displays one of the first color charts on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0012] The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0013] The first average brightness value of the preset screen center area in each of the first captured image data is calculated respectively to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

[0014] Optionally, when the calibration item includes a display current calibration item, the test chart includes a second color chart having various preset colors with grayscale values of preset grayscale values, and after the step of sending the test chart to the head-mounted device so that the head-mounted device displays the test chart on a screen, the step further includes:

[0015] sending a plurality of preset current values to the head-mounted device, so that the head-mounted device sequentially adjusts the screen display current to the various preset current values each time the head-mounted device displays a second color image card on the screen;

[0016] The step of photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data includes:

[0017] Whenever the head-mounted device displays a second color chart on a screen at a preset current value, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0018] The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0019] The second average brightness value of the preset screen center area in each of the first captured image data is calculated respectively to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

[0020] Optionally, when the calibration item includes a display uniformity calibration item, the test chart includes a third color chart having various preset colors with grayscale values being preset grayscale values, and the step of obtaining the first captured image data by photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye includes:

[0021] Whenever the head-mounted device displays one of the third color charts on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0022] The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0023] The brightness value of each preset sampling point in the screen area in each portion of the first captured image data is extracted as calibration auxiliary data corresponding to the display uniformity calibration item.

[0024] Optionally, the screen display calibration auxiliary method further includes:

[0025] Sending a positioning map card to the head-mounted device, so that the head-mounted device displays the positioning map card on a screen, wherein the positioning map card includes a plurality of positioning points;

[0026] photographing the positioning map card displayed on the screen of the head-mounted device through the lens to obtain a positioning map;

[0027] A conversion matrix for converting a coordinate point in a screen coordinate system into a coordinate point in an image coordinate system is calculated according to the position of the positioning point in the positioning map;

[0028] The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0029] Obtaining the first sampling point coordinates of each preset sampling point in the screen area;

[0030] Converting the first sampling point coordinates into second sampling point coordinates in the image coordinate system according to the conversion matrix;

[0031] The first captured image data is sampled using the second sampling point coordinates and then analyzed according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data.

[0032] Optionally, the step of obtaining first sampling point coordinates of each preset sampling point in the screen area includes:

[0033] Obtaining a distortion correction matrix of N rows and M columns, wherein each data in the distortion correction matrix includes a normalized distortion correction value in an X-axis direction and a normalized distortion correction value in a Y-axis direction;

[0034] Divide the range from 0 to 1 equally in both the X-axis direction and the Y-axis direction to obtain a first coordinate matrix with N rows and M columns;

[0035] Adding the first coordinate matrix to the distortion correction matrix to obtain a second coordinate matrix;

[0036] Multiplying the coordinate values in the second coordinate matrix by the screen resolution to obtain a third coordinate matrix;

[0037] The first sampling point coordinates of each preset sampling point in the screen area are obtained according to the third coordinate matrix.

[0038] Optionally, after the step of sending the calibration auxiliary data to the head mounted device so that the head mounted device performs screen display calibration according to the calibration auxiliary data, the method further includes:

[0039] Obtaining a calibration chart corresponding to the calibration item;

[0040] Sending the calibration card to the head-mounted device, so that the head-mounted device performs screen display calibration according to the calibration auxiliary data and then displays the calibration card on the screen;

[0041] photographing the calibration card displayed on the head-mounted device screen through the lens to obtain second photographed image data;

[0042] The second captured image data is analyzed according to a verification strategy corresponding to the calibration item to obtain verification data, so as to determine a screen display calibration effect of the head mounted device with respect to the calibration item based on the verification data.

[0043] Optionally, when the calibration chart includes a fourth color chart having various preset colors with grayscale values of preset grayscale values, the step of analyzing the second captured image data according to the calibration strategy corresponding to the calibration item to obtain calibration data includes:

[0044] respectively calculating a third average brightness value of a preset screen center area in the second captured image data corresponding to each of the fourth color charts to obtain brightness verification data;

[0045] The fourth average brightness value of each preset screen dispersion area in the second captured image data corresponding to each of the fourth color charts is calculated respectively, and brightness uniformity verification data is obtained according to each of the fourth average brightness values.

[0046] Optionally, when the calibration chart includes a contrast chart, the second captured image data is grayscale image data, and the step of analyzing the second captured image data according to the calibration strategy corresponding to the calibration item to obtain the calibration data includes:

[0047] identifying each white region of interest and each black region of interest in a preset screen center area in the second captured image data, wherein the contrast chart is a grid-shaped chart with two colors arranged alternately;

[0048] Contrast calibration data is calculated based on the average brightness value of each of the white regions of interest and the average brightness value of each of the black regions of interest.

[0049] To achieve the above-mentioned objectives, the present invention also provides a screen display calibration auxiliary device, which includes: a memory, a processor, and a screen display calibration auxiliary program stored in the memory and executable on the processor. When the screen display calibration auxiliary program is executed by the processor, the steps of the screen display calibration auxiliary method described above are implemented.

[0050] In addition, to achieve the above-mentioned purpose, the present invention also proposes a computer-readable storage medium, on which a screen display calibration auxiliary program is stored. When the screen display calibration auxiliary program is executed by a processor, the steps of the screen display calibration auxiliary method described above are implemented.

[0051] In the present invention, a test chart corresponding to a calibration item of a head-mounted device to be calibrated is obtained; the test chart is sent to the head-mounted device so that the head-mounted device displays the test chart on its screen; the test chart displayed on the head-mounted device screen is photographed using a lens that simulates the optical structure of the human eye to obtain first captured image data; the first captured image data is analyzed according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data; and the calibration auxiliary data is sent to the head-mounted device so that the head-mounted device performs screen display calibration according to the calibration auxiliary data. The present invention implements a screen display calibration assistance scheme for a head-mounted device, wherein the calibration auxiliary data obtained through analysis is used to assist the head-mounted device in performing screen display calibration, thereby improving the display effect of the head-mounted device. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] Figure 1 A schematic diagram of the hardware operating environment involved in an embodiment of the present invention;

[0053] Figure 2 This is a flow chart of a first embodiment of a screen display calibration assistance method according to the present invention;

[0054] Figure 3 A positioning chart card according to an embodiment of the present invention;

[0055] Figure 4 This is a grayscale image obtained by photographing a contrast chart displayed on a head-mounted device according to an embodiment of the present invention.

[0056] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION

[0057] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0058] like Figure 1 As shown, Figure 1 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present invention.

[0059] It should be noted that the screen display calibration auxiliary device in the embodiment of the present invention can be a headset, a smart phone, a personal computer, a server and other devices, and no specific limitation is made here.

[0060] like Figure 1 As shown, the screen display calibration auxiliary device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0061] Those skilled in the art will understand that Figure 1 The device structure shown in the figure does not constitute a limitation on the screen display calibration auxiliary device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0062] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a screen display calibration assistant program. The operating system is a program that manages and controls the hardware and software resources of the device and supports the operation of the screen display calibration assistant program and other software or programs. Figure 1 In the device shown, the user interface 1003 is mainly used to communicate data with the client; the network interface 1004 is mainly used to establish a communication connection with the server; and the processor 1001 can be used to call the screen display calibration auxiliary program stored in the memory 1005 and perform the following operations:

[0063] Obtain a test chart corresponding to a calibration item of the head-mounted device to be calibrated;

[0064] Sending the test image card to the head-mounted device, so that the head-mounted device displays the test image card on a screen;

[0065] photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data;

[0066] Analyzing the first captured image data according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data;

[0067] The calibration auxiliary data is sent to the head-mounted device, so that the head-mounted device performs screen display calibration according to the calibration auxiliary data.

[0068] Furthermore, when the calibration item includes a display grayscale calibration item, the test chart includes first color charts corresponding to various preset colors, each of the first color charts of the preset colors includes multiple charts with different grayscale values, and the operation of capturing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of the human eye to obtain first captured image data includes:

[0069] Whenever the head-mounted device displays one of the first color charts on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0070] The operation of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0071] The first average brightness value of the preset screen center area in each of the first captured image data is calculated respectively to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

[0072] Furthermore, when the calibration item includes a display current calibration item, the test chart includes a second color chart having various preset colors with grayscale values being preset grayscale values. After the operation of sending the test chart to the head-mounted device so that the head-mounted device displays the test chart on the screen, the processor 1001 may also be configured to call a screen display calibration auxiliary program stored in the memory 1005 to perform the following operations:

[0073] sending a plurality of preset current values to the head-mounted device, so that the head-mounted device sequentially adjusts the screen display current to the various preset current values each time the head-mounted device displays a second color image card on the screen;

[0074] The operation of photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data includes:

[0075] Whenever the head-mounted device displays a second color chart on a screen at a preset current value, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0076] The operation of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0077] The second average brightness value of the preset screen center area in each of the first captured image data is calculated respectively to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

[0078] Furthermore, when the calibration item includes a display uniformity calibration item, the test chart includes a third color chart having various preset colors with grayscale values being preset grayscale values, and the operation of obtaining the first captured image data by photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye includes:

[0079] Whenever the head-mounted device displays one of the third color charts on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0080] The operation of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0081] The brightness value of each preset sampling point in the screen area in each portion of the first captured image data is extracted as calibration auxiliary data corresponding to the display uniformity calibration item.

[0082] Furthermore, the processor 1001 may also be configured to call a screen display calibration auxiliary program stored in the memory 1005 to perform the following operations:

[0083] Sending a positioning map card to the head-mounted device, so that the head-mounted device displays the positioning map card on a screen, wherein the positioning map card includes a plurality of positioning points;

[0084] photographing the positioning map card displayed on the screen of the head-mounted device through the lens to obtain a positioning map;

[0085] A conversion matrix for converting a coordinate point in a screen coordinate system into a coordinate point in an image coordinate system is calculated according to the position of the positioning point in the positioning map;

[0086] The operation of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes:

[0087] Obtaining the first sampling point coordinates of each preset sampling point in the screen area;

[0088] Converting the first sampling point coordinates into second sampling point coordinates in the image coordinate system according to the conversion matrix;

[0089] The first captured image data is sampled using the second sampling point coordinates and then analyzed according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data.

[0090] Furthermore, the operation of obtaining the first sampling point coordinates of each preset sampling point in the screen area includes:

[0091] Obtaining a distortion correction matrix of N rows and M columns, wherein each data in the distortion correction matrix includes a normalized distortion correction value in an X-axis direction and a normalized distortion correction value in a Y-axis direction;

[0092] Divide the range from 0 to 1 equally in both the X-axis direction and the Y-axis direction to obtain a first coordinate matrix with N rows and M columns;

[0093] Adding the first coordinate matrix to the distortion correction matrix to obtain a second coordinate matrix;

[0094] Multiplying the coordinate values in the second coordinate matrix by the screen resolution to obtain a third coordinate matrix;

[0095] The first sampling point coordinates of each preset sampling point in the screen area are obtained according to the third coordinate matrix.

[0096] Furthermore, after sending the calibration auxiliary data to the head-mounted device so that the head-mounted device performs screen display calibration according to the calibration auxiliary data, the processor 1001 may also be configured to call a screen display calibration auxiliary program stored in the memory 1005 and perform the following operations:

[0097] Obtaining a calibration chart corresponding to the calibration item;

[0098] Sending the calibration card to the head-mounted device, so that the head-mounted device performs screen display calibration according to the calibration auxiliary data and then displays the calibration card on the screen;

[0099] photographing the calibration card displayed on the head-mounted device screen through the lens to obtain second photographed image data;

[0100] The second captured image data is analyzed according to a verification strategy corresponding to the calibration item to obtain verification data, so as to determine a screen display calibration effect of the head mounted device with respect to the calibration item based on the verification data.

[0101] Furthermore, when the calibration chart includes a fourth color chart having various preset colors with grayscale values of preset grayscale values, the operation of analyzing the second captured image data according to the calibration strategy corresponding to the calibration item to obtain the calibration data includes:

[0102] respectively calculating a third average brightness value of a preset screen center area in the second captured image data corresponding to each of the fourth color charts to obtain brightness verification data;

[0103] The fourth average brightness value of each preset screen dispersion area in the second captured image data corresponding to each of the fourth color charts is calculated respectively, and brightness uniformity verification data is obtained according to each of the fourth average brightness values.

[0104] Furthermore, when the calibration chart includes a contrast chart, the second captured image data is grayscale image data, and the operation of analyzing the second captured image data according to the calibration strategy corresponding to the calibration item to obtain the calibration data includes:

[0105] identifying each white region of interest and each black region of interest in a preset screen center area in the second captured image data, wherein the contrast chart is a grid-shaped chart with two colors arranged alternately;

[0106] Contrast calibration data is calculated based on the average brightness value of each of the white regions of interest and the average brightness value of each of the black regions of interest.

[0107] Based on the above structure, various embodiments of a screen display calibration assistance method are proposed.

[0108] Reference Figure 2 , Figure 2 FIG. 1 is a flow chart of a first embodiment of a screen display calibration assistance method according to the present invention.

[0109] The embodiment of the present invention provides an embodiment of a screen display calibration auxiliary method. It should be noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than here. In this embodiment, the execution subject of the screen display calibration auxiliary method can be a device such as headphones, personal computers, and smart phones. This is not limited in this embodiment. For ease of description, the following embodiments are described with the calibration device as the execution subject. In this embodiment, the screen display calibration auxiliary method includes:

[0110] Step S10, obtaining a test chart corresponding to a calibration item of the head mounted device to be calibrated;

[0111] Calibration items can be pre-set as needed. The calibration device can have one or more calibration items. The specific items included are not limited in this embodiment. For example, they may include display grayscale calibration items, display current calibration items, display uniformity calibration items, etc. In actual production, different head-mounted devices may require different calibration items. Therefore, in specific embodiments, calibration items can be pre-set based on the head-mounted device, or various possible calibration items can be pre-set in the calibration device. When calibrating the head-mounted device, the items required for calibration of the head-mounted device are selected from the various calibration items to implement the subsequent calibration assistance process.

[0112] Different calibration items may correspond to different test charts. In this embodiment, there is no limitation on the specific test chart to be used. For example, the test chart corresponding to the grayscale calibration item may include color charts of multiple colors.

[0113] The calibration device can obtain test charts corresponding to the calibration items of the head-mounted device to be calibrated. The acquisition method is not limited in this embodiment. For example, in one feasible implementation, the calibration device can pre-store test charts corresponding to various calibration items and retrieve them from the storage when needed. For another example, in another feasible implementation, the calibration device can download test charts corresponding to the calibration items from another device, such as a server.

[0114] Step S20: sending the test image card to the head-mounted device, so that the head-mounted device displays the test image card on a screen;

[0115] The calibration device sends the acquired test chart to the headset, which then displays it on its screen. If there are multiple test charts, the calibration device can send them all at once, with the headset displaying them one by one. Alternatively, the calibration device can send them one by one, with the headset displaying each chart and the calibration device controlling the camera to capture each chart.

[0116] Step S30, photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data;

[0117] The calibration device can control the lens simulating the optical structure of the human eye to capture an image. After the head-mounted device displays a test chart on the screen, the calibration device can control the lens to capture the test chart displayed on the screen to obtain image data. The image data will be referred to as the first captured image data below for distinction. The specific implementation method of the lens simulating the optical structure of the human eye is not limited in this embodiment. For example, a ProMetric I29 imaging colorimeter can be used. By using a lens simulating the optical structure of the human eye to capture the screen of the head-mounted device, compared to an ordinary lens, the scene of the human eye viewing the head-mounted device can be simulated, that is, the captured image is closer to the picture seen by the human eye, so that the effect of screen display calibration obtained by analyzing the calibration auxiliary data obtained by the captured image is better.

[0118] In a specific embodiment, the calibration device and the head-mounted device can determine the display order and display time of each picture card through information exchange, so that the calibration device can match the captured image data with the picture card one by one. The specific information interaction method is not limited here. For example, in a feasible embodiment, the calibration device can send the display order and display time of each picture card to the head-mounted device, and the head-mounted device displays each picture card according to the display order and display time. For another example, in a feasible embodiment, after displaying the picture card, the head-mounted device can feedback instruction information to the calibration device, and the calibration device controls the lens to shoot according to the instruction information, or selects the image data shot at the shooting time in the instruction information from the image data continuously shot by the lens.

[0119] In one feasible implementation, the calibration device can send a pure black picture card to the head-mounted device in advance, the head-mounted device displays the pure black picture card, the calibration device shoots through the lens, and saves the brightness data in the captured image as background noise brightness data. The brightness data in the first captured image data and the second captured image data obtained subsequently are subtracted from the background noise brightness data before participating in the analysis to avoid the impact of noise.

[0120] Step S40, analyzing the first captured image data according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data;

[0121] Different calibration items may require different auxiliary calibration data. In this embodiment, corresponding analysis strategies can be set for different calibration items. The calibration device analyzes the first captured image data corresponding to the calibration item according to the analysis strategy corresponding to the calibration item to obtain auxiliary calibration data for the calibration item. In this embodiment, there is no restriction on the specific analysis strategy used, nor on the specific content of the auxiliary calibration data.

[0122] In one feasible implementation, the calibration device can receive a test chart and analysis strategy code package corresponding to a newly added calibration item, and save the test chart and analysis strategy code package for the newly added calibration item. When the head-mounted device needs to be calibrated, the calibration device first determines the calibration item for the head-mounted device, obtains the saved test chart corresponding to the calibration item, and when the first captured image data corresponding to the calibration item needs to be analyzed, the analysis strategy code package corresponding to the calibration item is called to perform analysis. In a specific implementation, the test chart and analysis strategy code corresponding to the newly added calibration item can be uploaded to the calibration device by the user, downloaded from a server, or added to the calibration device through other channels.

[0123] Step S50: Send the calibration auxiliary data to the head-mounted device, so that the head-mounted device can perform screen display calibration according to the calibration auxiliary data.

[0124] The calibration auxiliary data shows the display effect of the head-mounted device before the screen display calibration. The head-mounted device can perform screen display calibration based on the calibration auxiliary data to correct the display effect. In this embodiment, there is no limitation on how the head-mounted device performs screen display calibration based on the calibration auxiliary data. For example, in one feasible implementation, when the calibration auxiliary data indicates that the brightness of the current screen of the head-mounted device is too dark (for example, less than a certain threshold), the head-mounted device adjusts the parameters that determine the screen display brightness to increase the screen brightness.

[0125] In this embodiment, a test chart corresponding to a calibration item for a head-mounted device to be calibrated is obtained; the test chart is sent to the head-mounted device so that the head-mounted device displays the test chart on its screen; the test chart displayed on the head-mounted device screen is photographed using a lens that simulates the optical structure of the human eye to obtain first captured image data; the first captured image data is analyzed according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data; and the calibration auxiliary data is sent to the head-mounted device so that the head-mounted device performs screen display calibration based on the calibration auxiliary data. This embodiment implements a screen display calibration assistance scheme for a head-mounted device, wherein the calibration auxiliary data obtained through analysis is used to assist the head-mounted device in performing screen display calibration, thereby improving the display quality of the head-mounted device.

[0126] Furthermore, based on the above-mentioned first embodiment, a second embodiment of the screen calibration method of the present invention is proposed. In this embodiment, when the calibration item includes a display grayscale calibration item, the test chart includes first color charts corresponding to various preset colors, and each first color chart of the preset color includes multiple charts with different grayscale values. Step S30 includes:

[0127] Step S301: Whenever the head-mounted device displays a first color chart on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0128] The display grayscale calibration project is a project that calibrates the grayscale values of the head-mounted device screen display. The test charts corresponding to the display grayscale calibration project can include color charts corresponding to various preset colors (hereinafter referred to as first color charts for distinction). The first color charts of each preset color include multiple charts with different grayscale values. For example, there are three preset colors: red, green, and blue, and each color has 10 grayscale values, so there are a total of 30 first color charts.

[0129] The head-mounted device displays a first color chart on its screen at a preset maximum display current. The preset maximum display current refers to the maximum current value on the head-mounted device screen. Each time the head-mounted device displays a first color chart, the calibration device controls the lens to capture a set of first captured image data. For N first color charts, N sets of first captured image data can be obtained. Each set of first captured image data can include image data for at least one image, including data for each pixel in the image, such as brightness and color values.

[0130] The step S40 includes:

[0131] Step S401 : calculating first average brightness values of a preset screen center area in each portion of the first captured image data to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

[0132] The first captured image data includes the brightness value of each pixel. For each set of first captured image data obtained using the first color chart, the calibration device can calculate the average brightness value of a preset screen center area in the first captured image data (hereinafter referred to as the first average brightness value for distinction), and the first average brightness value can be used as calibration auxiliary data corresponding to the display grayscale calibration item. The preset screen center area can be set as needed. For example, it can be a circular area with the center point of the screen as the center and a certain length (pre-set as needed) as the radius. The position of the preset screen center area in the image captured by the lens can be set in advance (can be expressed in pixel coordinates), or the position of the preset screen center area in the screen coordinate system can be set in advance. The calibration device can calculate the position of the preset screen center area in the image coordinate system based on the mapping relationship between the screen coordinate system and the image coordinate system. In a specific embodiment, assuming that the image captured by the lens is the entire picture displayed on the screen, and the picture card displayed on the screen has no distortion or negligible distortion, the image coordinate system can be set to be the screen coordinate system, and the screen coordinate system can be set to be the picture card coordinate system; if the image captured by the lens is offset or rotated relative to the picture displayed on the screen, the mapping relationship between the screen coordinate system and the image coordinate system can be pre-calibrated; if the picture card displayed on the screen has non-negligible distortion, the coordinates on the picture card coordinate system can be distortion corrected to correspond to the coordinate points on the screen coordinate system. In this case, the preset screen center area can be a circular area with the center point of the picture card as the center and a certain length as the radius, which can be represented by the coordinate points on the picture card coordinate system. Through distortion correction, the position of the preset screen center area on the screen coordinate system can be obtained. Due to the distortion, the preset screen center area on the screen is no longer a standard circle, but a distorted circle.

[0133] Furthermore, based on the first and / or second embodiments described above, a third embodiment of the screen calibration method of the present invention is proposed. In this embodiment, when the calibration item includes a display current calibration item, the test chart includes a second color chart of various preset colors with grayscale values of preset grayscale values. After step S20, the method further includes:

[0134] Step S60: sending a plurality of preset current values to the head mounted device, so that the head mounted device sequentially adjusts the screen display current to the various preset current values each time the head mounted device displays a second color card on the screen;

[0135] The display current calibration item is a item for calibrating the display current of the head-mounted device screen. The test chart corresponding to the display current calibration item may include color charts of various preset colors with grayscale values of preset grayscale values (hereinafter referred to as second color charts). The preset grayscale value can be set as needed, for example, to 255. For example, there are four preset colors: red, green, blue, and white, so there are a total of four second color charts.

[0136] For the display current calibration item, the calibration device can set multiple preset current values. The preset current values can be set as needed. The calibration device can send each preset current value to the headset. The headset will adjust the current display on the screen to each preset current value each time a second color chart is displayed.

[0137] The step S30 includes:

[0138] Step S302: Whenever the head-mounted device displays a second color chart on a screen at a preset current value, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0139] Each time the head-mounted device displays a second color chart on the screen at a preset current value, the calibration device captures a set of first captured image data through the lens. Given N second color charts and M preset current values, N*M sets of first captured image data can be captured. Each set of first captured image data can include image data for at least one image, including data for each pixel in the image, such as brightness and color values.

[0140] The step S40 includes:

[0141] Step S402 : calculating the second average brightness value of the preset screen center area in each portion of the first captured image data, and obtaining calibration auxiliary data corresponding to the display grayscale calibration item.

[0142] The first captured image data includes the brightness value of each pixel. For each piece of first captured image data obtained using the second color chart, the calibration device can calculate the average brightness value of a predetermined screen center region within that piece of first captured image data (hereinafter referred to as the second average brightness value for clarity). This second average brightness value can be used as auxiliary calibration data corresponding to the display grayscale calibration item. The explanation of the predetermined screen center region can be found in step S401 above and is not further elaborated here.

[0143] Furthermore, based on the first, second, and / or third embodiments described above, a fourth embodiment of the screen calibration method of the present invention is proposed. In this embodiment, when the calibration item includes a display uniformity calibration item, the test chart includes a third color chart of various preset colors with preset grayscale values, and step S30 includes:

[0144] Step S303: Whenever the head-mounted device displays a third color chart on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data;

[0145] The display uniformity calibration project is a project that calibrates the uniformity of the head-mounted device screen display. The test chart corresponding to the display uniformity project can include color charts with various preset colors and grayscale values (hereinafter referred to as third color charts). The preset grayscale value can be set as needed, for example, to 255. For example, there are four preset colors: red, green, blue, and white, so there are a total of four third color charts.

[0146] The head-mounted device displays the third color chart on its screen at a preset maximum display current. The preset maximum display current refers to the maximum current value on the head-mounted device screen. Each time the head-mounted device displays a third color chart, the calibration device controls the lens to capture a set of first captured image data. For N third color charts, N sets of first captured image data can be obtained. Each set of first captured image data can include image data for at least one image, including data for each pixel in the image, such as brightness and color values.

[0147] The step S40 includes:

[0148] Step S403 : extracting the brightness value of each preset sampling point in the screen area in each portion of the first captured image data as calibration auxiliary data corresponding to the display uniformity calibration item.

[0149] The first captured image data includes the brightness value of each pixel. For each set of first captured image data obtained using the third color chart, the calibration device can extract the brightness value of each preset sampling point in the screen area in each set of first captured image data and use it as calibration auxiliary data corresponding to the display uniformity calibration item. The preset sampling points in the screen area can be set as needed. For example, the screen can be sampled with a sampling size of 196*146 to obtain each sampling point. The position of each preset sampling point in the screen area in the image captured by the lens can be set in advance (can be expressed in pixel coordinates), or the position of each preset sampling point in the screen area in the screen coordinate system can be set in advance. The calibration device can calculate the position of each preset sampling point in the image coordinate system based on the mapping relationship between the screen coordinate system and the image coordinate system. In a specific embodiment, assuming that the image captured by the lens is the entire screen displayed on the screen, and the image card displayed on the screen has no distortion or negligible distortion, the image coordinate system can be set to be the screen coordinate system; if the image captured by the lens is offset or rotated relative to the screen displayed on the screen, the mapping relationship between the screen coordinate system and the image coordinate system can be pre-calibrated; if the image card displayed on the screen has non-negligible distortion, the coordinates on the image card coordinate system can be distortion corrected to correspond to the coordinate points on the screen coordinate system. In this case, the preset sampling points in the screen area can be represented by the coordinate points on the image card coordinate system. Through distortion correction, the position of each preset sampling point on the screen coordinate system can be obtained.

[0150] Furthermore, based on the first, second, third and / or fourth embodiments described above, a fifth embodiment of a screen calibration method of the present invention is proposed. In this embodiment, the screen display calibration auxiliary method further includes:

[0151] Step A10: sending a positioning map card to the head-mounted device, so that the head-mounted device displays the positioning map card on a screen, wherein the positioning map card includes a plurality of positioning points;

[0152] In order to obtain more accurate calibration auxiliary data, the screen area in the image captured by the lens can be located. Specifically, the calibration device can send a positioning map card to the head-mounted device. The positioning map card contains multiple positioning points. The positions and numbers of the positioning points are not limited in this embodiment. For example, the following can be used: Figure 3 Positioning card shown.

[0153] The head-mounted device displays a positioning chart on the screen. In a specific embodiment, if the chart displayed by the head-mounted device has non-negligible distortion, the head-mounted device may apply pre-set distortion correction parameters to correct the displayed positioning chart before displaying the chart to eliminate the distortion. The distortion correction parameters may be pre-set based on experience.

[0154] Step A20, photographing the positioning map card displayed on the screen of the head-mounted device through the lens to obtain a positioning map;

[0155] The image obtained by the calibration device through the lens of the positioning map card displayed on the head-mounted device screen is called the positioning map. It can be understood that the positioning map contains the positioning points on the positioning map card.

[0156] Step A30, calculating, based on the position of the positioning point in the positioning map, a conversion matrix for converting a coordinate point in the screen coordinate system into a coordinate point in the image coordinate system;

[0157] The calibration device can identify the position of the positioning point in the positioning map. The identification method is not limited here. For example, when using Figure 3 When positioning the card as shown, a corner point positioning algorithm can be used to identify the nine corner points in the image. Based on the positions of the positioning points in the positioning map and the positioning points in the positioning card, a transformation matrix can be calculated. The coordinate points in the screen coordinate system can be transformed into the coordinate points in the image coordinate system through the transformation matrix. The method for calculating the transformation matrix is not limited in this embodiment. For example, in a feasible implementation, the following method is used: Figure 3 The positioning card shown is used to calculate the homography transformation matrix H according to the coordinates of 9 points in the card and the coordinates of 9 points in the positioning map, where M1=H*M2.

[0158] Because the coordinates are two-dimensional, the transformation matrix formula is:

[0159]

[0160] The coordinates of the 9 points on the positioning map card are M2, and the coordinates of the 9 points on the positioning map are M1. The 3*3 transformation matrix H can be obtained by solving the above formula according to the least squares method of the coordinate points.

[0161] The step S40 includes:

[0162] Step S411, obtaining the first sampling point coordinates of each preset sampling point in the screen area on the screen;

[0163] The preset sampling points of the screen area can be set as needed, and the coordinates of each preset sampling point on the screen are referred to as first sampling point coordinates for distinction. The method for obtaining the coordinates of the first sampling point is not limited in this embodiment. For example, when the screen coordinate system is consistent with the image card coordinate system, the screen can be sampled using a certain sampling size, such as 196*146, to obtain each sampling point. For example, when the screen coordinate system is inconsistent with the image card coordinate system (distortion occurs when the head-mounted device screen displays the image card), the image card can be sampled using a certain sampling size to obtain the coordinates of each sampling point on the image card. After distortion correction, the coordinates of the sampling point in the screen coordinate system are obtained.

[0164] Step S412, converting the first sampling point coordinates into second sampling point coordinates in the image coordinate system according to the conversion matrix;

[0165] For example, the transformation matrix is represented by H, and the coordinates of the first sampling point are [x1, y1] 196,146 Indicates that the coordinates of the second sampling point are [x, y] 196,146 Indicates that the coordinates of the second sampling point can be calculated using the following formula:

[0166] [x,y] 196*146 =H*[x1,y1] 196*146

[0167] Step S413 : sampling the first captured image data using the second sampling point coordinates and analyzing the data according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data.

[0168] The method of sampling image data using sampling point coordinates will not be described in detail here.

[0169] Furthermore, in a feasible implementation manner, step S411 includes:

[0170] Step S4111: Obtain a distortion correction matrix of N rows and M columns, wherein each data in the distortion correction matrix includes a normalized distortion correction value in the X-axis direction and a normalized distortion correction value in the Y-axis direction;

[0171] N and M can be set as needed, for example, N is 32 and M is 18. The distortion correction matrix can be set based on experience and is not limited in this embodiment. The normalized distortion correction value is a value between 0 and 1, which represents the distortion displacement of the position of a point on the chart relative to the position of the point on the screen. The data in the i-th row and j-th column of the distortion correction matrix can be expressed as [△x i , △y i ].

[0172] Step S4112: divide the range from 0 to 1 into equal intervals in both the X-axis direction and the Y-axis direction to obtain a first coordinate matrix with N rows and M columns;

[0173] The X-axis direction can be divided into 0 and 1 at equal intervals to obtain N X-coordinate values, and the Y-axis direction can be divided into 0 and 1 at equal intervals to obtain M Y-coordinate values, and the combination can obtain a coordinate matrix with N rows and M columns (hereinafter referred to as the first coordinate matrix for distinction). The coordinate point in the i-th row and j-th column of the first coordinate matrix can be expressed as [x1 i , y1 j ].

[0174] Step S4113: Add the first coordinate matrix and the distortion correction matrix to obtain a second coordinate matrix;

[0175] The coordinate point of the i-th row and j-th column in the second coordinate matrix can be expressed as [x2 i , y2 j ],[x2 i , y2 j ]=[x1 i +△x i , y1 j +△y i ].

[0176] Step S4114: multiply the coordinate values in the second coordinate matrix by the screen resolution to obtain a third coordinate matrix;

[0177] The screen resolution is expressed as W*H, and the coordinate point of the i-th row and j-th column in the third coordinate matrix can be expressed as [x3 i , y3 j ], [x3 i , y3 j ]=[x2 i *W,y2 j *H].

[0178] Step S4115 , obtaining first sampling point coordinates of each preset sampling point in the screen area on the screen according to the third coordinate matrix.

[0179] In a specific embodiment, each coordinate in the third coordinate matrix can be directly used as the first sampling point of the preset sampling point on the screen. Alternatively, if the sampling interval of N*M is too large, the third coordinate matrix can be interpolated to obtain a coordinate matrix with a smaller sampling interval, which is used as the coordinate of the first sampling point. For example, when N is 32 and M is 18, a 196*146 coordinate matrix can be interpolated. The interpolation method is not limited in this embodiment; for example, a bilinear interpolation algorithm can be used.

[0180] Furthermore, based on the first, second, third, fourth and / or fifth embodiments described above, a sixth embodiment of the screen calibration method of the present invention is proposed. In this embodiment, after step S50, the method further includes:

[0181] Step B10, obtaining a calibration chart corresponding to the calibration item;

[0182] After the head-mounted device calibrates the screen display using the calibration auxiliary data, the calibration device can verify the effectiveness of the head-mounted device's screen display calibration. Different calibration items may correspond to different calibration charts, and the correspondence between the calibration items and the calibration charts can be pre-set.

[0183] The calibration device can obtain calibration charts corresponding to the calibration items. The method of obtaining such charts is not limited in this embodiment. For example, in one feasible embodiment, the calibration device can pre-store calibration charts corresponding to various calibration items and retrieve them from the storage when needed. In another feasible embodiment, the calibration device can download calibration charts corresponding to the calibration items from another device, such as a server.

[0184] Step B20: sending the calibration card to the head-mounted device, so that the head-mounted device can display the calibration card on the screen after performing screen display calibration according to the calibration auxiliary data;

[0185] The calibration device sends the acquired test chart to the headset, which then displays the chart on its screen. Note that if there are multiple charts, the calibration device can send them all at once, with the headset displaying them one by one. Alternatively, the calibration device can send them one by one, with the headset displaying each chart and the calibration device controlling the camera to capture each chart.

[0186] Step B30, photographing the calibration card displayed on the screen of the head-mounted device through the lens to obtain second photographed image data;

[0187] After the head-mounted device displays the calibration card on the screen, the calibration device can control the lens to capture the calibration card displayed on the screen to obtain image data, which is hereinafter referred to as second captured image data for distinction.

[0188] Step B40: Analyze the second captured image data according to the verification strategy corresponding to the calibration item to obtain verification data, so as to determine the screen display calibration effect of the head mounted device with respect to the calibration item according to the verification data.

[0189] Different calibration items may require different screen display effects to be verified. In this embodiment, corresponding verification strategies can be set for different calibration items. The calibration device analyzes the second captured image data corresponding to the calibration item according to the verification strategy corresponding to the calibration item to obtain verification data. The verification data represents the display effect of the head-mounted device after the screen display calibration. The calibration device can output the verification data so that the user can understand the effect of the head-mounted device's screen display calibration using the calibration auxiliary data.

[0190] In one feasible implementation, the calibration device can receive a calibration card and a calibration policy code package corresponding to a newly added calibration item, and save the calibration card and calibration policy code package for the newly added calibration item. When the head-mounted device needs to be calibrated, the calibration item for the head-mounted device is first determined, the saved calibration card corresponding to the calibration item is obtained, and when the second captured image data corresponding to the calibration item needs to be analyzed, the calibration policy code package corresponding to the calibration item is called for analysis. In a specific implementation, the calibration card and policy code corresponding to the newly added calibration item can be uploaded to the calibration device by the user, downloaded from a server, or added to the calibration device through other channels.

[0191] Furthermore, in a feasible implementation manner, when the calibration chart includes a fourth color chart of various preset colors with grayscale values being preset grayscale values, step B40 includes:

[0192] Step B401, respectively calculating the third average brightness value of the preset screen center area in the second captured image data corresponding to each of the fourth color charts to obtain brightness verification data;

[0193] The calibration charts corresponding to the calibration items may include color charts of various preset colors with grayscale values corresponding to preset grayscale values (hereinafter referred to as fourth color charts for distinction). The preset grayscale values can be set as needed, for example, to 255. For example, if there are four preset colors, namely red, green, blue, and white, there are a total of four fourth color charts.

[0194] Each time the head-mounted device displays a fourth color chart on the screen, the calibration device captures a piece of second captured image data through the lens. Given N fourth color charts, N pieces of second captured image data can be captured. One piece of second captured image data can include image data for at least one image, including data for each pixel in the image, such as brightness and color values.

[0195] Step B402 , respectively calculating the fourth average brightness value of each preset screen dispersion area in the second captured image data corresponding to each of the fourth color charts, and obtaining brightness uniformity verification data according to each of the fourth average brightness values.

[0196] The second captured image data includes the brightness value of each pixel. For each second captured image data obtained using the fourth color chart, the calibration device can calculate the average brightness value of each preset screen dispersion area in the second captured image data (hereinafter referred to as the fourth average brightness value for distinction). Based on each fourth average brightness value, the brightness uniformity verification data can be calculated. In a feasible implementation, the maximum and minimum values of each fourth average brightness value can be selected, and the average value of each fourth average brightness value can be calculated. The maximum value minus the minimum value is divided by the average value, and the result is used as the brightness uniformity verification data. For example, the maximum value, the minimum value, and the average value are respectively expressed as L max , L min , L mean , then the brightness uniformity calibration data can be calculated using the following formula:

[0197]

[0198] The preset screen dispersion area can be set as needed. For example, it can be a circular area with each of the nine points on the screen located by the positioning chart as the center and a certain length (predetermined as needed) as the radius. The position of the preset screen dispersion area in the image captured by the lens can be set in advance (can be expressed in pixel coordinates), or the position of the preset screen dispersion area in the screen coordinate system can be set in advance. The calibration device can calculate the position of the preset screen dispersion area in the image coordinate system based on the mapping relationship between the screen coordinate system and the image coordinate system. In a specific embodiment, assuming that the image captured by the lens is the entire screen displayed on the screen, and the distortion of the chart displayed on the screen is not or can be ignored, the image coordinate system can be set to be the screen coordinate system, and the screen coordinate system can be set to be the chart coordinate system; if the image captured by the lens is offset or rotated relative to the screen displayed on the screen, the mapping relationship between the screen coordinate system and the image coordinate system can be pre-calibrated; if the chart displayed on the screen has non-negligible distortion, the coordinates on the chart coordinate system can be distortion corrected to correspond to the coordinate points on the screen coordinate system. In this case, the preset screen dispersion area can be a circular area with the positioning point in the positioning chart as the center and a certain length as the radius, and can be represented by the coordinate points on the chart coordinate system. Through distortion correction, the position of the preset screen dispersion area on the screen coordinate system can be obtained. Due to the distortion, the preset screen dispersion area on the screen is no longer a standard circle, but a distorted circle.

[0199] Furthermore, in a feasible implementation manner, when the calibration chart includes a contrast chart, and the second captured image data is grayscale image data, step B40 includes:

[0200] Step B403, identifying each white ROI and each black ROI in a preset screen center area in the second captured image data, wherein the contrast chart is a grid-shaped chart with two colors arranged alternately;

[0201] The calibration chart corresponding to the calibration item may include a contrast chart. Multiple contrast charts may be provided, each of which may be a grid-like chart with two alternating colors. The two colors may be set as needed, for example, blue and black, red and black, or green and black.

[0202] Each time the head-mounted device displays a contrast chart on the screen, the calibration device captures a second captured image data through the lens. If there are N contrast charts, N second captured image data can be captured. One second captured image data may include image data of at least one image, and the image data includes data of each pixel in the image. In this embodiment, only the brightness value data (i.e., grayscale value data) of each pixel is obtained. Identify each white area of interest and each black area of interest in the preset screen center area in the second captured image data, for example, Figure 4 An example of a grayscale image obtained by photographing a contrast chart displayed on the screen of a head-mounted device is given.

[0203] Step B404 : Calculating contrast calibration data according to the average brightness value of each white ROI and the average brightness value of each black ROI.

[0204] The calibration device can calculate the average brightness value of each white ROI and the average brightness value of each black ROI, and calculate the contrast calibration data based on the two average brightness values. For example, in one feasible embodiment, the contrast calibration data can be obtained by dividing the average brightness value of the white ROI by the average brightness value of the black ROI.

[0205] Furthermore, in one feasible embodiment, the calibration chart corresponding to the calibration item may include a 24-color standard chart. The calibration device captures the 24-color standard chart displayed by the head-mounted device through a lens to obtain a second captured image data. The XYZ tristimulus values in the second captured image data may be used to calculate the color difference between the captured image and the 24-color standard chart, thereby obtaining color difference calibration data. The color difference calculation may utilize the DeltaE2000 standard color difference calculation method.

[0206] The various embodiments of the screen display calibration auxiliary method of the present invention can effectively assist in calibrating the display brightness of the head-mounted device to prevent the head-mounted device from displaying too much or too little brightness. At the same time, the display uniformity, contrast, and display color difference can be calibrated. After a single calibration, the single-channel uniformity can be increased from 40% to 80%, and after repeated calibrations, it can reach a uniformity of more than 95%. After calibration, the contrast can also achieve a good ideal effect, and the color difference of the screen display is also effectively improved.

[0207] In addition, an embodiment of the present invention further provides a computer-readable storage medium, on which a screen display calibration auxiliary program is stored. When the screen display calibration auxiliary program is executed by a processor, the steps of the screen display calibration auxiliary method described below are implemented.

[0208] The various embodiments of the screen display calibration auxiliary device and the computer-readable storage medium of the present invention may refer to the various embodiments of the screen display calibration auxiliary method of the present invention, and will not be described in detail here.

[0209] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0210] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0211] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0212] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A screen display calibration auxiliary method, characterized in that: The screen display calibration auxiliary method comprises the following steps: Obtaining a test chart corresponding to a calibration item of the head-mounted device to be calibrated, wherein the calibration items include: a display grayscale calibration item, a display current calibration item, and a display uniformity calibration item, and the preset colors of the test chart corresponding to different calibration items are different; Sending the test image card to the head-mounted device, so that the head-mounted device displays the test image card on a screen; photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data; Sending a positioning map card to the head-mounted device, so that the head-mounted device displays the positioning map card on a screen, wherein the positioning map card includes a plurality of positioning points; photographing the positioning map card displayed on the screen of the head-mounted device through the lens to obtain a positioning map; A conversion matrix for converting a coordinate point in the screen coordinate system into a coordinate point in the image coordinate system is calculated based on the position of the positioning point in the positioning map. Obtaining the first sampling point coordinates of each preset sampling point in the screen area; Converting the first sampling point coordinates into second sampling point coordinates in the image coordinate system according to the conversion matrix; After sampling the first captured image data using the second sampling point coordinates, the data is analyzed according to an analysis strategy corresponding to the calibration item to obtain calibration auxiliary data; The calibration auxiliary data is sent to the head-mounted device, so that the head-mounted device performs screen display calibration according to the calibration auxiliary data.

2. The screen display calibration assisting method according to claim 1, wherein: When the calibration item includes a display grayscale calibration item, the test chart includes first color charts corresponding to various preset colors, each of the first color charts of the preset colors includes multiple charts with different grayscale values, and the step of photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of the human eye to obtain first captured image data includes: Whenever the head-mounted device displays one of the first color charts on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data; The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes: The first average brightness value of the preset screen center area in each of the first captured image data is calculated respectively to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

3. The screen display calibration assisting method according to claim 1, wherein: When the calibration item includes a display current calibration item, the test chart includes a second color chart having various preset colors with preset grayscale values. After the step of sending the test chart to the head-mounted device so that the head-mounted device displays the test chart on a screen, the method further includes: sending a plurality of preset current values to the head-mounted device, so that the head-mounted device sequentially adjusts the screen display current to the various preset current values each time the head-mounted device displays a second color image card on the screen; The step of photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye to obtain first photographed image data includes: Whenever the head-mounted device displays a second color chart on a screen at a preset current value, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data; The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes: The second average brightness value of the preset screen center area in each of the first captured image data is calculated respectively to obtain calibration auxiliary data corresponding to the display grayscale calibration item.

4. The screen display calibration assisting method according to claim 1, wherein: When the calibration item includes a display uniformity calibration item, the test chart includes a third color chart having various preset colors with grayscale values of preset grayscale values, and the step of obtaining first captured image data by photographing the test chart displayed on the head-mounted device screen through a lens simulating the optical structure of a human eye includes: Whenever the head-mounted device displays one of the third color charts on the screen at a preset maximum display current, photographing the screen of the head-mounted device through a lens simulating the optical structure of a human eye to obtain a first captured image data; The step of analyzing the first captured image data according to the analysis strategy corresponding to the calibration item to obtain calibration auxiliary data includes: The brightness value of each preset sampling point in the screen area in each portion of the first captured image data is extracted as calibration auxiliary data corresponding to the display uniformity calibration item.

5. The screen display calibration assisting method according to claim 1, wherein: The step of obtaining the first sampling point coordinates of each preset sampling point in the screen area includes: Obtaining a distortion correction matrix of N rows and M columns, wherein each data in the distortion correction matrix includes a normalized distortion correction value in an X-axis direction and a normalized distortion correction value in a Y-axis direction; Divide the range from 0 to 1 equally in both the X-axis direction and the Y-axis direction to obtain a first coordinate matrix with N rows and M columns; Adding the first coordinate matrix to the distortion correction matrix to obtain a second coordinate matrix; Multiplying the coordinate values in the second coordinate matrix by the screen resolution to obtain a third coordinate matrix; The first sampling point coordinates of each preset sampling point in the screen area are obtained according to the third coordinate matrix.

6. The screen display calibration assisting method according to any one of claims 1 to 5, wherein: After the step of sending the calibration auxiliary data to the head mounted device so that the head mounted device performs screen display calibration according to the calibration auxiliary data, the method further includes: Obtaining a calibration chart corresponding to the calibration item; Sending the calibration card to the head-mounted device, so that the head-mounted device performs screen display calibration according to the calibration auxiliary data and then displays the calibration card on the screen; photographing the calibration card displayed on the head-mounted device screen through the lens to obtain second photographed image data; The second captured image data is analyzed according to a verification strategy corresponding to the calibration item to obtain verification data, so as to determine a screen display calibration effect of the head mounted device with respect to the calibration item based on the verification data.

7. The screen display calibration assisting method according to claim 6, wherein: When the calibration chart includes a fourth color chart of various preset colors with preset grayscale values, the step of analyzing the second captured image data according to the calibration strategy corresponding to the calibration item to obtain calibration data includes: respectively calculating a third average brightness value of a preset screen center area in the second captured image data corresponding to each of the fourth color charts to obtain brightness verification data; The fourth average brightness value of each preset screen dispersion area in the second captured image data corresponding to each of the fourth color charts is calculated respectively, and brightness uniformity verification data is obtained according to each of the fourth average brightness values.

8. The screen display calibration assisting method according to claim 6, wherein: When the calibration chart includes a contrast chart, and the second captured image data is grayscale image data, the step of analyzing the second captured image data according to the calibration strategy corresponding to the calibration item to obtain calibration data includes: identifying each white region of interest and each black region of interest in a preset screen center area in the second captured image data, wherein the contrast chart is a grid-shaped chart with two colors arranged alternately; Contrast calibration data is calculated based on the average brightness value of each of the white regions of interest and the average brightness value of each of the black regions of interest.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a screen display calibration auxiliary program, which, when executed by a processor, implements the steps of the screen display calibration auxiliary method according to any one of claims 1 to 8.

Images