Binocular consistency evaluation method and device for XR equipment

Abstract

The invention belongs to the technical field of intelligent wearing, and particularly discloses a binocular consistency evaluation method and device for XR equipment, and the method comprises the steps: obtaining a plurality of groups of display images of the XR equipment through switching to-be-displayed images of different gray scales under the same shooting condition, and each group of display images comprises matched left and right view angle display images; setting matched view overlapping areas of the left and right view angle display images, respectively acquiring pixel-by-pixel first evaluation index values of the matched view overlapping areas of the left and right view angle display images, comparing the first evaluation index values, and determining a detail binocular consistency evaluation result of the XR equipment; wherein the first evaluation index value comprises a Gamma value and / or a Delta E value. According to the method, the first evaluation index values of the view overlapping areas in the left and right view angle display images of the XR equipment are compared pixel by pixel, so that the detail consistency degree of the brightness and / or chromaticity display characteristics of the two displays of the XR equipment is evaluated through a small number of simple evaluation values.

Description

Technical Field

[0001] The present application belongs to the field of smart wearable technology, and more specifically, to a binocular consistency evaluation method and device for an XR device. Background Art

[0002] With the rapid development of technologies such as Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR), Extended Reality (XR) devices have become the focus of market attention. XR devices provide users with an immersive perspective experience and show great application potential in multiple fields.

[0003] In addition to affecting the brightness and color of the binocular display, the complex optical system of XR devices will also simultaneously affect the clarity, geometric distortion, crosstalk and cross color, resulting in inconsistent binocular display, causing users to feel dizzy when using it for a long time, directly affecting the user's wearing experience and viewing comfort.

[0004] Binocular consistency evaluation is a key link in ensuring the quality of XR equipment. Traditional binocular consistency evaluation methods mainly rely on manual observation and subjective evaluation, which is not only time-consuming and labor-intensive, but also easily affected by personal subjective factors, resulting in inconsistency and inaccuracy in the evaluation results. With the continuous advancement of XR equipment technology, the requirements for binocular consistency are getting higher and higher. Traditional binocular consistency evaluation methods can no longer meet the testing needs of modern XR equipment. Summary of the invention

[0005] In view of the defects existing in the related technology, the embodiments of the present application provide a binocular consistency evaluation method and device for an XR device, aiming to solve the binocular consistency evaluation problem of the XR device.

[0006] In a first aspect, an embodiment of the present application provides a binocular consistency evaluation method for an XR device, including:

[0007] Under the same shooting conditions, multiple groups of display images of the XR device are obtained by switching the images to be displayed with different grayscales, each group of display images includes a matching left-view display image and a right-view display image;

[0008] The overlapping area of ​​the field of view of the matched left-view display image and the right-view display image is set, and the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image is obtained and compared to determine the detailed binocular consistency evaluation result of the XR device;

[0009] The first evaluation index value includes a Gamma value and / or a Delta E value.

[0010] In some embodiments, respectively obtaining and comparing first evaluation index values ​​of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image includes:

[0011] Determine a first eigenvalue based on a first evaluation index value for each pixel in the overlapping area of ​​the visual field in the left-view display image; determine a second eigenvalue based on a first evaluation index value for each pixel in the overlapping area of ​​the visual field in the right-view display image;

[0012] Comparing the first eigenvalue and the second eigenvalue;

[0013] The first eigenvalue and the second eigenvalue are both one or more of a mean, a standard deviation and a mean square error.

[0014] In some embodiments, the first evaluation index value also includes a pixel position, and obtaining the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image and comparing them respectively includes:

[0015] Determine matching pixel points in the overlapping area of ​​the field of view of the matched left-view display image and right-view display image;

[0016] The pixel positions of the matching pixels in the matching left-view display image and right-view display image are compared to determine the pixel-by-pixel disparity.

[0017] In some embodiments, the method further comprises:

[0018] Obtain the second evaluation index values ​​of the center points of the matched left-view display image and right-view display image respectively and compare them to determine the overall binocular consistency evaluation result of the XR device;

[0019] The second evaluation index value includes a Gamma value and / or a Delta E value.

[0020] In some embodiments, respectively obtaining the second evaluation index value of the center point of the matched left-view display image and right-view display image includes:

[0021] Setting the region of interest where the center point of the matched left-view display image and the right-view display image is located; respectively obtaining the second evaluation index value of the pixel unit in the region of interest in the matched left-view display image and the right-view display image; determining the second evaluation index value of the center point based on the second evaluation index value of the pixel unit in the region of interest; or,

[0022] The second evaluation index values ​​of the pixel units corresponding to the center points of the matched left-view display image and right-view display image are respectively obtained.

[0023] In some embodiments, when the XR device is not assembled, the first evaluation index value and the second evaluation index value are measured by a single-point color analysis instrument or an imaging measuring instrument; when the XR device is assembled, the first evaluation index value and the second evaluation index value are measured by an imaging measuring instrument with a near-eye display measurement lens.

[0024] In some embodiments, when the XR device is not assembled, the imaging measuring instrument is: an industrial camera, or a spectroscopic spectrum-enhanced imaging measuring instrument, or a wheel-type spectrum-enhanced imaging measuring instrument;

[0025] When the XR device is assembled, the imaging measuring instrument is: a spectroscopic spectrum-enhanced imaging measuring instrument, or a wheel-type spectrum-enhanced imaging measuring instrument, or a binocular spectrum-enhanced imaging measuring instrument.

[0026] In a second aspect, an embodiment of the present application further provides a binocular consistency evaluation device for an XR device, comprising:

[0027] An acquisition module, used to acquire multiple groups of display images of the XR device by switching the images to be displayed in different grayscales under the same shooting conditions, each group of display images including a matching left-view display image and a right-view display image;

[0028] A first evaluation module is used to set the overlapping area of ​​the field of view of the matched left-view display image and the right-view display image, respectively obtain the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image, and compare them to determine the detailed binocular consistency evaluation result of the XR device;

[0029] The first evaluation index value includes a Gamma value and / or a Delta E value.

[0030] In a third aspect, an embodiment of the present application further provides an electronic device, comprising: at least one memory for storing programs; and at least one processor for executing the programs stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method described in the first aspect or any possible implementation of the first aspect.

[0031] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method described in the first aspect or any possible implementation of the first aspect.

[0032] In a fifth aspect, an embodiment of the present application further provides a computer program product, which, when executed on a processor, enables the processor to execute the method described in the first aspect or any possible implementation of the first aspect.

[0033] The binocular consistency evaluation method and apparatus for an XR device provided in an embodiment of the present application, for different pixel units of the same display, theoretically have the same Gamma value and Delta E value, but in reality there may be slight differences. Therefore, by comparing the Gamma value and / or Delta E value of the overlapping area of ​​the field of view in the left and right viewing angles of the XR device pixel by pixel, it is possible to objectively and accurately evaluate the degree of consistency in the details of the brightness and / or chromaticity display characteristics of the two displays of the XR device, thereby realizing the binocular consistency detail evaluation of the XR device through a small number of simple evaluation values. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the present application or related technologies, the following is a brief introduction to the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 It is a flowchart of a binocular consistency evaluation method for an XR device provided in an embodiment of the present application;

[0036] Figure 2 is a schematic diagram of the overlapping area of ​​the left and right fields of view of an XR device provided in an embodiment of the present application;

[0037] Figure 3 is a structural schematic diagram of a binocular consistency evaluation device for an XR device provided in an embodiment of the present application;

[0038] Figure 4 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0040] Figure 1 is a flow chart of a binocular consistency evaluation method for an XR device provided in an embodiment of the present application, such as Figure 1 As shown, the method at least includes the following steps:

[0041] S101. Under the same shooting conditions, multiple groups of display images of the XR device are obtained by switching images to be displayed with different grayscales, where each group of display images includes a matching left-view display image and a right-view display image.

[0042] Specifically, XR devices are generally equipped with two displays of the same model, corresponding to the left and right viewing angles of the human eye. The modulation transfer function, stray light, local distortion, etc. of the XR device imaging system may cause inconsistency in the binocular imaging of the XR device.

[0043] By setting the same shooting conditions and images to be displayed in different grayscales, multiple groups of display images of the left and right perspectives of the XR device are obtained as the basis for the subsequent binocular consistency evaluation of the XR device. Each group of display images includes a matching left-view display image and a right-view display image.

[0044] Optionally, the display images of the left and right viewing angles of the XR device are photographed separately, or photographed simultaneously. The photographing tool may be an industrial camera, an imaging colorimeter, an imaging brightness meter, and the like.

[0045] S102: Set the overlapping area of ​​the field of view of the matched left-view display image and the right-view display image, obtain the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image, respectively, and compare them to determine the detailed binocular consistency evaluation result of the XR device.

[0046] The first evaluation index value includes a Gamma value and / or a Delta E value.

[0047] Specifically, the Gamma curve is a special tone curve that describes the nonlinear relationship between input grayscale and output brightness. The change of the Gamma value will affect the brightness distribution of the image. A higher Gamma value will make the dark part of the image darker and the bright part brighter. Generally, Gamma correction is used to achieve fine control of the brightness distribution of the image and improve the image display effect of a single display.

[0048] The Delta E (ΔE) value is a quantitative result of the difference between the displayed color and the input color. It is a metric specified by the International Commission on Illumination for quantifying the color difference of display devices. It is generally used to improve the image display effect of a single display screen.

[0049] Theoretically, for different pixel units of the same display, the Gamma value and Delta E value should be exactly the same. However, due to the influence of various factors such as manufacturing process, material differences, aging degree and calibration accuracy, there may be slight differences in the Gamma value for different pixel units of the same display. Furthermore, due to the influence of factors such as the color processing algorithm, color management settings and calibration accuracy inside the display, there may also be slight differences in the DeltaE value for different pixel units of the same display.

[0050] Therefore, the first evaluation index value is set to the Gamma value and / or the Delta E value. Consider comparing the first evaluation index value of each pixel (Per-Pixel) in the matching left and right viewing angle display images, so as to achieve the detailed consistency evaluation of the brightness and / or chromaticity display characteristics of the two displays of the XR device.

[0051] When the input grayscale is determined, the Gamma value can be obtained by measuring the output brightness of the displayed image. By comparing the Gamma values ​​measured pixel by pixel in the left and right viewing angles of the XR device, the detailed binocular consistency evaluation results of the XR device brightness can be obtained. By switching the images to be displayed with different grayscales, multiple groups of detailed binocular consistency evaluation results of the XR device can be obtained to avoid the randomness of the evaluation results.

[0052] When the input grayscale is determined, the Delta E value can be obtained by measuring the chromaticity of the image to be displayed and the displayed image. By comparing the Delta E values ​​measured pixel by pixel in the left and right viewing angles of the XR device, the detailed binocular consistency evaluation results of the XR device chromaticity can be obtained. By switching the images to be displayed with different grayscales, multiple groups of overall binocular consistency evaluation results of the XR device can be obtained to avoid the randomness of the evaluation results.

[0053] It should be noted that the calculation of Delta E value depends on a specific color space, such as CLELAB color space, in which three parameters, namely brightness, red-green hue, and yellow-blue hue, jointly describe the characteristics of color. When the grayscale of the image to be displayed changes, the brightness will also change, resulting in a color difference between the displayed image and the image to be displayed. Therefore, by switching the images to be displayed with different grayscales, a control group setting for Delta E value comparison can be achieved.

[0054] Furthermore, considering the measurement cost, computational complexity, and practical application, the overlapping area of ​​the field of view of the matching left-view display image and the right-view display image is preset, and the first evaluation index value is measured pixel by pixel for the overlapping area of ​​the left and right fields of view of the XR device. The overlapping area of ​​the left and right fields of view of the XR device can be preset by simulating actual use. It is conceivable that other areas can also be specified to reduce the computational complexity of the pixel-by-pixel comparison, such as specifying an area of ​​interest containing a center point.

[0055] Figure 2 is a schematic diagram of the overlapping area of ​​the left and right fields of view of the XR device provided in an embodiment of the present application, such as Figure 2 As described above, when a user wears an XR device, a visual field overlap will appear in the binocular field of view. The first evaluation index value of each pixel in the visual field overlap area of ​​the left and right viewing angles of each group of displayed images is measured and compared to obtain the detailed binocular consistency evaluation result of the XR device.

[0056] The embodiments of the present application compare the gamma values ​​and / or Delta E values ​​of the overlapping areas of the visual field in the left and right viewing angles of the XR device pixel by pixel, thereby achieving an objective and accurate evaluation of the degree of consistency in the details of the brightness and / or chromaticity display characteristics of the two displays of the XR device, and realizing binocular consistency detail evaluation of the XR device through a small number of simple evaluation values.

[0057] In some embodiments, obtaining and comparing first evaluation index values ​​of each pixel in the overlapping area of ​​the left-view display image and the right-view display image that match each other in S102 specifically includes:

[0058] Determine a first eigenvalue based on a first evaluation index value for each pixel in the overlapping area of ​​the visual field in the left-view display image; determine a second eigenvalue based on a first evaluation index value for each pixel in the overlapping area of ​​the visual field in the right-view display image;

[0059] Comparing the first eigenvalue and the second eigenvalue;

[0060] The first eigenvalue and the second eigenvalue are both one or more of a mean, a standard deviation and a mean square error.

[0061] Specifically, after obtaining the first evaluation index value of each pixel in the overlapping area of ​​the field of view of the matching left and right perspective display images, the mean (Mean), standard deviation (STD) and mean squared error (MSE) of the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the single perspective display image can be obtained to obtain the characteristic value of the single perspective display image, and then the characteristic values ​​of the left and right perspective display images are compared as the detail binocular consistency evaluation result of the XR device.

[0062] In some embodiments, obtaining and comparing first evaluation index values ​​of each pixel in the overlapping area of ​​the left-view display image and the right-view display image that match each other in S102 specifically includes:

[0063] Compare the first evaluation index value of each pixel unit in the overlapping area of ​​the left and right viewing angle display images that match each other pixel by pixel to obtain the pixel by pixel comparison result; determine the third eigenvalue of the pixel by pixel comparison result, and the third eigenvalue is one or more of the mean, standard deviation and mean square error.

[0064] Specifically, after obtaining the first evaluation index value of each pixel in the overlapping area of ​​the field of view of the matching left and right perspective display images, the first evaluation index value of each pixel unit in the overlapping area of ​​the field of view of the left and right perspective display images can be compared pixel by pixel to obtain a pixel by pixel comparison result; then the pixel by pixel comparison result is averaged, standard deviation, and mean square error are calculated to obtain the characteristic value of the pixel by pixel comparison result as the detail binocular consistency evaluation result of the XR device.

[0065] The embodiment of the present application compares the first evaluation index value of each pixel in the overlapping area of ​​the field of view of the left and right viewing angles of the XR device by obtaining characteristic values, thereby further clarifying the evaluation of the consistency of the detail brightness and / or chromaticity display characteristics of the two displays of the XR device.

[0066] In some embodiments, the first evaluation index value in S102 also includes a pixel position, and obtaining the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image and comparing them respectively includes:

[0067] Determine matching pixel points in the overlapping area of ​​the field of view of the matched left-view display image and right-view display image;

[0068] The pixel positions of the matching pixels in the matching left-view display image and right-view display image are compared to determine the pixel-by-pixel disparity.

[0069] Specifically, the pixel-by-pixel position overlap deviation of the binocular display of the XR device will also directly affect the binocular consistency of the XR device. Therefore, the first evaluation index value can also include the pixel position, and the pixel position of the overlapping area of ​​the field of view in the matching left and right perspective display images is obtained pixel by pixel. In the overlapping area of ​​the field of view, for each matching pixel point, the difference in its pixel position in the left and right perspective display images, that is, the parallax, is calculated respectively.

[0070] By determining the matching pixel points in the overlapping area of ​​the field of view in the matching left and right viewing angle display images, and comparing the pixel positions of the matching pixel points in the left and right viewing angle display images, the pixel-by-pixel disparity can be obtained.

[0071] It is conceivable that some matching pixels may be selected within the overlapping area of ​​the visual field for pixel position comparison.

[0072] The embodiment of the present application compares the pixel positions of the left and right viewing angles of the XR device in the overlapping area of ​​the field of view by pixel matching, further clarifying the evaluation of the consistency of the display effect details of the two displays of the XR device.

[0073] In some embodiments, the method further comprises:

[0074] The second evaluation index values ​​of the center points of the matched left-view display image and the right-view display image are obtained respectively and compared to obtain the overall binocular consistency evaluation result of the XR device.

[0075] The second evaluation index value includes a Gamma value and / or a Delta E value.

[0076] Specifically, by comparing the second evaluation index value of a specified pixel unit in the left and right viewing angles of the XR device, the brightness and / or chromaticity display characteristics of the two displays of the XR device are evaluated for overall consistency. The second evaluation index value is set as a Gamma value and / or a Delta E value.

[0077] Optionally, the designated pixel unit is selected as the center point of the display, that is, the center point of the displayed image. It is conceivable that other pixel units in the display may also be selected as designated pixel units.

[0078] When the input grayscale is determined, the Gamma value can be obtained by measuring the output brightness of the displayed image. By comparing the Gamma values ​​measured at a specified pixel unit in the left and right viewing angles of the XR device, the overall binocular consistency evaluation result of the XR device brightness can be obtained. By switching the images to be displayed with different grayscales, multiple sets of overall binocular consistency evaluation results of the XR device can be obtained to avoid the randomness of the evaluation results.

[0079] When the input grayscale is determined, the Delta E of the display can be obtained by measuring the chromaticity of the image to be displayed and the displayed image. By comparing the Delta E values ​​measured for a specified pixel unit in the left and right viewing angles of the XR device, the overall binocular consistency evaluation result of the XR device chromaticity can be obtained. By switching the images to be displayed with different grayscales, multiple groups of overall binocular consistency evaluation results of the XR device can be obtained to avoid the randomness of the evaluation results.

[0080] Furthermore, by comparing the second evaluation index value measured at a specified pixel unit in the left and right viewing angles of the XR device, the brightness and / or chromaticity display characteristics of the two displays of the XR device are evaluated for overall consistency, but there is a lack of detailed evaluation. Therefore, combined with the comparison results of the first evaluation index values ​​pixel by pixel in the overlapping area of ​​the field of view in the matching left and right viewing angles, that is, the detailed consistency evaluation results of the XR device, the binocular consistency evaluation of the XR device can be achieved from both the overall and detailed levels.

[0081] The embodiment of the present application can evaluate the overall consistency of the two displays of the XR device by comparing the second evaluation index value measured at the center points of the images displayed by the left and right viewing angles of the XR device, which is in line with the current production and manufacturing process and has low implementation cost; the second evaluation index value is set as the Gamma value and / or Delta E value, and the Gamma value and Delta E value of different pixel units of the same display are theoretically unified. Therefore, by comparing the Gamma value and / or Delta E value of the center points of the images displayed by the left and right viewing angles of the XR device, the overall binocular consistency evaluation of the brightness and / or chromaticity display characteristics of the XR device can be achieved, thereby realizing the overall binocular consistency evaluation of the XR device through a small number of simple evaluation values; at the same time, the binocular consistency evaluation of the XR device can be achieved from both the overall and detailed levels.

[0082] In some embodiments, obtaining and comparing the second evaluation index values ​​of the center points of the matched left-view display image and the right-view display image respectively includes:

[0083] Setting the region of interest where the center point of the matched left-view display image and the right-view display image is located; respectively obtaining the second evaluation index value of the pixel unit in the region of interest in the matched left-view display image and the right-view display image; determining the second evaluation index value of the center point based on the second evaluation index value of the pixel unit in the region of interest; or,

[0084] The second evaluation index values ​​of the pixel units corresponding to the center points of the matched left-view display image and right-view display image are respectively obtained.

[0085] Specifically, when comparing the second evaluation index values ​​measured at the center points of the left and right viewing angles of the XR device, the second evaluation index values ​​of the pixel units where the center points of the left and right viewing angles of the image are located can be directly compared.

[0086] Alternatively, set a region of interest (Region of Interest, ROI), respectively obtain the second evaluation index values ​​of some or all pixel units in the region of interest in the left and right viewing angles of the displayed image, and use the average of the second evaluation index values ​​of some or all pixel units in the region of interest as the second evaluation value of the center point. The size and shape of the region of interest can be preset.

[0087] Furthermore, the evaluation of binocular consistency of an XR device may occur at various stages of the XR device production process. The embodiments of the present application mainly distinguish between the unassembled and assembled stages of the XR device.

[0088] In some embodiments, when the XR device is not assembled (Display), the second evaluation index value and the first evaluation index value are measured by a single-point color analysis instrument or an imaging measurement instrument.

[0089] Alternatively, use a single-point color analysis instrument to measure the center-point Gamma value.

[0090] Optionally, a single-point color analysis instrument is used to measure the chromaticity of the monocular center point, and an imaging measurement instrument (industrial camera or brightness meter, etc.) is used to measure the brightness of the monocular display pixel by pixel, fit the Gamma curve and / or calculate the center point Delta E value, and then compare the binocular displays.

[0091] Optionally, a spectroscopic spectrally enhanced imaging colorimeter is used to simultaneously measure the brightness and chromaticity of each pixel of the monocular display, fit the Gamma curve and / or calculate the Delta E value of the center point, and then compare the binocular displays.

[0092] Optionally, a rotating wheel spectrally enhanced imaging colorimeter is used to simultaneously measure the brightness and chromaticity of each pixel of a monocular display, fit a gamma curve and / or calculate a center point Delta E value, and then compare binocular displays.

[0093] In some embodiments, when the XR device is assembled (including the module or finished product stage of the XR device), the first evaluation index value and the second evaluation index value are measured by an imaging measuring instrument with a near-eye display measurement lens.

[0094] Optionally, a spectroscopic spectrally enhanced imaging colorimeter with a near-eye display measurement lens is used to simultaneously measure the brightness and chromaticity of each pixel in the overlapping area of ​​the binocular field of view of the XR device, fit the Gamma curve and / or calculate the Delta E value of the center point, and then compare the binocular displays.

[0095] Optionally, a rotating spectrally enhanced imaging colorimeter with a near-eye display measurement lens is used to simultaneously measure the brightness and chromaticity of each pixel in the overlapping area of ​​the binocular field of view of the XR device, fit the Gamma curve and / or calculate the Delta E value of the center point, and then compare the binocular displays.

[0096] Optionally, a binocular spectrally enhanced ARVR imaging colorimeter with a near-eye display measurement lens is used to simultaneously measure the brightness and chromaticity of the overlapping area of ​​the binocular field of view of the XR device, fit the Gamma curve and / or calculate the Delta E value of the center point, and then compare the binocular displays.

[0097] Figure 3 is a structural diagram of a binocular consistency evaluation device for an XR device provided in an embodiment of the present application, such as Figure 3 As shown, the device at least includes:

[0098] An acquisition module 301 is used to acquire multiple groups of display images of the XR device by switching the images to be displayed in different grayscales under the same shooting conditions, where each group of display images includes a matching left-view display image and a right-view display image;

[0099] The first evaluation module 302 is used to set the overlapping area of ​​the field of view of the matched left-view display image and the right-view display image, respectively obtain the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image, and compare them to determine the detailed binocular consistency evaluation result of the XR device;

[0100] The first evaluation index value includes a Gamma value and / or a Delta E value.

[0101] In some embodiments, the first evaluation module 302 includes:

[0102] A first determining unit, configured to determine a first characteristic value based on a first evaluation index value per pixel in a visual field overlap region in a left-view display image;

[0103] A second determining unit, configured to determine a second characteristic value based on a first evaluation index value pixel by pixel in a visual field overlap region in a right-view display image;

[0104] A first comparison unit, used for comparing the first eigenvalue and the second eigenvalue;

[0105] The first eigenvalue and the second eigenvalue are both one or more of a mean, a standard deviation and a mean square error.

[0106] In some embodiments, the first evaluation index value also includes a pixel position, and the first evaluation module 302 includes:

[0107] A third determining unit is used to determine matching pixel points in the overlapping area of ​​the field of view of the matched left-view display image and the right-view display image;

[0108] The second comparison unit is used to compare the pixel positions of the matching pixels in the matched left-view display image and the right-view display image to determine the pixel-by-pixel disparity.

[0109] In some embodiments, the apparatus further comprises:

[0110] The second evaluation module is used to obtain and compare the second evaluation index values ​​of the center points of the matched left-view display image and the right-view display image, respectively, to determine the overall binocular consistency evaluation result of the XR device;

[0111] The second evaluation index value includes a Gamma value and / or a Delta E value.

[0112] In some embodiments, the second evaluation module specifically includes:

[0113] A setting unit is used to set the region of interest where the center point of the matched left-view display image and the right-view display image is located; a first acquisition unit is used to respectively acquire the second evaluation index value of the pixel unit in the region of interest in the matched left-view display image and the right-view display image; a fourth determination unit is used to determine the second evaluation index value of the center point based on the second evaluation index value of the pixel unit in the region of interest; or,

[0114] The second acquisition unit is used to respectively acquire second evaluation index values ​​of pixel units corresponding to the center points of the matched left-view display image and right-view display image.

[0115] In some embodiments, when the XR device is not assembled, the first evaluation index value and the second evaluation index value are measured by a single-point color analysis instrument or an imaging measuring instrument; when the XR device is assembled, the first evaluation index value and the second evaluation index value are measured by an imaging measuring instrument with a near-eye display measurement lens.

[0116] In some embodiments, when the XR device is not assembled, the imaging measuring instrument is: an industrial camera, or a spectroscopic spectrum-enhanced imaging measuring instrument, or a wheel-type spectrum-enhanced imaging measuring instrument;

[0117] When the XR device is assembled, the imaging measuring instrument is: a spectroscopic spectrum-enhanced imaging measuring instrument, or a wheel-type spectrum-enhanced imaging measuring instrument, or a binocular spectrum-enhanced imaging measuring instrument.

[0118] It can be understood that the detailed functional implementation of each of the above-mentioned units / modules can be found in the introduction of the aforementioned method embodiment, and will not be repeated here.

[0119] It should be understood that the above-mentioned device is used to execute the method in the above-mentioned embodiment. The implementation principle and technical effect of the corresponding program module in the device are similar to those described in the above-mentioned method. The working process of the device can refer to the corresponding process in the above-mentioned method, which will not be repeated here.

[0120] Based on the method in the above embodiment, an embodiment of the present application provides an electronic device. The device may include: at least one memory for storing programs and at least one processor for executing the programs stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method described in the above embodiment.

[0121] Figure 4 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, such as Figure 4 As shown, the electronic device may include: a processor (Processor) 401, a communication interface (Communications Interface) 402, a memory (Memory) 403 and a communication bus 404, wherein the processor 401, the communication interface 402, and the memory 403 communicate with each other through the communication bus 404. The processor 401 can call the software instructions in the memory 403 to execute the method described in the above embodiment.

[0122] In addition, the logic instructions in the above-mentioned memory 403 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.

[0123] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0124] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0125] It is understandable that the processor in the embodiment of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0126] The method steps in the embodiments of the present application can be implemented by hardware, or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (Random Access Memory, RAM), flash memory, read-only memory (Read-Only Memory, ROM), programmable read-only memory (Programmable ROM, PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), registers, hard disks, mobile hard disks, CD-ROMs or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0127] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)), etc.

[0128] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.

[0129] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A binocular consistency evaluation method for an XR device, characterized in that: include: Under the same shooting conditions, multiple groups of display images of the XR device are obtained by switching the images to be displayed with different grayscales, each group of display images includes a matching left-view display image and a right-view display image; Setting the overlapping area of ​​the field of view of the matched left-view display image and the right-view display image, respectively obtaining the first evaluation index value of each pixel of the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image and comparing them, and determining the detailed binocular consistency evaluation result of the XR device; The first evaluation index value includes a Gamma value and / or a Delta E value.

2. The binocular consistency evaluation method according to claim 1, characterized in that: The step of respectively obtaining the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image and performing comparison includes: Determine a first eigenvalue based on a first evaluation index value for each pixel in the overlapping area of ​​the visual field in the left-view display image; determine a second eigenvalue based on a first evaluation index value for each pixel in the overlapping area of ​​the visual field in the right-view display image; comparing the first eigenvalue and the second eigenvalue; The first eigenvalue and the second eigenvalue are one or more of a mean, a standard deviation and a mean square error.

3. The binocular consistency evaluation method according to claim 1 or 2, characterized in that: The first evaluation index value also includes a pixel position, and the first evaluation index value of each pixel in the overlapping area of ​​the field of view in the matched left-view display image and the right-view display image is obtained and compared, including: Determine matching pixel points in the field of view overlap region of the matching left-view display image and right-view display image; The pixel positions of the matching pixel points in the matched left-view display image and the right-view display image are compared to determine the pixel-by-pixel disparity.

4. The binocular consistency evaluation method according to claim 1, characterized in that: The method further comprises: Respectively obtain and compare the second evaluation index values ​​of the center points of the matched left-view display image and the right-view display image to determine the overall binocular consistency evaluation result of the XR device; The second evaluation index value includes a Gamma value and / or a Delta E value.

5. The binocular consistency evaluation method according to claim 4, characterized in that: The step of respectively obtaining the second evaluation index values ​​of the center points of the matched left-view display image and the right-view display image comprises: Setting the region of interest where the center point of the matched left-view display image and the right-view display image is located; respectively obtaining the second evaluation index value of the pixel unit in the region of interest in the matched left-view display image and the right-view display image; determining the second evaluation index value of the center point based on the second evaluation index value of the pixel unit in the region of interest; or, The second evaluation index values ​​of the pixel units corresponding to the center points of the matched left-view display image and right-view display image are respectively obtained.

6. The binocular consistency evaluation method according to claim 4, characterized in that: When the XR device is not assembled, the first evaluation index value and the second evaluation index value are measured by a single-point color analysis instrument or an imaging measuring instrument; when the XR device is assembled, the first evaluation index value and the second evaluation index value are measured by an imaging measuring instrument with a near-eye display measurement lens.

7. The binocular consistency evaluation method according to claim 6, characterized in that: When the XR device is not assembled, the imaging measuring instrument is: an industrial camera, or a spectroscopic spectrum-enhanced imaging measuring instrument, or a wheel-type spectrum-enhanced imaging measuring instrument; When the XR device is assembled, the imaging measuring instrument is: a spectroscopic spectrum-enhanced imaging measuring instrument, or a wheel-type spectrum-enhanced imaging measuring instrument, or a binocular spectrum-enhanced imaging measuring instrument.

8. A binocular consistency evaluation device for an XR device, characterized in that: include: An acquisition module, used to acquire multiple groups of display images of the XR device by switching the images to be displayed in different grayscales under the same shooting conditions, each group of display images including a matching left-view display image and a right-view display image; A first evaluation module is used to set the visual field overlap area of ​​the matched left-view display image and the right-view display image, respectively obtain the first evaluation index value of each pixel of the visual field overlap area in the matched left-view display image and the right-view display image, and compare them to determine the detail binocular consistency evaluation result of the XR device; The first evaluation index value includes a Gamma value and / or a Delta E value.

9. An electronic device / image signal generator / network device / transmitter / terminal / base station / industrial computer, characterized in that: include: at least one memory for storing a computer program; At least one processor is used to execute the program stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program runs on a processor, the processor is caused to execute the method according to any one of claims 1 to 7.

Images