NED equipment binocular clarity adjustment, MTF consistency compensation method and device

Abstract

The present application belongs to the field of near-eye display, and specifically discloses a method and device for adjusting binocular clarity and compensating MTF consistency of NED equipment. The NED equipment includes: a left-eye optical display system and a right-eye optical display system; the clarity adjustment method includes: determining the PSF when a preset pixel is illuminated by the left-eye optical display system and the right-eye optical display system respectively; determining the correction coefficient when the pixel is illuminated synchronously by the two optical display systems according to the least common multiple of the PSF of the preset pixel in the two optical display systems; when the preset pixel needs to be illuminated by the two optical display systems, the relevant pixel is illuminated in combination with the correction coefficient; the correction coefficient is used to determine the pixel that needs to be additionally illuminated when the two optical display systems illuminate the preset pixel synchronously, so that the clarity of the virtual image of the two optical display systems at the preset pixel is consistent. Through this application, the binocular clarity of the NED device can be guaranteed to be consistent as much as possible, and the comfort of users wearing the NED device can be improved.

Description

Technical Field

[0001] The present application belongs to the field of Near Eye Display (NED), and more specifically, to a method and apparatus for adjusting binocular clarity and compensating MTF consistency of a NED device. Background Art

[0002] NED devices such as Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR) are devices that can combine computer-generated virtual images or real environments with virtual images and project virtual images to the human eye through an optical system. Since NED devices have their own optical systems, the impact of their optical systems on projected virtual images is reduced to varying degrees. In addition, it is difficult for the optical system used in the binoculars of NED devices to ensure the consistency of optical properties, which will lead to inconsistent clarity of binocular virtual images, thereby reducing the user's wearing comfort and causing discomfort such as dizziness and nausea.

[0003] Modulation Transfer Function (MTF) is one of the key indicators to describe the image quality displayed by NED devices. It is used to quantify the clarity of the image projected by NED devices to the human eye. The current MTF test of NED devices can only be performed on a single camera. When performing binocular MTF test, the clarity of the binoculars is inconsistent. There is no product in the existing technology that can complete the consistency compensation of binocular MTF. Summary of the invention

[0004] In view of the defects of the prior art, the purpose of this application is to provide a method and device for binocular clarity adjustment and MTF consistency compensation of a NED device, aiming to solve the problem that the binocular clarity consistency of the existing NED device is difficult to ensure, which will reduce the wearing comfort of the user, and consistency compensation cannot be performed when performing binocular MTF detection.

[0005] To achieve the above objectives, in a first aspect, the present application provides a binocular clarity adjustment method for a near-eye display (NED) device, wherein the NED device comprises: a left-eye optical display system and a right-eye optical display system, and the method comprises:

[0006] Determine a point spread function (PSF) when a preset pixel point is illuminated by a left-eye optical display system and a right-eye optical display system respectively;

[0007] Determining, according to the least common multiple of the PSFs of the preset pixel in the two optical display systems, a correction coefficient when the pixel is synchronously illuminated by the two optical display systems;

[0008] When the preset pixel points need to be illuminated by two optical display systems, the relevant pixel points are illuminated in combination with the correction coefficient; the correction coefficient is used to determine the pixel points that need to be additionally illuminated when the two optical display systems synchronously illuminate the preset pixel points, so that the clarity of the virtual images of the two optical display systems at the preset pixel points is consistent.

[0009] It is understandable that when the NED device lights up a certain pixel, two optical display systems are required to light up the pixel at the same time. Since the PSF of each optical display system when lighting up this pixel is different, that is, the corresponding imaging spot size is different, and different spot sizes correspond to different clarity; in this application, the PSF of the two optical display systems at this pixel is adjusted so that when the two optical display systems light up this pixel, the spot size is the same and the clarity remains consistent. Therefore, this application can enhance the comfort of users wearing NED devices, and will not cause users to feel dizzy or nauseous due to inconsistent binocular clarity.

[0010] In a possible implementation, the correction coefficient includes: the number of pixels that need to be additionally lit;

[0011] Determine the correction coefficient when the preset pixel is illuminated synchronously by two optical display systems, including:

[0012] The least common multiple is divided by the PSF of the left-eye optical display system and the right-eye optical display system at the preset pixel point to obtain the number of additional pixels that need to be lit when the left-eye optical display system and the right-eye optical display system light up the preset pixel point.

[0013] Optionally, when lighting a certain pixel for correction, other pixels need to be additionally lit so that the corresponding spot size reaches the expected value; ensure that the spot sizes when the two optical display systems light up this pixel can reach the same expectation, and ensure that the clarity of the binoculars of the NED device lighting up this pixel is consistent.

[0014] In a possible implementation, the correction coefficient also includes: the position of the pixel point that needs to be additionally illuminated;

[0015] Obtaining an image field when the PSF corresponding to the preset pixel point is the least common multiple;

[0016] The positions of pixels that need to be additionally lit up when the left-eye optical display system and the right-eye optical display system light up the preset pixels are determined in combination with the image field.

[0017] In a second aspect, the present application provides a binocular clarity adjustment method for a NED device, the NED device comprising: a left-eye optical display system and a right-eye optical display system, the method comprising:

[0018] Determining a plurality of pixels that need to be lit when a preset picture is displayed by a left-eye optical display system and a right-eye optical display system;

[0019] Acquire correction coefficients of at least some of the multiple pixel points by using the method described in the first aspect or any possible implementation manner of the first aspect;

[0020] When the preset picture is displayed by the left-eye optical display system and the right-eye optical display system, the relevant pixels are lit in combination with the correction coefficients of at least part of the pixels.

[0021] It should be noted that when the NED device lights up the preset picture, it needs to light up the corresponding multiple pixels. When the method provided in the first aspect is used to adjust the binocular clarity corresponding to each pixel, the clarity of the preset picture will be greatly improved. Of course, the more dispersed the pixels that need to be lit in the preset picture are, the better the clarity adjustment effect of the above preset picture will be. The more continuous the distribution of pixels that need to be lit in the preset picture is, the less obvious the clarity adjustment effect of the above preset picture will be.

[0022] In a possible implementation, lighting up relevant pixels in combination with the correction coefficient of at least some of the pixels includes:

[0023] Interpolating the correction coefficients of the partial pixel points to obtain correction coefficients of the remaining pixel points in the plurality of pixel points;

[0024] The relevant pixel points are illuminated based on the correction coefficient of each pixel point among the plurality of pixel points.

[0025] In a possible implementation, when the pixel point that needs to be additionally illuminated indicated by the correction coefficient belongs to a pixel point among the multiple pixel points, correction of the pixel point that needs to be additionally illuminated is ignored.

[0026] In a third aspect, the present application provides a binocular MTF consistency compensation method for a NED device, the NED device comprising: a left-eye optical display system and a right-eye optical display system, the method comprising:

[0027] The MTF test pattern used by the NED device for binocular modulation transfer function MTF test is used as the preset picture;

[0028] The preset screen is displayed using the method described in the second aspect or any possible implementation manner of the second aspect.

[0029] Obviously, by using the clarity adjustment method provided in the second aspect to perform consistency compensation for the MTF binocular test of the NED device, the clarity of the MTF test pattern displayed by the binocular can be adjusted to be consistent, so that the test results of the binocular MTF are consistent. Since the MTF test pattern is usually not too dense, it is easier and more intuitive to directly observe whether the binocular clarity of the NED device is adjusted to be consistent through the MTF test, which can facilitate the consistency detection and debugging of the NED device and improve the user experience.

[0030] In a fourth aspect, the present application provides a binocular clarity adjustment device for a NED device, wherein the NED device comprises: a left-eye optical display system and a right-eye optical display system, and the device comprises:

[0031] A PSF determination module, used to determine a point spread function PSF when a preset pixel point is illuminated by a left-eye optical display system and a right-eye optical display system respectively;

[0032] A correction coefficient determination module, used to determine the correction coefficient when the pixel is synchronously illuminated by the two optical display systems according to the least common multiple of the PSF of the preset pixel in the two optical display systems;

[0033] A pixel clarity adjustment module is used to illuminate the relevant pixel points in combination with the correction coefficient when the preset pixel points need to be illuminated by the two optical display systems; the correction coefficient is used to determine the pixel points that need to be additionally illuminated when the two optical display systems synchronously illuminate the preset pixel points, so that the clarity of the virtual images of the two optical display systems at the preset pixel points is consistent.

[0034] In a fifth aspect, the present application provides a binocular clarity adjustment device for a NED device, the NED device comprising: a left-eye optical display system and a right-eye optical display system, the device comprising:

[0035] A preset picture determination module determines a plurality of pixels that need to be lit when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system;

[0036] a correction coefficient determination module, configured to obtain correction coefficients of at least some of the plurality of pixels by using the method described in the first aspect or any possible implementation manner of the first aspect;

[0037] The picture clarity adjustment module is used to light up relevant pixel points in combination with the correction coefficient of at least part of the pixel points when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system.

[0038] In a sixth aspect, the present application provides a binocular MTF consistency compensation device for a near-eye display (NED) device, wherein the NED device comprises: a left-eye optical display system and a right-eye optical display system, and the device comprises:

[0039] An MTF test picture determination module is used to use the MTF test pattern used by the NED device for binocular modulation transfer function MTF test as a preset picture;

[0040] A binocular MTF compensation module is used to display the preset picture using the description of the second aspect or any possible implementation manner of the second aspect.

[0041] In the seventh aspect, the present application provides an electronic device, comprising: at least one memory for storing programs; and at least one processor for executing the programs stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method described in the first aspect, any possible implementation of the first aspect, the second aspect, any possible implementation of the second aspect, the third aspect, or any possible implementation of the third aspect.

[0042] In an eighth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method described in the first aspect, any possible implementation of the first aspect, the second aspect, any possible implementation of the second aspect, the third aspect, or any possible implementation of the third aspect.

[0043] In the ninth aspect, the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method described in the first aspect, any possible implementation of the first aspect, the second aspect, any possible implementation of the second aspect, the third aspect, or any possible implementation of the third aspect.

[0044] It can be understood that the beneficial effects of the fourth to eighth aspects mentioned above can be found in the relevant descriptions of the first to third aspects mentioned above, and will not be repeated here.

[0045] In general, the above technical solutions conceived by the present application have at least the following beneficial effects compared with the prior art:

[0046] The present application provides a method and device for adjusting binocular clarity and compensating for MTF consistency of a NED device. When the NED device lights up a certain pixel, the PSF of the two optical display systems at this pixel is adjusted so that the size of the light spot is the same and the clarity is consistent when the two optical display systems light up the pixel. The comfort of users wearing NED devices can be improved, and the user experience will not be improved by causing dizziness or nausea due to inconsistent binocular clarity. When the NED device lights up a preset screen, the corresponding multiple pixels need to be lit. When the above method is used to adjust the binocular clarity corresponding to each pixel, the clarity of the preset screen will be greatly improved.

[0047] The present application provides a method and device for adjusting binocular clarity and compensating MTF consistency of a NED device, and proposes a binocular MTF consistency compensation method, which can effectively solve the problem of MTF inconsistency of binocular virtual images of NED devices. The method of the present application obtains the PSF distribution of the left-eye optical display system and the right-eye optical display system and the correction coefficient of the display image, and corrects the original image, so that when the binocular displays the corrected image, it can output a basically consistent MTF test result, thereby realizing the consistency compensation of the binocular MTF, and facilitating intuitive observation through the MTF test whether the binocular clarity of the NED device is adjusted to be consistent.

[0048] In summary, the method provided by the present application can not only improve the binocular display quality of NED devices, but also improve the user experience of NED devices when providing stereoscopic visual experience, so that users will not feel uncomfortable due to the inconsistency of binocular clarity when watching stereoscopic images, thereby improving the use value of NED devices. The method provided by the present application can be used not only in the production and manufacturing process of NED devices, but also in the later maintenance and repair of NED devices, and has broad application prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is a schematic diagram of the structure of a NED device provided in an embodiment of the present application;

[0050] Figure 2 It is a flow chart of a binocular clarity adjustment method for a NED device provided in an embodiment of the present application;

[0051] Figure 3 is another flow chart of the binocular clarity adjustment method of the NED device provided in the embodiment of the present application;

[0052] Figure 4 is a flow chart of a method for compensating binocular MTF consistency of a NED device provided in an embodiment of the present application;

[0053] Figure 5It is a specific flow chart of the binocular MTF consistency compensation method for NED equipment provided in an embodiment of the present application;

[0054] Figure 6 This is an architectural diagram of a binocular clarity adjustment device for a NED device provided in an embodiment of the present application;

[0055] Figure 7 This is another architecture diagram of the binocular clarity adjustment device for NED equipment provided in an embodiment of the present application;

[0056] Figure 8 : is an architecture diagram of a binocular MTF consistency compensation device for a NED device provided in an embodiment of the present application;

[0057] Fig. 9 It is an architectural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0059] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0060] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0061] First, the technical terms involved in the embodiments of the present application are introduced.

[0062] (1) Optical display system

[0063] The optical display system consists of two main parts: the optical system and the display screen, which work together to provide high-quality virtual or real images for display.

[0064] (2) Left-eye optical display system / right-eye optical display system

[0065] In the NED field, the left-eye optical display system and the right-eye optical display system usually refer to independent display systems designed for the left eye and the right eye respectively. This design is common in stereoscopic vision technology; when the NED device is worn by the user, the left-eye optical display system and the right-eye optical display system are located in front of the user's left eye and right eye respectively.

[0066] (3) MTF test pattern

[0067] The MTF test pattern is a pattern used to evaluate the MTF of an imaging system. The MTF test pattern usually contains line pairs or strips of different spatial frequencies, which can test the responsiveness of a camera lens or other imaging device at different levels of detail.

[0068] (4) PSF

[0069] PSF is a function that describes the distribution characteristics of the light spot formed by a point light source after imaging in an optical system. It is the light intensity distribution of an ideal point light source imaging and reflects the imaging quality of the optical system.

[0070] Each pixel in the optical display system of NED devices can be regarded as a point light source. Pixel refers to the smallest controllable light point on electronic displays or digital cameras and other devices, and is the basic component of the smallest unit in the picture.

[0071] Next, the technical solutions provided in the embodiments of the present application are introduced.

[0072] Figure 1 is a schematic diagram of the structure of the NED device provided in the embodiment of the present application; Figure 1 As shown, the NED device includes a left-eye optical display system and a right-eye optical display system. When the NED device is worn by a user, the left-eye optical display system and the right-eye optical display system are located in front of the user's left eye and right eye, respectively.

[0073] Embodiment 1: For a certain pixel point lit by the NED device, if the PSF of the pixel point in two optical display systems is different, the size of the virtual image spot corresponding to the pixel point will be different, that is, the corresponding clarity will be inconsistent.

[0074] To adjust the problem of inconsistent clarity when the binoculars of the NED device light up a certain pixel, Figure 2 is a flow chart of a binocular clarity adjustment method for a NED device provided in an embodiment of the present application; Figure 2 As shown, the following steps are included:

[0075] Step S101, determining the PSF when a preset pixel point is illuminated by a left-eye optical display system and a right-eye optical display system respectively;

[0076] Step S102, determining a correction coefficient when the pixel is synchronously illuminated by the two optical display systems according to the least common multiple of the PSFs of the preset pixel in the two optical display systems;

[0077] Step S103, when the preset pixel points need to be illuminated by two optical display systems, the relevant pixel points are illuminated in combination with the correction coefficient; the correction coefficient is used to determine the pixel points that need to be additionally illuminated when the two optical display systems synchronously illuminate the preset pixel points, so that the clarity of the virtual images of the two optical display systems at the preset pixel points is consistent.

[0078] In a possible implementation, the correction coefficient includes: the number of pixels that need to be additionally lit;

[0079] Determine the correction coefficient when the preset pixel is illuminated synchronously by two optical display systems, including:

[0080] The least common multiple is divided by the PSF of the left-eye optical display system and the right-eye optical display system at the preset pixel point to obtain the number of additional pixels that need to be lit when the left-eye optical display system and the right-eye optical display system light up the preset pixel point.

[0081] Optionally, when lighting a certain pixel for correction, other pixels need to be additionally lit so that the corresponding spot size reaches the expected value; ensure that the spot sizes when the two optical display systems light up this pixel can reach the same expectation, and ensure that the clarity of the binoculars of the NED device lighting up this pixel is consistent.

[0082] In a possible implementation, the correction coefficient also includes: the position of the pixel point that needs to be additionally illuminated;

[0083] Obtaining an image field when the PSF corresponding to the preset pixel point is the least common multiple;

[0084] The positions of pixels that need to be additionally lit up when the left-eye optical display system and the right-eye optical display system light up the preset pixels are determined in combination with the image field.

[0085] For example, in the imaging process, the image field and the object field correspond one to one; in the NED device, the object field refers to the light source, that is, each pixel point. The image field refers to the distribution of the virtual image of the NED device.

[0086] Embodiment 2: For a preset picture lit by a NED device, the preset picture includes multiple pixels. If there is one or more pixels with different PSFs in the two optical display systems, the sizes of the virtual image spots corresponding to the pixels in the preset picture will be different, that is, the clarity corresponding to the preset pictures lit by the two optical display systems is inconsistent.

[0087] To adjust the problem of inconsistent clarity when the NED device's binoculars light up the preset screen, Figure 3 is another flow chart of the binocular clarity adjustment method of the NED device provided in the embodiment of the present application; Figure 3 As shown, the following steps are included:

[0088] Step S201, determining a plurality of pixels that need to be lit when a preset picture is displayed by a left-eye optical display system and a right-eye optical display system;

[0089] Step S202, using Figure 2 The provided method obtains correction coefficients of at least some of the plurality of pixels;

[0090] Step S203 , when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system, relevant pixels are lit in combination with the correction coefficients of at least some of the pixels.

[0091] It should be noted that when the NED device lights up the preset picture, it needs to light up the corresponding multiple pixels. When the method provided in Example 1 is used to adjust the binocular clarity corresponding to each pixel, the clarity of the preset picture will be greatly improved. Of course, the more dispersed the pixels that need to be lit in the preset picture are, the better the clarity adjustment effect of the preset picture will be. The more continuous the distribution of pixels that need to be lit in the preset picture is, the less obvious the clarity adjustment effect of the preset picture will be.

[0092] Optionally, lighting up relevant pixels in combination with the correction coefficient of at least part of the pixels includes:

[0093] Interpolating the correction coefficients of the partial pixel points to obtain correction coefficients of the remaining pixel points in the plurality of pixel points;

[0094] The relevant pixel points are illuminated based on the correction coefficient of each pixel point among the plurality of pixel points.

[0095] Optionally, when the pixel point that needs to be additionally illuminated indicated by the correction coefficient belongs to a pixel point among the multiple pixel points, correction of the pixel point that needs to be additionally illuminated is ignored.

[0096] It is understandable that, assuming that the multiple pixels in the preset picture are pixel 1, pixel 2, pixel 3, ..., pixel n; if pixel 1 and pixel 2 are continuous, when correcting pixel 1, if it is necessary to additionally light up pixel 2 at this time, it is ignored. Therefore, for the case where the pixels in the preset picture are continuously and densely distributed, the above definition adjustment method is more effective at the edge of the preset picture, and is relatively unobvious at the densely pixelated areas.

[0097] Figure 4: is a flow chart of a binocular MTF test method for NED equipment provided in an embodiment of the present application; Figure 4 As shown, the following steps are included:

[0098] Step S301, using the MTF test pattern used by the NED device for binocular MTF test as a preset picture;

[0099] Step S302, using Figure 3 The provided method displays the preset screen.

[0100] Combined with the above Figure 2 and Figure 3 The given embodiment applies the binocular clarity adjustment method of the NED device to the binocular MTF test process of the NED device, and compensates for the consistency of the binocular MTF test of the NED device, which can effectively solve the problem of inconsistent binocular virtual image MTF of the NED device. The method of the present application obtains the PSF distribution of the left-eye optical display system and the right-eye optical display system and the correction coefficient of the display image, and corrects the original image, so that the binocular can output basically consistent MTF test results when displaying the corrected image, thereby realizing the consistency compensation of the binocular MTF; based on the MTF image, the tester can more simply and intuitively observe and verify whether the binocular clarity of the NED device has been adjusted to be consistent, which can effectively improve the binocular consistency of the NED device.

[0101] The technical solution provided in this application can effectively improve the clarity consistency of the binocular virtual image or binocular MTF test pattern of the NED device, so as to improve the performance of the NED device, make the user wearing comfortable, reduce discomfort such as dizziness and nausea, and improve the user experience of the NED device when providing a stereoscopic visual experience.

[0102] Figure 5 is a specific flow chart of the binocular MTF consistency compensation method for NED equipment provided in the embodiment of the present application; Figure 5 As shown, the following technical means are mainly used:

[0103] Step 1. Obtain the point spread function (PSF) distribution of the left and right eyes of the NED: Light up the same dot diagram of the left and right eyes of the NED respectively, which covers the entire field of view of the NED, and then use the same NED test system or two NED test systems with basically the same MTF to image the dot diagram of the left and right eyes respectively, and extract the imaging of each pixel in the dot diagram, that is, the PSF distribution.

[0104] Step 2: Calculate the correction coefficients of the left and right eye display images: First, calculate the least common multiple of the left and right eye PSFs, then calculate the pattern correction coefficients of the left and right eyes based on this least common multiple, and finally interpolate to obtain the pattern correction coefficient n under any field of view within the entire field of view.

[0105] Step 3, apply the pattern correction coefficient to the original pattern: The pattern correction coefficient refers to the correction coefficient of the actual illuminated pixels in the pattern. For example, the left and right eyes originally illuminate a single point under a certain FOV, and the pattern correction coefficient under this FOV is n, then after correction, the pattern should illuminate n pixels under this FOV.

[0106] Step 4: Display the corrected image for both eyes and test the binocular MTF: Through the above steps, the binocular MTF can be basically consistent, thereby improving the consistency of the binocular virtual image MTF of the NED glasses, improving the user's wearing comfort, and reducing discomfort such as dizziness and nausea.

[0107] Embodiment 3: In a more specific embodiment, the above method includes the following steps:

[0108] Step 1: Get the point spread function (PSF) distribution of the left and right eyes of the NED. The left and right eyes light up the same dot diagram, which covers the entire field of view of the NED. Each dot in the dot diagram is a single NED display pixel. The interval between dots can be greater than 1 pixel, but the distance between two dots should not be too large. They should be distributed as densely as possible in the entire field of view of the NED. Then use the same NED test system or two NED test systems with basically the same MTF to image the dot diagram of the left and right eyes respectively, and then extract the image of each pixel in the dot diagram to obtain the PSF distribution of the left and right eyes, which are recorded as psfleft and psfright respectively.

[0109] Step 2: Calculate the correction coefficients for the left and right eye display images. First, calculate the least common multiple of psfleft and psfright, denoted as psfcom. Then, calculate the pattern correction coefficients for the left and right eyes, CorCoefLeft=psfcom / psfleft, CorCoefRight=psfcom / psfright. Finally, interpolate to obtain the pattern correction coefficients for any field of view within the entire field of view.

[0110] Step 3: Apply the pattern correction coefficient to the original pattern. The pattern correction coefficient refers to the correction coefficient of the actual illuminated pixel points in the pattern. For example, if a single point is originally illuminated under a certain FOV, and the pattern correction coefficient is 2 under the FOV, then the corrected pattern should illuminate 2 pixels under the FOV.

[0111] Step 4: Display the corrected image to the binocular eyes and test the binocular MTF. Control the NED left and right eyes to display the corrected image respectively, and then use the NED test system used in step 1 to test the binocular MTF.

[0112] At this point, a substantially consistent MTF test result can be obtained, thereby completing binocular MTF consistency compensation. The above is a specific embodiment of the present application. Through this method, the consistency of the binocular virtual image MTF of NED glasses can be effectively improved, the user's wearing comfort can be improved, and discomfort such as dizziness and nausea can be reduced.

[0113] Due to the advanced nature of this technical solution, it can be widely used in application fields such as VR, AR and MR. With the development of science and technology, the demand in these fields is growing, and the demand for improving user experience is also increasing. The consistent binocular MTF compensation process proposed in this application can effectively solve the problem that it is difficult to ensure the consistency of optical properties of the binocular optical display system used in NED glasses, improve the yield of NED products, and reduce the manufacturing cost of NED. At the same time, the present application can also achieve consistency compensation of binocular MTF, which can improve the user's wearing comfort for devices that provide stereoscopic visual experience, reduce discomfort such as dizziness and nausea, and thus greatly improve the user experience. Therefore, this application has broad market demand and good application prospects.

[0114] Figure 6 is a structural diagram of a binocular clarity adjustment device for a NED device provided in an embodiment of the present application; Figure 6 As shown, it includes: a PSF determination module 610, a correction coefficient determination module 620 and a pixel definition adjustment module 630.

[0115] A PSF determination module 610, for determining the PSF when a preset pixel point is illuminated by the left-eye optical display system and the right-eye optical display system respectively;

[0116] A correction coefficient determination module 620, for determining a correction coefficient when the pixel is synchronously illuminated by two optical display systems according to the least common multiple of the PSFs of the preset pixel in the two optical display systems;

[0117] The pixel clarity adjustment module 630 is used to illuminate the relevant pixel points in combination with the correction coefficient when the preset pixel points need to be illuminated by the two optical display systems; the correction coefficient is used to determine the pixel points that need to be additionally illuminated when the two optical display systems synchronously illuminate the preset pixel points, so that the clarity of the virtual images of the two optical display systems at the preset pixel points is consistent.

[0118] The correction coefficient determined by the correction coefficient determination module 620 includes: the number of pixels that need to be additionally illuminated; specifically, the correction coefficient determination module 620 divides the least common multiple by the PSF of the left-eye optical display system and the right-eye optical display system at the preset pixel points, respectively, to obtain the number of pixels that need to be additionally illuminated when the left-eye optical display system and the right-eye optical display system illuminate the preset pixel points.

[0119] The correction coefficient determined by the correction coefficient determination module 620 also includes: the position of the pixel points that need to be additionally illuminated; specifically, the correction coefficient determination module 620 obtains the image field when the corresponding PSF at the preset pixel point is the least common multiple; and combines the image field to determine the position of the pixel points that need to be additionally illuminated when the left-eye optical display system and the right-eye optical display system illuminate the preset pixel points.

[0120] Figure 7 is another architecture diagram of the binocular clarity adjustment device for NED equipment provided in an embodiment of the present application; Figure 7 As shown, it includes: a preset picture determination module 710, a correction coefficient determination module 720 and a picture clarity adjustment module 730.

[0121] A preset picture determination module 710 determines a plurality of pixels that need to be lit when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system;

[0122] Correction coefficient determination module 720, for adopting Figure 2 The provided method obtains correction coefficients of at least some of the plurality of pixels;

[0123] The picture definition adjustment module 730 is used to light up relevant pixels in combination with the correction coefficients of at least some of the pixels when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system.

[0124] The correction coefficient determination module 720 illuminates the relevant pixel points in combination with the correction coefficients of at least some of the pixel points, including: interpolating the correction coefficients of some of the pixel points to obtain the correction coefficients of the remaining pixel points in the multiple pixel points; and lighting the relevant pixel points based on the correction coefficients of each pixel point in the multiple pixel points.

[0125] The picture definition adjustment module 730 is configured to ignore the correction of the pixel points that need to be additionally illuminated when the pixel points that need to be additionally illuminated indicated by the correction coefficient belong to the pixel points among the multiple pixel points.

[0126] Figure 8 : is a schematic diagram of the binocular MTF consistency compensation device for NED equipment provided in an embodiment of the present application; Figure 8 As shown, the device comprises:

[0127] The MTF test picture determination module 810 is used to use the MTF test pattern used by the NED device to perform binocular modulation transfer function MTF test as a preset picture;

[0128] Binocular MTF compensation module 820 is used to adopt Figure 3 The provided method displays the preset screen.

[0129] It should be understood that the above Figures 6 to 8 The provided device is used to execute the method in the above embodiment. The implementation principle and technical effect of the corresponding program module in the device are similar to those described in the above method. The working process of the device can refer to the corresponding process in the above method and will not be repeated here.

[0130] Based on the method in the above embodiment, the embodiment of the present application provides an electronic device, such as Fig. 9 As shown, the electronic device may include: a processor 910, a communication interface 920, a memory 930 and a communication bus 940, wherein the processor 910, the communication interface 920 and the memory 930 communicate with each other via the communication bus 940. The processor 910 may call the logic instructions in the memory 930 to execute the method in the above embodiment.

[0131] In addition, the logic instructions in the above-mentioned memory 930 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.

[0132] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0133] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0134] It is understandable that the processor in the embodiment of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0135] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0136] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0137] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.

[0138] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A binocular clarity adjustment method for a near-eye display (NED) device, wherein the NED device include: The left-eye optical display system and the right-eye optical display system are characterized in that the method comprises: Determine a point spread function PSF when a preset pixel point is illuminated by a left-eye optical display system and a right-eye optical display system respectively; Determine, according to the least common multiple of the PSFs of the preset pixel point in the two optical display systems, a correction coefficient when the pixel point is synchronously illuminated by the two optical display systems; the correction coefficient includes: the number of pixels that need to be additionally illuminated; divide the least common multiple by the PSFs of the left-eye optical display system and the right-eye optical display system at the preset pixel point, respectively, to obtain the number of pixels that need to be additionally illuminated when the left-eye optical display system and the right-eye optical display system illuminate the preset pixel point; When the preset pixel point needs to be illuminated by two optical display systems, the relevant pixel point is illuminated in combination with the correction coefficient; the correction coefficient is used to determine the pixel point that needs to be additionally illuminated when the two optical display systems synchronously illuminate the preset pixel point, so that the size of the spot is the same when the two optical display systems illuminate the pixel point, and the clarity of the virtual image at the pixel point is consistent.

2. The method according to claim 1, It is characterized in that The correction coefficient also includes: the position of the pixel that needs to be additionally lit; Obtaining an image field when the PSF corresponding to the preset pixel point is the least common multiple; The positions of pixels that need to be additionally lit up when the left-eye optical display system and the right-eye optical display system light up the preset pixels are determined in combination with the image field.

3. A binocular clarity adjustment method for a near-eye display (NED) device, wherein the NED device include: The left-eye optical display system and the right-eye optical display system are characterized in that the method comprises: Determining a plurality of pixels that need to be lit when a preset picture is displayed by a left-eye optical display system and a right-eye optical display system; Using the method described in claim 1 or 2 to obtain correction coefficients of at least some of the multiple pixels; When the preset picture is displayed by the left-eye optical display system and the right-eye optical display system, the relevant pixels are lit in combination with the correction coefficients of at least part of the pixels.

4. The method according to claim 3, It is characterized in that Lighting up relevant pixels in combination with the correction coefficient of at least some of the pixels includes: Interpolating the correction coefficients of the partial pixel points to obtain correction coefficients of the remaining pixel points in the plurality of pixel points; The relevant pixel points are illuminated based on the correction coefficient of each pixel point among the plurality of pixel points.

5. The method according to claim 3 or 4, It is characterized in that When the pixel point that needs to be additionally illuminated indicated by the correction coefficient belongs to a pixel point among the multiple pixel points, the correction of the pixel point that needs to be additionally illuminated is ignored.

6. A binocular MTF consistency compensation method for near-eye display (NED) devices, NED devices include: The left-eye optical display system and the right-eye optical display system are characterized in that the method comprises: The MTF test pattern used by the NED device for binocular modulation transfer function MTF test is used as the preset picture; The preset screen is displayed using the method described in any one of claims 3 to 5.

7. A binocular clarity adjustment device for a near-eye display (NED) device, NED device include: The left-eye optical display system and the right-eye optical display system are characterized in that the device comprises: A PSF determination module, used to determine a point spread function PSF when a preset pixel point is illuminated by a left-eye optical display system and a right-eye optical display system respectively; A correction coefficient determination module, used to determine the correction coefficient when the pixel is synchronously illuminated by the two optical display systems according to the least common multiple of the PSF of the preset pixel in the two optical display systems; the correction coefficient includes: the number of pixels that need to be additionally illuminated; dividing the least common multiple by the PSF of the left-eye optical display system and the right-eye optical display system at the preset pixel, respectively, to obtain the number of pixels that need to be additionally illuminated when the left-eye optical display system and the right-eye optical display system illuminate the preset pixel; A pixel clarity adjustment module is used to illuminate the relevant pixel points in combination with the correction coefficient when the preset pixel points need to be illuminated by the two optical display systems; the correction coefficient is used to determine the pixel points that need to be additionally illuminated when the two optical display systems synchronously illuminate the preset pixel points, so that the clarity of the virtual images of the two optical display systems at the preset pixel points is consistent.

8. A binocular clarity adjustment device for a near-eye display (NED) device, wherein the NED device include: The left-eye optical display system and the right-eye optical display system are characterized in that the device comprises: A preset picture determination module determines a plurality of pixels that need to be lit when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system; A correction coefficient determination module, used to obtain correction coefficients of at least some of the multiple pixel points by using the method described in claim 1 or 2; The picture clarity adjustment module is used to light up relevant pixel points in combination with the correction coefficient of at least part of the pixel points when the preset picture is displayed by the left-eye optical display system and the right-eye optical display system.

9. A binocular MTF consistency compensation device for a near-eye display (NED) device, NED device include: The left-eye optical display system and the right-eye optical display system are characterized in that the device comprises: An MTF test picture determination module is used to use the MTF test pattern used by the NED device for binocular modulation transfer function MTF test as a preset picture; A binocular MTF compensation module is used to display the preset picture using the method described in any one of claims 3 to 5.

Images