Binocular stray light compensation and contrast compensation method, device and equipment for NED equipment

Abstract

This application belongs to the field of near-eye display, and specifically discloses a method, device, and apparatus for binocular stray light compensation and contrast compensation for NED devices. The compensation method includes: determining the stray light distribution when two optical display systems respectively illuminate preset pixel points; determining the superimposed stray light distribution at the preset pixel point based on the stray light distribution of the two optical display systems at the preset pixel point; the superimposed stray light distribution is to take the maximum value of the brightness of the two stray light distributions at each pixel point; when the preset pixel point needs to be illuminated by two optical display systems, based on the superimposed stray light distribution at the pixel point and the stray light distribution of each optical display system at the pixel point, controlling each optical display system to compensate for the stray light of the pixel point, so that the stray light distribution of the two optical display systems at the pixel point is consistent. Through this application, the binocular stray light of the NED device can be effectively compensated to be consistent, thereby improving the user experience.

Description

Technical Field

[0001] The present application belongs to the field of near eye display (NED), and more specifically, relates to a method, device and equipment for binocular stray light compensation and contrast compensation of NED equipment. Background Art

[0002] In near-eye display (NED) devices, such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), contrast is a critical optical property that directly impacts image clarity and the quality of the visual experience. Contrast refers to the display system's ability to reproduce the difference in brightness between its brightest and darkest areas. Near-eye display devices like AR, VR, and MR incorporate their own optical systems, and stray light introduced by these systems is a major factor affecting NED product contrast. However, achieving consistent stray light in binocular optical systems is difficult. Even if the contrast of the displays used by both eyes is consistent, the contrast of the virtual images projected through their respective optical systems will vary, resulting in inconsistent binocular contrast. Consistent binocular contrast is crucial for NED systems, directly impacting user experience quality, visual comfort, and the realism of the immersive experience. When there is a significant difference in contrast between the images received by both eyes, the brain must work hard to process this discrepancy, which can lead to visual fatigue or discomfort. Prolonged exposure to such conditions can increase eye strain, causing discomfort and even headaches.

[0003] Existing solutions primarily use imaging NED test systems to test the contrast of NED products. However, this method typically only tests monocular contrast, and no product can achieve consistent binocular contrast compensation. Summary of the Invention

[0004] In response to the defects of the existing technology, the purpose of this application is to provide a method, device and equipment for binocular stray light compensation and contrast compensation of NED equipment, aiming to solve the problem that the existing technology cannot compensate for binocular stray light of NED equipment and cannot compensate for binocular contrast consistency of NED equipment.

[0005] To achieve the above objectives, in a first aspect, the present application provides a method for compensating binocular stray light of an NED device, wherein the NED device includes two optical display systems, namely, a left-eye optical display system and a right-eye optical display system. The method includes:

[0006] Determining stray light distribution when two optical display systems respectively illuminate preset pixel points; the stray light distribution includes: a set of brightness distributions at unlit pixel points;

[0007] Determining a stray light superposition distribution at a preset pixel point based on the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is obtained by taking the maximum brightness of the two stray light distributions at each pixel point;

[0008] When the preset pixel point needs to be illuminated by two optical display systems, each optical display system is controlled to compensate for the stray light of the pixel point based on the superimposed distribution of the stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0009] The stray light distribution at the preset pixel point mentioned in this application refers to the stray light introduced by the optical display system of the NED device.

[0010] It should be noted that the image of a single optical display system when the preset pixel point is lit in a dark room can be captured by an imaging device to determine the stray light distribution at the preset pixel point; the above-mentioned stray light distribution is the brightness distribution of other pixel points in the captured image except for the preset pixel point that is lit. Furthermore, those skilled in the art will know that when an imaging device is used for imaging, additional stray light may be introduced because the imaging device usually has its own optical lens. In this application, it is considered to select an imaging device that introduces less stray light for imaging. At this time, the stray light introduced by the imaging device during the imaging process is very weak and can be ignored. Alternatively, after the imaging device captures the image, the stray light introduced by the imaging device in the captured image can be corrected by the existing technology first, and then the stray light distribution at the preset pixel point can be determined by the corrected image.

[0011] It should be noted that this application compensates the stray light distribution to the same level when the two optical display systems of the NED device light up the same pixel point, thereby improving the consistency of the stray light distribution of the binoculars of the NED device at the preset pixel points, and thus can improve the contrast consistency of the binoculars of the NED device.

[0012] In one possible implementation, controlling each optical display system to compensate for the stray light of the pixel includes:

[0013] Subtracting the stray light superposition distribution at a preset pixel from the stray light distribution of each optical display system at the pixel, to obtain a stray light compensation distribution of each optical display system at the pixel; the stray light compensation distribution includes: a set of compensated brightness distributions of at least one pixel other than the pixel that needs to be compensated;

[0014] According to the stray light compensation distribution of each optical display system at a preset pixel point, the stray light is compensated when each optical display system lights up the pixel point.

[0015] In a possible implementation, compensating for stray light when each optical display system illuminates the pixel includes:

[0016] Determining pixel points that need to be compensated and corresponding brightness that needs to be compensated according to the stray light compensation distribution;

[0017] When the pixel that needs to be compensated is in the lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated;

[0018] When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated, so that its brightness is compensated to the brightness that needs to be compensated.

[0019] It can be understood that when the pixel point that needs to be compensated is in the illuminated state, its lighting brightness is adjusted according to the brightness that needs to be compensated. Specifically: when the brightness grayscale value of the illuminated pixel point is less than the maximum brightness grayscale value of the corresponding optical display system, the brightness of the pixel point is compensated, and the corresponding brightness that needs to be compensated is increased on the basis of its original brightness.

[0020] Optionally, when the brightness required to be compensated added to the original brightness is greater than the maximum brightness grayscale value, the brightness may be directly compensated to the maximum brightness grayscale value.

[0021] In a possible implementation, when the brightness of a preset pixel point that needs to be illuminated increases, the pixel point distribution under the stray light compensation distribution remains unchanged, and the pixel point brightness changes year-on-year.

[0022] In a possible implementation, the stray light distribution when the optical display system illuminates a preset pixel is obtained by the following steps:

[0023] Acquire an image of a display screen when a single optical display system only lights up preset pixels;

[0024] The stray light distribution of the preset pixel point is determined according to the brightness of other pixel points in the captured image except the preset pixel point.

[0025] In a second aspect, the present application provides a method for compensating binocular stray light of an NED device, wherein the NED device includes two optical display systems, the two optical display systems being a left-eye optical display system and a right-eye optical display system. The method includes:

[0026] Determine all pixels that need to be lit when a preset image is displayed by two optical display systems;

[0027] The stray light of each pixel point among all the pixel points is compensated by the method described in the first aspect or any possible implementation manner of the first aspect, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

[0028] It can be understood that, under normal circumstances, the stray light compensation method provided in this application can be applied to the case of a single pixel or multiple pixels, and the stray light distribution of the illuminated pixels can be compensated for consistency, and the binocular stray light of the NED device can be compensated to a consistent level.

[0029] In a third aspect, the present application provides a binocular contrast compensation method for an NED device, wherein the NED device includes two optical display systems, the two optical display systems being a left-eye optical display system and a right-eye optical display system. The method includes:

[0030] Determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels;

[0031] Compensating the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset image is consistent;

[0032] The stray light of each pixel in all the pixels is compensated by the method described in the first aspect or any possible implementation manner of the first aspect, so that the brightness of the darkest areas when the two optical display systems display the preset picture is consistent.

[0033] In a fourth aspect, the present application provides a binocular stray light compensation device for an NED device, wherein the NED device includes: two optical display systems, the two optical display systems being: a left-eye optical display system and a right-eye optical display system, and the device includes:

[0034] A stray light distribution determining unit, configured to determine the stray light distribution when two optical display systems respectively light up preset pixels; the stray light distribution includes: a brightness distribution set of unlit pixels;

[0035] a stray light distribution superposition unit, configured to determine a stray light superposition distribution at a preset pixel point based on the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is obtained by taking the maximum brightness of the two stray light distributions at each pixel point;

[0036] The stray light compensation unit is used to control each optical display system to compensate for the stray light of the pixel point when the preset pixel point needs to be illuminated by two optical display systems, based on the superimposed distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0037] In a fifth aspect, the present application provides a binocular stray light compensation device for an NED device, wherein the NED device includes: two optical display systems, the two optical display systems being: a left-eye optical display system and a right-eye optical display system, and the device includes:

[0038] A pixel point determination module, used to determine all pixels that need to be lit when a preset image is displayed by two optical display systems;

[0039] A stray light compensation module is used to compensate for the stray light of each pixel in all the pixel points using the method described in the first aspect or any possible implementation of the first aspect, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

[0040] In a sixth aspect, the present application provides a binocular contrast compensation device for an NED device, wherein the NED device includes: two optical display systems, the two optical display systems being: a left-eye optical display system and a right-eye optical display system, and the device includes:

[0041] a pixel point determination unit, configured to determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels;

[0042] a bright area brightness compensation unit, configured to compensate for the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset image is consistent;

[0043] A dark area brightness compensation unit is used to compensate for the stray light of each pixel among all the pixel points using the method described in the first aspect or any possible implementation of the first aspect, so that the brightness of the darkest area is consistent when the two optical display systems display the preset picture.

[0044] In the seventh aspect, the present application provides an electronic device comprising: at least one memory for storing programs; at least one processor for executing the programs stored in the memory; when the programs stored in the memory are executed, the processor is used to execute the methods described in the first aspect, any possible implementation of the first aspect, the second aspect, and the third aspect.

[0045] In an eighth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method described in the first aspect, any possible implementation of the first aspect, the second aspect, and the third aspect.

[0046] In a ninth aspect, the present application provides a computer program product, which, when running on a processor, enables the processor to execute the method described in the first aspect, any possible implementation of the first aspect, the second aspect, and the third aspect.

[0047] It can be understood that the beneficial effects of the fourth to ninth aspects mentioned above can be found in the relevant descriptions of the first and second aspects mentioned above, and will not be repeated here.

[0048] In general, the above technical solutions conceived by this application have at least the following beneficial effects compared with the prior art:

[0049] The present application provides a method, device and equipment for binocular stray light compensation and contrast compensation of a NED device. By compensating for the stray light of the same pixel point lit by both eyes of the NED device, the stray light of both eyes is compensated to the same level, which greatly avoids the difference in binocular stray light of the NED device and can significantly improve the user experience of using the NED device. Furthermore, the above-mentioned stray light compensation scheme is applied to the contrast compensation of the NED device. By first compensating the brightness of the brightest pictures of the two eyes to be consistent, and then compensating the influence of the binocular stray light to be consistent, the contrast of the two eyes is at the same level, thereby improving the quality of the user's visual experience. Since the present application can ensure the consistency of the contrast of the two eyes, when using near-eye display devices such as virtual reality, augmented reality and mixed reality, users can enjoy more realistic and clearer visual effects, thereby improving the realism and comfort of the user experience.

[0050] This application provides a method, device, and apparatus for binocular stray light compensation and contrast compensation for NED devices. Because this application ensures consistent contrast between the two eyes, users' brains do not need to process visual information caused by inconsistent contrast when using near-eye display devices such as virtual reality, augmented reality, and mixed reality. This reduces the possibility of visual fatigue and is beneficial to the user's eye health. This application can effectively improve the contrast performance of NED products, thereby enhancing the overall quality and competitiveness of the products. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 This is a flow chart of a method for compensating binocular stray light of a NED device provided in an embodiment of the present application;

[0052] FIG2( a ) is a schematic diagram of an ideal brightness distribution of an image captured when a preset pixel point is illuminated by the optical display system provided by an embodiment of the present application;

[0053] FIG2( b ) is a schematic diagram of stray light distribution when a preset pixel point is illuminated by the left-eye optical display system provided by an embodiment of the present application;

[0054] FIG2( c ) is a schematic diagram of stray light distribution when a preset pixel point is illuminated by the right-eye optical display system provided by an embodiment of the present application;

[0055] FIG2( d ) is a schematic diagram of the superposition distribution of stray light at a preset pixel point of two optical display systems provided in an embodiment of the present application;

[0056] FIG3( a ) is a schematic diagram of stray light compensation distribution of a left-eye optical display system provided in an embodiment of the present application;

[0057] FIG3( b ) is a schematic diagram of stray light compensation distribution of a right-eye optical display system provided in an embodiment of the present application;

[0058] Figure 4 This is a flow chart of another method for compensating binocular stray light of an NED device provided in an embodiment of the present application;

[0059] Figure 5 This is a flow chart of a binocular contrast compensation method for a NED device provided in an embodiment of the present application;

[0060] Figure 6 This is a diagram showing the architecture of a binocular stray light compensation device for a NED device provided in an embodiment of the present application;

[0061] Figure 7 This is an architecture diagram of another NED device binocular stray light compensation device provided in an embodiment of the present application;

[0062] Figure 8 This is a diagram showing the architecture of a binocular contrast compensation device for an NED device provided in an embodiment of the present application;

[0063] Figure 9 This is an architectural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.

[0065] The term "and / or" as used herein describes an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. The symbol " / " as used herein indicates that the related objects are in an "or" relationship, for example, A / B means either A or B.

[0066] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0067] In the description of the embodiments of the present application, unless otherwise specified, "at least one" means one or more, for example, at least one pixel refers to one or more pixels, etc.

[0068] First, the technical terms involved in the embodiments of this application are introduced.

[0069] (1) Optical display system

[0070] The optical display system consists of two main parts: the optical system and the display screen, which work together to provide high-quality virtual or real images for display.

[0071] (2) Left-eye optical display system / right-eye optical display system

[0072] In the NED field, the left-eye optical display system and the right-eye optical display system usually refer to independent display systems designed for the left eye and the right eye respectively. This design is common in stereoscopic vision technology; when the NED device is worn by the user, the left-eye optical display system and the right-eye optical display system are located in front of the user's left eye and right eye respectively.

[0073] Among them, a single optical display system can be referred to as a monocular NED device; and the left and right eye optical display systems can be referred to as a binocular NED device.

[0074] (3) Stray light

[0075] Stray light is unwanted light in an optical system. It may come from ambient light or light reflected, scattered, or refracted by the optical system and does not follow the intended path through the optical system. This light may interfere with image quality and clarity.

[0076] (4) Darkroom

[0077] A darkroom is a room with very little light or complete darkness.

[0078] Next, the technical solutions provided in the embodiments of this application are introduced.

[0079] Figure 1 A flow chart of a binocular stray light compensation method for a NED device provided in an embodiment of the present application is as follows: Figure 1 As shown, the following steps are included:

[0080] Step S101, determining the stray light distribution when two optical display systems light up preset pixels respectively; the stray light distribution includes: a set of brightness distributions at unlit pixels;

[0081] Figure 2(a) is a schematic diagram of the ideal brightness distribution of the captured image when the optical display system provided by an embodiment of the present application lights up the preset pixel points; as shown in Figure 2(a), when the optical display system of the NED device does not introduce stray light, in the captured image, except for the sub-pixel in the 3rd row and 3rd column that is lit, the brightness grayscale value is 255, for example, the brightness grayscale value of other sub-pixels is 0.

[0082] FIG2( b ) is a schematic diagram of stray light distribution when the left-eye optical display system provided by an embodiment of the present application illuminates a preset pixel point. As shown in FIG2( b ), the stray light distribution of the left-eye optical display system when the above pixel point is illuminated is specifically shown in Table 1:

[0083] Table 1

[0084]

[0085]

[0086] FIG2( c ) is a schematic diagram of stray light distribution when the right-eye optical display system provided by an embodiment of the present application illuminates a preset pixel point. As shown in FIG2( c ), the stray light distribution of the right-eye optical display system when the above pixel point is illuminated is shown in Table 2:

[0087] Table 2

[0088] 0 2 4 3 0 1 8 9 7 1 5 8 0 9 5 1 10 12 9 1 0 2 3 2 0

[0089] Step S102, determining a stray light superposition distribution at a preset pixel point based on the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is obtained by taking the maximum brightness of the two stray light distributions at each pixel point;

[0090] FIG2( d ) is a schematic diagram of the superposition distribution of stray light at a preset pixel point of two optical display systems provided in an embodiment of the present application. As shown in FIG2( d ), the superposition distribution of stray light is shown in Table 3:

[0091] Table 3

[0092] 0 3 4 3 0 1 8 10 7 1 5 9 0 9 5 1 10 12 9 1 0 3 4 3 0

[0093] Step S103: When the preset pixel point needs to be illuminated by two optical display systems, each optical display system is controlled to compensate for the stray light of the pixel point according to the superimposed distribution of the stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0094] In one example, controlling each optical display system to compensate for the stray light of the pixel includes:

[0095] Subtracting the stray light superposition distribution at a preset pixel from the stray light distribution of each optical display system at the pixel, to obtain a stray light compensation distribution of each optical display system at the pixel; the stray light compensation distribution includes: a set of compensated brightness distributions of at least one pixel other than the pixel that needs to be compensated;

[0096] According to the stray light compensation distribution of each optical display system at a preset pixel point, the stray light is compensated when each optical display system lights up the pixel point.

[0097] FIG3( a ) is a schematic diagram of stray light compensation distribution of a left-eye optical display system provided in an embodiment of the present application.

[0098] FIG3( b ) is a schematic diagram of the stray light compensation distribution of the right-eye optical display system provided in an embodiment of the present application.

[0099] Furthermore, those skilled in the art will appreciate that compensating for stray light when each optical display system illuminates the pixel point includes:

[0100] Determining pixel points that need to be compensated and corresponding brightness that needs to be compensated according to the stray light compensation distribution;

[0101] When the pixel that needs to be compensated is in the lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated;

[0102] When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated.

[0103] It is understandable that in a possible scenario, when a pixel point that needs to be compensated is in a lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated, specifically:

[0104] When the brightness grayscale value of the illuminated pixel is less than the maximum brightness grayscale value of the corresponding optical display system, the brightness of the pixel is compensated by increasing the corresponding brightness to be compensated on the basis of its original brightness.

[0105] Optionally, when the brightness required to be compensated added to the original brightness is greater than the maximum brightness grayscale value, the brightness may be directly compensated to the maximum brightness grayscale value.

[0106] Furthermore, when the brightness grayscale value of the illuminated pixel is greater than or equal to the above-mentioned maximum brightness grayscale value, the brightness of the pixel is not compensated.

[0107] In another possible scenario, such as a scenario in which binocular contrast compensation is performed on an NED device, pixels that need to be compensated and corresponding brightness that needs to be compensated are determined based on the stray light compensation distribution;

[0108] When the pixel that needs to be compensated is already lit, its brightness is not adjusted;

[0109] When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated.

[0110] In the above-mentioned NED device binocular contrast compensation scenario, only the unlit pixels are compensated, so that the brightness of the binocular dark areas of the NED device can be compensated more efficiently to be consistent.

[0111] It can be understood that when the brightness of the preset pixel points that need to be illuminated increases, the pixel point distribution under the stray light compensation distribution remains unchanged, and the pixel point brightness changes year-on-year.

[0112] In a possible implementation, the stray light distribution when the optical display system illuminates a preset pixel is obtained by the following steps:

[0113] Acquire an image of a display screen when a single optical display system only lights up preset pixels;

[0114] The stray light distribution of the preset pixel point is determined according to the brightness of other pixel points in the captured image except the preset pixel point.

[0115] Figure 4 Another flow chart of a binocular stray light compensation method for NED devices provided in an embodiment of the present application is as follows: Figure 4 As shown, the following steps are included:

[0116] Step S201, determining all pixels that need to be lit when a preset image is displayed by two optical display systems;

[0117] In step S202 , the binocular stray light compensation method is used to compensate for the stray light of each pixel in all the pixels, so that the stray light distribution of the two optical display systems at all the pixels remains consistent.

[0118] It can be understood that the binocular compensation method for NED devices provided in the embodiment of the present application is not only applicable to the scenario where the NED device binocularly lights up a single pixel, but also to the scenario where the NED device binocularly lights up a preset picture (multiple pixels); the compensation in these two scenarios is to compensate the stray light of the lit pixel points to be consistent.

[0119] Figure 5 A flow chart of a binocular contrast compensation method for a NED device provided in an embodiment of the present application is as follows: Figure 5 As shown, the following steps are included:

[0120] Step S301, determining all pixels that need to be lit when two optical display systems respectively display a preset image and at least one pixel with the maximum brightness value among all the pixels;

[0121] Step S302, compensating the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset image is consistent;

[0122] Step S303 , using the binocular stray light compensation method to compensate for the stray light of each pixel in all the pixels, so that the brightness of the darkest areas when the two optical display systems display the preset image is consistent.

[0123] More specifically, in step S202 or step S303, the above-mentioned binocular stray light compensation method is used to compensate for the stray light of each pixel in all pixels, which can be: if the brightness grayscale value of the pixel that needs to be compensated and is in the illuminated state is greater than or equal to the brightness grayscale maximum value of the corresponding optical display system, then its brightness is no longer adjusted; if the brightness grayscale value of the pixel that needs to be compensated and is in the illuminated state is less than the aforementioned brightness grayscale maximum value, then its brightness is adjusted to the brightness that needs to be compensated; or if the pixel that needs to be compensated is in the illuminated state, then its brightness is no longer adjusted, and only the pixel that is not illuminated is compensated. Those skilled in the art can choose the corresponding method to achieve stray light compensation based on actual needs, so as to best improve the user's visual experience quality of the NED device.

[0124] Those skilled in the art can refer to the binocular stray light compensation method for NED devices provided in the embodiments of the present application, and apply this method to the binocular contrast compensation scheme of NED devices according to actual conditions and needs, so as to perform consistency compensation for the contrast of the binocular eyes of the NED device, so that the contrast of the binocular eyes of the NED device is at the same level, thereby improving the user's visual experience quality.

[0125] The core purpose of the technical solution provided by this application is to achieve accurate compensation for stray light and contrast in the binocular of a NED device. In a more specific embodiment, the stray light and contrast compensation method provided by the embodiment of this application is applied to the binocular of a NED device as follows:

[0126] Step 1: Brightness compensation: DeMura technology is used to set the compensation target value of the brightness of the brightest images of both eyes to be consistent. This generates brightness compensation coefficients for both eyes, thereby compensating the brightness of both eyes to be consistent.

[0127] Step 2: Obtaining the stray light intensity and distribution. The NED left-eye optical display system sequentially lights up individual pixels on the display screen and images them using an imaging NED test system. This way, the stray light intensity distribution Ileft generated when the NED left-eye optical display system displays a single pixel can be obtained. The same NED test system or another test system with essentially the same stray light can then be used to perform the same monochrome pixel imaging on the NED right-eye optical display system to obtain the stray light intensity distribution Iright generated when the right-eye optical display system displays a single pixel. The stray light intensity distributions of the left and right-eye optical display systems are superimposed to obtain a common compensation target value Itarget for binocular stray light. Taking the stray light brightness or intensity Ileft(i) and Iright(i) of the i-th pixel as an example, each pixel of Itarget(i) takes the maximum value of the corresponding pixels of Ileft(i) and Iright(i).

[0128] Step 3: Stray light compensation. Calculate the stray light intensity that needs to be compensated for each pixel in the left-eye optical display system when it is illuminated: Icompenleft(i) = Itarget(i) - Ileft(i). Then, extract the brightness distribution of the display corresponding to Icompenleft(i). This brightness distribution is the distribution of pixels that need to be additionally illuminated when the i-th pixel is illuminated, and their brightness. When the brightness of the i-th pixel changes, the distribution of pixels that need to be additionally illuminated remains unchanged, and the brightness value only changes year-on-year.

[0129] The same is true for the right-eye optical display system. Through the above steps, the consistency compensation of NED binocular contrast can be effectively achieved.

[0130] Due to the advanced nature of the technical solution provided by this application, it can be widely used in application fields such as VR, AR and MR. First, this application proposes a new binocular contrast consistency compensation method, which can effectively solve the problem that binocular contrast consistency cannot be achieved in the existing technology, which is of great significance for improving the quality of user experience, visual comfort and the realism of immersive experience. Secondly, with the development of science and technology, the application of technologies such as virtual reality, augmented reality and mixed reality is becoming more and more extensive, and people's demand for these technologies is also increasing. Therefore, the market demand for this application will be very broad. Finally, the technical application prospects of this application are broad. It can be applied not only to the consumer market, but also to industrial manufacturing, medical care, education and other fields, with great commercial value and social benefits.

[0131] Figure 6 This is a diagram of the architecture of a binocular stray light compensation device for a NED device provided in an embodiment of the present application, such as Figure 6 Shown, including:

[0132] The stray light distribution determining unit 610 is configured to determine the stray light distribution when two optical display systems respectively light up preset pixels; the stray light distribution includes: a set of brightness distributions of unlit pixels;

[0133] The stray light distribution superposition unit 620 is configured to determine a stray light superposition distribution at a preset pixel point based on the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is obtained by taking the maximum brightness of the two stray light distributions at each pixel point;

[0134] The stray light compensation unit 630 is used to control each optical display system to compensate for the stray light of the pixel point when the preset pixel point needs to be illuminated by two optical display systems, based on the superimposed distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0135] Figure 7 This is a diagram of the architecture of another NED device binocular stray light compensation device provided in an embodiment of the present application, such as Figure 7 Shown, including:

[0136] A pixel point determination module 710 is used to determine all pixels that need to be lit when a preset image is displayed by two optical display systems;

[0137] Stray light compensation module 720 is used to Figure 1 The provided stray light compensation method compensates for the stray light of each pixel point among all the pixel points, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

[0138] Figure 8 This is a schematic diagram of a binocular contrast compensation device for a NED device provided in an embodiment of the present application, such as Figure 8 Shown, including:

[0139] A pixel determination unit 810 is configured to determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the maximum brightness value among all the pixels;

[0140] a bright area brightness compensation unit 820, configured to compensate for the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset image is consistent;

[0141] Dark area brightness compensation unit 830 is used to Figure 1 The provided stray light compensation method compensates for the stray light of each pixel among all the pixel points, so that the brightness of the darkest areas when the two optical display systems display the preset picture is consistent.

[0142] It should be understood that the above Figures 6 to 8 The device provided is used to execute the method in the above embodiment. The implementation principle and technical effect of the corresponding program unit or module in the device are similar to those described in the above method. The working process of the device can refer to the corresponding process in the above method and will not be repeated here.

[0143] Based on the method in the above embodiment, the embodiment of the present application provides an electronic device, such as Figure 9 As shown, the electronic device may include: a processor 910, a communication interface 920, a memory 930, and a communication bus 940, wherein the processor 910, the communication interface 920, and the memory 930 communicate with each other via the communication bus 940. The processor 910 may call the logic instructions in the memory 930 to execute the method in the above embodiment.

[0144] In addition, the logic instructions in the above-mentioned memory 930 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.

[0145] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0146] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0147] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0148] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0149] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted via the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive (SSD)).

[0150] It will be understood that the various numerical numbers involved in the embodiments of the present application are merely distinctions for the convenience of description and are not intended to limit the scope of the embodiments of the present application.

[0151] It is easy for those skilled in the art to understand that the above is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A method for compensating binocular stray light for a near-eye display (NED) device, the NED device comprising: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the method includes: Determining stray light distribution when two optical display systems respectively illuminate preset pixel points; the stray light distribution includes: a set of brightness distributions at unlit pixel points; Determining a stray light superposition distribution at a preset pixel point based on the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is obtained by taking the maximum brightness of the two stray light distributions at each pixel point; When the preset pixel point needs to be illuminated by two optical display systems, each optical display system is controlled to compensate for the stray light of the pixel point based on the superimposed distribution of the stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

2. The method according to claim 1, characterized in that Controlling each optical display system to compensate for the stray light of the pixel point, including: Subtracting the stray light superposition distribution at a preset pixel from the stray light distribution of each optical display system at the pixel, to obtain a stray light compensation distribution of each optical display system at the pixel; the stray light compensation distribution includes: a set of compensated brightness distributions of at least one pixel other than the pixel that needs to be compensated; According to the stray light compensation distribution of each optical display system at a preset pixel point, the stray light is compensated when each optical display system lights up the pixel point.

3. The method according to claim 2, characterized in that The compensating for stray light when each optical display system lights up the pixel point includes: Determining pixel points that need to be compensated and corresponding brightness that needs to be compensated according to the stray light compensation distribution; When the pixel that needs to be compensated is in the lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated; When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated.

4. The method according to any one of claims 2 or 3, characterized in that When the brightness of the preset pixel points that need to be illuminated increases, the pixel point distribution under the stray light compensation distribution remains unchanged, and the pixel point brightness changes year-on-year.

5. The method according to claim 1, wherein The stray light distribution when the optical display system lights up a preset pixel point is obtained by the following steps: Acquire an image of a display screen when a single optical display system only lights up preset pixels; The stray light distribution of the preset pixel point is determined according to the brightness of other pixel points in the captured image except the preset pixel point.

6. A method for compensating binocular stray light for a near-eye display (NED) device, the NED device comprising: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the method includes: Determine all pixels that need to be lit when a preset image is displayed by two optical display systems; The method according to any one of claims 1 to 5 is used to compensate for the stray light of each pixel in all the pixel points, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

7. A method for compensating binocular contrast of a near-eye display (NED) device, the NED device comprising: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the method includes: Determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels; Compensating the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset image is consistent; The method according to any one of claims 1 to 5 is used to compensate for the stray light of each pixel among all the pixel points, so that the brightness of the darkest areas when the two optical display systems display the preset picture is consistent.

8. A binocular stray light compensation device for a near-eye display (NED) device, the NED device comprising: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the device includes: A stray light distribution determining unit, configured to determine the stray light distribution when two optical display systems respectively light up preset pixels; the stray light distribution includes: a brightness distribution set of unlit pixels; a stray light distribution superposition unit, configured to determine a stray light superposition distribution at a preset pixel point based on the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is obtained by taking the maximum brightness of the two stray light distributions at each pixel point; The stray light compensation unit is used to control each optical display system to compensate for the stray light of the pixel point when the preset pixel point needs to be illuminated by two optical display systems, based on the superimposed distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

9. A binocular contrast compensation device for a near-eye display (NED) device, the NED device comprising: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the device includes: a pixel point determination unit, configured to determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels; a bright area brightness compensation unit, configured to compensate for the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset image is consistent; A dark area brightness compensation unit is used to compensate for the stray light of each pixel in all the pixels using the method described in any one of claims 1 to 5, so that the brightness of the darkest areas when the two optical display systems display the preset picture is consistent.

10. An electronic device, characterized in that: include: at least one memory for storing a computer program; At least one processor is configured to execute the program stored in the memory, and when the program stored in the memory is executed, the processor is configured to execute the method according to any one of claims 1 to 5, 6 or 7.

Images