Binocular stray light compensation and contrast compensation method, device and equipment for NED equipment

Abstract

The invention belongs to the field of near-to-eye display, and particularly discloses a binocular stray light compensation and contrast compensation method, device and equipment for NED equipment, and the compensation method comprises the steps: determining stray light distribution when two optical display systems lighten preset pixel points respectively; determining stray light superposition distribution at the preset pixel point according to the stray light distribution of the two optical display systems at the preset pixel point; the stray light superposition distribution is the maximum value of the brightness of two stray lights distributed at each pixel point; and when a preset pixel point needs to be lightened by the two optical display systems, according to the stray light superposition distribution at the pixel point and the stray light distribution of each optical display system at the pixel point, controlling each optical display system to compensate the stray light of the pixel point. And the stray light distribution of the two optical display systems at the pixel point is kept consistent. According to the method and the device, the stray light of the eyes of the NED can be effectively compensated to be consistent, and the user experience is improved.

Description

Technical Field

[0001] The present application belongs to the field of near eye display (NED), and more specifically, to a method, device and equipment for binocular stray light compensation and contrast compensation of a NED device. Background Art

[0002] In near-eye display (NED) devices such as virtual reality (VR), augmented reality (AR) and mixed reality (MR), contrast is an important optical property that directly affects the clarity of the image and the quality of the visual experience. Contrast refers to the ability of the display system to present the difference in brightness between the brightest and darkest areas. AR, VR, MR and other near-eye display devices have their own optical system. The stray light introduced by the optical system is the main factor affecting the contrast of NED products, and the stray light introduced by the binocular optical system is difficult to be consistent. Even if the contrast of the display screens used by both eyes is consistent, the contrast of the virtual images projected after passing through their respective optical systems will be different, which will lead to inconsistent binocular contrast. The consistency of binocular contrast is crucial for NED systems. It is directly related to the quality of user experience, visual comfort and the realism of immersive experience. When the images received by both eyes have obvious differences in contrast, the brain must work hard to process this inconsistency, which may cause visual fatigue or discomfort. Long-term exposure to such an environment may increase the burden on the user's eyes, causing discomfort or even headaches.

[0003] The existing solution is to use imaging NED test systems to test the contrast of NED products. However, this method usually completes the contrast test of a single eye, and there is no product that can achieve consistent compensation of binocular contrast. Summary of the invention

[0004] In view of the defects of the prior art, the purpose of this application is to provide a method, device and equipment for binocular stray light compensation and contrast compensation of NED equipment, aiming to solve the problem that the prior art is unable to perform binocular stray light compensation for NED equipment and is unable to perform binocular contrast consistency compensation for NED equipment.

[0005] To achieve the above objectives, in a first aspect, the present application provides a method for compensating binocular stray light of a NED device, wherein the NED device comprises: two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, and the method comprises:

[0006] Determine the stray light distribution when two optical display systems light up preset pixel points respectively; the stray light distribution includes: a brightness distribution set at unlit pixel points;

[0007] Determine the stray light superposition distribution at the preset pixel point according to the stray light distribution of the two optical display systems at the preset pixel point; the stray light superposition distribution is to take the maximum value of the brightness of the two stray light distributions at each pixel point;

[0008] When the preset pixel point needs to be illuminated by two optical display systems, each optical display system is controlled to compensate for the stray light of the pixel point according to the superimposed distribution of the stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0009] Among them, the stray light distribution at the preset pixel point mentioned in the present application refers to the stray light introduced by the optical display system of the NED device.

[0010] It should be noted that the image of a single optical display system lighting up preset pixels in a dark room can be captured by an imaging device to determine the stray light distribution at the preset pixels; the above-mentioned stray light distribution is the brightness distribution of other pixels in the captured image except for the preset pixels that are lit. Furthermore, those skilled in the art will know that when an imaging device is used for imaging, additional stray light may be introduced because the imaging device usually has its own optical lens. In the present application, it is considered to select an imaging device that introduces weaker stray light for imaging. At this time, the stray light introduced by the imaging device during the imaging process is very weak and can be ignored. Alternatively, after the imaging device captures the image, the stray light introduced by the imaging device in the captured image can be corrected by the existing technology, and then the stray light distribution at the preset pixel can be determined by the corrected image.

[0011] It should be noted that the present application compensates the stray light distribution to the same level when the two optical display systems of the NED device light up the same pixel, thereby improving the consistency of the stray light distribution of the binoculars of the NED device at the preset pixel points, and thereby improving the contrast consistency of the binoculars of the NED device.

[0012] In a possible implementation, controlling each optical display system to compensate for the stray light of the pixel includes:

[0013] Subtracting the stray light superposition distribution at the preset pixel point from the stray light distribution of each optical display system at the pixel point, respectively, to obtain the stray light compensation distribution of each optical display system at the pixel point; the stray light compensation distribution includes: a compensation brightness distribution set of at least one pixel point other than the pixel point that needs to be compensated;

[0014] According to the stray light compensation distribution of each optical display system at a preset pixel point, the stray light is compensated when each optical display system lights up the pixel point.

[0015] In a possible implementation, compensating for stray light when each optical display system lights up the pixel includes:

[0016] Determining the pixel points that need to be compensated and the corresponding brightness that needs to be compensated according to the stray light compensation distribution;

[0017] When the pixel point that needs to be compensated is in a lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated;

[0018] When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated, so that its brightness is compensated to the brightness that needs to be compensated.

[0019] It can be understood that when the pixel point that needs to be compensated is in the illuminated state, its lighting brightness is adjusted according to the brightness that needs to be compensated. Specifically, when the brightness grayscale value of the illuminated pixel point is less than the maximum brightness grayscale value of the corresponding optical display system, the brightness of the pixel point is compensated by increasing the corresponding brightness that needs to be compensated on the basis of its original brightness.

[0020] Optionally, when the brightness to be compensated added to the original brightness is greater than the maximum brightness grayscale value, the brightness may be directly compensated to the maximum brightness grayscale value.

[0021] In a possible implementation, when the brightness of a preset pixel point that needs to be illuminated increases, the pixel point distribution under the stray light compensation distribution remains unchanged, and the pixel point brightness changes year-on-year.

[0022] In a possible implementation, the stray light distribution when the optical display system lights up a preset pixel point is obtained by the following steps:

[0023] Acquire an image of a display screen when a single optical display system only lights up preset pixels;

[0024] The stray light distribution of the preset pixel point is determined according to the brightness of other pixel points in the captured image except the preset pixel point.

[0025] In a second aspect, the present application provides a method for compensating binocular stray light of a NED device, wherein the NED device comprises: two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, and the method comprises:

[0026] Determine all pixels that need to be lit when the preset picture is displayed by two optical display systems;

[0027] The stray light of each pixel among all the pixel points is compensated by the method described in the first aspect or any possible implementation manner of the first aspect, so that the stray light distribution of the two optical display systems at all the pixel points is consistent.

[0028] It can be understood that, under normal circumstances, the stray light compensation method provided in the present application can be applicable to the case of a single pixel or multiple pixels, and the stray light distribution of the lit pixels can be compensated for consistency, so as to compensate the binocular stray light of the NED device to a consistent level.

[0029] In a third aspect, the present application provides a binocular contrast compensation method for a NED device, wherein the NED device comprises: two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, and the method comprises:

[0030] Determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels;

[0031] Compensating the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset picture is consistent;

[0032] The stray light of each pixel among all the pixels is compensated by the method described in the first aspect or any possible implementation manner of the first aspect, so that the brightness of the darkest areas when the two optical display systems display the preset picture is consistent.

[0033] In a fourth aspect, the present application provides a binocular stray light compensation device for a NED device, wherein the NED device comprises: two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, and the device comprises:

[0034] A stray light distribution determination unit, used to determine the stray light distribution when two optical display systems light up preset pixels respectively; the stray light distribution includes: a brightness distribution set of unlit pixels;

[0035] A stray light distribution superposition unit, used to determine the stray light superposition distribution at the preset pixel point according to the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is to take the maximum brightness of the two stray light distributions at each pixel point;

[0036] The stray light compensation unit is used to control each optical display system to compensate for the stray light of the pixel point when the preset pixel point needs to be illuminated by two optical display systems, according to the superimposed distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0037] In a fifth aspect, the present application provides a binocular stray light compensation device for a NED device, wherein the NED device comprises: two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, and the device comprises:

[0038] A pixel point determination module, used to determine all the pixels that need to be lit when a preset picture is displayed by two optical display systems;

[0039] A stray light compensation module is used to compensate for the stray light of each pixel among all the pixel points by using the method described in the first aspect or any possible implementation of the first aspect, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

[0040] In a sixth aspect, the present application provides a binocular contrast compensation device for a NED device, wherein the NED device comprises: two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, and the device comprises:

[0041] A pixel point determination unit, used to determine all the pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels;

[0042] A bright area brightness compensation unit, used to compensate for the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest area when the two optical display systems display the preset picture is consistent;

[0043] A dark area brightness compensation unit is used to compensate for the stray light of each pixel among all the pixels by using the method described in the first aspect or any possible implementation of the first aspect, so that the brightness of the darkest area is consistent when the two optical display systems display the preset picture.

[0044] In the seventh aspect, the present application provides an electronic device, comprising: at least one memory for storing programs; at least one processor for executing the programs stored in the memory, when the program stored in the memory is executed, the processor is used to execute the first aspect, any possible implementation of the first aspect, the second aspect, and the method described in the third aspect.

[0045] In an eighth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method described in the first aspect, any possible implementation of the first aspect, the second aspect, and the third aspect.

[0046] In a ninth aspect, the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method described in the first aspect, any possible implementation of the first aspect, the second aspect, and the third aspect.

[0047] It can be understood that the beneficial effects of the fourth to ninth aspects mentioned above can be found in the relevant descriptions of the first and second aspects mentioned above, and will not be repeated here.

[0048] In general, the above technical solutions conceived by the present application have at least the following beneficial effects compared with the prior art:

[0049] The present application provides a method, device and equipment for binocular stray light compensation and contrast compensation of a NED device. By compensating for the stray light of the same pixel point lit by the binoculars of the NED device, the stray light of the binoculars is compensated to the same level, which greatly avoids the difference in binocular stray light of the NED device, and can significantly improve the user experience of using the NED device. Furthermore, the above-mentioned stray light compensation scheme is applied to the contrast compensation of the NED device. By first compensating the brightness of the brightest pictures of the binoculars to be consistent, and then compensating the influence of the binocular stray light to be consistent, the contrast of the binoculars is at the same level, thereby improving the quality of the user's visual experience. Since the present application can ensure the consistency of the contrast of the binoculars, when using near-eye display devices such as virtual reality, augmented reality and mixed reality, users can enjoy more realistic and clearer visual effects, thereby improving the realism and comfort of the user experience.

[0050] The present application provides a method, device and equipment for binocular stray light compensation and contrast compensation of NED equipment. Since the present application can ensure the consistency of binocular contrast, when users use near-eye display devices such as virtual reality, augmented reality and mixed reality, the brain does not need to work hard to process the visual information generated by inconsistent contrast, thereby reducing the possibility of visual fatigue and benefiting the user's eye health. The present application can effectively improve the contrast performance of NED products, thereby improving the overall quality and competitiveness of the products. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] Figure 1 This is a flow chart of a binocular stray light compensation method for a NED device provided in an embodiment of the present application;

[0052] FIG. 2( a ) is a schematic diagram of an ideal brightness distribution of an image captured when a preset pixel point is illuminated by the optical display system provided in an embodiment of the present application;

[0053] FIG2( b ) is a schematic diagram of stray light distribution when a preset pixel point is illuminated by the left-eye optical display system provided by an embodiment of the present application;

[0054] FIG2( c ) is a schematic diagram of stray light distribution when the right-eye optical display system provided by an embodiment of the present application lights up a preset pixel point;

[0055] FIG2( d ) is a schematic diagram of the superposition distribution of stray light at a preset pixel point of two optical display systems provided in an embodiment of the present application;

[0056] FIG3( a ) is a schematic diagram of stray light compensation distribution of a left-eye optical display system provided in an embodiment of the present application;

[0057] FIG3( b ) is a schematic diagram of stray light compensation distribution of a right-eye optical display system provided in an embodiment of the present application;

[0058] Figure 4 is a flow chart of another method for compensating binocular stray light of a NED device provided in an embodiment of the present application;

[0059] Figure 5 This is a flow chart of a binocular contrast compensation method for a NED device provided in an embodiment of the present application;

[0060] Figure 6 This is a schematic diagram of a binocular stray light compensation device for a NED device provided in an embodiment of the present application;

[0061] Figure 7 This is another architecture diagram of a binocular stray light compensation device for a NED device provided in an embodiment of the present application;

[0062] Figure 8 This is a schematic diagram of a binocular contrast compensation device for a NED device provided in an embodiment of the present application;

[0063] Fig. 9 This is an architecture diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0065] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The symbol " / " in this article indicates that the associated objects are in an or relationship, for example, A / B means A or B.

[0066] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0067] In the description of the embodiments of the present application, unless otherwise specified, "at least one" means one or more than one, for example, at least one pixel refers to one or more pixels, etc.

[0068] First, the technical terms involved in the embodiments of the present application are introduced.

[0069] (1) Optical display system

[0070] The optical display system consists of two main parts: the optical system and the display screen, which work together to provide high-quality virtual or real images for display.

[0071] (2) Left-eye optical display system / right-eye optical display system

[0072] In the NED field, the left-eye optical display system and the right-eye optical display system usually refer to independent display systems designed for the left eye and the right eye respectively. This design is common in stereoscopic vision technology; when the NED device is worn by the user, the left-eye optical display system and the right-eye optical display system are located in front of the user's left eye and right eye respectively.

[0073] Among them, a single optical display system can be referred to as a monocular NED device; and the left and right eye optical display systems can be referred to as a binocular NED device.

[0074] (3) Stray light

[0075] Stray light is unwanted light in an optical system. It may come from ambient light or light reflected, scattered or refracted by the optical system and does not pass through the optical system according to the intended path. These lights may interfere with the quality and clarity of the image.

[0076] (4) Darkroom

[0077] A darkroom is a room with very little light or complete darkness.

[0078] Next, the technical solutions provided in the embodiments of the present application are introduced.

[0079] Figure 1 A flow chart of a binocular stray light compensation method for a NED device provided in an embodiment of the present application is as follows: Figure 1 As shown, the following steps are included:

[0080] Step S101, determining the stray light distribution when two optical display systems light up preset pixels respectively; the stray light distribution includes: a brightness distribution set at unlit pixels;

[0081] Figure 2(a) is a schematic diagram of the ideal brightness distribution of a captured image when the optical display system provided by an embodiment of the present application lights up a preset pixel point; as shown in Figure 2(a), when the optical display system of the NED device does not introduce stray light, in the captured image, except for the sub-pixel in the 3rd row and 3rd column that is lit up, the brightness grayscale value is 255, for example, the brightness grayscale value of other sub-pixels is 0.

[0082] FIG2( b ) is a schematic diagram of stray light distribution when the left-eye optical display system provided in an embodiment of the present application lights up a preset pixel point; as shown in FIG2( b ), the stray light distribution when the left-eye optical display system lights up the above pixel point is specifically shown in Table 1:

[0083] Table 1

[0084]

[0085]

[0086] FIG2( c ) is a schematic diagram of stray light distribution when the right-eye optical display system provided by an embodiment of the present application lights up a preset pixel point; as shown in FIG2( c ), the stray light distribution when the right-eye optical display system lights up the above pixel point is shown in Table 2:

[0087] Table 2

[0088] 0 2 4 3 0 1 8 9 7 1 5 8 0 9 5 1 10 12 9 1 0 2 3 2 0

[0089] Step S102, determining a stray light superposition distribution at a preset pixel point according to the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is to take the maximum value of the brightness of the two stray light distributions at each pixel point;

[0090] FIG2( d ) is a schematic diagram of the superposition distribution of stray light at a preset pixel point of two optical display systems provided in an embodiment of the present application; as shown in FIG2( d ), the superposition distribution of stray light is shown in Table 3:

[0091] Table 3

[0092] 0 3 4 3 0 1 8 10 7 1 5 9 0 9 5 1 10 12 9 1 0 3 4 3 0

[0093] Step S103, when the preset pixel point needs to be illuminated by two optical display systems, according to the superposition distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, control each optical display system to compensate for the stray light of the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0094] In one example, controlling each optical display system to compensate for the stray light of the pixel includes:

[0095] Subtracting the stray light superposition distribution at the preset pixel point from the stray light distribution of each optical display system at the pixel point, respectively, to obtain the stray light compensation distribution of each optical display system at the pixel point; the stray light compensation distribution includes: a compensation brightness distribution set of at least one pixel point other than the pixel point that needs to be compensated;

[0096] According to the stray light compensation distribution of each optical display system at a preset pixel point, the stray light is compensated when each optical display system lights up the pixel point.

[0097] FIG. 3( a ) is a schematic diagram of stray light compensation distribution of a left-eye optical display system provided in an embodiment of the present application.

[0098] FIG3( b ) is a schematic diagram of stray light compensation distribution of the right-eye optical display system provided in an embodiment of the present application.

[0099] Furthermore, those skilled in the art can understand that compensating for stray light when each optical display system lights up the pixel point includes:

[0100] Determining the pixel points that need to be compensated and the corresponding brightness that needs to be compensated according to the stray light compensation distribution;

[0101] When the pixel point that needs to be compensated is in a lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated;

[0102] When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated.

[0103] It is understandable that in a possible scenario, when a pixel point that needs to be compensated is in a lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated, specifically:

[0104] When the brightness grayscale value of the illuminated pixel is less than the maximum brightness grayscale value of the corresponding optical display system, the brightness of the pixel is compensated by increasing the corresponding brightness to be compensated on the basis of its original brightness.

[0105] Optionally, when the brightness to be compensated added to the original brightness is greater than the maximum brightness grayscale value, the brightness may be directly compensated to the maximum brightness grayscale value.

[0106] Furthermore, when the brightness grayscale value of the illuminated pixel is greater than or equal to the above-mentioned maximum brightness grayscale value, the brightness of the pixel is not compensated.

[0107] In another possible scenario, for example, a scenario in which binocular contrast compensation is performed on a NED device, pixels that need to be compensated and corresponding brightness that needs to be compensated are determined according to the stray light compensation distribution;

[0108] When the pixel to be compensated is in the lit state, its brightness is not adjusted;

[0109] When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated.

[0110] In the above-mentioned NED device binocular contrast compensation scenario, only the unlit pixels are compensated, so as to more efficiently compensate the brightness of the binocular dark area of ​​the NED device to be consistent.

[0111] It can be understood that when the brightness of the preset pixel points that need to be illuminated increases, the pixel point distribution under the stray light compensation distribution remains unchanged, and the pixel point brightness changes year-on-year.

[0112] In a possible implementation, the stray light distribution when the optical display system lights up a preset pixel point is obtained by the following steps:

[0113] Acquire an image of a display screen when a single optical display system only lights up preset pixels;

[0114] The stray light distribution of the preset pixel point is determined according to the brightness of other pixel points in the captured image except the preset pixel point.

[0115] Figure 4 Another flow chart of a binocular stray light compensation method for a NED device provided in an embodiment of the present application is as follows: Figure 4 As shown, the following steps are included:

[0116] Step S201, determining all pixels that need to be lit when a preset picture is displayed by two optical display systems;

[0117] Step S202 , using the binocular stray light compensation method to compensate for the stray light of each pixel in all the pixels, so that the stray light distribution of the two optical display systems at all the pixels is consistent.

[0118] It can be understood that the binocular compensation method for NED devices provided in the embodiment of the present application is not only applicable to the scenario in which the NED device binocularly lights up a single pixel, but also to the scenario in which the NED device binocularly lights up a preset picture (multiple pixels); the compensation in these two scenarios is to compensate the stray light of the lit pixels to be consistent.

[0119] Figure 5 A flow chart of a binocular contrast compensation method for a NED device provided in an embodiment of the present application is as follows: Figure 5 As shown, the following steps are included:

[0120] Step S301, determining all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels;

[0121] Step S302, compensating the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest area when the two optical display systems display the preset picture is consistent;

[0122] Step S303, using the binocular stray light compensation method to compensate for the stray light of each pixel in all the pixels, so that the brightness of the darkest area is consistent when the two optical display systems display the preset picture.

[0123] More specifically, in step S202 or step S303, the above binocular stray light compensation method is used to compensate the stray light of each pixel in all pixels, which can be: if the brightness grayscale value of the pixel that needs to be compensated and is in the lit state is greater than or equal to the maximum brightness grayscale of the corresponding optical display system, then its brightness is no longer adjusted; if the brightness grayscale value of the pixel that needs to be compensated and is in the lit state is less than the aforementioned maximum brightness grayscale, then its brightness is adjusted to the brightness that needs to be compensated; or if the pixel that needs to be compensated is in the lit state, then its brightness is no longer adjusted, and only the pixel that is not lit is compensated. Those skilled in the art can choose the corresponding method to achieve stray light compensation based on actual needs, so as to best improve the visual experience quality of the user of the NED device.

[0124] Those skilled in the art may refer to the binocular stray light compensation method for NED devices provided in the embodiments of the present application, and apply the method to the binocular contrast compensation scheme of the NED device according to actual conditions and needs, so as to perform consistency compensation for the contrast of the binocular eyes of the NED device, so that the contrast of the binocular eyes of the NED device is at the same level, thereby improving the user's visual experience quality.

[0125] The core purpose of the technical solution provided by this application is to achieve accurate compensation for binocular stray light and contrast of NED devices. In a more specific embodiment, the application of the stray light and contrast compensation method provided by the embodiment of this application in the binocular of NED devices is as follows:

[0126] Step 1: Brightness compensation. By using DeMura technology, the compensation target value of the brightness of the brightest images of the binoculars is set to be consistent, and the brightness compensation coefficients of the binoculars can be generated respectively, so as to compensate the brightness of the binoculars to be consistent.

[0127] Step 2: Obtaining the intensity and distribution of stray light. The NED left-eye optical display system lights up a single pixel of the display screen in turn, and uses an imaging NED test system to image it. In this way, the stray light intensity distribution Ileft generated when the NED left-eye optical display system displays a single pixel can be obtained. Then, the same NED test system or another test system with basically the same stray light is used to perform the same monochrome pixel imaging on the NED right-eye optical display system to obtain the stray light intensity distribution Iright generated when the right-eye optical display system displays a single pixel. The stray light intensity distributions of the left and right eye optical display systems are superimposed to obtain the common compensation target value Itarget for binocular stray light. Taking the stray light brightness or intensity Ileft(i) and Iright(i) of the i-th pixel as an example, each pixel of Itarget(i) takes the maximum value of the corresponding pixels of Ileft(i) and Iright(i).

[0128] Step 3: Stray light compensation. Calculate the stray light intensity Icompenleft(i)=Itarget(i)-Ileft(i) that needs to be compensated when each pixel of the left-eye optical display system is lit, and then extract the brightness distribution of the display screen corresponding to Icompenleft(i), which is the distribution of pixels that need to be lit additionally when the i-th pixel is lit and their brightness. When the brightness of the i-th pixel changes, the distribution of pixels that need to be lit additionally remains unchanged, and the brightness value changes year-on-year.

[0129] The same is true for the right eye optical display system. Through the above steps, the consistency compensation of NED binocular contrast can be effectively achieved.

[0130] Due to the advanced nature of the technical solution provided by this application, it can be widely used in application fields such as VR, AR and MR. First of all, this application proposes a new binocular contrast consistency compensation method, which can effectively solve the problem that binocular contrast consistency cannot be achieved in the prior art, which is of great significance for improving the quality of user experience, visual comfort and the realism of immersive experience. Secondly, with the development of science and technology, the application of technologies such as virtual reality, augmented reality and mixed reality is becoming more and more extensive, and people's demand for these technologies is also increasing. Therefore, the market demand for this application will be very extensive. Finally, the technical application prospects of this application are broad. It can be applied not only to the consumer market, but also to industrial manufacturing, medical treatment, education and other fields, with great commercial value and social benefits.

[0131] Figure 6 The architecture diagram of a binocular stray light compensation device for a NED device provided in an embodiment of the present application is as follows: Figure 6 As shown, including:

[0132] The stray light distribution determining unit 610 is used to determine the stray light distribution when two optical display systems light up preset pixels respectively; the stray light distribution includes: a brightness distribution set of unlit pixels;

[0133] A stray light distribution superposition unit 620 is used to determine a stray light superposition distribution at a preset pixel point according to the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is to take the maximum brightness of the two stray light distributions at each pixel point;

[0134] The stray light compensation unit 630 is used to control each optical display system to compensate for the stray light of the pixel point when the preset pixel point needs to be illuminated by two optical display systems, according to the superimposed distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

[0135] Figure 7 The architecture diagram of another NED device binocular stray light compensation device provided in the embodiment of the present application is as follows: Figure 7 As shown, including:

[0136] A pixel point determination module 710 is used to determine all the pixels that need to be lit when a preset picture is displayed by two optical display systems;

[0137] The stray light compensation module 720 is used to Figure 1 The provided stray light compensation method compensates for the stray light of each pixel point among all the pixel points, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

[0138] Figure 8 The architecture diagram of a binocular contrast compensation device for a NED device provided in an embodiment of the present application is as follows: Figure 8 As shown, including:

[0139] A pixel point determination unit 810 is used to determine all the pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the maximum brightness value among all the pixels;

[0140] A bright area brightness compensation unit 820, used to compensate for the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest area when the two optical display systems display the preset picture is consistent;

[0141] Dark area brightness compensation unit 830 is used to adopt Figure 1 The provided stray light compensation method compensates for the stray light of each pixel among all the pixel points, so that the brightness of the darkest area is consistent when the two optical display systems display the preset picture.

[0142] It should be understood that the above Figures 6 to 8 The provided device is used to execute the method in the above embodiment. The implementation principle and technical effect of the corresponding program unit or module in the device are similar to those described in the above method. The working process of the device can refer to the corresponding process in the above method and will not be repeated here.

[0143] Based on the method in the above embodiment, the embodiment of the present application provides an electronic device, such as Fig. 9 As shown, the electronic device may include: a processor 910, a communication interface 920, a memory 930 and a communication bus 940, wherein the processor 910, the communication interface 920 and the memory 930 communicate with each other via the communication bus 940. The processor 910 may call the logic instructions in the memory 930 to execute the method in the above embodiment.

[0144] In addition, the logic instructions in the above-mentioned memory 930 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.

[0145] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0146] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0147] It is understandable that the processor in the embodiment of the present application can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor can be a microprocessor or any conventional processor.

[0148] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0149] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, a computer, a server or a data center to another website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0150] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.

[0151] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A binocular stray light compensation method for a near-eye display (NED) device, wherein the NED device include: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the method comprises: Determine the stray light distribution when two optical display systems light up preset pixel points respectively; the stray light distribution includes: a brightness distribution set at unlit pixel points; Determine the stray light superposition distribution at the preset pixel point according to the stray light distribution of the two optical display systems at the preset pixel point; the stray light superposition distribution is to take the maximum value of the brightness of the two stray light distributions at each pixel point; When the preset pixel point needs to be illuminated by two optical display systems, each optical display system is controlled to compensate for the stray light of the pixel point according to the superimposed distribution of the stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

2. The method according to claim 1, It is characterized in that Controlling each optical display system to compensate for the stray light of the pixel, including: Subtracting the stray light superposition distribution at the preset pixel point from the stray light distribution of each optical display system at the pixel point, respectively, to obtain the stray light compensation distribution of each optical display system at the pixel point; the stray light compensation distribution includes: a compensation brightness distribution set of at least one pixel point other than the pixel point that needs to be compensated; According to the stray light compensation distribution of each optical display system at a preset pixel point, the stray light is compensated when each optical display system lights up the pixel point.

3. The method according to claim 2, It is characterized in that The compensating for stray light when each optical display system lights up the pixel point includes: Determining the pixel points that need to be compensated and the corresponding brightness that needs to be compensated according to the stray light compensation distribution; When the pixel point that needs to be compensated is in a lit state, its lighting brightness is adjusted according to the brightness that needs to be compensated; When a pixel point that needs to be compensated is in an unlit state, the pixel point is controlled to light up, and its lighting brightness is adjusted according to the brightness that needs to be compensated.

4. The method according to any one of claims 2 or 3, It is characterized in that When the brightness of the preset pixel points that need to be illuminated increases, the pixel point distribution under the stray light compensation distribution remains unchanged, and the pixel point brightness changes year-on-year.

5. The method according to claim 1, It is characterized in that The stray light distribution when the optical display system lights up a preset pixel point is obtained by the following steps: Acquire an image of a display screen when a single optical display system only lights up preset pixels; The stray light distribution of the preset pixel point is determined according to the brightness of other pixel points in the captured image except the preset pixel point.

6. A method for compensating binocular stray light of a near-eye display (NED) device, wherein the NED device include: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the method comprises: Determine all pixels that need to be lit when the preset picture is displayed by two optical display systems; The method described in any one of claims 1 to 5 is used to compensate for the stray light of each pixel among all the pixel points, so that the stray light distribution of the two optical display systems at all the pixel points remains consistent.

7. A binocular contrast compensation method for a near-eye display (NED) device, wherein the NED device include: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the method comprises: Determine all pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels; Compensating the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest areas when the two optical display systems display the preset picture is consistent; The method described in any one of claims 1 to 5 is used to compensate for the stray light of each pixel among all the pixels, so that the brightness of the darkest areas when the two optical display systems display the preset picture is consistent.

8. A binocular stray light compensation device for a near-eye display (NED) device, wherein the NED device include: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the device comprises: A stray light distribution determination unit, used to determine the stray light distribution when two optical display systems light up preset pixel points respectively; the stray light distribution includes: a brightness distribution set of unlit pixel points; A stray light distribution superposition unit, used to determine the stray light superposition distribution at the preset pixel point according to the stray light distributions of the two optical display systems at the preset pixel point; the stray light superposition distribution is to take the maximum brightness of the two stray light distributions at each pixel point; The stray light compensation unit is used to control each optical display system to compensate for the stray light of the pixel point when the preset pixel point needs to be illuminated by two optical display systems, according to the superimposed distribution of stray light at the pixel point and the stray light distribution of each optical display system at the pixel point, so that the stray light distribution of the two optical display systems at the pixel point remains consistent.

9. A binocular contrast compensation device for a near-eye display (NED) device, wherein the NED device include: Two optical display systems, the two optical display systems are: a left-eye optical display system and a right-eye optical display system, characterized in that the device comprises: A pixel point determination unit, used to determine all the pixels that need to be lit when two optical display systems respectively display preset images and at least one pixel with the largest brightness value among all the pixels; A bright area brightness compensation unit, used to compensate for the brightness of the at least one pixel when the two optical display systems light up, so that the brightness of the brightest area when the two optical display systems display the preset picture is consistent; A dark area brightness compensation unit is used to compensate for the stray light of each pixel among all the pixels using the method described in any one of claims 1 to 5, so that the brightness of the darkest area is consistent when the two optical display systems display the preset picture.

10. An electronic device, It is characterized in that include: at least one memory for storing a computer program; At least one processor is used to execute the program stored in the memory, when the program stored in the memory is executed, the processor is used to execute the method according to any one of claims 1-5, 6 or 7.

Images