A system and method for adjusting the transmittance of AR glasses based on visual perception.

Abstract

This invention provides a transmittance adjustment system and method for AR glasses based on visual perception. The system includes a polarizing beam splitter and an adjustable analyzer. The system can be combined with existing AR optical engines to form AR glasses with transmittance adjustment functionality. The adjustment method includes inputting real-time captured images of the user's eye, the real-world scene, and the virtual image, respectively, into an adaptive dimming system. The adaptive dimming system can set the optimal polarization axis angle of the adjustable analyzer based on the user's visibility of the current AR scene, thereby adjusting the transmittance of the device to the real and virtual images. This invention can dynamically optimize the mixing ratio of the real and virtual images in the AR scene imaging light under dynamic lighting conditions, based on the user's visibility of the real and virtual images, ensuring that both are clearly visible to the user. The transmittance adjustment method of this invention can directly use the built-in camera in the AR glasses product, without the need for additional equipment installation.

Description

Technical Field

[0001] This invention relates to the field of augmented reality technology, and more specifically, to a system and method for adjusting the light transmittance of AR glasses based on visual perception. Background Technology

[0002] Augmented reality (AR) glasses overlay virtual images displayed on a pixelated screen with real-world images from the physical world and project them onto the user's eyes, creating a seamless AR scene that significantly improves the efficiency of user interaction with digital information. The light transmittance of AR glasses determines the blending ratio of virtual and real images, a crucial factor affecting the viewing experience of AR scenes. High light transmittance helps maintain high brightness in the real-world image seen by the AR glasses user, but in well-lit environments (such as a sunny outdoor environment), it can lead to excessively low contrast in the virtual image, making it difficult for the user to see clearly. Conversely, low light transmittance allows the virtual image displayed by the AR glasses to maintain good visibility, but in dimly lit environments (such as a nighttime street environment), it will significantly reduce the brightness of the real-world image, making it difficult for the user to see their surroundings.

[0003] Existing AR glasses typically use a fixed transmittance, making it difficult to ensure that virtual and real images always have a good viewing effect under dynamic lighting conditions, thus limiting the application scenarios of the devices.

[0004] Patent application CN112965248A discloses an AR smart glasses with adjustable transparency, including an AR smart glasses main body. The main body contains a transparency adjustment device positioned between the AR smart glasses eyepiece and the AR smart glasses display screen. The device comprises a transparency adjustment mechanism mounting bracket, a transparency adjustment mechanism, and a transparency adjustment mechanism drive assembly. The transparency adjustment mechanism includes a left-side transparency adjustment mechanism and a right-side transparency adjustment mechanism. In use, manually rotating the adjustment knob rotates a worm gear, which in turn rotates a winding shaft. This winding shaft moves a filter membrane, allowing for the replacement of filters with different transparency levels. When light emitted from the AR smart glasses display screen passes through filters of varying transparency, the image transparency can be adjusted. However, this patent cannot completely solve the existing technical problems and does not meet the needs of this invention. Summary of the Invention

[0005] In view of the deficiencies in the prior art, the purpose of this invention is to provide an AR glasses transmittance adjustment system and method based on visual perception.

[0006] The AR glasses transmittance adjustment system based on visual perception provided by the present invention includes: a polarization beam splitter, an adjustable analyzer, an eye-tracking camera, a scene camera, a virtual camera, and an adaptive dimming system;

[0007] The polarization beam splitter is configured to receive real image illumination from the physical world and virtual image illumination from the AR optical engine, and to form a p-polarized beam from the real image illumination and an s-polarized beam from the virtual image illumination.

[0008] The adjustable analyzer is configured to receive the p-polarized beam and the s-polarized beam, and adjust the mixing ratio of real image illumination and virtual image illumination based on the angle between the analyzer and the polarization axis of the polarization beam splitter.

[0009] The eye-tracking camera is configured to capture images of the user's eye movements to obtain pupil diameter data;

[0010] The scene camera is configured to capture images of real-world scenes;

[0011] The virtual camera is configured to capture virtual images;

[0012] The adaptive dimming system is configured to receive the outputs of the eye-tracking camera, the scene camera, and the virtual camera, and to set the optimal polarization axis angle of the adjustable analyzer based on the user's visibility of the virtual and real images.

[0013] Preferably, the polarization axis angle between the adjustable analyzer and the polarization beam splitter is achieved by driving the analyzer with an electric rotary table.

[0014] Preferably, the adaptive dimming system is configured to calculate the total illuminance of the incident user's pupil based on the pupil diameter data and using a human eye illumination response model, and to calculate the brightness of the real environment by combining the virtual image brightness and the transmittance of the AR glasses.

[0015] The AR glasses transmittance adjustment method based on visual perception provided by the present invention includes:

[0016] Step 1: Use an eye-tracking camera to capture images of the user's eye movements to obtain pupil diameter data;

[0017] Step 2: Use the scene camera to capture images of the real-world scene;

[0018] Step 3: Capture virtual images using a virtual camera;

[0019] Step 4: Input the pupil diameter data, real-world scene image, and virtual image into the adaptive dimming system;

[0020] Step 5: The adaptive dimming system adjusts the optimal polarization axis angle of the adjustable analyzer based on the user's visibility settings for virtual and real images, thereby adjusting the light transmittance of the AR glasses.

[0021] Preferably, the optimal polarization axis angle of the adjustable analyzer is calculated by comparing the visibility of the virtual image and the visibility of the real image with the corresponding visibility threshold.

[0022] Preferably, the method further includes calculating the transmittance of the AR glasses to the real-world image. and virtual image reflectivity The expression is:

[0023]

[0024]

[0025] in, This is the real-time polarization axis angle between the adjustable analyzer and the polarization beam splitter.

[0026] Preferably, the method further includes calculating the brightness of the virtual image. The expression is:

[0027]

[0028] in, The image brightness value measured at the exit pupil using a luminance meter when displaying a completely white image for AR glasses. The average pixel value calculated to convert the virtual image to grayscale and perform gamma correction.

[0029] Preferably, the method further includes calculating the brightness of the real-world environment. The expression is:

[0030]

[0031] in, The total illuminance incident on the user's pupil.

[0032] Preferably, the method further includes calculating the visibility of the virtual image. Visibility of real-world images The visibility of virtual images Weber contrast is used as a metric, and is obtained using the following formula:

[0033]

[0034] Visibility of real-world images Using bandpass RMS contrast as a metric, including the use of bandpass filters. Decompose real-world images.

[0035] Preferably, the method further includes calculating a visibility threshold for the real-world image. , It can be calculated based on the human eye contrast sensitivity function;

[0036] Calculate the optimal polarization axis angle ,in:

[0037] When the AR glasses do not include a virtual / real occlusion function, the optimal polarization axis angle Calculate according to the following formula:

[0038]

[0039] in, The visibility threshold for the virtual image; To adjust the brightness of a target in a real-world image, calculate using the following formula:

[0040]

[0041] When the AR glasses include a virtual-real occlusion function, the method further includes calculating the reflectance of the AR glasses for the virtual-real occlusion image. The expression is:

[0042]

[0043] Calculate the optimal polarization axis angle The expression is:

[0044]

[0045] in, When the polarization axis angle between the adjustable analyzer and the polarization beam splitter is set to 90º, the OLED screen displays full black and the spatial light modulator displays full white, the ratio of the brightness of the virtual and real occluded image to the brightness of the incident real image is measured by a luminance meter at the exit pupil position of the virtual and real occluded AR glasses.

[0046] Compared with the prior art, the present invention has the following beneficial effects:

[0047] (1) The present invention dynamically adjusts the transmittance of AR glasses according to the user’s visibility of virtual and real images in AR scene, which can improve the display effect of AR scene in dynamically changing lighting environment and avoid the user having difficulty seeing virtual images or real environment.

[0048] (2) The present invention uses bandpass contrast to measure the user’s visibility of the real image. In practical applications, the spatial frequency range of the bandpass filter can be changed according to the user’s task operation accuracy requirements. For example, for tasks with high operation accuracy requirements such as AR mechanical repair and AR surgical navigation, the spatial frequency range of the bandpass filter should be increased; otherwise, the spatial frequency range of the bandpass filter should be decreased.

[0049] (3) The present invention uses the user's pupil size captured by the eye-tracking camera to calculate the ambient light intensity and uses the real image captured by the scene camera to calculate the user's visibility of the real scene; the eye-tracking camera and the scene camera are widely used in current AR glasses devices, making the present invention easy to use. Attached Figure Description

[0050] Other features, objects, and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings:

[0051] Figure 1 This is an overall structural diagram of the present invention when implemented in conjunction with AR glasses;

[0052] Figure 2 This is a schematic diagram illustrating the principle of the transmittance adjustment method based on visual perception in this invention.

[0053] Figure 3 This is a schematic diagram illustrating the calculation of energy spectral density of a virtual image in an embodiment of the present invention;

[0054] Figure 4 This is a schematic diagram illustrating the calculation of bandpass RMS contrast of a real image in an embodiment of the present invention;

[0055] Figure 5 This is a schematic diagram illustrating the superior performance of the present invention when combined with ordinary AR glasses;

[0056] Figure 6 This is an overall structural diagram of the present invention when implemented with AR glasses that combine virtual and real occlusion;

[0057] Figure 7 This is a schematic diagram illustrating the superior performance of the present invention when combined with ordinary virtual-real occlusion AR glasses. Detailed Implementation

[0058] The present invention will now be described in detail with reference to specific embodiments. These embodiments will help those skilled in the art to further understand the present invention, but do not limit the invention in any way. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all fall within the protection scope of the present invention.

[0059] Example 1

[0060] like Figure 1As shown, an AR glasses system incorporating a transmittance adjustment system according to the present invention includes a polarizing beam splitter 1, an adjustable analyzer 2, an eye-tracking camera 3, a scene camera 4, a virtual camera 5, and an adaptive dimming system 6. This transmittance adjustment system, together with the Birdbath structure, constitutes the AR glasses, wherein the display of the virtual image is composed of an OLED screen 7a, the polarizing beam splitter 1, the adjustable analyzer 2, and a spherical mirror 7b covering a quarter-wave plate.

[0061] Specifically, the virtual image beam from the OLED screen 7a and the real image beam from the physical world are converted into p-polarized light after passing through the polarization beam splitter 1. The virtual image beam is then imaged by the spherical mirror 7b covered with a quarter-wave plate, becoming s-polarized light, which is then mixed with the p-polarized real image light to form the AR scene imaging light. This AR scene imaging light is then transmitted through the adjustable analyzer 2, where the mixing ratio of the virtual and real image illumination is controlled by the angle between the polarization axes of the polarization beam splitter 1 and the adjustable analyzer 2. The adjusted AR scene imaging light then enters the user's eye, allowing the user to see a blended virtual and real AR scene.

[0062] like Figure 2 As shown, this invention provides a method for adjusting the transmittance of AR glasses based on visual perception. The eye-tracking camera 3 built into the AR glasses captures the user's eye-tracking images, thereby obtaining the user's pupil diameter data. The obtained pupil diameter data needs to be smoothed using a filter, such as moving window averaging or Kalman filtering. Based on the filtered user pupil diameter, the total illuminance incident on the user's pupil can be obtained using a human eye illumination response model. .

[0063] Specifically, based on the real-time polarization axis angle between the adjustable analyzer 2 and the polarization beam splitter 1... Calculate the transmittance of AR glasses and output the transmittance of the current device to the real-world image. and virtual image reflectivity :

[0064]

[0065] Furthermore, the brightness of the real environment can be obtained through calculations of environmental and image brightness. and virtual image brightness First, based on the virtual image displayed by the AR glasses, which can be read by the virtual camera 5, the brightness of the virtual image is then... It can be obtained from the following formula:

[0066]

[0067] Specifically, The average pixel value calculated to convert a virtual image to grayscale and perform gamma correction. When displaying a completely white image on AR glasses, the image brightness value measured at the exit pupil position using a luminance meter is multiplied to obtain the average brightness value of the virtual image displayed by the AR glasses at this time. Therefore, based on formulas (1), (2), and the total illuminance... The actual ambient brightness at this time was calculated. :

[0068]

[0069] Furthermore, the virtual image undergoes frequency domain transformation, and its energy spectral density (PSD) is calculated. Based on the proportion of high-frequency and low-frequency features in the virtual image's PSD, the virtual image can be classified into high-frequency and low-frequency images. For example... Figure 3 As shown, Stanford Bunny and Uta Teapot, due to their relatively simple geometry and materials, can be classified as low-frequency images based on their PSDs; Maple and Christmas tree, due to their relatively complex geometry and materials, can be classified as high-frequency images based on their PSDs. Depending on the needs of AR applications, more complex classification strategies can also be applied to virtual images.

[0070] Furthermore, based on the classification results of virtual images in the PSD classification, a corresponding visibility threshold can be set for each type of image, and virtual image visibility detection can be performed. When the visibility of a virtual image is higher than the visibility threshold, it indicates that the user can clearly see the virtual image displayed by the AR glasses; conversely, it indicates that the user cannot clearly see the virtual image displayed by the AR glasses.

[0071] Specifically, the corresponding visibility threshold All values ​​were quantized using Weber contrast ratio, and the specific values ​​could be obtained through user experiments based on virtual image datasets in AR application scenarios. The visibility of the virtual images was also quantified using Weber contrast ratio. Example 1 shows the Weber contrast ratio of the virtual image seen by the user wearing AR glasses. The calculation can be performed using the following formula:

[0072]

[0073] Furthermore, the scene camera 4 built into the AR glasses can capture images of the current real-world scene, and then a bandpass filter is used to extract the spatial frequency information of the real-world image. The bandpass filter used is based on the method in the paper by Peli et al. (1990), which decomposes the image from low to high frequencies into i+2 layers of images with spatial frequency intervals of one octave. The bandpass filter is obtained using the following formula:

[0074]

[0075] Specifically, the This represents the pixel distance from any position in the spectrum of a real-world image to the center of the spectrum. For example... Figure 4 As shown, the real image is decomposed into 7 layers using the bandpass filter described in formula (5). Alternatively, any suitable bandpass filter can be used to decompose the real image into any number of layers.

[0076] Furthermore, the root mean square (RMS) contrast of each decomposed image layer is calculated using bandpass RMS contrast calculation. For example... Figure 4 As shown, arbitrary spatial frequencies in real-world images can be obtained. Visibility of image features .

[0077] Furthermore, the contrast sensitivity function of Barten et al. is used in the calculation of the human visual visibility threshold. Of course, other contrast sensitivity functions, such as those of Rovamo et al., can also be used for calculation depending on the actual situation.

[0078] Specifically, Barten et al.'s contrast sensitivity function uses the AR glasses user's pupil diameter, the brightness of the real environment, and the AR glasses' field of view to calculate the user's sensitivity to arbitrary spatial frequencies. Contrast sensitivity of image features At this time, the user is concerned about spatial frequency. The visibility threshold of real-world image features can be expressed as:

[0079]

[0080] The For parameters relevant to real-world scenarios, refer to the method described in the paper by Triantaphillidou et al. (2019). Based on the visual acuity characteristics of the human eye, the focus is on the user's visibility of image features with a spatial frequency of approximately 5 cycles / degree (cpd) in real-world images. and All use Calculations are performed. In practical applications, an appropriate spatial frequency range can be selected based on the user's task operation accuracy requirements. For example, for AR tasks with high operation accuracy requirements, a larger range should be selected. The value is adjusted to allow users to obtain better visibility of real-world images. Of course, it can also be dynamically selected based on different AR application scenarios. This provides a more flexible user experience.

[0081] Furthermore, in the adaptive adjustment of the polarization axis angle, the visibility of the virtual image by the current AR glasses user is considered. and visibility threshold And the visibility of real-world images and visibility threshold The optimal polarization axis angle can be calculated. . Real-time adjustment is performed according to the following formula:

[0082]

[0083] Specifically, adjusting the brightness of the target in the real image. It can be calculated using the following formula:

[0084]

[0085] Optimal polarization axis angle in practical applications The real-time output is sent to the adjustable analyzer 2, thereby realizing adaptive adjustment of the transmittance of AR glasses based on the user's visual perception, which helps users maintain good visibility of both virtual and real images in dynamic lighting environments. Figure 5 A schematic diagram illustrating the effect of Example 1 is shown. For example... Figure 5 As shown on the left, the AR glasses currently display a high-brightness virtual cartoon character. However, the actual ambient light is low, making it difficult for the user to see the real image clearly. At this point, adaptive adjustment of the polarization axis angle can be performed to increase the AR glasses' transmittance to the real image, thereby increasing the brightness of the perceived real image. Although the AR glasses' reflectivity to the virtual image decreases simultaneously, the high brightness of the virtual image means the visibility of the virtual cartoon character remains above the user's visual threshold. Ultimately, as... Figure 5 As shown on the right, AR glasses users can maintain good visibility of both virtual cartoon characters and the real environment.

[0086] Example 2

[0087] Unlike Embodiment 1, Embodiment 2 of the present invention combines a transmittance adjustment system with the optical structure of AR glasses that obscure both real and virtual images. This includes a polarizing beam splitter 1, an adjustable analyzer 2, an eye-tracking camera 3, a scene camera 4, a virtual camera 5, and an adaptive dimming system 6. The display of the obscuring image is achieved by the polarizing beam splitter 1, the adjustable analyzer 2, the polarizing beam splitter 7c, a first plane mirror 7a covering a quarter-wave plate, a second plane mirror 7f covering a quarter-wave plate, a semi-transparent lens 7g covering a quarter-wave plate, a first convex lens 7b, a second convex lens 7e, and a spatial light modulator 7d. The display of the virtual image is achieved by the OLED screen 7h, the semi-transparent lens 7g covering a quarter-wave plate, the polarizing beam splitter 7c, the first convex lens 7b, the polarizing beam splitter 1, and the adjustable analyzer 2.

[0088] Specifically, the illumination transmission process of the virtual-real occlusion image is as follows: the illumination from the real scene is polarized by the beam splitter 1 to form s-polarized light (1). The s-polarized light (1) is reflected by the first plane mirror 7a covering the quarter-wave plate to form p-polarized light (2). The p-polarized light (2) passes through the beam splitter 1, then through the first convex lens 7b, and then through the beam splitter 7c to form p-polarized light (4). The p-polarized light (4) is generated by the spatial light modulator 7d to form s-polarized light (5). The s-polarized light (5) is generated by the beam splitter 7c to form s-polarized light (6). The s-polarized light (6) is generated by the second convex lens 7e to form s-polarized light (7). The s-polarized light (7) is generated by the second plane mirror 7f covering the quarter-wave plate to form p-polarized light (8). The p-polarized light (8) passes through the second convex lens 7e and then through the polarizing beam splitter 7c to form a p-polarized beam (9); the p-polarized beam (9) is reflected by the half-lens 7g covering the quarter-wave plate to form s-polarized light (11). The s-polarized light (11) passes through the polarizing beam splitter 7c to form s-polarized light (12), and the s-polarized light (12) passes through the first convex lens 7b to form s-polarized light (13).

[0089] Specifically, the virtual image illumination transmission process is as follows: the illumination from the OLED screen 7h passes through the semi-transparent lens 7g covered by a 1 / 4 wave plate and is mixed with light of the s polarization direction (11). After that, it is transmitted along the same path as the virtual and real occlusion image illumination through the process of (11) to (13).

[0090] Specifically, the real-world image illumination transmission process is as follows: the illumination from the real scene passes through the polarization beam splitter 1 to form p-polarized light (14). Subsequently, the p-polarized light (14) is fused with the mixed illumination (13) of the real-world occlusion image and the virtual image, and output as outgoing light through the adjustable analyzer 2.

[0091] Specifically, the mixing ratio of virtual image lighting, real image lighting, and virtual-real occlusion image lighting is controlled by the polarization axis angle between polarization beam splitter 1 and adjustable analyzer 2. After the controlled AR scene imaging light enters the human eye, the user can see the AR scene with virtual-real occlusion function.

[0092] This invention provides a method for adjusting the transmittance of AR glasses based on visual perception and virtual / real occlusion. Unlike Example 1, Figure 2 In this process, the transmittance of AR glasses is calculated and output to show the transmittance of the current device to the real-world image. Reflectivity of virtual images and reflectivity of images with virtual and real occlusion It can be calculated using the following formula:

[0093]

[0094] Specifically, The real-time polarization axis angle between the adjustable analyzer 2 and the polarization beam splitter 1. for When the screen is set to 90°, the OLED screen displays a completely black image (7h), and the spatial light modulator displays a completely white image (7d), the ratio of the brightness of the virtual and real occluded image to the brightness of the incident real image is measured using a luminance meter at the exit pupil position of the AR glasses.

[0095] Furthermore, unlike Example 1, in Example 2, the adaptive adjustment of the polarization axis angle uses the following formula to calculate the optimal polarization axis angle. :

[0096]

[0097] Furthermore, the remaining steps in Example 2 are the same as those in Example 1.

[0098] Figure 7 The demonstration showed users wearing regular AR glasses, regular AR glasses with virtual and real occlusion, and... Figure 6 The image shows the actual AR scene viewed when using AR glasses with virtual and real occlusion. The virtual cartoon character is displayed by the AR glasses, while the rest of the real-world background is projected onto a physical screen in front of the user. The lighting environment of the real-world background changes continuously in four stages, with the brightness of the real-world image gradually increasing from indoor light off, indoor light on, outdoor shaded, to outdoor sunlight. It can be seen that users using ordinary AR glasses (third row) have difficulty seeing the virtual cartoon character clearly in the outdoor shaded and outdoor sunlight stages; users using ordinary AR glasses with virtual and real occlusion (second row) have difficulty seeing the real-world environment clearly in the indoor light off and indoor light on stages; users using AR glasses with virtual and real occlusion that incorporate a visual perception-based transmittance adjustment system can maintain good visibility of both virtual and real images in all four stages.

[0099] Those skilled in the art will understand that, in addition to implementing the system, apparatus, and their modules provided by this invention in purely computer-readable program code, the same program can be implemented in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers by logically programming the method steps. Therefore, the system, apparatus, and their modules provided by this invention can be considered a hardware component, and the modules included therein for implementing various programs can also be considered structures within the hardware component; alternatively, modules for implementing various functions can be considered both software programs implementing the method and structures within the hardware component.

[0100] Specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art can make various changes or modifications within the scope of the claims, which do not affect the essence of the present invention. Unless otherwise specified, the embodiments and features described in this application can be arbitrarily combined with each other.

Claims

1. A transmittance adjustment system for AR glasses based on visual perception, characterized in that, include: Polarizing beam splitters, adjustable analyzers, eye-tracking cameras, scene cameras, virtual cameras, and adaptive dimming systems; The polarization beam splitter is configured to receive real image illumination from the physical world and virtual image illumination from the AR optical engine, and to form a p-polarized beam from the real image illumination and an s-polarized beam from the virtual image illumination. The adjustable analyzer is configured to receive the p-polarized beam and the s-polarized beam, and adjust the mixing ratio of real image illumination and virtual image illumination based on the angle between the analyzer and the polarization axis of the polarization beam splitter. The eye-tracking camera is configured to capture images of the user's eye movements to obtain pupil diameter data; The scene camera is configured to capture images of real-world scenes; The virtual camera is configured to capture virtual images; The adaptive dimming system is configured to receive the outputs of the eye-tracking camera, the scene camera, and the virtual camera, and to set the optimal polarization axis angle of the adjustable analyzer based on the user's visibility of the virtual and real images. The adaptive dimming system is configured to calculate the total illuminance of the incident light into the user's pupil based on the pupil diameter data and using a human eye illumination response model, and to calculate the brightness of the real environment by combining the virtual image brightness and the transmittance of the AR glasses.

2. The AR glasses transmittance adjustment system based on visual perception according to claim 1, characterized in that, The polarization axis angle between the adjustable analyzer and the polarization beam splitter is achieved by driving the analyzer with an electric rotary table.

3. A method for adjusting the transmittance of AR glasses based on the visual perception-based AR glasses transmittance adjustment system as described in claim 1 or 2, characterized in that, include: Step 1: Use an eye-tracking camera to capture images of the user's eye movements to obtain pupil diameter data; Step 2: Use the scene camera to capture images of the real-world scene; Step 3: Capture virtual images using a virtual camera; Step 4: Input the pupil diameter data, real-world scene image, and virtual image into the adaptive dimming system; Step 5: The adaptive dimming system adjusts the optimal polarization axis angle of the adjustable analyzer based on the user's visibility settings for virtual and real images, thereby adjusting the light transmittance of the AR glasses.

4. The method for adjusting the transmittance of AR glasses based on visual perception according to claim 3, characterized in that, The optimal polarization axis angle for setting the adjustable analyzer includes: calculating the optimal polarization axis angle based on a comparison of the visibility of the virtual image and the visibility of the real image with corresponding visibility thresholds.

5. The method for adjusting the transmittance of AR glasses based on visual perception according to claim 4, characterized in that, The method also includes calculating the transmittance of AR glasses to real-world images. and virtual image reflectivity The expression is: in, This is the real-time polarization axis angle between the adjustable analyzer and the polarization beam splitter.

6. The method for adjusting the transmittance of AR glasses based on visual perception according to claim 5, characterized in that, The method also includes calculating the brightness of the virtual image. The expression is: in, The image brightness value measured at the exit pupil using a luminance meter when displaying a completely white image for AR glasses. The average pixel value calculated to convert the virtual image to grayscale and perform gamma correction.

7. The method for adjusting the transmittance of AR glasses based on visual perception according to claim 6, characterized in that, The method also includes calculating the brightness of the real-world environment. The expression is: in, The total illumination intensity incident on the user's pupil.

8. The method for adjusting the transmittance of AR glasses based on visual perception according to claim 7, characterized in that, The method also includes calculating the visibility of the virtual image. Visibility of real-world images The visibility of virtual images Weber contrast is used as a metric, and is obtained using the following formula: Visibility of real-world images Using bandpass RMS contrast as a metric, including the use of bandpass filters. Decompose real-world images.

9. The method for adjusting the transmittance of AR glasses based on visual perception according to claim 8, characterized in that, The method also includes calculating the visibility threshold of the real-world image. , It can be calculated based on the human eye contrast sensitivity function; Calculate the optimal polarization axis angle ,in: When the AR glasses do not include a virtual / real occlusion function, the optimal polarization axis angle Calculate according to the following formula: in, The visibility threshold for the virtual image; To adjust the brightness of a target in a real-world image, calculate using the following formula: When the AR glasses include a virtual-real occlusion function, the method further includes calculating the reflectance of the AR glasses for the virtual-real occlusion image. The expression is: Calculate the optimal polarization axis angle The expression is: in, When the polarization axis angle between the adjustable analyzer and the polarization beam splitter is set to 90º, the OLED screen displays full black and the spatial light modulator displays full white, the ratio of the brightness of the virtual and real occluded image to the brightness of the incident real image is measured by a luminance meter at the exit pupil position of the virtual and real occluded AR glasses.

Images