Augmented reality system adapted for a low-light night vision goggle

By placing an augmented reality device behind the low-light night vision goggles, the images from the low-light night vision goggles are combined with augmented information, thus solving the physiological impact of low-light night vision goggles on visual perception and improving nighttime visual perception capabilities.

CN118393739BActive Publication Date: 2026-01-20AIR FORCE MEDICAL CENT PLA
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202410556059.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-05-07
Publication Date
2026-01-20
Estimated Expiration
2044-05-07

AI Technical Summary

Technical Problem

Low-light night vision goggles can cause physiological effects on visual perception during nighttime observation, such as narrowed field of view, decreased visual acuity, altered distance judgment, and changes in stereoscopic vision. How can we improve their visual perception capabilities?

Method used

An augmented reality device is set behind the low-light night vision goggles, including a camera module, a computing module, a display module, and an optical module. The optical module combines the low-light night vision goggles image with augmented information to present the image, reducing the visual impact of imaging limitations on the human eye.

Benefits of technology

It improves visual perception under low-light night vision, reduces the physiological impact of imaging limitations on the human eye, and enhances nighttime visual perception.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118393739B_ABST
    Figure CN118393739B_ABST
Patent Text Reader

Abstract

This invention provides an augmented reality system adapted to low-light night vision goggles. The system includes: low-light night vision goggles and an augmented reality device disposed behind the low-light night vision goggles. The augmented reality device includes: a camera module for acquiring scene information; a computing module for generating augmented information based on the scene information; a display module for displaying the augmented information; and an optical module for combining a first ray of light from the objective lens of the low-light night vision goggles (which generates the image formed by the goggles) and a second ray of light generated from displaying the augmented information, converging and presenting them in the human eye. Using this invention, visual perception capabilities under low-light night vision goggles can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of night vision goggles (NVG) visual perception training, and particularly relates to an augmented reality system adapted to night vision goggles. BACKGROUND

[0002] Vision is the main perception of human beings to obtain information, but due to the limitations of the spectral and spatial resolution of the human eye, the time and space range of human activities, and the ability to understand and transform the world, are greatly limited. For a long time, improving, expanding and extending the visual ability of human beings in low-illumination at night has been the goal of human pursuit. In recent decades, with the rapid development of night vision technology, various new night vision products and equipment have emerged, and have been gradually applied to surveillance, monitoring, tracking, reconnaissance and other aspects in the fields of traffic security and other fields besides military security, and the market potential and application prospect in military and civilian fields are huge.

[0003] Night vision goggles are a kind of night vision equipment, which converts the low-illumination micro-light environment target at night into a human eye visible light signal through photoelectric conversion and amplification, and electro-optical conversion, so that the image that cannot be seen by the human eye in the night or low-illumination environment is converted into a human eye visible image. Under the help of night vision goggles, the human eye can observe the target in the micro-light environment, and the visual perception ability in the night and low-illumination environment is improved.

[0004] Although the night vision goggles can help the observer to see the target in the micro-light scene, the imaging of the night vision goggles itself also has a series of visual perception physiological effects such as reduced observation field of view, decreased vision, changed distance judgment and stereoscopic vision, illusion, spatial orientation disorder, visual fatigue and the like. Therefore, how to reduce the series of visual perception physiological effects of the night vision goggles and improve the visual perception ability under the night vision goggles is an important problem to be solved in the industry. SUMMARY

[0005] The present application provides an augmented reality system adapted to night vision goggles to improve the visual perception ability under the night vision goggles.

[0006] To this end, the present application provides the following technical solutions:

[0007] An augmented reality system adapted to night vision goggles, the system comprising: a night vision goggles, and an augmented reality device arranged behind the night vision goggles; the augmented reality device comprising:

[0008] A camera module for acquiring scene information, the scene information comprising: a micro-light scene image, an image on the screen of the night vision goggles, and an image on the optical module;

[0009] A computing power module for generating augmented information according to the scene information;

[0010] a display module for displaying the augmented information;

[0011] an optical module for combining the first light rays from the micro-luminance night vision objective lens generating the image formed by the micro-luminance night vision and the second light rays generated by the display module displaying the augmented information, and converging them in the human eye.

[0012] Optionally, the minimum eye relief of the micro-luminance night vision is matched with the thickness of the optical module and its minimum eye relief.

[0013] Optionally, the display module and the optical module are combined as an optical machine.

[0014] Optionally, the optical machine is adapted to the micro-luminance night vision for night vision observation, and the components of the optical machine are constrained by the structure, performance and optical parameters of the micro-luminance night vision.

[0015] Optionally, the constraint parameters for constraining the components of the optical machine include any one or more of the following: micro-luminance night vision eyepiece size, micro-luminance night vision eyepiece screen brightness, micro-luminance night vision eyepiece screen color, micro-luminance night vision eye relief, micro-luminance night vision exit pupil diameter, micro-luminance night vision field of view.

[0016] Optionally, the detection distance of the micro-luminance night vision is matched with the near-eye display imaging distance of the optical machine.

[0017] Optionally, the field of view angle of the micro-luminance night vision is matched with the field of view angle of the optical module.

[0018] Optionally, the field of view of the micro-luminance night vision is circular, and the field of view of the optical module is square, and a circular diaphragm is arranged in the optical module, which is used to match the field of view of the optical module with the field of view of the micro-luminance night vision.

[0019] Optionally, the interpupillary distance of the micro-luminance night vision is matched with the interpupillary distance of the optical module.

[0020] Optionally, the interpupillary distance of the micro-luminance night vision and the interpupillary distance of the optical module are both adjustable.

[0021] Optionally, the micro-luminance night vision is mounted on a helmet and can be flipped up and down.

[0022] Optionally, the optical module is arranged behind the entrance optical system of the micro-luminance night vision, and separates the human eye and the outside world into a micro-luminance environment space, an image space and an observation space.

[0023] Optionally, an optical attenuation sheet is arranged between the display module and the optical module, and the optical attenuation sheet is used to weaken the brightness of the display module, so that the brightness of the observation space is compatible with the brightness of the image space.

[0024] Optionally, the optical attenuation sheet has one or more levels, and the parameters of the optical attenuation sheet are adjustable.

[0025] Optionally, the brightness of the display module is adjustable.

[0026] Optionally, the augmented reality device further comprises:

[0027] a detection module for sensing and detecting the environment and providing environmental sensing data;

[0028] a tracking module for determining the position information of the user according to the environmental sensing data;

[0029] The computing power module is further used to correct the augmented information according to the position information of the user.

[0030] The augmented reality system for adapting to the low-light night vision mirror provided by the application, by setting the augmented reality device behind the low-light night vision mirror, setting the camera module in the augmented reality device to obtain scene information, generating augmented information by the computing power module according to the scene information, combining the first light from the objective lens of the low-light night vision mirror to form the image of the low-light night vision mirror and the second light generated by the display of the augmented information together by the optical module, and converging in the human eye to present, so as to realize the image information enhancement of the low-light night vision mirror, reduce the physiological influence of the imaging limitation of the low-light night vision mirror on the visual perception of the human eye, and improve the visual perception ability under the low-light night vision mirror. BRIEF DESCRIPTION OF DRAWINGS

[0031] In order to more clearly illustrate the technical solutions in the embodiments of the application or the prior art, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings described in the following description are only some embodiments of the application, and other drawings can also be obtained by those skilled in the art without creative labor.

[0032] Figure 1 is a structural schematic diagram of the augmented reality system for adapting to the low-light night vision mirror provided by the application;

[0033] Figure 2 is a schematic diagram of three different incidence modes of the display module and the optical module in the system of the application;

[0034] Figure 3 is a schematic diagram of the optical path combination in the system of the application;

[0035] Figure 4is the design constraint guide of each module in the system of the application;

[0036] Figure 5 is the structure matching schematic diagram of the low-light night vision mirror and the optical module in the system of the application;

[0037] Figure 6 is the schematic diagram of the detection distance and the imaging distance of the low-light night vision mirror in the structure shown in the system of the application; Figure 5

[0038] Figure 7 is the matching schematic diagram of the field of view of the low-light night vision mirror and the field of view of the optical module in the system of the application;

[0039] Figure 8 is the matching schematic diagram of the interpupillary distance of the low-light night vision mirror and the interpupillary distance of the optical module in the system of the application;

[0040] Figure 9 is the matching structure schematic diagram of the low-light night vision mirror and the optical module in the system of the application when being installed and turned over. DETAILED DESCRIPTION

[0041] In order to make the above-mentioned purposes, features and beneficial effects of the present application more obvious and easy to understand, the specific embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0042] Augmented Reality (AR) technology is a new technology that seamlessly integrates the real world and virtual information, superimposes computer-generated virtual information on the real world, and presents it to people's field of view through certain display devices to enhance people's perception and cognition of the real world. Augmented Reality technology has two optical synthesis ways, optical perspective and video perspective. In the optical perspective, the human eye can see the real world and the virtual information superimposed on it at the same time, while in the video perspective, the human eye sees the real world image and the virtual information superimposed on it at the same time. In the optical perspective, the human eye is open to the real world and directly observes the outside space to understand the real world, while in the video perspective, the human eye is closed in the image space and perceives the real world through the outside space image.

[0043] Therefore, in view of some deficiencies in the imaging of the existing low-light night vision mirror, the embodiment of the application provides an augmented reality system adapted to the low-light night vision mirror, which adapts the structure and performance of the low-light night vision mirror as the front-end input of the AR system, realizes the image information enhancement of the low-light night vision mirror, reduces the physiological influence of the imaging limitations of the low-light night vision mirror on the visual perception of the human eye, and improves the visual perception ability under the night vision mirror.

[0044] As shown in Figure 1 , it is a structure schematic diagram of the augmented reality system adapted to the low-light night vision mirror provided by the application.​

[0045] Referring Figure 1 The system comprises a night vision device 0100 and an augmented reality device arranged behind the night vision device 0100. The augmented reality device comprises a camera module 0115, a computing power module 0110, a display module 0112, and an optical module 0111. The optical module 0111 is arranged between the human eye and the night vision device 0100. In this embodiment,

[0046] The camera module 0115 is configured to acquire scene information, which includes but is not limited to a night vision scene image, an image on the night vision device screen (i.e., an image formed by the night vision device), an image on the optical module 0111, etc. The camera module 0115 can include but is not limited to any one or more of the following: an infrared camera, a laser camera, and a laser scanner.

[0047] The computing power module 0110 is a central processor of the system, which receives and processes the scene information from the camera module 0115, and determines the relevant parameters of the augmented information required by the image formed by the night vision device through image analysis and calculation. Further, an optimization algorithm can be established to generate the augmented information based on prior knowledge, various rules, etc. The computing power module 0110 can include but is not limited to any one or more of the following: a wearable smart device, a smartphone, a computer, etc.

[0048] The display module 0112 is configured to display the augmented information. The augmented information can be in the form of text, numbers, symbols, marks, graphics, images, animations, etc. The display module 0112 can include but is not limited to any one of the following: a liquid crystal on silicon (LCOS), a digital light processor (DLP), a digital micromirror device (DMD), a laser beam scanner (LBS), an organic light-emitting diode (OLED) (such as a micro light-emitting diode (μLED), a micro organic light-emitting diode (Micro-OLED), etc.), a light-emitting micro display, etc. The light-emitting micro display can be preferred.

[0049] The optical module 0111 is configured to combine the first light rays from the night vision device objective lens to form the image formed by the night vision device and the second light rays from the display module 0112 to generate the augmented information, and to converge and present the combined light rays in the human eye.

[0050] In a specific implementation example, the display module 0112 can be integrated with the optical module 0111 as an optical machine of the AR system.

[0051] The light engine is the key to distinguish the characteristics of different AR systems, and different light engines are suitable for different application scenarios and tasks. The light engine in the embodiment of the application is suitable for a micro-light scene and is adapted to a micro-light night vision mirror for night vision observation. The key devices of the display module and the optical module constituting the light engine are constrained by the structure, performance and optical parameters of the micro-light night vision mirror. The constraint parameters include but are not limited to the eyepiece size of the micro-light night vision mirror, the screen brightness of the night vision mirror eyepiece, the screen color of the night vision mirror eyepiece, the exit pupil distance of the night vision mirror, the exit pupil diameter of the night vision mirror, the field of view of the night vision mirror and other key parameters. The constraint parameters of the AR light engine selection and design with the front input of the micro-light night vision mirror and other front input visual optical systems belong to the application.

[0052] The augmented reality system of the micro-light night vision mirror in this embodiment is used in a micro-light environment 0120 scene. The micro-light night vision mirror 0100 is used as the front input optical system, the augmented reality device is placed behind the micro-light night vision mirror 0100, the design and selection of each module are based on the micro-light night vision mirror 0100, and the image information formed by the micro-light night vision mirror is enhanced.

[0053] It should be noted that the screen brightness, color, resolution and the like of the display module 0112 need to be compatible with the eyepiece screen of the micro-light night vision mirror, and the thickness, weight and size of the display module 0112 do not affect the matching of the optical module 0111 and the micro-light night vision mirror 0100. In addition, the brightness, color, resolution, transparency and contrast of the text, numbers, symbols, marks, graphics, images, animations and other information displayed on the screen of the display module 0112 are compatible with the micro-light night vision mirror 0100, and can effectively reduce the influence of the imaging limitations of the micro-light night vision mirror 0100 on the observation of the human eye, thereby improving the visual perception ability of the observer under the night vision mirror.

[0054] Continuing to refer to Figure 1 In another non-limiting embodiment of the augmented reality system of the micro-light night vision mirror of the application, the augmented reality device can further include:

[0055] Continuing to refer to Figure 1 In another non-limiting embodiment of the augmented reality system of the micro-light night vision mirror of the application, the augmented reality device can further include a detection module (not shown) and a tracking module 0113. The detection module is used to perceive and detect the current environment and provide environmental sensing data. The tracking module 0113 is used to determine the position information of the user according to the environmental sensing data.

[0056] Correspondingly, in this embodiment, the computing power module 0110 can also correct the augmented information according to the position information of the user, further improving the quality of the augmented information and the auxiliary effect on the micro-light night vision mirror image.

[0057] In a specific application, the detection module can include a visual sensor composed of one or more groups of micro-cameras. The tracking module 0113 can include, but is not limited to, any of the following: an inertial tracker, a gyroscope, an ultrasonic tracker, a laser tracking locator, etc.

[0058] Figure 1 The principle of information enhancement of the augmented reality system for the low-light night vision device is as follows:

[0059] The camera module 0115 collects scene information, including: low-light scene images, images on the screen of the low-light night vision device, and images on the optical module. The computing power module 0110 performs image analysis and processing, and combines the screen data and feature data of the low-light night vision device to perform image calculation. The screen data of the low-light night vision device includes screen optical parameters, screen display images, and screen physical parameters, and the feature data includes low-light scene features, scene target features, and low-light night vision imaging features. Through calculation and analysis, the demand for enhanced information and spatial positioning data of enhanced information are obtained. Further, pre-generated stored information can be read from the memory, or information of other sensors and information systems can be called, and knowledge rules established in advance can be called to generate enhanced information. Finally, the enhanced information is fused with the low-light night vision image through the display module 0112 and the optical module 0111, and is imaged and converged to the human eye through the optical module 0111.

[0060] The augmented reality system for the low-light night vision device provided by the present application can realize information enhancement of the image formed by the low-light night vision device by setting an augmented reality device behind the low-light night vision device, reduce the physiological impact of the imaging limitations of the low-light night vision device on the visual perception of the human eye, and effectively improve the visual perception ability under the low-light night vision device.

[0061] The positions and structural designs of the modules in the system of the present application will be further described in detail below.

[0062] Reference Figure 2 Fig. 1 is a schematic diagram of three different incident modes of the display module and the optical module in the system of the present application.

[0063] Among them, (a) is an upper entry mode, in which the display module 0112 is arranged above the optical module 0111; (b) is a side entry mode, in which the display module 0112 is arranged beside the optical module 0111; and (c) is a rear entry mode, in which the display module 0112 is arranged behind the optical module 0111.

[0064] As mentioned above, the display module 0112 and the optical module 0111 can be combined together as an AR system light machine. The selection design of the light machine can be based on the structure size, optical parameters of the night vision device, and the size structure and optical performance of the incident mode determined in the limited space between the human eye and the night vision device meet the requirements.

[0065] The light machine realizes virtual-real fusion by optical perspective optical combination, and the optical path combination is as shown in Figure 3 The optical path combination is the collection of two parts of light entering the human eye, one part is the light 0300 from the objective lens of the night vision device 0100, the light 0311 imaged by the night vision device 0100, and the light 0312 entering the human eye after passing through the optical module 0111; the other part is the light 0320 emitted by the display module 0112, the light 0321 entering the human eye after being folded by the optical module 0111, and the two parts of light converging and imaging through the AR system light machine.

[0066] It should be noted that the augmented reality system of the application adapted to the night vision device uses the night vision device as the front-end input, and the structure and optical performance of the night vision device are not changed, and the augmented reality system structure, optical design, etc. are designed. The selection design of each module in the system is designed around the optical path combination imaging and system function implementation, constrained by the structure, optical and physical parameters of the night vision device, and influenced by the night vision environment, and needs to meet the head-mounted design requirements and input / output connection requirements, and the design guide is as shown in Figure 4 . Among them, the design of the computing module 0110, the optical module 0111, the reality module 0112, the tracking module 0113, the I / O interface module 0114, and the camera module 0115 is constrained, limited, influenced and required by the night vision device 0401, the night vision environment 0402, the connection requirement 0403, the head-mounted requirement 0404, and other constraints, limitations, influences and requirements 0405.

[0067] Among them, the constraints, limitations, influences and requirements 0401 of the night vision device include but are not limited to the size, field of view, exit pupil distance, interpupillary distance, installation and flip of the night vision device, the brightness, contrast, transparency compatibility, display color, display information color of the eyepiece screen of the night vision device, etc.

[0068] As shown in Figure 5 , it is a structure matching diagram of the night vision device and the optical module in the system of the application. Among them, the eyepiece screen diameter 0510 of the night vision device 0100 matches the size 0511 of the optical module 0111, and the minimum exit pupil distance 0520 of the night vision device 0100 matches the thickness of the optical module 0111 and its minimum exit pupil distance.

[0069] As shown in Figure 6Fig. 2 shows the matching structure of the micro-light night vision scope and the optical module in the system of the present application. Figure 5 Fig. 3 shows the schematic diagram of the detection distance and the imaging distance under the structure of the present application. The augmented image 0610 displayed by the display module is imaged 0611 by the optical module 0111 and fused with the spatial image 0600 formed by the micro-light night vision scope 0100. The detection distance 0620 of the micro-light night vision scope matches the near-eye display imaging distance of the augmented reality optical machine.

[0070] Fig. 4 shows the matching structure of the micro-light night vision scope and the optical module in the system of the present application. Figure 7 Fig. 5 shows the matching schematic diagram of the field of view of the micro-light night vision scope and the field of view of the optical module in the system of the present application. The field of view angle 0700 of the micro-light night vision scope 0100 matches the field of view angle 0710 of the optical module of the augmented reality device. The field of view of the two is close, and the field of view angle 0700 of the micro-light night vision scope 0100 is not limited by the field of view angle 0710 of the optical module.

[0071] In particular, generally, the field of view of the micro-light night vision scope 0100 is circular, and most of the augmented reality optical.

[0072] Fig. 6 shows the matching structure of the micro-light night vision scope and the optical module in the system of the present application. Figure 9 Fig. 7 shows the matching structure of the micro-light night vision scope and the optical module in the system of the present application.

[0073] In specific applications, the micro-light night vision scope 0100 can be installed on a helmet and be flipped up and down. When flipped up, it is at the position 0901, and when flipped down, it is at the position 0902, and the flipping rule is 0900. In order to match the installation and flipping manner of the micro-light night vision scope, maintain the structural matching of the micro-light night vision scope 0100 and the AR optical machine (including the optical module 0111 and the display module 0112) independent of each other, and maintain the precise and stable combination of the light paths of the two, it is necessary to maintain the distance 0910 between the micro-light night vision scope 0100 in the flipped-up position 0901 and the upper edge of the AR optical machine, the distance 0912 between the micro-light night vision scope 0100 in the flipped-down position 0902 and the AR display module, the distance 0913 between the human eye and the display module 0111, and the distance 0911 between the human eye and the ocular screen of the micro-light night vision scope 0100 have sufficient adjustment redundancy space, and can be adjusted to the light path combination position so that the two can clearly image and accurately fuse.

[0074] Generally, the light intensity under moonlight outdoors is about 1×10 -1 Lx, and the light intensity under clear sky without moon and stars is 1×10 -3 Lx. Under the conditions of starlight or moonlight illumination at night, it is difficult for the human eye to observe, discover and identify targets. By using the augmented reality system adapted to the micro-light night vision scope provided by the present application, the micro-light night vision scope images the objects and scenes irradiated by starlight or moonlight at a distance on the input surface of the micro-light image intensifier through the micro-light objective lens, and then the image is amplified and displayed on the display module 0112. 4 to 10 5The output surface of the low-light image intensifier forms a fluorescent screen image for the human eye to observe, so that the physiological influence of the imaging limitations of the low-light night vision device on the visual perception of the human eye can be effectively reduced, and the visual perception ability under the low-light night vision device can be improved.

[0075] The constraints, limitations, influences and requirements considered in the design of the system of the present application include but are not limited to the above, and the AR system adapted to the low-light night vision device and applied to the low-light environment based on the low-light night vision device belongs to the scope of the present application.

[0076] The augmented reality system adapted to the low-light night vision device provided by the embodiment of the present application enhances the additional auxiliary visual perception information to the low-light night vision image formed by the night vision device through the augmented reality technology, and then converges the human eye through optical imaging, so that the visual perception deficiency caused by the imaging limitations of the low-light night vision device can be supplemented. The additional auxiliary visual perception information includes but is not limited to information in the form of text, numbers, symbols, marks, images, animations, etc., which can be pre-generated and stored in the system of the present application, or real-time received from other sensor, information system or external data source, or integrated with pre-stored information, other data source information through AI analysis to generate intelligent information. The AI analysis intelligent generated information can be based on prior knowledge such as low-light night vision imaging, low-light night vision observation, low-light night vision image visual perception, as well as visual ergonomics rules, human-computer interface display rules, etc., to generate low-light night vision visual perception auxiliary information.

[0077] The additional auxiliary visual perception information is enhanced to the low-light night vision image focused and converged by the human eye, but not on the eyepiece screen of the low-light night vision device. The enhanced information can be realized through the visual SLAM algorithm of the camera module. The visual SLAM algorithm can fuse the position and attitude data of the tracking module, and can improve the positioning accuracy and robustness of the enhanced information on the low-light night vision image.

[0078] The "multiple" in the embodiment of the present application refers to two or more.

[0079] It should be noted that the terms "include" and "have" and any variations thereof in the specification and claims of the present application and the above-described drawings are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to the process, method, product or device.

[0080] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on its differences from other embodiments. Furthermore, the system embodiments described above are merely illustrative; the modules and units described as separate components may or may not be physically separate. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0081] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can be physically arranged separately, or two or more units can be integrated into one unit.

[0082] The embodiments of the present invention have been described in detail above. Specific implementation methods have been used to illustrate the present invention. The descriptions of the embodiments above are only for the purpose of helping to understand the methods and systems of the present invention, and are merely some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention, and the content of this specification should not be construed as a limitation of the present invention. Therefore, any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. An augmented reality system adapted to low-light night vision goggles, characterized in that, The system includes: low-light night vision goggles, and an augmented reality device disposed behind the low-light night vision goggles; the augmented reality device includes: A camera module is used to acquire scene information, which includes: low-light scene images, images on the screen of low-light night vision goggles, and images on the optical module. The computing power module is used to generate enhanced information based on the scene information; Display module, used to display the enhanced information; An optical module is used to combine a first ray of light from the objective lens of the low-light night vision device to generate an image formed by the low-light night vision device and a second ray of light generated to display the enhancement information, and to converge and present them in the human eye. The augmented reality device also includes: The detection module is used to sense and detect the environment, providing environmental sensing data. The tracking module is used to determine the user's location information based on the environmental sensing data; The computing module is also used to correct the enhancement information according to the user's location information, and to receive and process scene information from the camera module, and to determine the parameters of the enhancement information required for the image formed by the low-light night vision lens through image analysis calculation. The computing module performs image analysis and processing, and combines the screen data and feature data of the low-light night vision goggles to perform image calculations; The low-light night vision goggle screen data includes screen optical parameters, screen display images, and screen physical parameters; the feature data includes low-light scene features, scene target features, and low-light night vision goggle imaging features. The augmented information needs and spatial positioning data are obtained through computational analysis. Pre-generated stored information is read from the memory, or information from other sensors and information systems is called, and pre-established knowledge rules are invoked to generate augmented information. The enhanced information is fused with the low-light night vision image through the display module and optical module, and the image is focused on the human eye through the optical module.

2. The augmented reality system adapted for low-light night vision goggles according to claim 1, characterized in that, The minimum exit pupil distance of the low-light night vision goggles is matched with the thickness of the optical module and its minimum exit pupil distance.

3. The augmented reality system adapted for low-light night vision goggles according to claim 1, characterized in that, The display module and the optical module are combined to form an optomechanical system. The optomechanical system is adapted to the low-light night vision goggles for night vision observation, and the components of the optomechanical system are constrained by the structure, performance and optical parameters of the low-light night vision goggles.

4. The augmented reality system adapted for low-light night vision goggles according to claim 3, characterized in that, The detection range of the low-light night vision goggles is matched with the near-eye display imaging range of the optical engine.

5. The augmented reality system adapted for low-light night vision goggles according to claim 1, characterized in that, The field of view of the low-light night vision goggles matches the field of view of the optical module.

6. The augmented reality system adapted for low-light night vision goggles according to claim 5, characterized in that, The field of view of the low-light night vision goggles is circular, while the field of view of the optical module is square. A circular aperture is provided in the optical module to match the field of view of the optical module with that of the low-light night vision goggles.

7. The augmented reality system adapted for low-light night vision goggles according to claim 1, characterized in that, The interpupillary distance of the low-light night vision goggles matches the interpupillary distance of the optical module, and both are adjustable.

8. The augmented reality system adapted to low-light night vision goggles according to any one of claims 1 to 7, characterized in that, The optical module is positioned after the incident optical system of the low-light night vision goggles, separating the human eye from the outside world into a low-light environment space, an image space, and an observation space.

9. The augmented reality system adapted for low-light night vision goggles according to claim 8, characterized in that, An optical attenuator is provided between the display module and the optical module. The optical attenuator is used to reduce the brightness of the display module so that the brightness of the observation space is compatible with the brightness of the image space.

Citation Information

Patent Citations

  • Night vision device, night vision method, and program

    WO2016171190A1