Method and apparatus for generating enhanced information for a low-light-level night vision device

Abstract

The application provides an enhanced information generation method and device for a low-light night vision device, and the method comprises the following steps: collecting low-light night vision scene information, wherein the low-light night vision scene information comprises low-light night vision scene environment information and a low-light night vision device screen image; constructing a virtual scene according to the low-light night vision scene environment information; and determining enhanced information according to the virtual scene and the low-light night vision device screen image, wherein the enhanced information is used for enhancing the visual effect of the low-light night vision device image. According to the application, the enhanced information can be provided for the low-light night vision device image in a low-light night vision scene, so that the visual perception ability in the low-light night vision device can be improved.

Description

Technical Field

[0001] This invention relates to the field of visual perception training technology for night vision goggles (NVG), specifically to a method and apparatus for low-light scene reconstruction and enhancement information generation. Background Technology

[0002] Vision is the primary sensory organ for humans to acquire information, but its limitations in spectral and spatial resolution significantly restrict the temporal and spatial scope of human activities, as well as our ability to understand and transform the world. Improving, expanding, and extending human vision in low-light conditions at night has long been a goal pursued by humankind. In recent decades, with the rapid development of night vision technology, various new night vision products and equipment have emerged and are gradually being applied to surveillance, monitoring, tracking, and reconnaissance in fields beyond military security, such as transportation security. The market potential and application prospects in both military and civilian sectors are enormous.

[0003] Low-light night vision goggles are a type of low-light night vision equipment. They convert and amplify targets in low-light environments at night, transforming them into visible light signals. This allows images that are unclear or invisible to the human eye at night or in low-light environments to be visualized. With the aid of night vision goggles, the human eye can observe targets in low-light environments, improving visual perception capabilities at night and in low light conditions.

[0004] While low-light night vision goggles can help observers see targets in low-light scenes, their imaging capabilities also suffer from a series of physiological effects on visual perception, including a narrowed field of view, decreased visual acuity, altered distance judgment and stereoscopic vision, as well as illusions, spatial orientation disorders, and visual fatigue. Therefore, minimizing these physiological effects and improving visual perception capabilities under low-light night vision goggles is a crucial issue that the industry needs to address. Summary of the Invention

[0005] This invention provides a method and apparatus for generating enhanced information for low-light night vision goggles, which can provide enhanced information for low-light night vision goggles images in low-light night vision scenarios, thereby helping to improve the visual perception capability under low-light night vision goggles.

[0006] Therefore, the present invention provides the following technical solution:

[0007] A method for generating enhanced information for low-light night vision goggles, the method comprising:

[0008] Collect low-light night vision scene information, which includes: low-light night vision scene environment information and low-light night vision goggles screen image;

[0009] A virtual scene is constructed based on the low-light night vision scene environment information;

[0010] Enhancement information is determined based on the virtual scene and the low-light night vision goggles screen image, and the enhancement information is used to enhance the visual effect of the low-light night vision goggles image.

[0011] Optionally, the acquisition of low-light night vision scene information includes: acquiring low-light night vision scene information using a low-light environment perception sensor.

[0012] Optionally, the low-light night vision scene environment information includes scene data and scene images;

[0013] The construction of the virtual scene based on the low-light night vision scene environment information includes:

[0014] Feature extraction is performed on the scene image to obtain scene features;

[0015] A virtual scene is constructed based on the scene data and the scene features.

[0016] Optionally, the scene features include any one or more of the following: point cloud data, depth information, and frequency domain features.

[0017] Optionally, determining the enhancement information based on the virtual scene and the low-light night vision goggle screen image includes:

[0018] Determine the mapping relationship between the screen image of the low-light night vision goggles and the virtual scene;

[0019] The enhanced information requirements are determined based on the mapping relationship;

[0020] The enhancement information is determined based on the enhancement information requirements and the image on the low-light night vision goggles screen.

[0021] Optionally, the enhanced information requirements include the areas and features of the low-light night vision goggle image that need to be enhanced.

[0022] Optionally, determining the enhancement information based on the enhancement information requirements and the low-light night vision goggle screen image includes:

[0023] Feature extraction is performed on the screen image of the low-light night vision goggles to obtain image features;

[0024] Enhancement information is generated based on the region and features to be enhanced and the image features.

[0025] An enhanced information generation device for low-light night vision goggles, the device comprising:

[0026] The information acquisition module is used to acquire low-light night vision scene information, which includes: low-light night vision scene environment information and low-light night vision goggles screen image;

[0027] A virtual scene construction module is used to construct a virtual scene based on the low-light night vision scene environment information;

[0028] An enhancement information determination module is used to determine enhancement information based on the virtual scene and the low-light night vision goggles screen image, wherein the enhancement information is used to enhance the visual effect of the low-light night vision goggles image.

[0029] Optionally, the low-light night vision scene environment information includes scene data and scene images;

[0030] The virtual scene construction module includes:

[0031] The feature extraction unit is used to extract features from the scene image to obtain scene features;

[0032] A scene construction unit is used to construct a virtual scene based on the scene data and the scene features.

[0033] Optionally, the enhanced information determination module includes:

[0034] A mapping relationship determination unit is used to determine the mapping relationship between the low-light night vision goggle screen image and the virtual scene;

[0035] A requirement determination unit is used to determine the enhanced information requirements based on the mapping relationship;

[0036] An information determination unit is used to determine enhancement information based on the enhancement information requirements and the image on the low-light night vision goggle screen.

[0037] The present invention provides a method and apparatus for generating enhanced information for low-light night vision goggles. By collecting low-light night vision scene information, a virtual scene is constructed based on the collected low-light night vision scene environment information. Enhancement information is determined based on the virtual scene and the screen image of the low-light night vision goggles. This enhancement information can be used to help enhance the visual effect of the low-light night vision goggles image, reduce the physiological impact of the imaging limitations of low-light night vision goggles on human visual perception, and improve the visual perception capability under low-light night vision goggles. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the accompanying drawings used in the embodiments will be briefly described below. Obviously, the drawings described below are merely some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0039] Figure 1 This is a flowchart of an enhanced information generation method for low-light night vision goggles provided by the present invention;

[0040] Figure 2 This is a schematic diagram of an enhanced information generation device for low-light night vision goggles provided by the present invention. Detailed Implementation

[0041] To make the above-mentioned objectives, features and beneficial effects of this application more apparent and understandable, the specific embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0042] To address some shortcomings in the imaging capabilities of existing low-light night vision goggles, this invention provides a method and apparatus for generating enhanced information for low-light night vision goggles. By collecting low-light night vision scene information, enhanced information is generated to improve the image quality of the low-light night vision goggles in low-light night vision environments. This enhanced information can reduce the physiological impact of the imaging limitations of low-light night vision goggles on human visual perception and improve visual perception capabilities under night vision goggles.

[0043] like Figure 1 The diagram shown is a flowchart of an enhanced information generation method for low-light night vision goggles provided by the present invention, comprising the following steps:

[0044] Step 101: Collect low-light night vision scene information, which includes: low-light night vision scene environment information and low-light night vision goggles screen image.

[0045] Specifically, the low-light night vision scene environment information may include scene data and scene images.

[0046] In practical applications, low-light environment perception sensors (such as infrared camera arrays) can be used to collect low-light night vision scene information.

[0047] Step 102: Construct a virtual scene based on the low-light night vision scene environment information.

[0048] Specifically, feature extraction can be performed on the scene image to obtain scene features; the scene features may include any one or more of the following: point cloud data, depth information, frequency domain features, etc. Then, a virtual scene is constructed based on the scene data and the scene features. The virtual scene may be a three-dimensional virtual scene.

[0049] Step 103: Determine enhancement information based on the virtual scene and the low-light night vision goggle screen image. The enhancement information is used to enhance the visual effect of the low-light night vision goggle image.

[0050] The process for determining the enhanced information is as follows:

[0051] (1) Determine the mapping relationship between the screen image of the low-light night vision goggles and the virtual scene;

[0052] (2) Determine the enhanced information requirements based on the mapping relationship.

[0053] The enhanced information requirements include the areas and features of the low-light night vision goggles image that need to be enhanced. In other words, when observing with the night vision goggles, which features of the low-light night vision goggles image, and in which areas of the image (which can be represented by pixels), need to be enhanced to make the image features stand out and achieve the purpose of assisting the observer in perception.

[0054] (3) Determine the enhancement information based on the enhancement information requirements and the low-light night vision goggles screen image.

[0055] Specifically, feature extraction is performed on the screen image of the low-light night vision goggles to obtain image features; then, enhancement information is generated based on the region and features to be enhanced and the image features.

[0056] It should be noted that the enhancement information can be determined based on information such as low-light environment illuminance, contrast, scene, and target features. Furthermore, it can be combined with prior scene knowledge, scene imaging theory, scene human-computer interaction rules, etc., and the enhancement information can be obtained in real time by applying deep learning and neural networks.

[0057] The enhanced information may include information content and information format. The forms of enhanced information include, but are not limited to, any one or more of the following: text, numbers, symbols, marks, images, animations, etc.

[0058] The method for generating enhanced information for low-light night vision goggles provided by this invention involves collecting low-light night vision scene information and constructing a virtual scene based on the low-light night vision scene environment information; determining enhanced information based on the virtual scene and the screen image of the low-light night vision goggles; and using this enhanced information to help enhance the visual effect of the low-light night vision goggles image, reduce the physiological impact of the imaging limitations of low-light night vision goggles on human visual perception, and improve the visual perception capability under low-light night vision goggles.

[0059] Furthermore, when enhancing the image of a low-light night vision device using this enhancement information, the enhancement information can be superimposed on the low-light night vision device image, and then focused onto the human eye through optical imaging. This results in a low-light night vision image with enhanced information that has better visual perception, thereby improving the visual perception capability under low-light night vision devices. The low-light night vision image with enhanced information refers to the low-light night vision image formed by the low-light night vision device and focused onto the human eye, not the image on the eyepiece screen of the low-light night vision device.

[0060] Furthermore, considering changes in the observer's pose, the observer's position information can be determined through real-time tracking, and the generated enhancement information can be superimposed onto the low-light night vision image more accurately and in real time based on this position information.

[0061] Accordingly, the present invention also provides an enhanced information generation device for low-light night vision goggles, such as... Figure 2 The diagram shown is a structural schematic of the device.

[0062] The enhanced information generation device 200 for low-light night vision goggles provided by the present invention includes the following modules:

[0063] Information acquisition module 201 is used to acquire low-light night vision scene information, which includes: low-light night vision scene environment information and low-light night vision goggles screen image;

[0064] Virtual scene construction module 202 is used to construct a virtual scene based on the low-light night vision scene environment information;

[0065] The enhancement information determination module 203 is used to determine enhancement information based on the virtual scene and the low-light night vision goggles screen image, and the enhancement information is used to enhance the visual effect of the low-light night vision goggles image.

[0066] Specifically, the low-light night vision scene environment information may include scene data and scene images.

[0067] Accordingly, the virtual scene construction module 202 may include the following units:

[0068] The feature extraction unit is used to extract features from the scene image to obtain scene features;

[0069] A scene construction unit is used to construct a virtual scene based on the scene data and the scene features.

[0070] In a non-limiting embodiment, the enhanced information determination module 203 described above may include the following units:

[0071] A mapping relationship determination unit is used to determine the mapping relationship between the low-light night vision goggle screen image and the virtual scene;

[0072] A requirement determination unit is used to determine the enhanced information requirements based on the mapping relationship;

[0073] An information determination unit is used to determine enhancement information based on the enhancement information requirements and the image on the low-light night vision goggle screen.

[0074] For further explanation of the above modules and units, please refer to the description in the previous embodiment of the enhanced information generation method for low-light night vision goggles of the present invention, which will not be repeated here.

[0075] The method and apparatus for generating enhanced information for low-light night vision goggles provided by this invention can generate corresponding enhanced information for the image formed by the low-light night vision goggles in low-light environments. This enhanced information is then superimposed on the low-light night vision goggles image and focused onto the human eye through optical imaging, resulting in a low-light night vision image with enhanced information that provides better visual perception, thereby improving the visual perception capability under low-light night vision goggles.

[0076] In the embodiments of this invention, "multiple" refers to two or more.

[0077] It should be noted that the terms "comprising" and "having" and any variations thereof in the specification, claims and accompanying drawings of this invention are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to such processes, methods, products or devices.

[0078] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on its differences from other embodiments. Furthermore, the system embodiments described above are merely illustrative; the modules and units described as separate components may or may not be physically separate. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0079] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can be physically arranged separately, or two or more units can be integrated into one unit.

[0080] The embodiments of the present invention have been described in detail above. Specific implementation methods have been used to illustrate the present invention. The descriptions of the embodiments above are only for the purpose of helping to understand the methods and systems of the present invention, and are merely some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention, and the content of this specification should not be construed as a limitation of the present invention. Therefore, any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A method for generating enhanced information for a low-light-level night vision device, characterized by, The method comprises: collecting micro-light night vision scene information, the micro-light night vision scene information comprising: micro-light night vision scene environment information and a micro-light night vision mirror screen image; constructing a virtual scene according to the micro-light night vision scene environment information; determining enhancement information according to the virtual scene and the micro-light night vision mirror screen image, the enhancement information being used to enhance the visual effect of the micro-light night vision mirror image; wherein the determining of the enhancement information according to the virtual scene and the micro-light night vision mirror screen image comprises: determining a mapping relationship between the micro-light night vision mirror screen image and the virtual scene; determining enhancement information requirements according to the mapping relationship; the enhancement information requirements comprising areas and features that need to be enhanced in the micro-light night vision mirror screen image; determining the enhancement information according to the enhancement information requirements and the micro-light night vision mirror screen image.

2. The method for generating augmented information for a low-light-level night vision device according to claim 1, wherein, The collecting of the micro-light night vision scene information comprises: collecting the micro-light night vision scene information by using a micro-light environment perception sensor.

3. The method for generating augmented information for a low-light-level night vision device according to claim 1, wherein, The micro-light night vision scene environment information comprises scene data and a scene image; The constructing of the virtual scene according to the micro-light night vision scene environment information comprises: extracting features from the scene image to obtain scene features; constructing the virtual scene according to the scene data and the scene features.

4. The method for generating augmented information for a micro-light night vision device according to claim 3, characterized in that, The scene features comprise any one or more of the following: point cloud data, depth information and frequency domain features.

5. The method for generating augmented information for a low-light-level night vision device according to claim 1, wherein, The enhancement information requirements comprise areas and features that need to be enhanced in the micro-light night vision mirror image.

6. The method for generating augmented information for a low-light-level night vision device according to claim 5, wherein, The determining of the enhancement information according to the enhancement information requirements and the micro-light night vision mirror screen image comprises: extracting features from the micro-light night vision mirror screen image to obtain image features; generating the enhancement information according to the areas and features that need to be enhanced and the image features.

7. An enhanced information generation device for a low light level night vision device, characterized by The device comprises: an information collection module, configured to collect micro-light night vision scene information, the micro-light night vision scene information comprising: micro-light night vision scene environment information and a micro-light night vision mirror screen image; a virtual scene construction module, configured to construct a virtual scene according to the micro-light night vision scene environment information; an enhancement information determination module, configured to determine enhancement information according to the virtual scene and the micro-light night vision mirror screen image, the enhancement information being used to enhance the visual effect of the micro-light night vision mirror image; wherein the enhancement information determination module comprises: a mapping relationship determination unit, configured to determine a mapping relationship between the micro-light night vision mirror screen image and the virtual scene; a requirement determination unit, configured to determine enhancement information requirements according to the mapping relationship; the enhancement information requirements comprising areas and features that need to be enhanced in the micro-light night vision mirror screen image; an information determination unit, configured to determine the enhancement information according to the enhancement information requirements and the micro-light night vision mirror screen image.

8. The enhanced information generation device for a micro light night vision scope according to claim 7, characterized by, The micro-light night vision scene environment information comprises scene data and a scene image; The virtual scene construction module comprises: a feature extraction unit, configured to extract features from the scene image to obtain scene features; a scene construction unit, configured to construct the virtual scene according to the scene data and the scene features.

Images