Multi-image source common exit pupil overlapping display system and method

Abstract

The invention discloses a multi-image-source common exit pupil overlapping display system and method, and belongs to the technical field of optical imaging and display, and the system comprises a multi-image-source module which comprises a plurality of independent image generation sources and is used for providing different types of image information; the image wavefront guiding optical module is arranged behind each path of image source and is used for carrying out collimation, shaping, regulation and control and path guiding on light waves emitted by the multi-image source module and realizing consistent superposition of a plurality of heterogeneous image sources in spatial positions, angles and wavefront parameters at a common exit pupil superposition display surface P; the common exit pupil superposition display surface P is used for carrying out space and time fusion on wavefronts of all image sources to generate a composite image; and the detector module is arranged behind the common exit pupil superposition display surface and is used for receiving the fused composite image wavefront and converting the fused composite image wavefront into image data to be output. According to the system and the method, high-uniformity, high-resolution, high-dynamic-range and multispectral large-depth-of-field fusion imaging can be realized, so that higher requirements of modern simulators, visual systems and multidimensional sensing equipment on imaging quality and system performance are met.

Description

TECHNICAL FIELD

[0001] The present application belongs to the field of optical imaging and display technology, and particularly relates to a multi-image source common-pupil overlapping display system and method. BACKGROUND

[0002] In the development of modern optical imaging and display technology, how to realize efficient fusion and accurate display of multiple image sources has always been a key issue in the industry. Most existing imaging systems use single image source imaging or multiple image sources imaging and then image synthesis. This method has many limitations in practical application, mainly manifested as limited spatial resolution, poor spectral information fusion effect, insufficient depth of field expression, and difficulty in meeting the simulation and recognition needs of multi-dimensional complex scenes.

[0003] Especially in multi-band imaging, dynamic scene simulation, and large depth of field display, due to the limitations of structure and optical path design, the traditional optical system often cannot realize accurate superposition of multiple image sources at the same pupil position, resulting in problems such as large wavefront error, uneven brightness distribution, and low image clarity in the final imaging. In addition, unreasonable optical path layout also increases the complexity of system integration, limiting its application in high information simulation and display systems. SUMMARY

[0004] In view of the problems of poor imaging uniformity, insufficient image information, limited depth of field, difficulty in realizing multi-spectral / multi-dynamic simulation, and difficulty in meeting the needs of high-precision target recognition and simulation training in the prior art optical imaging and target simulation system, the present application provides a multi-image source common-pupil overlapping display system and method, which constructs independent imaging light paths for each sub-pixel by designing a multi-wavefront superposition imaging system to realize overlapping display of multiple image sources at the same pupil position. This method can effectively integrate the information of multiple image sources based on the common optical pupil, and realize high-uniformity, high-resolution, high-dynamic-range, and multi-spectral large-depth-of-field fusion imaging through reasonable wavefront control and optical path design, to meet the higher requirements of modern simulators, visual systems, and multi-dimensional perception devices for imaging quality and system performance.

[0005] The present application is implemented by the following technical solutions:

[0006] A multi-image source common-pupil overlapping display system, comprising:

[0007] A multi-image source module: comprising a plurality of independent image generation sources, for providing different types of image information, the image information including multi-spectral images, multi-depth-of-field images, or high-dynamic-range images;

[0008] Image wavefront guiding optical module: arranged behind each image source, used for collimating, shaping, regulating and path guiding the light waves emitted by the multi-image source module, and realizing the consistency of spatial position, angle and wavefront parameters of multiple heterogeneous image sources at the co-pupil superposition display surface P;

[0009] Co-pupil superposition display surface P: used for spatial and temporal fusion of wavefronts of all image sources to generate a composite image;

[0010] Detector module: arranged behind the co-pupil superposition display surface, used for receiving the fused composite image wavefront and converting it into image data output.

[0011] Further, the image generation sources in the multi-image source module include at least one of the following:

[0012] Laser image source: providing monochromatic or quasi-monochromatic high coherence image, suitable for high resolution imaging;

[0013] Aperture modulation source: realizing light field modulation through liquid crystal aperture or variable diffraction aperture, suitable for light field reconstruction or image projection;

[0014] Digital micromirror device image source: based on MEMS micromirror array for light modulation, which can realize high-speed grayscale or binary image spatial coding, suitable for fast image scanning or spectral coding.

[0015] Further, the multi-spectral image is obtained by different image generation sources working in infrared, visible or ultraviolet waveband;

[0016] The multi-depth-of-field image is obtained by different image generation sources focusing on different spatial depths;

[0017] The high dynamic range image is obtained by different image generation sources having different exposure or gain settings to capture different brightness levels.

[0018] Further, the image wavefront guiding optical module includes:

[0019] Collimating and shaping optical module: including collimating optical elements and beam shapers, the collimating optical elements are used to generate spatially parallel outgoing beams, and the beam shapers are used to regulate the geometric parameters and illumination distribution of the light beams, providing a uniform optical substrate;

[0020] Wavefront correction module: used for real-time compensation of optical distortion and path difference caused by system errors or source-end interference, improving wavefront consistency and imaging quality;

[0021] Beam combining and guiding module: including wavelength selective element and control element; the wavelength selective element is used for realizing effective shunting and superposition of different image sources in spectral dimension, and the control element includes an adjustable mirror or a micro-opto-electro scanning mirror, which is used for controlling the incident angle and spatial position of each wave front, realizing high-precision path convergence and pupil registration.

[0022] Further, the collimating optical element includes a collimating lens or a mirror;

[0023] The beam shaper includes a cylindrical lens, an aspherical lens or a micro-structured optical element.

[0024] Further, the wave front correction assembly includes a deformable mirror, a liquid crystal light modulator or a MEMS control surface array.

[0025] Further, the detector module is configured as a CCD, CMOS or InGaAs image sensor, which is used for outputting a multi-spectral image, a high dynamic range image or a three-dimensional depth image.

[0026] In another aspect, the application also provides a display method of a multi-image source co-pupil overlapping display system, which specifically includes the following steps:

[0027] Step one: generating at least two different types of image information through a multi-image source module;

[0028] Step two: collimating, shaping and path guiding each wave front through an image wave front directing optical system, so that it realizes parameter matching at a co-pupil overlapping display surface P;

[0029] Step three: spatial and temporal fusion of multiple wave fronts at the co-pupil overlapping display surface P to form a composite image;

[0030] Step four: converting the composite image into image data output through a detector module.

[0031] Further, in step three, the spatial and temporal fusion specifically includes:

[0032] Multi-band fusion: each image source works at different central wavelengths, and multiple wave front images at different wavelengths are spatially overlapped at the co-pupil overlapping display surface P through wavelength selective optical elements to form a multi-spectral composite image;

[0033] Multi-depth-of-field fusion: each image source is focused at different spatial depth-of-field positions, or the image focal point is switched through time division, to realize rotation or synchronous superposition of multiple layers of depth-of-field images;

[0034] High dynamic range fusion: each image source is operated under different exposure intensity, light source brightness or image gain conditions to capture high-brightness and low-brightness area images, respectively, and a high dynamic range image is formed after fusion.

[0035] Compared with the prior art, the advantages of the present invention are as follows:

[0036] 1. Support multi-band fusion display: Each image source can carry information of different bands (such as infrared, visible, ultraviolet, etc.), and realize the fusion output of wide-band images on the common exit pupil surface to meet the imaging requirements in complex spectral environments.

[0037] 2. Ability to express depth of field information: By performing timing control or phase modulation on different image sources, spatial depth information can be expressed in the fused image, enabling three-dimensional scene simulation and providing support for spatial perception and target recognition.

[0038] 3. Achieve high dynamic range imaging: Utilize the grayscale and brightness levels of different image sources to achieve dynamic expansion of grayscale levels, enhance dark details and bright layering in the fused image, and improve the overall image information content and visual quality.

[0039] 4. The system has strong scalability and can adapt to multiple application requirements: the optical structure adopts a modular design, and the number of image sources can be flexibly configured according to needs. It is suitable for a variety of target simulation and image display scenarios and has good versatility and adaptability.

[0040] 5. Enhanced information detection and output capabilities: The fused image is uniformly received and recorded by the detector, and the output image can simultaneously contain multi-dimensional information such as space, spectrum, intensity and depth, significantly improving the information carrying capacity and application performance of the system imaging.

[0041] 6. Widely applicable to high-demand simulation and recognition applications: The system design of the present invention is particularly suitable for laser target simulators, multi-spectral imaging systems, virtual reality simulation, complex visual testing and other fields, which improves the authenticity, accuracy and engineering practicality of the simulation system. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly describes the drawings required for the specific embodiments or the description of the prior art. Similar elements or parts are generally identified by similar reference numerals throughout the drawings. Elements or parts in the drawings are not necessarily drawn to scale.

[0043] Figure 1 Schematic diagram of the structure of a multi-image source common exit pupil overlapping display system of the present invention;

[0044] Figure 2 This is a schematic diagram of the multi-image source co-exit pupil overlapping display system of Example 2 applied to an augmented reality visualization scene. DETAILED DESCRIPTION

[0045] In order to clearly and completely describe the technical solution and specific working process of the present invention, the specific implementation methods of the present invention are as follows in conjunction with the accompanying drawings:

[0046] Example 1

[0047] This embodiment provides a multi-image source common exit pupil overlapping display system, including:

[0048] Multi-image source module: includes multiple independent image generation sources, used to provide different types of image information, such as multi-spectral images, multi-depth images or high dynamic range images; Figure 1 As shown in , image sources 1 to n are included, and each image source can provide different types of image information, such as spectrum, depth or intensity distribution.

[0049] The image generation source in the multi-image source module includes at least one of the following:

[0050] Laser image source: provides monochrome or quasi-monochromatic high-coherence images, suitable for high-resolution imaging;

[0051] Aperture modulation source: light field modulation is achieved through liquid crystal iris or variable diffraction iris, suitable for light field reconstruction or image projection;

[0052] Digital micromirror device image source: Based on MEMS micromirror array for light modulation, it can achieve high-speed grayscale or binary image spatial encoding, suitable for fast image scanning or spectral encoding.

[0053] In this embodiment, the multi-image source module is configured with three wavelength bands: a visible light image source (central wavelength 550nm), a near-infrared image source (850nm), and a short-wave infrared image source (1550nm). All of them use narrow-band laser illumination and DMD pattern modulation, and the three image sources are arranged independently.

[0054] Image wavefront guidance optical module: It is set after each image source and is used to collimate, shape, regulate and guide the light waves emitted by the multi-image source modules, and achieve consistent superposition of multiple heterogeneous image sources in spatial position, angle and wavefront parameters at the common exit pupil superposition display surface P;

[0055] In this embodiment, three image wavefront guiding optical modules are provided after the three image sources respectively. Each image wavefront guiding optical module includes:

[0056] Collimation and shaping optical module: includes a collimation optical element and a beam shaper. The collimation optical element is used to generate a spatially parallel outgoing light beam. The beam shaper is used to control the geometric parameters and illumination distribution of the light beam to provide a uniform optical substrate.

[0057] Wavefront correction module: used for real-time compensation of optical distortion and path difference caused by system error or source interference, improving wavefront consistency and imaging quality;

[0058] Combining and guiding module: including wavelength-selective elements and control elements; the wavelength-selective elements are used to realize effective shunting and superposition of different image sources in the spectral dimension, and the control elements include adjustable mirrors or micro-opto-electro scanning mirrors, which are used to control the incident angle and spatial position of each wavefront, realize high-precision path convergence and pupil surface registration.

[0059] The collimating optical element includes a collimating lens or a mirror;

[0060] The beam shaper includes a cylindrical lens, an aspherical lens or a micro-structured optical element. Through the above multi-stage optical control design, the image wavefront directing optical system ensures that multiple heterogeneous image sources can realize the consistency of spatial, angular and wavefront parameters on the unified exit pupil P, providing physical foundation and geometric guarantee for subsequent detection and information fusion, which is one of the core optical support modules for realizing high-quality image composition of the present application.

[0061] Common exit pupil superposition display surface P: used for spatial and temporal fusion of wavefronts of all image sources to generate a composite image; specifically, a real physical plane or a conjugate plane in an imaging system.

[0062] In multi-band imaging, each image source works at different wavelengths, and through common exit pupil overlap, wide-band image fusion is realized. The specific fusion method is: each image source works at different center wavelengths, such as visible light (RGB), near-infrared, ultraviolet, etc., and through wavelength-selective optical elements (such as dichroic mirrors, wavelength division combiners), multiple band image wavefronts are spatially superimposed at the common exit pupil P to form a multispectral composite image. This fusion method can realize cross-band image information complementation and enhancement, and is suitable for complex scene recognition and analysis in multiple fields such as biological imaging, remote sensing detection, material identification, etc.

[0063] In terms of depth of field expression, the system supports focusing each image source at different spatial depth positions, or quickly switching image focal points through time division, realizing the rotation or synchronous superposition of multi-layer depth of field images. This mechanism can reconstruct the three-dimensional structure of the target or realize the quick switching observation of different focal planes, significantly enhancing the spatial expressiveness of the image. When applied to 3D display, spatial modeling, extended depth of field imaging, etc., it has high depth resolution and good real-time performance.

[0064] In high dynamic range imaging, by setting different image sources to operate at different exposure intensities, light source brightness, or image gain, the system can capture images of both bright and dark areas. Fusion at the common exit pupil plane P creates a high dynamic range (HDR) image with rich brightness levels and sharp details. This fusion method is particularly suitable for complex lighting environments with strong contrast between light and dark, such as night vision enhancement, backlit imaging, or industrial scenes with strong light interference.

[0065] The detector module, located behind the common-exit pupil superimposed display, receives the fused composite image wavefront and converts it into image data for output. This module can be configured with various image sensors, such as CCD, CMOS, and InGaAs, depending on system requirements. It boasts high resolution, high sensitivity, and wide-band response, enabling effective sensing and acquisition of images across visible, near-infrared, and ultraviolet wavelengths. The detector system integrates functional modules for photoelectric conversion, signal amplification, analog-to-digital conversion, caching, and synchronization control to ensure accurate and real-time image acquisition.

[0066] This embodiment uses an InGaAs detector with wide spectral response capability. The detector is equipped with a multi-channel acquisition card and host processing software to perform sub-band decoding, fusion reconstruction and spectral feature extraction of the image.

[0067] The multi-image source co-exit pupil overlapping display system of this embodiment is used for surface material identification and crop classification in earth observation. Testing has shown that the system can obtain RGB+NIR+SWIR image information of ground objects in a single scan, achieving high-spectral accuracy recognition. It is particularly suitable for distinguishing vegetation types, identifying areas of pests and diseases, and estimating soil moisture content. It has the advantages of fast speed, multi-source fusion, and compact structure.

[0068] Example 2

[0069] like Figure 2 As shown, this embodiment provides a multi-image source common exit pupil overlapping display system, which is applied to augmented reality visualization scenes and is aimed at the depth of field multi-layer imaging requirements in 3D assisted diagnosis and treatment or industrial assembly guidance. The image source module uses three DMD image sources to project image content representing the three depth of field planes of near, medium and far respectively. The output image of each image source is focused at different depth positions through its corresponding guiding optical module (L1 to L3), but after passing through the adjustable focal length system and spatial filtering components, the wavefront is fused into a composite field of view at the common exit pupil plane P. In order to achieve a dynamic focusing effect, the system synchronously controls the three image sources to refresh at high speed according to different time sequences, so that the focus of the human eye / detector end can be switched or a sense of depth can be formed. The image is finally captured by a high frame rate CMOS detector, or output to a wearable augmented reality device (such as AR glasses) by a transparent display.

[0070] The observer can perceive multi-level depth-of-field structure in the display, such as simultaneously seeing the blood vessel layer, the bone layer and the instrument positioning point, or dynamically switching the front and rear structures in a complex assembly process. Compared with the traditional single-plane display, the system effectively improves the spatial sense and the task execution efficiency.

[0071] The preferred embodiments of the present application are described in detail above with reference to the drawings, but the present application is not limited to the specific details in the above-described embodiments. Various simple modifications can be made to the technical solutions of the present application within the technical concept of the present application, and all of these simple modifications belong to the protection scope of the present application.

[0072] In addition, it should be noted that each specific technical feature described in the above-described specific embodiments can be combined in any appropriate manner without contradiction. In order to avoid unnecessary repetition, the present application will not describe various possible combinations again.

[0073] In addition, various different embodiments of the present application can also be combined in any manner, as long as they do not deviate from the idea of the present application, and they should also be considered as disclosed by the present application.

Claims

1. A multi-image source common exit pupil overlapping display system, characterized in that: include: Multi-image source module: includes multiple independent image generation sources, used to provide different types of image information, including multi-spectral images, multi-depth images or high dynamic range images; Image wavefront guidance optical module: It is set after each image source and is used to collimate, shape, regulate and guide the light waves emitted by the multi-image source modules, and achieve consistent superposition of multiple heterogeneous image sources in spatial position, angle and wavefront parameters at the common exit pupil superposition display surface P; Common exit pupil superposition display surface P: used to spatially and temporally fuse the wavefronts of all image sources to generate a composite image; Detector module: It is set behind the common exit pupil superposition display surface and is used to receive the fused composite image wavefront and convert it into image data output.

2. The multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The image generation source in the multi-image source module includes at least one of the following: Laser image source: provides monochrome or quasi-monochromatic high-coherence images, suitable for high-resolution imaging; Aperture modulation source: light field modulation is achieved through liquid crystal iris or variable diffraction iris, suitable for light field reconstruction or image projection; Digital micromirror device image source: Based on MEMS micromirror array for light modulation, it can achieve high-speed grayscale or binary image spatial encoding, suitable for fast image scanning or spectral encoding.

3. The multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The image generation source in the multi-image source module includes at least one of the following: Laser image source: provides monochrome or quasi-monochromatic high-coherence images, suitable for high-resolution imaging; Aperture modulation source: light field modulation is achieved through liquid crystal iris or variable diffraction iris, suitable for light field reconstruction or image projection; Digital micromirror device image source: Based on MEMS micromirror array for light modulation, it can achieve high-speed grayscale or binary image spatial encoding, suitable for fast image scanning or spectral encoding.

4. The multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The image wavefront guiding optical module comprises: Collimation and shaping optical module: includes a collimation optical element and a beam shaper. The collimation optical element is used to generate a spatially parallel outgoing light beam. The beam shaper is used to control the geometric parameters and illumination distribution of the light beam to provide a uniform optical substrate. Wavefront correction module: used to compensate for optical distortion and path differences caused by system errors or source-end interference in real time, improving wavefront consistency and imaging quality; Beam combining and guiding module: includes band-selective elements and control elements; the band-selective elements are used to achieve effective diversion and superposition of different image sources in the spectral dimension, and the control elements include adjustable reflectors or micro-electromechanical scanning mirrors to control the incident angle and spatial position of each wavefront to achieve high-precision path merging and pupil plane alignment.

5. The multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The collimating optical element includes a collimating lens or a reflector; The beam shaper includes a cylindrical lens, an aspherical lens or a microstructure optical element.

6. The multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The wavefront correction component includes a deformable mirror, a liquid crystal light modulator or a MEMS control array.

7. The multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The detector module is configured as a CCD, CMOS or InGaAs image sensor, and is used to output a multispectral image, a high dynamic range image or a three-dimensional depth image.

8. The display method of a multi-image source common exit pupil overlapping display system according to claim 1, characterized in that: The specific steps include: Step 1: Generate at least two different types of image information through a multi-image source module; Step 2: The image wavefront guiding optical system collimates, shapes and guides each wavefront to achieve parameter matching at the common exit pupil superposition display surface P; Step 3: Perform spatial and temporal fusion of multiple wavefronts at the common exit pupil superposition display surface P to form a composite image; Step 4: Convert the composite image into image data output through the detector module.

9. The display method of a multi-image source common exit pupil overlapping display system according to claim 8, characterized in that: In step 3, the spatial and temporal fusion is specifically performed, including: Multi-band fusion: Each image source operates at a different central wavelength, and wavelength-selective optical elements are used to spatially overlap the wavefronts of multiple band images at the common exit pupil superposition display surface P to form a multispectral composite image. Multi-depth fusion: Each image source focuses on a different spatial depth of field position, or switches the image focus in time sequence to achieve alternating or synchronous superposition of multiple depth of field images; High dynamic range fusion: Each image source operates under different exposure intensities, light source brightness or image gain conditions to capture images of high-brightness and low-brightness areas respectively, which are then fused to form a high dynamic range image.

Images