Variable field of view wide spectrum correlation imaging system based on dmd

By utilizing the spatial light coding modulation function of DMD, the variable field-of-view wide-spectrum correlation imaging system based on DMD solves the problems of high device cost and low imaging quality in the existing technology, and realizes low-cost, high-precision visible light and near-infrared spectral imaging.

CN115752726BActive Publication Date: 2026-03-24BEIHANG UNIV +1
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-15
Publication Date
2026-03-24

AI Technical Summary

Technical Problem

Existing variable field-of-view imaging and spectral correlation imaging technologies are costly, have low imaging quality, and low utilization of light field information.

Method used

A variable field-of-view wide-spectrum correlation imaging system based on DMD is adopted. By utilizing the spatial light coding modulation function of DMD, different modulation matrix patterns are generated by setting the modulation matrix size and relative position, thereby realizing variable field-of-view wide-spectrum correlation imaging under a fixed lens. Combined with visible light and near-infrared spectrometers, efficient imaging is achieved.

Benefits of technology

It enables low-cost, high-precision visible and near-infrared spectral imaging, reducing the cost of the imaging system and improving imaging quality and light field information utilization.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115752726B_ABST
    Figure CN115752726B_ABST
Patent Text Reader

Abstract

The application relates to a variable field of view wide spectrum correlation imaging system based on a DMD, and particularly relates to the field of imaging technology. In the system, a computer is used for generating N modulation matrix patterns according to a set modulation matrix size, a target object is arranged on the output light path of a wide spectrum laser to reflect laser, a DMD is arranged on the light path of the reflected light beam of the target object to modulate the laser reflected by the target object according to the N modulation matrix patterns to obtain N modulation signals; a focusing lens module is arranged on the reflected light path of the DMD to focus the modulation signals to form a focused light beam, a spectrometer module is arranged on the transmission light path of the focusing lens module to obtain light intensity information of multiple spectrum bands according to the focused light beam, and the computer is used for obtaining a wide spectrum image of the target object according to the light intensity information of the spectrum bands and the modulation matrix patterns. The application can reduce the system cost and improve the imaging quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of imaging technology, and in particular to a variable field-of-view wide-spectrum correlation imaging system based on DMD. Background Technology

[0002] As a key parameter in imaging technology, the size of the imaging field of view has received increasing attention in the development of imaging technology. In addition to increasing the field of view, researchers have also conducted a series of studies on variable field of view.

[0003] There is relatively little research on variable field of view in existing correlation imaging technologies. Currently, most variable field of view research is used in traditional imaging. In traditional imaging, variable field of view requires the use of adjustable optical devices, usually through the displacement of some lenses or the use of multiple lens systems. However, the displacement of lenses introduces mechanical components, increasing errors, and multiple lens imaging systems increase system costs.

[0004] Existing broadband correlation imaging technology utilizes information from different spectral bands of the visible and near-infrared spectrum of the target to obtain the target's physical properties, expanding the detection capabilities of traditional imaging systems. It has extremely important application value in fields such as remote sensing, environmental monitoring, and national defense security. However, existing broadband correlation imaging uses a specific field of view for imaging, resulting in low utilization of the system's light field information and low imaging quality.

[0005] In summary, existing variable field-of-view imaging and spectral correlation imaging technologies suffer from high device costs and low imaging quality. Summary of the Invention

[0006] The purpose of this invention is to provide a variable field-of-view wide-spectrum correlation imaging system based on DMD, which can reduce system cost and improve imaging quality.

[0007] To achieve the above objectives, the present invention provides the following solution:

[0008] A DMD-based variable field-of-view broadband correlation imaging system includes:

[0009] The system comprises a computer, a broadband laser, a beam expander module, an imaging lens module, a digital depth sensor (DMD), a focusing lens module, and a spectrometer module. The computer is connected to the broadband laser, the DMD, and the spectrometer module. The computer controls the broadband laser to emit laser light and generates N modulation matrix patterns based on a set modulation matrix size and the relative positions of the modulation matrix patterns. These N modulation matrix patterns are then transmitted to the DMD. The beam expander module is positioned in the output optical path of the broadband laser and expands the laser beam to form a laser beam. A target object is positioned in the output optical path of the beam expander module and reflects the laser beam to form a reflected beam. The imaging lens module is positioned in the optical path of the reflected beam. An imaging lens module is used to image the reflected beam to obtain an imaging beam. The DMD is disposed in the output optical path of the imaging lens module. The DMD is used to modulate the imaging beam according to N modulation matrix patterns to obtain N modulation signals. A focusing lens module is disposed in the reflected optical path of the DMD. The focusing lens module is used to focus the N modulation signals to form N focused beams. A spectrometer module is disposed in the transmission optical path of the focusing lens module. The spectrometer module is used to obtain N sets of light intensity information according to the N focused beams. Each set of light intensity information includes light intensity information of multiple spectral bands corresponding to the same focused beam. The computer is used to obtain a broadband image of the target object according to the light intensity information of each spectral band and the N modulation matrix patterns, where N is an integer greater than 1.

[0010] Optionally, the focusing lens module includes: a first focusing lens and a second focusing lens; the first focusing lens is disposed in the optical path of the left reflected beam of the DMD, and the second focusing lens is disposed in the optical path of the right reflected beam of the DMD.

[0011] Optionally, the spectrometer module includes a visible light spectrometer and a near-infrared spectrometer; the visible light spectrometer is disposed in the transmission light path of the first focusing lens, and the near-infrared spectrometer is disposed in the transmission light path of the second focusing lens.

[0012] Optionally, the beam expander module is a transmitting lens.

[0013] Optionally, the imaging lens module is a target lens.

[0014] Optionally, the broadband laser operates in the 450nm to 1700nm band.

[0015] Optionally, the modulation matrix pattern is a Hadamard matrix pattern.

[0016] Optionally, the DMD-based variable field-of-view wide-spectrum correlation imaging system further includes: an optical fiber, through which the focusing lens module is connected to the spectrometer module.

[0017] According to specific embodiments provided by the present invention, the present invention discloses the following technical effects: The present invention employs a spectral correlation imaging method that utilizes the spatial optical coding modulation function of a DMD. By setting the corresponding modulation matrix size and the relative position of the modulation matrix pattern, different modulation matrix patterns are obtained, thereby realizing variable field-of-view wide-spectral correlation imaging under a fixed lens. The same system can obtain wide-spectral images with different fields of view, achieving efficient visible and near-infrared spectral imaging, improving imaging accuracy, and realizing adjustable field-of-view and resolution wide-spectral imaging with only one system, significantly reducing the cost of the imaging system. Attached Figure Description

[0018] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 A schematic diagram of a variable field-of-view wide-spectrum correlation imaging system based on DMD is provided in an embodiment of the present invention;

[0020] Figure 2 A flowchart illustrating the workflow of a DMD-based variable field-of-view wide-spectral correlation imaging system provided in this embodiment of the invention.

[0021] Symbol explanation:

[0022] 1-Computer, 2-Broadband laser, 3-Emitting lens, 4-DMD, 5-Target lens, 6.1-First focusing lens, 6.2-Second focusing lens, 7.1-Visible spectrometer, 7.2-Near-infrared spectrometer, 8-Target object. Detailed Implementation

[0023] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0024] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0025] This invention provides a variable field-of-view wide-spectrum correlation imaging system based on DMD (Digital Micromirror Devices), such as... Figure 1 As shown, it includes:

[0026] The system comprises a computer 1, a broadband laser 2, a beam expander lens module, an imaging lens module, a DMD 4, a focusing lens module, and a spectrometer module. The computer 1 is connected to the broadband laser 2, the DMD 4, and the spectrometer module. The computer 1 controls the broadband laser 2 to emit a broadband laser beam. The computer 1 generates N modulation matrix patterns based on a set modulation matrix size and the relative positions of the modulation matrix patterns, and transmits these N modulation matrix patterns to the DMD 4. The beam expander lens module is positioned in the output optical path of the broadband laser 2 to expand the laser beam and form a laser beam. A target object 8 is positioned in the output optical path of the beam expander lens module to reflect the laser beam and form a reflected beam. The imaging lens module is positioned in the optical path of the reflected beam from the target object 8 to image the reflected beam and obtain an image beam. The DMD 4... 4. A DMD4 is disposed on the output optical path of the imaging lens module. The DMD4 is used to modulate the imaging beam according to the N modulation matrix patterns to obtain N modulation signals. A focusing lens module is disposed on the reflection optical path of the DMD4. The focusing lens module is used to focus the N modulation signals to form N focused beams. A spectrometer module is disposed on the transmission optical path of the focusing lens module. The spectrometer module is used to obtain N sets of light intensity information according to the N focused beams. Each set of light intensity information includes light intensity information of multiple spectral bands corresponding to the same focused beam. Specifically, it receives the focused beam and detects the light intensity and spectral band information of the focused beam. A computer 1 is used to obtain a broadband image of the target object 8 according to the light intensity information of each spectral band and the N modulation matrix patterns. Specifically, it receives the light intensity information of each spectral band and performs correlation calculations between the light intensity information of each spectral band and the modulation matrix patterns to recover the broadband image of the target object 8. N is an integer greater than 1.

[0027] As an optional implementation, the focusing lens module includes: a first focusing lens 6.1 and a second focusing lens 6.2; the first focusing lens 6.1 is disposed in the optical path of the left reflected beam of the DMD4, and the second focusing lens 6.2 is disposed in the optical path of the right reflected beam of the DMD4.

[0028] As an optional implementation, the spectrometer module includes: a visible light spectrometer 7.1 and a near-infrared spectrometer 7.2; the visible light spectrometer 7.1 is disposed in the transmission light path of the first focusing lens 6.1, and the near-infrared spectrometer 7.2 is disposed in the transmission light path of the second focusing lens 6.2, and the modulation signal is reflected to the left and right respectively to the first focusing lens 6.1 and the second focusing lens 6.2.

[0029] As an optional implementation, the beam expander lens module is the transmitting lens 3.

[0030] As an optional implementation, the imaging lens module is a target lens 5, which is used to focus and collect the reflected signal reflected by the target object 8 to obtain the target signal, i.e., the imaging beam. The DMD4 modulates the target signal into a modulation signal.

[0031] As an optional implementation, the broadband laser 2 operates in the 450nm to 1700nm wavelength range.

[0032] As an optional implementation, the modulation matrix pattern is a Hadamard matrix pattern.

[0033] As an optional implementation, the DMD-based variable field-of-view wide-spectrum correlation imaging system further includes: an optical fiber, wherein the focusing lens module is connected to the spectrometer module via the optical fiber for transmitting the focused beam.

[0034] As an optional implementation, the DMD-based variable field-of-view wide-spectrum correlation imaging system operates in the 450nm to 1700nm band.

[0035] like Figure 2 As shown, the working process of the above-mentioned system of the present invention is as follows:

[0036] A computer-controlled broadband laser emits broadband laser light, which is then directed onto the target object through a lens.

[0037] Based on the imaging field of view requirements (imaging field of view and resolution requirements), the size of the modulation matrix in the modulation matrix pattern and the relative position of the modulation matrix pattern are set. The computer generates the corresponding modulation matrix pattern and records N modulation matrix patterns, and loads the modulation matrix pattern into the DMD through a data line.

[0038] DMD acquires the reflected signal of the target object through the target lens and modulates the reflected signal N times, reflecting it to both sides to form N modulated signals respectively. The focusing lens focuses the modulated signals to obtain a focused beam.

[0039] The spectrometer collects the focused beam of light and obtains light intensity information in multiple spectral bands.

[0040] The computer correlates the light intensity information of multiple spectral bands with N modulation matrix patterns to obtain a broadband spectral image of the target object.

[0041] Example: Based on the imaging field of view requirements, the size and relative position of the modulation matrix patterns are set. The computer generates corresponding modulation matrix patterns and records N modulation matrix patterns. Taking an image with 64×64 pixels as an example, when the imaging field of view requirement is at a specific small position and the resolution is high, a modulation matrix pattern at the specified imaging position can be generated, where the modulation matrix size is the size of the corresponding 64×64 micromirror array on the DMD, and the resolution is the maximum resolution of the DMD. When the imaging field of view requirement is large, a modulation matrix pattern at the specified imaging position can be generated, where the modulation matrix size is the size of the corresponding 512×512 micromirror array on the DMD, and the resolution is one-eighth of the maximum resolution of the DMD.

[0042] Advantages: Variable field of view, which can meet the needs of different fields of view and different resolutions through a single optical system, saving space and weight, and greatly reducing system cost.

[0043] Principle: DMD has spatial optical coding modulation function, which can load different modulation matrix patterns. By adjusting the relative position and size of the modulation matrix of the loaded pattern, the field of view and resolution of the imaging system can be changed conveniently and quickly by using the correlation imaging principle.

[0044] The technical problem solved by this invention is:

[0045] By employing a spectral correlation imaging method, combined with high-precision visible light spectrometers and near-infrared spectrometers, low-cost, high-precision visible light spectral imaging and near-infrared spectral imaging of target objects can be achieved simultaneously.

[0046] By utilizing the spatial light coding modulation function of DMD, different modulation matrix patterns can be obtained by flipping the micromirror array by setting the corresponding modulation matrix size and the relative position of the modulation matrix pattern. This enables variable field-of-view broadband correlation imaging under a fixed lens, allowing the same system to obtain broadband images with different fields of view. This achieves efficient visible and near-infrared spectral imaging, realizing broadband imaging with adjustable field of view and resolution with only one system, significantly reducing the cost of the imaging system.

[0047] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0048] This document uses specific examples to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. Furthermore, those skilled in the art will recognize that, based on the ideas of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A variable field-of-view broadband correlation imaging system based on DMD, characterized in that, include: The system comprises a computer, a broadband laser, a beam expander module, an imaging lens module, a digital depth sensor (DMD), a focusing lens module, and a spectrometer module. The computer is connected to the broadband laser, the DMD, and the spectrometer module. The computer controls the broadband laser to emit laser light and generates N modulation matrix patterns based on a set modulation matrix size and the relative positions of the modulation matrix patterns. These N modulation matrix patterns are then transmitted to the DMD. The beam expander module is positioned in the output optical path of the broadband laser and expands the laser beam to form a laser beam. A target object is positioned in the output optical path of the beam expander module and reflects the laser beam to form a reflected beam. The imaging lens module is positioned in the optical path of the reflected beam. An imaging lens module is used to image the reflected beam to obtain an imaging beam. The DMD is disposed in the output optical path of the imaging lens module. The DMD is used to modulate the imaging beam according to N modulation matrix patterns to obtain N modulation signals. A focusing lens module is disposed in the reflected optical path of the DMD. The focusing lens module is used to focus the N modulation signals to form N focused beams. A spectrometer module is disposed in the transmission optical path of the focusing lens module. The spectrometer module is used to obtain N sets of light intensity information according to the N focused beams. Each set of light intensity information includes light intensity information of multiple spectral bands corresponding to the same focused beam. The computer is used to obtain a broadband image of the target object according to the light intensity information of each spectral band and the N modulation matrix patterns, where N is an integer greater than 1. The focusing lens module includes: a first focusing lens and a second focusing lens; the first focusing lens is disposed in the optical path of the left reflected beam of the DMD, and the second focusing lens is disposed in the optical path of the right reflected beam of the DMD; the spectrometer module includes: a visible light spectrometer and a near-infrared spectrometer; the visible light spectrometer is disposed in the transmission optical path of the first focusing lens, and the near-infrared spectrometer is disposed in the transmission optical path of the second focusing lens.

2. The variable field-of-view wide-spectral correlation imaging system based on DMD according to claim 1, characterized in that, The beam expander lens module is a transmitting lens.

3. The variable field-of-view wide-spectral correlation imaging system based on DMD according to claim 1, characterized in that, The imaging lens module is the target lens.

4. The variable field-of-view wide-spectral correlation imaging system based on DMD according to claim 1, characterized in that, The broadband laser operates in the 450nm–1700nm band.

5. A variable field-of-view wide-spectral correlation imaging system based on DMD according to claim 1, characterized in that, The modulation matrix pattern is a Hadamard matrix pattern.

6. A variable field-of-view wide-spectral correlation imaging system based on DMD according to claim 1, characterized in that, Also includes: The focusing lens module is connected to the spectrometer module via an optical fiber.

Citation Information

Patent Citations

  • DMD-based multi-target imaging spectrum system and method

    CN110567581A

  • Compressed sensing-based dynamic double-arm multichannel staring spectral imaging system

    CN110632000A