Snapshot spectrum camera device and method

Abstract

The invention relates to the technical field of photoelectronic imaging, in particular to a snapshot spectrum camera shooting device and method.The device comprises an imaging modulation device, an acquisition device and a computing device.The imaging modulation device comprises an imaging lens, an optical filter array and a spatial modulation device; the optical modulator is configured to generate an optical signal with modulation at an image plane position of an imaging lens; the acquisition device comprises a two-dimensional image detector configured to convert an optical signal into image data and / or video data to generate a measurement image and / or a measurement video; and the computing equipment is connected with the acquisition equipment, and is configured to read and store the measurement image and / or the measurement video from the acquisition equipment, and invert the spectral image and / or the spectral video of the target scene from the measurement image and / or the measurement video. Therefore, the problems of difficulty in improving the spatial resolution, high cost and the like caused by exponential increase of on-chip encoder device cost and process complexity when pursuing higher spatial resolution in related technologies are solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of photoelectric imaging, and in particular to a snapshot spectral camera device and method. BACKGROUND

[0002] In the field of photoelectric imaging, with the increasing demand for analyzing the intrinsic properties of target objects, imaging technology has gradually upgraded. RGB (Red, Green, Blue) imaging technology can only obtain three-channel spectral information, while spectral imaging technology can obtain continuous narrow-band spectral information, enabling accurate analysis and quantitative characterization of the chemical composition and material composition of objects.

[0003] In related technologies, although a spectral imaging system can obtain multispectral information, there are inherent constraints on performance parameters such as spatial resolution, spectral resolution, and imaging rate. Optimizing one requires sacrificing others, and the complex imaging light path results in a large imaging system volume. Computational spectral imaging technology breaks through the performance limit through an "optical coding - software decoding" architecture. Its representative scheme, the coded aperture snapshot spectral imaging system, uses a combination of coded apertures and dispersive prisms to randomly code and modulate incident spectral images. At the same time, micro-nano processing technology also realizes pixel-level integration of on-chip coding devices, significantly reducing the volume of the imaging system.

[0004] However, in related technologies, when pursuing higher spatial resolution, the manufacturing cost and process complexity of on-chip coding devices increase exponentially, not only making it difficult to improve spatial resolution, but also resulting in high manufacturing costs, ultimately restricting the promotion of miniaturized scenarios, which needs to be urgently addressed. SUMMARY

[0005] The present application provides a snapshot spectral camera device and method to solve the problems of related technologies, such as difficulty in improving spatial resolution and high manufacturing cost.

[0006] The first aspect of the present application provides a snapshot spectral camera device, comprising an imaging modulation device, a collection device, and a computing device. The imaging modulation device includes an imaging lens, a filter array, and a spatial modulation device to generate a modulated light signal at the image plane position of the imaging lens. The collection device includes a two-dimensional image detector to convert the light signal into image data and / or video data to generate measurement images and / or measurement videos. The computing device is connected to the collection device to read and store the measurement images and / or measurement videos from the collection device, and to inverse the spectral images and / or spectral videos of the target scene from the measurement images and / or measurement videos.

[0007] By means of the above technical means, the embodiment of the present application can adopt a basic imaging lens, a filter array and a spatial modulation device, without complex micro-nano processing or high-end customized devices, greatly reducing the manufacturing cost, and can generate a modulated light signal at the image plane position of the imaging lens, reducing the loss of light signal information, cooperating with the inversion algorithm, effectively improving the spatial resolution of the spectral imaging system, and at the same time, completing light collection, modulation, data conversion and inversion in a single time, realizing snapshot imaging.

[0008] Optionally, in an embodiment of the present application, the imaging lens is composed of at least one glass or plastic lens to collect light rays of different angles emitted by the same point in the target scene and converge at the same point on the image plane; the filter array is composed of at least four filters spliced, each filter being arranged at a corresponding position of the imaging lens; and the spatial modulation device is a two-dimensional array device with a light-shielding pattern, which is arranged at a target position of the image plane of the imaging lens to spatially modulate the light rays of different angles according to spatial positions.

[0009] By means of the above technical means, the embodiment of the present application can accurately converge light rays through the imaging lens, ensure that the target space details are clearly imaged on the image plane, lay a foundation for high spatial resolution, and adopt a spliced filter array and a two-dimensional array device with a light-shielding pattern, avoiding complex on-chip coding processes, being easier to realize miniaturized design, having lower manufacturing cost, and being suitable for miniaturized application scenarios.

[0010] Optionally, in an embodiment of the present application, each filter has a different spectral transmittance to modulate the light rays of different angles in the spectrum.

[0011] By means of the above technical means, the embodiment of the present application can directly associate the light angle information with the specific spectral information through the difference in the transmittance of the filters, providing key data support for subsequent inversion of high-resolution spectral images.

[0012] Optionally, in an embodiment of the present application, the filter array can be arranged at the aperture stop plane of the imaging lens to make the light signal completely cover the filter array.

[0013] By means of the above technical means, the embodiment of the present application can arrange the filter array at the aperture stop plane to ensure that all incident light rays pass through the filters, avoiding the omission of spectral information from the source, and significantly improving the accuracy of spectral modulation.

[0014] Optionally, in an embodiment of the present application, the spatial modulation device can be a fixed pattern mask and an electrically controlled variable pattern spatial light modulator.

[0015] Through the above technical means, the spatial modulation device can be configured as a fixed pattern mask and an electrically controllable variable pattern spatial light modulator. For a conventional fixed scene, only the fixed pattern mask is enabled, without complex electrical control, reducing power consumption and operation difficulty, and relying on the stability of the fixed pattern to ensure long-term modulation accuracy. For a dynamic and variable scene, the electrically controllable variable pattern spatial light modulator can be used to adjust the pattern in real time, achieving a balance between modulation stability and scene adaptability.

[0016] Optionally, in an embodiment of the present application, the two-dimensional image detector can be arranged at the image plane position.

[0017] Through the above technical means, the light signal can be collected at the image plane, thereby avoiding defocus blur and completely capturing the spatial details of the object, to ensure the resolution and detail accuracy of the measurement image or video, meeting the precise measurement requirement.

[0018] The second aspect embodiment of the present application provides a snapshot spectral imaging method, including the following steps: controlling a single point source in the target scene to emit light rays of different angles and transmit to different spatial regions of the imaging lens; performing spectral modulation on the light rays of different angles through the filter array, and performing spatial modulation on the light rays of different angles by using the spatial modulation device, to obtain modulated light rays of different angles; converging the modulated light rays of different angles to the same position of the image plane, to generate the modulated light signal at the image plane position of the imaging lens, to be received by the corresponding pixels on the acquisition device; converting the modulated light signal into the image data and / or the video data by the acquisition device, to generate the measurement image and / or measurement video; reading and storing the measurement image and / or measurement video by using the computing device, and inverting the spectral image and / or spectral video of the target scene.

[0019] Through the above technical means, the embodiment of the present application can use a basic imaging lens, a filter array and a spatial modulation device, without complex micro-nano processing or high-end customized devices, greatly reducing the manufacturing cost, and can generate a modulated light signal at the image plane position of the imaging lens, reducing the loss of light signal information, cooperating with the inversion algorithm, effectively improving the spatial resolution of the spectral imaging system, and at the same time, completing the light collection, modulation, data conversion and inversion at a time, realizing snapshot imaging.

[0020] The third aspect embodiment of the present application provides an electronic device, including a memory, a processor and a computer program stored on the memory and executable on the processor, and the processor executes the program to realize the snapshot spectral imaging method as described in the above embodiments.

[0021] The fourth aspect of the present application provides a computer readable storage medium storing a computer program, which is executed by a processor to implement the snapshot spectral imaging method.

[0022] The fifth aspect of the present application provides a computer program, which includes a computer program executed to implement the snapshot spectral imaging method.

[0023] The snapshot spectral imaging device of the embodiments of the present application can generate a modulated light signal at the image plane position of the imaging lens based on the imaging modulation device, and then convert the light signal into image data or video data based on the acquisition device to generate a measurement image or a measurement video, so as to read and store the measurement image or the measurement video based on the acquisition device to inverse the spectral image or the spectral video of the target scene, complete the snapshot spectral imaging, only use the basic imaging lens, the filter array and the spatial modulation device, without complex micro-nano processing or high-end customized devices, greatly reduce the manufacturing cost, and reduce the loss of light signal information by generating the modulated light signal at the image plane position of the imaging lens, cooperate with the inversion algorithm, effectively improve the spatial resolution of the spectral imaging system, and at the same time complete the light collection, modulation, data conversion and inversion in a single time, realize the snapshot imaging. Thus, the problems of exponential growth of the cost and process complexity of the on-chip coding device when pursuing higher spatial resolution in the related art are solved, and the problems of difficult improvement of the spatial resolution and high cost are solved.

[0024] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0025] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, including the accompanying drawings, wherein: Figure 1 A block schematic diagram of a snapshot spectral imaging device according to an embodiment of the present application is provided; Figure 2 A flowchart of a snapshot spectral imaging method according to an embodiment of the present application is provided; Figure 3 A structural schematic diagram of an electronic device according to an embodiment of the present application is provided.

[0026] REFERENCE NUMERALS 10-snapshot spectral imaging device; 100-imaging modulation device, 200-acquisition device, 300-computing device; 301-memory, 302-processor, 303-communication interface. DETAILED DESCRIPTION

[0027] Embodiments of the present application are described below in detail, examples of which are shown in the accompanying drawings, wherein the same or similar notations represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by reference to the drawings are exemplary and are intended to explain the present application, and cannot be understood as a limitation of the present application.

[0028] A snapshot spectral imaging device and method of embodiments of the present application are described below with reference to the accompanying drawings. In view of the problems of difficult improvement of spatial resolution and high manufacturing cost of related technologies mentioned in the above background, the present application provides a snapshot spectral imaging device, in which a modulated light signal can be generated at the image plane position of an imaging lens based on an imaging modulation device, and then the light signal is converted into image data or video data based on an acquisition device to generate a measurement image or a measurement video, so that the measurement image or the measurement video is read and stored based on the acquisition device to inverse a spectral image or a spectral video of a target scene, to complete snapshot spectral imaging. Only a basic imaging lens, a filter array and a spatial modulation device are used without complex micro-nano processing or high-end customized devices, which greatly reduces the manufacturing cost, and by generating a modulated light signal at the image plane position of the imaging lens, the loss of light signal information is reduced, and the spatial resolution of the spectral imaging system is effectively improved by cooperating with the inversion algorithm. At the same time, light collection, modulation, data conversion and inversion are completed at a time to realize snapshot imaging. Thus, the problems of exponential growth of on-chip encoder cost and process complexity when higher spatial resolution is pursued in related technologies, resulting in difficult improvement of spatial resolution and high cost, are solved.

[0029] Specifically, Figure 1 A block schematic diagram of the snapshot spectral imaging device provided according to embodiments of the present application is shown.

[0030] As Figure 1 shown, the snapshot spectral imaging device 10 can include an imaging modulation device 100, an acquisition device 200 and a computing device 300.

[0031] The imaging modulation device 100 includes an imaging lens, a filter array and a spatial modulation device to generate a modulated light signal at the image plane position of the imaging lens. Further, the modulated light signal can be understood as a light signal processed by the imaging modulation device (such as the filter array and the spatial modulation device) and endowed with spectral information (such as specific wavelength transmission) and spatial information (such as specific position light intensity control) of a target scene, which can be used for subsequent conversion and inversion.

[0032] Specifically, in one embodiment of the present application, the imaging lens is composed of at least one glass or plastic lens to collect different angles of light emitted by the same point in the target scene and converge at the same point on the image plane; the filter array is composed of at least four filters spliced, each filter is arranged at the corresponding position of the imaging lens; the spatial modulation device is a two-dimensional array device with a light shielding pattern, which is arranged at the target position of the image plane of the imaging lens to modulate the light of different angles according to the spatial position.

[0033] It should be noted that the target position of the image plane refers to the position adjacent to the image plane, which can be flexibly adjusted according to the size of the pixel, the setting of the lens, etc., and the specific target position can be set by a person skilled in the art according to the actual situation, which is not limited in the present application.

[0034] It can be understood that the image plane is a specific plane where the optical system converges the light of external objects through refraction or reflection to form a clear and in-focus object real image, which is the key position of the conjugate space position of the object and the image. Collecting light signals on the image plane can obtain high-fidelity images, which is the core reference surface of optical imaging and accurate light signal conversion.

[0035] In addition, spatial modulation can be understood as regular regulation of light characteristics (such as intensity, transmittance, phase, etc.) in spatial dimension (different positions or regions) through spatial modulation devices, etc., to encode specific spatial information into light signals, so that the light carries the spatial distribution characteristics of the target, providing a basis for subsequent inversion.

[0036] In an embodiment of the present application, the imaging lens can utilize the optical refraction characteristics of glass or plastic lenses to collect different angles of light emitted by the same point in the target scene, and converge these light rays to the same point on the image plane through the optical path design of the lens group, ensuring the accurate imaging of the target spatial information on the image plane, and providing a stable spatial reference for subsequent modulation.

[0037] In addition, the filter can be understood as any device that can select or modulate the spectrum of incident light, and its type can include but is not limited to related absorption, interference, and reflection filters, and can also include but is not limited to optical devices with the same or similar functions based on any emerging materials (such as quantum dots) and micro-nano structures (such as superstructures and photonic crystals). The filter array can selectively transmit light of different wavelengths, breaking through the three-channel limitation of traditional RGB, realizing the spectral dimension separation of incident light, and preliminarily obtaining multispectral information. The shape of each filter includes but is not limited to rectangle, sector, polygon, which can be arranged inside the imaging lens or outside the imaging lens, which is not limited in the present application.

[0038] Further, the spatial modulation device has a binary modulation or grayscale modulation function, and can perform spatial coding on the light signal after the light filter array according to the spatial distribution of the light shielding pattern (such as selectively shielding or transmitting light rays at different spatial positions and different angles), so that the light rays carry information such as spatial position and spectral band, to generate a modulated light signal at the image plane of the imaging lens.

[0039] The embodiment of the present application can precisely converge light rays through the imaging lens, ensure that the details of the target space are clearly imaged at the image plane, lay a foundation for high spatial resolution, and use a spliced light filter array and a two-dimensional array device with a light shielding pattern, which avoids complex on-chip coding processes, is easier to realize miniaturization design, has lower manufacturing cost, and is suitable for miniaturized application scenarios.

[0040] Further, in an embodiment of the present application, each light filter has a different spectral transmittance to modulate the spectrum of light rays at different angles.

[0041] It can be understood that spectral modulation can be understood as regularly regulating the spectral characteristics (such as wavelength) of light rays through a light filter or the like, encoding specific spectral information into light signals, so that the light rays carry the spectral information of the target, providing a basis for subsequent inversion.

[0042] It should be noted that each light filter only allows light rays of a specific wavelength range to pass through, and blocks light rays of other wavelengths. For example, light filter A only transmits 450-500 nm blue light, and light filter B only transmits 550-600 nm green light. The transmission wavelengths of different light filters do not overlap or are distributed in a specific pattern. The spectral transmittance of the light filter can be set by a person skilled in the art according to the actual situation, and the present application does not make specific limitations.

[0043] In the embodiment of the present application, since the light filter corresponds to a specific area of the imaging lens, different areas of the imaging lens will collect light rays of different angles emitted by the same point of the target scene, such as the edge area of the lens collecting large-angle light rays and the center area collecting small-angle light rays. Therefore, different angles of light rays will accurately enter the corresponding light filter.

[0044] Further, when light rays of different angles enter light filters with different spectral transmittances, the light filters will perform wavelength screening on the received light rays, only retaining the wavelength components within the transmittance curve range of the light filter, and eliminating other wavelength components, so that light rays of different angles carry different spectral characteristics, and the spectral modulation of light rays of different angles is completed.

[0045] The embodiment of the present application can directly associate the angle information of the light rays with the specific spectral information through the difference in the transmittance of the light filter, to provide key data support for subsequent inversion of high-resolution spectral images.

[0046] Optionally, in an embodiment of the present application, the filter array can be arranged at the aperture stop plane of the imaging lens so that the light signal completely covers the filter array.

[0047] In an embodiment of the present application, the aperture stop plane can be understood as a key plane in an optical system (such as an imaging lens) that controls the total amount of incident light and defines the passing range of light, and is a necessary passage for all light entering the system, and is used to determine the angle and amount of light entering the system by the aperture size and position, and is directly related to the light amount, depth of field and optical resolution of imaging.

[0048] In some embodiments, since the aperture stop plane is the only way for all incident light, the filter array can directly intercept all incident light at this position, avoiding the bypass of light due to angle deviation or position deviation, and fundamentally realizing the complete coverage of the filter array by the light signal.

[0049] Embodiments of the present application can arrange the filter array at the aperture stop plane to ensure that all incident light passes through the filter, avoiding the omission of spectral information from the source, and significantly improving the accuracy of spectral modulation.

[0050] Optionally, in an embodiment of the present application, the spatial modulation device can be but not limited to a fixed pattern mask and an electrically controllable variable pattern spatial light modulator.

[0051] In an embodiment of the present application, the fixed pattern mask can be understood as a two-dimensional array device (such as a transparent substrate etched with a fixed light-shielding or light-transmitting pattern) whose physical structure cannot be dynamically changed, which performs fixed spatial modulation on light by physical interception, and the pattern does not change after manufacturing, and the characteristics are stable, non-electrically controlled, and low cost.

[0052] In addition, the electrically controllable variable pattern spatial light modulator can be understood as a pixelated electrically controllable device (such as liquid crystal), which can adjust the light-transmitting or light-shielding state in real time through electrical signals, realize dynamic and programmable spatial modulation, and the characteristics are flexible adaptation to scenarios and do not need to replace hardware.

[0053] In some cases, the fixed pattern mask and the electrically controllable variable pattern spatial light modulator are both arranged at the target position of the image plane of the imaging lens, and together complete the spatial modulation of light to generate a modulated light signal at the image plane position of the imaging lens.

[0054] The embodiment of the present application can configure the spatial modulation device as a fixed pattern mask and an electrically controllable variable pattern spatial light modulator. For a conventional fixed scene, only the fixed pattern mask is enabled, without complex electrical control, reducing power consumption and operation difficulty, while relying on the stability of the fixed pattern to ensure long-term modulation accuracy. For a dynamic and variable scene, the electrically controllable variable pattern spatial light modulator can be used to adjust the pattern in real time, achieving a balance between modulation stability and scene adaptability.

[0055] The acquisition device 200 includes a two-dimensional image detector to convert the light signal into image data and / or video data to generate a measurement image and / or a measurement video. The two-dimensional image detector can be arranged at an image plane position.

[0056] In the embodiment of the present application, the two-dimensional image detector is arranged at the image plane, which can directly acquire the light signal processed by the optical system and the spatial modulation device, and then convert the light signal into image data or video data through the circuit to generate a measurement image or a measurement video.

[0057] The embodiment of the present application can acquire the light signal at the image plane, thereby avoiding defocus blur and completely capturing the spatial details of the object to ensure the resolution and detail accuracy of the measurement image or video, meeting the requirement of accurate measurement.

[0058] The computing device 300 is connected to the acquisition device 200 to read and store the measurement image and / or the measurement video from the acquisition device 200, and to inverse the spectral image and / or the spectral video of the target scene from the measurement image and / or the measurement video.

[0059] In some embodiments, the measurement image or the measurement video output by the acquisition device 200 is essentially hybrid encoded data of spatial information and spectral information. After the computing device 300 is connected to the acquisition device 200, the hybrid data is first read and stored, and then a specific inversion algorithm (such as a model-driven numerical inversion algorithm or a data-driven deep learning inversion algorithm) is used to disassemble the hybrid encoded measurement image or measurement video based on the preset correspondence between encoding and decoding, and finally the spectral image or the spectral video of the target scene is obtained.

[0060] The embodiment of the present application can inverse the spectral image or the spectral video of the target scene from the measurement image or the measurement video, which can identify the object through spectral characteristics, further reveal the nature of the substance, expand the analysis dimension of the data, and reduce the error based on the known modulation mode to establish a mathematical model, meeting the requirement of high-precision measurement.

[0061] The working principle of the snapshot spectral camera device proposed in the present application will be described in detail below in combination with a specific embodiment.

[0062] In the embodiments of this application, the imaging lens collects light from different angles of the target scene, the filter array modulates the light from different angles to filter specific wavelengths of light, and then the spatial modulation device modulates the light from different angles to make the light carry spatial distribution characteristics, thereby generating a modulated light signal containing both spatial and spectral information on the image plane of the imaging lens.

[0063] Subsequently, a two-dimensional image detector is placed on the image plane of the imaging lens, which can directly acquire the light signal that has been modulated by the filter array and spatial modulation device, and then convert the light signal into image data or video data through the circuit to generate a measurement image or measurement video.

[0064] Furthermore, the acquisition device reads and stores the measurement images or videos, runs a model-driven numerical inversion algorithm, decomposes the mixed-encoded measurement images or videos, and finally obtains the spectral images or spectral videos of the target scene.

[0065] The snapshot spectral imaging device proposed in this application can generate a modulated light signal at the image plane position of the imaging lens based on an imaging modulation device. Then, based on a data acquisition device, the light signal is converted into image data or video data to generate a measurement image or measurement video. The measurement image or measurement video is then read and stored by the data acquisition device to retrieve the spectral image or spectral video of the target scene, thus completing snapshot spectral imaging. It only uses a basic imaging lens, filter array, and spatial modulation device, eliminating the need for complex micro / nano fabrication or high-end custom components, significantly reducing manufacturing costs. Furthermore, by generating a modulated light signal at the image plane position of the imaging lens, it reduces light signal information loss. Combined with the inversion algorithm, it effectively improves the spatial resolution of the spectral imaging system. Simultaneously, it completes light acquisition, modulation, data conversion, and inversion in a single operation, achieving snapshot imaging. Therefore, it solves the problems in related technologies where the pursuit of higher spatial resolution leads to an exponential increase in the cost and process complexity of on-chip coding devices, resulting in difficulty in improving spatial resolution and high costs.

[0066] Next, the snapshot spectral imaging method proposed according to the embodiments of this application is described with reference to the accompanying drawings.

[0067] Figure 2 This is a flowchart of a snapshot spectral imaging method provided according to an embodiment of this application.

[0068] like Figure 2 As shown, this snapshot spectral imaging method utilizes the snapshot spectral device of the above embodiment and includes the following steps: In step S201, a single point source in the target scene is controlled to emit light at different angles and transmit it to different spatial areas of the imaging lens.

[0069] In step S202, light rays at different angles are spectrally modulated by a filter array and spatially modulated by a spatial modulation device to obtain modulated light rays at different angles.

[0070] In step S203, the modulated light rays at different angles are converged to the same position on the image plane to generate a modulated light signal at the image plane position of the imaging lens, which is then received by the corresponding pixel on the acquisition device.

[0071] In step S204, the modulated optical signal is converted into image data and / or video data by the acquisition device to generate measurement images and / or measurement videos.

[0072] In step S205, the measurement images and / or measurement videos are read and stored using a computing device, and the spectral images and / or spectral videos of the target scene are retrieved.

[0073] It should be noted that the foregoing explanation of the snapshot spectral imaging device embodiment also applies to the snapshot spectral imaging method of this embodiment, and will not be repeated here.

[0074] The snapshot spectral imaging method proposed in this application generates a modulated light signal at the image plane of the imaging lens, and then converts the light signal into image data or video data to generate a measurement image or measurement video. The measurement image or measurement video is then read and stored to retrieve the spectral image or spectral video of the target scene, completing snapshot spectral imaging. This method uses only a basic imaging lens, filter array, and spatial modulation device, eliminating the need for complex micro / nano fabrication or high-end custom devices, significantly reducing manufacturing costs. Furthermore, by generating a modulated light signal at the image plane of the imaging lens, information loss of the light signal is reduced. Combined with the inversion algorithm, this effectively improves the spatial resolution of the spectral imaging system. Simultaneously, it completes light acquisition, modulation, data conversion, and inversion in a single operation, achieving snapshot imaging. Therefore, it solves the problems in related technologies where the pursuit of higher spatial resolution leads to an exponential increase in the cost and process complexity of on-chip encoding devices, resulting in difficulty in improving spatial resolution and high costs.

[0075] Figure 3 This is a schematic diagram of the structure of an electronic device provided according to an embodiment of this application. The electronic device may include: The memory 301, the processor 302, and the computer program stored on the memory 301 and capable of running on the processor 302.

[0076] When the processor 302 executes the program, it implements the snapshot spectral imaging method provided in the above embodiments.

[0077] Furthermore, electronic devices also include: Communication interface 303 is used for communication between memory 301 and processor 302.

[0078] The memory 301 is used to store computer programs that can run on the processor 302.

[0079] The memory 301 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0080] If the memory 301, processor 302, and communication interface 303 are implemented independently, then the communication interface 303, memory 301, and processor 302 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, Figure 3 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0081] Optionally, in a specific implementation, if the memory 301, processor 302, and communication interface 303 are integrated on a single chip, then the memory 301, processor 302, and communication interface 303 can communicate with each other through an internal interface.

[0082] Processor 302 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0083] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the snapshot spectral imaging method described above.

[0084] This application also provides a computer program, which, when executed, implements the snapshot spectral imaging method described above.

[0085] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0086] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0087] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0088] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0089] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, it can be implemented using any one or more of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0090] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0091] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0092] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A snapshot spectral imaging device, characterized in that, include: An imaging modulation device, comprising an imaging lens, a filter array, and a spatial modulation device, for generating a modulated optical signal at the image plane position of the imaging lens; The acquisition device includes a two-dimensional image detector to convert the optical signal into image data and / or video data to generate a measurement image and / or measurement video; A computing device connected to the acquisition device to read and store the measurement images and / or measurement videos from the acquisition device, and to deduce the spectral images and / or spectral videos of the target scene from the measurement images and / or measurement videos.

2. The snapshot spectral imaging device according to claim 1, characterized in that, in, The imaging lens is composed of at least one glass or plastic lens to collect light rays emitted from the same point in the target scene at different angles and converge them to the same point on the image plane. The filter array is composed of at least four types of filters spliced ​​together, with each filter positioned at a corresponding position on the imaging lens; The spatial modulation device is a two-dimensional array device with a light-shielding pattern. The two-dimensional array device is disposed at the target position on the image plane of the imaging lens to spatially modulate the light at different angles according to the spatial position.

3. The snapshot spectral imaging device according to claim 2, characterized in that, Each filter has a different spectral transmittance to spectrally modulate light at different angles.

4. The snapshot spectral imaging device according to claim 2 or 3, characterized in that, The filter array is disposed on the aperture stop plane of the imaging lens so that the light signal completely covers the filter array.

5. The snapshot spectral imaging device according to claim 2, characterized in that, The spatial modulation device is a spatial light modulator with a fixed pattern mask and an electrically controlled variable pattern.

6. The snapshot spectral imaging device according to claim 1, characterized in that, The two-dimensional image detector is positioned at the image plane location.

7. A snapshot spectral imaging method, characterized in that, Using the snapshot spectral imaging device as described in any one of claims 1-6, wherein the method comprises the following steps: Control a single point source in the target scene to emit light at different angles and transmit it to different spatial areas of the imaging lens; The light rays at different angles are spectrally modulated by the filter array and spatially modulated by the spatial modulation device to obtain modulated light rays at different angles. The modulated light rays at different angles are converged to the same position on the image plane to generate the modulated light signal at the image plane position of the imaging lens, so that it can be received by the corresponding pixel on the acquisition device. The acquisition device converts the modulated optical signal into image data and / or video data to generate the measurement image and / or measurement video. The computing device is used to read and store the measured images and / or measured videos, and to deduce the spectral images and / or spectral videos of the target scene.

8. An electronic device, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the program to implement the snapshot spectral imaging method as described in claim 7.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the snapshot spectral imaging method as described in claim 7.

10. A computer program product, comprising a computer program, characterized in that, The computer program is executed to implement the snapshot spectral imaging method as described in claim 7.

Images