High-resolution spectral imaging system and method for video frame rate

Abstract

The invention relates to the technical field of photoelectric imaging, in particular to a high-resolution spectral imaging system and method for a video frame rate, and the system comprises optical path equipment which is used for transmitting an optical signal of a target scene; the array acquisition group comprises at least two image acquisition devices, a miniature filtering structure array is arranged in a photoreceptor of at least one image acquisition device, and the array acquisition group is connected with the light path device and used for receiving light signals transmitted by the array light path device and converting the light signals into an image data group, the image data set comprises a first digital image or video and a second digital image or video; and the imaging equipment is connected with the array acquisition group and is used for carrying out inversion calculation on the image data group to generate a spectral image or a spectral video of the target scene. Therefore, the problems that an existing spectral imaging system is large in size and difficult to apply to a small platform, the spatial resolution is still reduced, and the optical coding detection amount of a single camera is insufficient are solved.

Description

Technical Field

[0001] The present invention relates to the field of optoelectronic imaging technology, and in particular to a high-resolution spectral imaging system and method at a video frame rate. Background Art

[0002] Images captured in RGB color format are familiar to the human visual system, but at the same time they also lose most of the characteristic information of the target scene in the spectral dimension. Spectral imaging technology can record the transmission or reflection response of the target scene in different spectral bands, thereby further revealing the physical and chemical properties that are difficult to capture with RGB images, such as the material, type and other mid- and high-level attribute characteristics of the target object.

[0003] The core difficulty of spectral imaging technology is that it is difficult to balance spatial resolution, spectral resolution, temporal resolution, and system portability. Early technical solutions used scanning imaging, which sacrificed temporal resolution, making it difficult to complete spectral imaging at video frame rates, and the system size was relatively large. With the development of information technology, computational spectral imaging technology based on the "optical encoding-computational decoding" architecture has been proposed, which can achieve a good performance balance between spatial resolution, spectral resolution, and temporal resolution. In the early stages of the development of computational spectral imaging technology, the corresponding system size was large and the structure was relatively complex. Since the development of this technology, a technical solution with a size similar to that of ordinary RGB image acquisition equipment has been formed, such as spectral imaging chips, equipment, and spectral imaging methods. However, this type of solution still faces the problems of reduced spatial resolution and insufficient optical coding detection of single image acquisition equipment. There are also computational spectral imaging solutions that use dual-image acquisition equipment or multi-image acquisition equipment structures, such as dual-camera design for coded aperture snapshot spectral imaging. The system structure of such solutions is still relatively large and complex, which hinders the application of spectral imaging technology on small platforms. Summary of the invention

[0004] The present invention provides a high-resolution spectral imaging system and method with a video frame rate, so as to solve the problems that the existing computational spectral imaging system is large in size and difficult to be applied to a small platform, and still faces the problems of reduced spatial resolution and insufficient optical encoding detection of a single camera.

[0005] A first aspect of the present invention provides a high-resolution spectral imaging system with a video frame rate, comprising: an optical path device, the optical path device is used to transmit an optical signal of a target scene; an array acquisition group, the array acquisition group includes at least two image acquisition devices, and a photoreceptor of at least one image acquisition device is provided with a micro-filter structure array, the array acquisition group is connected to the optical path device, and is used to receive the optical signal transmitted by the optical path device and convert the optical signal into an image data group, wherein the image data group includes a first digital image or video and a second digital image or video; an imaging device, the imaging device is connected to the array acquisition group, and is used to perform inversion calculation on the image data group to generate a spectral image or spectral video of the target scene.

[0006] Optionally, the optical path device includes: at least one lens for acquiring the optical signal of the target scene.

[0007] Optionally, the optical path device further includes:

[0008] A light splitting device is connected to each lens and is used to distribute the optical signal to each image acquisition device in the array acquisition group.

[0009] Optionally, the array acquisition group includes:

[0010] At least one multi-spectral image acquisition device, wherein the photoreceptor of the at least one multi-spectral image acquisition device is provided with a micro-filter structure array for imaging the light signal according to different spectral transmittance curves to obtain the first digital image or video;

[0011] At least one color image acquisition device is used to image the light signal through at most four spectral bands to obtain the second digital image or video.

[0012] Optionally, the micro-filter structure array includes at least four filter structures, and each filter structure has a different spectral transmittance curve.

[0013] Optionally, the micro-filter structure array is arranged periodically on a spatial scale.

[0014] Optionally, each image acquisition device in the array acquisition group has a spectral detection range with an overlap greater than or equal to 50%.

[0015] Optionally, each image acquisition device of the array acquisition group faces the same target in the target environment, and each image acquisition device is connected to the at least one lens.

[0016] Optionally, each image acquisition device of the array acquisition group faces the light splitting device, and each image acquisition device is connected to the at least one lens.

[0017] Optionally, each image acquisition device of the array acquisition group faces the light splitting device, and the light splitting device is connected to the at least one lens.

[0018] Optionally, the array acquisition group is connected to the optical path device via a preset mechanical structure, wherein the preset mechanical structure includes a housing structure, an adjustment component and / or a detachable connection component.

[0019] Optionally, an artificial neural network or a numerical algorithm is loaded in the imaging device to perform inversion calculation on the image data set through the artificial neural network or the numerical algorithm to generate a spectral image or spectral video of the target scene.

[0020] A second aspect of the present invention provides a high-resolution spectral imaging method at a video frame rate, comprising the following steps: adjusting the position of an optical path device to transmit an optical signal of a target scene to an array acquisition group; converting the optical signal into an image data group through the array acquisition group; and performing inversion calculations on the image data group using the imaging device to generate a spectral image or spectral video of the target scene.

[0021] A third aspect of the present invention provides an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement a high-resolution spectral imaging method at a video frame rate as described in the above embodiment.

[0022] A fourth aspect of the present invention provides a computer program product, which, when executed by a processor, implements the high-resolution spectral imaging method at the video frame rate as described above.

[0023] A fifth aspect of the present invention provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the high-resolution spectral imaging method at the video frame rate as described above.

[0024] The high-resolution spectral imaging system and method at video frame rate proposed in the embodiments of the present invention have a simple and compact structure, can effectively acquire the target scene light signal, can realize high-resolution spectral reconstruction at video frame rate through inversion calculation, and can be adapted to various carriers such as drones and unmanned vehicles.

[0025] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0027] Figure 1 A block diagram of a high-resolution spectral imaging system with a video frame rate provided by an embodiment of the present invention;

[0028] Figure 2 A schematic diagram of a high-resolution spectral imaging system with a video frame rate using a dual-camera structure provided by an embodiment of the present invention;

[0029] Figure 3 A schematic diagram of a micro-filter structure array when a dual-camera structure is used according to an embodiment of the present invention;

[0030] Figure 4 A block diagram of another high-resolution spectral imaging system with a video frame rate provided by an embodiment of the present invention;

[0031] Figure 5 A schematic diagram of a high-resolution spectral imaging system with a video frame rate using a three-camera structure provided by an embodiment of the present invention;

[0032] Figure 6 A schematic diagram of a micro-filter structure array when a three-camera structure is adopted according to an embodiment of the present invention;

[0033] Figure 7 A flowchart of a high-resolution spectral imaging method at a video frame rate provided by an embodiment of the present invention;

[0034] Figure 8 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention.

[0035] Description of reference numerals:

[0036] 10-high-resolution spectral imaging system with video frame rate, 101-optical path equipment, 1011-at least one lens, 1012-spectrometric device, 102-array acquisition group, 1021 and 1023-at least one multi-spectral image acquisition device, 1022-at least one color image acquisition device, 103 imaging device and 104-preset mechanical structure. DETAILED DESCRIPTION

[0037] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0038] The following describes a high-resolution spectral imaging system and method at a video frame rate according to an embodiment of the present invention with reference to the accompanying drawings.

[0039] Specifically, Figure 1 A block diagram of a high-resolution spectral imaging system with a video frame rate provided by an embodiment of the present invention.

[0040] like Figure 1 As shown, the high-resolution spectral imaging system 10 with a video frame rate includes: an optical path device 101 , an array acquisition group 102 and an imaging device 103 .

[0041] The optical path device 101 is used to transmit the optical signal of the target scene. The array acquisition group 102 includes at least two image acquisition devices, and the photoreceptor of at least one image acquisition device is provided with a micro-filter structure array. The array acquisition group is connected to the optical path device, and is used to receive the optical signal transmitted by the optical path device and convert the optical signal into an image data group, wherein the image data group includes a first digital image or video and a second digital image or video. The imaging device 103 is connected to the array acquisition group, and is used to perform inversion calculation on the image data group to generate a spectral image or spectral video of the target scene.

[0042] In some embodiments, the optical path device 101 includes: at least one lens for acquiring an optical signal of a target scene.

[0043] In some embodiments, the optical path device 101 further includes: a light splitting device, which is connected to each lens and is used to distribute the optical signal to each image acquisition device in the array acquisition group.

[0044] Specifically, Figure 2 and 3 As shown, the optical path device 101 may include: at least one lens 1011 and / or a light source, a spectrometer 1012, wherein when the optical path device 101 only includes the lens 1011, each image acquisition device in the array acquisition group 102 is respectively connected to a lens 1011, each image acquisition device faces the same target scene, and the optical axes of each image acquisition device are parallel to each other or have a certain angle; when the optical path device 101 includes the lens 1011 and the spectrometer 1012, each image acquisition device in the array acquisition group 102 is respectively connected to a lens 1011, each image acquisition device faces the spectrometer 1012, or each image acquisition device in the array acquisition group 102 directly faces the spectrometer 1012, and the spectrometer is connected to each lens 1011; and any of the above structures can be selected to transmit the optical signal of the target scene to the image acquisition device of the array acquisition group 102.

[0045] Furthermore, if Figure 4As shown, the optical path device 101 is connected to the array acquisition group 102 via a preset mechanical structure 104, wherein the preset mechanical structure 104 may include a housing structure, an adjustment component and / or a detachable connection component.

[0046] In some embodiments, the array acquisition group 102 includes:

[0047] At least one multispectral image acquisition device, at least one photoreceptor of which is provided with a micro-filter structure array for imaging the light signal according to different spectral transmittance curves to obtain a first digital image or video;

[0048] At least one color image acquisition device is used to perform imaging through at most four spectral bands to obtain a second digital image or video.

[0049] Specifically, the array acquisition group 102 in the embodiment of the present invention may include at least one multispectral image acquisition device 1021, 1023 and at least one color image acquisition device 1022, such as at least one multispectral camera and at least one color camera, wherein each image acquisition device has a similar spectral detection range, and the similar spectral detection ranges have an overlap greater than or equal to 50%.

[0050] like Figure 5 and 6 As shown, each photoreceptor of the multispectral image acquisition device is provided with a micro-filter structure array containing more than four filter structures with different spectral transmittance curves, and the micro-filter structure array is arranged periodically or non-periodically on a spatial scale, such as a micro-filter structure array implemented by an absorption-type or interference-type filter film, or a micro-filter structure array implemented by a metasurface. It should be noted that in some cases, the micro-filter structure array is arranged periodically on a spatial scale, which can facilitate the manufacture of the overall system. In other cases, the micro-filter structure array is arranged non-periodically on a spatial scale, which is conducive to improving the detection stability.

[0051] Furthermore, when the multispectral image acquisition device in the array acquisition group 102 images the light signal according to different spectral transmittance curves to obtain a first digital image or video, the color image acquisition device images the light signal through at most four spectral bands to obtain a second digital image or video, the first digital image or video and the second digital image or video are formed into an image data group, and the image data group is sent to the imaging device for inversion calculation.

[0052] In some embodiments, the imaging device 103 is loaded with an artificial neural network or a numerical algorithm to perform inversion calculations on the image data set through the artificial neural network or the numerical algorithm to generate a spectral image or spectral video of the target scene.

[0053] Specifically, the imaging device 103 may use but is not limited to a computer, a mobile phone, a field programmable gate array, an application-specific integrated circuit, a server or a cloud virtual machine embedded with an artificial neural network or a numerical algorithm, and then perform inversion calculations on the image data group to generate a spectral image or spectral video of the target scene.

[0054] Among them, the spectral video can be directly inverted from the image data group, or formed by combining the inverted spectral images. The image data group can also be divided into multiple groups of data according to the shooting time. After the multiple groups of data are inverted, multiple groups of spectral video clips are obtained, which are formed by combining multiple groups of spectral video clips.

[0055] Furthermore, the imaging device 103 may be placed in the same mechanical structure as the array acquisition group 102 , or the imaging device 103 may be placed outside the mechanical housing of the array acquisition group 102 , or the imaging device 103 may be deployed separately.

[0056] The high-resolution spectral imaging system with a video frame rate proposed in the embodiment of the present invention is further described below through several specific embodiments.

[0057] Embodiment 1: High-resolution spectral imaging system with high video frame rate using dual-camera structure

[0058] In this embodiment, the optical path device 101 and the array acquisition group 102 are used in conjunction, the optical path device 101 includes a lens 1011, and the array acquisition group 102 includes two cameras, namely a multi-spectral camera 1021 and a color camera 1022. The photoreceptor of the multi-spectral camera 1021 is equipped with a micro-filter structure array, and the micro-filter structure array includes nine kinds of filter structures, wherein the difference between different kinds of filter structures is that the spectral transmittance curves are different; the two camera monomers have similar spectral detection ranges, wherein the similar spectral detection ranges have an overlap greater than or equal to 50%.

[0059] like Figure 3 As shown, the micro-filter structure array in this embodiment is periodically arranged on a spatial scale. For example, the micro-filter structure array is implemented using an absorption-type filter film.

[0060] like Figure 2 As shown, the optical path device 101 in this embodiment is configured in the following manner: all camera units of the array acquisition group 102 are connected to the lens 1011, all camera units face the same target object, and the optical axes of all camera units are parallel.

[0061] In this embodiment, the mechanical structure 104 includes a housing structure, an adjustment component and / or a detachable connection. The optical path device 101 is connected to the array acquisition group 102 via the mechanical structure 104 .

[0062] In this embodiment, the imaging device 103 is used to perform spectral image or video inversion calculation on the image data set. The imaging device 103 is used but not limited to a computer, a mobile phone, a field programmable gate array, an application specific integrated circuit, a server or a cloud virtual machine.

[0063] The imaging device 103 in this embodiment is placed in the same mechanical structure as the array acquisition group 102 , or the imaging device 103 is placed outside the mechanical housing of the array acquisition group 102 , or the imaging device 103 is deployed separately.

[0064] For example, the multispectral camera 1021 and the color camera 1022 are both commercial cameras, and the lens 1011 is also a commercial lens. The imaging device 103 and the array acquisition group 102 are placed in the same mechanical structure. The entire system structure is simple, compact and efficient, and can be loaded on a variety of load platforms.

[0065] In this embodiment, by adjusting the lens 1011, the multi-spectral camera 1021 and the color camera 1022 can clearly image the target scene. The optical path device 101 transmits the optical signal of the target scene to the photoreceptor of the array acquisition group 102; the photoreceptor converts the optical signal of the target scene into a digital image; the array acquisition group 102 transmits the image data group to the imaging device 103; the imaging device 103 calculates the spectral image or spectral video of the target scene according to the image data group through the inversion method.

[0066] Embodiment 2: High-resolution spectral imaging system with video frame rate using a three-camera structure

[0067] In this embodiment, the optical path device 101 and the array acquisition group 102 are used in conjunction with each other. The optical path device 101 includes a lens 1011 and a spectrometer 1012. The array acquisition group 102 includes three cameras, namely, two multispectral cameras 1021 and 1023, and a color camera 1022. The photoreceptors of the multispectral cameras 1021 and 1023 are equipped with different micro-filter structure arrays; the micro-filter structure arrays include more than four filter structures; wherein the difference between different filter structures is that the spectral transmittance curves are different. The three camera units have similar spectral detection ranges; wherein the similar spectral detection ranges have an overlap greater than or equal to 50%.

[0068] like Figure 6 As shown, the different micro-filter structure arrays assembled on the photoreceptors of the multi-spectral camera 1021 and the multi-spectral camera 1023 in this embodiment are arranged periodically on a spatial scale, for example, the micro-filter structure arrays are implemented using a metasurface.

[0069] like Figure 5As shown, the optical path device 101 in this embodiment is configured in the following manner: all camera units of the array acquisition group 102 are directly facing the light splitting device 1012 , and the light splitting device 1012 is connected to the lens 1011 .

[0070] In this embodiment, the optical path device 101 and the array acquisition group 102 are connected via a mechanical structure 104. The mechanical structure 104 includes a housing structure, an adjustment component and / or a detachable connection.

[0071] The imaging device 103 in this embodiment is used to perform inversion calculation of spectral images or videos on the image data set. The imaging device 103 is used, but not limited to, a computer, a mobile phone, a field programmable gate array, an application-specific integrated circuit, a server, or a cloud virtual machine.

[0072] In this embodiment, the imaging device 103 and the array acquisition group 102 are placed in the same mechanical structure, or the imaging device 103 is placed outside the mechanical housing of the array acquisition group 102, or the imaging device 103 is deployed separately.

[0073] For example, multispectral cameras 1021 and 1023 need to be customized (existing technical means can meet the requirements), and color camera 1022 is a commercial camera. Lens 1011 and spectrometer 1012 are common optical components and do not need to be customized. Imaging device 103 is deployed separately. The entire system structure is simple, compact and efficient, and can be loaded on a variety of load platforms.

[0074] In this embodiment, by adjusting the lens 1011, the multi-spectral camera 1021, the multi-spectral camera 1023 and the color camera 1022 can clearly image the target scene. The optical path device 101 transmits the light of the target scene to the photoreceptor of the array acquisition group 102; the photoreceptor converts the light signal of the target object into a digital image; the array acquisition group 102 transmits the image data group to the imaging device 103; the imaging device 103 calculates the spectral image or spectral video of the target scene according to the image data group through the inversion method.

[0075] In summary, the high-resolution spectral imaging system at video frame rate proposed in an embodiment of the present invention has a simple and compact structure, can effectively acquire the target scene light signal, can realize high-resolution spectral reconstruction at video frame rate through inversion calculation, and can be adapted to various carriers such as drones and unmanned vehicles.

[0076] Next, the high-resolution spectral imaging method at a video frame rate proposed in an embodiment of the present invention will be described with reference to the accompanying drawings.

[0077] Figure 7 4 is a flowchart of a high-resolution spectral imaging method at a video frame rate according to an embodiment of the present invention.

[0078] like Figure 7 As shown, the high-resolution spectral imaging method of the video frame rate includes the following steps:

[0079] In step S701, the position of the optical path device is adjusted to transmit the optical signal of the target scene to the array acquisition group.

[0080] In step S702, the optical signal is converted into an image data set by an array acquisition group.

[0081] In step S703, an imaging device is used to perform inversion calculation on the image data set to generate a spectral image or spectral video of the target scene.

[0082] It should be noted that the above explanation of the embodiment of the high-resolution spectral imaging system at a video frame rate is also applicable to the high-resolution spectral imaging method at a video frame rate of this embodiment, and will not be repeated here.

[0083] The high-resolution spectral imaging method at video frame rate proposed in an embodiment of the present invention has a simple and compact structure, can effectively acquire the light signal of the target scene, can realize high-resolution spectral reconstruction at video frame rate through inversion calculation, and can be adapted to various carriers such as drones and unmanned vehicles.

[0084] Figure 8 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. The electronic device may include:

[0085] A memory 801 , a processor 802 , and a computer program stored in the memory 801 and executable on the processor 802 .

[0086] When the processor 802 executes the program, the high-resolution spectral imaging method at the video frame rate provided in the above embodiment is implemented.

[0087] Furthermore, the electronic device further comprises:

[0088] The communication interface 803 is used for communication between the memory 801 and the processor 802 .

[0089] The memory 801 is used to store computer programs that can be executed on the processor 802 .

[0090] The memory 801 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk memory.

[0091] If the memory 801, the processor 802 and the communication interface 803 are implemented independently, the communication interface 803, the memory 801 and the processor 802 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0092] Optionally, in a specific implementation, if the memory 801, the processor 802 and the communication interface 803 are integrated on a chip, the memory 801, the processor 802 and the communication interface 803 can communicate with each other through an internal interface.

[0093] The processor 802 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present invention.

[0094] An embodiment of the present invention further provides a computer program product, and when the computer program / instructions are executed by a processor, the high-resolution spectral imaging method at the video frame rate as described above is implemented.

[0095] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the high-resolution spectral imaging method at the video frame rate as described above.

[0096] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0097] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "N" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0098] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present invention belong.

[0099] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or N wirings (electronic devices), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways as necessary and then storing it in a computer memory.

[0100] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above embodiment, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. If implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0101] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0102] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0103] The storage medium mentioned above may be a read-only memory, a magnetic disk or an optical disk, etc. Although the embodiments of the present invention have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limiting the present invention. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present invention.

Claims

1. A high-resolution spectral imaging system with a video frame rate, characterized in that: include: An optical path device, the optical path device is used to transmit an optical signal of a target scene; An array acquisition group, the array acquisition group comprises at least two image acquisition devices, and a photoreceptor of at least one image acquisition device is provided with a micro-filter structure array, the array acquisition group is connected to the optical path device, and is used to receive the optical signal transmitted by the optical path device and convert the optical signal into an image data group, wherein the image data group comprises a first digital image or video and a second digital image or video; An imaging device is connected to the array acquisition group and is used to perform inversion calculation on the image data group to generate a spectral image or spectral video of the target scene.

2. The high-resolution spectral imaging system of video frame rate according to claim 1, characterized in that: The optical path equipment comprises: At least one lens is used to acquire the light signal of the target scene.

3. The high-resolution spectral imaging system of video frame rate according to claim 2, characterized in that: The optical path device also includes: A light splitting device is connected to each lens and is used to distribute the optical signal to each image acquisition device in the array acquisition group.

4. The high-resolution spectral imaging system of video frame rate according to claim 1, characterized in that: The array acquisition group includes: At least one multi-spectral image acquisition device, wherein the photoreceptor of the at least one multi-spectral image acquisition device is provided with a micro-filter structure array for imaging the light signal according to different spectral transmittance curves to obtain the first digital image or video; At least one color image acquisition device is used to image the light signal through at most four spectral bands to obtain the second digital image or video.

5. The high-resolution spectral imaging system of video frame rate according to claim 1 or 4, characterized in that: The micro-filter structure array includes at least four filter structures, and each filter structure has a different spectral transmittance curve.

6. The high-resolution spectral imaging system of video frame rate according to claim 1 or 4, characterized in that: Each image acquisition device in the array acquisition group has a spectral detection range with an overlap greater than or equal to 50%.

7. The high-resolution spectral imaging system of video frame rate according to claim 2, characterized in that: Each image acquisition device of the array acquisition group faces the same target in the target environment, and each image acquisition device is connected to the at least one lens.

8. The high-resolution spectral imaging system of video frame rate according to claim 3, characterized in that: Each image acquisition device of the array acquisition group faces the light splitting device, and each image acquisition device is connected to the at least one lens.

9. The high-resolution spectral imaging system of video frame rate according to claim 3, characterized in that: Each image acquisition device of the array acquisition group faces the light splitting device, and the light splitting device is connected to the at least one lens.

10. The high-resolution spectral imaging system of video frame rate according to claim 1, characterized in that: The array acquisition group is connected to the optical path device via a preset mechanical structure, wherein the preset mechanical structure includes a housing structure, an adjustment component and / or a detachable connection component.

11. The high-resolution spectral imaging system of video frame rate according to claim 1, characterized in that: The imaging device is loaded with an artificial neural network or a numerical algorithm to perform inversion calculation on the image data set through the artificial neural network or the numerical algorithm to generate a spectral image or spectral video of the target scene.

12. A high-resolution spectral imaging method at a video frame rate, characterized in that: The high-resolution spectral imaging system based on the video frame rate according to any one of claims 1 to 11 comprises the following steps: Adjust the position of the optical path device to transmit the optical signal of the target scene to the array acquisition group; Converting the optical signal into an image data set by the array acquisition group; The imaging device is used to perform inversion calculation on the image data set to generate a spectral image or spectral video of the target scene.

13. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the high-resolution spectral imaging method at a video frame rate as claimed in claim 12.

14. A computer program product, characterized in that When the computer program / instructions are executed by a processor, the high-resolution spectral imaging method at a video frame rate as claimed in claim 12 is implemented.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: The program is executed by a processor to implement the video frame rate high-resolution spectral imaging method as claimed in claim 12.

Images