Spectroscopic device and terminal device with spectroscopic device and method of operation

Abstract

The present application provides a spectrum device and a terminal device with the spectrum device and a working method, wherein the spectrum device comprises a spectrum chip, an optical system and at least one data processing unit, wherein the optical system is located in the optical path of the spectrum chip, the spectrum chip is electrically connected with the at least one data processing unit, and the spectrum chip is provided with a plurality of transmission spectrum matrices, wherein the optical system has a variable focal length, so that by adjusting the focal length of the optical system, the incident light incident on the spectrum chip is modulated by the optical system, and the spectrum information corresponding to the incident light is calculated by the data processing unit based on the specific transmission spectrum matrix corresponding to the spectrum chip.

Description

Technical Field

[0001] This invention relates to a spectroscopic device, and more particularly to a spectroscopic device, a terminal device incorporating the spectroscopic device, and a method of operation thereof. Background Technology

[0002] With the development of spectral technology, spectral analysis has been widely applied in daily life and industry; for example, it is used for non-invasive examinations in medical and cosmetic fields, food testing of fruits and vegetables, and monitoring of water quality. Its working principle is that light interacts with matter through processes such as absorption, scattering, fluorescence, and Raman spectroscopy, producing specific spectra. Each substance's spectrum is unique. Spectroscopic devices can directly detect the spectral information of substances, obtaining the presence and composition of the target, making them one of the important testing instruments in materials characterization, chemical analysis, and other fields. Therefore, spectral information can be considered the "fingerprint" of everything.

[0003] However, specific spectra often require matching spectroscopic devices for detection and identification to achieve higher efficiency and accuracy. This leads to the need for spectroscopic devices with different performance levels for detection in different scenarios and for different analytes. Existing spectroscopic devices require a specific distance from the analyte to obtain good spectral detection results, but in practical use, existing spectroscopic devices are difficult to adapt to different types of analytes, resulting in insufficient detection and identification effects.

[0004] Therefore, there is an urgent need to develop a spectroscopic device that can be applied to the detection of different scenarios and objects simultaneously. Summary of the Invention

[0005] A key advantage of this invention is that it provides a spectroscopic device, a terminal device with the spectroscopic device, and a method of operation, wherein the spectroscopic device provides a suitable transmission spectrum matrix according to the characteristics of the analyte, thereby improving the applicability and / or accuracy of the spectroscopic device.

[0006] Another advantage of the present invention is that it provides a spectroscopic device and a terminal device with the spectroscopic device and a method of operation, wherein the spectroscopic device is adjusted according to the characteristics of the object to be measured, so that the principal angle and / or the receiving cone angle of the incident light containing the information of the object to be measured to the structural pixel of the spectroscopic chip changes, and the transmission spectrum matrix of the spectroscopic chip changes, making it more suitable for the characteristics of the object to be measured, thereby improving the recognition and detection accuracy.

[0007] Another advantage of this invention is that it provides a spectroscopic device, a terminal device with the spectroscopic device, and a method of operation. The spectroscopic device includes a spectroscopic chip and an optical system disposed in the optical path of the spectroscopic chip. The optical system is focusable. By adjusting the focal length of the optical system, the principal angle and / or the receiving cone angle of the incident light reaching the surface of the filter structure change, thereby changing the transmission spectrum matrix corresponding to the filter structure. Based on the characteristics of the object under test, a suitable transmission spectrum matrix is ​​obtained by selecting the corresponding focal length for identification and detection, thereby improving the accuracy of identification and detection.

[0008] Another advantage of the present invention is that it provides a spectroscopic device and a terminal device with the spectroscopic device, as well as a method of operation, wherein the optical system is implemented as a zoom lens group, and the zoom of the optical system is achieved by moving the lenses of the zoom lens group, thereby selecting the corresponding focal length according to the characteristics of the object to be measured for identification and detection, so as to improve the accuracy of identification and detection.

[0009] Another advantage of the present invention is that it provides a spectroscopic device and a terminal device with the spectroscopic device, as well as a method of operation, wherein the optical system includes a liquid lens, the focal length of the optical system is adjusted by the liquid lens, and the height of the spectroscopic device can be further reduced.

[0010] Another advantage of the present invention is that it provides a spectroscopic device and a terminal device with the spectroscopic device, as well as a method of operation, wherein the optical system is implemented as a periscope lens, which can effectively reduce the height of the spectroscopic device in the optical axis direction.

[0011] Another advantage of this invention is that it provides a spectroscopic device, a terminal device with the spectroscopic device, and a method of operation, wherein the change in the focal length of the optical system causes a change in the principal angle and / or the cone angle of the incident light reaching the surface of the filter structure. Due to the change in the principal angle and / or the cone angle of the incident light, the transmission spectrum curve corresponding to the structural unit of the spectroscopic chip changes. Therefore, the spectroscopic device of this invention can select the corresponding focal length (or the corresponding transmission spectrum curve) according to the characteristics of the object to be measured for identification and detection, thereby improving the accuracy of identification and detection.

[0012] According to one aspect of the present invention, a spectroscopic device of the present invention, capable of achieving the aforementioned and other objects and advantages, comprises:

[0013] A spectral chip, wherein the spectral chip has multiple transmission spectrum matrices; and

[0014] An optical system, wherein the optical system is located in the optical path of the spectral chip;

[0015] The optical system has a variable focal length, and the variable focal length of the optical system corresponds to the plurality of transmission spectrum matrices of the spectral chip. By adjusting the focal length of the optical system, a specific transmission spectrum matrix is ​​configured for the spectral chip, and then the data processing unit calculates the spectral information corresponding to the incident light based on the specific transmission spectrum matrix corresponding to the spectral chip.

[0016] According to one embodiment of the present invention, the optical system includes at least one lens assembly and at least one moving mechanism, wherein the at least one lens assembly is transversely connected to the at least one moving mechanism, and the at least one moving mechanism drives the at least one lens assembly to move in order to adjust the focal length of the optical system.

[0017] According to one embodiment of the present invention, the optical system further includes at least one deflector, wherein the deflector is disposed in the optical axis direction of the at least one lens assembly, and the deflector deflects the transmission direction of light incident on or exiting the at least one lens assembly.

[0018] According to one embodiment of the present invention, the lens assembly further includes a first lens group, a second lens group, and a third lens group, wherein the first lens group, the second lens group, and the third lens group are arranged along the same optical axis direction, the second lens group is located between the first lens group and the third lens group, and wherein the second lens group is connected to the moving mechanism and is driven to move by the moving mechanism.

[0019] According to one embodiment of the present invention, the second lens group further includes at least one zoom lens and at least one compensation lens, the at least one zoom lens and the at least one compensation lens being tractably connected to the moving mechanism, and zooming is achieved by moving the zoom lens and the compensation lens.

[0020] According to one embodiment of the present invention, the turning member further includes a first turning member and a second turning member, the first turning member being located at the front end of the first lens group, and the second turning member being located between the second lens group and the third lens group.

[0021] According to one embodiment of the present invention, the optical system includes at least one liquid lens assembly and at least one lens assembly, the liquid lens assembly and the lens assembly being arranged one after the other along the same optical axis, and the liquid lens assembly being capable of changing its curvature.

[0022] According to one embodiment of the present invention, the liquid lens assembly may include at least one deformable lens body, a flexible transparent cover component, and an actuator, wherein the flexible transparent cover component is attached to the surface of the at least one deformable lens body, and the actuator is located on the upper surface of the flexible transparent cover component, thereby driving the flexible transparent cover component to move to change the shape of the deformable lens body.

[0023] According to one embodiment of the present invention, a focusing mechanism is further included, wherein the focusing mechanism is connected to the at least one lens assembly, and the at least one lens assembly is driven by the focusing mechanism to achieve focusing.

[0024] According to one embodiment of the present invention, it further includes at least one image stabilization mechanism, wherein the image stabilization mechanism is connected to the at least one lens assembly of the optical system, and the movement of the optical system driven by the image stabilization mechanism compensates for the jitter generated by the spectral device during use.

[0025] According to one embodiment of the present invention, the image stabilization mechanism further includes a first image stabilization mechanism component and a second image stabilization mechanism component, wherein the first image stabilization mechanism component is connected to the turning member, and the first image stabilization mechanism component enables the turning member to rotate to compensate for roll, pitch and yaw, wherein the second image stabilization mechanism component is connected to the lens assembly of the optical system, and the second image stabilization mechanism component drives the lens assembly to move horizontally.

[0026] According to one embodiment of the present invention, it further includes at least one data processing unit, wherein the spectral chip is electrically connected to the at least one data processing unit, and the data processing unit obtains the spectral information corresponding to the incident light based on a specific transmission spectrum matrix corresponding to the spectral chip and the incident light.

[0027] According to one embodiment of the present invention, the device further includes a circuit board and at least one heat sink, wherein the spectral chip is electrically connected to the circuit board, and the heat sink may be attached to the circuit board or to the spectral chip.

[0028] According to one embodiment of the present invention, a bracket is further included, the bracket being disposed on the circuit board, the optical system being disposed on the bracket, the bracket having a light-transmitting hole corresponding to the photosensitive area of ​​the spectral chip.

[0029] According to one embodiment of the present invention, the spectral chip records the principal angle corresponding to each of the transmission spectrum matrices and / or the zoom position of the optical system corresponding to each of the transmission spectrum matrices.

[0030] According to one embodiment of the present invention, the first lens group includes a first lens and a second lens, the second lens group includes the third lens and the fourth lens, and the third lens group includes the fifth lens and the sixth lens. Along the optical axis of the optical system from the object side to the image side, the first lens, the second lens, the third lens, the fourth lens, the fifth lens, and the sixth lens are arranged sequentially, and the optical system satisfies the following relationships: -3 < f2 / f1 < 0; 0 < f3 / f1 < 4; 0 < f4 / f1 < 4; -7 < f5 / f1 < -2; -3 < f6 / f1 < 0. f1 is the focal length of the first lens, f2 is the focal length of the second lens, f3 is the focal length of the third lens, f4 is the focal length of the fourth lens, f5 is the focal length of the fifth lens, and f6 is the focal length of the sixth lens.

[0031] According to one embodiment of the present invention, the spectral chip further includes an image sensor and at least one filter structure disposed on the photosensitive side of the image sensor, wherein the filter structure is located above the image sensor, and the filter structure is a broadband filter structure in the frequency domain or wavelength domain.

[0032] According to one embodiment of the present invention, the filter structure of the spectral chip is selected from a combination of metasurfaces, photonic crystals, nanopillars, multilayer films, dyes, quantum dots, MEMS, FP etalon, cavity layers, waveguide layers, and diffraction elements.

[0033] According to one embodiment of the present invention, the data processing unit is selected from a combination of processing units consisting of MCU, CPU, GPU, FPGA, NPU and ASIC.

[0034] According to another aspect of the present invention, the present invention further provides a terminal device, comprising:

[0035] A terminal device host; and

[0036] The spectroscopic device described above is electrically connected to the terminal device host, and the terminal device host sends control commands to the spectroscopic device to adjust the focal length of the spectroscopic device.

[0037] According to one embodiment of the present invention, a selection module is further included, wherein the selection module selects the test object and generates the control command.

[0038] According to one embodiment of the present invention, a judgment module is further included, wherein the judgment module identifies and judges the spectral characteristics of the object to be tested, and further generates the control command based on the spectral characteristics of the object to be tested.

[0039] According to one embodiment of the present invention, an imaging module is further included, wherein the imaging module is electrically connected to the host of the terminal device, thereby acquiring image information of the object under test to analyze the spectral characteristics of the object under test.

[0040] According to another aspect of the present invention, the present invention further provides a method of operating a spectroscopic device, comprising:

[0041] (a) Adjusting the focal length of an optical system based on a control command to modulate the principal angle and / or the receiving cone angle of the incident light reaching a spectral chip; and

[0042] (b) Match a transmission spectrum matrix to the spectral chip and calculate the spectral information of the incident light based on the transmission spectrum matrix.

[0043] According to one embodiment of the present invention, the optical system of the spectral device includes at least one lens assembly and at least one moving mechanism, wherein the moving mechanism drives the at least one lens assembly to move in order to change the effective focal length of the optical system.

[0044] According to an embodiment of the present invention, the lens assembly further includes a first lens group, a second lens group, and a third lens group, wherein the first lens group, the second lens group, and the third lens group are arranged along the same optical axis direction, wherein the second lens group of the optical system is connected to the moving mechanism in a driving manner, and the moving mechanism drives the second lens group to move, thereby changing the focal length of the optical system, so that the principal angle and / or the light cone angle of the incident light reaching the surface of the filter structure changes.

[0045] According to one embodiment of the present invention, the optical system includes at least one liquid lens assembly and at least one lens assembly, the liquid lens assembly and the lens assembly being arranged one after the other along the same optical axis, the liquid lens assembly being able to change its own curvature, thereby changing the focal length of the optical system.

[0046] According to one embodiment of the present invention, the liquid lens assembly may include at least one deformable lens body, a flexible transparent cover component, and an actuator, wherein the flexible transparent cover component is attached to the surface of the at least one deformable lens body, the actuator is located on the upper surface of the flexible transparent cover component, and the actuator performs work on the deformable lens body to deform the deformable lens body, thereby causing the optical system to zoom.

[0047] According to one embodiment of the present invention, the optical system includes at least one lens assembly, at least one moving mechanism, and at least one turning member, wherein the turning member is disposed at the front end of the at least one lens assembly in the optical axis direction, the moving mechanism is connected to the at least one lens assembly, and the moving mechanism drives the at least one lens assembly to adjust the focal length of the optical system.

[0048] According to one embodiment of the present invention, the lens assembly further includes a first lens group, a second lens group, and a third lens group, wherein the first lens group, the second lens group, and the third lens group are arranged along the same optical axis direction, wherein the second lens group of the lens assembly is connected to the moving mechanism, and the moving mechanism drives the second lens group to move to adjust the focal length of the optical system.

[0049] According to one embodiment of the present invention, the second lens group includes at least one zoom lens and at least one compensation lens, wherein the at least one zoom lens and the at least one compensation lens of the second lens group are tractably connected to the moving mechanism, and the moving mechanism drives the zoom lens and the at least one compensation lens to move in order to adjust the focal length of the optical system.

[0050] According to one embodiment of the present invention, the method further includes the following steps:

[0051] Multiple transmission spectrum matrices are preset, and the principal angle corresponding to each transmission spectrum matrix is ​​matched, or the shape of each transmission spectrum matrix is ​​matched to the shape of the optical system.

[0052] The further objects and advantages of the invention will become fully apparent from the following description and accompanying drawings.

[0053] These and other objects, features and advantages of the present invention will become fully apparent from the following detailed description and accompanying drawings. Attached Figure Description

[0054] Figure 1 This is a schematic diagram of the frame of a spectroscopic device according to a preferred embodiment of the present invention.

[0055] Figure 2A and Figure 2B This is a schematic diagram of an optional embodiment of a spectral chip of the spectral device according to the preferred embodiment of the present invention described above.

[0056] Figure 3A and Figure 3B This is a schematic diagram of another optional embodiment of a spectral chip of the spectral device according to the preferred embodiment of the present invention described above.

[0057] Figure 4A and Figure 4B This is a schematic diagram of another optional embodiment of a spectral chip of the spectral device according to the preferred embodiment of the present invention described above.

[0058] Figure 5A and Figure 5B This is a schematic diagram of the effect of the transmission spectrum curve of the spectroscopic device according to the preferred embodiment of the present invention.

[0059] Figure 6 This is a schematic diagram of another optional embodiment of the spectral chip of the spectral device according to the preferred embodiment of the present invention described above.

[0060] Figure 7 This is a schematic diagram of another optional embodiment of a spectral chip of the spectral device according to the preferred embodiment of the present invention described above.

[0061] Figure 8 This is a schematic diagram of the pixel structure of the spectral chip of the spectral device according to the preferred embodiment of the present invention.

[0062] Figure 9 This is a schematic diagram of the system framework of a spectroscopic device according to another preferred embodiment of the present invention.

[0063] Figure 10 This is a schematic diagram of the structure of an optical system of the spectral device according to any of the preferred embodiments of the present invention, wherein the optical system is a vertical lens.

[0064] Figure 11A and Figure 11B This is a schematic diagram of the operation of the optical system of the spectral device according to any of the preferred embodiments of the present invention.

[0065] Figure 12 This is a schematic diagram of another alternative embodiment of an optical system of the spectral device according to any of the preferred embodiments described above, wherein the optical system is a liquid lens.

[0066] Figure 13 This is a schematic diagram of the operation of the optical system of the spectral device according to any of the preferred embodiments of the present invention.

[0067] Figure 14A and Figure 14B This is a schematic diagram of another alternative embodiment of an optical system of the spectral device according to any of the preferred embodiments described above, wherein the optical system is a periscope lens.

[0068] Figure 15 This is a schematic diagram of the operation of the optical system of the spectral device according to any of the preferred embodiments of the present invention.

[0069] Figure 16 This is a schematic diagram of a spectroscopic device according to another preferred embodiment of the present invention.

[0070] Figure 17 This is an experimental diagram showing the effect of the principal angle of the spectral device according to any of the preferred embodiments of the present invention on the transmission spectrum curve.

[0071] Figure 18A and Figure 18B This is a schematic diagram of a zoom lens of an optical system of the spectral device according to another preferred embodiment of the present invention.

[0072] Figure 19 This is a schematic diagram of the parameter table of the optical system of the spectral device according to the preferred embodiment of the present invention.

[0073] Figure 20A and Figure 20B This is a schematic diagram of the field curvature and distortion generated by the optical system of the spectral device according to the preferred embodiment of the present invention.

[0074] Figure 21 This is a schematic diagram of a terminal device applying the spectral apparatus described in the preferred embodiment of the present invention.

[0075] Figure 22 This is a schematic diagram of another terminal device of the spectral apparatus described in the preferred embodiment of the present invention.

[0076] Figure 23 This is a schematic diagram of another terminal device of the spectral apparatus described in the preferred embodiment of the present invention.

[0077] Figure 24 This is a schematic diagram of the operation of a spectroscopic device according to any of the preferred embodiments of the present invention. Detailed Implementation

[0078] The following description is intended to disclose the present invention and enable those skilled in the art to implement it. The preferred embodiments described below are merely examples, and other obvious variations will occur to those skilled in the art. The basic principles of the invention defined in the following description can be applied to other embodiments, modifications, improvements, equivalents, and other technical solutions that do not depart from the spirit and scope of the invention.

[0079] Those skilled in the art should understand that, in the disclosure of this invention, the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, the above terms should not be construed as limiting this invention.

[0080] It is understood that the term "a" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element can be one, while in another embodiment, the number of the element can be multiple, and the term "a" should not be understood as a limitation on the number.

[0081] Referring to the accompanying drawings of this invention Figure 1 As shown, a spectroscopic device according to a preferred embodiment of the present invention will be described below. The spectroscopic device of this embodiment is a computational spectroscopic device that approximates or even reconstructs the spectrum of incident light through calculation. The spectroscopic device includes a spectroscopic chip 10, an optical system 20 located in the photosensitive path of the spectroscopic chip 10, and at least one data processing unit 30 electrically connected to the spectroscopic chip 10. In this preferred embodiment of the invention, the optical system 20 of the spectroscopic device is optional and can be implemented as a lens assembly, a homogenizing assembly, or other optical system. The spectroscopic chip 10 further includes an image sensor 11 and at least one filter structure 12 disposed on the photosensitive side of the image sensor 11, wherein the filter structure 12 is located above the image sensor 11, and the filter structure 12 is a broadband filter structure in the frequency domain or wavelength domain. The optical system 20 is located at the front end of the spectral chip 10 in the photosensitive direction. Light emitted or reflected by the object under test, carrying information about the object, is guided to the spectral chip 10 via the optical system 20. The spectral chip 10 converts the incident light signal of the object under test into an electrical signal suitable for processing by the data processing unit 30, and transmits it to the data processing unit 30. The signal processing unit 30 is equipped with an algorithm processing system that can process the differential response based on an algorithm to reconstruct the original spectrum.

[0082] It is worth noting that the transmittance of the filter structure 12 is not entirely the same for light of different wavelengths. The filter structure 12 can be implemented as a metasurface, photonic crystal, nanopillar, multilayer film, dye, quantum dot, MEMS (microelectromechanical systems), FP etalon, cavity layer, waveguide layer, diffraction element, or other structures or materials with filtering properties. For example, in the embodiments of this application, the filter structure 12 can be the light modulation layer in Chinese Patent CN201921223201.2.

[0083] The image sensor 11 of the spectral chip 10 can be a CMOS image sensor (CIS), CCD, array photodetector, etc. In this preferred embodiment of the invention, the optional data processing unit 30 in the spectral device can be a processing unit such as an MCU, CPU, GPU, FPGA, NPU, ASIC, etc., which can export the data generated by the image sensor 11 to an external source for processing. It is worth noting that the data processing unit 30 can be integrated into the spectral chip 10; alternatively, it can be a separate processing unit, such as a computer, microcontroller, or cloud computing device.

[0084] It is worth mentioning that after the image sensor 11 of the spectral device measures the light intensity information, it transmits it to the data processing unit 30 for processing, such as spectral restoration and spectral imaging. The process is described in detail below:

[0085] The intensity signals of the incident light of the test object at different wavelengths λ are denoted as x(λ), and the transmission spectrum curve of the filter structure 12 is denoted as T(λ). The filter structure 12 has m groups of structural units 121, and the transmission spectrum of each group of structural units 121 is different. The image sensor 11 has multiple physical pixels, wherein the physical pixels of the image sensor 11 correspond to the structural units 121 of the filter structure 12. The structural units 121 of the filter structure 12 can be denoted as T. i (λ)(i=1,2,3,…,m). Each group of structural units 121 of the filter structure 12 corresponds to at least one physical pixel of the image sensor 11, that is, each group of structural units 121 of the filter structure 12 has a corresponding physical pixel below it, and the image sensor 11 detects the light intensity b modulated by the filter structure 12. i .

[0086] In this preferred embodiment of the present invention, one physical pixel of the image sensor 11 corresponds to a group of structural units 121, but this is not limited to this. In other embodiments of the present invention, multiple physical pixels are grouped together to correspond to a group of structural units 121, wherein each structural unit 121 of the filter structure 12 and at least one group of physical pixels of the image sensor 11 constitute a structural pixel 102. Therefore, in the computational spectral apparatus according to the embodiments of the present application, at least two structural pixels 102 constitute a spectral pixel. It is understood that in this preferred embodiment of the present invention, multiple groups of structural units 121 of the filter structure 12 and the corresponding image sensor 11 constitute the spectral pixel.

[0087] It is worth mentioning that, in this preferred embodiment of the present invention, the effective transmission spectrum (the transmission spectrum used for spectral reconstruction, is called the effective transmission spectrum) T of the filter structure 12 i The number of (λ) elements may differ from the number of structural units 121. The transmission spectrum of the filter structure 12 is set, tested, or calculated according to certain rules based on the requirements of identification or recovery (for example, the transmission spectrum obtained by testing each structural unit 121 is the effective transmission spectrum). Therefore, the number of effective transmission spectra of the filter structure 12 may be less than or even more than the number of structural units 121. Thus, it is understood that in this preferred embodiment of the invention, a particular transmission spectrum curve is not necessarily determined by a group of structural units 121, but may be determined by multiple structural units 121.

[0088] The relationship between the spectral distribution of the incident light on the object under test and the measurement value of the image sensor 11 can be expressed by the following formula:

[0089] b i =∫x(λ)*T i (λ)*R(λ)dλ

[0090] After discretization, we get

[0091] b i =Σ(x(λ)*T i (λ)*R(λ))

[0092] Where R(λ) is the response of the image sensor, denoted as:

[0093] A i (λ)=T i (λ)*R(λ)

[0094] The above equation can then be extended into matrix form:

[0095]

[0096] Among them, b i (i = 1, 2, 3, ..., m) represents the response of the image sensor 11 after the light to be measured passes through the filter structure 12, corresponding to the light intensity measurement values ​​of the image sensor 11 corresponding to each of the m structural units. When one physical pixel corresponds to one structural unit 121, it can be understood that the light intensity measurement values ​​corresponding to the m physical pixels can form a vector of length m. A is the system's response to light of different wavelengths, determined by the transmittance of the filter structure 12 and the quantum efficiency of the image sensor 11, and can be called the transmission spectrum matrix. A is a matrix, where each row vector corresponds to a set of structural units 121 responding to incident light of different wavelengths. As an example, in this invention, the incident light is sampled discretely and uniformly, with a total of n sampling points. The number of columns in A is the same as the number of sampling points of the incident light, where x(λ) is the light intensity of the incident light at different wavelengths λ, which is the incident light spectrum to be measured.

[0097] In other optional embodiments of the present invention, the filter structure 12 can be directly formed on the upper surface of the image sensor, such as quantum dots, nanowires, etc., which directly form the filter structure or material (nanowires, quantum dots, etc.) in the photosensitive area of ​​the image sensor 11. In other words, the filter structure 12 is integrally formed on the photosensitive side surface of the image sensor 11. With the filter structure formed on the upper surface of the image sensor 11, the transmission spectrum curve and the response of the image sensor are integrated, that is, it can be understood that the response of the image sensor and the transmission spectrum curve are the same curve. In this case, the relationship between the spectral distribution of the incident light and the light intensity measurement value of the image sensor can be expressed by the following formula:

[0098] b i =Σ(x(λ)*R i (λ))

[0099] In this embodiment, the transmission spectrum A i (λ)=R i (λ)

[0100] It is understood that in other alternative embodiments of the present invention, at least one other filter structure 12b for modulating incident light is provided on the image sensor having a filter structure 12a, thus forming a spectral chip 10 with a dual filter structure. It can be understood that the image sensor 11 in the first embodiment, which could be a CMOS image sensor (CIS), CCD, array photodetector, etc., can be replaced with an image sensor integrating a filter structure in the second embodiment.

[0101] The relationship between the spectral distribution of the incident light and the light intensity measurement value of the image sensor 11 can be expressed by the following formula:

[0102] b i =∫x(λ)*Ti (λ)*R i (λ)dλ

[0103] After discretization, we get

[0104] b i =Σ(x(λ)*T i (λ)*R i (λ))

[0105] In this embodiment, A i (λ)=T i (λ)*R i (λ)

[0106] It should be noted that the spectral chip 10 of the spectral device is sensitive to the principal angle and the receiving cone angle of the incident light signal. Changes in the principal angle and / or the receiving cone angle of the incident light signal of the analyte will cause changes in the transmission spectrum matrix of the spectral chip, thereby affecting the accuracy of spectral recovery.

[0107] The principal angle at any specific location of the spectral chip 10 represents the angle between the principal ray guided to the spectral chip 10 and the normal. The principal ray represents the line connecting the point from which the light signal is emitted from the target and the point arriving at the corresponding structural pixel 102 of the spectral chip 10. The normal represents a line perpendicular to the photosensitive surface of the spectral chip 10. Those skilled in the art will understand that the principal angles of different structural pixels 102 are allowed to vary considerably, but the light incident on the same structural pixel 102 needs to maintain a small angular difference.

[0108] It is also important to note that the spectral chip 10 is quite sensitive to the light-receiving cone angle at various locations where the incident light signal arrives. In practical applications, a significant change in the light-receiving cone angle of the incident light signal will substantially affect the accuracy of spectral reconstruction. Specifically, when the light signal incident on the analyte arrives at a certain structural pixel 102 of the spectral chip, the incident angle of the light signal to that structural pixel 102 (which can also be defined as the light-receiving cone angle of that structural unit 121) changes. If the incident angle changes, the parameter values ​​at the corresponding positions in the transmission spectrum matrix A will also change accordingly, thus affecting the accuracy of spectral reconstruction. Furthermore, when the light-receiving cone angle of the incident light signal is large, it is equivalent to the superposition of the transmission spectra of collimated light incident at multiple angles. At this time, the randomness and complexity of the spectrum transmitted by the filter structure 12 decrease, and the correlation between different light modulation units increases, thereby causing a decrease in the spectral recovery effect. Conversely, the smaller the light-receiving cone angle, the better the spectral recovery effect.

[0109] In other words, due to the angular sensitivity of the filter structure 12, the transmission spectrum matrix A is affected by the principal angle and / or the receiving cone angle of the incident light signal during the calculation and reconstruction process. In actual use environments, the spatial distribution of the incident light from the analyte and the angular distribution of the light rays are uncertain. Therefore, the principal angle and the receiving cone angle of different structural units 121 incident on the spectral chip 10 are also uncertain, resulting in a large error in the spectral measurement. In short, different types of analytes and different incident light from the analytes may lead to different principal angles or receiving cone angles of the light signal, which may affect the accuracy of the calculation and reconstruction by the spectral device.

[0110] It is worth noting that different objects to be tested have different properties and exhibit different characteristics. Therefore, a corresponding transmission spectrum matrix A is needed to modulate the incident light containing information about the object to be tested, which can improve the accuracy of object identification and detection. Therefore, in this preferred embodiment of the present invention, the spectral device changes the transmission spectrum matrix A based on the change of the principal beam angle and / or the receiving beam cone angle. This allows a single spectral device to change the principal beam angle and / or the receiving beam cone angle for different objects to be tested, making the corresponding transmission spectrum matrix A more closely match the characteristics of the corresponding object to be tested, thereby achieving high-precision identification or detection.

[0111] For ease of explanation, the linear correlation between each row of the transmission spectrum matrix A is defined as the correlation coefficient. For example, the commonly used Pearson correlation coefficient is used. A good match refers to a low correlation coefficient between each row of the transmission spectrum matrix A in the band corresponding to the spectral characteristics of the object being identified or detected. In this invention, a low Pearson correlation coefficient means a correlation coefficient less than or equal to 0.9, preferably less than or equal to 0.7, and even more preferably less than or equal to 0.4.

[0112] The optical system 20 can be adjusted according to the characteristics of the object under test, so that the principal angle and / or the receiving cone angle of the incident light containing the information of the object under test reaching the structural pixel 102 of the spectral chip 10 changes, and the transmission spectrum matrix A of the spectral chip 10 changes, becoming more suitable for the incident light of the object under test, thereby improving the recognition and detection accuracy. Preferably, in this preferred embodiment of the present invention, the incident angle of the incident light of the optical system 20 is adjusted by adjusting the focal length of the optical system 20, thereby adjusting the principal angle and / or the receiving cone angle of the incident light of the object under test reaching the structural pixel 102 of the spectral chip 10, and thus changing the transmission spectrum matrix A, so as to be suitable for the spectral device to reconstruct the relevant spectrum of the object under test or to detect and recognize the object under test.

[0113] It should be noted that, generally speaking, the larger the zoom ratio of the optical system 20, the larger the range of the principal angle variation. Preferably, the zoom ratio of the optical system 20 is greater than or equal to 2, for example, 3 or 4 times. More preferably, in this preferred embodiment of the present invention, the optical system 20 has a zoom ratio greater than or equal to 5 times. Since the spectral device of the present invention requires specific angles for the principal angle and the receiving light cone angle, it is necessary to consider the values ​​of the principal angle and the receiving light cone angle at the focal length corresponding to the zoom ratio, that is, to ensure that the values ​​of the principal angle and the receiving light cone angle make the corresponding transmission spectrum matrix A more suitable for the needs of object identification, detection, or corresponding spectral recovery.

[0114] The structure of the spectral chip 10 of the spectral device described in the above preferred embodiments of the present invention is further illustrated below through Embodiments 1 to 3.

[0115] Example 1

[0116] like Figure 2A and Figure 2B The diagram illustrates an optional embodiment of the structure of a spectral chip 10 in the zoom spectral device of the preferred embodiment of the present invention. The spectral chip 10 includes a filter structure 12 and an image sensor 11. The filter structure 12 is disposed along the photosensitive path of the image sensor 11. The image sensor 11 may be, but is not limited to, a CMOS image sensor (CIS), a CCD, an array photodetector, etc. The filter structure 12 includes at least one light modulation layer 120. The light modulation layer 120 has at least one structural unit 121, which corresponds to at least one physical pixel of the image sensor 11. The structural unit 121 modulates the incident light, which is then received by the corresponding physical pixel.

[0117] In this preferred embodiment of the present invention, the structural unit 121 of the filter structure 12 and at least one physical pixel of the image sensor 11 corresponding to the structural unit 121 constitute a structural pixel 102. Preferably, the structural unit 121 further has at least one modulation aperture 1210, wherein the modulation aperture 1210 of the structural unit 121 is positively opposite to the physical pixel of the image sensor 11. It is worth mentioning that, in this preferred embodiment of the present invention, the structural unit 121 of any structural pixel 102 may have the same or different types of modulation apertures 1210, that is, the structural unit 121 may have multiple modulation apertures, and at least two modulation apertures 1210 have different structures and parameters. Preferably, a structural pixel 102 is composed of only one type of modulation aperture 1210 with the same structure and size. The material of the light modulation layer 120 may be silicon, germanium, germanium-silicon materials, silicon compounds, germanium compounds, metals and III-V group materials, tantalum oxide, and / or titanium dioxide, etc., wherein silicon compounds include, but are not limited to, silicon nitride, silicon dioxide, and silicon carbide. It is worth mentioning that the material of the light modulation layer 120 can be, but is not limited to, low-refractive-index materials such as silicon dioxide and polymers.

[0118] It is worth mentioning that the modulation aperture 1210 of each of the structural units 121 all possess C4 symmetry, meaning that after rotating the modulation aperture 1210 along the axis of symmetry by 90°, 180°, or 270°, the structure of the modulation aperture 1210 coincides with the original structure. Correspondingly, the structure of the modulation aperture 1210 of the structural unit 121 includes circles, crosses, regular polygons, squares, ellipses, etc. This enables the spectral chip 10 to achieve polarization independence, allowing it to measure the spectral information of incident light without being affected by the polarization characteristics of the incident light.

[0119] The light modulation layer 120 can be formed on the upper surface of the image sensor 11 through processes such as bonding, coupling, bonding, and deposition. As an example, a corresponding light modulation layer material is deposited on the upper surface of the image sensor 11, and then etched to form corresponding modulation holes, thereby fabricating the filter structure 12 on the surface of the image sensor 11. Optionally, a dielectric layer material can be deposited on the upper surface of the image sensor 11 first, then the upper surface of the dielectric layer can be planarized to obtain a flat upper surface dielectric layer, then a light modulation layer material can be deposited on the upper surface of the dielectric layer, then a photoresist layer can be coated, and exposure etching can be performed to form the structural units corresponding to the light modulation layer. The photoresist layer can then be removed to obtain the desired spectral chip.

[0120] Those skilled in the art will understand that the spectral chip 10 can also be fabricated to obtain a light modulation layer first, and then the light modulation layer can be combined with the image sensor by coupling and bonding. It should be noted that the upper surface of the image sensor needs to be kept flat in this process. Therefore, preferably, a dielectric layer with a flat surface needs to be formed on the upper surface of the image sensor first.

[0121] Example 2

[0122] like Figure 3A and Figure 3B The diagram illustrates the structure of an optional embodiment of a spectral chip 10A in the zoom spectral device of the preferred embodiment of the present invention. In this embodiment, the spectral chip 10A has a regional chip structure. Specifically, the spectral chip 10A includes a filter structure 12A and an image sensor 11A, with the filter structure 12A disposed along the photosensitive path of the image sensor 11A. The filter structure 12A includes a light modulation layer 120A, wherein the light modulation layer 120A further includes a plurality of modulation regions 122A and at least one non-modulation region 123A for spacing adjacent modulation regions 122A, wherein the modulation regions 122A modulate the incident light, and the modulated incident light is received by the image sensor 11A, and the corresponding spectrum can be recovered by calculation.

[0123] The light modulation layer 120A of the filter structure 12A further includes a plurality of structural units 121A, wherein the structural units 121A of the light modulation layer 120A are located in the modulation region 122A of the light modulation layer 120A, and the structural units 121A of the light modulation layer 120A have corresponding transmission spectrum curves; while the non-modulation region 123A may not have any structure, that is, the incident light is received by the physical pixels of the image sensor in the corresponding region without any processing. Optionally, the non-modulation region 123A also has adjustment functions such as filtering, deflection, convergence, refraction, diffraction, diffusion and / or collimation of the incident light, and it can be implemented as a structure with specific adjustment functions such as a filter, concave lens, convex lens, optical diffraction.

[0124] Preferably, in this preferred embodiment of the present invention, the modulation region 122A of the light modulation layer 120A is implemented as the structural unit 121A composed of modulation apertures, while the non-modulation region 123A is composed of common imaging pixels such as RGB pixels or black and white pixels.

[0125] It is worth mentioning that, in this preferred embodiment of the present invention, the spectral information of the object under test is determined by the spectral information of the pixel corresponding to each structural unit 121A of the modulation region 122A of the light modulation layer 120A of the spectral chip 10A, irradiated by the target beam from the object under test; and the image information of the object to be imaged is determined by the light intensity information of the pixel corresponding to each non-modulation region 123A in the light modulation layer 120A irradiated by the target beam. Therefore, compared with the image sensor of the prior art, the spectral chip 10A of the spectral device of the present invention can obtain spectral information without affecting the spatial resolution and imaging quality of the image, making it easier to obtain more comprehensive information about the object to be imaged. Since the spectral information of the object under test can be used to uniquely identify the object to be imaged, qualitative or quantitative analysis of the object to be imaged can be achieved through the spectral information of the object to be imaged. This allows the spectral chip to be applied to fields such as fruit freshness, air pollution level, AI scene recognition, and liveness detection, increasing the application scenarios of the spectral imaging chip and providing a theoretical basis for the widespread application of the spectral imaging chip.

[0126] Example 3

[0127] like Figures 4A to 6 The diagram illustrates the structure of an optional embodiment of a spectral chip 10B in the zoom spectral device of the preferred embodiment of the present invention. In this embodiment, the spectral chip 10B has a multilayer structure. In practical industry, due to limitations in processing technology, fabricating structural units with complex structures and forming structural units with high processing precision present a technical contradiction. Specifically, when the structural unit used to modulate incident light is a modulation aperture (i.e., when the structural unit is a modulation aperture, such as a through-hole or blind aperture), ideally, the more complex the modulation aperture, the better the modulation effect on the incident light. However, in practical industry, it is difficult to obtain complex modulation apertures using existing production processes. In particular, the deeper the modulation aperture, the more difficult it is to guarantee its precision. For example, in etching, the precision is higher at shallower depths, but as the aperture is processed deeper, the etching solution concentration, etching time, and speed become more difficult to control, which may lead to lower etching precision.

[0128] Maintaining manufacturing precision while increasing the complexity of structural units is difficult. This embodiment reduces the complexity requirements of the structural units in a single modulation layer by using multi-layer modulation. It should be understood that the precision of the structural units in a single modulation layer can be achieved with existing manufacturing processes, while multi-layer modulation allows for relatively flexible adjustment of the overall modulation structure complexity of the spectral chip according to actual needs.

[0129] In detail, taking a two-layer optical modulation layer as an example, the spectral chip 10B includes a filter structure 12B and an image sensor 11B, with the filter structure 12B disposed along the photosensitive path of the image sensor 11B. The filter structure 12B of the spectral chip 10B includes a first optical modulation layer 124B and a second optical modulation layer 125B, wherein the first optical modulation layer 124B and the second optical modulation layer 125B are used to modulate the incident light. The first optical modulation layer 124B and the second optical modulation layer 125B are stacked vertically to form an optical modulation layer 120B of the filter structure 12B. It is understood that in this preferred embodiment of the present invention, the optical modulation layer 120B may further include a third modulation layer or a fourth modulation layer; that is, the number of layers of the optical modulation layer 120B is merely an example and not a limitation.

[0130] The image sensor 11B is used to receive the modulated light signal and process the modulated light signal to obtain the spectral information of the target. The first light modulation layer 124B and the second light modulation layer 125B work together to modulate the incident light. It is worth mentioning that the transmission spectrum matrix A corresponding to the spectral chip 10B in this preferred embodiment of the present invention cannot be simply understood as the convolution of the transmission spectrum A1 of the first light modulation layer 124B and the transmission spectrum A2 of the second light modulation layer 125B, but is a transmission spectrum matrix A formed by the combined action of the first light modulation layer 124B and the second light modulation layer 125B.

[0131] As an example, in this preferred embodiment of the present invention, both the first optical modulation layer 124B and the second optical modulation layer 125B can be implemented as having a modulation aperture structure. Specifically, the first optical modulation layer 124B further includes a plurality of first structural units 1241B, and the second optical modulation layer 125B further includes a plurality of second structural units 1251B, wherein at least one first structural unit 1241B and at least one second structural unit 1251B correspond to each other; that is, the incident light from the object under test is modulated by the first structural unit 1241B and then by the second structural unit 1251B to improve the optical modulation effect of the optical modulation layer 120B. Each first structural unit 1241B further has at least one first modulation aperture 1240B, and each second structural unit 1251B further has at least one second optical modulation aperture 1250B. The first modulation aperture 1240B of the first optical modulation layer 124B differs from the corresponding second modulation aperture 1250B of the second optical modulation layer 125B.

[0132] It is understood that the difference between the first modulation aperture 1240B and the second modulation aperture 1250B may be due to differences in structure (e.g., shape, type) and / or structural parameters (e.g., structural dimensions, structural depth). In one example of the present invention, one of the first modulation apertures 1240B of the first structural unit 1241B is a circular aperture, and the second optical modulation aperture 1250B of the second structural unit 1251B corresponding to the first structural unit 1241B is a square aperture. In another example of the present invention, one of the first modulation apertures 1240B of the first structural unit 1241B is a circular aperture, and the second optical modulation aperture 1250B of the second structural unit 1251B corresponding to the first structural unit 1241B is also a circular aperture, but with different diameters and / or aperture depths.

[0133] To further demonstrate the advantages of this application, such as Figure 5A and Figure 5B The illustration shows the first structural unit 1241B and the second structural unit 1251B of the optical modulation layer 120B being implemented as a first circular aperture and a second circular aperture, and the transmission spectrum corresponding to the multilayer structure after the first and second circular apertures are combined. Figure 5A In the intended effect, the structural unit shapes corresponding to the first and second curves are both circular holes, but their sizes differ; Figure 5B As shown in the diagram, the curve represents a new modulation effect produced by the combination of the first and second circular holes. It is evident that the combination of two simple graphics can complicate the transmission spectrum, thereby improving the final recovery accuracy.

[0134] like Figure 4A and Figure 4B As shown, the spectral chip 10B further includes a dielectric layer 13B, wherein the dielectric layer 13B is formed between the image sensor 11B and the filter structure 12B of the spectral chip 10B to bond the filter structure 12B and the image sensor 11B. As an example, the dielectric layer 13B can be silicon dioxide, and the dielectric layer 13B has a flat upper surface, thereby improving the bonding performance between the filter structure 12B and the image sensor 11B.

[0135] The spectral chip 10B further includes a connecting layer 14B, which is located between the first optical modulation layer 124B and the second optical modulation layer 125B of the filter structure 12B, and serves to connect the first optical modulation layer 124B and the second optical modulation layer 125B. Preferably, the connecting layer 14B is made of a low refractive index material, such as silicon oxide, which is beneficial for improving the complexity of the transmission spectrum of the spectral chip 10B. It is worth mentioning that the refractive index of the connecting layer 14B differs significantly from that of the optical modulation layer 120B.

[0136] like Figure 6 Another optional embodiment of the spectral chip 10B of the present invention is shown, wherein the spectral chip 10B further includes at least one filling structure 15B, wherein the filling structure 15B is formed in the first light modulation layer 124B and / or the second light modulation layer 125B of the light filtering structure 12B, and light can be transmitted through the filling structure 15B of the spectral chip 10B. It is worth mentioning that, in this preferred embodiment of the present invention, the filling structure 15B of the spectral chip 10B is formed within the modulation aperture of the first light modulation layer 124B and / or the second light modulation layer 125B to improve modulation complexity.

[0137] As an example, the first optical modulation layer 124B fills the filling structure 15B, or the second optical modulation layer 125B fills the filling structure 15B. Alternatively, both the first optical modulation layer 124B and the second optical modulation layer 125B may have filling structures. The corresponding filling structures 15B may be the same or different. Preferably, in this embodiment, the first optical modulation layer 124B and the second optical modulation layer 125B are made of high refractive index materials, such as silicon nitride or single-crystal silicon; the filling structure 15B is formed of a low refractive index material, such as metal or silicon oxide. Further, the spectral chip 10B further includes a capping layer 16B, which is located on the upper surface of the first optical modulation layer 124B of the filter structure 12B. Therefore, it can be understood that the incident light of the object under test first passes through the cover layer 16B, enters the first light modulation layer 124B of the filter structure 12B, that is, passes through the first structural unit 1241B, then enters the connection layer 14B, and then enters the second light modulation layer 125B, that is, after passing through the second structural unit 1251B, the incident light is modulated, and then received by the image sensor 11B.

[0138] Example 4

[0139] As image sensor technology advances, the physical pixel size of the image sensor decreases, making it difficult to focus incident light onto the corresponding physical pixel, leading to interference between physical pixels. This interference will affect the matrix A and output b of the interfering pixel unit. i The discrepancy between the actual and the predicted results will lead to deviations in the spectral reconstruction results, making them inconsistent with reality.

[0140] In response to the above technical problems, such as Figure 7 and Figure 8As shown, a spectral chip 10C according to another aspect of the present invention is illustrated in the following description. The spectral chip 10C includes an image sensor 11C, a filter structure 12C located on the photosensitive path of the image sensor 11C, and a plurality of grids 17C for preventing crosstalk of incident light at the image sensor 11C. Accordingly, the image sensor 11C includes a substrate layer 111C and at least one physical pixel formed on the substrate layer 111C. In this embodiment, the physical pixels are arranged in an array on the substrate layer 111C to form a physical pixel array. The filter structure 12C includes at least one structural unit 121C having a specific transmission spectrum for modulating incident light, and the grids 17C are located between the structural units 121C. Each structural unit 121C of the filter structure 12C and at least one physical pixel group of the image sensor 11C constitute a structural pixel 102C.

[0141] The spectral chip 10C can prevent crosstalk between incident light entering the structural pixels 102C by using grids 17C disposed between the structural pixels 102C. It is worth noting that in this embodiment, the structural pixels 102C can be divided into two cases: one where a group of structural units 121C corresponds to one physical pixel, in which case the grids 17C can be understood as being disposed between adjacent structural units 121C and surrounding the corresponding physical pixel. Preferably, in this application, a group of structural units 121C corresponds to multiple physical pixels, such as 4, 9, or 16 physical pixels, etc., and the multiple physical pixels are square, such as 2*2, 3*3, or 4*4 physical pixels. The grids 17C are disposed with the structural pixels 102C as units, that is, the grids 17C are disposed between adjacent filter structure units 12C and surround the corresponding multiple physical pixels.

[0142] Furthermore, the grid 17C can be made of metallic or non-metallic materials, such as copper or aluminum, or it can be made of a low-n material, wherein the low-n material can be a low-refractive-index material. It is worth mentioning that metallic or low-n materials can cause incident light incident on the surface of the grid 17C to be reflected into the corresponding physical pixel, which, in addition to preventing crosstalk, can also improve the corresponding QE value.

[0143] Optionally, in other alternative embodiments of the present invention, the light modulation layer 120C of the spectral chip 10C further includes a plurality of modulation regions 122C and at least one non-modulation region 123C for spacing adjacent modulation regions 122C, wherein the modulation regions 122C modulate the incident light, and the modulated incident light is received by the image sensor 11C, and the corresponding spectrum can be recovered by calculation. In this preferred embodiment of the present invention, the modulation regions 122C of the light modulation layer 120C have structural pixels 102C composed of structural units 121C and physical pixels, so the grid 17C is disposed between the structural units 121C, with the structural pixels 102C as units; the non-modulation regions 123C of the light modulation layer 120C are disposed between the physical pixels, with the grid 17C as units.

[0144] Example 5

[0145] Current spectral imaging technology is mainly based on spectrometers combined with mechanical scanning structures. This approach requires precise control of the mechanical scanning and a trade-off between scanning step size, leading to increased costs and reduced temporal resolution. In contrast, spectrometers utilizing filters and photodetector arrays, due to their inherent two-dimensional photosensitive structure, can directly achieve spectral imaging through arraying. This approach has irreplaceable advantages in cost, temporal resolution, and integration. Combined with computational spectroscopy methods, the spatial resolution of this approach can be significantly improved, resulting in a substantial overall advantage. However, this approach has significant data storage and logical processing requirements, especially under conditions of high spectral resolution, high spatial resolution, and high frame rate, posing new challenges to the system architecture.

[0146] Referring to the accompanying drawings of this invention Figure 9 As shown, a spectral device according to another preferred embodiment of the present invention will be described below. Unlike the first preferred embodiment described above, the spectral device includes a spectral chip 10D, which comprises an image sensor 11D, a filter structure 12D located on the optical path of the image sensor 11D, multiple memories 18D, and a logic processing component 19D. The image sensor 11D, the memories 18D, and the logic processing component 19D are arranged in a stacked structure to realize the transmission and processing of data and / or signals. The memories 18D are typically RAM, such as DRAM, SRAM, etc. The logic processing component 19D consists of multiple first-level logic processors 191D and multiple second-level logic processors 192D. Furthermore, the logic processors can be processing units such as ISP, CPU, GPU, or NPU, or logic computing units customized for specific algorithms, i.e., computing units that have specific operators embedded in their memory.

[0147] The spectral chip 10D is divided into a first stacked layer 101D and a second stacked layer 103D. The first stacked layer 101D includes the image sensor 11D, a plurality of memories 18D, and a plurality of first-level logic processors 191D with physical pixels as the smallest unit. The image sensor 11D, the plurality of memories 18D, and the logic processors 19D are stacked sequentially, wherein one physical pixel of the image sensor 11D corresponds to one memory 18D and one first-level logic processor 191D. The second stacked layer 103D includes at least one second-level logic processor 192D, which is located below the first stacked layer 101D and connected to the first-level logic processors 191D. Photoelectric conversion, signal storage, and traditional image processing, such as signal scanning phase difference and color difference processing, can be performed through the first stacked layer. This layer processes the signal read from each physical pixel. Based on this, the signals read from the physical pixels constituting the spectral pixels are then transmitted to the secondary logic processor 192D of the corresponding second stacked layer 103D. The second stacked layer 103D performs logic operations related to spectral recovery, such as using the aforementioned artificial neural network, least 2 norm, etc.

[0148] In this embodiment, the secondary logic processor 192D is connected to at least one primary logic processor 191D, enabling direct or indirect data transmission. Both processors perform different processing on the received signals, allowing each secondary logic processor 192D to directly perform spectral reconstruction for each spectral pixel. Further arraying and expanding the spectral pixels yields a spectral image. Notably, the secondary logic processor 192D can be configured in units of spectral pixels. For example, if the spectral pixels comprise 10*10 physical pixels, then the secondary logic processor 192D can be connected to 10*10 primary logic processors 191D.

[0149] From the perspective of the stacking structure, the image sensor 11D of the spectral device in this embodiment has an integration function, both in terms of physical structure and data flow. That is, in terms of physical aspect, the secondary logic processor is integrated (close to) its corresponding physical pixel as much as possible to reduce the data transmission distance. In terms of data aspect, the data of the physical pixels that constitute the spectral pixels are uniformly transmitted to the corresponding secondary logic processor for calculation.

[0150] Example 6

[0151] Figures 10 to 11BFurther explanation is provided regarding a specific implementation of an optical system 20 of the spectral device according to any of the preferred embodiments of the present invention. As an example, in this preferred embodiment of the invention, the optical system 20 is implemented as a vertical lens.

[0152] It should be noted that different objects under test have different properties and exhibit different characteristics. Therefore, a corresponding transmission spectrum matrix A is needed to modulate the incident light containing information about the object under test, which can improve the accuracy of object identification and detection. In other words, in this preferred embodiment of the invention, based on the properties, type, and characteristics of the object under test, the optical system 20 adjusts the principal angle and the receiving cone angle of the incident light from the object under test onto the spectral chip 10, so that the transmission spectrum matrix A corresponding to the spectral chip 10 can adapt to the characteristics of the object under test, thereby improving the accuracy of object identification and detection. In other words, the present invention, based on the influence of the principal angle on the transmission spectrum matrix A, uses the optical system 20 of the spectral device to achieve accurate identification or testing of different objects under test in different scenarios.

[0153] In detail, in this preferred embodiment of the present invention, the optical system 20 can be implemented as a zoom lens group. The optical system 20 includes at least one lens assembly 21. Based on the characteristics of the object under test, by adjusting the relative position of the at least one lens assembly 21, the effective focal length of the optical system 20 is changed, so that the transmission spectrum matrix corresponding to the principal angle and / or the receiving cone angle of the incident light from the object under test incident on the spectral chip 10 is more suitable for the object under test.

[0154] like Figure 10 As shown, the lens assembly 21 of the optical system 20 further includes a first lens group 21a, a second lens group 21b, and a third lens group 21c, wherein the first lens group 21a, the second lens group 21b, and the third lens group 21c are arranged along the same optical axis, and the second lens group 21b is located between the first lens group 21a and the third lens group 21c.

[0155] Preferably, the first lens group 21a and the third lens group 21c are relatively fixed in position on the optical axis, while the second lens group 21b can be driven and moved along the optical axis, thereby achieving zoom (changing the effective focal length). It is worth mentioning that, in other optional embodiments of the present invention, the first lens group 21a can also be movable, and the zoom magnification can be increased by moving the first lens group 21a. Further, the second lens group 21b further includes at least one zoom lens 211b and at least one compensation lens 212b, and zoom is achieved by moving the zoom lens 211b and the compensation lens 212b.

[0156] The spectral chip 10 includes a filter structure 12 and an image sensor 11. The filter structure 12 is located on the optical path of the image sensor 11. The filter structure 12 includes multiple structural units 121, wherein each structural unit 121 can modulate the incident light after passing through the optical system 20 before it is received by the image sensor 11. Each structural unit 121 has a corresponding transmission spectrum curve, which can modulate the incident light.

[0157] The working principle of the spectral device is as follows: the incident light containing the object to be measured first enters the optical system 20. After adjustment by the optical system 20, it will be incident on the surface of the filter structure 12 with a specific principal angle and receiving cone angle. After being modulated by the filter structure 12, it is received by the image sensor 11. Then, the corresponding spectral information is recovered or calculated by the algorithm, thereby realizing the identification or detection of the object to be measured.

[0158] The optical system 20 further includes at least one moving mechanism 22, wherein the second lens group 21b of the optical system 20 is tractively connected to the moving mechanism 22. The moving mechanism 22 drives the second lens group 21b to move, thereby changing the focal length of the optical system 20, which in turn changes the principal angle and / or the receiving cone angle of the incident light reaching the surface of the filter structure 12. Specifically, the moving mechanism 22 is tractably connected to the zoom lens 211b and the compensation lens 212b of the second lens group 21b. The moving mechanism 22 drives the zoom lens 211b and the compensation lens 212b of the second lens group 21b to adjust the focal length of the optical system 20.

[0159] The structural unit 121 of the spectral chip 10 corresponding to the optical system 20 changes its corresponding transmission spectrum curve due to changes in the principal angle and / or the receiving cone angle of the incident light. Since the transmission spectrum matrix A is composed of the transmission spectrum curves of multiple structural units, zooming of the optical system 20 will cause a change in the transmission spectrum matrix A, thereby selecting the corresponding focal length for identification and detection based on the characteristics of the object under test, thereby improving the identification and detection accuracy. The moving mechanism 22 can be implemented as a motor, piezoelectric ceramic, or other device that moves the lens.

[0160] Furthermore, the spectral device further includes at least one focusing mechanism 40, wherein the focusing mechanism 40 is connected to the first lens group 21a, and the focusing is achieved by driving the first lens group 21a through the focusing mechanism 40. Optionally, in other alternative embodiments of the present invention, the focusing mechanism 40 may also operate on the entire optical system 20, that is, the optical system 20 is connected to the focusing mechanism 40, and focusing is achieved by moving the optical system 230.

[0161] The optical system 20 further includes an aperture stop 23, which is disposed at the front end of the first lens group 21a.

[0162] Furthermore, in everyday operation, jitter in the spectral device results in six degrees of freedom of displacement: linear movement in three orthogonal directions (X, Y, and Z), roll (tilt about the X-axis), yaw (tilt about the Z-axis), and pitch (tilt about the Y-axis). "Roll" also involves tilting around the optical axis of the spectral chip 10 that provides the recovered image. Roll causes rotation of the image around its center (and can therefore be termed "image roll"). Linear motion in XYZ has little impact on the quality of spectral recovery and can be largely left uncompensated, especially the movement along the Z-axis (i.e., the movement along the optical axis). Alternatively, stabilization can be achieved by connecting the spectral device itself to a stabilization mechanism, which drives the overall movement of the spectral device.

[0163] The spectroscopic device further includes at least one image stabilization mechanism 50, wherein the image stabilization mechanism 50 is connected to the first lens group 21a. That is, the image stabilization mechanism 50 acts on the first lens group 21a of the optical system 20 to achieve image stabilization through the rolling, yaw, movement, and / or pitch of the first lens group 21a. The image stabilization mechanism 50 is connected to the first lens group 21a and obtains information from inertial devices such as accelerometers or gyroscopes to acquire the jitter of the spectroscopic device. The image stabilization mechanism 50 then drives and generates rolling, yaw, movement, and / or pitch in the opposite direction to achieve image stabilization. The more dimensions of image stabilization the image stabilization mechanism 50 needs to achieve, the more requirements it places, generally resulting in the image stabilization mechanism occupying more space and making the spectroscopic device too large. Therefore, in this preferred embodiment of the invention, the spectroscopic device has at least two-axis image stabilization. For example, when two-axis image stabilization is achieved, it generally prevents the yaw and pitch effects caused by X and Y axis jitter; while three-axis image stabilization generally prevents the yaw, pitch, and yaw effects caused by X, Y, and Z axes. For five-axis image stabilization, X and Y axis translation compensation is introduced on top of the three-axis stabilization.

[0164] In another optional embodiment of the present invention, the optical system 20 and the spectral chip 10 simultaneously have image stabilization functions, thereby achieving a multi-axis image stabilization effect. That is, the image stabilization mechanism 50 is tractably connected to the optical system 20 and the spectral chip 10, and the image stabilization mechanism 50 drives the optical system 20 and the spectral chip 10 to move in coordination to improve the image stabilization effect.

[0165] It should be noted that the image stabilization mechanism can also interact directly with the optical system to achieve image stabilization; or it can be directly connected to the spectral device to achieve overall image stabilization.

[0166] Example 7

[0167] Figures 12 to 13 Further explanation is provided regarding another specific embodiment of the optical system 20A of the spectral device described in any of the preferred embodiments of the present invention. As an example, in this preferred embodiment of the present invention, the optical system 20A is implemented as a liquid lens.

[0168] The optical system 20A described in this embodiment includes at least one liquid lens assembly 25A and at least one lens assembly 21A. The liquid lens assembly 25A and the lens assembly 21A are arranged one after the other along the same optical axis. The liquid lens assembly 25A can change its curvature, thereby changing the focal length of the optical system 20A.

[0169] The liquid lens assembly 25A may include at least one deformable lens body 251A, a flexible transparent cover member 252A, and an actuator 253A, wherein the flexible transparent cover member 252A is attached to the surface of the at least one deformable lens body 251A to provide mechanical stability to the at least one deformable lens body 251A. The actuator 253A is used to shape the flexible transparent cover member 252A into a desired shape. The actuator 253A is located on the upper surface of the flexible transparent cover member 252A, and the desired shape is defined by a configuration pattern of the actuator 253A and a respective voltage amplitude applied to the configuration pattern of the actuator 253A. Work is performed on the deformable lens body 251A by the actuator 253A, causing the deformable lens body 251A to deform, thereby causing the optical system 20A to zoom. Preferably, the at least one deformable lens body 251A has an elastic modulus greater than 300 Pa, thereby avoiding deformation caused by attraction in the flexible transparent cover component 252A during normal operation. Preferably, the lens body 251A has a refractive index as high as possible, such as in the range of 1.35-1.90. Accordingly, the refractive index of the lens body should be at least 1.35, such as in the range of 1.35-1.75, such as in the range of 1.35-1.55. The absorptivity of the deformable lens body 251A in the visible light region is less than 10% per millimeter of thickness, and the deformable lens body 251A comprises a polymer network of cross-linked or partially cross-linked polymers, and further comprises mixed oils or bound oils, thereby increasing the refractive index of the polymer network of cross-linked or partially cross-linked polymers.

[0170] Similar to the preferred embodiment described above, the spectral device further includes at least one focusing mechanism 40A, wherein the focusing mechanism 40A is connected to the first lens group 21a, and the focusing is achieved by driving the first lens group 21a through the focusing mechanism 40A. The optical system 20A also includes an aperture stop 23A, which is disposed at the front end of the first lens group 21a.

[0171] The spectroscopic device further includes at least one image stabilization mechanism 50A, wherein the image stabilization mechanism 50A is connected to the liquid lens assembly 25A and / or the at least one lens assembly 21A of the optical system 20A, or the image stabilization mechanism 50A is connected in a driving manner to the spectroscopic chip 10, thereby driving the optical system 20A and / or the spectroscopic chip 10 to achieve the image stabilization function of the spectroscopic device. Preferably, the image stabilization mechanism is disposed on the lens assembly 21A.

[0172] Example 8

[0173] Figures 14A to 15 Further explanation is provided regarding another specific embodiment of the optical system 20B of the spectral device described in any of the preferred embodiments of the present invention. As an example, in this preferred embodiment of the present invention, the optical system 20B is implemented as a periscope lens.

[0174] The optical system 20B is a zoom lens, comprising at least one lens assembly 21B, at least one moving mechanism 22B, and at least one deflector 26B. The at least one moving mechanism 22B is connected to the at least one lens assembly 21B and drives the at least one lens assembly 21B to move, thereby changing the focal length of the optical system 20B. The deflector 26B is disposed at the front end of the at least one lens assembly along its optical axis, deflecting the transmission direction of light incident on or exiting the at least one lens assembly 21B. The lens assembly 21B further comprises a first lens group 21a, a second lens group 21b, and a third lens group 21c, wherein the first lens group 21a, the second lens group 21b, and the third lens group 21c are arranged along the same optical axis, and the second lens group 21b is located between the first lens group 21a and the third lens group 21c.

[0175] The deflector 26B, the first lens group 21a, the second lens group 21b, and the third lens group 21c are arranged sequentially. After the incident light enters the deflector 26B and is deflected, it passes through the first lens group 21a, the second lens group 21b, and the third lens group 21c in sequence to reach the filter structure 12. After being modulated by the filter structure 12, it is received by the image sensor 11.

[0176] It is worth mentioning that at least one of the first lens group 21a, the second lens group 21b, and the third lens group 21c of the lens assembly 21B is tractably connected to the moving mechanism 22B. The moving mechanism 22B drives the first lens group 21a, the second lens group 21b, or the third lens group 21c to move, thereby changing the focal length of the optical system 20B. That is, the first lens group 21a can also be moved, and the zoom magnification is increased by moving the first lens group 21a. Preferably, the moving mechanism 22B is connected to the second lens group 21b, wherein the second lens group 21b includes at least one zoom lens 211b and at least one compensation lens 212b, and zoom is achieved by moving the zoom lens 211b and the compensation lens 212b. The at least one zoom lens 211b and the at least one compensation lens 212b of the second lens group 21b are tractably connected to the moving mechanism 22B, and the moving mechanism 22B drives the zoom lens 211b to move along the optical axis to adjust the overall focal length of the optical system 20B.

[0177] In this embodiment, the bending element 26B redirects the incident light from a vertical direction to a horizontal direction, thereby reducing the height of the spectroscopic device. The bending element 26B can be implemented as a prism or a mirror. Notably, at least one front lens group (not shown in the figure) can be optionally provided at the front end of the bending element 26B, which can increase the field of view (FOV) or the light flux of the spectroscopic device.

[0178] Furthermore, since the optical system 20B typically corresponds to a long optical path, its size in one direction becomes excessively large. For example... Figure 14B Another optional embodiment of the present invention is shown, wherein the turning element 26B of the optical system 20B further includes a first turning element 261B and a second turning element 262B, wherein the first turning element 261B turns the incident light in the height direction (which can be defined as the Z-axis) to propagate along the X-axis, and the second turning element 262B turns the incident light propagating along the X-axis to the Y-axis, wherein the X-axis and Y-axis are perpendicular, and the Z-axis is perpendicular to the plane formed by the X and Y axes. The first turning element 261B, the first lens group 21a, the second lens group 21b, the second turning element 262B, the third lens group 21c, and the spectral chip 10 are arranged sequentially.

[0179] It is worth mentioning that, to ensure sufficient light intake, the lens size corresponding to the first lens group 21a is often the largest, which directly determines the height of the spectroscopic device. Therefore, the first lens group 21a can include at least one first lens 211a, wherein the at least one lens 211a is chamfered along a direction perpendicular to the Z-axis. The first lens 211a includes an effective region and an ineffective region. The height of the lens can be controlled by removing the ineffective region, thereby reducing the height of the spectroscopic device. It is understood that by chamfering, the height of the first lens 211a can be controlled to be less than or equal to 6mm, further ensuring that the height of the spectroscopic device is less than or equal to 6.5mm.

[0180] Preferably, the first lens element 211a is less than or equal to 5.5 mm, and the spectral device is less than or equal to 5.9 mm. Furthermore, to compensate for the reduced light intake, the first lens element 211a of the first lens group 21a is implemented as a glass lens, thereby reducing light loss and increasing the amount of light entering the lens.

[0181] Similar to the preferred embodiment described above, the spectral device further includes at least one focusing mechanism 40B, wherein the focusing mechanism 40B is connected to the first lens group 21a, and the focusing mechanism 40B drives the first lens group 21a to achieve focusing. The optical system 20B also includes an aperture stop 23B, which is disposed at the front end of the first lens group 21a.

[0182] like Figures 14A to 15 As shown, the spectroscopic device further includes at least one image stabilization mechanism 50B, wherein the image stabilization mechanism 50B is connected to the optical system 20B of the spectroscopic device, and the movement of the optical system 20B driven by the image stabilization mechanism 50B compensates for the jitter generated by the spectroscopic device during use.

[0183] It is understood that the tilting motion (or “rotation”) of the bend member 26B of the optical system 20B, such as a prism or mirror, about any axis can advantageously be used in conjunction with the movement of the lens module for complete OIS, including compensation for image movement and displacement caused by roll, pitch, and yaw. Displacement caused by the tilt of the bend member 26B is compensated by an appropriate opposite displacement movement of the optical system 20B, while roll caused by the tilt of the bend member 26B is used for OIS to compensate for image roll. Roll compensation is based on the fact that rotation of the bend member 26B about the Y direction results in image displacement in the X direction, while rotation of the bend member 26B about another axis such as X or Z results in image displacement in the Y direction and image rotation about the Z direction. For example, any tilt of the bend member 26B about an axis in the XZ plane will result in roll + image displacement in the Y direction. That is, preferably, the jitter caused by rotation about the X, Y, and Z axes is compensated by the tilt or rotation of the bend member 26B, and the horizontal movement problem is solved by the movement of the lens assembly 21B. It should be noted that this horizontal movement can be caused by the user's hand shaking or by the anti-shake rotation of the pivot component.

[0184] The image stabilization mechanism 50B further includes a first image stabilization component 51B and a second image stabilization component 52B. The first image stabilization component 51B is connected to the pivot member 26B, and the pivot member 26B rotates via the first image stabilization component 51B to compensate for roll, pitch, and yaw. The second image stabilization component 52B is connected to the lens assembly 21B of the optical system 20B, and the lens assembly 21B is driven to move horizontally via the second image stabilization component 52B to solve the horizontal shaking problem and achieve multi-axis image stabilization. Preferably, the second image stabilization component 52B is connected to the first lens group 21a, and horizontal image stabilization is achieved by moving the first lens group 21a.

[0185] As an example, in other alternative embodiments of the present invention, the image stabilization mechanism 50B is connected to the spectral chip 10, and the image stabilization mechanism 50B drives the spectral chip 10 to move in order to compensate for the jitter caused by the movement of the optical system 20B.

[0186] Optionally, in other alternative embodiments of the present invention, the first image stabilization mechanism component 51B is used to drive the pivot member 26B to achieve two degrees of freedom compensation of roll (tilt about the X-axis) and pitch (tilt about the Y-axis), and the second image stabilization mechanism component 52B is used to drive the first lens group 21a to achieve three degrees of freedom compensation of yaw (tilt about the Z-axis) and horizontal movement. Optionally, the image stabilization mechanism 50B further includes a third image stabilization mechanism component, wherein the first image stabilization mechanism component 51B is used to drive the pivot member 26B to achieve two degrees of freedom compensation of roll (tilt about the X-axis) and pitch (tilt about the Y-axis), the second image stabilization mechanism component 52B is used to drive the first lens group 21a to achieve yaw (tilt about the Z-axis), and the third image stabilization mechanism component is used to drive the spectral chip 10 to achieve horizontal movement compensation.

[0187] Example 9

[0188] Figure 16 Further illustrating an exemplary structure of the spectroscopic device according to any of the preferred embodiments of the present invention, the spectroscopic device further includes a circuit board 70, to which the spectroscopic chip 10 is electrically connected. The spectroscopic chip 10 can be implemented as a chip-on-board (COB), a chip-scale package (CSP), or a flip-chip package. It is worth noting that the circuit board 70 can be, but is not limited to, a PCB, an F-PCB, or a ceramic substrate. When the spectroscopic device is used for imaging or video recording, the spectroscopic chip 10 generates significant heat. Therefore, preferably, the circuit board 70 is implemented as a ceramic substrate. Furthermore, the spectroscopic device may also include a heat sink 60, which can be attached to the circuit board 70 or to the spectroscopic chip 10 to improve heat dissipation of the spectroscopic chip 10.

[0189] The spectroscopic device further includes a bracket 80, which is disposed on the circuit board 70. The optical system 20 is disposed on the bracket 80. The bracket 80 has a light-transmitting hole to allow light entering the optical system 20 to pass through and be received by the spectroscopic chip 10. Preferably, the bracket 80 is formed from an opaque material such as plastic through a process such as injection molding, and then fixed to the circuit board 70 with an adhesive. Further, the bracket 80 can also be integrally formed on the circuit board 70. For example, the circuit board with the spectroscopic chip 10 attached is placed in a mold, the mold is closed, molding material is injected, cured, and the mold is removed. An integrally formed molded body is formed on the circuit board and covers the non-imaging area of ​​the spectroscopic chip, which can effectively improve the reliability of the spectroscopic chip and the circuit board, and further reduce the size of the spectroscopic device to a certain extent.

[0190] For specific applications, the spectroscopic device may further include a filter (not shown in the figure), which is disposed between the optical system 20 and the spectroscopic chip 10, located on the optical path of the spectroscopic chip 10. The filter is used to filter incident light in unwanted wavelengths, thereby improving image quality. Preferably, the filter is attached to the bracket.

[0191] Figure 17 An experimental diagram illustrating the effect of the principal angle of the spectral chip 10 of the spectral device according to any of the preferred embodiments of the present invention on the transmission spectrum curve is shown. It is worth noting that different objects to be tested have different properties and exhibit different characteristics; therefore, a corresponding transmission spectrum matrix A is needed to modulate the incident light containing information about the object to be tested, which can improve the accuracy of object identification and detection.

[0192] The change in the principal beam angle and / or the receiving beam cone angle causes a change in the transmission spectrum matrix A. This allows a single spectroscopic device to adjust the principal beam angle and / or the receiving beam cone angle for different objects under test, making the corresponding transmission spectrum matrix A more closely match the object, thus achieving high-precision identification or detection. For ease of explanation, the correlation coefficient between each row of the transmission spectrum matrix A is introduced here. "Fitness" refers to a low correlation coefficient between each row of the transmission spectrum matrix A in the corresponding spectral band of the object under test during identification and detection. Therefore, the spectroscopic device in any of the preferred embodiments described above can have multiple different transmission spectrum matrices A by changing the focal length of the optical system 20, enabling high-precision identification or detection in different scenarios. To further enhance understanding, this invention provides experimental diagrams illustrating the influence of the principal beam angle on the transmission spectrum curve.

[0193] Furthermore, it is necessary to determine the characteristics of the application scenario or the object under test, namely, the spectral characteristics of the incident light containing information about the object under test, and then adapt a more suitable transmission spectrum matrix A based on the spectral characteristics of the incident light generated by the object under test. For ease of understanding, as an example, the spectroscopic device needs to be applied to accurately detect at least five items a, b, c, d, and e with different spectral characteristics. In this case, the spectroscopic device should have at least five transmission spectrum matrices Aa, Ab, Ac, Ad, and Ae, where the correlation coefficient corresponding to the transmission spectrum curve Aa is low in the spectral band of item a.

[0194] Therefore, it is necessary to measure the corresponding transmission spectrum matrices Aa, Ab, Ac, Ad, and Ae, and simultaneously record the principal angles corresponding to the transmission spectrum matrices, and / or the zoom position (shape) of the optical system 20, and burn these values ​​into the spectral chip 10 of the spectral device. Thus, when a user needs to test a corresponding object, the spectral device sends a command to drive the zoom lens group to move or deform, thereby determining the focal length of the incident light in the optical system of the spectral device, making the corresponding transmission spectrum matrix more suitable for the spectral characteristics of the object under test.

[0195] In short, in this preferred embodiment of the invention, by adjusting the focal length of the optical system 20 of the spectroscopic device, the principal angle and / or the receiving cone angle of the incident light from the object under test are varied, thereby enabling the spectroscopic chip 10 to have multiple different transmission spectrum matrices A. Therefore, based on the characteristics of the object under test, by adjusting a specific transmission spectrum matrix A of the spectroscopic chip 10, the spectroscopic device can be adapted to the current object under test, thereby improving the accuracy of the spectroscopic device in reconstructing the spectrum of the object under test.

[0196] It is worth mentioning that in the spectroscopic device described in any of the preferred embodiments of the present invention, the zoom of the optical system 20 of the spectroscopic device causes a change in the principal angle and / or the receiving cone angle of the incident light from the object under test, thereby altering the transmission spectrum matrix A of the spectroscopic chip 10. It is understood that the spectroscopic device can be used independently, i.e., it can function as a standalone device for spectral curve testing, spectral imaging, or spectral video recording. The spectroscopic device can also be mounted on or integrated into a terminal device.

[0197] Example 10

[0198] like Figures 18A to 20B As shown, an optical system 20 applicable to the spectral apparatus described in the sixth and eighth preferred embodiments of the present invention will be explained in the following description. The optical system 20 includes a first lens group 21A, a second lens group 21B, and a third lens group 21C, wherein the first lens group 21A, the second lens group 21B, and the third lens group 21C are arranged sequentially on the photosensitive path. The first lens group 21A includes a first lens 211A and a second lens 212A; the second lens group 21B includes the third lens 211B and the fourth lens 212B; and the third lens group 21C includes the fifth lens 211C and the sixth lens 212C. Along the optical axis o of the optical system 20 from the object side to the image side (i.e., the incident light direction of the optical system 20), the first lens group 21A...

[0199] Lens 211A, the second lens 212A, the third lens 211B, the fourth lens 212B, the fifth lens 211C, and the sixth lens 212C are arranged in sequence.

[0200] The first lens 211A has an object-side surface s1 and an image-side surface s2, the second lens 212A has an object-side surface s3 and an image-side surface s4, the third lens 211B has an object-side surface s5 and an image-side surface s6, the fourth lens 212B has an object-side surface s7 and an image-side surface s8, the fifth lens 211C has an object-side surface s9 and an image-side surface s10, and the sixth lens 212C has an object-side surface s11 and an image-side surface s12.

[0201] The optical system 20 satisfies the following relationships: -3 < f2 / f1 < 0; 0 < f3 / f1 < 4; 0 < f4 / f1 < 4; -7 < f5 / f1 < -2; -3 < f6 / f1 < 0. f1 is the focal length of the first lens 211A, f2 is the focal length of the second lens 212A, f3 is the focal length of the third lens 211B, f4 is the focal length of the fourth lens 212B, f5 is the focal length of the fifth lens 211C, and f6 is the focal length of the sixth lens 212C. That is, f2 / f1 can be any value between (-3, 0), for example, it can be -2.99, -2.27, -2.25, -2.33, -2.26, -2.00, -1.55, -1.00, -0.98, -0.97, -0.05, -0.01, etc. f3 / f1 can be any value between the interval (0, 4). For example, this value can be 0.01, 0.02, 0.10, 0.50, 0.80, 0.99, 1.00, 1.11, 1.12, 1.50, 1.72, 1.75, 1.76, 2.00, 2.50, 3.00, 3.55, 3.99, etc. f4 / f1 can also be any value between the interval (0, 4). For example, this value can be 0.01, 0.02, 0.10, 0.50, 0.80, 0.99, 1.00, 1.01, 1.12, 1.50, 1.72, 1.75, 1.76, 2.00, 2.50, 3.00, 3.55, 3.99, etc. f5 / f1 can be any value between the interval (-7, -2), for example, the value can be -6.99, -6.85, -6.53, -6.24, -5.99, -5.89, -5.66, -5.36, -5.24, -4.99, -4.98, -4.90, -4.58, -4.57, -4.10, -4.00, -3.99, -3.50, -3.42, -3.25, -3.00, -2.50, -2.01, etc. f6 / f1 can be any value between the interval (-3, 0), for example, the value can be -2.99, -2.27, -2.25, -2.33, -2.26, -2.00, -1.55, -1.00, -0.72, -0.71, -0.05, -0.01, etc.

[0202] It should be noted that when a lens has positive refractive power, its focal length is positive; when a lens has negative refractive power, its focal length is negative. A negative focal length ratio between two lenses means that the two lenses have different refractive powers. For example, if f2 / f1 takes any value between (-3, 0), then the second lens 212A has positive refractive power, and the first lens 211A has negative refractive power; or the second lens 212A has negative refractive power, and the first lens 211A has positive refractive power. A positive focal length ratio between two lenses means that the two lenses have the same refractive power. For example, if f3 / f1 takes any value between (0, 4), then the third lens 211B has positive refractive power, and the first lens 211A has positive refractive power; or the third lens 211B has negative refractive power, and the first lens 211A has negative refractive power. The same applies to the fourth lens 212B, the fifth lens 211C, and the sixth lens 212C, which will not be described in detail here.

[0203] The first lens 211A, the second lens 212A, the third lens 211B, the fourth lens 212B, the fifth lens 211C, and the sixth lens 212C are glass lenses or plastic lenses. For example, the first lens 211A, the second lens 212A, the third lens 211B, the fourth lens 212B, the fifth lens 211C, and the sixth lens 212C are all glass lenses. Optionally, in other optional embodiments of the present invention, the first lens 211A, the second lens 212A, the third lens 211B, the fourth lens 212B, the fifth lens 211C, and the sixth lens 212C are all plastic lenses. Optionally, in other optional embodiments of the present invention, some of the lenses in the first lens 211A, the second lens 212A, the third lens 211B, the fourth lens 212B, the fifth lens 211C, and the sixth lens 212C are glass lenses, and the other part of the lenses are plastic lenses. Thus, by rationally configuring the lens materials, the optical system 20 can achieve ultra-thinness while correcting aberrations and solving temperature drift problems, and at a low production cost.

[0204] In the eighth preferred embodiment described above, the bending member 26B is located on the object side of the first lens group 21A, and is used to change the incident direction of the incident light of the optical system 20 to realize the periscope structure of the optical system 20B. This allows the imaging module to be mounted laterally on the electronic device, minimizing the space occupied in the width direction of the terminal device while reducing the space occupied in the thickness direction, thus meeting the user's demand for a thin and light terminal device. When the bending member 26B is implemented as a prism, it has an incident surface s13, a reflecting surface s14, and an exit surface s15, with the reflecting surface s14 obliquely connecting the incident surface s13 and the exit surface s15.

[0205] The optical system 20 may also include a filter (not shown in the figure), which is disposed between the spectral chip 10 and the third lens group 21C. The filter remains unchanged during the switching between short and long focal lengths and during autofocusing. The filter may be an IR pass filter or an IR cutoff filter, and filters with different wavelengths can be used depending on the actual application.

[0206] The optical system 20 may further include an aperture stop STO23, which may be disposed in the first lens group 21A. Specifically, the aperture stop STO23 may be disposed on the side of the first lens facing the exit surface s15 of the prism. During the switching between short and long focal lengths and during autofocusing, the aperture stop STO23 may be fixed together with the first lens group on the optical axis o. Along the optical axis o of the optical system 20 from the object side to the image side, the prism (removable), the first lens group (together with the aperture stop STO23), the second lens group, the third lens group, the filter (removable), and the spectral chip are arranged in sequence.

[0207] Specifically, optical system 20 satisfies the following conditions: f2 / f1 = -0.977, f3 / f1 = 1.113, f4 / f1 = 1.004, f5 / f1 = -5.373, f6 / f1 = -0.711. When optical system 20 is in short focal length mode, its focal length f = 30mm, CRA = 2.38°, FOV = 13.3°, and image height = 7mm. When optical system 20 is in long focal length mode, its focal length f = 90mm, CRA = 5.45°, FOV = 4.45°, and image height = 7mm.

[0208] In this invention, the first lens 211A and the second lens 212A of the first lens group 21A are cemented together; the third lens 211B and the fourth lens 212B of the second lens group 21B are cemented together; and the fifth lens 211C and the sixth lens 212C of the third lens group 21C are cemented together. Figure 19An example of the specific parameters of each lens of the optical system 20 of the preferred embodiment of the present invention is shown, which can eliminate spherical aberration and chromatic aberration, and also reduce the design difficulty to a certain extent.

[0209] like Figure 20A and Figure 20B A schematic diagram illustrating the optimized field curvature and distortion of the optical system 20 according to the preferred embodiment of the present invention is shown. The optical system optimizes field curvature by controlling it within ±0.1 mm across the entire field of view, thereby improving image quality. The optical distortion of the optical system is controlled within ±0.2%, controlling the deformation of the image acquired by the spectral chip, thus improving image quality.

[0210] Example 11

[0211] like Figure 21 As shown, the present invention further illustrates a terminal device incorporating the spectral device of any of the preferred embodiments described above. The terminal device includes a terminal device host 100 and at least one spectral device 200 disposed on the terminal device host 100. The terminal device may be, but is not limited to, a wearable device, a mobile phone, a tablet, etc. It is worth noting that the spectral device 200 may be implemented as the spectral device of any of the preferred embodiments described above, wherein the optical system 20 of the spectral device 200 can adjust its focal length to adjust the transmission spectrum matrix A of the spectral chip 10 of the spectral device 200 by zooming.

[0212] Taking the integration of the spectroscopic device into a terminal device as an example, in conjunction with the spectroscopic device of any of the preferred embodiments described above, the terminal device further includes a selection module 300. The selection module 300 can be built into the terminal device host 100, and the selection module 300 allows the user to select the scene to be tested or the object to be tested. Based on the user's selection, the terminal device host 100 sends a command that causes at least one lens in the optical system 20 of the spectroscopic device 200 to change, thereby changing the focal length of the optical system 20 (zoom lens), and consequently changing the principal angle and / or the receiving cone angle of the incident light reaching the spectroscopic chip 10 of the spectroscopic device 200. Based on the relationship between the focal length determined during initial calibration and the corresponding transmission spectrum matrix A, the corresponding focal length is selected according to the user's selection, making the transmission spectrum matrix A of the spectroscopic device 20 more compatible with the object to be tested. In short, in this preferred embodiment of the present invention, the user can manually adjust the spectral device through the terminal device, that is, select the corresponding focal length according to the user's choice, so that the transmission spectrum matrix A of the spectral device is more suitable for the object to be measured.

[0213] Example 12

[0214] like Figure 22 As shown, the present invention further illustrates a terminal device incorporating the spectral device of any of the preferred embodiments described above. The terminal device includes a terminal device host 100 and at least one spectral device 200 disposed on the terminal device host 100. The terminal device may be, but is not limited to, a wearable device, a mobile phone, a tablet, etc. It is worth noting that the spectral device 200 may be implemented as the spectral device of any of the preferred embodiments described above, wherein the optical system 20 of the spectral device 200 can adjust its focal length to adjust the transmission spectrum matrix A of the spectral chip 10 of the spectral device 200 by zooming.

[0215] Unlike the tenth preferred embodiment described above, the terminal device further includes an imaging module 400 for imaging. The imaging module 400 is electrically connected to the terminal device host 100, and the imaging device is used to capture images of the object under test, acquiring image information of the object. The terminal device further includes a judgment module 500, which identifies and judges the spectral characteristics of the object under test. Based on the spectral characteristics of the object under test, the terminal device sends a command to drive a change in the focal length of the optical system, further changing the principal angle, thereby changing the corresponding transmission spectrum matrix A. Since the spectral characteristics of the object under test, the corresponding focal length, and the corresponding transmission spectrum matrix A have been burned into the memory of the spectral chip 10 during calibration, in this embodiment, the change in focal length makes the transmission spectrum matrix A more suitable for the spectral characteristics of the object under test; that is, the correlation coefficient of the transmission spectrum matrix A is lower in the specific spectral band. Therefore, this embodiment can automatically detect and judge the object to be tested, and select the corresponding focal length according to the object to be tested, thereby realizing the identification or detection of the object to be tested according to the specific transmission spectrum matrix A.

[0216] Example 13

[0217] like Figure 23 As shown, the present invention further illustrates a terminal device incorporating the spectral device of any of the preferred embodiments described above. The terminal device includes a terminal device host 100 and at least one spectral device 200 disposed on the terminal device host 100. The terminal device may be, but is not limited to, a wearable device, a mobile phone, a tablet, etc. It is worth noting that the spectral device 200 may be implemented as the spectral device of any of the preferred embodiments described above, wherein the optical system 20 of the spectral device 200 can adjust its focal length to adjust the transmission spectrum matrix A of the spectral chip 10 of the spectral device 200 by zooming.

[0218] It is worth mentioning that, unlike the eleventh preferred embodiment described above, the terminal device does not require an imaging module and can automatically drive the spectral device 200 to zoom via the terminal device host 100. Specifically, in this preferred embodiment of the present invention, the spectral device 200 is the spectral device of the second preferred embodiment described above, that is, the spectral device 200 is obtained by assembling the spectral chip based on the regionalized spectral chip of Embodiment Two.

[0219] Specifically, the optical modulation layer 120 of the spectral chip 10 of the spectral device 200 has a non-modulated region and a modulation region. By acquiring the spectral information of the pixel points corresponding to each structural unit in the modulation region of the optical modulation layer of the spectral chip after the target beam from the object under test is irradiated, the spectral information of the object under test is determined; and the image information of the object to be imaged is determined based on the light intensity information of the pixel points corresponding to each non-modulated region in the optical modulation layer after the target beam is irradiated. The terminal device further includes a judgment module 500. Based on the acquired image information, the judgment module 500 of the terminal device identifies and judges the spectral characteristics of the object under test. Further, based on the spectral characteristics of the object under test, the terminal device host 100 of the terminal device sends a command to drive at least one lens of the optical system 20 to move or deform, causing the focal length of the optical system 20 to change, further causing the principal angle to change, thereby causing the corresponding transmission spectrum matrix A to change.

[0220] In this embodiment, the spectral chip 10 performs precise spectral analysis on the subject to obtain the necessary information, and then performs quantitative or qualitative analysis based on the obtained information. That is, in these application scenarios, the image information of the subject is only used as auxiliary information (e.g., for monitoring some emergencies) or even as useless information. Accordingly, in these application scenarios, preferably, the overall area of ​​the structural unit 121 of the spectral chip 10 occupies more than or equal to 60% of the effective area of ​​the spectral chip 10. More preferably, it is between 80% and 95%.

[0221] It is worth mentioning that, since the required transmission spectrum matrix A varies depending on the scenario or the object under test, but the corresponding transmission spectrum matrix A needs to be adapted to the object under test or different scenarios, a corresponding optical modulation layer 120 needs to be set up. Specifically, each structural unit 121 located in the optical modulation layer 120 needs to be set up. According to another aspect of the present invention, the present invention further provides a design method for a structural unit, and further provides a design method for a structural unit 121, so that the corresponding optical modulation layer 120 is more in line with the requirements, that is, it can make different transmission spectrum matrices A more adapted to the spectral characteristics of the object under test or different scenarios, thereby improving accuracy.

[0222] This embodiment provides a method for inverse design of structural unit 121 based on a deep neural network, including the following steps:

[0223] Step 101: Obtain the initial data of the structural unit 121 according to the structural unit 121 to be reverse designed.

[0224] In this invention, based on the structural unit 121 to be reverse-designed, firstly, a polygonal structural unit 121 with a structure closely similar to the structural unit 121 is generated. Then, based on this polygonal structural unit 121, a set of initial parameters, i.e., the initial data of the structural unit 121, is generated. This application can predict optical parameters based on any random polygonal structural unit 121, thereby optimizing the previous polygonal structural unit 121 based on the optical parameters obtained from each prediction, so that the structural data of the final polygonal structural unit 121 satisfies the target optical parameters.

[0225] Step 102: Input the initial data of the structural unit 121 into the trained optical parameter prediction model to obtain optical prediction parameters. The trained optical parameter prediction model is obtained by training a deep neural network with sample micro-nano data labeled with optical attribute parameters. The sample micro-nano data includes sample structural unit 121 data and sample micro-nano optical property data.

[0226] Step 103: Based on the evaluation function and optical target parameters, evaluate the optical prediction parameters. If the evaluation result does not meet the preset conditions, optimize the initial data of the structural unit 121 using the optimization algorithm and the evaluation result to obtain optimized data of the structural unit 121. Input the optimized data of the structural unit 121 into the trained optical parameter prediction model, and execute steps 102 to 103 again until the evaluation result of the optical prediction parameters obtained in the current iteration meets the preset conditions. Then, perform inverse design of the structural unit 121 based on the optimized data of the structural unit 121 corresponding to the optical prediction parameters in the current iteration.

[0227] In this embodiment, an optical parameter prediction model trained by a deep neural network predicts the corresponding electromagnetic response of the device (such as transmission spectrum and Q value) based on the initial parameters of structural unit 121. Then, the evaluation value (Figure of merit) of the device's electromagnetic response is calculated using an evaluation function and optical target parameters. In this embodiment, the evaluation function can be arbitrarily chosen according to the actual design goals, which include, but are not limited to: resonance at a preset frequency, increasing the resonant Q value, preset pass spectrum shape, preset electric field amplitude, and preset phase response. Then, through an optimization algorithm, based on the obtained evaluation value, a set of optimized parameters is generated for the initial parameters of structural unit 121. The process of neural network prediction, prediction result evaluation, and parameter optimization and updating continues until the parameters of structural unit 121 corresponding to a value close to the global optimum are obtained, so as to realize inverse design based on the parameters of structural unit 121.

[0228] The reverse design method for structural unit 121 based on deep neural networks provided in this embodiment uses deep neural networks to predict the electromagnetic response corresponding to the structural parameters. Specifically, it trains the neural network to predict the electromagnetic characteristics of structural unit 121 and obtains the optimal structural parameters that meet the target through iterative optimization based on preset optical target parameters. Since the calculation principle is based on prediction, the calculation time for the electromagnetic response is significantly reduced (up to 105 times faster) compared to directly calculating the electromagnetic response using simulation software, allowing for iterative optimization using optimization algorithms. The final design result, compared to forward design, not only obtains parameters that approach global optimum but also significantly shortens the design time and saves considerable human resources.

[0229] Based on the above embodiments, the trained optical parameter prediction model is obtained through the following steps:

[0230] According to the optical property parameters, each sample micro-nano data is labeled with a corresponding tag, and a training sample set is constructed based on the labeled sample micro-nano data and the corresponding sample optical parameters. The sample micro-nano data includes sample structural unit 121 data and sample micro-nano optical property data.

[0231] The training sample set is input into a deep neural network for training to obtain a trained optical parameter prediction model.

[0232] In this invention, the number of hidden layers in the deep neural network is approximately 3-20. The data dimension of the input layer varies depending on the actual structural complexity, roughly ranging from 3 to 10,000 dimensions. The output parameters, i.e., the optical prediction parameters obtained by the deep neural network, may include, but are not limited to, resonant wavelength, resonant Q value, pass spectrum, amplitude, and phase response, with the output parameter dimension roughly ranging from 1 to 1,000 dimensions. In this invention, the training and testing samples of the deep neural network can be calculated using commercial software such as FDTD, FEM, or Rsoft; alternatively, they can be calculated programmatically using the Fourier modal analysis method (also known as the strictly coupled mode analysis method).

[0233] Referring to the accompanying drawings of this invention Figure 24 As shown, the operation method of a spectroscopic device according to another aspect of the present invention will be explained in the following description. The operation method of the spectroscopic device includes the following steps:

[0234] (a) Modulating incident light based on a control command to adjust the focal length of an optical system 20, thereby adjusting the principal angle and / or the receiving cone angle of the incident light reaching a spectral chip 10; and

[0235] (b) Match a transmission spectrum matrix A to the spectral chip 10, and obtain the spectral information of the incident light based on the transmission spectrum matrix A.

[0236] According to the operating method of the above-described spectroscopic device of the present invention, the optical system 20 of the spectroscopic device includes at least one lens assembly 21 and at least one moving mechanism 22, wherein the moving mechanism drives the at least one lens assembly 21 to move, thereby changing the effective focal length of the optical system 20.

[0237] The lens assembly 21 further includes a first lens group 21a, a second lens group 21b, and a third lens group 21c, wherein the first lens group 21a, the second lens group 21b, and the third lens group 21c are arranged along the same optical axis. The second lens group 21b of the optical system 20 is connected to the moving mechanism 22 in a driving manner. The moving mechanism 22 drives the second lens group 21b to move. By changing the focal length of the optical system 20, the principal angle and / or the cone angle of the incident light reaching the surface of the filter structure 12 are changed.

[0238] According to another aspect of the present invention, in other optional embodiments of the present invention, the optical system 20A includes at least one liquid lens assembly 25A and at least one lens assembly 21A, the liquid lens assembly 25A and the lens assembly 21A being arranged one after the other along the same optical axis, the liquid lens assembly 25A being able to change its own curvature, thereby changing the focal length of the optical system 20A.

[0239] The liquid lens assembly 25A may include at least one deformable lens body 251A, a flexible transparent cover member 252A, and an actuator 253A, wherein the flexible transparent cover member 252A is attached to the surface of the at least one deformable lens body 251A to provide mechanical stability to the at least one deformable lens body 251A. The actuator 253A is used to shape the flexible transparent cover member 252A into a desired shape. The actuator 253A is located on the upper surface of the flexible transparent cover member 252A, and the desired shape is defined by a configuration pattern of the actuator 253A and a respective voltage amplitude applied to the configuration pattern of the actuator 253A. Work is performed on the deformable lens body 251A by the actuator 253A, causing the deformable lens body 251A to deform, thereby causing the optical system 20A to zoom.

[0240] According to another aspect of the present invention, in other optional embodiments of the present invention, the optical system 20B includes at least one lens assembly 21B, at least one moving mechanism 22B, and at least one turning member 26B, wherein the turning member 26B is disposed at the front end of the at least one lens assembly in the optical axis direction, the moving mechanism 22B is connected to the at least one lens assembly 21B, and the moving mechanism 22B drives the at least one lens assembly 21B to adjust the focal length of the optical system 20B.

[0241] The lens assembly 21B further includes a first lens group 21a, a second lens group 21b, and a third lens group 21c, wherein the first lens group 21a, the second lens group 21b, and the third lens group 21c are arranged along the same optical axis. The second lens group 21b of the lens assembly 21B is connected to the moving mechanism 22B, and the moving mechanism 22B drives the second lens group 21b to move in order to adjust the focal length of the optical system 20B.

[0242] The second lens group 21b includes at least one zoom lens 211b and at least one compensation lens 212b, wherein the at least one zoom lens 211b and the at least one compensation lens 212b of the second lens group 21b are tractably connected to the moving mechanism 22B, and the moving mechanism 22B drives the zoom lens 211b and the at least one compensation lens 212b to move in order to adjust the focal length of the optical system 20B.

[0243] According to another aspect of the invention, in other alternative embodiments of the invention, the focal length of the optical system 20 is adjusted by driving the spectral chip 10 to change the distance between the spectral chip 10 and the optical system 20.

[0244] Furthermore, the method of operating the spectroscopic device described in this invention further includes the following steps:

[0245] Multiple transmission spectrum matrices A are preset, and each transmission spectrum matrix A corresponds to the shape (focal length) of the optical system 20. It is worth mentioning that the matching information between the transmission spectrum matrix A and the optical system 20 is burned into the spectral chip 10 of the spectral device. When the optical system 20 undergoes a better change, the spectral chip 10 of the spectral device adaptively matches the corresponding transmission spectrum matrix A.

[0246] Furthermore, in the operating method of the spectroscopic device described in this invention, the spectroscopic device is integrated into a terminal device, and a terminal device host of the terminal device sends the control command to the spectroscopic device to adjust the focal length of the optical system 20 of the spectroscopic device.

[0247] Those skilled in the art should understand that the embodiments of the present invention described above and shown in the accompanying drawings are merely examples and do not limit the present invention. The objectives of the present invention have been fully and effectively achieved. The functions and structural principles of the present invention have been demonstrated and explained in the embodiments, and any variations or modifications may be made to the implementation of the present invention without departing from the stated principles.

Claims

1. A spectroscopic apparatus, comprising: A spectral chip; The spectral chip has multiple transmission spectrum matrices, wherein the transmission spectrum matrix is ​​the transmission spectrum response matrix corresponding to incident light under different principal angles or different light-receiving cone angles of its filter structure; and An optical system, wherein the optical system is located in the optical path of the spectral chip; The optical system has a variable focal length, and the variable focal length of the optical system corresponds to the plurality of transmission spectrum matrices of the spectral chip, so that by adjusting the focal length of the optical system, the principal angle or the receiving cone angle of the incident light reaching the filter structure of the spectral chip can be changed, thereby configuring and switching the spectral chip to a specific transmission spectrum matrix, and then obtaining the spectral information corresponding to the incident light based on the specific transmission spectrum matrix corresponding to the spectral chip.

2. The spectroscopic device according to claim 1, wherein the optical system comprises at least one lens assembly and at least one moving mechanism, wherein the at least one lens assembly is transversely connected to the at least one moving mechanism, and the at least one lens assembly is driven to move by the at least one moving mechanism to adjust the focal length of the optical system.

3. The spectroscopic device according to claim 2, wherein the optical system further includes at least one deflector, wherein the deflector is disposed in the optical axis direction of the at least one lens assembly, and the deflector deflects the transmission direction of light incident on or exiting the at least one lens assembly.

4. The spectroscopic device according to claim 2 or 3, wherein the lens assembly further includes a first lens group, a second lens group, and a third lens group, wherein the first lens group, the second lens group, and the third lens group are arranged along the same optical axis, the second lens group is located between the first lens group and the third lens group, and wherein the second lens group is connected to the moving mechanism and is driven to move by the moving mechanism.

5. The spectroscopic device according to claim 4, wherein the second lens group further comprises at least one zoom lens and at least one compensation lens, the at least one zoom lens and the at least one compensation lens being tractably connected to the moving mechanism, and zooming is achieved by moving the zoom lens and the compensation lens.

6. The spectroscopic device according to claim 4, wherein the optical system further includes at least one bend, the bend further including a first bend and a second bend, the first bend being located at the front end of the first lens group, and the second bend being located between the second lens group and the third lens group.

7. The spectroscopic device according to claim 1, wherein the optical system comprises at least one liquid lens assembly and at least one lens assembly, the liquid lens assembly and the lens assembly being arranged one after the other along the same optical axis, and the liquid lens assembly being capable of changing its curvature.

8. The spectroscopic apparatus of claim 7, wherein the liquid lens assembly may include at least one deformable lens body, a flexible transparent cover component, and an actuator, wherein the flexible transparent cover component is attached to the surface of the at least one deformable lens body, and the actuator is located on the upper surface of the flexible transparent cover component, thereby driving the flexible transparent cover component to move to change the shape of the deformable lens body.

9. The spectroscopic device according to claim 4, further comprising a focusing mechanism, wherein the focusing mechanism is connected to the at least one lens assembly, and the at least one lens assembly is driven by the focusing mechanism to achieve focusing.

10. The spectroscopic device of claim 7, further comprising a focusing mechanism, wherein the focusing mechanism is connected to the at least one lens assembly, and the at least one lens assembly is driven by the focusing mechanism to achieve focusing.

11. The spectroscopic device according to claim 4, further comprising at least one image stabilization mechanism, wherein the image stabilization mechanism is connected to the at least one lens assembly of the optical system, and the movement of the optical system driven by the image stabilization mechanism compensates for the jitter generated by the spectroscopic device during use.

12. The spectroscopic device according to claim 7, further comprising at least one image stabilization mechanism, wherein the image stabilization mechanism is connected to the at least one lens assembly of the optical system, and the movement of the optical system driven by the image stabilization mechanism compensates for the jitter generated by the spectroscopic device during use.

13. The spectroscopic device according to claim 11 or 12, wherein the optical system further includes at least one bend, and the image stabilization mechanism further includes a first image stabilization mechanism assembly and a second image stabilization mechanism assembly, wherein the first image stabilization mechanism assembly is connected to the bend and the rotation of the bend is achieved through the first image stabilization mechanism assembly to compensate for roll, pitch and yaw, wherein the second image stabilization mechanism assembly is connected to the lens assembly of the optical system and the lens assembly is driven to move horizontally through the second image stabilization mechanism assembly.

14. The spectroscopic device according to claim 1, further comprising at least one data processing unit, wherein the spectroscopic chip is electrically connected to the at least one data processing unit, and the data processing unit obtains the spectral information corresponding to the incident light based on a specific transmission spectrum matrix corresponding to the spectroscopic chip and the incident light.

15. The spectroscopic device according to claim 4, further comprising a circuit board and at least one heat sink, wherein the spectroscopic chip is electrically connected to the circuit board, and the heat sink may be attached to the circuit board or to the spectroscopic chip.

16. The spectroscopic device according to claim 7, further comprising a circuit board and at least one heat sink, wherein the spectroscopic chip is electrically connected to the circuit board, and the heat sink may be attached to the circuit board or to the spectroscopic chip.

17. The spectral device according to claim 15 or 16, further comprising a bracket disposed on the circuit board, the optical system disposed on the bracket, the bracket having a light-transmitting aperture corresponding to the photosensitive area of ​​the spectral chip.

18. The spectroscopic device according to claim 1, wherein the spectroscopic chip records the zoom position of the optical system corresponding to each of the transmission spectrum matrices.

19. The spectroscopic device according to claim 4, wherein the first lens group comprises a first lens and a second lens, the second lens group comprises a third lens and a fourth lens, the third lens group comprises a fifth lens and a sixth lens, and the first lens, the second lens, the third lens, the fourth lens, the fifth lens and the sixth lens are arranged sequentially along the optical axis of the optical system from the object side to the image side, and the optical system satisfies the following relationships: -3 < f2 / f1 < 0; 0 < f3 / f1 < 4; 0 < f4 / f1 < 4; -7 < f5 / f1 < -2; -3 < f6 / f1 < 0; f1 is the focal length of the first lens, f2 is the focal length of the second lens, f3 is the focal length of the third lens, f4 is the focal length of the fourth lens, f5 is the focal length of the fifth lens, and f6 is the focal length of the sixth lens.

20. The spectral device according to claim 1, 2, 3 or 7, wherein the spectral chip further comprises an image sensor and at least one filter structure disposed on the photosensitive side of the image sensor, wherein the filter structure is located above the image sensor, and the filter structure is a broadband filter structure in the frequency domain or wavelength domain.

21. The spectroscopic device of claim 20, wherein the filter structure of the spectroscopic chip is selected from a combination of metasurfaces, photonic crystals, nanopillars, multilayer films, dyes, quantum dots, MEMS, FP etalon, cavity layers, waveguide layers, and diffraction elements.

22. The spectral device according to claim 14, wherein the data processing unit is selected from a combination of processing units consisting of MCU, CPU, GPU, FPGA, NPU and ASIC.

23. A terminal device, comprising: A terminal device host; and The spectroscopic device as described in any one of claims 1 to 22, wherein the spectroscopic device is electrically connected to the host terminal device, and the host terminal device sends control commands to the spectroscopic device to adjust the focal length of the spectroscopic device.

24. The terminal device according to claim 23, further comprising a selection module, wherein the selection module selects the object to be tested and generates the control command.

25. The terminal device according to claim 24, further comprising a judgment module, wherein the judgment module identifies and judges the spectral characteristics of the test object, and further generates the control command based on the spectral characteristics of the test object.

26. The terminal device according to claim 24, further comprising an imaging module, wherein the imaging module is electrically connected to the host of the terminal device, thereby acquiring image information of the object under test to analyze the spectral characteristics of the object under test.

27. A method of operating a spectroscopic device as described in any one of claims 1 to 22, comprising: (a) Adjusting the focal length of an optical system based on a control command to change the principal angle and / or the receiving cone angle of incident light reaching the filter structure of a spectral chip; and (b) Match a transmission spectrum matrix to the spectral chip and calculate the spectral information of the incident light based on the transmission spectrum matrix.

28. The method of operating the spectroscopic device according to claim 27, wherein the optical system of the spectroscopic device includes at least one lens assembly and at least one moving mechanism, wherein the moving mechanism drives the at least one lens assembly to move, thereby changing the effective focal length of the optical system.

29. The method of operating the spectroscopic device according to claim 28, wherein the lens assembly further includes a first lens group, a second lens group, and a third lens group, wherein the first lens group, the second lens group, and the third lens group are arranged along the same optical axis direction, wherein the second lens group of the optical system is connected to the moving mechanism in a driving manner, and the moving mechanism drives the second lens group to move, thereby changing the focal length of the optical system to change the principal angle and / or the light cone angle of the incident light reaching the surface of the filter structure.

30. The method of operating the spectroscopic device according to claim 27, wherein the optical system includes at least one liquid lens assembly and at least one lens assembly, the liquid lens assembly and the lens assembly being arranged one after the other along the same optical axis, and the liquid lens assembly being able to change its own curvature, thereby changing the focal length of the optical system.

31. The method of operating the spectroscopic device according to claim 30, wherein the liquid lens assembly may include at least one deformable lens body, a flexible transparent cover component, and an actuator, wherein the flexible transparent cover component is attached to the surface of the at least one deformable lens body, the actuator is located on the upper surface of the flexible transparent cover component, and the actuator performs work on the deformable lens body to deform the deformable lens body, thereby causing the optical system to zoom.

32. The method of operating the spectroscopic device according to claim 27, wherein the optical system includes at least one lens assembly, at least one moving mechanism and at least one turning member, wherein the turning member is disposed at the front end of the at least one lens assembly in the optical axis direction, the moving mechanism is connected to the at least one lens assembly, and the moving mechanism drives the at least one lens assembly to adjust the focal length of the optical system.

33. The method of operating the spectroscopic device according to claim 32, wherein the lens assembly further includes a first lens group, a second lens group, and a third lens group, wherein the first lens group, the second lens group, and the third lens group are arranged along the same optical axis, wherein the second lens group of the lens assembly is connected to the moving mechanism, and the moving mechanism drives the second lens group to move to adjust the focal length of the optical system.

34. The method of operating the spectroscopic device according to claim 33, wherein the second lens group includes at least one zoom lens and at least one compensation lens, wherein the at least one zoom lens and the at least one compensation lens of the second lens group are tractably connected to the moving mechanism, and the moving mechanism drives the zoom lens and the at least one compensation lens to move in order to adjust the focal length of the optical system.

35. The method of operating the spectroscopic device according to claim 27, further comprising the step of: Multiple transmission spectrum matrices are preset, and each transmission spectrum matrix is ​​matched to the shape of the optical system.

Images