Spectroscopic imaging based device and imaging method

Abstract

The present application provides a kind of equipment and imaging method based on spectral imaging, wherein the imaging equipment includes optical lens, support mechanism and optical sensor, wherein the optical lens is supported by the support mechanism in the photosensitive path of the optical sensor, wherein the optical sensor includes spectral imaging module, the spectral information of each pixel is obtained through the spectral imaging module, and the original signal after spectral imaging is processed by the optical sensor to obtain spectral image information and / or digital image information corresponding to the scene to be shot.

Description

Technical Field

[0001] This invention relates to the field of spectral imaging technology, and more specifically, to devices and imaging methods based on spectral imaging, such as those applied to mobile phones or tablets, which can achieve long-range macro photography and also perform multi-functional tasks such as object recognition based on spectral images. Background Technology

[0002] Spectral imaging technology, as a comprehensive technology, incorporates multiple techniques such as optics, computer science, and information processing. It can acquire the spatial features of an object while simultaneously obtaining the spectral information of each pixel. Spectral images contain rich information and have wide applications in agriculture, food, biomedicine, and cultural relic preservation.

[0003] Mobile electronic devices such as smartphones and tablets are equipped with camera functions. In addition to the regular main camera lens, imaging devices usually also have an ultra-wide-angle lens and a telephoto lens. Some devices also have a macro lens. For cost reasons, many mobile phones use an ultra-wide-angle lens instead of a macro lens to achieve macro shooting. However, because the distance between the ultra-wide-angle camera and the subject is very short when used as a macro camera, it often blocks the shooting light, resulting in shadows in the final image. To solve this problem, a telephoto macro lens can be used, which can greatly increase the shooting distance without affecting the clarity of the final image. Summary of the Invention

[0004] A key advantage of this invention is that it provides a device and method based on spectral imaging, wherein the imaging device can simultaneously acquire the spectral information of the scene being photographed while performing long-focal-length macro photography, and the spectral information of the image can be used to achieve functions such as substance type detection, color analysis, and color fidelity reproduction.

[0005] Another advantage of the present invention is that it provides a device and method based on spectral imaging, wherein the imaging device includes a telephoto macro lens, which images objects at a distance and can acquire the microstructure of the object being photographed, thereby realizing the macro photography function of the image. From the spectral image, spectral recovery is performed to obtain the spectral curve of each microscopic image pixel of the shooting scene.

[0006] Another advantage of the present invention is that it provides a device and method based on spectral imaging, wherein the imaging device can perform operations such as material analysis using rich spectral information, and can also perform true color restoration of the image using the spectral curve of the image to obtain the RGB information of each pixel for normal display.

[0007] Another advantage of the present invention is that it provides a device and method based on spectral imaging, wherein the device with the imaging device has a spectral recognition mode. When a target for macro photography is received, the spectral recognition mode is activated and the focal area of ​​the spectral recognition is aligned with the target to be photographed. The parameters of the target area can be displayed in real time on the preview interface, allowing the user to understand the parameters of the target at any time (including at least the material properties of the target and the range of the target).

[0008] Another advantage of the present invention is that it provides a device and method based on spectral imaging, wherein the device uses a telephoto macro lens when taking macro photos, which can effectively reduce the generation of shadows and can more accurately obtain the composition and range of tiny objects.

[0009] According to one aspect of the present invention, a spectral imaging-based device of the present invention, capable of achieving the foregoing and other objects and advantages, includes: an optical lens, a support mechanism; and an optical sensor, wherein the optical lens is supported by the support mechanism in the light-sensing path of the optical sensor, wherein the optical sensor includes a spectral imaging module, through which spectral information of each pixel is obtained, and the optical sensor processes the raw signal after spectral imaging to obtain spectral image information and / or digital image information corresponding to the scene to be captured.

[0010] According to one embodiment of this application, the optical lens is a telephoto macro lens, and the optical lens is driven by the support mechanism to adjust the focal length of the optical lens.

[0011] According to one embodiment of this application, it further includes a spectral recognition module, wherein the spectral recognition module identifies the target object based on the spectral image information captured by the imaging device and determines the location information of the target object.

[0012] According to one embodiment of this application, when the distance of the target object captured by the imaging device exceeds a set distance, the spectral recognition module identifies the focal point of the distance of the target object to be photographed based on the spectral image information captured by the imaging device.

[0013] According to one embodiment of this application, when the imaging device takes a picture of the target object, the imaging light of the target object is recovered by the optical sensor to obtain the spectral information corresponding to the target object, and then the spectral recognition module identifies the target object parameter information corresponding to the target object in the image information based on the spectral information.

[0014] According to one embodiment of this application, it further includes a spectral optimization module, wherein the spectral optimization module identifies the regional boundary of the environment in which the target object is located in the spectral image based on the spectral information captured by the imaging device, and divides the spectral image into a target object region and a target environment region.

[0015] According to one embodiment of this application, the spectral optimization module identifies the regional boundaries of the target object and the target environment in the spectral image based on the spectral curve of the target object and the spectral curve of the target object environment captured by the imaging device, and identifies the target object and the target environment based on the regional boundaries.

[0016] According to one embodiment of this application, it further includes a spectral selection module, which selects at least a portion of the image information as spectral information based on the imaging information captured by the imaging device, wherein the spectral selection module can select at least a portion of the image information as spectral information, and the remaining portion of the image information as corresponding display image information.

[0017] According to one embodiment of this application, when a setting operation is detected, the spectral selection module of the imaging device responds to the user's operation command and displays the image information corresponding to the selected position as a spectral image.

[0018] According to one embodiment of this application, the spectral imaging module includes an optical system, a filter structure, an image sensor, and a data processing unit, wherein the filter structure is located between the optical system and the image sensor, and the image sensor is electrically connected to the data processing unit.

[0019] According to another aspect of this application, this application further provides an electronic device, characterized in that it comprises:

[0020] The imaging device described above, wherein the imaging device is mounted on the electronic device.

[0021] According to another aspect of this application, this application further provides a method based on spectral imaging, wherein the method of spectral imaging includes the following steps:

[0022] (a) Photograph a target area to obtain the imaging light of the target area;

[0023] (b) Acquire spectral information corresponding to each pixel of the imaging ray via an optical sensor; and

[0024] (c) In response to a specific operating command, the optical sensor processes the raw signal after spectral imaging to obtain the spectral information of each pixel and performs digital image processing to obtain a display spectral image and / or a true color image.

[0025] According to another aspect of this application, this application further provides a method for identifying a target object and determining the location information of the target object by means of a spectral recognition module based on spectral image information captured by the imaging device.

[0026] According to another aspect of this application, this application further provides a method in which, when the distance of the target object captured by the imaging device exceeds a set distance, the spectral recognition module identifies the focal point of the distance of the target object to be photographed based on the spectral image information captured by the imaging device.

[0027] According to another aspect of this application, this application further provides a step (c) comprising: in response to the user's selection of a macro shooting mode, activating a spectral recognition mode, and adjusting the focal length of the optical lens so that the focal area of ​​the spectral recognition is aligned with the target to be photographed, so as to obtain the microstructure of the photographed object.

[0028] According to another aspect of this application, this application further provides a step (c) comprising: identifying the regional boundary of the environment in which the target object is located in the spectral image based on the spectral information captured by the imaging device, and dividing the spectral image into a target object region and a target environment region.

[0029] According to another aspect of this application, this application further provides a method for identifying the regional boundaries of the target object and the target environment in the spectral image based on the spectral curve of the target object and the spectral curve of the target object environment captured by the imaging device, and identifying the target object and the target environment based on the regional boundaries.

[0030] According to another aspect of this application, this application further provides a method that allows at least a portion of the image information to be selected as spectral information via a spectral selection module, while the remaining portion of the image information is selected as correspondingly displayed image information.

[0031] According to another aspect of this application, this application further provides a step (c) comprising: in response to a user marking a selected location, the spectral selection module displays image information corresponding to the selected location as a spectral image, and the area outside the selected location is displayed as an image.

[0032] The further objects and advantages of the invention will become fully apparent from the following description and accompanying drawings.

[0033] These and other objects, features and advantages of the present invention will become fully apparent from the following detailed description and accompanying drawings. Attached Figure Description

[0034] Figure 1 This is a schematic diagram of an imaging device according to a first preferred embodiment of the present invention.

[0035] Figure 2 This is a schematic diagram of the frame of the optical sensor of the imaging device according to the first preferred embodiment of this application.

[0036] Figure 3 This is a schematic diagram of an imaging device according to the first preferred embodiment of this application.

[0037] Figure 4 This is a schematic diagram of macro photography taken by the imaging device according to the first preferred embodiment of this application.

[0038] Figure 5 This is a schematic diagram of spectral imaging of the imaging device according to the first preferred embodiment of this application.

[0039] Figure 6 This is a schematic diagram of an imaging method based on spectral imaging according to a first preferred embodiment of this application. Detailed Implementation

[0040] The following description is intended to disclose the present invention and enable those skilled in the art to implement it. The preferred embodiments described below are merely examples, and other obvious variations will occur to those skilled in the art. The basic principles of the invention defined in the following description can be applied to other embodiments, modifications, improvements, equivalents, and other technical solutions that do not depart from the spirit and scope of the invention.

[0041] Those skilled in the art should understand that, in the disclosure of this invention, the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, the above terms should not be construed as limiting this invention.

[0042] It is understood that the term "a" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element can be one, while in another embodiment, the number of the element can be multiple, and the term "a" should not be understood as a limitation on the number.

[0043] Existing telephoto macro cameras still use the traditional Bayer structure in their optical sensors, which causes them to lose spectral information during image capture. This results in the loss of original color information in the color characterization and color space conversion models built upon them. Current telephoto macro cameras generally can only achieve macro optical imaging within the conventional three primary colors of visible light and cannot handle other functions.

[0044] Because mobile devices such as smartphones and tablets are typically subject to strict cost control during production, simply adding a standard telephoto macro camera to a smartphone would only increase the phone's cost without providing users with significant photographic benefits. Therefore, this application provides an imaging device based on spectral imaging. This device, while performing telephoto macro photography, can simultaneously acquire the spectral information of the scene being photographed. The spectral information of the image can then be used to perform functions such as substance detection, color analysis, and color fidelity reproduction.

[0045] Exemplary imaging device

[0046] Refer to the accompanying drawings in this application specification. Figure 1 As shown, a spectral imaging device and imaging method according to a first preferred embodiment of the present application are described below. The imaging device includes an optical lens 10, a support mechanism 20, and an optical sensor 30, wherein the optical lens 10 is supported by the support mechanism 20 in the light-sensing path of the optical sensor 30, and external imaging light reaches the optical sensor 30 through the optical lens, and the optical sensor 30 obtains a spectral image or a color image. In this preferred embodiment of the present application, the optical lens 10 may be, but is not limited to, a 50mm telephoto macro lens. Further, the support mechanism 20 is provided with a driving mechanism, wherein the driving mechanism drives the optical lens 10 to move, so as to realize the automatic zoom of the telephoto macro lens. Preferably, in this preferred embodiment of the present application, the zoom distance of the optical lens 10 of the imaging device is between 2 cm and 7 cm. Preferably, in this preferred embodiment of the present application, the optical sensor 30 is a multispectral sensor with more than 2 megapixels.

[0047] Preferably, in this preferred embodiment of the present application, the imaging device is a camera device with a shooting function, such as a spectral analysis device. In other optional embodiments of the present application, the imaging device is a camera or a camera module, wherein the imaging device is mounted on an electronic device, such as a mobile phone or a tablet computer, that is, the imaging device serves as the shooting element of the electronic device. Therefore, the specific embodiment type of the imaging device is merely illustrative and not limiting.

[0048] like Figure 2The structure of the optical sensor 30 in this preferred embodiment of the present application is further illustrated. The optical sensor 30 according to this embodiment includes a spectral imaging module 31, wherein the spectral imaging module 31 includes an optical system 311, a filter structure 312, an image sensor 313, and a data processing unit 314. The filter structure 312 is located between the optical system 311 and the image sensor 313, and the image sensor 313 is electrically connected to the data processing unit 314. It is worth noting that in this preferred embodiment of the present application, the optical system 311 of the spectral imaging module 31 is optional; that is, in another optional embodiment of the present application, the optical system 311 is integrated into the optical lens 10. The optical system 311 includes lens assemblies, light-diffusing assemblies, etc., and the specific type and structure of the optical system 311 are merely exemplary and not limiting.

[0049] The filter structure 312 can be a metasurface, photonic crystal, nanopillar, multilayer film, dye, quantum dot, MEMS (microelectromechanical systems), FP etalon, cavity layer, waveguide layer, diffraction element, or other structures or materials with filtering properties. For example, in this embodiment, the filter structure can be the light modulation layer in Chinese Patent CN201921223201.2. The image sensor 313 (i.e., photodetector array) can be a CMOS image sensor (CIS), CCD, array photodetector, etc. Optionally, the data processing unit 314 can be a processing unit such as an MCU, CPU, GPU, FPGA, NPU, ASIC, etc., which can export the data generated by the image sensor 313 to an external device for processing. In this preferred embodiment, the data processing unit 314 can be integrated into the imaging device, or when the imaging device is mounted on an electronic device, the data processing unit 314 is integrated into the electronic device. It is understood that the data processing unit 314 is optional in the imaging device, that is, the data generated by the image sensor 313 is exported to an external source for processing.

[0050] It is worth mentioning that the signal processing unit 314 is equipped with a system processing algorithm, which can process the signal to reconstruct the original spectrum.

[0051] like Figure 3This illustration depicts the imaging process of a spectral imaging device or an electronic device equipped with the spectral imaging device according to a preferred embodiment of this application. External imaging light passes through the optical lens 10 of the imaging device, and the spectral imaging module 31 of the optical sensor 30 obtains the spectral information of each pixel. The signal processing unit 314 processes the spectral image, using linear and nonlinear methods to process the raw signal after spectral imaging to obtain the spectral information of each pixel, and performs other digital image processing. The imaging device is mounted on the electronic device; taking a mobile phone as an example, the spectral imaging device processes the raw signal of the captured external image to obtain spectral information and other digital image information corresponding to the scene to be captured, and displays the spectral image or true-color image on the mobile phone screen according to the user's actual usage needs, and stores the obtained image.

[0052] It is understood that, in this preferred embodiment of the present application, the image information captured by the imaging device based on spectral imaging can be presented by the electronic device as spectral image information, as RGB color image information, or as a composite image of spectral image information and color image information.

[0053] It is worth mentioning that, in this preferred embodiment of the application, the optical lens 10 of the imaging device is a telephoto macro lens. The imaging process is as follows: Figure 4 As shown, the imaging device achieves imaging of distant objects by adjusting the focal length of the optical lens 10, enabling the acquisition of the microscopic structure of the object and realizing macro imaging functionality. The spectral image captured by the imaging device undergoes spectral reconstruction to obtain the spectral curve of each pixel in the microscopic image of the captured scene. This provides information about the image in each spectral band. This information can be used for various operations, such as material analysis, and also for true-color restoration of the image using the spectral curve, obtaining the RGB information of each pixel for normal display.

[0054] In another embodiment of this application, when the imaging device is more than a set distance from the target to be photographed, it identifies the focal point at the desired photographing distance and prompts the user whether to perform macro photography. Upon receiving a macro photography target, it activates the spectral recognition mode and aligns the focal area of ​​the spectral recognition with the target. The parameters of the target area can be displayed in real-time on the user preview interface, allowing the user to understand the parameters of the target (at least including the material properties of the target and its location). The parameters of the target are recovered based on the spectral information corresponding to the target. Preferably, in this preferred embodiment of the application, the imaging device recovers the spectral information of the target through a reconstruction algorithm.

[0055] In detail, in this preferred embodiment of the present application, the spectral imaging device further includes a spectral recognition module 301, wherein the spectral recognition module 301 identifies the target object based on the spectral image information captured by the imaging device and determines the position information of the target object. When the distance of the target object captured by the imaging device exceeds a set distance, the spectral recognition module 301 identifies the focal point of the distance to the target object based on the spectral image information captured by the imaging device. The imaging device activates the spectral recognition mode in response to the user's selection of the macro shooting mode, that is, it controls the support mechanism 20, and the support mechanism 20 adjusts the focal length of the optical lens 10 so that the focal area of ​​the spectral recognition is aligned with the target object. It is worth mentioning that in this preferred embodiment of the present application, the spectral recognition module 301 feeds back the identified target object's position information to the user, so that the user can choose whether to activate the macro shooting mode based on the target object's position information.

[0056] The spectral image information captured by the imaging device is used by the optical sensor 30 to recover the parameters of the target object based on the spectral information corresponding to the target object. That is, when the imaging device captures the target object, the imaging light of the target object is recovered by the optical sensor 30 to obtain the spectral information corresponding to the target object. Then, the spectral recognition module 301 identifies the target object parameter information corresponding to the target object in the image information based on the spectral information, such as the material characteristics of the target object, the range of the target object, and the location information of the target object.

[0057] It is worth mentioning that the spectral recognition module 301 can be implemented as an algorithm module integrated into the signal processing unit 314 of the optical sensor 30. Optionally, in other alternative embodiments of this application, the spectral recognition module 301 is implemented as an independent functional element, wherein the spectral recognition module 301 is built into an electronic device such as a mobile phone, camera, or tablet computer.

[0058] Furthermore, the imaging device of this preferred embodiment can also optimize the spectral information. Since the spectral information obtained by the imaging device when photographing the target object includes at least the spectral curve of the target object and the spectral curve of the target object's environment, the imaging device determines the regional boundary of the target object's environment based on the spectral curves of the target object and the target environment, thereby achieving the distinction between the target object and the target environment. For example, when an apple has some contaminants (such as pesticide residue), the device can photograph the residue, bacteria, and the extent of the residue or bacteria.

[0059] Accordingly, the spectral imaging-based device further includes a spectral optimization module 302, wherein the spectral optimization module 302 identifies the regional boundaries of the environment in which the target object is located in the spectral image based on the spectral information captured by the imaging device, and divides the spectral image into a target object region and a target environment region. It can be understood that the target environment is the environment in which the target object is located at the time of imaging. Therefore, the spectral optimization module 302 identifies the regional boundaries of the target object and the target environment in the spectral image based on the spectral curves of the target object and the target environment captured by the imaging device, and identifies the target object and the target environment based on the regional boundaries.

[0060] It is worth mentioning that the spectral optimization module 302 can be implemented as an algorithm module integrated into the signal processing unit 314 of the optical sensor 30. Optionally, in other alternative embodiments of this application, the spectral optimization module 302 is implemented as a separate electronic component, wherein the spectral optimization module 302 is built into an electronic device such as a mobile phone, camera, or tablet computer.

[0061] Therefore, in another optional embodiment of this application, the imaging device obtains the spectral curves of the target object and the target environment by photographing the target object in the target environment, and the spectral recognition module 301 and the spectral optimization module 302 identify the target object based on the spectral curves of the target object and the target environment, and determine the location information of the target object according to the user's selection.

[0062] Those skilled in the art will understand that some target objects are difficult to distinguish from their surroundings in an image, such as a green insect on a green leaf. The imaging device of this preferred embodiment, based on the spectral characteristics of the target object and its environment, uses the spectral optimization module 302 to distinguish the differences and boundaries between the target object and its environment through metamerism, and displays this information in a preview interface. When photographing a white pigeon against a white sky background, the pigeon can be more clearly identified and photographed as the main subject.

[0063] Existing photographic devices typically produce images with shadows when capturing macro images of tiny objects. The imaging device described in this application reduces the occurrence of shadows through telephoto macro photography and can more accurately obtain the composition and extent of tiny objects.

[0064] like Figure 5As shown, according to another aspect of this application, this application provides a filter structure with micro / nano structures, wherein the filter structure corresponds to the pixels of the image sensor. When the imaging device acquires an image, a portion of the image captured by the imaging device is displayed as spectral information according to the user's selection, while the remaining portion is displayed normally as a color image. The spectral information corresponding to each pixel is obtained from the displayed spectral image. The acquisition of the partially displayed spectral image is achieved through preset settings, as follows: Figure 5 As shown in the image, the dashed lines represent the spectral image display, with markers indicating the selected or clicked locations. Alternatively, multiple regions can be selected simultaneously to display the spectral image.

[0065] Accordingly, the spectral imaging-based device further includes a spectral selection module 303, which selects at least a portion of the image information as spectral information based on the imaging information captured by the imaging device, and the remaining portion as image information to be displayed, such as RGB color image information. Therefore, in the image displayed on the display interface by the imaging device, part of the image is displayed as a spectral image, and the rest is displayed as a color image.

[0066] like Figure 5 As shown in the figure, the dashed line represents the spectral image display area selected by the user. In response to the user's marking of the selected location, the spectral selection module 303 displays the image information corresponding to the selected location as a spectral image. The area outside the dashed line is displayed as an image. In other words, the spectral selection module 303 converts the spectral information obtained from each pixel position corresponding to the dashed line into a displayed spectral image.

[0067] It is worth mentioning that the spectral selection module 303 can be implemented as an algorithm module integrated into the signal processing unit 314 of the optical sensor 30. Optionally, in other alternative embodiments of this application, the spectral selection module 303 is implemented as a separate electronic component, wherein the spectral selection module 303 is built into an electronic device such as a mobile phone, camera, or tablet computer. That is, in this preferred embodiment of this application, when the imaging device takes a picture, the user marks the area of ​​the spectral display image according to the content of the captured image. The spectral selection module 303 obtains the spectral information of each pixel position corresponding to the spectral display image area, and then the optical sensor 30 displays a partial spectral information pattern and a partial normally displayed color information pattern.

[0068] Those skilled in the art will understand that users can mark selected locations as needed, such as by marking the selected location with a dashed ring or the clicked location; or they can select multiple regions at the same time to display spectral images.

[0069] When a set operation is detected, such as a click or long press, the spectral selection module 303 of the imaging device responds to the user's click or long press operation command, providing a partial spectral image display prompt, and then displays the selected area. Each pixel position in the spectral image can obtain corresponding spectral information, and this spectral information can be used for color temperature selection, white balance correction, material identification, color confirmation, etc. Furthermore, when the telephoto lens module is shooting macro, a partial macro image can be selected for display and analysis.

[0070] According to another aspect of this application, this application further provides a method based on spectral imaging, wherein the method of spectral imaging includes the following steps:

[0071] (a) Photograph a target area to obtain the imaging light of the target area;

[0072] (b) Acquire spectral information corresponding to each pixel of the imaging ray via optical sensor 30; and

[0073] (c) In response to a specific operation command, the optical sensor 30 processes the raw signal after spectral imaging to obtain the spectral information of each pixel and performs digital image processing to obtain a display spectral image and / or a true color image.

[0074] In the spectral imaging method of this application, the spectral recognition module 301 identifies the target object based on the spectral image information captured by the imaging device and determines the position information of the target object. When the distance of the target object captured by the imaging device exceeds a set distance, the spectral recognition module 301 identifies the focal point of the distance to the target object based on the spectral image information captured by the imaging device.

[0075] In the spectral imaging method of this application, step (c) includes: in response to the user's selection of macro shooting mode, activating spectral recognition mode, and adjusting the focal length of optical lens 10 so that the focal area of ​​spectral recognition is aligned with the target to be photographed, so as to obtain the microstructure of the object to be photographed.

[0076] The spectral image information captured by the imaging device is used by the optical sensor 30 to recover the parameters of the target object based on the spectral information corresponding to the target object. That is, when the imaging device captures the target object, the imaging light of the target object is recovered by the optical sensor 30 to obtain the spectral information corresponding to the target object. Then, the spectral recognition module 301 identifies the target object parameter information corresponding to the target object in the image information based on the spectral information, such as the material characteristics of the target object, the range of the target object, and the location information of the target object.

[0077] In the spectral imaging method of this application, step (c) includes: identifying the regional boundary of the environment where the target object is located in the spectral image based on the spectral information captured by the imaging device via the spectral optimization module 302, and dividing the spectral image into the target object region and the target environment region.

[0078] The spectral optimization module 302 identifies the regional boundaries of the target object and the target environment in the spectral image based on the spectral curve of the target object and the spectral curve of the target environment captured by the imaging device, and identifies the target object and the target environment based on the regional boundaries.

[0079] In the spectral imaging method described in this application, at least a portion of the image information can be selected as spectral information via the spectral selection module 303, while the remaining portion of the image information is the corresponding displayed image information.

[0080] In the spectral imaging method of this application, step (c) includes: in response to a user marking a selected location, the spectral selection module 303 displays image information corresponding to the selected location as a spectral image, and the area outside the selected location is displayed as an image.

[0081] Those skilled in the art should understand that the embodiments of the present invention described above and shown in the accompanying drawings are merely examples and do not limit the present invention. The objectives of the present invention have been fully and effectively achieved. The functions and structural principles of the present invention have been demonstrated and explained in the embodiments, and any variations or modifications may be made to the implementation of the present invention without departing from the stated principles.

Claims

1. An imaging device based on spectral imaging, characterized in that, include: An optical lens, wherein the optical lens is a telephoto macro lens; Supporting institutions; as well as An optical sensor, wherein the optical lens is supported by the support mechanism in the light-sensing path of the optical sensor, wherein the optical sensor includes a spectral imaging module, through which spectral information of each pixel is obtained, and the optical sensor processes the raw signal after spectral imaging to obtain spectral image information corresponding to the scene to be captured. The imaging device further includes a spectral recognition module, wherein the spectral recognition module identifies the target object based on the spectral image information captured by the imaging device and determines the target object's parameter information. The imaging device achieves macro photography by adjusting the focal length of the optical lens to obtain the microstructure of the object.

2. The imaging device according to claim 1, wherein, The optical lens is driven by the support mechanism to adjust the focal length of the optical lens.

3. The imaging device according to claim 1, wherein when the distance of the target object captured by the imaging device exceeds a set distance, the spectral recognition module identifies the focal point of the distance of the target object based on the spectral image information captured by the imaging device.

4. The imaging device according to claim 3, wherein when the imaging device takes a picture of the target object, the imaging light of the target object is recovered by the optical sensor to obtain the spectral information corresponding to the target object, and then the spectral recognition module identifies the target object parameter information of the target object in the image information based on the spectral information.

5. The imaging device according to claim 1, further comprising a spectral optimization module, wherein the spectral optimization module identifies the regional boundary of the environment in which the target object is located in the spectral image based on the spectral information captured by the imaging device, and divides the spectral image into a target object region and a target environment region.

6. The imaging device according to claim 5, wherein the spectral optimization module identifies the regional boundaries of the target object and the target environment in the spectral image based on the spectral curve of the target object and the spectral curve of the target object environment captured by the imaging device, and identifies the target object and the target environment according to the regional boundaries.

7. The imaging device according to claim 1 or 5, further comprising a spectral selection module, based on the imaging information captured by the imaging device, wherein the spectral selection module can select at least a portion of the image information as spectral information, and the remaining portion of the image information as corresponding display image information.

8. The imaging device according to claim 7, wherein when a setting operation is detected, the spectral selection module of the imaging device responds to the user's operation command and displays image information corresponding to the selected position as a spectral image.

9. The imaging device according to claim 1, wherein the spectral imaging module includes an optical system, a filter structure, an image sensor, and a data processing unit, wherein the filter structure is located between the optical system and the image sensor, and the image sensor is electrically connected to the data processing unit.

10. An electronic device, characterized in that, include: The imaging device as claimed in any one of claims 1 to 9, wherein the imaging device is mounted on the electronic device.

11. An imaging method based on spectral imaging, characterized in that, The imaging method includes the following steps: (a) Photographing a target area using a telephoto macro lens to obtain the imaging light of the target area; (b) Acquire spectral information corresponding to each pixel of the imaging ray via an optical sensor; (c) In response to the operation command, the optical sensor processes the raw signal after spectral imaging to obtain the spectral information of each pixel, and performs digital image processing to obtain a display spectral image; And the target object is identified based on the captured spectral image information via the spectral recognition module, and the location information of the target object is determined. Step (c) includes: in response to the user's selection of macro shooting mode, activating spectral recognition mode, and adjusting the focal length of the telephoto macro lens so that the focal area of ​​spectral recognition is aligned with the target to be photographed, so as to obtain the microstructure of the object being photographed.

12. The imaging method according to claim 11, wherein when the distance to the target object exceeds a set distance, the spectral recognition module identifies the focal point of the distance to the target object based on the captured spectral image information.

13. The imaging method according to claim 11, wherein step (c) comprises: Based on the captured spectral information, the regional boundaries of the environment in which the target object is located in the spectral image are identified, and the spectral image is divided into the target object region and the target environment region.

14. The imaging method according to claim 13, wherein the regional boundaries of the target object and the target environment in the spectral image are identified based on the spectral curve of the captured target object and the spectral curve of the target object environment, and the target object and the target environment are identified according to the regional boundaries.

15. The imaging method according to claim 11, wherein at least a portion of the image information can be selected as spectral information via a spectral selection module, and the remaining portion of the image information is the corresponding displayed image information.

16. The imaging method according to claim 15, wherein step (c) comprises: In response to the user's marking of a selected location, the spectral selection module displays the image information corresponding to the selected location as a spectral image, while the area outside the selected location is displayed as an image.

Images