Imaging system and method for imaging
The imaging system addresses the limitations of conventional Raman scattering by using 810nm illumination and 950nm to 2500nm detection, achieving label-free, wide-field imaging for mesoscopic and macroscopic biological and medical applications.
Patent Information
- Application Number
- PCT/EP2025/060574
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-04-16
- Filing Date
- 2025-04-16
- Publication Date
- 2025-10-23
AI Technical Summary
Conventional Raman scattering-based techniques are limited to microscopic scales due to high autofluorescence background and require labeling, hindering applications in mesoscopic and macroscopic imaging, particularly in vivo imaging.
An imaging system using illumination light with a wavelength of at least 810nm and a detector capable of detecting light in the range of 950nm to 2500nm, enabling diffused illumination and wide-field imaging to suppress autofluorescence and enhance Raman scattering contrast.
Enables mesoscopic and macroscopic label-free imaging by significantly improving the signal-to-noise ratio, allowing visualization of biological tissues and objects without labeling, suitable for medical and biological applications.
Smart Images

Figure EP2025060574_23102025_PF_FP_ABST
Abstract
Description
[0001] Imaging system and method for imaging
[0002] Technical field
[0003] The present disclosure relates to an imaging system and a method for imaging, in particular to imaging using Raman scattered light.
[0004] Background
[0005] For many applications, the identification of molecules and / or biological tissue compositions play an important role. One common approach is based on labeling and / or staining (in the following, labeling and staining will be generally referred to as "labeling" without any loss of generality) the object to be analyzed and rely on the label for the identification.
[0006] One common example is the use of f luorophores , in which the resulting fluorescence is used to analyze the object. While this approach has clear advantages, the requirement of labeling the object comes with substantial disadvantages. For example, labeling the object may not always be possible, may alter the object under study and / or may damage the object. Similarly, also the process of fluorescence imaging itself may damage the object. Thus, the possible range of applications of this approach is limited.
[0007] One mechanism that can be exploited without the need for labeling is Raman scattering. Raman scattering-based techniques are based entirely on the endogenous chemical contrast without the need for labelling techniques (Freudiger et al., Science 322 (5909) : 1857-1861, 2008) . This method is based on detecting light from Raman scattering, an inelastic scattering process in which energy is exchanged between incident photons and the scattering object, often times the chemical bonds in tissues: because each chemical bond exchanges energy with light in a specific matter, the spectrum of the incident light shifts in a predictable manner based on the chemical bonds involved (Hu, Shi and Min, Nat Methods 16(9) : 830-842, 2019) . For instance, a typical biomolecule exhibits four broad Raman bands: the "fingerprint" region between 400 and 1800 cm-1, where many chemical bonds are identified by their very narrow vibrational peaks; the "Raman-silent" region between 1800 and 2800 cm-1, where vibrational transitions of biomolecules are rare; the "CH2-CH3" region, also referred to "CH" region, between 2800 and 3100 cm-1, where stretching of CH2and CH3groups in lipids and proteins can be identified; and the "OH" region between 3200 and 3600 cm-1, where hydroxylcontaining molecules including water and sugars can be detected (Movasaghi et al., Applied Spectroscopy Reviews 42 (5) : 493- 541, 2007) . Instead of "region", also the term "band" is commonly used. If reference is made to detection of light within such a region, the term "channel" is used as well.
[0008] Conventionally, Raman-based techniques are however only used for spectroscopy or microscopy. These methods take advantage of this phenomenon to visualize and analyze biomolecules in cells and thin tissue sections (Zhang et al. , Acc Chem Res 47 (8) : 2282-2290, 2014) . The limitation to small sample areas limits applications, in particular in vivo applications (Bohndiek et al., Proc Natl Acad Sci USA 110 (30) : 12408-12413, 2013) . Specifically, scanning microscopy based on Raman scattering requires high laser fluxes, thus for all practical purposes limiting this technique to analyzing the laser focal point, which is on the order of millimeters (Krafft et al., Chem Soc Rev 45(7) : 1819-1849, 2016) . Further, spectroscopic detection of spontaneous Raman scattering involves illumination at a single point or at best along a line and while extending this to areas is in principle possible by scanning the sample, such a process requires minutes in order to scan an area of only 1 cm2. Consequently, at present Raman scattering-based techniques are limited to the microscopic scale without any practical applications on the mesoscopic or macroscopic scale.
[0009] One reason for this limitation lies in the cross section of Raman scattering oftentimes being smaller than other processes taking place in parallel. These other processes include, but are not limited to, fluorescence, luminescence and autofluorescence processes and are herein generally referred to as "autofluorescence" or "background signals". These background signals make high laser fluxes necessary to achieve a regime in which Raman scattering becomes sufficiently strong to provide a clear and distinguishable signal, i.e., a sufficient signal to noise ratio is needed for detection.
[0010] As evidently macroscopic label-free imaging would be highly desirable for elucidating complex processes in healthy or diseased tissues and animal models (Jermyn et al., Sci Transl Med 7 (274) : 274ral9, 2015) , it was suggested to achieve larger fields of view within reasonable exposure times to image Raman scattering with wide-field systems, which provide scalable fields of view based on their optical design (Mallia et al., J Biomed Opt 17 (7) : 076017, 2012) .
[0011] However, a major hindrance faced by conventional wide-field Raman techniques is the elevated autofluorescence background from endogenous fluorophores that drown out the desired chemical contrast (Yang et al., Analyst 139(12) : 3107-3114, 2014) such that the signals obtained from Raman scattering are not clearly distinguishable from this background. One reason for this is that, while generally autofluorescence decreases at longer wavelengths because fewer biological chromophores are excited (Frangioni, Curr Opin Chem Biol 7 (5) : 626-34, 2003; Sun et al., J Biomed Opt 28 (9) : 094805, 2023) as the illumination wavelength increases, at the same time the intensity of Raman scattering also decreases, in particular the Raman cross-section is inversely proportional to the fourth power of illumination wavelength (Shipp et al., Advances in Optics and Photonics 9(2) : 315-428, 2017; Patil et al., Opt Lett 39(2) : 303-306, 2014) .
[0012] As consequence, even when going to wavelengths in the nearinfrared range, reaching up to 785nm, such that the autofluorescence is reduced while keeping the Raman scattering shifts within the detection range of typical Si-based detectors (Papour et al., Biomed Opt Express 6(10) : 3892-3897, 2015) , the chemical contrast obtained with this approach has been unsatisfactory.
[0013] In view of this, there is a need for a technique that allows imaging, in particular imaging at the mesoscopic and macroscopic scale, rather than mere microscopy, without the need for labeling, remains to be developed.
[0014] Summary
[0015] The present disclosure has been made in view of the above technical limitations of currently existing techniques and provides an imaging system and method for imaging that allow to image an object, preferably a mesoscopic or macroscopic object, for example, of biological and / or medical origin, such as tissue, without the need to label the object.
[0016] According to an aspect of the present disclosure, there is provided an imaging system for imaging an object, the imaging system comprising: an illumination light source configured to illuminate an area of the object; and a detector configured to detect an image based on Raman scattered light from the object, wherein light emitted by the illumination light source has a wavelength of at least 810nm.
[0017] According to another aspect of the present disclosure, there is provided a method for imaging an object, the method comprising the steps of: illuminating an area of the object using illumination light; and detecting an image based on Raman scattered light from the object, wherein the illumination light has a wavelength of at least 810nm.
[0018] In addition, preferred aspects of the present disclosure are defined in the dependent claims.
[0019] According to the invention, a technique that allows imaging, in particular imaging an object at the mesoscopic and macroscopic scale, for example, an object of biological and / or medical origin, such as tissue, without the need for labeling and / or staining, is provided.
[0020] Brief description of the drawings
[0021] Embodiments of the present disclosure, which are presented for better understanding the inventive concepts, but which are not to be seen as limiting the disclosure, will be described with reference to the figures in which:
[0022] Fig. 1 shows an illustration of an imaging system for imaging an object;
[0023] Fig. 2 shows a flow chart of a method for imaging an ob j ect ;
[0024] Fig. 3 shows an illustration of an imaging system including a filter for imaging an object;
[0025] Fig. 4 shows Raman spectra of water and olive oil; Fig. 5 shows images of a probe containing water and olive using different imaging methods and / or different detection ranges;
[0026] Fig. 6 shows images obtained using Raman imaging at different illumination light wavelengths and corresponding CH channel intensity across a line through the object;
[0027] Fig. 7 shows images obtained using Raman imaging at different illumination light wavelengths for different channels;
[0028] Fig. 8 shows a plot of the fat pads to liver ratio in the CH channel of Fig. 6 as a function of the illumination light wavelength;
[0029] Fig. 9 shows images of a porcine facial nerve embedded in adipose tissue obtained using Raman imaging; and
[0030] Fig. 10 shows images of an awake mouse using Raman imaging .
[0031] Detailed description
[0032] Fig. 1 shows an illustration of an imaging system for imaging an object. In this general embodiment, there is provided an imaging system for imaging an object 100, which may be a label- free object 100, the imaging system comprising: an illumination light source 10 configured to illuminate an area 1000 of the object 100; and a detector 20 configured to detect an image based on Raman scattered light from the object 100, wherein light emitted by the illumination light source 10 has a wavelength of at least 810nm. It is noted that in the present disclosure imaging is understood as distinct from microscopy and / or spectroscopy: While microscopy and spectroscopy, in the context of Raman scattering from the focus of a coherent laser beam, is limited to the microscopic scale, imaging refers to analyzing not merely such a microscopically small part of the object, but rather at least a mesoscopic or macroscopic part of the object is analyzed. In particular, imaging implies - different from microscopy / spectroscopy - that at least a mesoscopic or macroscopic part of the object is illuminated by a single illumination step and consequently analyzed by a single analysis step.
[0033] That is, imaging may mean simultaneous, spatially resolved detection on a linear or 2D array of pixels and / or detectors.
[0034] It is noted that the area 1000 of the object 100 may be the entire object 100. In other words, the present disclosure is not limited to imaging only a part of the object under study or to imaging the whole object. Instead, imaging can be adjusted to an arbitrary part of the object according to the respective application.
[0035] In this context, it is noted that a field of view of the imaging system, associated with the area 1000 of the object 100 illuminated by the illumination light source 10, may be at least 0.25cm2, at least 2cm2, preferably at least 5cm2, preferably at least 10cm2, more preferably at least 50cm2, more preferably at least 100cm2, more preferably at least 400cm2.
[0036] This illustrates that the present disclosure is directed at Raman imaging at the mesoscopic or macroscopic scale rather than Raman microscopy limited to a microscopic focal spot which may be scanned to obtain Raman spectra sequentially and to analyze a spectrum for each point scanned. Herein, field of view may be considered as the area that is illuminated and detected by the imaging system concurrently, that is, at the same time. In other words, the field of view can be illuminated and detected in a single acquisition step. Different from that, in Raman microscopy, even when the entire object is scanned, only the light from the focal spot is analyzed .
[0037] In other words, different from spectroscopy, imaging may comprise multiplexing the detection with a spatial resolution and the detector has an array of pixels, preferably a square array of pixels. Such an array may for example have at least 16 x 16 pixels, preferably at least 160 x 128 pixels, more preferably at least 320 x 256 pixels, more preferably at least 640 x 512 pixels, or more preferably at least 1280 x 1024 pixels .
[0038] The illumination light source 10 may comprise a laser. Further, the illumination light source 10 may be configured to diffusely illuminate the area of the object. Here, diffusely illuminating the area 1000 and / or the object 100 may be understood as illuminating the area 1000 / the object 100 without focusing on a particular part of the area / object. It may in particular mean that the area 1000 / the object 100 is substantially uniformly illuminated. Diffuse illumination is different from focusing the coherent laser on a single focus point as done in conventional Raman spectroscopy.
[0039] Diffusely illuminating may be achieved by using a diffuser. A diffuser, i.e., a device that diffuses light, may be device that scrambles the wavefront of the light and reduces the spatial coherence of the light. In other words, the illumination light source 10 may comprise a diffuser through which the light, preferably laser light, passes before it illuminates the area of the object. The illumination light source may comprise a laser source, for example a continuous wave laser source collimated by a lens. The laser light may then go through a diffuser and may further be coupled with one or more clean-up filters suitable for each laser. In an example using 785nm laser, such a filter may be a SP800.
[0040] In a further example, the illumination light source may comprise an LED. This may require longer exposure times compared to a laser source but may simplify the setup.
[0041] Some of the experimental data discussed in this disclosure may be obtained with the following setup: Samples are illuminated using the following lasers (Lumics) to obtain the wavelengths indicated in the figure legends: 785 nm, LU0785D250-U70AN; 892 nm, LU0890D400-U10AF; 938 nm, LU0940D250-U70AF; 968 nm, LU0980D350-U30AF; and 1064 nm, LUI 064D350-U7 OAF . Lasers are connected to a 7 x 1 fan-out fiber-optic bundle (catalog no. BF76LS01, Thorlabs) with a core diameter of 600 pm. The laser light travels from the common end of the multi-fiber bundle into an excitation cube (catalog no. KCB1EC / M, Thorlabs) , it reflects off a mirror (catalog no. BBE1-E03, Thorlabs) , then it passes through a positive achromat (catalog no. AC254-050- B, Thorlabs) . The wavelength of the laser output is cleaned up using appropriate short-pass filters to prevent detection of the laser light, such as a 900nm filter for illumination at 892 nm. From the achromat, the laser light passes through an engineered diffuser (catalog no. ED1-S20-MD, Thorlabs) to provide uniform illumination on the field of view.
[0042] Depending on the experiment, the maximum laser power density varies roughly between 50 and 150 mW / cm2, as measured using a PM100D power meter equipped with a S130C sensor (Thorlabs) . The densities remain within international exposure limits (International Commission on Non-Ionizing Radiation 2013) . As indicated, the light emitted by the illumination light source 10 has generally a wavelength of at least 810nm, i . e . , 810nm or more .
[0043] In a preferred embodiment , the light emitted by the illumination light source has a wavelength in the range of 810nm to 1800nm .
[0044] In a further preferred embodiment, the light emitted by the illumination light source has a wavelength in the range of 810nm to 1300nm .
[0045] In a further preferred embodiment, the light emitted by the illumination light source has a wavelength in the range of 830nm to 1300nm .
[0046] In a further preferred embodiment, the light emitted by the illumination light source has a wavelength in the range of 830nm to 1200nm .
[0047] In a further preferred embodiment, the light emitted by the illumination light source has a wavelength in the range of 850nm to 1200nm .
[0048] In a further preferred embodiment, the light emitted by the illumination light source has a wavelength in the range of 890nm to 1070nm .
[0049] In a further preferred embodiment, the light emitted by the illumination light source has a wavelength in the range of 892nm to 1064nm .
[0050] Any of the disclosed lower limits for the wavelength of the light emitted by the illumination light source 10 can be combined with any of the disclosed upper limits for the wavelength of the light emitted by the illumination light source 10 to define further suitable ranges of the illumination wavelength for the purposes of this invention . As an example , further exemplary ranges for the wavelength of the light emitted by the illumination light source 10 illustrating this include the range of 810nm to 1064nm and the range of 892nm to 1800nm .
[0051] In conventional attempts to achieve Raman imaging, wavelength up to 785nm were used in line with the understanding that autofluorescence reduces with increased wavelength, the autofluorescence background nevertheless has proven to be a substantial obstacle . The inventors of the present disclosure , however, have reasoned and found that further increasing the wavelength, despite the associated decrease in Raman intensity due to the scaling of Raman scattering with the illumination wavelength, decreases the autofluorescence background further such that the overall ratio between Raman scattering-based signals and background signals improves signi ficantly . Based on these observations , see also the discussion of Figs . 6-8 , it has been found that a wavelength of 810nm of the illumination light is suf ficient to achieve an acceptable contrast and thus to reali ze Raman imaging, i . e . , visuali zation of an obj ect on a mesoscopic or macroscopic scale based on Raman scattering, in particular label- free Raman imaging .
[0052] In this context , it is noted that the shi ft to higher wavelengths , i . e . , at least 810nm, has an impact on the detection of the Raman scattered signals and hence using particular detectors , as discussed also below, may be advantageous . Speci fically, with shi fting the illumination light wavelength, the range of detection wavelengths of the detector may have to increase as well .
[0053] The detector 20 may thus be configured to detect light with a wavelength of at least 950nm, i . e . , 950nm or more .
[0054] In a preferred embodiment , the detector 20 may be configured to detect light with a wavelength in a range of 950nm to 2500nm, which may be referred to as "short-wave infrared (SWIR) " or "near-infrared II (NIR-II)".
[0055] In a further preferred embodiment, the detector 20 may be configured to detect light with a wavelength in a range of 950nm to 2200nm.
[0056] In a further preferred embodiment, the detector 20 may be configured to detect light with a wavelength in a range of 950nm to 2000nm.
[0057] In a further preferred embodiment, the detector 20 may be configured to detect light with a wavelength in a range of 950nm to 1700nm.
[0058] In a further preferred embodiment, the detector 20 may be configured to detect light with a wavelength in a range of 950nm to 1600nm.
[0059] Any of the disclosed ranges of illumination wavelength of the illumination light source 10 can be combined with any of the disclosed ranges in which the detector 20 may be configured to detect light. In fact, these combinations are not particularly limited as, apart from the Raman shifts one is interested and / or are present in the object to be analyzed, there are no limitation on any of these combinations.
[0060] In line with the above discussion, the detector 20 may be a wide-field imaging detector. This in particular advantageous in the context if a large field of view is desired.
[0061] Further, the detector 20 may be a InGaAs-based detector, a HgCdTe-based detector or a Ge-based detector. These detectors may be advantageous over conventionally used detectors, such as Si-based detectors, as they can reach higher detection ranges (ranges having longer wavelengths) necessary if longer illumination light wavelengths are used. Moreover, the detector 20 may be cooled to a temperature in the range of -20°C to -272°C, preferably -50°C to -272°C, preferably in the range of -50°C to -200°C, preferably in a range of -180°C to -200°C, more preferably to about -190°C. Further, as explained below, in specific setups, cooling may not be necessary at all and imaging with a detector operated higher than room temperature may become possible. In fact, the detector may be operable at temperatures of up to 70°C
[0062] Temperatures (of the camera chip / detector ) in the range from -20°C to -90°C can be reached by a combination of thermoelectric and water cooling. A setup that can operate by such cooling techniques is overall lighter and more portable, drastically enhancing the range of possible. A temperature close to -50°C can be reached by air cooling, while temperatures in the range of -180°C to -200°C may be reached using, for example, liquid nitrogen. A temperature down to - 272°C may be reached using, for example, liquid helium.
[0063] The object 100 may be of biological and / or medical origin. For example, the object 100 may be a sample to be analyzed, for example for a medical purpose. This may include the object 100 being a mouse.
[0064] In addition, the object 100 may be chemicals, heterogeneous samples, or pharmaceutical compounds. This may find applications in, for example, manufacturing quality control procedures, in material sciences, food production.
[0065] The object 100 may be label-free. In the context of the present disclosure, label-free may refer to the object 100 subject to the disclosed imaging being free of any labeling and / or staining, for example, with an external contrast agent. However, label-free, in particular label-free imaging may refer to the imaging process being label-free, that is, not reliant on labeling / staining . In other words, label-free imaging does not require that the object 100 being imaged is label-free in general but only requires that the imaging itself does not involve / rely on labeling. In more concrete terms, in the context of the present disclosure, an object 100 that is labeled by an agent having no influence on the herein described imaging techniques is also considered a label-free object 100 and the imaging performed is considered a label-free imaging.
[0066] The detection path may comprise the detector, one or more lenses, one or more filter, such as laser clean-up filters and / or effective band-pass filters that will determine which spectral region to be detected. It may further involve a filter wheel. Manual operation may be used instead of the filter wheel .
[0067] Illumination light may be blocked from reaching the detector 20. This may be more relevant if the signal is weak, small fractions of the illumination light passing through the filters may influence the detected signals. In such a case, the detected signals may be overwhelmed by reflection and measuring the Raman signals may be difficult.
[0068] Some of the experimental data discussed in this disclosure may be obtained with the following setup: The nitrogen-cooled camera NIRvana LN (Princeton Instruments) is mounted on a rail carriage (catalog no. G026428000, Qioptic) parallel to an optical table (catalog nos. SDR7590 and B7590L, Thorlabs) . This camera may be advantageous because of its deep cooling, low dark current and low read noise, which may provide high signal-to-noise ratios at long exposures in a single frame. It is noted that a simpler, air-cooled portable NIRvana HS (Princeton Instruments) can also detect Raman scattering. An f / 2.8, 50-mm lens capable of transmitting SWIR radiation (SWIRON 2.8 / 50, Schneider-Kreuznach) is attached to the camera using an F-mount adapter, while three 30-mm cage plates with removable holders (catalog no. CFH2 / M, Thorlabs) for 1-inch optical filters (filter slots 1-3) are positioned in front of the camera lens to facilitate filter changes. A silver mirror in a right-angle kinematic elliptical holder (catalog nos. KCB1EC / M and PFE10-P01, Thorlabs) is mounted on the cage plate farthest from the lens in order to direct the laser light towards the optical table. A 60-mm cage plate with a removable holder for 2-inch optical filters (catalog no. LCFH2 / M, Thorlabs) is attached to the side of the kinematic elliptical holder closer to the sample. Of the four filter positions, the one closest to the camera lens and the one closest to the sample (slots 1 and 4, respectively) is usually occupied by long-pass filters, which eliminated stray light from the laser; for example, the filters were long-pass 1000 nm when samples are illuminated at 968 nm. The two central filter positions are usually occupied by band-pass filters to define the detection band. With this set-up, fields of view at least 56 cm2can be obtained. It is further noted that a different choice of optics can enable larger or smaller fields of view, reflecting the scale-spanning character of wide-field imaging.
[0069] In an aspect, the imaging system may comprise a second illumination light source configured to illuminate the area of the object.
[0070] In an aspect, light emitted by the second illumination light source may have a different wavelength than the light emitted by the illumination light source. This may serve the purpose of target two different Raman bands of the same or two different molecules.
[0071] This second illumination light source, which may be a second laser, may improve the speed of imaging, that is, may reduce the time necessary for imaging.
[0072] In an aspect, the detector 20 may be configured to detect the image in a single wavelength range. A single wavelength range may be achieved by using a single band-pass filter. In other words, in some aspects according to the present invention, the wavelength range in which detection takes place is fixed and does not change during imaging. It is noted that detecting in a single wavelength range does not mean that the detector comprises only a single filter as other filters having different functionality may be present and the single wavelength range may for example be achieved by a combination of a low-pass filter and a high-pass filter. In other words, "single wavelength range" may refer to the wavelength range used being fixed, that is, to a f ixed / constant / predetermined wavelength range.
[0073] In an aspect, the imaging system comprises the object and wherein the object is a label-free object.
[0074] In an aspect, the wavelength of the light emitted by the illumination light source, the wavelength of the light emitted by the second illumination light source, and the single wavelength range may be such that the detected image contains Raman scattered light originating from the illumination by the illumination light source and from the illumination by the second illumination light source.
[0075] In other words, while the wavelengths of the illumination light source and the second illumination light source are different, they are chosen such that the wavelength of the Raman scattered light coincides and thus can be detected using a single wavelength range.
[0076] Advantages associated with the above aspects directed to the second illumination source and / or the single wavelength range used for detection will be discussed below in detail.
[0077] Fig. 2 shows a flow chart of a method for imaging an object. Specifically, Fig. 2 shows a method for imaging an object, preferably a method for label-free imaging an object, the method comprising the steps of: illuminating an area of the object using illumination light (S100) ; and detecting an image based on Raman scattered light from the object (S200) , wherein the illumination light has a wavelength of at least 810nm.
[0078] As can readily be understood, the method for imaging an object can be carried out using any imaging system discussed in the present disclosure, for example, the imaging system discussed in connection with Fig. 1.
[0079] Further, as also mentioned elsewhere, in an aspect, the object may be a label-free object.
[0080] In an aspect, the method may further comprise a step of illuminating the area of the object using second illumination light .
[0081] In an aspect, a wavelength of the illumination light is different from a wavelength of the second illumination light.
[0082] In an aspect, the detected image may contain Raman scattered light originating from the illumination light and the second illumination light.
[0083] In an aspect, detecting the image may involve a single wavelength range.
[0084] Specifically, while one possible aspect according to the present disclosure may be based on a single illumination light source / a single illumination light and the separate detection of the resulting different Raman scattered light by means of different filters, in a further aspect of the present disclosure, it is foreseen that different illumination light sources with different wavelengths are used, preferably such that the resulting Raman scattered light of the different illumination light sources lies within a single wavelength range .
[0085] In an aspect of the present disclosure the first wavelength of the illumination light source is selected to excite a Raman band of a first bond / molecule / type of molecule (of the object) and the second wavelength of the second illumination light source is selected to shift a Raman band of a second bond / molecule / type of molecule (of the object) so that the Raman scattering of the two Raman bands results in the same wavelength range, e.g., in a range with a bandwidth of lOOnm, preferably 50nm.
[0086] For example, when considering the Raman scattering of the OH band and the CH band, it can be readily understood that a first laser (the illumination light source) with a wavelength of about 892 nm and a second laser (the second illumination light source) with a wavelength of about 936 nm will both result in Raman scattered light of the respective bands in the range of about 1275 nm, specifically in the range of 1250 to 1300 nm.
[0087] As switching between illumination light sources, in particular between lasers, can be performed faster than switching between band-pass filters, this aspect of the present disclosure may increase the speed of imaging substantially. Specifically, such a configuration does not require any " (mechanically) moving parts", e.g., filters being changed by means of filter wheel as commonly done, and can be implemented completely electronically, e.g., by turning off / on the illumination light sources. Consequently, the limitation on the imaging time is not given by the mechanical structure of the system but by the limitations of the detector. As the detector allows for much shorter imaging times, this represents a substantial improvement, in particular allows not only to reduce the imaging time as such but also reduces motion artefacts to a substantial degree.
[0088] To ensure that the Raman scattering from different illumination light sources / diff erent illumination light can be differentiated sufficiently clearly, a cycle sequence may be used. Such a cycle sequence may comprise a first illumination frame with illumination by the illumination light source and a second illumination frame with illumination by the second illumination light source, each with a duration of for example 100ms. The cycle sequence may further comprise an initial frame, with a duration of for example 10ms, to mark the beginning of the cycle, and / or background frames, in which no illumination takes place, each with a duration of for example 100ms, before and / or after the first and / or second frame in which illumination takes place.
[0089] Additionally, it is noted that a possible cycle sequence could also involve a very short illumination duration of only 10ms with a rather long "laser off" period of 990ms. In this case, the power during the illumination can be further increased, for example up to 10W / cm2, while maintain an average of 100mW / cm2. At such conditions, the detector does not require any cooling and may be operated at room temperature.
[0090] In this connection, it is noted that one important aspect of the illumination scheme in general is that the total flux, for example expressed in power per area, is such that the object 100 is not heated as this may af f ect / disrupt the imaging process and / or damage the object 100. In this regard, established guidelines may be followed. In some embodiments, an average of about 260mW / cm2may be used.
[0091] In this regard, the background frames, specifically the time off, i.e., without illumination, may allow to increase the power during the illumination frames while maintaining the average power, that is, the total flux. Moreover, the background frames may be used for background correction.
[0092] Importantly, such a cycle allows imaging on very short time scales which allows imaging of living tissue, for example, during surgery.
[0093] In an aspect, the illumination by two different illumination light sources may take place shortly after each other, i.e., the illumination in the first frame takes place at the end of this first frame and the illumination in the second frame takes place at the beginning of this second frame. In this way, imagining with very short delay (in the order of a few hundred nanoseconds is possible) can be achieved. This not only further increases the speed of imaging; it also further removes motion artefacts as the time between the two illuminations is further decreased .
[0094] A further advantage of using a same detection range, i.e., a single wavelength range, is that it improves comparability between the different Raman scattered signals. Specifically, the object may have varying optical properties across different wavelengths, such as differences in absorption and scattering properties. These wavelength-dependent optical characteristics can have a significant impact on the detected signals, which are directly imaged onto the camera detector, as opposed to the illumination light, which is typically diffuse and less affected. Thus, the penetration depth, detected signal and contrast can strongly vary, which makes quantitative comparison of the different data streams challenging. In addition, when using different detection ranges, effects such as chromatic aberration may affect the detection ranges differently, which may be particularly pronounced in the shortwave infrared range. While these effects can be corrected, this makes the data analysis more cumbersome.
[0095] Additionally, the usage of more than one illumination light source to illuminate the object may be used to amplify the signal since the relevant parts of the Raman spectrum may be overlapped / correlated / multiplied with each other. Hence, a configuration of more than one illumination light source combined with a single detection range may allow further postprocessing modifications leading to enhanced / amplif led signals .
[0096] It is further noted that it is also possible to extend the concept of using more than one illumination light source, each of which chosen such that the resulting Raman scattering falls within a common wavelength range to be detected by the detector, to a setup in which more than one detector is used. In this case, the limitation to a common wavelength range can be lifted.
[0097] In such a setup, different Raman scattered signals may be detected by the different detectors, e.g. using a dichroic mirror to direct the scattered signals to different detectors or using individual filters per detectors, in which case each camera may be position at different angles and images acquired by each detector may be co-registered through computational post-processing. While this requires additional detectors, it allows more freedom in the choice of illumination wavelength as the Raman scattered light does not have to be within a single detection range. As such a setup would also allow to rely solely on electrical control of the illumination without the need for mechanical control of the detection range, the above considerations apply equally to such a setup.
[0098] It is further noted that the present disclosure is not limited to two illumination light sources, but instead this concept can readily be extended to more than two illumination light sources .
[0099] Fig. 3 shows an illustration of an imaging system including a filter for imaging an object. The imaging system of Fig. 3 may be understood as a particular example of the imaging system of Fig. 1 and accordingly contains an illumination light source 10, a detector 20 and an object 100, which is a mouse.
[0100] Here, the illumination light source comprises a laser diffusely illuminating the whole object 100. In line with the above discussion, the various bonds in the various molecules of the object 100 lead to Raman scattering at the different scattering wavenumbers, i.e., different scattered light with different wavelengths as illustrated by the three upgoing arrows going towards the detector 20. It is noted that the left and middle arrow represent Raman-scattered light with different wavelength as can be seen from the overlaid wave, while the right arrow represents the background signals.
[0101] Fig. 3 further shows a filter, preferably a band-pass filter and / or a combination of long- and short-pass filters resulting in an effective band-pass filter, which in the specifically depicted case, filters out any light different from the one represented by the middle arrow. Accordingly, the detector 20, in this case, only detects this band of the scattered light. As indicated on the right, several filters can be used, each leading to a separate image of the object 100 showing light in different wavelength ranges / channels . These may then be overlaid (merged) using different colors to arrive at one image merging the individual images each representing a single Raman band, leading to an image showing the complete Raman spectrum. Alternatively, the images can also be done at the single channel without overlaying such that a color composite can be obtained .
[0102] The filters may, for example, be used in parallel, i.e., the light incident towards the detector 20 may be split and each split part may be subject to a different filter, or may be used in series, the imaging is carried out several times, each time with a different filter. However, the details of the filters are not particularly limited and their arrangement may be varied as appropriate. It is further noted that the filters can also split incident light and multiple images can be generated simultaneously on multiple cameras / detectors .
[0103] The band-pass filters may be chosen in accordance with the above discussion regions of a typical biomolecule such that a classification of different molecules becomes possible. For example, as discussed below with reference to Figs. 4 and 5, this may allow to distinguish between water and olive oil or as discussed below with reference to Figs. 6 and 7, this may allow to distinguish various parts of a mouse.
[0104] In other words, the imaging system may comprise a filter or a filter group, preferably at least two band-pass filters, more preferably at least three band-pass filters, each configured to select at least one Raman peak.
[0105] For these filters, a high optical density (OD) may be advantageous, in particular an OD of at least 4 may be preferred, to block the illumination light. Examples of these filter can be colored glass, dielectric, or a combination of both .
[0106] Here, Raman peak may be understood to refer to the Raman bands mentioned above, namely, the "fingerprint" region, the "Raman- silent" region, the "CH2-CH3" or "CH" region, or the "OH" region. Raman peak may further also refer to a more narrow part of such a band or may also be a combination of such bands or more narrow parts of such bands.
[0107] Figs. 4 and 5 discuss an example of using these Raman bands to demonstrate the capability of the present invention to use Raman scattering to visualize and differentiate between different biomolecules on a macroscopic scale. Fig. 4 shows Raman spectra of water and olive oil, while Fig. 5 shows images of a probe containing water and olive using different imaging methods and / or different detection ranges.
[0108] Fig. 4, showing the Raman spectrum of olive oil (top) and water (bottom) as normalized intensities as a function of the Raman shift in units of wavenumber (in cm-1) and also indicating the four Raman bands, makes clear that by counting the detection events, i.e., intensity, when selecting, by means of a filter, the CH band and by counting the detection events when selecting the OH band, one can distinguish water from olive oil by means of Raman imaging. In fact, the clear peak in the CH band in the case of olive oil and the broader but equally clear peak in the OH band in the case of water make such a distinction straightforward .
[0109] Fig . 5 demonstrates that this distinction is indeed not only possible on the basis of the spectrum but that the present invention allows to implement this technique on a macroscopic scale . In detail , the left part , titled "Visible" , of Fig . 5 shows a normal photo taken by a conventional camera sensitive to visible light of a tube filled with water (bottom) and olive oil ( top ) . The middle part , titled "CH" , shows the result of a Raman imaging process performed according to the present invention, wherein as titled the incident light detected by the detector is basically limited to the CH band . Similarly, the right part , titled "OH" , shows the result of a Raman imaging process performed according to the present invention, wherein as titled the incident light detected by the detector is basically limited to the OH band . From the middle and right part of Fig . 5 , it can clearly be recogni zed that the Raman imaging of the shown tube is able to provide a distinction between the water on the top and the olive oil on the bottom . Fig . 5 thus illustrates that the present invention is not directed at Raman microscopy but is able to image macroscopic elements , i . e . , that the field of view imaged clearly extends beyond the microscopic scale .
[0110] Figs . 6 and 7 show examples of Raman imaging according to the present invention performed on a mouse . Fig . 6 shows images obtained using Raman imaging at di f ferent illumination light wavelengths ( top ) and corresponding CH channel intensity across a line through these images (bottom) .
[0111] The top part of Fig . 6 in particular shows how the autofluorescence dominant at an illumination wavelength of 785nm decreases compared to the Raman scattering signal at a wavelength of 892nm and above in the CH channel . In more detail , while in the most left image obtained with illumination light having a wavelength of 785nm, the lower part of the mouse is illuminated without showing any details in the image , the remaining four images obtained at higher wavelengths show a clear contrast indicating fat pads in the mouse in line with general mouse anatomy .
[0112] This is also confirmed in the bottom part of Fig . 6 showing the CH intensity across the line indicated in the top part of Fig . 6 . While the most left image shows no particular contrast (no distinct spatially separable peaks ) , the four images on the right side show a common "W-shape" contrast that becomes more pronounced with increasing wavelength .
[0113] Fig . 7 shows images obtained using Raman imaging at di f ferent illumination light wavelengths for di f ferent channels . Speci fically, Fig . 7 shows the " silent region" , the "CH band" and the "OH band" as discussed above for the same mouse as shown in Fig . 6 illuminated at di f ferent wavelengths . Accordingly, the middle row of Fig . 7 corresponds , expect for the omission of the image for a wavelength of 1064nm, to the top part of Fig . 6 .
[0114] The top row of Fig . 7 shows the silent region . As no ( strong) Raman scattering takes place in the silent region, the four images obtained using illumination light at wavelengths of 785nm, 892nm, 938nm and 968nm are very similar : Without Raman scattering taking place , the change from 785nm to higher wavelength at which Raman should become more pronounced ( i f present ) compared to the autofluorescence cannot be observed and accordingly the image does not change qualitatively .
[0115] The middle row of Fig . 7 showing the CH band has been discussed above and shows prominently how the Raman scattering becomes far more pronounced compared to the autofluorescence at higher wavelengths . The bottom row of Fig. 7 showing the OH band shows a similar behavior as the CH band: While at 785nm the autofluorescence is very strong and thus mostly the lower part of the mouse is imaged, the Raman scattering of the CH band becomes more pronounced at higher wavelengths, leading to a better contrast of the complete mouse compared to the black background.
[0116] Taken together, Fig. 7 underscores that the capability of Raman scattering-based imaging at the macroscopic scale across the whole range of the Raman spectrum.
[0117] Fig. 8 shows a plot of the fat pads to liver ratio in the CH channel of Fig. 6. Specifically, Fig. 8 is based on the following considerations: The bottom part of Fig. 6, obtained by extracting the data from the dotted line in the middle of the mouse, shows that while at conventionally used wavelengths up to 785nm Raman scattering is subdued by autofluorescence, Raman scattering is dominant at the remaining wavelengths of 892nm and becomes more pronounced at 938nm, 968nm and 1064nm. This suggests that Raman scattering becomes dominant already at wavelength between 785nm and 892nm.
[0118] To obtain a better understanding at which wavelengths the advantageous effect of Raman scattering becomes dominant over autofluorescence, the data of the bottom part of Fig. 6, i.e., data obtained from the CH channel, has been analyzed in more detail. Specifically, a region of interest (ROT) in the bottom of the mouse was selected (the solid rectangle) , its mean value was measured and divided by the mean value of an ROT in the liver of the mouse (the dotted rectangle) . As the former lies within the fat pads of the mouse and the latter within the liver, this ratio is referred to as "fat pads to liver ratio".
[0119] One motivation behind this ratio is the following. The CH channel can be used to measure fatty tissue, represented by the fat pads, while liver tissue is autof luorescent and low in fat. Thus, a higher signal in the CH channel from liver tissue indicates a higher contribution from autofluorescence in the CH channel, while a higher signal in the CH channel from the fat pads indicates a higher contribution from Raman scattering. Thus, the higher the fat pads to liver ratio, the higher the chemical contrast. In other words, an increase in the fat pads to liver ratio indicates an increase in the Raman-to- Autof luorescence-contrast .
[0120] Further, for this purpose the images have been postprocessed to correct for illumination inhomogeneities.
[0121] Fig. 8 shows this fat pads to liver ratio as a function of the illumination wavelength. Solid circles indicate experimental data. The curve is an exponential fit of the experimental data, and the solid triangles are predicted values at wavelengths 810nm, 830nm and 850nm. From the values shown, it can be understood that already at an illumination light wavelength of 810nm it can be expected that Raman scattering is dominant over autofluorescence as the ratio is significantly larger than 1.
[0122] In the following, the capabilities for real-time acquisition provided by techniques according to the present invention will be described with reference to Figs. 9 and 10. Fig. 9 shows images of a porcine facial nerve embedded in adipose tissue obtained using Raman imaging, while Fig. 10 shows images of an awake mouse using Raman imaging.
[0123] Specifically, to enhance portability, light throughput and speed, a system utilizing a small, low-noise, water-cooled InGaAs camera (C-RED 2, First Light Imaging) was developed. This camera, operated at -40°C, allowed the attachment of a high-aperture lens (f / 1.4, model no. SWIR 35, Navitar) , thereby increasing light throughput. A lens tube with four 1-in filters was attached to the lens, containing three long-pass filters to block stray laser light, and one band-pass filter (BP 1275- 50, Edmund Optics) to select for the Raman bands. Further, higher power densities across a field of view of approximately 50 cm2can be achieved by setting up two illumination units, each connected to a 892- and a 936-nm laser, equipped with a focusing achromat (Thorlabs) , shortpass filters (either 950 or 975 nm) , and an engineer diffuser (part no. ED1-S20 or ED1-C20, Thorlabs) . The 892 nm and 936 nm lasers were used to shift the OH and CH bands into the BP1275- 50 window, respectively, in line with the above considerations.
[0124] The camera and lasers were synchronized using an Arduino Nano board. A typical cycle sequence can comprise (consist of) five frames: 1) a 10-ms laser-off frame to mark the beginning of the cycle; 2) a 100-ms laser-off background frame; 3) a 100- ms frame with the 892-nm lasers on; 4) a 100-ms frame with the 936-nm lasers on; and 5) a 100-ms laser-off background frame.
[0125] A delay may be introduced after the last frame to capture one full frame cycle per second. A custom software can be used for the live dual-channel visualization in pseudo-color, with online background correction to increase signal to noise in live mode. With an average of ~260 mW / cm2laser-on during one second, this approached enabled good signal-to-noise within 100-ms frames, while reducing motion artifacts. The delay and laser-off times helped prevent sample overheating and kept the total laser flux within exposure limits.
[0126] Using this setup, the images of Figs. 9 and 10 have been obtained .
[0127] Fig. 9 shows images of a porcine facial nerve embedded in adipose tissue obtained using Raman imaging. Specifically, Fig. 9 shows the dissection of a porcine facial nerve embedded in adipose tissue. Selected frames of a 30-second movie of OH and CH SWIR Raman imaging of a facial nerve dissection in a pig head. These images show the real-time capabilities of SWIR Raman imaging during a tissue dissection. As this models a surgical scenario , it underlines the applications the techniques herein disclosed can have .
[0128] Fig . 10 shows images of an awake mouse using Raman imaging . Speci fically, Fig . 10 shows SWIR Raman images of the CH and OH channels of an awake and freely-moving nude mouse . The shown frames are part of a 7-second interval in which the mouse freely roams across the field of view .
[0129] These images highlight the possibility for fast imagining using SWIR Raman imaging system, in particular that techniques as disclosure herein enable exposure times in the order of 100 ms .
[0130] In summary, the present invention provides an imaging system and a method for imaging that allows to image an obj ect , in particular a mesoscopic or macroscopic obj ect , on the basis of Raman scattering by using illumination light with a wavelength of at least 810nm . Speci fically, this imaging may be label- free imaging .
[0131] Advantageously, this allows imaging of macroscopic obj ects such that identi fication of molecules and / or biological tissue compositions becomes possible without the need to label and / or stain the obj ect . The techniques discussed in the present disclosure may find application wherever label- free imaging techniques and / or techniques able to image mesoscopic / macroscopic obj ects are required or particular advantageous .
[0132] This technique may thus be preferable over conventional fluorescence techniques i f labeling / staining the obj ect to be analyzed should be avoided or i f autofluorescence is too unspeci fic or not present . With respect to Raman microscopy, the present invention allows faster analysis when a large field of view is required as well as a broader range of applications .
[0133] In conclusion, the present invention provides a technique for Raman imaging that allows label- free visuali zation of obj ects in mesoscopic and macroscopic fields of view, which can in particular find application in visuali zation in physiological and pathological processes . Thus , the present invention presents a straightforward optical technique di f ferent to conventional fluorescence imagining and expands the applications of biomedical imaging into the range of Short Wave Infrared light .
Claims
ClaimsAn imaging system for imaging an object, the imaging system comprising: an illumination light source configured to illuminate an area of the object; and a detector configured to detect an image based on Raman scattered light from the object, wherein light emitted by the illumination light source has a wavelength of at least 810nm.
2. The imaging system according to claim 1, wherein light emitted by the illumination light source has a wavelength in the range of 810nm to 1800nm, preferably in the range of 810nm to 1300nm, more preferably in the range of 830nm to 1300nm, more preferably in the range of 830nm to 1200nm, more preferably in the range of 850nm to 1200nm, more preferably in the range of 890nm to 1070nm, more preferably in the range of 892nm to 1064 nm .
3. The imaging system according to claim 1 or 2, wherein a field of view of the imaging system, associated with the area of the object illuminated by the illumination light source, is at least 0.25cm2, at least 2 cm2, preferably at least 5cm2, preferably at least 10cm2, more preferably at least 50cm2, more preferably at least 100cm2, more preferably at least 400cm2.
4. The imaging system according to any one of claims 1 to 3, wherein the illumination light source is configured to diffusely illuminate the area of the object.
5. The imaging system according to any one of claims 1 to4, wherein the illumination light source comprises a diffuser through which the light passes before it illuminates the area of the object.
6. The imaging system according to any one of claims 1 to5, wherein the detector is configured to detect light with a wavelength of at least 950nm.
7. The imaging system according to claim 6, wherein the detector is configured to detect light with a wavelength in a range of 950nm to 2500nm, preferably in a range of 950nm to 2200nm, more preferably in a range of 950nm to 2000nm, more preferably in a range of 950nm to 1700nm, more preferably in a range of 950nm to 1600nm.
8. The imaging system according to any one of claims 1 to7, wherein the detector is a wide-field imaging detector .
9. The imaging system according to any one of claims 1 to8, wherein the detector is an InGaAs-based detector, a HgCdTe-based detector or a Ge-based detector.
10. The imaging system according to any one of claims 1 to9, wherein the detector is cooled to a temperature in the range of -20°C to -272°C, preferably in the range of -50°C to -200°C, preferably in a range of -180°C to - 200°C, more preferably to about -190°C, or wherein the detector is operable at temperatures of up to 70°C.
11. The imaging system according to any one of claims 1 to10, wherein the imaging system further comprises a filter or a filter group, preferably at least two bandpass filters, more preferably at least three band-pass filters, each configured to select at least one Raman peak .
12. The imaging system according to any one of claims 1 to 11, further comprising a second illumination light source configured to illuminate the area of the object.
13. The imaging system according to claim 12, wherein light emitted by the second illumination light source has a different wavelength than the light emitted by the illumination light source.
14. The imaging system according to claim 12 or 13, wherein the detector is configured to detect the image in a single wavelength range.
15. The imaging system according to any one of claims 1 to 14, wherein the imaging system comprises the object and wherein the object is a label-free object.
16. The imaging system according to claim 15, when dependent on claim 14, wherein the wavelength of the light emitted by the illumination light source, the wavelength of the light emitted by the second illumination light source, and the single wavelength range are such that the detected image contains Raman scattered light originating from the illumination by the illumination light source and from the illumination by the second illumination light source.
17. A method for imaging an object, the method comprising the steps of illuminating an area of the object using illumination light; and detecting an image based on Raman scattered light from the object,wherein the illumination light has a wavelength of at least 810nm.
18. The method according to claim 17, wherein the object is of biological and / or medical origin.
19. The method according to claim 17 or 18, wherein the method is carried out using the imaging system according to any one of claims 1 to 16.
20. The method according to any one of claims 17 to 19, wherein the object is a label-free object.
21. The method according to any one of claims 17 to 20, further comprising a step of illuminating the area of the object using second illumination light.
22. The method according to claim 21, wherein a wavelength of the illumination light is different from a wavelength of the second illumination light.
23. The method according to claim 21 or 22, wherein the detected image contains Raman scattered light originating from the illumination light and the second illumination light.
24. The method according to any one of claims 21 to 23, wherein detecting the image involves a single wavelength range .
Citation Information
Patent Citations
Methods and systems for imaging a sample using raman spectroscopy
EP3682203A1
Wide field raman imaging apparatus and associated methods
US20160000329A1