Sample observation device and sample observation method

The sample observation device simplifies multimodal observation by using a single light source to generate a pulse train with multiple wavelengths, enabling time-resolved measurements and linear separation processing to achieve efficient, real-time, and less invasive sample analysis.

JP7590257B2Active Publication Date: 2024-11-26HAMAMATSU PHOTONICS KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2021070905
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-20
Publication Date
2024-11-26
Estimated Expiration
2041-04-20

AI Technical Summary

Technical Problem

Conventional multimodal observation devices using ultrashort pulse light require complex optical systems and suffer from time lags during wavelength switching, making real-time observation difficult and increasing invasiveness due to non-optimal excitation light energy.

Method used

A sample observation device that uses a single light source to generate a pulse train with multiple wavelengths at predetermined intervals, performing time-resolved measurements and linear separation processing to eliminate the need for multiple light sources and wavelength separation elements, allowing for simple optical systems and reduced crosstalk.

Benefits of technology

Enables multimodal observation with a simplified optical system, reducing invasiveness and facilitating real-time analysis by avoiding crosstalk and optimizing excitation light energy for each target.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590257000001
    Figure 0007590257000001
  • Figure 0007590257000002
    Figure 0007590257000002
  • Figure 0007590257000003
    Figure 0007590257000003
Patent Text Reader

Abstract

To provide a sample observation method and a sample observation device that can execute multi-modal observation of a sample with a simple optical system.SOLUTION: A sample observation device 1 comprises: a light source unit 2 that outputs, as excitation light Le, a pulse train Lc in which a plurality of beams of pulse light L different in center wavelength are arranged at a predetermined time interval; a measuring unit 3 that performs time-resolved measurement of response light Lr from a sample S according to irradiation with the beams of pulse light L included in the pulse train Lc while scanning the sample S with the excitation light Le, and acquires measurement data for the beams of pulse light L; and a processing unit 22 that, based on excitation spectra of each of targets included in the sample S, executes linear separation processing on the measurement data of the beams of pulse light L.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a sample observation device and a sample observation method. [Background technology]

[0002] An example of a conventional sample observation device is a fluorescence observation microscope. In a fluorescence observation microscope, a dye that selectively chemically bonds to a target in a sample is injected, and the fluorescence from the target is observed when excitation light is irradiated. However, when using a fluorescence observation microscope, if the sample is a living organism, the invasiveness of the microscope must be taken into consideration. For example, sufficient consideration must be given to the safety of the dye for the living organism and the handling of the excitation light in the visible range, which has a relatively high energy.

[0003] In recent years, nonlinear optical microscopes based on phenomena such as multiphoton excitation and high-order harmonic generation have been attracting attention in place of conventional fluorescence observation. In nonlinear optical microscopes, near-infrared light with a wavelength of, for example, about 700 nm to 1700 nm is used. Near-infrared light has lower energy than visible light, so the invasiveness of nonlinear optical microscopes is relatively low. In addition, multiphoton excitation and high-order harmonic generation may occur without staining. From the viewpoint of not requiring staining of the sample, it can be said that the invasiveness of nonlinear microscopes is low. A microscope that has the function of identifying multiple different targets by discriminating optical responses based on multiple observation modalities such as multiphoton excitation and high-order harmonic generation is called a multimodal microscope.

[0004] Techniques related to nonlinear optical microscopes include, for example, the methods described in Non-Patent Documents 1 and 2. In Non-Patent Document 1, an image is captured while changing the wavelength of the light irradiated to the sample, and a portion in which only a single target emits light is extracted from the sample image, and a separation process is performed based on the excitation spectrum of the extracted portion. In Non-Patent Document 2, the polarization of the light irradiated to the sample is modulated for each pulse, and the orientation direction of collagen in a mouse tail is observed. [Prior art documents] [Non-patent literature]

[0005] [Non-Patent Document 1] AndrewJ Radosevich et al., “Hyperspectral in-vivo two-photon microscopy of intrinsicfluorophores” Biomedical optics 2008, OSA Technical Digest (CD) paper BWG7.pdf [Non-Patent Document 2] XimengY. Dow et al., “Imaging the Nonlinear Susceptibility Tensor of Collagen byNonlinear Optical Stokes Ellipsometry” Biophysical Journal 111, 1361-1374, October 4, 2016 Summary of the Invention [Problem to be solved by the invention]

[0006] The multimodal observation described above is premised on the use of ultrashort pulsed light, rather than normal laser light, so that multiple photons are absorbed simultaneously by the target. In recent years, the development of light sources that generate ultrashort pulsed light has progressed, but on the other hand, the fact that the target does not need to be stained in order to realize multimodal observation makes it more difficult to build the equipment.

[0007] Specifically, in conventional multimodal observation, pulsed light with a wide range of wavelengths is used to support multiple different observation methods, so multiple light sources corresponding to the number of observation methods must be incorporated into the device. Also, in order to distinguish between the different wavelengths of light from the sample, wavelength separation elements such as dichroic mirrors and photodetectors must be incorporated into the device according to the number of observation methods. Considering that users of the device are not necessarily experts in light, typical multimodal observation devices are difficult for users to handle due to their complex optical systems.

[0008] There are also other challenges to achieving multimodal observation with a simple configuration. For example, when performing multimodal observation with a single ultrashort pulse laser, wavelength switching is required to perform observation using multiple methods. When switching wavelengths, a finite time lag occurs, making it difficult to perform real-time observation of a sample based on wavelength switching. For this reason, it is possible to perform observations using all methods simultaneously by, for example, setting the wavelength near the average of the ideal wavelengths used for the multiple observation methods. However, this method uses excitation light that is not the optimal wavelength for each observation method, so the energy of the pulse light must be increased to perform observations with a good S / N ratio, which results in increased invasiveness of the sample.

[0009] The present disclosure has been made to solve the above-mentioned problems, and has an object to provide a sample observation method and a sample observation device that can perform multimodal observation of a sample using a simple optical system. [Means for solving the problem]

[0010] A sample observation device according to one aspect of the present disclosure includes a light source unit that outputs a pulse train as excitation light, in which a plurality of pulsed lights with different central wavelengths are arranged at a predetermined time interval, a measurement unit that performs time-resolved measurement of an optical response from the sample in response to irradiation of each pulsed light included in the pulse train while scanning the sample with the excitation light, and acquires measurement data for each pulsed light, and a processing unit that performs linear separation processing on the measurement data for each pulsed light based on the excitation spectrum for each target included in the sample.

[0011] In this sample observation device, a pulse train is formed in which a plurality of pulsed lights with different central wavelengths are arranged at a predetermined time interval. By applying each of the central wavelengths of the plurality of pulsed lights to each observation method, it is not necessary to arrange a plurality of light sources according to the number of observation methods. In addition, in this sample observation device, the optical response from the sample in response to the irradiation of each pulsed light is time-resolved and linear separation processing is performed on the measurement data for each pulsed light based on the excitation spectrum for each target contained in the sample. This makes it unnecessary to arrange wavelength separation elements and photodetectors according to the number of observation methods. In addition, by using linear separation processing, crosstalk between the obtained observation images for each target can be avoided in principle. Therefore, in this sample observation device, multimodal observation of the sample can be performed with a simple optical system.

[0012] The light source unit may generate a pulse train by modulating the central wavelength of pulsed light generated from a single light source according to time, which can further simplify the optical system.

[0013] The light source may generate a pulse train using soliton self-frequency shift, in which the output wavelength changes according to the input intensity. In this case, for example, a fiber laser can be used to easily perform time modulation of each wavelength of the pulse light. This simplifies the device.

[0014] The processing unit may store in advance an excitation spectrum of a region in which only a specific target emits light in response to a plurality of pulsed lights included in a pulse train in the sample, and perform linear separation processing on the measurement data for each pulsed light based on the excitation spectrum. In this case, by storing in advance an excitation spectrum obtained from a sample equivalent to the actual sample, the accuracy of the linear separation processing can be sufficiently ensured. Therefore, crosstalk between the obtained measurement data can be more effectively avoided.

[0015] The sample observation device may further include an image generating unit that generates an observation image of a specific target based on the measurement data that has been subjected to the linear separation process, thereby making it possible to obtain an observation image of each target while suppressing crosstalk.

[0016] The image generator may generate a superimposed image in which observation images of a specific target are superimposed. In this case, the observation results of each target are collected into a single image, which improves the convenience of analyzing the observation results. In addition, it becomes possible to deal with events that can be observed through multiple observation methods.

[0017] The measurement unit may have a multi-channel detection unit that performs time-resolved measurement of light from the sample. With this configuration, multimodal observation of the sample can be performed even if the number of wavelengths of the pulsed light included in the excitation light is smaller than the number of targets on the sample.

[0018] A sample observation method according to one aspect of the present disclosure includes an output step of outputting a pulse train as excitation light, in which a plurality of pulsed lights with different central wavelengths are arranged at a predetermined time interval; a measurement step of performing time-resolved measurement of an optical response from the sample in response to irradiation of each pulsed light included in the pulse train while scanning the sample with the excitation light, thereby acquiring measurement data for each pulsed light; and a processing step of performing linear separation processing on the measurement data for each pulsed light based on the excitation spectrum for each target included in the sample.

[0019] In this sample observation method, a pulse train is formed in which a plurality of pulsed lights with different central wavelengths are arranged at a predetermined time interval. By applying each of the central wavelengths of the plurality of pulsed lights to each observation method, it is not necessary to arrange a plurality of light sources according to the number of observation methods. In addition, in this sample observation method, the optical response from the sample in response to the irradiation of each pulsed light is time-resolved and linear separation processing is performed on the measurement data for each pulsed light based on the excitation spectrum for each target contained in the sample. This makes it unnecessary to arrange wavelength separation elements and photodetectors according to the number of observation methods. In addition, by using linear separation processing, crosstalk between the obtained observation images of each target can be avoided in principle. Therefore, in this sample observation method, multimodal observation of the sample can be performed with a simple optical system.

[0020] In the output step, a pulse train may be generated by modulating the central wavelength of the pulsed light generated from a single light source according to time, which can further simplify the optical system.

[0021] In the output step, a pulse train may be generated using a soliton self-frequency shift in which the output wavelength changes depending on the input intensity. In this case, time modulation of each wavelength of the pulse light can be easily performed using, for example, a fiber laser.

[0022] In the processing step, an excitation spectrum of a region in which only a specific target emits light in response to a plurality of pulsed lights included in a pulse train in a sample may be stored in advance, and linear separation processing may be performed on the measurement data for each pulsed light based on the excitation spectrum. In this case, by storing an excitation spectrum obtained from a sample equivalent to an actual sample in advance, the accuracy of the linear separation processing can be sufficiently ensured. Therefore, crosstalk between the obtained measurement data can be more suitably avoided.

[0023] The sample observation method may further include an image generating step of generating an observation image of a specific target based on the measurement data that has been subjected to the linear separation process, thereby making it possible to obtain an observation image of each target while suppressing crosstalk.

[0024] In the image generating step, a superimposed image may be generated in which observation images relating to a specific target are superimposed. In this case, since the observation results relating to each target are collected into a single image, it is possible to improve the convenience of analyzing the observation results. In addition, it is possible to deal with events that can be observed through multiple observation methods.

[0025] In the measuring step, the optical response from the sample may be time-resolved measured by multichannel detection. With this configuration, even if the number of wavelengths of the pulsed light included in the excitation light is smaller than the number of targets on the sample, multimodal observation of the sample can be performed. Effect of the Invention

[0026] According to the present disclosure, multimodal observation of a sample can be performed using a simple optical system. [Brief description of the drawings]

[0027] [Figure 1] FIG. 1 is a schematic diagram showing an embodiment of a sample observation device. [Diagram 2] 4 is a schematic diagram showing an example of time modulation of pulsed light by a modulation section. FIG. [Diagram 3] 1 is a timing chart for acquiring response light in a typical microscope system. [Figure 4] 4 is a timing chart for acquiring response light in this embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of an excitation spectrum. [Figure 6] FIG. 13 is a diagram illustrating an example of simultaneous equations used in the linear separation process. [Figure 7] FIG. 1A is a diagram showing observed images for each pulse of light, and FIG. 1B is a diagram showing the superimposed image. [Figure 8] 1 is a flowchart showing an embodiment of a sample observation method. [Figure 9] FIG. 13 is a schematic diagram showing a main part of a modified example of the sample observation device. [Figure 10] FIG. 2 is a diagram showing an example of an excitation spectrum and an emission spectrum. [Figure 11] FIG. 13 is a diagram illustrating an example of simultaneous equations used in the linear separation process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0028] Hereinafter, preferred embodiments of a sample observation device and a sample observation method according to one aspect of the present disclosure will be described in detail with reference to the drawings.

[0029] 1 is a schematic diagram showing one embodiment of a sample observation device. This sample observation device 1 is configured as a device that realizes multimodal observation of a sample S. The sample observation device 1 may be a device that constitutes a microscope system by itself, or may be a unit that can be attached to an existing microscope.

[0030] Multimodal observation is an observation technique that combines multiple different observation modalities. In multimodal observation, for example, near-infrared light with a wavelength of about 700 nm to 1700 nm is used, and by combining phenomena such as multiphoton excitation fluorescence and generation of high-order harmonics, it is possible to observe the sample S without staining it. In multimodal observation, the use of dyes to generate fluorescence can be eliminated, and near-infrared light with relatively low energy can be used. For this reason, it is possible to ensure high non-invasiveness, especially when the sample S is a living organism.

[0031] Multiphoton excitation fluorescence is a technique in which a target in a sample S is excited to a high-energy state by multiple photons, causing it to emit fluorescence. There are various types of multiphoton excitation fluorescence, such as two-photon excitation fluorescence and three-photon excitation fluorescence. These can be applied, for example, to observing the autofluorescence of the sample S. Representative targets for multiphoton excitation fluorescence include proteins such as keratin and FAD, lipids such as vitamin A, and enzymes such as NAD(P)H.

[0032] High-order harmonics are a method of converting multiple photons into one photon under certain conditions and emitting light without actual excitation like multiphoton excitation fluorescence. In this method, light with a wavelength different from that of the incident light is generated from the target by the action of the incident light. Second harmonics can be applied to the observation of microstructures, for example. Typical targets of second harmonics include proteins such as collagen, nucleic acids such as DNA, and lipids such as cholesterol. Third harmonics can be applied to the observation of interfaces between layers with different refractive indices, for example. Typical targets of third harmonics include proteins such as blood cells and mitochondria, and inorganic substances such as enamel.

[0033] A specific configuration of the sample observation device 1 will be described below. As shown in Fig. 1, the sample observation device 1 is configured to include a light source unit 2, a measurement unit 3, and a control unit 4. The light source unit 2 has a laser light source 11 and a modulation unit 12. The laser light source 11 is a light source that emits near-infrared ultrashort pulse light in the femtosecond region or picosecond region. The laser light source 11 is configured, for example, by a titanium sapphire laser, a Yb:YAG laser, a Yb fiber laser, an Er fiber laser, a Tm fiber laser, or the like.

[0034] The modulation unit 12 is a section that modulates the central wavelength of the pulsed light L from the single laser light source 11 according to time. The modulation unit 12 outputs a pulse train Lc in which a plurality of pulsed lights L with different central wavelengths are arranged at a predetermined time interval as the excitation light Le. In the example of FIG. 1, a pulse train Lc in which four pulsed lights L with central wavelengths λ1, λ2, λ3, and λ4 are arranged at a predetermined time interval is generated. Light including this pulse train Lc is output from the modulation unit 12 as the excitation light Le.

[0035] The modulation unit 12 may be configured to generate the pulse train Lc using a soliton self-frequency shift in which the output wavelength changes according to the input intensity, for example. In this case, the modulation unit 12 may be configured by, for example, a combination of an acousto-optic modulator and a photonic crystal fiber. In this configuration, the soliton self-frequency shift can be generated by propagating the pulse train Lc, the intensity of which is modulated at high speed by the acousto-optic modulator, through the photonic crystal fiber. The modulation unit 12 may be configured by a combination of a pulse shaper and a photonic crystal fiber. In this case, the soliton self-frequency shift can be generated by propagating a multi-pulse, the intensity of which is modulated by the pulse shaper, through the photonic crystal fiber.

[0036] In the example of Fig. 2, four pulse lights L with a wavelength of λ0 are modulated to four different intensities by an acousto-optic modulator to generate a pulse train Lc in which the four pulse lights L are arranged in order at times t1, t2, t3, and t4. In the modulated pulse train Lc, the intensity of the pulse lights L decreases gradually from the earliest one in time. A soliton self-frequency shift occurs when these pulse lights L are propagated through the photonic crystal fiber 14. In the pulse train Lc output from the photonic crystal fiber 14, the four pulse lights L with center wavelengths λ1, λ2, λ3, and λ4 are arranged in order at times t1, t2, t3, and t4.

[0037] The measurement unit 3 has a scanning unit 15, a collimator lens 16, an objective lens 17, a detection unit 18, and a data acquisition unit 19. The scanning unit 15 is a part that performs two-dimensional scanning of the excitation light Le on the sample S. The scanning unit 15 is configured, for example, by a pair of galvanometer mirrors 20A and 20B. The galvanometer mirror 20A scans the excitation light Le in the x direction of the sample S, and the galvanometer mirror 20B scans the excitation light Le in the y direction of the sample S. The elements that configure the scanning unit 15 are not limited to galvanometer mirrors, and may be other elements such as MEMS mirrors. The scanning unit 15 may be configured by other means such as an acousto-optical deflector or an xy stage.

[0038] The excitation light Le passing through the scanning unit 15 is collimated by the collimator lens 16, then collected by the objective lens 17, and irradiated onto the sample S. Light (hereinafter referred to as "response light Lr") is generated from the sample S in response to the irradiation of each pulse light L included in the pulse train of the excitation light Le. In the example of FIG. 1, four response lights I1, I2, I3, and I4 are generated in response to the irradiation of four pulse lights L. Note that a filter (not shown) that blocks the excitation light Le and passes the response light Lr is preferably disposed on the optical path between the sample S and the detection unit 18.

[0039] The detection unit 18 is a part that performs time-resolved measurement of response light from the sample S in response to irradiation with each pulse light L included in the pulse train. The detection unit 18 is composed of, for example, a photomultiplier tube. The detection unit 18 is composed of a device capable of time-resolved measurement, such as a photomultiplier tube, an MPPC (Multi pixel photon counter), a photodiode, an avalanche photodiode, etc. In this embodiment, the detection unit 18 is composed of a single-channel photomultiplier tube. The detection unit 18 outputs a signal in response to the response light Lr to the data acquisition unit 19.

[0040] The data acquisition unit 19 is a part that acquires measurement data for each pulse light L contained in the excitation light Le. The data acquisition unit 19 is configured with, for example, an oscilloscope, a PCI board, etc. The data acquisition unit 19 digitizes the signal output from the detection unit 18 to generate measurement data, and outputs the measurement data to the control unit 4.

[0041] Figure 3 is a timing chart for acquiring response light in a general microscope system. As shown in the figure, in a general microscope system, pulsed light, which is excitation light, is incident on a sample at a predetermined repetition frequency. The excitation light scans the sample in the x and y directions at a frequency that is sufficiently slow compared to the repetition frequency of the pulsed light. Measurement data of the response light is collected at each coordinate on the xy plane and reconstructed as an observation image.

[0042] In contrast, Fig. 4 is a timing chart of response light acquisition in the sample observation device according to this embodiment. As shown in the figure, in the sample observation device 1, excitation light Le, in which four pulsed lights L with central wavelengths λ1, λ2, λ3, and λ4 are arranged in order at times t1, t2, t3, and t4, are incident on the sample S. The scanning of the excitation light Le in the x and y directions on the sample S is the same as in Fig. 3. Meanwhile, measurement data of the response light is time-resolved and collected at different timings of times t1, t2, t3, and t4 at each coordinate on the xy plane, and reconstructed as an observation image.

[0043] The control unit 4 is physically a computer system configured with memories such as RAM and ROM, a processor (arithmetic circuit) such as a CPU, a communication interface, a storage unit such as a hard disk, and a display unit such as a display. Examples of computer systems include personal computers, cloud servers, and smart devices (smartphones, tablet terminals, etc.). The control unit 4 may be configured with a PLC (programmable logic controller) or an integrated circuit such as an FPGA (field-programmable gate array).

[0044] The control unit 4 has, as functional components, a drive control unit 21, a processing unit 22, a storage unit 23, and an image generating unit 24. The drive control unit 21 is a part that controls the operation of the sample observation device 1. The drive control unit 21 controls the operations of the laser light source 11, the modulation unit 12, and the scanning unit 15 in response to a user's operation input via an operation unit (not shown).

[0045] The processing unit 22 is a part that performs linear separation processing on the measurement data for each pulsed light L based on the excitation spectrum for each target contained in the sample S. FIG. 5 is a diagram showing an example of an excitation spectrum. As shown in FIG. 5, the excitation spectrum is a spectrum obtained when the intensity of the response light from each target is measured while changing the wavelength of the excitation light. On the other hand, the spectrum obtained when the response light from each target is measured by a spectroscope is called an emission spectrum (see FIG. 10).

[0046] In the example of Figure 5, g R ,g G ,g B In this embodiment, these three excitation spectra g R ,g G ,g B The data on the excitation spectrum g is stored in advance in the storage unit 23. R ,g G ,g Bis obtained by a prior measurement of a region (seed region) in the sample S where only a specific target emits light in response to a plurality of pulsed lights L included in a pulse train of the excitation light Le. Alternatively, the excitation spectrum may be obtained by measuring the wavelength dependency of the response light Lr in response to the excitation light Le in advance using an in vitro sample, or by referring to existing data for each target.

[0047] Excitation spectrum g R ,g G ,g B The linear separation process of the measurement data based on is performed using the simultaneous equations (1) to (4) shown in FIG. 6. The information used in this linear separation process is the excitation spectrum g R ,g G ,g B and the wavelengths λ1, λ2, λ3, and λ4 of the pulsed light L contained in the pump light Le. In the formula, |Ex(λ)| 2 is the intensity of each pulse light L contained in the excitation light Le. The number of wavelengths of the pulse light L is equal to the number of simultaneous equations. By finding the solutions to these simultaneous equations (1) to (4), the response light I1 originating from each target can be extracted from the four time-separated response lights I1, I2, I3, and I4 without providing a wavelength separation element such as a dichroic mirror and a photodetector in the sample observation device 1. R ,I G ,I B The processing unit 22 outputs the measurement data that has been subjected to the linear separation processing to the image generating unit 24.

[0048] The image generating unit 24 is a part that generates an observation image of each target from the response light from each target obtained as a result of the linear separation process. As shown in FIG. 7(a), the image generating unit 24 generates an observation image of each target from the response light I R ,I G ,I B By arranging the values ​​of on a two-dimensional plane, the observed image G R ,G G ,G BIn this embodiment, the image generating unit 24 generates an observation image G R ,G G ,G B The image generating unit 24 generates a superimposed image Gs by superimposing the observation image G R ,G G ,G B And all or a part of the superimposed image Gs is output to the display unit 25. In the display unit 25, the observation results of the sample S by all or a part of the plurality of observation methods are displayed.

[0049] 8 is a flowchart showing one embodiment of a sample observation method. As shown in the figure, the sample observation method includes an output step (step S01), a measurement step (step S02), a processing step (step S03), and an image generation step (step S04).

[0050] In the output step S01, the central wavelength of pulsed light L from a single light source is modulated according to time, and a pulse train Lc in which multiple pulsed lights L with different central wavelengths are arranged at a predetermined time interval is output as pump light Le. Here, ultrashort pulsed light output from a laser light source 11 at a predetermined repetition frequency is modulated using soliton self-frequency shift (see FIG. 2). In soliton self-frequency shift, a pulse train whose output wavelength changes according to input intensity is generated. As a result, a pulse train Lc in which four pulsed lights L with central wavelengths λ1, λ2, λ3, and λ4 are arranged in order at times t1, t2, t3, and t4 is output as pump light Le.

[0051] In the measurement step S02, while scanning the sample S with the excitation light Le, time-resolved measurement is performed on response lights I1, I2, I3, and I4 from the sample S in response to the irradiation of each pulse light L included in the pulse train, and measurement data for each pulse light L is obtained. In the subsequent processing step S03, linear separation processing is performed on the measurement data for each pulse light L based on the excitation spectrum for each target included in the sample S. In processing step S03, for example, an excitation spectrum in a region in the sample S where only a specific target emits light in response to multiple pulse lights L included in the pulse train is stored in advance, and linear separation processing is performed on the measurement data for each pulse light L based on the excitation spectrum. As a result, response lights I1, I2, I3, and I4 originating from each target are obtained from the measurement data for the response lights I1, I2, I3, and I4. R ,I G ,I B Separate them from each other.

[0052] In the image generation step S04, the response light I from each target obtained as a result of the linear separation process for each coordinate on the xy plane is R ,I G ,I B The values ​​of are arranged on a two-dimensional plane, and the observation image G R ,G G ,G B In the image generation step S04, an observation image G R ,G G ,G B Then, the generated superimposed image Gs is generated. R ,G G ,G B Then, all or a part of the superimposed image Gs is output to the display unit 25, and each target of the sample S is observed.

[0053] As described above, in the sample observation device 1, a pulse train Lc is formed in which a plurality of pulsed lights L with different central wavelengths are arranged at a predetermined time interval. By applying each of the central wavelengths of the plurality of pulsed lights L to each observation method, it becomes unnecessary to arrange a plurality of light sources according to the number of observation methods. Furthermore, in the sample observation device 1, time-resolved measurement is performed on the light from the sample S corresponding to the irradiation of each pulsed light L, and linear separation processing is performed on the measurement data for each pulsed light L based on the excitation spectrum for each target contained in the sample S. This makes it unnecessary to arrange wavelength separation elements and photodetectors according to the number of observation methods. Furthermore, by using linear separation processing, the obtained observation image G for each target can be R ,G G ,G B Therefore, in the sample observation device 1, multimodal observation of the sample S can be performed with a simple optical system.

[0054] In this sample observation device 1, assuming that the repetition frequency of the pulsed light L in the excitation light Le is 80 MHz and the lifetime of the response light Lr from the sample S is about 3 ns, the sample S can be observed by four types of observation methods using the pulsed light L with central wavelengths of λ1, λ2, λ3, and λ4. R ,I G ,I B This is an essential advantage of label-free microscope systems, in which the emission spectrum of a target cannot be controlled by staining.

[0055] The linear separation process is a relatively simple process, and the observed image G is generated almost in real time according to the acquisition of the measurement data. R ,G G ,G Band a superimposed image Gs can be obtained. In multimodal observation, real-time measurement is important. In a configuration in which the excitation wavelength is switched for each observation method, it is difficult to observe an event such as extravasation of white blood cells in a vascular branch adjacent to a tumor, for example, in the medical field. Such an event can only be captured by observing the sample in real time using multiple observation methods, demonstrating the high usefulness of the sample observation device 1.

[0056] In this embodiment, the light source unit 2 generates the pulse train Lc by modulating the central wavelength of the pulse light L generated from a single laser light source 11 according to time. This can further simplify the optical system. Also, in this embodiment, the pulse train Lc is generated using a soliton self-frequency shift in which the output wavelength changes according to the input intensity. With this method, it is possible to easily perform time modulation of each wavelength of the pulse light L using, for example, a fiber laser. This can simplify the device.

[0057] In this embodiment, an excitation spectrum of a region in which only a specific target emits light in response to a plurality of pulsed lights L included in a pulse train Lc in a sample S is stored in advance, and linear separation processing is performed on measurement data for each pulsed light L based on the excitation spectrum. By storing an excitation spectrum obtained from a sample S equivalent to an actual sample S in advance, it is possible to sufficiently ensure the accuracy of the linear separation processing. Therefore, crosstalk between the obtained measurement data can be more suitably avoided.

[0058] In this embodiment, an observation image G for each target is generated based on the measurement data that has been subjected to linear separation processing. R ,G G ,G B This allows for the generation of an observation image G that is compatible with each observation method while suppressing crosstalk. R ,G G ,G B In this embodiment, the observed image G R ,G G ,G BThis generates a superimposed image Gs by superimposing the observation results from each observation method on one image, which improves the convenience of analyzing the observation results. It also makes it possible to respond to events that can be observed using multiple observation methods.

[0059] The present disclosure is not limited to the above embodiment. For example, in the above embodiment, the detection unit 18 is configured by a single-channel detector, but instead, the detection unit 18 may be configured by a multi-channel detector. An example of such a detector is a multi-channel photomultiplier tube. With this configuration, even if the number of wavelengths of the pulsed light L contained in the excitation light Le is smaller than the number of targets of the sample S, it is possible to obtain a solution to the simultaneous equations used in the linear separation process.

[0060] When this configuration is adopted, for example, as shown in FIG. EX1 ,λ EX2 A pulse train Lc in which two pulsed lights L, each of which is a pulse of light L, are arranged in sequence is generated as excitation light Le. Two response lights I1 and I2 are generated in response to the irradiation of these two pulsed lights L. In addition, a diffraction grating 31 and a lens 32 are disposed in the optical path of the response light Lr between the sample S and the detection unit 18, thereby providing a spectroscopic function to the measurement unit 3. The addition of the diffraction grating 31 makes it possible to change the propagation direction according to the wavelength of the response light Lr from the sample S. Therefore, when the detection unit 18 is a multi-channel photomultiplier tube, different wavelength components can be simultaneously detected for each channel.

[0061] For linear separation of the measurement data of the response light Lr obtained with this configuration, the emission spectrum is used in addition to the excitation spectrum, as shown in Figure 10. In the example of Figure 10, R ,h G ,h B The three emission spectra of g R ,g G ,g BThe figure shows three excitation spectra of the response light Lr and the response light Lr. CH1 and CH2 are two channels of the photomultiplier tube. The short wavelength component of the response light Lr is detected by CH1, and the long wavelength component of the response light Lr is detected by CH2. The measurement wavelength range by CH1 is [λ EM1 ,λ EM2 ], and the measurement wavelength range by CH2 is [λ EM2 ,λ EM3 ]. λ EM1 ,λ EM2 ,λ EM3 The value of can be adjusted by the grating interval of the diffraction grating 31, the focal length of the lens 32, the optical path length from the diffraction grating 31 to the detection unit 18, and the like.

[0062] Excitation spectrum g R ,g G ,g B and emission spectrum h R ,h G ,h B The linear separation process of the measurement data based on is performed using the simultaneous equations (1) to (4) shown in FIG. 11. The information used in this linear separation process is the excitation spectrum g R ,g G ,g B , emission spectrum h R ,h G ,h B , and the wavelength λ of the pulsed light L contained in the pump light Le. EX1 ,λ EX2 These parameters are defined for CH1 and CH2, respectively. h([λ EM1 ,λ EM2 ]) in the interval [λ EM1 ,λ EM2 ] is the integrated value of the emission spectrum at h([λ EM2 ,λ EM3 ]) in the interval [λ EM2 ,λ EM3 The integrated value is defined for each target. EX1 )| 2 and |E(λ EX2 )| 2 is the intensity of each pulse light L contained in the excitation light Le.

[0063] In this embodiment, the number of wavelengths of the pulsed light L is two, but the number of channels of the detection unit 18 is two, so the product of the number of wavelengths of the pulsed light L and the number of channels of the detection unit 18 matches the number of simultaneous equations. Therefore, the solutions of the simultaneous equations (1) to (4) shown in FIG. 11 can be obtained, and the four response lights I 1,CH1 ,I 1,CH2 ,I 2,CH1 ,I 2,CH2 The response light I from each target R ,I G ,I B can be calculated respectively.

[0064] In addition, for example, in the above embodiment, the light source unit 2 is exemplified as outputting a pulse train Lc in which a plurality of pulse lights L with different center wavelengths are arranged at a predetermined time interval as excitation light Le by modulating the central wavelength of the pulse light L from a single laser light source 11 according to time, but the light source unit 2 may be configured to output similar excitation light Le using a plurality of laser light sources. In this case, the light source unit 2 may have a configuration in which a plurality of laser light sources with different wavelengths are combined with a wavelength separation element such as a dichroic mirror to generate pulse light from each laser light source at a predetermined time interval. [Explanation of symbols]

[0065] 1 ... sample observation device, 2 ... light source unit, 3 ... measurement unit, 11 ... laser light source (single light source), 18 ... detection unit, 22 ... processing unit, 24 ... image generation unit, L ... pulsed light, Lc ... pulse train, Le ... excitation light, Lr ... response light (light from sample), G R ,G G ,G B ...observed image, Gs...superimposed image, S...sample.

Claims

1. a light source unit that outputs a pulse train as excitation light, in which a plurality of pulsed lights with different center wavelengths are arranged at a predetermined time interval; a measurement unit that performs time-resolved measurement of an optical response from the sample in response to irradiation with each pulse light included in the pulse train while scanning the excitation light over the sample, and acquires measurement data for each pulse light; a processing unit that performs linear separation processing collectively on the measurement data for each of the pulsed beams based on the excitation spectrum for each target contained in the sample.

2. 2. The sample observation device according to claim 1, wherein the light source unit generates the pulse train by modulating a central wavelength of the pulsed light generated from a single light source according to time.

3. 3. The sample observation device according to claim 1, wherein the light source unit generates the pulse train using a soliton self-frequency shift in which the output wavelength changes depending on the input intensity.

4. 4. The sample observation device according to claim 1, wherein the processing unit holds in advance an excitation spectrum of a region in which only a specific target in the sample emits light in response to the plurality of pulsed light beams included in the pulse train, and performs linear separation processing on the measurement data for each of the pulsed light beams based on the excitation spectrum.

5. 5. The sample observation device according to claim 1, further comprising an image generating unit that generates an observation image relating to a specific target, based on the measurement data that has been subjected to the linear separation processing.

6. 6. The sample observation device according to claim 5, wherein the image generating section generates a superimposed image in which an observation image relating to the specific target is superimposed.

7. 7. The sample observation device according to claim 1, wherein the measurement unit has a multi-channel detection unit that performs time-resolved measurement of the optical response from the sample.

8. an output step of outputting, as excitation light, a pulse train in which a plurality of pulse lights with different center wavelengths are arranged at a predetermined time interval; a measuring step of performing time-resolved measurement of an optical response from the sample in response to irradiation of each pulse light included in the pulse train while scanning the excitation light over the sample, and acquiring measurement data for each pulse light; and a processing step of collectively performing linear separation processing on the measurement data for each of the pulsed beams based on the excitation spectrum for each target contained in the sample.

9. 9. The sample observation method according to claim 8, wherein in the outputting step, the pulse train is generated by modulating a central wavelength of the pulsed light generated from a single light source according to time.

10. 10. The sample observation method according to claim 8, wherein in the output step, the pulse train is generated using a soliton self-frequency shift in which the output wavelength changes depending on the input intensity.

11. 11. A sample observation method according to any one of claims 8 to 10, wherein in the processing step, an excitation spectrum of a region in which only a specific target emits light in response to the plurality of pulsed light beams included in the pulse train is stored in advance, and linear separation processing is performed on measurement data for each of the pulsed light beams based on the excitation spectrum.

12. 12. The sample observation method according to claim 8, further comprising an image generating step of generating an observation image relating to a specific target based on the measurement data to which the linear separation process has been performed.

13. 13. A sample observation method according to claim 12, wherein the image generating step generates a superimposed image in which observation images relating to the specific target are superimposed.

14. 14. The sample observation method according to claim 8, wherein in the measuring step, the optical response from the sample is time-resolved measured by multichannel detection.

Citation Information

Patent Citations

  • Sampling light generating device and optical sampling device using the same

    JP2005241733A

  • Sample observation device and sample observation method

    JP2012032183A