Devices, methods, and systems for providing imaging of one or more aspects of blood perfusion

CN116615138BActive Publication Date: 2026-11-10KONINKLIJKE PHILIPS NV
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202180085145.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-12-17
Filing Date
2021-12-07
Publication Date
2026-11-10
Estimated Expiration
2041-12-07

AI Technical Summary

Technical Problem

Existing blood perfusion imaging systems such as PPGI and SCI suffer from ambiguity issues, making it difficult for users to interpret false-color images. This is because the depth information of the signal source is unknown, leading to difficulties in image interpretation and limiting the commercial success of the system.

Method used

By combining wide-field imaging and radial imaging techniques, the optical depth index (ODI) is calculated, amplitude image mapping is corrected, and depth information of the signal source is determined, providing more accurate blood perfusion imaging.

Benefits of technology

This improves the accuracy of blood perfusion imaging and simplifies the interpretation of image mapping, enhancing the commercial application value of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116615138B_ABST
    Figure CN116615138B_ABST
Patent Text Reader

Abstract

The invention relates to an apparatus (100), system (500, 500', 500") and method for providing imaging of one or more aspects of blood perfusion caused by blood motion caused by a heart in a skin region (12) of a subject. Current perfusion imaging systems use photoplethysmography (PPG) or speckle contrast (SC), but a problem with both techniques is that there is considerable ambiguity as the source of the signal (volume pulsations in PPG or blood flow in SC) is unknown. The invention is based on the idea of combining two different types of measurements (i.e. wide-field imaging and radial imaging) in order to estimate the source depth (20) of the signal in order to provide more accurate PPG imaging and SC imaging.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an apparatus, method, and system for providing imaging of one or more aspects of blood perfusion in a skin region of an object, caused by blood movement induced by the heart. Background Technology

[0002] Blood perfusion imaging can provide information about tissue microcirculation (capillaries, venules, arterioles) and is crucial in the diagnosis and management of vascular diseases such as peripheral artery disease (PAD) and severe limb ischemia (CLI). Vascular surgeons and interventional radiologists are particularly interested in both preoperative and postoperative monitoring of blood flow to improve medical care.

[0003] Current perfusion imaging systems are typically based on photoplethysmography (PPGI) or speckle contrast imaging (SCI). Both imaging techniques share some similarities, but also have some differences.

[0004] PPG generally refers to the measurement of volume changes in organs or body parts, and more specifically, the detection of volume changes caused as the heart's blood vessels travel through the body with each heartbeat. More specifically, PPG is an optical measurement technique that assesses the time-varying changes in the reflection or transmission of light in a region or volume of interest (such as a skin area), and is based on the principle that blood absorbs more light than surrounding tissue. Thus, the blood volume changes with each heartbeat, correspondingly affecting the transmission or reflection. For example, more details about PPG imaging (PPGI) can be found in Verkruysse et al., “Remote plethysmographic imaging using ambient light” (Opt. Express 16(26), 2008).

[0005] SCI is also an optical measurement technique that uses laser speckle plethysmographic imaging to measure blood flow and / or changes in blood flow. When a laser illuminates a diffuse region or volume of interest, it produces a random interference effect called a speckle pattern. If there is movement in the object, the speckle fluctuates in intensity, and there is a correlation between the fluctuation of the speckle pattern and the movement of scattering centers in the organism (e.g., the movement of red blood cells). Averaging the region of interest from speckle contrast images over time allows for the monitoring of heart rate and respiratory rate. Further details on the differences and similarities between PPG and SC can be found, for example, in Dunn et al., “Comparison of speckleplethysmographic (SPG) and photoplethysmographic (PPG) imaging by Monte Carlo simulations and in vivo measurement” (Biomedical Optics Express 9(9), 2018).

[0006] WO2018 / 148701A1 discloses a sensor, such as a photoplethysmography sensor, for non-invasively monitoring characteristics of organisms (such as vital signs). The sensor has multiple light sources disposed on a substrate and an array of optical detection channels for transmitting light from the light sources to the probed area. Each detector pixel in the detector pixel array receives light from the corresponding optical detection channel after interacting with a sub-region of the probed area and undergoing spatial filtering, and generates a corresponding pixel signal. A processor derives the value of the vital sign based at least on the multiple pixel signals.

[0007] US2019 / 175030A1 relates to an apparatus, system, and method for monitoring peripheral arterial perfusion in a subject, which addresses the problem that low PPG signals may be caused by vascular stiffness or low cardiac output and therefore present ambiguity in PPG measurements.

[0008] Images generated by PPGI and SCI typically display false colors proportional to the perfusion caused by blood movement in the skin region under study. However, a problem with these images is the considerable ambiguity present because the source of the signal (i.e., the source of volumetric pulsation in the PPG or blood flow in the SC) is unknown. Due to Beer's law of decay, the signal's dependence on source depth is exponential, and therefore, the interpretation of false-color images is very challenging. This means that users find it difficult to correctly interpret perfusion images because the false colors in PPG and SC images represent a depth-integrated (non-linearly weighted) perfusion signal. Consequently, clinicians cannot easily resolve this ambiguity, which has limited the commercial success of PPG and SCI imaging systems to date.

[0009] For these reasons, there is a need to provide the possibility of addressing this ambiguity for both PPG and SCI to improve blood perfusion imaging. Summary of the Invention

[0010] One object of this invention is to provide users with means for improving the interpretation and accuracy of SCI and PPGI, particularly to simplify image mapping (e.g., pseudocolor mapping). This will further lead to greater commercial success of SCI and PPGI systems by making them a common tool for medical professionals such as vascular surgeons and interventional radiologists.

[0011] In a first aspect of the invention, an apparatus is provided for providing imaging of one or more aspects of blood perfusion caused by cardiac-induced blood movement in a skin region of an object. The apparatus includes a processing unit, and the processing unit is configured to:

[0012] A data stream derived from detected electromagnetic radiation transmitted through or reflected from the skin region is obtained, the data stream comprising data signals per skin pixel for a plurality of skin pixels of the skin region, wherein a first data stream is derived from patterned illumination of the skin region, and a second data stream is derived from patterned illumination and / or uniform illumination of the skin region.

[0013] The Optical Depth Index (ODI) is determined by dividing the data signal of the first data stream by the data signal of the second data stream according to the skin pixel or skin pixel group, based on the data signals of the first data stream and the second data stream, wherein the ODI indicates the depth of blood flow in the skin region at the skin pixel or skin pixel group.

[0014] Based on the determined ODI, create an ODI image map of the skin region including the plurality of skin pixels;

[0015] An amplitude image map of the skin region, including the plurality of skin pixels, is created based on the amplitude of the data signal from the second data stream; and

[0016] The amplitude image mapping is corrected by adjusting the amplitude of the data signal of the second data stream according to the determined ODI based on skin pixels or groups of skin pixels.

[0017] In another aspect of the invention, a system is provided for providing imaging of one or more aspects of blood perfusion caused by cardiac-induced blood movement in a skin region of an object. The system includes:

[0018] An irradiation unit configured to emit electromagnetic radiation in a narrow beam;

[0019] An optical diffuser is configured to diffuse the electromagnetic radiation emitted by the irradiation unit to irradiate the skin area of ​​the object uniformly and / or by patterned irradiation.

[0020] An imaging unit configured to detect electromagnetic radiation transmitted through or reflected from the skin region of the object, and to derive a data stream based on the detected electromagnetic radiation; and

[0021] The equipment described above.

[0022] Alternatively, and in another aspect of the invention, a system is provided comprising:

[0023] A first irradiation unit is configured to emit a pattern of electromagnetic radiation to irradiate the skin region of the object by patterned irradiation;

[0024] The second irradiation unit is configured to emit a uniform irradiation profile to uniformly irradiate the skin region of the object;

[0025] An imaging unit configured to detect electromagnetic radiation transmitted through or reflected from the skin region of the object, and to derive a data stream based on the detected electromagnetic radiation; and

[0026] The device as disclosed in this article.

[0027] In another aspect of the invention, a corresponding method and computer program, as well as a non-transient computer-readable recording medium, are provided. The computer program includes program code units that, when executed on a computer, cause the computer to perform the steps of the method disclosed herein. The non-transient computer-readable recording medium stores a computer program product therein that, when executed by a processor, causes the method disclosed herein to be performed.

[0028] Preferred embodiments of the invention are defined in the dependent claims. It should be understood that the claimed methods, systems, computer programs, and media have similar and / or identical preferred embodiments to the claimed devices, as defined particularly in the dependent claims and disclosed herein.

[0029] This invention is based on the idea that since the signal sources (volume pulsation in PPG and blood flow in SC) are unknown, the considerable ambiguity existing for both PPG and SCI is resolved because the depth of the signal sources is determined. Thus, imaging of one or more aspects of blood perfusion caused by cardiac-induced blood movement in the skin region of an object is achieved with higher quality. These aspects can be, for example, volume pulsation or blood flow in the skin region to be studied.

[0030] Images can be displayed, for example, on a display unit that can be connected to a processing unit. However, the processing unit itself provides all the prior processing to provide imaging of one or more aspects of blood perfusion.

[0031] As mentioned above, one problem in the prior art PPGI and SCI is that the pseudo-color represents the depth integral (non-linear weighted) perfusion signal. Therefore, the present invention is based on the insight that the use of an optical depth index (ODI) for the dominant optical depth expression of a PPG or SC signal source allows for significant improvement in PPGI and SCI.

[0032] The inventors recognized that two different types of measurements were required to determine the ODI. These two different types are also referred to below as “wide-field imaging” and “radial imaging” because the first type of measurement (wide-field imaging) is based on the principle that the skin area of ​​the object is uniformly illuminated (wide-field exposure) and the PPG or SC signal is measured across the same skin area. This type of measurement has been used in camera mode for about a decade (see, for example, Verkruysse et al., “Remote plethysmographic imaging using ambient light”, Opt. Express 16(26), 2008 or Y. Sun and N. Thakor: Photoplethysmography revisited: from contact to noncontact, from point to imaging, IEEE Trans Biomed Eng. 63(3), 2016).

[0033] It should be noted that the spatial integral of light reflected from patterned or structured illumination of the skin region can also be used for wide-field imaging, and the skin region does not necessarily need to be uniformly illuminated for wide-field imaging. Furthermore, even using only spot illumination (i.e., a single laser spot on the skin region of the object) and determining the spatial integral of all light reflected from the skin region can be suitable for wide-field imaging. Therefore, the expression "patterned illumination" can refer to illumination with a single spot (e.g., a laser spot) according to the invention. However, it is generally probably better to use uniform illumination for wide-field imaging, as this ensures a uniform light distribution over the skin region under study.

[0034] Another type of measurement (radial imaging) is based on the principle that the skin area is not uniformly illuminated but rather through patterned illumination, which again involves the possibility of illuminating the skin area with a single spot of light (e.g., a laser spot). The pattern can be, for example, caused by several laser spots on the skin area of ​​the object, or even any illumination pattern with significant spatial intensity fluctuations. Compared to using uniform illumination, using patterned illumination offers the advantage of obtaining more signal intensity within a few pixels, because more light intensity is collected in a smaller area, which may be suitable for obtaining more accurate SC and PPG signals due to a smaller signal-to-noise ratio.

[0035] A typical problem with wide-field imaging is that in some tissues, the wide-field signal is too small to be measured (e.g., under the arm or leg). This may be due to the small arteries being too deep. The small amount of light reaching these depths (even in the red and infrared spectral ranges, where the known penetration depth is greater than in other spectral ranges) is overwhelmed by the much higher intensity light re-emitted from shallower skin depths. In this case, wide-field imaging fails because the signal is too small and overwhelmed by noise from, for example, the detector and / or illumination noise. The present invention also addresses this problem in imaging by using both wide-field imaging and radial imaging, since radial imaging provides a large amount of light intensity over only a few skin pixels. This results in a greater penetration depth of electromagnetic radiation in the tissue and a greater signal intensity.

[0036] The inventors recognized that combining the data signals obtained from the two measurements (wide-field and radial imaging) allows for the resolution of the depth from which the PPG and SC signals are generated. This is a major advantage compared to prior art systems, as these conventional imaging systems have shown, for example, that relatively deep signal sources (e.g., 0.5 mm below the epidermis) can provide the same signal intensity as shallower vascular beds with much less perfusion located closer to the epidermis (e.g., 0.1 mm below the epidermis).

[0037] In this context, it should also be noted that the ODI mapping created according to the present invention has provided many insights into blood movement in the skin region under study, as it allows for the study of different depths of pulsatile and non-pulsatile blood movement across the skin region.

[0038] According to the present invention, these novel insights into the depth of the source are used to correct conventional amplitude image mappings representing the spatial distribution of amplitudes of wide-field PPG or wide-field SC signals across skin regions. Thus, the corrected amplitude image mapping provides measurements that are far more accurate than conventional image mappings known in the art. Therefore, users (such as clinicians) can distinguish whether tissue is better perfused at one skin pixel than at another, even if the two locations initially appear to have the same perfusion intensity (which is not actually the case).

[0039] In PPGI, the proposed technique provides source-depth-corrected image mapping for the signal source (a blood vessel with pulsatile volume). In SCI, the proposed technique provides source-depth-corrected image mapping for two components of the signal: pulsatile blood flow and constant blood flow. This will be explained in more detail later.

[0040] According to an embodiment, the processing unit is configured to correct the amplitude image map by estimating the depth of blood flow in the skin region at the skin pixel or group of skin pixels based on a determined ODI. As described above, the ODI is an expression of the primary or characteristic optical depth of the PPG or SC signal source at the corresponding skin pixel or group of skin pixels. Therefore, these ODIs are not a direct representation of the physical depth of the signal source. However, the inventors recognize that these ODIs can be used to estimate the optical depth from which these signals (PPG signals or SC signals) originate. In this case, the processing unit is configured to correct the amplitude image map by correcting the amplitude of the data signal of the second data stream according to the estimated source depth of the blood flow at the skin pixel or group of skin pixels.

[0041] Typically, the amplitude of the data signal in the second data stream is related to exp(-2μ a Proportional to SD, where μ a SD is a predetermined tissue attenuation coefficient, and SD is the estimated source depth of blood movement within the skin region at the skin pixel or group of skin pixels. This indicates that the signal strength follows Beer's Law. Beer's Law correlates the attenuation of light with the properties of the material through which the light travels and reflects that signals generated from relatively deep locations beneath the epidermis attenuate much more than signals generated from locations closer to the epidermis. Furthermore, it reflects why considerable ambiguity exists because the PPG or SC signal source is unknown: the signal's dependence on the source depth SD is exponential, and this non-linear dependence makes it difficult to interpret perfusion maps without depth information. This resolves the persistent problem with conventional PPGI and SCI.

[0042] Because Beer's Law defines that a large source depth (SD) leads to a large attenuation of the measured signal, when a large source depth is estimated from ODI, the amplitude of the second data stream signal can be corrected by increasing the amplitude, since a low signal amplitude may be due not to low ripple, but to the large attenuation effect in this case. Conversely, when a small source depth is estimated from ODI, the amplitude of the second data stream signal can be corrected by decreasing the amplitude. Another alternative possibility is to correct for an amplitude stronger due to a large source depth than due to a small source depth, in order to compensate for the attenuation effect. This correction can be achieved by increasing or decreasing the amplitude.

[0043] Furthermore, it should be noted that ODI depends on the wavelength used for measurement. However, the resulting ODI mapping ideally no longer depends on the wavelength, thus eliminating another ambiguity of conventional perfusion mapping. This is because ODI implicitly depends on the wavelength. For ODI-corrected PPGI and SCI mappings, at least ideally, no longer depend on the wavelength.

[0044] In the case of performing wide-field imaging measurements by illuminating the skin region to be studied with patterned illumination (i.e., patterns of dots, circles, lines, etc.), the second detection signal is preferably derived by the processing unit through spatial integration of electromagnetic radiation transmitted through or reflected from the skin region. Thus, the data signal of the second data stream is obtained in this way from, for example, the raw image data stream sent from the camera to the processing unit.

[0045] As mentioned above, this invention relates to PPGI and SCI. However, the two optical measurement techniques are different, and the processing of data signals differs between them. This is explained below, where first, how the data signal is processed in the case of PPG measurement is explained, and then how the data signal is processed in the case of SC measurement is explained.

[0046] As is known in the art, a PPG signal comprises two components: an alternating current (AC) component and a direct current (DC) component. The AC component depends on pulsatile blood flow and therefore varies at the same frequency as the pulse. Since the AC component is directly connected to the pulsatile blood, it can be used to estimate blood perfusion. The DC component is quasi-constant and relates to tissue composition other than pulsatile blood. Therefore, in the case of PPG measurement, the data signals of the first and second data streams comprise a time-varying AC component and a constant DC component. In the case of PPG measurement, the processing unit is preferably configured to create the amplitude image map by determining the ratio of the time-varying AC component to the constant DC component of the data signal of the second data stream according to skin pixels or groups of skin pixels.

[0047] Furthermore, when the data signal is derived from PPG measurements, the processing unit can be configured to determine the ODI based on the data signals of the first and second data streams according to skin pixels or skin pixel groups by dividing the ratio of the time-varying AC component to the constant DC component of the data signal of the first data stream by the ratio of the time-varying AC component to the constant DC component of the data signal of the second data stream. Therefore, the ODI is calculated by taking the ratio of the AC component to the DC component of the radial PPG signal and dividing it by the ratio of the AC component to the DC component of the wide-field PPG signal.

[0048] According to an embodiment, the processing unit may also be configured to determine the ODI according to the skin pixel or skin pixel group by selecting a value of the ratio of the time-varying AC component and the constant DC component of the data signal of the first data stream at a predetermined radial distance between the skin pixel or skin pixel group and the illumination spot of the patterned illumination. In the case of patterned illumination with multiple illumination spots on the skin region, these radial distances may be the distance between a skin pixel and its nearest illumination spot; that is, the radial distance refers to the shortest distance between an illumination spot and its corresponding skin pixel. Preferably, these radial distances are substantially greater than 0, such as a few millimeters for short wavelengths (such as for green light) and up to a few centimeters for longer wavelengths (such as for red light). The processing of the data signal is different when the data signal is derived from SC measurements. This is explained below.

[0049] SCI is based on the following principle: backscattered light from tissue irradiated with coherent light (such as coherent laser) forms a random interference pattern, the so-called primitive speckle pattern, at a detector or imaging unit. Movement of particles within the tissue causes fluctuations in this speckle, and the perfusion signal derived from the primitive speckle pattern includes pulsating and non-pulsating constant components (for more details, see also D. Briers et al., “Laser speckle contrast imaging: theoretical and practical limitations”, Journal of Biomedical Optics, 2013). The pulsating component represents pulsatile blood movement in the blood vessels of the studied skin region caused by the heart, and the constant component represents the average non-pulsating blood movement in the blood vessels of the studied skin region.

[0050] Although the AC and DC components of the PPG signal are also commonly referred to in the art as "pulsating components" and "constant components," the terms "pulsating components" and "constant components" are used hereinafter only for components of the perfusion signal in SCI. For PPG, the components are referred to as "AC components" and "DC components." This allows it to distinguish how PPG data signals and SC data signals are processed differently according to the present invention.

[0051] In an embodiment of optical measurement based on SC technology, the data signals of the first and second data streams may include pulsating components and / or constant components. Furthermore, in this embodiment, the processing unit is configured to create the amplitude image map based on the pulsating component or the constant component of the data signal from the second data stream. This means creating a pulsating wide-field SCI map or a constant wide-field SCI map from the data signal of the second data stream. Therefore, unlike PPG, where the amplitude image map is created by acquiring the ratio of the time-varying AC component and the constant DC component, in the case of SCI, the amplitude image map can be created by acquiring either the pulsating component or the constant component (instead of acquiring the ratio of the PPG). Preferably, for example, the amplitude image map is created for both the pulsating component and the constant component by first creating the pulsating amplitude image map and then creating the constant amplitude image map. In this case, insights are gained into the pulsating blood flow in the blood vessels as well as the average non-pulsating blood flow in the blood vessels.

[0052] Therefore, although the main data signals of PPG and SCI appear very similar, there are important differences. In PPG, normalization of the AC and DC components is meaningful because the data signal includes information related to light intensity, and normalization cancels out said light intensity since both the AC and DC components are proportional to it. In SCI, the main data signal is the perfusion signal as known in the SCI field (see also D. Briers et al., “Laser speckle contrast imaging: theoretical and practical limitations” (Journal of Biomedical Optics, 2013) or Dunn et al., “Comparison of speckleplethysmographic (SPG) and photoplethysmographic (PPG) imaging by Monte Carlo simulations and in vivo measurement” (Biomedical Optics Express 9(9), 2018)). Therefore, normalization as in PPG is meaningless. Instead, according to the present invention, the pulsating or constant components are treated as separate independent components.

[0053] In the case of SCI, the processing unit can also be configured to determine the ODI based on the data signals of the first and second data streams according to skin pixels or skin pixel groups. Here, a distinction needs to be made between pulsating and constant components. For pulsating components, the ODI can be calculated by dividing the pulsating component of the data signal of the first data stream by the pulsating component of the data signal of the second data stream according to skin pixels or skin pixel groups. For constant components, the ODI can be calculated by dividing the constant component of the data signal of the first data stream by the constant component of the data signal of the second data stream according to skin pixels or skin pixel groups.

[0054] According to an embodiment, the processing unit may also be configured to determine the ODI based on the skin pixel or skin pixel group by selecting the value of the pulsating component or the constant component of the data signal of the first data stream at a predetermined radial distance between the skin pixel or skin pixel group and the patterned illumination spot. In the case of patterned illumination with multiple illumination spots on the skin region, these radial distances may be the distance between a skin pixel and its nearest illumination spot.

[0055] The system according to the invention for providing imaging of one or more aspects of blood perfusion caused by cardiac-induced blood movement in a skin region of an object can be a system having an irradiation unit (such as a laser) emitting electromagnetic radiation with a narrow beam of radiation and an optical diffuser configured to diffuse said electromagnetic radiation, or a system having two irradiation units (a first irradiation unit and a second irradiation unit) configured to generate different irradiation profiles required for wide-field imaging and radial imaging on the skin of the object. In the case where the system includes only one irradiation unit, the diffuser can be selectively arranged inside or outside the path of the emitted light from the irradiation unit. In this case, diffuse wide-field illumination can be obtained by arranging the optical diffuser inside the light path, and radial illumination (such as a single laser spot) can be obtained by arranging the optical diffuser outside the light path. Furthermore, the optical diffuser can be configured to obtain structured or patterned illumination with multiple circles, lines, dots, etc., on the skin region to be studied.

[0056] In embodiments, the imaging unit may include an optical sensing array, particularly a two-dimensional image sensor, comprising filters (such as bandpass filters) providing at least two different wavelength channels, and the illumination unit may be configured to emit electromagnetic radiation for illuminating the skin region of the subject using light from the at least two different wavelength channels. The two-dimensional image sensor allows for the measurement of the image and the lateral distribution of the measured PPG or SC signal. Instead of using a single imaging unit, two different imaging units, such as two different cameras, may be selected, equipped with bandpass filters for two different wavelengths λ1 and λ2 of the emitted electromagnetic radiation. Furthermore, wavelengths λ1 and λ2 are preferably selected such that they are very close (e.g., less than 50 nm difference for red light and less than 10 nm difference for green light) to ensure that the optical properties are very similar and small enough not to significantly affect the penetration depth. In this case, the passband of the bandpass filter must be very small. Selecting wavelengths with very similar optical properties (absorption and scattering) is possible by selecting wavelengths in regions where blood absorption does not change significantly (e.g., in the electromagnetic range around 660 nm). Alternatively, measurements can be performed by selecting wavelengths λ1 and λ2 in the red or infrared spectral range, as these spectral ranges are known to be suitable for perfusion measurements due to the greater penetration depth of electromagnetic radiation in the skin of the subject within said spectral ranges. Therefore, deeper blood vessels can be reached for measurements in the red and near-infrared spectral ranges.

[0057] Last but not least, it should be mentioned that both the irradiation unit and the imaging unit may or may not be in direct physical contact with the skin region of the object. Therefore, the invention can be implemented, for example, by using a conventional fingertip sensor attached to the skin of the object or by performing remote measurements (such as remote PPG (see Verkruysse et al., “Remote plethysmographic imaging using ambient light”, Opt. Express 16(26), 2008 for more details), wherein the irradiation unit and the imaging unit are not in direct physical contact with the skin of the object).

[0058] Further advantages are obtained from the description and accompanying drawings. It should be understood that the features mentioned above and below can be used not only in the indicated combinations, but also in other combinations or as a whole, without departing from the framework of the invention. Attached Figure Description

[0059] These and other aspects of the invention will become apparent with reference to one or more embodiments described below, and will be illustrated with reference to one or more embodiments described below. In the following figures:

[0060] Figure 1 A conventional PPG amplitude image map is shown, created by PPG measurements on the head of an object as known in the art;

[0061] Figure 2 This diagram illustrates how the strong dependence of the measured signal on the skin depth causes ambiguity in the interpretation of the modulation depth.

[0062] Figure 3 The image shows the object's hand and its corresponding regular PPG amplitude image mapping;

[0063] Figure 4 A schematic diagram illustrating how SC perfusion images are generated collaboratively is shown;

[0064] Figure 5 The diagram illustrates how the measured PPG signal depends on volumetric pulsation, tissue attenuation, and source depth.

[0065] Figure 6A and 6B The diagram illustrates the path of electromagnetic radiation through the skin region of an object for both wide-field PPG and radial PPG.

[0066] Figure 7A and 7B The diagram illustrates the detected reflected light for wide-field PPG and radial PPG.

[0067] Figure 8 A schematic diagram of a Monte Carlo simulation of the path of light through the skin region of an object for radial PPG measurement is shown.

[0068] Figure 9A and 9B Monte Carlo results are shown for three different skin configurations with superficial, intermediate, and deep pulsating layers;

[0069] Figure 10 A system according to the invention is shown for providing imaging of one or more aspects of blood perfusion caused by cardiac blood movement in a skin region of an object;

[0070] Figure 11 An additional system according to the invention is shown for providing imaging of one or more aspects of blood perfusion caused by cardiac blood movement in a skin region of an object;

[0071] Figure 12 A flowchart illustrating a method performed according to the present invention by an apparatus for providing imaging of one or more aspects of blood perfusion caused by blood movement caused by the heart in a skin region;

[0072] Figure 13 Visualizations are shown as follows Figure 12 A schematic diagram of the processing steps S20-S50 of the method shown;

[0073] Figure 14 Visualizations are shown as follows Figure 12 A schematic diagram of processing step S50 of the method shown;

[0074] Figure 15 A schematic diagram illustrating the similarities and differences between SC and PPG is shown.

[0075] Figure 16 The illustration shows a schematic diagram of the contrast signal and its conversion to the perfusion signal for wide-field SCI imaging and radial SCI imaging.

[0076] Figure 17 Images showing different illumination patterns for patterned illumination according to the present invention are illustrated;

[0077] Figure 18 A schematic diagram illustrating the analysis and comparison between point light source illumination and circular illumination is shown;

[0078] Figure 19 The diagram illustrates different types of irradiation and the points for which values ​​are chosen less arbitrarily to determine ODI; and

[0079] Figure 20Schematic diagrams illustrating several embodiments (options 1-6) for improving the resolution of ODI and source depth corrected images are shown. Detailed Implementation

[0080] Figure 1 A conventional PPG amplitude image map 40 is illustrated, created by PPG measurements on the head of an object as known in the art. PPG can be used to detect changes in blood volume in the microvascular bed of tissue and these changes by illuminating the skin with light from an irradiation unit (e.g., an LED) and then measuring the amount of light transmitted or reflected to an imaging unit (e.g., a camera). Figure 1 The schematic diagram on the left exemplarily illustrates the reflection intensity of such a measured PPG signal and shows that the PPG signal comprises two components: a pulsatile waveform (AC) attributable to the change in the probed blood volume with each heartbeat, and a constant baseline (DC) or offset that combines only low-frequency fluctuations caused primarily by respiratory and sympathetic nervous system activity.

[0081] Create such a skin pixel by determining the ratio of AC component to DC component for each skin pixel or group of skin pixels. Figure 1 The image shown is a typical PPG amplitude map 40. The amplitude AC / DC (modulation depth of the PPG signal) is typically imaged as a pseudocolor. For example... Figure 1 As shown, the modulation depth of the PPG signal on the forehead is typically large (in this example, it is almost 5 × 10⁻⁶). -3 Maximum modulation depth).

[0082] The problem with conventional PPG imaging (PPGI) is that the amplitude of the PPG signal does not provide clear information about skin blood perfusion. Figure 1 Skin pixels A and B in the image can give the same PPG amplitude, but it is unclear to users (such as clinicians) why this is the case.

[0083] Figure 2 This diagram illustrates how the strong dependence of the measured signal on skin depth causes ambiguity in the interpretation of modulation. Even though the modulation depth (amplitude intensity) of skin pixels A and B is... Figure 1 The components are the same, but the signal sources may be completely different, such as... Figure 2 As shown in the image.

[0084] exist Figure 2The diagram illustrates the epidermis 13 of skin region 12, along with the underlying non-pulsatile vessels 14 and pulsatile vessels 16. It can be seen that the signal I(t) at skin pixel A is caused by several pulsatile vessels located near the epidermis 13. On the other hand, the signal measured at skin pixel B is caused by a much greater number of pulsatile vessels at a much greater depth. Therefore, the relative overall skin perfusion at skin pixel B is much higher than that at skin pixel A because more vessels are pulsatile (indicating arterial supply, which can deliver oxygen to the tissue and remove CO2, is greater at skin pixel B than at skin pixel A).

[0085] By recognizing that the light reaching the deeper pulsating vessels at skin pixel B has a much lower intensity than the light reaching the pulsating vessels at skin pixel A, it can be understood that... Figure 1 and 2 The skin pixels A and B in the image have equal PPG magnitudes. This can be achieved by... Figure 2 The schematic diagram shows that the relative intensity of the probe light depends on the nonlinear behavior of skin depth. This simply means that conventional PPG amplitude image mapping is blurry due to the lack of depth information.

[0086] Besides depth dependence, another ambiguity in perfusion mapping is that the wavelength used is a factor that is not typically mentioned in the art. Users of perfusion imaging equipment are also unaware of this wavelength dependence. When using high-penetrating wavelengths, perfusion mapping may differ from that measured with smaller-penetrating wavelengths (e.g., green).

[0087] Figure 3 An image of the object's hand and its corresponding standard PPG amplitude image mapping 40 are shown. Typically, the increased PPG amplitude is measured at the fingertips, the lower amplitude at the center of the palm, and the much lower amplitude at the forearm (in...). Figure 3 In the diagram, bright pixels represent large PPG amplitudes (AC / DC). However, differences in amplitude measurements between nearby locations are more likely due to varying depths of the local vascular system rather than variations in local perfusion.

[0088] This blurring issue is not limited to PPG, as the same problem occurs in speckle contrast imaging (SCI). The light used for laser speckle contrast analysis attenuates as it progresses to deeper skin depths. Therefore, flow in deeper vessels has a smaller impact on the total perfusion signal than flow in shallower vessels. Consequently, conventional SCI perfusion maps suffer from the same blurring as PPG images.

[0089] Figure 4This diagram illustrates how a typical SC perfusion map image is generated. SCI is an optical measurement technique that uses laser speckle imaging to measure changes in blood flow. When a laser illuminates a diffuse region or volume of interest, it produces a randomly occurring interference effect called the primitive speckle pattern. This primitive speckle pattern 42 can be... Figure 4 The speckle pattern observed is, in fact, a deterministic interference pattern. If movement exists within the volume of interest, the speckle pattern changes as the scattering particles and structures below change their positions. These fluctuations can provide information about blood movement. In the case of a finite exposure time, if the speckle pattern changes during that time period, the photogrammetric record will appear somewhat blurred. Therefore, the reduced contrast can be understood by recognizing that the interference pattern changes due to the different locations of scattering. Reduced speckle contrast can also be understood in terms of Doppler broadening, which is caused by the scattering of moving particles (such as blood cells). Thus, such a raw speckle image 42 includes portions or locations with high contrast and locations with low contrast, where fluctuations cause blurring of the speckle, resulting in a reduction in local speckle contrast. Therefore, the reduced contrast can be understood by recognizing that the light is less monochromatic after scattering because the carrier frequency of photons is Doppler shifted as they are scattered from moving particles.

[0090] Therefore, the original speckle image 42 includes a temporal aspect: a static laser speckle pattern indicates the absence of blood cell movement, while a dynamic pattern indicates the presence of blood cell movement.

[0091] In subsequent steps, a contrast image 44 is generated from the original speckle image 42, and in a final step, a final perfusion map 46 is generated from the contrast image 44, wherein perfusion is generally proportional to the inverse of the contrast and the blood flow velocity and volume of the flowing blood. By comparing the final perfusion map 46 and the original speckle image 42, it becomes apparent that locations with low contrast have high perfusion. Therefore, the contrast image includes a spatial aspect: high contrast indicates the absence of blood cell movement, and low contrast indicates the presence of blood cell movement.

[0092] However, furthermore, regarding the PPG images discussed earlier, it is unclear whether the high perfusion at certain locations is caused by very strong perfusion in deep vessels or by fairly moderate perfusion in shallower vessels. Therefore, the interpretation of conventional perfusion mapping images is also ambiguous due to the lack of depth information.

[0093] Figure 5 The diagram illustrates how the measured PPG signal depends on volumetric pulsation (VP) and tissue attenuation (μ). a A schematic diagram of the source depth (SD). Light in tissue can be modeled using Beer's Law, which correlates the attenuation of light with the properties of the material through which the light travels. Attenuation coefficient μ.a It can be reasonably determined from known optical and tissue properties. For example... Figure 5 As shown in the upper part, it is assumed that the PPG amplitude is related to the attenuation coefficient μ. a P(z) and intensity I(z) are proportional, where P(z) can be replaced by p(z) and VP, and z is the tissue travel distance of light penetrating into the skin region. VP is the total volumetric pulsation that can vary greatly from person to person or, for example, vary greatly within the human body due to ambient temperature. The expression p(z) represents the pulse at the level of the arteriole (the local pulsation profile in the arteriole), which can vary under different shunt states at the skin level and depends on the depth of the arteriole. Similarly, the tissue attenuation coefficient μ a It also changes drastically because it is highly dependent on wavelength. However, by using emitted light of a known wavelength, the attenuation coefficient μ... a It can be reasonably determined based on known tissue characteristics. Typically, μ a It does not depend on p(z), but rather on the total amount of chromophores and scattering properties of the tissue being studied.

[0094] By defining the dominant source depth SD from which the measured PPG signal is generated, it is possible to obtain... Figure 5 Substituting p(z) and I(z) in the second equation yields the final expression, where the PPG amplitude depends on only three factors: volumetric pulsation VP, tissue attenuation μ. a And source depth SD. Therefore, it is assumed that the PPG amplitude is linearly proportional to the total volumetric pulsation VP of the vessel, and to the attenuation coefficient μ. a It is linearly proportional, and non-linearly proportional to the source depth SD of the pulsatile vessel (i.e., light must travel down a distance SD to reach the pulsatile vessel and return to the skin surface).

[0095] Therefore, extracting depth information allows for the determination of the corrected PPG amplitude. This can be achieved from... Figure 5 Find VP and μ in the last equation. a The ratio is used to obtain an expression for the PPG amplitude that depends only (if not uniquely) on geometry (i.e., source depth SD). This is the basic principle behind the method of the present invention for determining the ODI, which will be interpreted later, for a PPG signal source. The same principle applies to SC signal sources, and it should be understood that... Figure 5 The calculations shown are therefore only illustrative for PPG.

[0096] Furthermore, it should be noted that modeling light in tissue using Beer's Law and the different attenuation coefficients of cardiac contraction and relaxation is an option. In this way, an expression for the AC / DC of the PPG amplitude, which depends only on the tissue travel distance z and the difference between the contraction and relaxation attenuation coefficients, can be found. Therefore, this model also allows for the estimation of the source depth of the PPG signal (i.e., the source depth of the volumetric pulsations at that depth).

[0097] Figure 6A and 6B The diagram illustrates the path of electromagnetic radiation 90 through the skin region 12 of the object for both wide-field and radial PPG measurements. This invention combines two different measurement types: wide-field imaging and radial imaging. Figure 6A and 6B This exemplifies how these two different measurement types can be performed in the case of PPG measurement. Wide-field PPG is a mode commonly used in camera mode for many years, in which irradiation by electromagnetic radiation 90 from irradiation unit 200 is uniformly distributed across skin region 12, and the PPG signal is measured across the same skin region. Figure 6A The pattern is illustrated. Electromagnetic radiation 90 travels through a skin region 12 having non-pulsatile canals 14 and pulsatile canals 16 before being detected by an imaging unit 300 (such as a camera). The detected electromagnetic radiation 90 and the derived PPG signal are the average of all electromagnetic radiation 90 detected by the camera 300.

[0098] Figure 6B The radial PPG mode is shown. Radial PPG is, in principle, very similar to conventional contact probe PPG measurements. Skin region 12 is illuminated by a spot (or pattern, such as a pattern of circles, stripes, dots, etc.), and the PPG signal is measured a few millimeters away from this illuminated spot on skin region 12. Figure 6B The diagram illustrates, exemplarily, the radial distance 15 between an irradiated spot on skin region 12 and the spot from which the PPG signal is measured. Therefore, the radial PPG signal is typically dependent on the radial distance 15. In other words, electromagnetic radiation 90 reflected from the skin region 12 of the object enters the skin region through the epidermis at the irradiated spot, is reflected from the components of the skin region, and exits the skin region through the epidermis 13 at a radial distance 15 from the irradiated spot (typically a few millimeters or centimeters away from the irradiated spot). Thus, the electromagnetic radiation 90 detected by the imaging unit 300 is scattered back from the skin region 12, and pulsation information is collected from the various non-pulsating vessels 14 and pulsating vessels 16 located in the skin region 12 beneath the epidermis 13.

[0099] The present invention combines results obtained from these two different measurement types (radial PPG imaging and wide-field PPG imaging). The above applies to SC measurements, where results from radial and wide-field imaging are also combined.

[0100] Figure 7A and 7B The diagram illustrates the detected reflected light for wide-field PPG and radial PPG. Figure 7A and 7B The diagram at the top is consistent with the previous one. Figure 6A and 6B The diagrams used in the discussion are the same.

[0101] Figure 7A (At the bottom) A schematic diagram of the detected reflected light in the illustrated wide-field PPG setup is shown. For this purpose, the vertical axis plots the reflected detected light, and the horizontal axis plots the measurement time. The curves show the reflected detected light including DC and AC components. The AC component represents the pulsating component of optical absorption originating from pulsatile arterial blood, and the DC component represents the non-pulsatile component including contributions from non-pulsatile arterial blood, venous blood, and other tissues.

[0102] Figure 7B The middle row shows three schematic diagrams illustrating the detected reflected light at the radial PPG setting. For this purpose, the vertical axis again plots the detected reflected light, and the horizontal axis plots the measurement time. It is evident from the three curves that the longer the light has traveled through the object's skin (and the larger the radial distance 15, see...), the more effective the measurement. Figure 6B The smaller the DC component of the reflected detection light, the better. This is schematically illustrated by the offsets of three different curves. The reason is that if light travels a longer path through the skin, more light or electromagnetic radiation 90 is absorbed and / or scattered by the skin region 12. Therefore, the DC component is reduced.

[0103] exist Figure 7B This dependence is also illustrated in the bottom diagram. The diagram plots the AC or DC components of the reflected detection light on the vertical axis and the radial distance 15 on the horizontal axis. One curve shows the DC component of the reflected detection light, and another curve shows the AC / DC ratio of the reflected detection light. The trends already discussed become apparent. Furthermore, it becomes clear that the larger the radial distance 15, the larger the AC / DC ratio (relatively, the larger the pulsation component).

[0104] Figure 8 A schematic diagram of a Monte Carlo simulation of the path of light through skin region 12 of an object, based on radial PPG measurements, is shown. The light distribution within skin region 12 is visualized to illustrate different penetration depths.

[0105] Figure 9A and 9B Monte Carlo results are shown for three different skin configurations with superficial, intermediate, and deep pulsation layers. The superficial, intermediate, and deep pulsation layers have different source depths of 0.4 mm, 0.7 mm, and 1 mm, respectively. The Monte Carlo results show that the source depth 20 of the pulsation layer affects the amplitude of both the wide-field PPG and radial PPG signals. The amplitude of the wide-field PPG signal decreases with increasing source depth 20, while the amplitude of the radial PPG signal increases. This is evident in… Figure 9A As observed, the amplitude of the radial PPG signal (radPPG(r)) is the largest for the deepest pulsatile layer (located at a skin depth of 1 mm 20), and the amplitude of the wide-field PPG signal (wfPPG) is the largest for the shallowest pulsatile layer (located at a skin depth of 0.4 mm 20).

[0106] Figure 9A The lowest-level schematic in the diagram illustrates the normalized radial PPG signal (RadPPG_n) determined by dividing the radPPG(r) signal by the wfPPG signal. The inventors recognized that this expression, RadPPG_n, allows for the estimation of the dominant source depth of the pulsating layer. This is in... Figure 9B The diagram in the middle shows the RadPPG_n curve again at a larger scale. The larger the amplitude of the RadPPG_n curve, the higher the ODI, which indicates the depth of blood flow in the skin area.

[0107] In summary, in the case of PPG, the determination of ODI can be accomplished by combining the wide-field PPG and the radial PPG, more specifically, by normalizing radPPG(r) with the wide-field PPG signal: radPPG_n(r) = radPPG(r) / wfPPG, and then by taking the ODI as the value of radPPG_n(r) at a predetermined radial distance.

[0108] It should be understood that these principles also apply to SC measurements. Similar to the determination of ODI for PPG modulation depth, the ODI for SCI can be determined by selecting a predefined distance r (such as...). Figure 9B The value of radSCI(r) / wfSCI is determined for the example shown in the PPG at 0.5 mm. Figure 9B In the example of PPG measurement, for shallow, medium and deep pulsating layers, the ODI for R = 0.5 mm will be determined as ODI = 2.2, 3.2 and 4.1, respectively.

[0109] Figure 10 A system 500 according to the invention is shown for providing imaging of one or more aspects of blood perfusion caused by blood movement induced by the heart in a skin region 12 of an object.

[0110] like Figure 10 As shown, the system 500 includes at least an irradiation unit 200, an imaging unit 300, and a device 100 with a processing unit 110 for providing imaging of one or more aspects of blood perfusion caused by blood movement induced by the heart in the skin region 12 of the subject. Reference will be made below. Figure 12 A more detailed explanation of the device 100 is given below.

[0111] Irradiation unit 200 is configured to emit electromagnetic radiation 90 to irradiate skin region 12. Preferably, the irradiation unit 200 is configured to emit a controllable narrow beam of electromagnetic radiation 90. The electromagnetic radiation 90 is further preferably located in the visible and infrared spectral range. Therefore, the irradiation unit 200 can also be configured to emit electromagnetic radiation 90 at at least two different wavelengths and / or alternately emit, for example, visible light and infrared light as electromagnetic radiation 90. One difference between SCI and PPGI is that for SC measurements, the emitted light must be coherent, while for PPG measurements, the emitted light is not necessarily coherent. However, when a coherent light source is used as the irradiation unit 200, SCI and PPGI can be extracted from the same video sequence that can be recorded using the same (conventional) camera as the imaging unit 300.

[0112] according to Figure 10 In the illustrated embodiment, system 500 may optionally also include a support 250 for confining the skin region 12 of the object to the limited skin region to be measured. Figure 10 As shown, the support 250 can be placed on the skin of the object and is preferably made of a material that is opaque to incident electromagnetic radiation 90 in the visible or infrared spectral range. Preferably, the skin area 12 for measurement is thus limited to a region comprising a skin area having a uniform surface along the area to be measured. This increases measurement accuracy.

[0113] in addition, Figure 10 The system 500 shown also includes a diffuser 220. The diffuser 220 is configured to diffuse the controllable narrow beam of electromagnetic radiation 90 emitted by the irradiation unit 200 to generate a uniform irradiation profile and / or patterns of dots, circles, stripes, etc., on the skin region 12 of the object. The imaging unit 300 is preferably a camera configured to detect electromagnetic radiation 90 in the visible and infrared spectral ranges. The camera 300 is positioned such that its field of view covers the skin region 12 irradiated by the irradiation unit 200.

[0114] It should be noted that wide-field PPG or wide-field SC can be measured not only when the skin 12 of the object is uniformly irradiated, but also when the skin region 12 is irradiated by a pattern such as a spot pattern (dots, circles, stripes, etc.) or by only a single spot. In this case, the PPG or SC signal is derived by spatial integration of all electromagnetic radiation 90 preferably transmitted through or reflected from the skin region 12. The processing unit 100 can be configured to perform the spatial integration. Furthermore, it should be noted that the generation of a uniform irradiation profile on the skin region 12 of the object can be obtained not only by using an irradiation unit 200 (such as a laser) configured to emit a controllable narrow beam and a diffuser 220 for diffusing the narrow beam, but also by using one or more irradiation units (such as a light bulb) that directly emit a uniform irradiation profile. This is from the subsequent... Figure 11 It becomes obvious in the middle.

[0115] In the case where the system includes only one irradiation unit (e.g.) Figure 10 As shown, the diffuser 220 can be selectively arranged inside or outside the path of the emitted light from the irradiation unit 200. In this case, diffuse wide-field irradiation can be obtained by arranging the optical diffuser inside the path of the light, and radial irradiation (such as a single laser spot) can be obtained by arranging the optical diffuser inside the path of the light.

[0116] Figure 11 An additional system 500', 500' according to the invention is shown for providing imaging of one or more aspects of blood perfusion caused by blood movement induced by the heart in the skin region 12 of an object.

[0117] As shown for the two systems 500, 500”, two different irradiation units 200a, 200b can also be used, wherein the first irradiation unit 200a is configured to emit a pattern of electromagnetic radiation 90 to irradiate the skin region 12 of the object by patterned irradiation, and the second irradiation unit 200b is configured to emit a uniform irradiation profile to uniformly irradiate the skin region of the object. According to this aspect, optical diffusers that can be selectively arranged inside or outside the light path are no longer needed.

[0118] A common problem is secondary irradiation "contamination" of the measured PPG or SC signal. Secondary irradiation occurs when light is reflected or re-emitted from tissue and then reflected from a non-tissue object, thus irradiating the tissue a second time. To suppress this secondary irradiation, system 500 may include high-absorption baffles 350 coated to absorb emitted light to avoid secondary irradiation. These baffles 350 may be arranged such that the measured SC or PPG signal is not contaminated by secondary irradiation. Optionally or additionally, system 500 may also include polarizers 410, 420 to minimize secondary irradiation.

[0119] Figure 12 A flowchart illustrating a method performed according to the present invention by an apparatus 100 for providing imaging of one or more aspects of blood perfusion caused by blood movement induced by the heart in a skin region. The apparatus 100 includes components configured to perform such... Figure 12 The processing unit 110 is shown in steps S10-S50. It is clear that this processing unit is not configured to image one or more aspects of the blood perfusion, but rather to provide imaging by performing all processing steps prior to imaging one or more aspects. The processing unit 110 can be, for example, a computer processor, and therefore can be configured to perform all steps S10-S50, such that a display unit connected to the processing unit is configured to image one or more aspects.

[0120] In the first step S10, the processing unit obtains a data stream. The data stream is derived from detected electromagnetic radiation transmitted through or reflected from the skin region under study. Furthermore, the data stream includes a data signal for each of the multiple skin pixels of the skin region. A first data stream is derived from patterned illumination of the skin region, and a second data stream is derived from patterned illumination and / or uniform illumination of the skin region. Therefore, in other words, the first data stream is derived from radial imaging, and the second data stream is derived from wide-field imaging.

[0121] In step S20, the processing unit determines the Optical Depth Index (ODI) based on the data signals of the first data stream and the second data stream. This determination of the ODI is accomplished by dividing the data signal of the first data stream by the data signal of the second data stream based on the data signals of the skin pixel or skin pixel group, wherein the ODI indicates the depth of blood flow within the skin region at the skin pixel or skin pixel group.

[0122] In step S30, an ODI image map including multiple skin pixels is created based on the determined ODI.

[0123] In step S40, an amplitude image map of a skin region comprising multiple skin pixels is created based on the data signal of the second data stream.

[0124] Last but equally important, in the final step S50, the amplitude image mapping is corrected by correcting the data signal of the second data stream according to the determined ODI based on skin pixels or skin pixel groups.

[0125] Figure 13 Visualizations are shown as follows Figure 12 The diagram illustrates processing steps S20-S50 of the method shown. Figure 13The left side shows a wide-field PPG image map wfPPG(x,y) 140 and a radial PPG image map radPPG(r,x,y) 150. The wide-field PPG image map 140 is also referred to hereinafter as an “amplitude image map” 140. The amplitude image map 140 is preferably created based on a data signal 112 of a second data stream derived from uniform illumination of the skin region (i.e., from wide-field imaging). Therefore, this amplitude image map 140 is a conventional PPG image map known in the art (see also Verkruysse et al., “Remoteplethysmographic imaging using ambient light”, 2008). Thus, as... Figure 13 The amplitude image map 140 shown reflects the amplitude of the data signal of the second data stream for each skin pixel in the skin pixel group. In the case of PPG, the pseudocolor can reflect the AC / DC ratio obtained from wide-field PPG imaging. In the case of SC, the pseudocolor can reflect the pulsating component or the constant component of the perfusion signal obtained from wide-field SC imaging.

[0126] The radial PPG image mapping radPPG(r, x, y) 150 is not necessarily required by the present invention, but can be additionally created based on the data signal 111 of the first data stream derived from patterned illumination (i.e., from radial imaging). In the case of PPG, the pseudocolor can reflect the ratio AC / DC obtained from radial PPG imaging. In the case of SC, the pseudocolor can reflect the pulsating component or the constant component of the perfusion signal obtained from radial SC imaging.

[0127] exist Figure 13 The right side shows the ODI image mapping ODI(x, y) 130. This ODI image mapping 130 is created based on the previously determined ODI 120. These ODIs are determined by dividing the data signal 111 of the first data stream by the data signal 112 of the second data stream according to skin pixels or skin pixel groups, i.e., as shown... Figure 13 The ODI image mapping 130 shown can be based on the combined amplitude image mapping 140 ( Figure 13 It is created using wfPPG(x,y) and radial image mapping 150.

[0128] Preferably, for each skin pixel or group of skin pixels having coordinates (x, y), the ODI is determined by determining the ratio radPPGn(r) = radPPG(r) / wfPPG (in the case of PPG measurement) or the ratio RadSCn(r) = RadSC(r) / WFSC (in the case of SC measurement). For example, Figure 13This demonstrates how to determine ODI for PPG measurements. To create an ODI image map 130, multiple skin pixels are illuminated sequentially or simultaneously (but at a sufficient distance from each other). This allows for the creation of ODI 120 for different spatial tissue locations, and thus forms an image map such as... Figure 13 The ODI image mapping shown is 130.

[0129] In the case of SC measurement, the pulsatile or constant component of the measured perfusion signal is used to calculate the ODI mapping indicating the depth of pulsatile flow in the vessel (possibly an arteriole). puls (x, y) or an ODI map indicating the depth of average non-pulsatile flow in all vessels with blood flow. const (x, y) (neither mapping is in) Figure 13 (as shown in the image).

[0130] like Figure 13 The ODI image map 130 shown illustrates a small ODI on the forehead and a large ODI on the cheek. This illustrates that the PPG or SC signal measured on the forehead is generated by superficial vessels, while the PPG or SC signal measured on the cheek is generated by deeper vessels. Typically, ODI indicates the depth of blood flow within a skin region at a skin pixel or group of skin pixels.

[0131] like Figure 13 As further shown in the PPG section, the ODI of each skin pixel or skin pixel group can be determined by selecting the value of the ratio of the time-varying AC component and the constant DC component of the data signal 111 of the first data stream at a predetermined radial distance 15 between the skin pixel or skin pixel group and the patterned illumination spot (i.e., by selecting the value of the radPPG(r) curve). For example, Figure 13 The value of the AC / DC ratio (radPPG (r = rc = 5mm)) of the data signal 111 of the first data stream for each skin pixel (x, y) is shown, representing a predetermined radial distance 15 of 5mm.

[0132] In the final step S50, the amplitude image map 140 is corrected for depth. This is done by correcting the data signal 112 of the amplitude image map 140 according to the determined ODI 120 of the determined ODI image map 130 based on skin pixels or skin pixel groups. Therefore, the source depth-corrected amplitude image map PPG is finally obtained. sdc (x, y) 160. Further details regarding this final correction step can be found in the following... Figure 14 Found it.

[0133] Figure 14 Visualizations are shown as follows Figure 12A schematic diagram of processing step S50 of the method shown. The source depth-corrected amplitude image map PPG is obtained by targeting the depth-corrected amplitude image map 140. sdc (x, y) = 160. Equation PPG sdc (x, y) = wfPPG(x, y)x C sd (ODI) indicates the skin pixel or skin pixel group through a correction factor C that depends on the determined ODI. sd (ODI) is used to correct the amplitude image mapping 140 data signal 112. This means that different correction factors C are used on the forehead and cheeks. sd (ODI)(For ODI = 2 on the forehead, C sd =0.28, and for the cheek ODI=5, C sd =0.87) is used to correct the data signal 112 of the amplitude image map 140. This is because the ODI is small on the forehead (ODI=2) and large on the cheeks (ODI=5). In other words, the amplitude image map 140 corrects the data signal 112 of the second data stream by correcting the determined ODI for each skin pixel or group of skin pixels.

[0134] Figure 15 A schematic diagram illustrating the similarities and differences between SC and PPG is shown. For PPG, the pulsation intensity AC / DC is preferably calculated based on the original reflection intensity signals for both wide-field PPG and radial PPG to obtain the wfPPG signal and radPPG(r) signal. Furthermore, in the case of PPG, ODI is preferably calculated by determining the ratio of these signals. PPG 120. Therefore, in the case of PPG, the data signals 111 and 112 of the first and second data streams (e.g.) Figure 13 (As shown) is the original intensity signal.

[0135] For SC, the data signals 111 and 112 of the first and second data streams are preferably perfusion signals divided into pulsating and constant components. The pulsating component represents the pulsating blood movement caused by the heart in the blood vessels of the skin region, and the constant component represents the average non-pulsating blood movement in the blood vessels of the skin region. ODI sci,puls ODI sci,const 120 is calculated by determining the ratio of the radSCI(r) to the wfSCI of the pulsating component (“puls”) or by determining the ratio of the constant component (“const”). This also means as Figure 13 The different ODI image mappings 130 shown are preferably created for the pulsating or constant components of the perfusion signal. Furthermore, as... Figure 13 The amplitude image mapping wfPPG shown red(x, y)140 and radial image mapping radPPG(r, x, y)150 are created based on the pulsating or constant component of the perfusion signal. Furthermore, it should be mentioned that for SC, ODI can be determined according to the skin pixel or skin pixel group by selecting the value of the pulsating or constant component of the data signal of the first data stream at a predetermined radial distance R15 between the skin pixel or skin pixel group and the patterned illumination spot. Exemplarily, the predetermined radial distance R15 is... Figure 15 The value is quite large, in which the curve radSCI(r) / wfSCI transitions to the steady-state period.

[0136] exist Figure 4 The diagram illustrates the process of obtaining the perfusion signal from the raw speckle pattern of SCI. Further details can be found in the subsequent... Figure 16 Found it.

[0137] Figure 16 The diagram illustrates the contrast signal and its conversion to perfusion signal for wide-field SCI and radial SCI. In wide-field SCI imaging, where the skin region 12 is uniformly irradiated with coherent light (unlike PPG, which can use either coherent or incoherent light) or by patterning, the contrast σ is high and temporally modulated due to the pulsating flow. In radial SCI imaging, where the skin region 12 is irradiated with a coherent pencil beam (or a pattern of a coherent pencil beam), the contrast is smaller for a larger radial distance 15 from the laser spot. The temporal modulation portion (from the pulsating flow) is as large as the total flow. Essentially, for radial SCI, the same principle applies as for radial PPG: the longer the light has traveled through the tissue, the more relevant signal is picked up from that tissue (see also...). Figure 6A and 6B In PPG, the signal is simply the modulation depth of intensity (generated by volumetric pulsating blood vessels). In SCI, the signal is the reduced speckle contrast due to flow.

[0138] It should be noted that although the primary signals of PPG and SCI appear very similar, there are important differences. In PPG, normalization of the AC and DC components is meaningful because the primary signal of the first and second data streams is light intensity, and normalization cancels out the light intensity, as both AC and DC are proportional to it. Therefore, the modulation depth after normalization is preferably the data signal to be further considered. In SCI, the primary signal (i.e., the data signals of the first and second data streams) is preferably the perfusion signal P(t) (see...). Figure 16 Furthermore, normalization, as in PPG, is meaningless. Instead, pulsating and constant components are treated as separate, independent components.

[0139] Figure 17Images showing different irradiation patterns for patterned irradiation according to the present invention are illustrated. So far, irradiation for radial PPG and radial SC measurements has been primarily discussed using a pencil beam (such as a single laser spot on the skin of an object). Figure 17 Various different illumination patterns, such as dots, circles, or stripes, can be used. Circles or loops and lines have the advantage that the DC level of the measured signal decreases less drastically with radial distance 15 compared to a pencil beam, and therefore the dynamic range requirements for the detector (e.g., a camera) can be lower. For circles, the radial dependence of AC / DC (which contains ODI information of PPG) is similar, and the dynamic range is similar. (DC) is more advantageous. Similar arguments can be made for line illumination or other types of structural illumination. This is also discussed later. Figure 18 The diagram in the middle shows, Figure 18 An analytical comparison between point source illumination and circular illumination is shown. While a more beneficial DC range is achieved using circular illumination, this comes at the cost of a limited range at a radial distance of 15. Similar trade-offs exist for line illumination or other types of structural illumination.

[0140] Figure 19 This diagram illustrates different types of irradiation and the points used for determining ODI values ​​with less arbitrariness. (See diagram for example.) Figure 19 The different types of illumination shown can be exemplarily divided into circular illumination (i), line illumination (ii), and point illumination (iii).

[0141] For circular irradiation (I), the center of the irradiated circle is preferably selected to determine the ODI.

[0142] For line irradiation (II), it is preferable to select a predetermined distance between the irradiation lines or the center between two irradiation lines to determine the ODI.

[0143] For spot or multi-point irradiation (iii), it is preferable to select the one with the maximum perfusion signal P. max The ODI is determined by the point (r) or the point between two illumination spots.

[0144] In addition, several techniques have been proposed to create higher resolution image maps from rather coarse resolution points, which are referenced below. Figure 20 This will be explained. These techniques include interpolation, translation, rotation, and combinations thereof.

[0145] Figure 20 Schematic diagrams illustrating several embodiments (options 1-6) for improving the resolution of ODI and source depth corrected images are shown. Figure 20As shown at the top, 20 ODI(x) curves can be obtained from an illumination pattern with 21 lines, because for each y j Determine ODI(x). Option 1 includes the step of discretizing line measurements to create pixels. Therefore, for each line j, the ODI(x) curve is discretized into ODI. xj Then, for each skin pixel or each group of skin pixels i, j, an ODI image map is created based on the discretized ODI to correct the perfusion signal for depth.

[0146] Another option 2 includes obtaining ODI first under the condition of online irradiation. xj Then rotate the irradiation pattern 90° to obtain ODI. yj Data. Then ODI ij Determined as ODI xj and ODI yj The average value of the data, and continue according to the determined ODI ij To create an ODI image map.

[0147] For option 3, illumination is performed using a grid, and the ODI for skin pixels i and j is selected as the value at the center of each skin pixel or group of skin pixels. Option 3 offers the advantage of being faster compared to option 2.

[0148] For option 4, irradiation is performed simultaneously using two sets of orthogonal lines L1 and L2, each with wavelengths λ1 and λ2, respectively. Two irradiation units (such as two cameras) equipped with bandpass filters to allow wavelengths λ1 and λ2 to pass through independently record each line pattern because the passbands do not overlap. Wavelengths λ1 and λ2 are chosen such that they are very close to ensure that the optical properties of the tissue are very similar, and small enough not to significantly affect the penetration depth. For this purpose, the bandpass filter has a very small passband. Choosing wavelengths with very similar optical properties (absorption and scattering) is possible by selecting them in regions where there is no significant variation in blood (the main chromophore) (e.g., in the range around 660 nm).

[0149] For option 5, illumination is performed simultaneously using two sets of orthogonal lines of the same wavelength, but the pattern and its recording at one or more imaging units are time-multiplexed (time-modulated or frequency-modulated).

[0150] For the final option 6, illumination is performed using a grid with a fairly large square size (e.g., 5×5 mm) to ensure that the light at the center of the square has traveled a considerable depth / distance. To mitigate the low image resolution that would result from this coarser grid, illumination is also performed at a translation of the grid, and the coarse-resolution images are combined into a higher-resolution image. Preferably, four illuminations / recordings are performed simultaneously using the wavelength selection of option 4 or time multiplexing as proposed in option 5. Figure 20 In the diagram, three translations of the grid are indicated by three arrows. For example, a translation within 0.5 grid periods results in a doubling of resolution in both the x and y directions. Clearly, nine illuminations with a translation within 0.333 periods provide even higher effective image resolution, at the cost of requiring more multiplexing. Furthermore, this translation is possible not only for the illumination grid but also for circles or points, such as... Figure 20 The answer is shown in option 6.

[0151] Although the invention has been illustrated and described in detail in the accompanying drawings and the foregoing description, such illustrations and descriptions should be considered illustrative or exemplary, and not restrictive; the invention is not limited to the disclosed embodiments. Those skilled in the art, through studying the drawings, the disclosure, and the claims, will understand and implement other variations of the disclosed embodiments in practicing the claimed invention.

[0152] In the claims, the word "comprising" does not exclude other elements or steps, and the words "a" or "an" do not exclude a plurality. A single element or other unit can perform the functions of several items recited in the claims. Although specific measures are recited in different dependent claims, this does not indicate that combinations of these measures cannot be advantageously used.

[0153] Computer programs can be stored / distributed on suitable non-transient media, such as optical storage media or solid-state media supplied together with or as part of other hardware, but can also be distributed in other forms, such as via the Internet or other wired or wireless telecommunications systems.

[0154] No reference numerals in the claims should be construed as limiting the scope.

Claims

1. An apparatus (100) for providing imaging of one or more aspects of blood perfusion caused by cardiac blood movement in a skin region of an object, the apparatus comprising a processing unit (110) configured to: (S10) Obtain (S10) a data stream derived from detected electromagnetic radiation transmitted through or reflected from the skin region (90), the data stream comprising data signals (111, 112) for a plurality of skin pixels of the skin region, wherein, The first data stream is derived from patterned illumination of the skin region, and the second data stream is derived from patterned illumination and / or uniform illumination of the skin region; The Optical Depth Index (ODI) (120) is determined (S20) based on the data signals (111, 112) of the first data stream and the second data stream by dividing the data signal (111) of the first data stream by the data signal (112) of the second data stream according to the skin pixel or skin pixel group. The ODI (120) indicates the depth of blood flow in the skin region at the skin pixel or skin pixel group. Based on the determined ODI (120), an ODI image mapping (130) is created (S30) of the skin region including the plurality of skin pixels. Based on the amplitude of the data signal (112) of the second data stream, an amplitude image map (140) comprising the plurality of skin pixels is created (S40); and The amplitude image mapping (140) is corrected (S50) by correcting the amplitude of the data signal (112) of the second data stream according to the determined ODI (120) based on the skin pixel or skin pixel group.

2. The device according to claim 1, wherein, The processing unit (110) is configured to correct the amplitude image mapping (140) by estimating the source depth (20) of the blood flow in the skin region at the skin pixel or skin pixel group according to the determined ODI (120), and correcting the amplitude of the data signal (112) of the second data stream according to the estimated source depth (20) of the blood flow at the skin pixel or skin pixel group.

3. The device according to claim 2, wherein, The amplitude of the data signal (112) of the second data stream is equal to exp(-2μ a SD Proportional, where μ a It is the predetermined tissue attenuation coefficient, and SD It is the estimated source depth (20) of the blood movement in the skin region at the skin pixel or group of skin pixels.

4. The device according to any one of the preceding claims, wherein, The processing unit (110) is configured to, under patterned illumination, derive the data signal (112) of the second data stream by spatial integration of the electromagnetic radiation (90) transmitted through or reflected from the skin region (12).

5. The device according to any one of the preceding claims, wherein, The data signals of the first data stream and the second data stream include a time-varying AC component and a constant DC component, and wherein the processing unit (110) is configured to create the amplitude image map (140) by determining the ratio of the time-varying AC component to the constant DC component of the data signal (112) of the second data stream according to skin pixels or skin pixel groups.

6. The device according to claim 5, wherein, The processing unit (110) is configured to determine the ODI (120) based on the data signals (111, 112) of the first data stream and the second data stream according to skin pixels or groups of skin pixels: Divide the pulse component of the data signal in the first data stream by the pulse component of the data signal in the second data stream according to skin pixels or skin pixel groups, or Divide the constant component of the data signal of the first data stream by the constant component of the data signal of the second data stream according to skin pixels or skin pixel groups.

7. The device according to claim 6, wherein, The processing unit (110) is further configured to determine the ODI (120) according to the skin pixel or skin pixel group by selecting the value of the ratio of the time-varying AC component to the constant DC component of the data signal (111) of the first data stream at a predetermined radial distance (15) between the skin pixel or skin pixel group and the patterned illumination spot.

8. The device according to any one of claims 1-4, wherein, The data signals (111, 112) of the first data stream and the second data stream include a pulsating component and / or a constant component, the pulsating component representing pulsatile blood movement caused by the heart in the blood vessels of the skin region, and the constant component representing average non-pulsatile blood movement in the blood vessels of the skin region (12), wherein the processing unit (110) is configured to create the amplitude image map (140) based on the pulsating component or the constant component of the data signal (112) of the second data stream.

9. The device according to claim 8, wherein, The processing unit (110) is configured to determine the ODI (120) based on the data signals (111, 112) of the first data stream and the second data stream by means of the following operations: i) Divide the pulsation component of the data signal (111) of the first data stream by the pulsation component of the data signal (112) of the second data stream according to skin pixels or skin pixel groups, or ii) Divide the constant component of the data signal (111) of the first data stream by the constant component of the data signal (112) of the second data stream according to skin pixels or skin pixel groups.

10. The device according to claim 9, wherein, The processing unit (110) is further configured to determine the ODI (120) according to the skin pixel or skin pixel group by selecting the value of the pulsating component or the constant component of the data signal (111) of the first data stream at a predetermined radial distance (15) between the skin pixel or skin pixel group and the patterned illumination spot.

11. A system (500) for providing imaging of one or more aspects of blood perfusion caused by cardiac-induced blood movement in a skin region (12) of an object, the system comprising: Irradiation unit (200) is configured to emit electromagnetic radiation (90) in a narrow beam. An optical diffuser (220) is configured to diffuse the electromagnetic radiation (90) emitted by the irradiation unit to irradiate the skin area of ​​the object uniformly and / or by patterned irradiation. An imaging unit (300) is configured to detect electromagnetic radiation (90) transmitted through or reflected from the skin region (12) of the object, and to derive a data stream based on the detected electromagnetic radiation (90). as well as An apparatus (100) for providing imaging of one or more aspects of blood perfusion caused by cardiac blood movement in a skin region of an object based on an acquired data stream, according to any of the preceding claims.

12. The system according to claim 11, in, The imaging unit (300) includes an optical sensing array, particularly a two-dimensional image sensor, the optical sensing array including filters providing at least two different wavelength channels, and The irradiation unit (200) is configured to emit electromagnetic radiation (90) for irradiating the skin region (12) of the object with light from the at least two different wavelength channels.

13. A system (500', 500") for providing imaging of one or more aspects of blood perfusion caused by cardiac blood movement in a skin region of an object, the system comprising: A first irradiation unit (200a) is configured to emit a pattern of electromagnetic radiation (90) to irradiate the skin region of the object by patterned irradiation. The second irradiation unit (200b) is configured to emit a uniform irradiation profile to uniformly irradiate the skin region of the object. An imaging unit (300) is configured to detect electromagnetic radiation (90) transmitted through or reflected from the skin region of the object, and to derive a data stream based on the detected electromagnetic radiation. as well as An apparatus (100) according to any one of claims 1-10 for providing imaging of one or more aspects of blood perfusion caused by cardiac blood movement in a skin region of an object based on an acquired data stream.

14. A method for providing imaging of one or more aspects of blood perfusion caused by cardiac-induced blood movement in a skin region (12) of an object, the method comprising the steps of: (S10) Obtain (S10) a data stream derived from detected electromagnetic radiation (90) transmitted through or reflected from the skin region (12), the data stream comprising data signals (111, 112) per skin pixel for a plurality of skin pixels of the skin region, wherein a first data stream is derived from patterned illumination of the skin region, and a second data stream is derived from patterned illumination and / or uniform illumination of the skin region (12); The Optical Depth Index (ODI) (120) is determined by dividing the data signal (111) of the first data stream by the data signal (112) of the second data stream according to the skin pixel or skin pixel group, based on the data signals (111, 112) of the first data stream and the second data stream, wherein the ODI (120) indicates the depth of blood flow in the skin region at the skin pixel or skin pixel group; Based on the determined ODI (120), an ODI image mapping (130) is created (S30) of the skin region including the plurality of skin pixels. An amplitude image map (140) comprising the plurality of skin pixels is created (S40) based on the amplitude of the data signal (112) of the second data stream; and The amplitude image mapping (140) is corrected (S50) by correcting the amplitude of the data signal (112) of the second data stream according to the determined ODI (120) based on the skin pixel or skin pixel group.

15. A computer program product comprising program code units, wherein when the computer program is executed on a computer, the program code units are configured to cause the computer to perform the steps of the method according to claim 14.

Citation Information

Patent Citations

  • Methods and system for multi-channel bio-optical sensing

    WO2018148701A1

  • Device for use in blood oxygen saturation measurement

    CN109561842A

  • Biological component measuring apparatus and biological component measuring method

    CN109984727A