Blood flow evaluation device
The blood flow evaluation device addresses inaccuracies in existing methods by using chromatic imaging and movement correction to accurately assess blood flow distribution, enhancing surgical precision and PAD diagnosis.
Patent Information
- Application Number
- JP2021008881
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-01-22
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2041-01-22
AI Technical Summary
Existing methods for evaluating blood flow in tissues, such as skin flaps and peripheral artery disease (PAD), suffer from inaccuracies due to tissue movement and respiratory fluctuations, and are unable to accurately assess blood flow distribution during surgery or diagnose PAD effectively.
A blood flow evaluation device using chromatic imaging, time-series image processing, and non-rigid registration to correct for movement, combined with RGB or HSV color space analysis to quantify blood flow dynamics, allowing for precise visualization of blood flow distribution and detection of stagnant areas.
Enables accurate visualization of blood flow dynamics during surgery and diagnosis of PAD, supporting the selection of appropriate skin flaps for transplantation and identifying areas of sufficient blood flow, reducing complications.
Smart Images

Figure 0007591228000001 
Figure 0007591228000002 
Figure 0007591228000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an evaluation device for inspecting the state of blood flow in tissue, and more particularly to an apparatus for evaluating the blood flow of a skin flap used in reconstructive surgery and the state of blood vessels for diagnosing peripheral arterial disease. [Background technology]
[0002] Blood flow disorders are diseases that mainly occur due to arteriosclerosis, and cause various diseases including peripheral arterial disease (PAD). Most PAD cases occur in the lower limbs, and as they progress, they can cause serious symptoms such as intermittent claudication, ulcers, and necrosis.
[0003] Because arteriosclerosis progresses throughout the body, arteriosclerosis in the lower limbs can also lead to arteriosclerosis in the heart and brain, which can cause complications such as angina, myocardial infarction, and stroke. Early detection and early treatment are important to prevent PAD from worsening and further complications.
[0004] Furthermore, blood flow disorders not only cause diseases such as PAD, but also affect transplant surgery using skin flaps. Skin flaps are deep tissues with blood flow, such as skin, subcutaneous tissue, muscle, bone, and nerves, and are used to replace defects caused by the removal of malignant tumors or when large tissues have been lost due to trauma. For example, in breast cancer treatment, a flap is a piece of tissue taken from the abdomen or back of a patient and transplanted to reconstruct a breast defect that occurs when a tumor is removed by surgery. Reconstruction through transplantation is not only necessary to restore function, but also eases the patient's sense of loss and contributes to improving quality of life (QOL).
[0005] The skin flap is excised with the artery and vein included, and when transplanted, it is sutured to the artery and vein of healthy tissue near the transplant site, which resumes blood flow to the transplanted tissue and allows the transplanted tissue to take root. If there is blood flow disturbance, it can cause suture failure and local infection, and in the worst case, the tissue can necrotize, necessitating a second surgery. In addition, in the case of autologous tissue transplantation for breast reconstruction, if the blood flow is weak, it can not only cause suture failure and local infection, but also cause liposclerosis, in which the transplanted tissue hardens in parts, and atrophy of the transplanted fat, which can greatly reduce the quality of the reconstructed breast.
[0006] Therefore, it is extremely important to identify blood flow disorders in transplanted tissues during reconstruction surgery. In particular, since the skin flaps to be transplanted are large in breast reconstruction surgery, ensuring blood flow is important, and it is necessary to check the blood flow distribution state of the skin flap to be transplanted before transplantation. Conventionally, a method has been used in which the blood flow of a skin flap is measured by injecting the fluorescent dye indocyanine green (ICG) and checking the fluorescence of the ICG with a dedicated camera to use a skin flap with good blood flow (Non-Patent Documents 1 and 2). Various proposals have also been made for improving this method (Patent Documents 1 and 2). In addition, a method using a sensor sheet (Patent Document 3) and a system using a multi-sensor to take images have been proposed as methods for inspecting blood flow disorders after surgery (Patent Document 4). [Prior art documents] [Patent documents]
[0007] [Patent Document 1] Special publication 2011-519589 [Patent Document 2] Special publication 2013-541370 [Patent Document 3] International Publication No. 2017 / 026393 [Patent Document 4] Special Publication No. 2019-520113 [Non-patent literature]
[0008] [Non-Patent Document 1] Pestana, IA, etal., 2009, Plast. Reconstr. Surg. Vol.123, pp.1239-1244. [Non-Patent Document 2] Hembd, AS et al., 2020, Plast. Reconstr. Surg. Vol.146, 1e-9e. [Non-Patent Document 3] Naohiro Wada et al., 59th Japanese Society for Medical and Biological Engineering, 2020 Summary of the Invention [Problem to be solved by the invention]
[0009] The present inventors have created a blood flow evaluation device that uses image processing and is simple in configuration and inexpensive, and that covers the areas controlled by the anterior tibial system, posterior tibial system, and peroneal artery system, and can predict diseases of the central vascular system (Non-Patent Document 3). However, when the blood flow evaluation device is applied to PAD patients, there is a problem that the movement of the toes when avascularization is released is large, which affects image processing and makes it difficult to perform accurate analysis.
[0010] In addition, the ICG fluorescence method described in Patent Documents 1 and 2 as a method for evaluating the blood flow of a skin flap is a large-scale system equipped with a dedicated camera and a recording system. Furthermore, in ICG angiography, in areas where the fluorescence intensity is strong and the blood flow is sufficiently secured, there are no problems in judging regardless of the doctor's experience, but in areas where the fluorescence intensity is weak, it is difficult to judge the range where it can be used without problems. The current ICG angiography cannot evaluate the quality of blood vessels, and there is a need to develop a system that can judge areas where good quality blood vessels can be secured.
[0011] In addition, the methods using sensors described in Patent Documents 3 and 4 are methods for monitoring the condition of a patient after transplantation, and although they are capable of detecting blood flow disorders early after surgery, they are unable to grasp the blood flow distribution state of the skin flap during surgery. Therefore, it is not possible to select an area of the skin flap with sufficient blood flow for use in surgery and prevent complications in advance.
[0012] The present invention aims to provide a system for evaluating blood flow using a simple system. The inventors have improved a blood flow evaluation device used for diagnosing PAD into a device capable of evaluating blood flow in other tissues such as skin flaps as well as in the lower limbs. This system is a simple device capable of evaluating blood flow in any tissue, regardless of the diagnosis of PAD or skin flaps described in the following embodiments. Another aim is to remove noise caused by the movement of the tissue to be evaluated, such as involuntary movement or respiratory variation, and perform accurate evaluation.
[0013] Furthermore, with regard to PAD, the objective is to provide a measurement system that can determine the amputation site, evaluate postoperative effectiveness, and perform other diagnostic tasks in place of large-scale devices such as transcutaneous oxygen pressure (TcpO2) measurement. With regard to skin flaps, the objective is to provide a system that can monitor blood flow during surgery. Specifically, the objective is to provide a blood flow evaluation device that can monitor the blood flow distribution state of the excised skin flap, and furthermore, can evaluate whether sufficient blood flow is secured immediately after the blood vessels are sutured by microsurgery and transplanted into the patient. [Means for solving the problem]
[0014] The present invention relates to a blood flow evaluation device for solving the above problems. (1) A blood flow evaluation device comprising: an imaging means for imaging an object in chromatic colors; an analysis means for recording the images acquired by the imaging means in chronological order and performing image processing to normalize the acquired images to a color space; and an estimation means for estimating a blood flow state of the object using the results of the image processing, wherein the estimation means displays a change over time in chromaticity coordinate values relating to a specific color of the image after the compression is released, calculates an amount of change over time, estimates that the object's arterial blood, which has been blocked due to compression, has transitioned to a recovery state when the amount of change over time becomes negative, and measures the recovery time from the release to the recovery state. (2) A blood flow evaluation device as described in (1), characterized in that the time from the release when the amount of change over time is positive and the increment in a predetermined time interval has decreased is measured, and the time is subtracted from the recovery time to calculate a blood flow-mediated dilation reaction time. (3) The blood flow evaluation device described in (1) or (2), characterized in that the estimation means generates a signal when the amount of change over time between the release and the recovery state is less than a predetermined value set in advance. (4) The blood flow evaluation device according to any one of (1) to (3), characterized in that a specific shape in the image acquired by the imaging means is used as a marker and a non-rigid registration algorithm is used to correct the movement of the object. (5) A blood flow evaluation device according to any one of (1) to (4), characterized in that a two-dimensional marker is placed near the subject, and noise caused by the movement of the subject is cancelled out and noise is removed. (6) The blood flow evaluation device according to any one of (1) to (5), wherein the color space is an RGB color space, and the specific color is R. (7) The blood flow evaluation device according to (6), wherein the color space is an HSV color space and the specific color is S. (8) A blood flow evaluation device according to any one of (1) to (7), characterized in that the subject is a skin flap and the blood flow evaluation device measures and evaluates the skin flap before it is excised and / or after it is transplanted. (9) The blood flow evaluation device according to any one of (1) to (7), wherein the target is a toe, the device is attached to the ankle, and the device is provided with a pressurizing means for avascularization and release. (10) A blood flow evaluation device as described in (9), comprising a jig for restricting the movement of the subject. [Brief description of the drawings]
[0015] [Figure 1] A schematic diagram of flap reconstruction. An example of breast reconstruction using an abdominal flap is shown. [Diagram 2] 1 shows an overall configuration diagram according to an embodiment of the present invention; [Diagram 3] 1 shows a block diagram according to an embodiment of the present invention; [Figure 4] FIG. 2 is a schematic diagram showing an example of blood flow evaluation according to the present invention. [Diagram 5] 1 is a diagram showing the measurement conditions in an embodiment, illustrating a comparison with ICG. [Figure 6] 13 is a diagram showing a measurement situation in another embodiment, illustrating a comparison with ICG. [Figure 7] FIG. 1 shows an embodiment applied to PAD diagnosis. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Implementation
[0016] As shown in the following embodiment, the blood flow evaluation device includes an imaging means for imaging a skin flap in chromatic colors, an analysis means for recording the images acquired by the imaging means in chronological order and performing image processing for normalizing the acquired images to a color space, and an estimation means for estimating a blood flow state using the image processing result, and the estimation means displays a temporal change in chromaticity coordinate values related to a specific color of the image after the compression is released, calculates the amount of temporal change, estimates that the arterial blood that has been blocked due to compression has transitioned to a recovery state when the amount of temporal change becomes negative, and measures the recovery time from the release to the recovery state. The present invention also relates to a calculation method for removing noise due to the movement of the measurement object caused by respiratory variation or the like when calculating the amount of temporal change. Any specific embodiment is acceptable.
[0017] In the following examples, breast reconstruction will be taken as an example for PAD and skin flaps, but it goes without saying that the present technology can be used regardless of the site where the skin flap is transplanted, such as the limbs, head and neck. In addition, as shown in this example, blood flow to the evaluation target such as the lower limbs or skin flaps is temporarily blocked during evaluation, and then released to change the blood flow. Since this change in blood flow is expressed as a color change on the tissue surface, it is captured in chromatic colors using an imaging means such as a video camera. The captured moving image is normalized in color space to digitize the image data. Normalization of the color space means, for example, that the distance between white and black that maximizes the color difference is set to MAX, and the color between them is quantified with a value of 0 to 1. In order to stabilize the conditions of the image to be captured, the imaging means may be configured to include a light emitting element and a light receiving element.
[0018] The digitized color coordinate values are binarized by, for example, setting a threshold value related to a specific color display, and the area of the area including coordinates equal to or greater than the threshold is calculated, or the total coordinate value of the entire imaging area is calculated, thereby digitalizing and calculating the amount of color change over time on the tissue surface. When blood flow is blocked and then released, the color of the tissue surface usually changes from a whitish state to a suddenly reddish state and returns to the normal surface color, so the estimation means estimates the recovery state as the point in time when the slope of the amount of change over time in redness becomes negative (meaning the aforementioned decrease in area or decrease in the total coordinate value, etc.).
[0019] By using this blood flow evaluation device, it is possible to visualize areas with good or weak blood flow by changing the blood flow and then blocking and releasing it. In this way, since the blood flow is visualized, when it is used to diagnose PAD, it is possible to accurately visualize areas where blood flow is stagnant. As a result, it is possible to accurately judge the dynamics of blood flow during surgical treatment such as resection of necrotic areas in severe PAD, and it is possible to support the decision of the resection site. In addition, when evaluating the blood flow of a skin flap, it is possible to support the selection of an appropriate skin flap for transplantation. As a result, it is possible to select an appropriate skin flap area for transplantation regardless of the doctor's level of expertise.
[0020] The inventors have found that in the process of blood flow being blocked and then released and restored, the blood vessel first expands rapidly (phase 1), then expands further (phase 2) although the speed of expansion slows down, and then recovers to normal blood vessels (see FIG. 4). In this two-stage increase in blood flow, phase 1 is a change caused by blood flowing into the blocked blood vessel, and phase 2 is presumed to reflect flow-mediated dilation (FMD). The timing of the transition from phase 1 to phase 2 is presumed to be when the amount of change over time becomes equal to or less than a preset value. According to the present system, the timing of this transition can be recorded, and it is possible to assist in determining blood flow evaluation as digital time. As a result, phase 1 and phase 2 can be measured to determine areas where blood flow is stagnant and areas where blood flow is good.
[0021] In the present evaluation device, any color space may be used, for example, RGB color space or HSV color space may be used. When the RGB color space is used, a specific color may be R. The processing in the RGB color space includes, for example, 1) obtaining the maximum and minimum values from the luminance value change of only the R value, normalizing and inverting the values, and 2) processing the R value / (G value+B value) and performing normalizing and inverting the obtained value of the relative (human-perceived) "redness (redness)". The RGB color space is a color system in which the primary colors are R (red, 700 nm), G (green, 546.1 nm), and B (blue, 435.8 nm), and colors can be quantified by coordinates. As described above, a threshold value for a specific color is set and binarized, and the area of the area including the coordinates above the threshold value is calculated, or the total coordinate value over the entire imaging area is calculated, so that the amount of change in color of the tissue surface over time can be digitized and calculated. It goes without saying that the color space is not limited to the RGB color space, and any color space that can be recorded as a color profile (RGBA, YCbCr, CMYK, Lab color, etc.) can be used as the color space.
[0022] When using the HSV color space, a specific color can be designated as S. The HSV color space is a color space consisting of three components: hue, saturation, chroma, and value, lightness, where saturation (S) indicates the vividness of a color. In the HSV color space, the image can be divided into an evaluation area and a background area by binarizing the image using saturation (S). This allows the evaluation area to be analyzed using the RGB color space or the like without being affected by disturbances caused by colors or light other than the evaluation area. The background area can be defined using saturation (S) at an early stage of observation, and then analysis can be performed based on the defined evaluation area using a color space such as RGB.
[0023] Furthermore, due to various factors such as respiratory fluctuations, involuntary movements, and during surgery, medical staff may unintentionally bump into the operating bed, which may cause the target area to move during measurement, resulting in noise during image processing and making it difficult to fully visualize the blood flow dynamics. As described above, since the amount of change over time is measured and calculated, it is assumed that the same position of skin or tissue continues to be captured in the same pixel. Therefore, if the target skin or tissue moves during shooting, the color of another skin or tissue will replace the color of the original position, and the amount of change will be an incorrect value and will be emphasized, resulting in noise after image processing.
[0024] Motion artifacts that cause noise are removed as follows. When shooting, a 2D barcode is placed on the part to be shot and shot at the same time as the barcode is taken as a marker. Since the 2D barcode also moves with the slightest movement of the subject to be shot, such as a skin flap or toe, a non-rigid registration algorithm is used to match the shape of the skin flap or toe in the image in a specific frame of the video to the shape of the skin flap or toe in the image in all remaining frames of the video, using the 2D barcode as a marker. As a result, a video with "no movement," i.e., no change in shape, is created, and by performing image processing, it is possible to capture color changes over time.
[0025] The marker used here may be any two-dimensional barcode, and examples of such markers include matrix-type two-dimensional codes such as QR Code (registered trademark) and SP Code, or stack-type two-dimensional codes such as PDF417 and Code49. A plurality of spheres of a different color from the skin and blood may be arranged. If an image of a skin flap or toe has sufficient features, a non-rigid registration algorithm may be used on the captured image to match the shape of the skin flap or toe in a specific frame of the video to the shape of the skin flap or toe in the images of all remaining frames of the video, thereby creating a video with no movement. In other words, any marker that can be used as a two-dimensional marker may be used. In this way, by using a non-rigid registration algorithm to create a video with no movement but with changing color tones, blood flow can be evaluated with high accuracy.
[0026] First, blood flow evaluation in a skin flap will be explained. Breast reconstruction will be used as an example to explain the target skin flap. As mentioned above, a skin flap is skin, subcutaneous tissue, or deep tissue with blood flow. The tissue and amount to be excised vary depending on the transplant site, but when performing breast reconstruction with autologous tissue, tissue from the abdomen, back, etc. is used for transplantation. Figure 1 shows a schematic example of a skin flap taken from the abdomen and transplanted to the chest. The skin and fat from the abdomen are harvested with blood vessels (arteries and veins) still attached. Before cutting off the skin flap, it is confirmed that the blood flow is sufficiently maintained (Figure 1, left). While measuring with a blood flow evaluation device, the artery is compressed by clamping it with a special clip to block the blood flow, and then the blood flow is released, and the area where the blood flow is sufficiently secured is marked while referring to the measurement results of the blood flow evaluation device, and then transplanted to the chest. The artery and vein of the chest and the artery and vein of the skin flap are sutured, respectively (Figure 1, right). Once the suturing is complete, the compressed blood flow is released to allow blood flow to resume, and measurements are taken using a blood flow evaluation device to confirm that sufficient blood flow has been secured in the transplanted skin flap.
[0027] In addition, if noise occurs due to respiratory fluctuations, a marker is placed on the outside of the skin flap to measure the fluctuations due to breathing. Figure 1 shows an example of placing a QR code on the outside of the skin flap. Noise can be eliminated by using a program that cancels out respiratory fluctuations.
[0028] Next, one embodiment of the blood flow evaluation device will be described with reference to Figures 2 and 3. The blood flow evaluation device 1 according to one embodiment of the present invention shown in Figures 2 and 3 includes an imaging means 10 so that the skin flap can be photographed during transplantation, an analysis means 20 that records images acquired by the imaging means 10 in chronological order and performs image processing to normalize the acquired images into a color space, and an estimation means 30 that estimates the blood flow state of the skin flap using the image processing results. The device can further include a display unit 40 that displays the results estimated by the estimation means 30, and an alarm unit 50 that generates a signal such as sound or light depending on the results.
[0029] The blood flow evaluation device 1 includes an imaging means 10 for imaging the skin flap in chromatic colors. The imaging means 10 may be an imaging element such as a video camera or a CCD image sensor, which is an apparatus or device capable of capturing images in chromatic colors. The light detected by the imaging means 10 is visible light for analyzing a color space. However, infrared light or other light may be selected depending on the imaging situation. In order to stabilize the conditions for capturing an image, the imaging means may be configured to include a light-emitting element 11, such as a light for illuminating an object, together with a light-receiving element 12 for capturing images.
[0030] The analysis means 20 and the estimation means 30 are each composed of a microcomputer, and have a processor CPU for performing calculations, a ROM for storing control programs and various data lists, tables, maps, and other items required for calculation and recording, and a RAM for temporarily storing calculation results by the CPU. The analysis means 20 and the estimation means 30 are each equipped with a memory, and store necessary data and the like in the memory. The memory is preferably a non-volatile memory, and can be composed of an EEPROM, which is a rewritable ROM, or a RAM with a backup function that supplies a holding current to hold the memory even when the power is turned off. In the following, the analysis means 20 and the estimation means 30 will be described as separate means, but a single microcomputer may be configured to have both functions.
[0031] The analysis means 20 records the images acquired by the imaging means 10 (light receiving element 12) in chronological order, and performs image processing to normalize the acquired images into a color space. The normalization image processing is, for example, to digitize the captured image data by setting the distance between white and black at which the color difference is maximum as MAX, and quantifying the colors between them with values between 0 and 1. By normalizing, the image data can be easily used for transformation, comparison, calculation, etc. based on a certain rule. The analysis means 20 may be configured to include, for example, a color space conversion unit 21 that defines the data sent from the light receiving element 12 in a predetermined area, and an evaluation image generation unit 24 that generates an image to be evaluated based on the defined image.
[0032] The color space conversion unit 21 can be configured to include a background region definition unit 23 that defines an evaluation region of the flap for evaluating blood flow and a background region in which the surrounding situation of the flap is reflected by binarizing an image using, for example, saturation (S) in the HSV color space. By defining the region in this way, it is possible to perform subsequent analysis using a color space on the surface of the flap without being affected by disturbances due to colors or light other than the evaluation region. Note that the definition of the background region using saturation (S) may be performed at an early stage of observation, and thereafter, analysis may be performed based on a color space such as RGB based on the defined evaluation region. In addition, in cases where the evaluation is less affected by disturbances or light scattering, the configuration may not include the background region definition unit 23.
[0033] The color space conversion unit 21 may be configured to include, for example, an evaluation area definition unit 22 that normalizes the image from which the background has been removed by the background area definition unit 23 to an RGB color space. The processing in the RGB color space focuses on the R value, which expresses the "redness" of blood flow, and obtains the time-series change in luminance value of only the R value. The maximum and minimum values are used to convert the color between the R value and the R value into a numerical value of 0 to 1 or 0 to 255 when expressing the color in 8-bit gradation (normalization). The maximum luminance red color can be expressed as (1,0,0) when expressed as 0 to 1, and as (255,0,0) when expressed as 0 to 255. As described above, it goes without saying that any color space that can be recorded as a color profile (RGBA, YCbCr, CMYK, Lab color, etc.) can be applied as the color space, not limited to the RGB color space. Furthermore, by combining and calculating each color space, the evaluation site can be made more obvious. Furthermore, in processing in the RGB color space, if the state of blood flow can be visualized, color elements other than red (R value), such as green, blue, black, white, etc., can be appropriately selected.
[0034] The evaluation image generating unit 24 can clarify the range to be evaluated, for example, by setting an appropriate threshold value for the R value, binarizing it, and then performing inversion processing. Furthermore, if the boundary between "redness" and other colors is not clear, the evaluation image generating unit 24 may be configured to sum up each value in units of dots of the image, etc., to show the overall change in "redness." The image data processed by the evaluation image generating unit 24 is then sent to the estimation means 30.
[0035] An example of the change in R-value over time is shown in Figure 4. The solid line shows an example of a flap area where blood flow is maintained, and the dotted line shows a schematic example of an area where blood flow is weak. The "normal" phase is the R-value of the image data of the flap before the artery is compressed and blood flow is blocked, and this value remains constant. Then, due to the "blood flow blocked" event, it transitions to the "blood flow blocked" phase. As the blood flow is blocked, blood does not flow to the flap, and the R-value decreases as the "redness" gradually decreases.
[0036] In the event of "blood flow release", the blockage of the arterial blood flow is released, blood flow in the flap is restored, and with "blood flow release", the "redness" of the flap increases and a rapid increase in the R value is observed. As mentioned above, the inventors discovered that in the process from blood flow release to recovery, the blood vessels first rapidly expand, then expand further although the speed of expansion slows, and then recover to normal blood vessels. In this way, the increase in the blood flow rate of the peripheral arteries is thought to progress in roughly two stages, and first, "phase 1" is observed as a rapid increase in the R value, which represents the rapid expansion of the blood vessels. Phase 1 captures the step in which the blood vessels physically reopen as blood flow resumes. In other words, it is thought to be a phase that reflects measurements using ICG fluorescence angiography.
[0037] Next, the increase in the R value over time is somewhat alleviated, that is, "phase 2" is observed, in which the blood vessels return to normal. As described above, based on the findings of the inventors, it is estimated that the duration of phase 2 indicates the active state of the blood flow dynamics of the living body, that is, blood flow-dependent vasodilation. It is believed that the vasodilation in phase 1 causes the vascular endothelial cells to expand, which stimulates the release of nitric oxide, which further stimulates the release of nitric oxide to further expand the blood vessels. This is thought to capture the phenomenon measured by the FMD measuring device. That is, if the duration of phase 2 is short, it may be determined that the flap has a sufficiently maintained blood flow (solid line in Figure 4, T3 = T2 - T1), and conversely, if the duration of phase 2 is long (dotted line in Figure 4, T3' = T2' - T1'), it indicates a state in which the blood flow is stagnant and an area with weak blood flow. When "phase 2" ends, the process of recovery to "normal" begins, the R value drops, and the blood flow evaluation ends.
[0038] The estimation means 30 estimates the transition from "Phase 2" to "Recovery" after the "Blood Flow Opening" event, that is, the time when the gradient of the amount of change over time for the R value ("Redness") becomes negative (meaning the above-mentioned decrease in area or decrease in the total coordinate value, etc.) as the recovery state, and calculates the recovery time T2. Furthermore, the estimation means 30 measures the time from the "Blood Flow Opening" event when the transition from "Phase 1" to "Phase 2" after the "Blood Flow Opening" event, the amount of change over time for the R value is positive, and the increment in a predetermined time segment set in advance decreases, and subtracts this time from the recovery time T2 to calculate the vasodilatory response time T1. The reason for setting the predetermined time segment set in advance is that, for example, if a time that is too short is estimated compared to the expected vasodilatory response time T1, there may be a problem with the surrounding light and color environment or the setting of the color space, and it may be caused by a spike-like disturbance, etc.
[0039] The display unit 40 is a general display monitor, and displays the time-series change in the R value as analyzed by the analysis means 20, as shown in FIG. 4, and the recovery time T2, vasodilatory response time T1, etc. estimated by the estimation means 30.
[0040] The notification unit 50 notifies each event and phase shown in Fig. 4 by voice or image. The doctor during the operation can check the progress of the examination and can confirm the area of the flap where blood flow is maintained by the image. In addition, based on the estimation result obtained by the estimation means 30, thresholds for the recovery time T2 and the vasodilation reaction time T1 can be determined in advance as support for the evaluation of the blood flow of the flap, and a notification can be given when these are exceeded.
[0041] As mentioned above, in Figure 4, the solid line indicates the measurement example of the area with good blood flow, and the dotted line indicates the measurement example of the area with weak blood flow. Comparing the two, the recovery time T2' and the vasodilatory response time T2' are longer than the recovery time T2 and the vasodilatory response time T1.
[0042] The duration of phase 2 is calculated by subtracting the vasodilation response time T1, T1' from the recovery time T2', T2'. If the duration of phase 2 is long, it can be assumed that the flap area has many blood vessels with narrow arteries or where blood flow is restricted due to arteriosclerosis. If a flap with a short duration of phase 2, that is, one in an active state of hemodynamics, is transplanted, it is thought that various complications are unlikely to occur. EXAMPLES
[0043] An example of actual measurement of blood flow in a skin flap is shown below (Figure 5). The left side shows a color image measured and evaluated using the blood flow evaluation device shown in this embodiment, and the right side shows an angiogram using ICG. The color image (upper left) taken by the blood flow evaluation device in a blood flow blocking state is shown below with time-dependent changes. The image measured by the blood flow evaluation device and the ICG blood flow image, arranged side by side, were taken at almost the same time.
[0044] The image on the left was processed by the blood flow evaluation device in RGB color space focusing on the R value, that is, the time series brightness value change of only the R value was acquired, and the color between the maximum and minimum values was quantified (normalized), and this was further inverted. Note that in this example, the evaluation region of the skin flap where blood flow is evaluated is selected as the Region of Interest (ROI) and the evaluation is performed. The image during blood flow blockage (Figure 5, upper left) is displayed in a dark color indicating that there is almost no "redness."
[0045] Next, when the measurement image after blood flow was released was subjected to the same image processing to obtain an evaluation image (inversion processing), it was shown that the area of the "red" portion had increased. In this way, the change in color of the skin flap became apparent. Specifically, in the abdominal skin flap, a characteristic finding was observed in the blood flow evaluation device image, where blood flow gradually spreads from the center of the flap. In the ICG contrast image, when the navel, which is a characteristic of this flap, was set as the midline, an image was obtained in which only the midline was enhanced, demonstrating that the blood flow evaluation device accurately displayed the blood flow. EXAMPLES
[0046] An example of measuring the blood flow of another flap is shown (Figure 6). This is an example of blood flow evaluation performed before cutting out the medial thigh flap. A comparison is made between the color tone image measured and evaluated with the blood flow evaluation device on the left and the ICG contrast image on the right. The change over time is shown downward from the state of blood flow blockage (upper row of the blood flow evaluation device), and the blood flow evaluation device image and ICG blood flow image, placed side by side, are images taken at roughly the same time. The area with slightly poor contrast, indicating weak blood flow, shown by the dotted line in the upper row of the ICG contrast image, is also depicted as black in the blood flow evaluation device image.
[0047] As explained above, this blood flow evaluation device can not only visualize the blood flow in a skin flap with the same accuracy without the need for ICG imaging, but also, by graphing changes over time, it is possible to capture the phase that reflects the flow-mediated vasodilation response, making it possible to perform transplantation using a skin flap with sufficient blood flow. EXAMPLES
[0048] Next, application to PAD diagnosis will be explained (Fig. 7). The basic configuration of the blood flow evaluation device is the same, but in the case of PAD diagnosis, since the dorsum of the toe and the sole are imaged, it is usually preferable to perform imaging using two imaging means. The procedure is the same as in the case of skin flaps, in which a pressure means 61 is attached to the ankle, blood flow is temporarily blocked by avascularization, and then the avascularization is released to measure the recovery of blood flow. A tourniquet or the like can be used as the pressure means.
[0049] When evaluating blood flow in the toes, the position of the foot is often significantly displaced when the foot is released after avascularization, and it is therefore desirable to fix the position using a fixing jig 62. The fixing jig 62 may have any shape, but it is preferable to use a fixing jig that clamps and fixes the sides of the foot from both sides, which has little effect on imaging. A schematic side view of the fixing jig is shown in the lower part of FIG. 7, and it is configured so that the foot can be clamped from both sides using fixing pads 63 and fixed with screws 64. The fixing jig may have any other shape as long as it does not cause any displacement of the toes, which are the subject of imaging, during imaging. Furthermore, blood flow can be evaluated with high accuracy by attaching a two-dimensional marker such as a two-dimensional barcode and taking an image.
[0050] As mentioned above, the measurement results of this system are considered to be able to comprehensively confirm the measurement results of two instruments, ICG fluorescence imaging and FMD measurement equipment. Therefore, when used for the diagnosis and treatment of PAD, it is not only possible to confirm areas where blood flow is stagnant, but also to comprehensively judge the state of arteriosclerosis, making it an extremely useful system. Although this system has a relatively simple configuration, it is capable of evaluating a wide range of blood flow, including diagnosing PAD and evaluating blood flow in skin flaps. [Explanation of symbols]
[0051] 1 blood flow evaluation device, 10 imaging means, 11 light emitting element, 12 light receiving element, 20 analysis means, 21 color space conversion section, 22 evaluation area definition section, 23 background area definition section, 24 evaluation image generation section, 30 estimation means, 40 display section, 50 notification section, 61 pressure means, 62 fixing jig
Claims
1. The present invention is directed to a skin flap before it is excised and / or after it is transplanted, imaging means for imaging the object in chromatic color; an analysis means for recording the images acquired by the imaging means in chronological order and performing image processing for normalizing the acquired images to a color space; and an estimation means for estimating a blood flow state of the target using a result of the image processing, The estimation means includes: displaying a change over time in chromaticity coordinate values relating to a specific color of the image after the arterial blood of the subject that has been blocked due to the compression is released, and calculating the amount of change over time; When the time change amount becomes negative, it is estimated that the patient has transitioned to a recovery state. Measure a recovery time from the release to the recovery state; A blood flow evaluation device characterized by measuring the time from the release when the amount of change over time is positive and the increment in a predetermined time interval has decreased, and subtracting the time from the release from the recovery time to calculate a blood flow-mediated vasodilation reaction time.
2. 2. The blood flow evaluation device according to claim 1, wherein the estimation means generates a signal when the amount of change over time from the release state to the recovery state is equal to or less than a predetermined value set in advance.
3. A specific shape is used as a marker in the image acquired by the imaging means.
3. The blood flow evaluation device according to claim 1, wherein a non-rigid registration algorithm is used to correct the movement of the object.
4. 4. The blood flow evaluation device according to claim 1, further comprising a two-dimensional marker disposed near the object, for canceling noise caused by the movement of the object and for removing noise.
5. the color space is an RGB color space, 5. The blood flow evaluation device according to claim 1, wherein the specific color is red.
6. The color space is the HSV color space, The image is binarized according to a specific color S; An evaluation area and a background area are defined, 6. The blood flow evaluation device according to claim 5, wherein the defined evaluation region is analyzed based on the RGB color space and normalized.
7. A method for treating the toes, The device is attached to the ankle and has a pressure means for avascularization and release, imaging means for imaging the object in chromatic color; an analysis means for recording the images acquired by the imaging means in chronological order and performing image processing for normalizing the acquired images to an RGB color space; and an estimation means for estimating a blood flow state of the target using a result of the image processing, The estimation means includes: a change over time in the chromaticity coordinate value associated with R in an RGB color space as a specific color of the image after the arterial blood of the subject that has been blocked due to the compression is released, and an amount of change over time is calculated; When the time change amount becomes negative, it is estimated that the patient has transitioned to a recovery state. Measure a recovery time from the release to the recovery state; measuring the time from the release when the amount of change over time is positive and the increment in a predetermined time segment has decreased, and calculating a flow-mediated dilation reaction time by subtracting the time from the release from the recovery time; Placing a two-dimensional marker near the subject; A blood flow evaluation device characterized in that the two-dimensional marker is used as a marker and a non-rigid registration algorithm is used to correct the movement of the object.
8. A blood flow evaluation device as described in Claim 7, characterized in that the estimation means generates a signal when the amount of temporal change between the release and the recovery state is below a predetermined value set in advance.
9. The color space uses the HSV color space, The image is binarized according to a specific color S; An evaluation area and a background area are defined, 9. The blood flow evaluation device according to claim 8, wherein the defined evaluation region is analyzed based on an RGB color space and normalized.
10. A blood flow evaluation device as described in any one of claims 7 to 9, characterized in that it is provided with a jig that clamps the sides of the foot from both sides to restrict the movement of the subject.
Citation Information
Patent Citations
Face photographing apparatus
JP2008173237A
Living body observation device
JP2008298860A
Image registration method, algorithm for implementing said image registration method, program for registering images using said algorithm, and method of handling biomedical images to reduce image artifacts due to movement of an object
JP2009512527A
Identification and analysis of lesions in medical images
JP2010517601A
Location and analysis of perforator flaps for plastic surgery and reconstructive surgery
JP2011519589A
