Photoacoustic and ultrasonic imaging device and image forming method

The dual-mode photoacoustic and ultrasound imaging device addresses low resolution in vascular imaging by combining laser and ultrasound sources for high-resolution images of blood vessels, bones, and skin, enhancing image clarity through contour scanning.

JP7604042B2Active Publication Date: 2024-12-23オプティコ インクリミテッド
View PDF 10 Cites 0 Cited by

Patent Information

Application Number
JP2023543082
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-08-10
Filing Date
2021-09-02
Publication Date
2024-12-23
Estimated Expiration
2041-09-02

AI Technical Summary

Technical Problem

Existing vascular imaging techniques, such as Doppler ultrasound, CT, and MR angiography, have low spatial resolution for visualizing microvessels, and methods requiring contrast agents are not suitable for routine checkups.

Method used

A dual-mode photoacoustic and ultrasound imaging device that combines laser and ultrasound sources to generate high-resolution images of blood vessels, bones, and skin, using synchronized emission and detection of laser and ultrasound waves, with contour scanning to enhance image resolution.

Benefits of technology

Provides high-resolution multi-structure images of blood vessels, bones, and skin, improving image clarity and accuracy by using contour scanning techniques.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007604042000001
    Figure 0007604042000001
  • Figure 0007604042000002
    Figure 0007604042000002
  • Figure 0007604042000003
    Figure 0007604042000003
Patent Text Reader

Abstract

The photoacoustic and ultrasound imaging device includes an imaging probe including a laser light source configured to generate a laser, an ultrasound source configured to generate an ultrasound generation signal, a laser emission device configured to receive the laser and emit the laser toward an object, and an ultrasound transducer configured to receive the ultrasound generation signal, emit ultrasound toward the object, and detect photoacoustic and ultrasound signals generated and reflected from the object, and a computing unit configured to form an image of tissue in the object from the laser and form an image of tissue in the object from ultrasound based on the photoacoustic and ultrasound signals detected by the ultrasound transducer.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] SUMMARY The present disclosure relates to photoacoustic and ultrasound imaging devices and methods for forming photoacoustic and ultrasound images. [Background technology]

[0002] Peripheral vascular imaging is important to evaluate blood circulation in patients with peripheral arterial disease. Numerous vascular imaging techniques, such as Doppler ultrasound imaging, computed tomography (CT), or magnetic resonance (MR) angiography, are performed clinically, but the spatial resolution for visualizing microvessels is generally low. CT angiography and MR angiography are not suitable for routine medical examinations because contrast agents must be injected to obtain vascular images. Doppler ultrasound examination is relatively safe but has low resolution. Summary of the Invention [Problem to be solved by the invention]

[0003] Each embodiment is directed to deriving images from high resolution dual mode photoacoustic (PA) / ultrasound images based on structural information of the ultrasound images. [Means for solving the problem]

[0004] An optoacoustic and ultrasonic imaging device according to one embodiment includes an imaging probe including a laser source configured to generate a laser, an ultrasound source configured to generate an ultrasound generation signal, a laser emission device configured to receive the laser and emit the laser at an object, and an ultrasound transducer configured to receive the ultrasound generation signal, emit ultrasound at the object, and detect optoacoustic and ultrasound signals generated and reflected from the object, and a computing unit configured to form an image of tissue in the object from the laser and form an image of tissue in the object from ultrasound based on the ultrasound signal detected by the ultrasound transducer.

[0005] According to one aspect of the embodiment, the imaging probe may emit laser and ultrasound waves while moving along the contour profile of the object.

[0006] According to one aspect of the embodiment, the laser source may generate and provide lasers having two or more different wavelengths.

[0007] According to one aspect of the embodiment, the image of tissue within the object may be an image of blood vessels within the object.

[0008] According to one aspect of the embodiment, the images of tissue within the object from the ultrasound may include at least one of images of blood vessels within the object, images of the skin of the object, and images of bones of the object.

[0009] According to one aspect of the embodiment, the ultrasound transducer may comprise a plurality of transducers arranged in an array configured to deliver ultrasound waves to the subject.

[0010] According to one aspect of the embodiment, the photoacoustic and ultrasonic imaging device may further include a distance sensor that may detect the distance to the object before the laser is emitted to the object, thereby forming a contour profile of the object.

[0011] According to one aspect of the embodiment, the ultrasound source may control the laser source and the ultrasound transducer to emit the laser and ultrasound in synchronization with each other.

[0012] According to one aspect of the embodiment, the photoacoustic and ultrasound imaging device may further include an examination table configured to place an object thereon, and the examination table may include an object fixing portion configured to fix the object, a moving structure configured to place and move the imaging probe on the object, and a container filled with a medium for sending ultrasound signals and photoacoustic signals between the object and the imaging probe.

[0013] According to one embodiment, a method for forming photoacoustic and ultrasound images of an object includes: (a) forming a contour profile of the object; (b) providing laser light and ultrasound to the object according to the contour profile; and (c) forming photoacoustic and ultrasound images of the object by detecting a photoacoustic signal generated from the laser light and an ultrasound signal generated from the ultrasound.

[0014] According to one aspect of the embodiment, step (a) may include forming a contour profile of the object by calculating a distance to the object using an ultrasonic transducer or distance sensor.

[0015] According to one aspect of the embodiment, step (b) may include maintaining a distance between the object and the ultrasonic transducer and a distance between the object and the laser emitting device constant.

[0016] According to one aspect of the embodiment, step (b) may be performed after forming a contour profile of the entire object.

[0017] According to one aspect of the embodiment, step (a) may be performed on a particular region of the object, and step (b) may be performed while moving along a contour profile of this region.

[0018] According to one aspect of the embodiment, forming an optoacoustic image of an object may include detecting a background signal of surrounding tissue, calculating a representative value of the background signal, and correcting the image of the object based on the representative value of the background signal.

[0019] According to one aspect of the embodiment, the representative value may be the average luminance of the background signal.

[0020] According to one aspect of the embodiment, correcting the image of the object may include dividing the pixel intensities of the optoacoustic image by this representative value.

[0021] According to one aspect of the embodiment, the ultrasound and the laser may be emitted in synchronization with each other.

[0022] According to one aspect of the embodiment, step (b) may be performed with two or more laser beams having different wavelengths, and step (c) may include forming a photoacoustic image from the two or more emitted laser beams having different wavelengths.

[0023] According to one aspect of the embodiment, the method may further include (d) calculating hemoglobin concentration, blood oxygen saturation, vascularity, and vascular depth from the photoacoustic and ultrasound images.

[0024] According to one aspect of the embodiment, the method may further include (d) calculating hemoglobin concentration, blood oxygen saturation, vascularity, and vascular depth from the photoacoustic and ultrasound images. Effect of the Invention

[0025] Each embodiment uses photoacoustic vascular imaging to provide a multi-structure image extracted from a combination of images of various structures (e.g., skin, bone, blood vessels). Additionally, a contour scanning technique can be used to improve the resolution of the image by performing a scan along the contour of the object. [Brief description of the drawings]

[0026] [Figure 1] FIG. 1 is a schematic block diagram of a photoacoustic / ultrasonic imaging device (1) according to one embodiment. [Diagram 2] FIG. 2 is a flow diagram overview of a method for photoacoustic and ultrasound imaging in accordance with one embodiment. [Diagram 3] 3(a), 3(b) and 3(c) are schematic diagrams illustrating the operation of a photoacoustic / ultrasonic imaging device according to one embodiment. [Figure 4]Fig. 4(a) is an example of a skin image obtained from an ultrasound 3D image (volumetric image). Fig. 4(b) is an example of a bone image obtained from an ultrasound 3D image. Fig. 4(c) is an example of a blood vessel image obtained from an ultrasound 3D image. [Diagram 5] FIG. 5 is an example of a photoacoustic image of the microvessels of a foot, which is the object (T). [Figure 6] FIG. 6(a) is a display of an ultrasound image (US) and a photoacoustic image (PA) obtained by linearly moving an imaging probe according to the related art. FIG. 6(b) is a display of an ultrasound image (US) and a photoacoustic image (PA) obtained by moving an imaging probe according to a contour profile of an object according to an embodiment. FIG. 6(c) is a blood vessel image (PA) obtained in the form of a photoacoustic image by linearly moving an imaging probe according to the related art, and a photoacoustic image showing oxygen saturation (PA-sO2) on the right. FIG. 6(d) is a blood vessel image (PA) obtained in the form of a photoacoustic image by moving an imaging probe according to a contour profile of an object according to an embodiment, and a photoacoustic image showing oxygen saturation (PA-sO2) on the left. [Figure 7] 7(a) is a diagram showing hemoglobin concentration (HbT), oxygen saturation (sO2), and subcutaneous blood vessel depth (Depth) obtained by a photoacoustic imaging (PA) technique of the related art. FIG. 7(b) is a diagram showing hemoglobin concentration (HbT), oxygen saturation (sO2), and subcutaneous blood vessel depth (Depth) obtained by a photoacoustic imaging (PA) technique for correcting an image of a tissue at a target (T) according to one embodiment. [Figure 8] FIG. 8 is a graph showing average values ​​of total hemoglobin concentration (HbT), oxygen saturation (sO2), vascularity, and average depth for four different individuals measured five times, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Each embodiment will be described below with reference to the accompanying drawings.

[0028] Fig. 1 is a block diagram of an overview of a photoacoustic / ultrasonic imaging device 1 according to an embodiment. Referring to Fig. 1, the photoacoustic / ultrasonic imaging device 1 includes an imaging probe 200 including a laser light source 120 for forming a laser, an ultrasonic source 142 for forming an ultrasonic generation signal, a laser emitting device 220 for receiving a laser and emitting the laser to an object T, and an ultrasonic transducer 240 for receiving the ultrasonic generation signal, emitting ultrasonic waves to the object, and detecting a photoacoustic image and an ultrasonic signal generated from the object, and a computing unit 146 configured to form an image of tissue in the object T by the laser and form an image of tissue in the object T by ultrasonic waves based on the ultrasonic signal detected by the ultrasonic transducer 240.

[0029] Referring to FIG. 1, the photoacoustic / ultrasonic imaging device 1 according to this embodiment includes a laser source 120 and an ultrasonic unit 140. The laser source 120 forms a laser having a predetermined wavelength. For example, the laser provided by the laser source 120 may be a pulsed laser with a pulse repetition rate of 1 Hz to 20 Hz. For example, the laser source 20 may control the light provided, and may be, for example, a Phocus Mobile product manufactured by OPOTEK Inc. The laser source 120 may form and provide multiple laser beams having various wavelengths.

[0030] The ultrasound unit 140 may include an ultrasound source 142 and a computing unit 146 configured to receive signals detected by the ultrasound transducer 240 and perform imaging. In the embodiment shown in FIG. 1, the computing unit 146 is included in the ultrasound unit 140. However, in embodiments not shown herein, the computing unit may be a separate component configured to receive signals detected by the ultrasound transducer and perform operations on the signals before performing imaging to form an image.

[0031] The ultrasonic source 142 generates and supplies ultrasonic waves of a predetermined frequency. In one embodiment, the ultrasonic waves supplied by the ultrasonic source 142 may be ultrasonic waves having a center frequency of 5.5 MHz to 11.5 MHz. For example, the ultrasonic source 142 may be an ultrasonic system ECUBE 12R manufactured by Alpinion Medical Systems Co. Ltd.

[0032] When the laser pulse repetition rate is 10 Hz, one photoacoustic image can be obtained from one or more consecutive laser pulses, and the available frame rates can be 10 Hz or less for both photoacoustic and ultrasound images (US). However, this is just one example, and the available frame rates can be higher or lower than 10 Hz.

[0033] The imaging probe 200 includes a laser emitting device 220 configured to receive a laser and deliver the laser to the object T, and one or more ultrasonic transducers 240 configured to receive an ultrasonic wave and deliver the ultrasonic wave to the object T. In one embodiment, the laser emitting device 220 may include a plurality of optical fiber bundles connected to the laser source 120 and may emit a linear laser to the object T. The ultrasonic transducer 240 may include one or more transducers arranged in an array, for example, 128 transducers arranged in an array. This is merely exemplary. The ultrasonic transducer 240 receives an ultrasonic wave generation signal provided by the ultrasonic source 142, forms an ultrasonic wave corresponding to the ultrasonic wave generation signal, and delivers the ultrasonic wave to the object T. The ultrasonic transducer 240 and the laser emitting device 220 may each be moved by a motor drive device (not shown) controlled by a controller.

[0034] The ultrasonic transducer 240 and the laser emitting device 220 included in the imaging probe 200 are arranged such that the laser beam from the laser emitting device 220 and the ultrasonic waves from the ultrasonic transducer 240 are coincident with an image plane at a predetermined position below the imaging probe 200. In one embodiment, the laser beam and the ultrasonic waves are provided to coincide with each other at a distance of 10-50 mm below the imaging probe 200, for example, they may coincide with each other at a depth of 30 mm in the object T.

[0035] Ultrasound from the ultrasonic transducer 240 is provided to the subject T. From the provided ultrasound, an ultrasound signal corresponding to tissues and structures within the subject T is generated and provided to the outside of the subject T.

[0036] The laser light supplied from the laser emitting device 220 to the subject T is absorbed by tissue within the subject T. A signal in the ultrasonic band corresponding to the tissue within the subject T that absorbs the laser light is formed, and this signal is supplied to the outside of the subject T.

[0037] The ultrasonic signals provided by the object T are detected by the ultrasonic transducer 240. The ultrasonic signals detected by the ultrasonic transducer 240 are provided to a computing unit 146. The computing unit 146 detects signals generated from the laser provided to the object T and forms an optoacoustic image, for example, using Fourier domain reconstruction techniques.

[0038] The computing unit 146 detects signals formed at the object T from the ultrasound delivered to the object T and reconstructs an ultrasound image, for example, by performing delay-and-sum beamforming. In one embodiment, the reconstructed photoacoustic image and ultrasound image may be generated, displayed, and stored by the computing unit 146 in the form of image signals, respectively.

[0039] In an embodiment not shown here, the imaging probe may further comprise a distance sensor configured to measure the distance to the object, thereby obtaining a contour profile of the object.

[0040] The operation of the photoacoustic / ultrasonic imaging device 1 having the above configuration will be described below. Fig. 2 is a flow chart showing an overview of a photoacoustic and ultrasonic imaging method according to one embodiment. Referring to Fig. 2, the method for forming a photoacoustic image and an ultrasonic image according to this embodiment includes (a) forming a contour profile of an object (S100), (b) supplying laser light and ultrasonic waves to the object according to the contour profile (S200), and (c) detecting a photoacoustic signal generated from the laser light and an ultrasonic signal generated from the ultrasonic waves to form a photoacoustic image and an ultrasonic image of the object (S300).

[0041] The contour of the object T is obtained by scanning the object T with the ultrasonic transducer 240. In one embodiment, an ultrasonic image of the skin is obtained using the ultrasonic transducer 240. In order to quickly perform the process of obtaining an image of the skin to obtain the contour, the process of detecting the skin is preferably simplified. In one embodiment, the process of detecting the skin may be performed by setting a threshold according to the intensity of the ultrasonic waves and performing a smoothing process using boxcar filtering or median filtering. A contour profile corresponding to the height of the object T is obtained by selecting the median value in the x-axis direction of the obtained ultrasonic image of the skin.

[0042] The acquired contour profile corresponding to the height of the object T is used to control a motor drive (not shown) so that the imaging probe 200 performs a scan at a constant speed in the Y-axis direction and moves in the Z-axis direction depending on the height of the object T.

[0043] The contour acquisition according to this embodiment may be performed before photoacoustic / ultrasonic imaging of the object T. In one embodiment, photoacoustic / ultrasonic imaging may be performed after the contour is acquired. That is, after the contour of the object T is acquired, photoacoustic / ultrasonic imaging may be performed according to the acquired contour. In another embodiment, the contour of a predetermined portion of the object T may be acquired, photoacoustic / ultrasonic imaging may be performed on the predetermined portion according to the contour, and the contour acquisition and the photoacoustic / ultrasonic imaging may be repeatedly performed. In an embodiment not shown in this specification, the contour acquisition may be performed by a distance sensor.

[0044] 3(a), 3(b), and 3(c) are schematic diagrams showing the operation of a photoacoustic / ultrasonic imaging device according to an embodiment. In the embodiment of FIG. 3(a), 3(b), and 3(c), a case is shown in which the object T is a human foot. However, this is merely an example, and a detected object, for example, a foot, a hand, a thigh, a calf, an upper arm, a forearm, or a torso may be set as the object T.

[0045] The object T may be placed on an examination table (not shown) for performing an imaging process on the object T. The examination table may include an object fixing portion (not shown) for fixing the object T during the imaging process. The examination table may include a moving structure (not shown) including rails and a frame for allowing the imaging probe 200 to perform imaging while moving over the object T. The moving structure may be an electric moving structure for moving the imaging probe 200 in the X-axis, Y-axis, and Z-axis directions.

[0046] The examination table may include a container (not shown) for immersing the object T in a medium, and the container is filled with a medium for transmitting ultrasonic and photoacoustic signals. In one embodiment, the object fixing portion may fix the object T by immersing the object T in the container, and the liquid in which the object T is immersed may be water.

[0047] In the embodiments of Figures 3(a) and 3(c), the imaging probe 200 moves along the Y axis, and the computing unit 146 forms a three-dimensional image by stacking optoacoustic / ultrasound images obtained at each position where the imaging probe 200 moves.

[0048] The step size with which the imaging probe 200 is moved in the Y-axis direction by an electrical stage (not shown) may be smaller than the −6 dB beam width of the ultrasound transducer array, for example, the step size with which the imaging probe 200 is moved in the Y-axis direction may be smaller than 0.5 mm.

[0049] The width w over which the imaging probe 200 scans the object T by providing laser and ultrasound to the object T may be smaller than the width of the object T. In this case, photoacoustic and ultrasound images of the entire object T can be obtained by performing multiple scans while the object T is fixed.

[0050] As shown in Fig. 3(c), the process of supplying laser and ultrasound and performing a scan with the imaging probe 200 may be performed by adjusting the height of the imaging probe 200 to correspond to the contour profile of the object. Thus, imaging is performed by adjusting the focus of the imaging probe 200 to correspond to the contour profile, as shown in the right part of Fig. 3(c). Accordingly, it is possible to obtain an image with a higher resolution than that in the related art.

[0051] A scan is performed to obtain an image of the entire object T, and the photoacoustic and ultrasound images obtained from the scan are combined by computer software to form a three-dimensional (3D) image. In one embodiment, multiple scans may be performed to obtain an image of the entire object T. In one embodiment, the 3D image may be obtained by computer software.

[0052] In one embodiment, by scanning the contour, the height of the image may be adjusted according to the height of the contour in order to reconstruct the structural information of the original contour of the photoacoustic / ultrasound image obtained at the same height as the object T, and multiple scan results may be combined by computer software.

[0053] A three-dimensional image may be obtained from the photoacoustic / ultrasound image of the entire object T, and essential components of the object T are extracted. The ultrasound three-dimensional image of the object shows various structures according to their brightness, such as skin (hyperechoic), bone (hyperechoic but aechoic underneath), and blood vessels (hyperechoic but aechoic inside).

[0054] FIG. 4(a) is an example of an image of skin obtained from an ultrasonic 3D image. The ultrasonic image of the skin is obtained by detecting a smooth surface from the brightness information and detecting the position of the skin. For example, the detection of this smooth surface may be performed using computer software as described above.

[0055] Figure 4(b) is an example of a bone image obtained from an ultrasound 3D image. In an ultrasound image, bones are darker than the skin but appear as bright dots. After the information about the skin is obtained, a pixel brightness adjustment process is performed to reduce the brightness of the skin and increase the brightness of the bone, after which the bone can be detected by software. For example, the bone image may be obtained by detecting the bone boundary by a Log-Gabor filter, or by inverting the pixel brightness and detecting the outline of the bottom of the bone using computer software.

[0056] FIG. 4(c) is an example of a blood vessel image obtained from an ultrasound 3D image. In an ultrasound image, the inside of a blood vessel is displayed dark (low brightness). By color inversion, the inside of a block vessel appears bright, and a blood vessel image can be obtained by using a Frangi filter to determine whether pixels corresponding to blood in the blood vessel are connected in the shape of a blood vessel.

[0057] 5 is an example of a photoacoustic image of the microvessels of the foot, which is the object (T). Laser light supplied from the laser emitting device 220 is supplied to the object T and passes through the object T. The tissue within the object T absorbs the passing laser light and supplies a signal in the ultrasonic band to the outside. The arithmetic unit 146 detects the signal in the ultrasonic band formed as described above and forms a photoacoustic image.

[0058] However, since the laser light provided to the object T may be scattered, and the intensity of the laser light decreases as the depth of penetration of the laser light into the skin increases, signal processing is performed on the background signal so that the signal intensity is sufficient to form an image. A background signal of the tissue surrounding the blood vessel is formed from the laser light provided to the object T, and the laser forming this background signal is expected to attenuate in the same manner as the laser provided to the tissue surrounding the blood vessel.

[0059] Therefore, a representative value may be calculated by extracting the background signal excluding the blood vessel signal, and a trend in the light attenuation may be identified by identifying a trend in the representative value for a position within the object T. For example, the representative value of the background signal may be an average value of the intensity of the background signal within a particular region.

[0060] Therefore, the trend of the representative value corresponds to the trend of attenuation of the laser light passing through the object T, and the image formed by correcting the image of the tissue in the object T is substantially the same as the image of the blood vessels in the object T shown in Fig. 5. For example, a method of correcting the image of the tissue in the object T may be performed by dividing the pixel brightness in the photoacoustic image of the tissue by the trend of the representative value.

[0061] Experimental Example Hereinafter, an experimental example of an embodiment will be described with reference to the accompanying drawings. Fig. 6(a) is a display of an ultrasound image (US) and a photoacoustic image (PA) obtained by linearly moving an imaging probe based on the related art, and Fig. 6(b) is a display of an ultrasound image (US) and a photoacoustic image (PA) obtained by moving an imaging probe according to a contour profile of an object according to an embodiment. With reference to Fig. 6(a) and Fig. 6(b), according to the related art, imaging was performed on an object below a focal plane indicated by a yellow dashed line. However, according to an embodiment, imaging was performed on this object by moving an imaging probe according to the contour profile of the object, and thus the object was imaged according to the focal plane.

[0062] Therefore, it can be seen that the resolution and signal strength of the image in FIG. 6(b) is greater than the resolution and signal strength of the image in FIG. 6(a) according to the related art.

[0063] The left diagram of Fig. 6(c) is a blood vessel image (PA) obtained in the form of a photoacoustic image by linearly moving an imaging probe based on the related art, and the right diagram of Fig. 6(c) is a photoacoustic image showing oxygen saturation (PA-sO2). The left diagram of Fig. 6(d) is a blood vessel image (PA) obtained in the form of a photoacoustic image by moving an imaging probe according to a contour profile of an object according to an embodiment, and the right diagram of Fig. 6(d) is a photoacoustic image showing oxygen saturation (PA-sO2).

[0064] Referring to Figures 6(c) and 6(d), the photoacoustic images of blood vessels and oxygen absorption rate images obtained by this embodiment are shown in more detail, and it can be seen that each image has relatively high resolution and values ​​closer to actual oxygen saturation compared to related art.

[0065] FIG. 7(a) shows total hemoglobin concentration (HbT), oxygen saturation (sO2), and subcutaneous blood vessel depth (Depth) obtained by a photoacoustic imaging (PA) technique of the related art, and FIG. 7(b) shows hemoglobin concentration (HbT), oxygen saturation (sO2), and subcutaneous blood vessel depth (Depth) obtained by a photoacoustic imaging (PA) technique for correcting an image of tissue at a target (T) according to one embodiment.

[0066] For example, based on the fact that the light absorption rate of oxygenated hemoglobin or non-oxygenated hemoglobin changes depending on the wavelength of the laser, the total hemoglobin concentration (HbT) and the oxygen saturation (sO2) were measured. The oxygenated / non-oxygenated hemoglobin concentration at the pixel of the photoacoustic image formed and acquired by emitting laser light having two or more wavelengths (four wavelengths in one embodiment) may be calculated by a linear equation, the total hemoglobin concentration (HbT) may be calculated by adding up the oxygenated / non-oxygenated hemoglobin concentrations, and the oxygen saturation (sO2) may be calculated by dividing the oxygenated hemoglobin concentration by the total hemoglobin concentration (HbT).

[0067] For example, the subcutaneous blood vessel depth may be calculated by detecting the position of the skin from ultrasound images and photoacoustic images, and the position of the pixel corresponding to each blood vessel may be calculated and expressed as the vertical distance from the position of the pixel of the skin. When the position of the skin is detected from the photoacoustic image, the position of the skin may be detected from the melanin distribution shape by calculating the light absorption rate of the melanin component in the skin in the photoacoustic image obtained from laser light having two or more wavelengths using a linear equation similar to that described above for hemoglobin.

[0068] Referring to Figures 7(a) and 7(b), which show the total hemoglobin concentration (HbT) and the oxygen saturation (sO2) and subcutaneous tissue depth, it can be seen that the resolution of the image formed by correcting the image of the tissue within the object T in one embodiment is relatively high.

[0069] 8 is a graph showing the average values ​​of total hemoglobin concentration (HbT), oxygen saturation (sO2), blood vessel density and average depth of four different people measured five times according to one embodiment. For example, the hemoglobin concentration (HbT), oxygen saturation (sO2) and average depth may be calculated by selecting pixels each having a value equal to or greater than a predetermined threshold based on the image of the total hemoglobin concentration (HbT) and calculating the average of the hemoglobin concentration (HbT), oxygen saturation (sO2) and depth at the position of the selected pixel. For example, the blood vessel density may be calculated by dividing the total area occupied by the pixels each having a value equal to or greater than a predetermined threshold based on the image of the hemoglobin concentration (HbT) by the total area of ​​the object T.

[0070] As shown in Figure 8, the deviation of the results measured from four different people is not large, so the results show a high probability of reproduction in this embodiment.

[0071] To facilitate understanding of the present disclosure, the present disclosure has been described above with reference to the embodiments shown in the drawings, but those skilled in the art will understand that the embodiments are merely exemplary and that various modifications may be made and equivalent embodiments may be implemented. Accordingly, the scope of the present disclosure should be defined by the appended claims.

Claims

1. a laser source configured to generate a laser; an ultrasonic source configured to generate an ultrasonic generated signal; an imaging probe including a laser emitting device configured to receive the laser and emit the laser at an object, and an ultrasound transducer configured to receive the ultrasound-generated signal, emit ultrasound at the object, and detect photoacoustic and ultrasound signals generated and reflected from the object; a computing unit configured to form an image of tissue within the object from the laser and form an image of tissue within the object from the ultrasound based on the ultrasound signals detected by the ultrasound transducer; Equipped with The computing unit obtains a contour profile of the object from the ultrasonic waves emitted from the ultrasonic transducer to the object; or the photoacoustic and ultrasonic imaging device further comprises a distance sensor; The distance sensor detects a distance to the object, The computing unit obtains a contour profile of the object from the distance detected by the distance sensor; the imaging probe emits the laser and the ultrasound while moving along the contour profile of the object; the computing unit forms the image of the tissue within the object by adjusting a height of the image according to the contour profile. Photoacoustic and ultrasound imaging devices.

2. The photoacoustic and ultrasound imaging device of claim 1 , wherein the laser light source forms and provides lasers of two or more different wavelengths.

3. The photoacoustic and ultrasound imaging device of claim 1 , wherein the images of the tissue of the object from the laser include images of one or more of the skin, background tissue, and blood vessels of the object.

4. The photoacoustic and ultrasound imaging device of claim 1 , wherein the images of the tissue within the object from the ultrasound include one or more of an image of blood vessels within the object, an image of the skin of the object, and an image of bones of the object.

5. The photoacoustic and ultrasound imaging device of claim 1 , wherein the ultrasound transducer comprises a plurality of transducers configured to deliver the ultrasound to the object and arranged in an array.

6. The photoacoustic and ultrasonic imaging device of claim 1 , wherein the ultrasonic source controls the laser light source and the ultrasonic transducer to emit the laser and the ultrasonic waves in synchronization with each other.

7. and further comprising an examination table configured to place the object thereon, The examination table, An object fixing portion configured to fix the object; a moving structure configured to position and move the imaging probe above the object; a vessel filled with a medium for transmitting ultrasonic and photoacoustic signals between the object and the imaging probe; The photoacoustic and ultrasonic imaging device of claim 1 .

8. 1. A method for forming photoacoustic and ultrasound images of an object, comprising: (a) generating a contour profile of the object; (b) applying laser light and ultrasonic waves to the object according to the contour profile; (c) detecting photoacoustic signals generated from the laser light and ultrasonic signals generated from the ultrasonic waves to form a photoacoustic image and an ultrasonic image of the object. Including, step (a) includes forming the contour profile of the object by calculating a distance to the object using an ultrasonic transducer or a distance sensor; Step (a) is performed on a particular area of ​​the object; Step (b) is performed while moving along a contour profile of the region. method.

9. The method of claim 8 , wherein step (b) comprises maintaining a constant distance between the object and an ultrasonic transducer and a constant distance between the object and a laser emitting device.

10. The method of claim 8 , wherein step (b) is performed after forming the contour profile of the entire object.

11. forming the photoacoustic image of the object, Detecting a background signal of surrounding tissue; calculating a representative value of the background signal; correcting the image of the object based on the representative value of the background signal; The method of claim 8 , comprising:

12. The method of claim 11 , wherein the representative value is an average luminance of the background signal.

13. The method of claim 11 , wherein the correcting the image of the object comprises dividing pixel intensities of the optoacoustic image by the representative values.

14. The method of claim 8 , wherein step (c) comprises forming an image of tissue within the object by adjusting the height of the photoacoustic and ultrasound images according to the contour profile.

15. The method of claim 8 , wherein step (b) comprises emitting the ultrasonic wave and the laser light in synchronization with each other.

16. step (b) includes emitting two or more laser beams having different wavelengths; The method of claim 8 , wherein step (c) comprises forming a photoacoustic image from the emitted two or more laser beams having different wavelengths.

17. The method of claim 8 , further comprising: (d) calculating hemoglobin concentration, blood oxygen saturation, vascularity, and vascular depth from the photoacoustic image and the ultrasound image.

Citation Information

Patent Citations

  • Living body information imaging apparatus

    JP2010012295A

  • Continuous emission photoacoustic spectroscopy

    JP2013518673A

  • Double modality image processing system for functional and anatomical concurrent display mapping

    JP2018143778A

  • Acoustic wave device

    JP2019025217A

  • Processing device and processing method related to medical image

    JP2019051016A