Image processing device, image processing method, and non-transitory computer-readable medium

Through spectral image processing technology, multi-wavelength light irradiation and photoacoustic signals are used to distinguish the contrast agent area from the vascular area, solving the problem that it is difficult to clearly identify the structure of the contrast object in the prior art, and improving the contrast effect of photoacoustic imaging.

CN112584775BActive Publication Date: 2024-11-22CANON KK +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN201980054755.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-08-21
Filing Date
2019-03-29
Publication Date
2024-11-22
Estimated Expiration
2039-03-29

AI Technical Summary

Technical Problem

It is difficult to clearly identify the structure of the contrast object in the subject to be measured, such as the traveling of blood vessels and lymphatic vessels.

Method used

By adopting a spectral image processing device, the photoacoustic wave signal is obtained by irradiating the subject to be injected with the contrast agent, and the contrast agent is different from the light absorption coefficient of a specific substance, and the contrast agent area and other areas are distinguished. A spectral image is generated to show the distribution of the contrast agent.

Benefits of technology

Image processing that clearly distinguishes the contrast agent area and the blood vessel area is achieved, which improves the structural visibility of the contrast object and enhances the imaging ability of structures such as lymphatic vessels.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112584775B_ABST
    Figure CN112584775B_ABST
Patent Text Reader

Abstract

An image processing device comprises: a spectral image acquisition unit, which acquires a spectral image, which is an image generated based on photoacoustic waves generated by irradiating a subject with light having multiple different wavelengths injected with a contrast agent, and is generated using photoacoustic signals corresponding to the multiple different wavelengths; a contrast agent information acquisition unit, which acquires information about the contrast agent; a region determination unit, which determines a region corresponding to the contrast agent in the spectral image based on the information about the contrast agent; and a display control unit, which displays the spectral image so that the region corresponding to the contrast agent and the region other than the region can be distinguished.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to image processing for images generated by photoacoustic imaging. Background Art

[0002] In the examination of blood vessels, lymphatic vessels, etc., photoacoustic imaging (also called "optical ultrasound imaging") using a contrast agent is known. Patent document 1 discloses a photoacoustic image generating device that uses a contrast agent for contrasting lymph nodes, lymphatic vessels, etc. as an evaluation object and projects light having a wavelength that is absorbed by the contrast agent to generate a photoacoustic wave.

[0003] Citation List

[0004] Patent Literature

[0005] Patent Document 1: International Publication No. WO 2017 / 002337 Summary of the invention

[0006] Technical issues

[0007] However, in the photoacoustic imaging disclosed in Patent Document 1, it is sometimes difficult to ascertain the structure of the contrast target in the subject (for example, the structure running in a blood vessel, a lymphatic vessel, etc.).

[0008] Therefore, an object of the present invention is to provide an image processing device that generates an image that makes it easy to ascertain the structure of a contrast object by photoacoustic imaging.

[0009] Solution to the problem

[0010] An image processing device according to one aspect of the present invention includes: a spectral image acquisition component, which acquires a spectral image, which is an image generated based on photoacoustic waves generated by irradiating a subject injected with a contrast agent with light of multiple different wavelengths, and is generated using photoacoustic signals corresponding to the multiple different wavelengths; a contrast agent information acquisition component, which acquires information about the contrast agent; a region determination component, which determines a region in the spectral image corresponding to the contrast agent based on the information about the contrast agent; and a display control component, which displays the spectral image so that the region corresponding to the contrast agent and the region other than the region corresponding to the contrast agent can be distinguished.

[0011] Advantageous Effects of the Invention

[0012] According to the present invention, it is possible to provide an image processing device that generates an image that makes it easy to ascertain the structure of a contrast object by photoacoustic imaging. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a block diagram of a system according to an embodiment of the present invention.

[0014] Figure 2 is a block diagram illustrating a specific example of the image processing apparatus and its peripheral components according to the embodiment of the present invention.

[0015] Figure 3 is a detailed block diagram of a photoacoustic apparatus according to an embodiment of the present invention.

[0016] Figure 4 is a schematic diagram of a probe according to an embodiment of the present invention.

[0017] Figure 5 is a flowchart of an image processing method according to an embodiment of the present invention.

[0018] Figure 6 is a graph showing absorption coefficient spectra when the ICG concentration has been changed.

[0019] Figure 7 A to Figure 7 D is a contour plot of the calculated values ​​of the formula (1) corresponding to the contrast agent when the wavelength combination has been changed.

[0020] Figure 8 : is a line graph showing the calculated values ​​of the formula (1) corresponding to the contrast agent when the ICG concentration has changed.

[0021] Fig. 9 is a graph showing the molar absorption coefficient spectra of oxyhemoglobin and deoxyhemoglobin.

[0022] Fig.10 is a diagram illustrating a GUI according to an embodiment of the present invention.

[0023] Fig.11 A and Fig.11 B is a spectral image of the extensor side of the right forearm when the ICG concentration has been changed.

[0024] Fig.12 A and Fig.12 B is a spectral image of the extended side of the left forearm when the ICG concentration has been changed.

[0025] Fig.13 A and Fig.13 B is a spectral image of the inner side of the right calf and the inner side of the left calf when the ICG concentration has been changed. DETAILED DESCRIPTION

[0026] A suitable embodiment of the present invention will be described below with reference to the accompanying drawings. However, the size, material, shape, relative arrangement, etc. of the components described below can be appropriately changed according to the configuration of the device to which the present invention is applied and various conditions. Therefore, the scope of the present invention is not limited to the following description.

[0027] The photoacoustic image acquired by the system according to the present invention reflects the amount and rate of absorption of light energy. The photoacoustic image is an image representing the spatial distribution of at least one piece of information about the subject, and the subject information includes the generated sound pressure (initial sound pressure) of the photoacoustic wave, the light absorption energy density, the light absorption coefficient, etc. The photoacoustic image can be an image representing a two-dimensional spatial distribution, or an image (volume data) representing a three-dimensional spatial distribution. The system according to this embodiment generates a photoacoustic image by imaging a subject injected with a contrast agent. In addition, in order to ascertain the three-dimensional structure of the imaging object, the photoacoustic image can be an image representing a two-dimensional spatial distribution in the depth direction from the surface of the subject, or an image representing a three-dimensional spatial distribution.

[0028] In addition, the system according to the present invention can generate a spectral image of the object using a plurality of photoacoustic images corresponding to a plurality of wavelengths. The spectral image of the present invention is an image generated using photoacoustic signals corresponding to a plurality of wavelengths based on photoacoustic waves generated by irradiating a subject with light having a plurality of different wavelengths.

[0029] In addition, the spectral image can be an image representing the concentration of a specific substance in the object being measured, which is generated using photoacoustic signals corresponding to multiple wavelengths. When the light absorption coefficient spectrum of the contrast agent to be used is different from the light absorption coefficient spectrum of the specific substance, the image value of the contrast agent in the spectral image is different from the image value of the specific substance in the spectral image. Therefore, the area of ​​the contrast agent and the area of ​​the specific substance can be distinguished based on the image value of the spectral image. In addition, as a specific substance, substances constituting the object being measured, such as hemoglobin, glucose, collagen, melanin, fat or water, can be thought of. In this case, it is necessary to select a contrast agent with a light absorption spectrum different from the light absorption coefficient spectrum of the specific substance. In addition, the spectral image can be calculated by different calculation methods depending on the type of specific substance.

[0030] In the embodiment to be described below, an image calculated using the oxygen saturation calculation formula (1) is described as a spectral image. The inventors have found that when the measured value I(r) of the photoacoustic signal obtained using a contrast agent whose wavelength dependence of light absorption coefficient tends to be different from the wavelength dependence of oxygenated hemoglobin and deoxygenated hemoglobin is substituted into the formula (1) for calculating the oxygen saturation of hemoglobin in the blood (which can be an index having a correlation with the oxygen saturation) based on the photoacoustic signals corresponding to a plurality of wavelengths, a calculated value Is(r) is obtained that deviates greatly from the numerical range obtained by the oxygen saturation of hemoglobin. Therefore, if the calculated value Is(r) is used as an image value to generate a spectral image, it is easy to separate (distinguish) the hemoglobin area (blood vessel area) in the subject from the area where the contrast agent exists (for example, the lymphatic vessel area if the contrast agent is injected into the lymphatic vessel) on the image.

[0031] [Mathematical expression 1]

[0032]

[0033] Here, I λ 1(r) is a measured value based on the photoacoustic wave generated according to the irradiation of the light having the first wavelength λ1, I λ 2(r) is a measured value based on the photoacoustic wave generated according to the irradiation of the light having the second wavelength λ2. Hb λ 1 is the molar absorption coefficient of deoxyhemoglobin corresponding to the first wavelength λ1 [mm -1 mol -1 ],ε Hb λ 2 is the molar absorption coefficient of deoxyhemoglobin corresponding to the second wavelength λ2 [mm -1 mol -1 ]. HbO λ 1 is the molar absorption coefficient of oxygenated hemoglobin corresponding to the first wavelength λ1 [mm -1 mol -1 ],ε HbO λ 2 is the molar absorption coefficient of oxygenated hemoglobin corresponding to the second wavelength λ2 [mm -1 mol -1 ]. r is the position. In addition, as the measured value I λ 1(r) and I λ 2(r), the absorption coefficient μ can be used a λ 1(r) and μ a λ 2(r), or the initial sound pressure P0 can be used λ 1(r) and P0 λ 2(r).

[0034] When the measured value based on the photoacoustic wave generated from the hemoglobin existing area (blood vessel area) is substituted into formula (1), the oxygen saturation of hemoglobin (or an indicator correlated with the oxygen saturation) is obtained as the calculated value Is(r). On the other hand, in a subject injected with a contrast agent, when the measured value based on the acoustic wave generated from the contrast agent existing area (e.g., lymphatic vessel area) is substituted into formula (1), the pseudo-concentration distribution of the contrast agent is obtained as the calculated value Is(r). In addition, when calculating the concentration distribution of the contrast agent, the numerical value of the molar absorption coefficient of hemoglobin can be used as is in formula (1). The spectral image Is(r) obtained in this way becomes an image depicted in a state where the hemoglobin existing area (blood vessel) and the contrast agent existing area (e.g., lymphatic vessel) in the subject can be separated (distinguished) from each other.

[0035] In addition, although the formula (1) for calculating oxygen saturation is used to calculate the image value of the spectral image in the present embodiment, when calculating an index other than oxygen saturation as the image value of the spectral image, a calculation method other than formula (1) may be used. Since known indexes and index calculation methods may be used as the indexes and their calculation methods, their detailed description is omitted here.

[0036] Furthermore, the system according to the present invention can use an image representing the ratio of a first photoacoustic image based on photoacoustic waves generated by irradiation with light having a first wavelength λ1 to a second photoacoustic image based on photoacoustic waves generated by irradiation with light having a second wavelength λ2 as a spectral image. That is, an image based on the ratio of a first photoacoustic image based on photoacoustic waves generated by irradiation with light having a first wavelength λ1 to a second photoacoustic image based on photoacoustic waves generated by irradiation with light having a second wavelength λ2 can be used as a spectral image. In addition, an image generated according to a modified formula of formula (1) can also be represented by the ratio of the first photoacoustic image to the second photoacoustic image, and can therefore be said to be an image (spectral image) based on the ratio of the first photoacoustic image to the second photoacoustic image.

[0037] In order to clarify the three-dimensional structure of the imaging object, the spectral image may be an image showing a two-dimensional spatial distribution in the depth direction from the surface of the object or an image showing a three-dimensional spatial distribution.

[0038] Hereinafter, the configuration of the system and the image processing method of the present embodiment will be described.

[0039] Will use Figure 1 A system according to the present embodiment is described. Figure 1 1 is a block diagram illustrating a configuration of a system according to the present embodiment. The system according to the present embodiment includes a photoacoustic device 1100, a storage device 1200, an image processing device 1300, a display device 1400, and an input device 1500. Transmission and reception of data between the devices may be performed in a wired or wireless manner.

[0040] The photoacoustic device 1100 generates a photoacoustic image by imaging a subject into which a contrast agent has been injected, and outputs the photoacoustic image to the storage device 1200. The photoacoustic device 1100 is a device that generates information of characteristic values ​​corresponding to a plurality of positions in the subject using a reception signal acquired by receiving a photoacoustic wave generated according to irradiation of light. That is, the photoacoustic device 1100 is a device that generates a spatial distribution of characteristic value information derived from the photoacoustic wave as medical image data (photoacoustic image).

[0041] The storage device 1200 may be a storage medium such as a read-only memory (ROM), a disk, or a flash memory. In addition, the storage device 1200 may be a storage server via a network such as a picture archiving and communication system (PACS).

[0042] The image processing device 1300 is a device that processes information such as the photoacoustic image and the supplementary information of the photoacoustic image stored in the storage device 1200 .

[0043] The unit that performs the operation function of the image processing device 1300 may be composed of a processor such as a CPU or a graphics processing unit (GPU) and an operation circuit such as a field programmable gate array (FPGA). These units may be composed not only of a single processor and a single operation circuit, but also of multiple processors and multiple operation circuits.

[0044] The unit that performs the storage function of the image processing device 1300 may be configured as a non-transitory storage medium such as a read-only memory (ROM), a disk, or a flash memory. In addition, the unit that performs the storage function may be a volatile medium such as a random access memory (RAM). In addition, a storage medium storing a program is a non-transitory storage medium. In addition, the unit that performs the storage function may be configured not only as a single storage medium but also as a plurality of storage media.

[0045] The unit that performs the control function of the image processing device 1300 is configured as an operation element such as a CPU. The unit that performs the control function controls the operation of each component of the system. The unit that performs the control function can receive an instruction signal of various operations such as the start of measurement from the input unit and control each component of the system. In addition, the unit that performs the control function can read the program code stored in the computer 150 and control the operation of each component of the system.

[0046] The display device 1400 is a display such as a liquid crystal display or an organic electroluminescent (EL) device. In addition, the display device 1400 can display a GUI for operating an image or a device.

[0047] As the input device 1500 , an operation console composed of a mouse, a keyboard, etc. that can be operated by a user can be used. In addition, the display device 1400 may be configured as a touch panel, and the display device 1400 may be used as the input device 1500 .

[0048] Figure 2A specific configuration example of the image processing apparatus 1300 according to the present embodiment is illustrated. The image processing apparatus 1300 according to the present embodiment includes a CPU 1310, a GPU 1320, a RAM 1330, a ROM 1340, and an external storage device 1350. In addition, a liquid crystal display 1410 as a display device 1400 and a mouse 1510 and a keyboard 1520 as an input device 1500 are connected to the image processing apparatus 1300. In addition, the image processing apparatus 1300 is connected to an image server 1210 as a storage device 1200 such as a picture archiving and communication system (PACS). Therefore, image data can be stored in the image server 1210, or image data in the image server 1210 can be displayed on the liquid crystal display 1410.

[0049] Next, a configuration example of devices included in the system according to the present embodiment will be described. Figure 3 is a schematic block diagram of devices included in the system according to this embodiment.

[0050] The photoacoustic device 1100 according to the present embodiment includes a driving unit 130, a signal collecting unit 140, a computer 150, a probe 180, and an injection unit 190. The probe 180 includes a light irradiation unit 110 and a receiving unit 120. Figure 4 1 is a schematic diagram of a probe 180 according to the present embodiment. The measurement object is a subject 100 into which a contrast agent is injected by an injection unit 190. The driving unit 130 drives the light irradiation unit 110 and the receiving unit 120 to perform mechanical scanning. When the light irradiation unit 110 irradiates light to the subject 100, an acoustic wave is generated in the subject 100. The acoustic wave generated according to the photoacoustic effect caused by light is also called a photoacoustic wave. The receiving unit 120 outputs an electrical signal (photoacoustic signal) as an analog signal when receiving the photoacoustic wave.

[0051] The signal collection unit 140 converts the analog signal output from the receiving unit 120 into a digital signal, and outputs the digital signal to the computer 150. The computer 150 stores the digital signal output from the signal collection unit 140 as signal data derived from the photoacoustic wave.

[0052] The computer 150 generates a photoacoustic image by performing signal processing on the stored digital signal. In addition, the computer 150 performs image processing on the obtained photoacoustic image and then outputs the photoacoustic image to the display unit 160. The display unit 160 displays an image based on the photoacoustic image. The display image is stored in a memory in the computer 150 or a storage device 1200 such as a data management system connected to a modality through a network based on a storage instruction from a user or the computer 150.

[0053] In addition, the computer 150 also performs drive control of components included in the photoacoustic device. In addition, in addition to the image generated by the computer 150, the display unit 160 can also display a GUI or the like. The input unit 170 is configured so that the user can input information. The user can use the input unit 170 to perform operations such as indication of measurement start or end and storage of the generated image.

[0054] Hereinafter, each component of the photoacoustic apparatus 1100 according to the present embodiment will be described in detail.

[0055] (Light irradiation unit 110)

[0056] The light irradiation unit 110 includes a light source 111 that emits light and an optical system 112 that guides the light projected from the light source 111 to the object 100. In addition, the light includes pulse light such as so-called rectangular waves and triangular waves.

[0057] In consideration of the heat suppression condition and the stress suppression condition, it is preferred that the pulse width of the light emitted from the light source 111 is not greater than 100 ns. In addition, a wavelength in the range of approximately 400 nm to 1600 nm may be used as the wavelength of the light. When imaging blood vessels at high resolution, a wavelength (at least 400 nm and not greater than 700 nm) that is more absorbed in blood vessels may be used. When imaging the deep part of a living body, light of a wavelength (at least 700 nm and not greater than 1100 nm) that is generally less absorbed in the background tissue (water, fat, etc.) of the living body may be used.

[0058] A laser or a light emitting diode can be used as the light source 111. In addition, when a measurement is performed using light having multiple wavelengths, a light source capable of changing the wavelength can be used. In addition, in the case of irradiating a plurality of wavelengths to the object to be measured, a plurality of light sources that generate light having different wavelengths can be provided, and light can be irradiated alternately from each light source. In the case of using a plurality of light sources, these light sources are collectively represented as one light source. As a laser, various lasers such as solid lasers, gas lasers, dye lasers, and semiconductor lasers can be used. For example, a pulsed laser such as an Nd:YAG laser or an alexandrite laser can be used as a light source. In addition, a Ti:sa laser or an optical parametric oscillator (OPO) laser using an Nd:YAG laser as excitation light can be used as a light source. In addition, a flash lamp or a light emitting diode can be used as the light source 111. In addition, a microwave source can be used as the light source 111.

[0059] Optical elements such as lenses, mirrors, and optical fibers can be used for the optical system 112. In the case where a breast or the like is used as the object 100, the light projection part of the optical system can be configured as a diffuser or the like that diffuses light to expand the beam diameter of the pulsed light and irradiate the pulsed light. On the other hand, in a photoacoustic microscope, the light projection part of the optical system 112 can be configured as a lens or the like and focus the beam and irradiate to improve resolution.

[0060] Alternatively, the light irradiation unit 110 may not include the optical system 112 and may directly irradiate the object 100 with light from the light source 111 .

[0061] (Receiving unit 120)

[0062] The receiving unit 120 includes a transducer 121 that outputs an electrical signal when receiving an acoustic wave and a support 122 that supports the transducer 121. In addition, the transducer 121 may be a transmitting component that transmits an acoustic wave. The transducer as the receiving component and the transducer as the transmitting component may be a single (shared) transducer or separate components.

[0063] As components constituting the transducer 121, piezoelectric ceramic materials represented by lead zirconate titanate (PZT), polymer piezoelectric film materials represented by polyvinylidene fluoride (PVDF), and the like can be used. In addition, elements other than piezoelectric elements can be used. For example, a transducer utilizing a capacitive micromechanical ultrasonic transducer (CMUT) or the like can be used. In addition, any transducer can be used as long as it can output an electrical signal when receiving a sound wave. In addition, the signal acquired by the transducer is a time-resolved signal. That is, the amplitude of the signal acquired by the transducer represents a value based on the sound pressure received by the transducer at each moment (for example, a value proportional to the sound pressure).

[0064] The frequency components constituting the photoacoustic waves are generally 100 KHz to 100 MHz, and a transducer capable of detecting these frequencies may be employed as the transducer 121 .

[0065] The support member 122 can be formed of a metal material with high mechanical strength. Mirror finishing or processing for light scattering can be performed on the surface of the object 100 side of the support member 122, so that a large amount of irradiation light is input to the object. In the present embodiment, the support member 122 has a hemispherical shell shape and is configured to be able to support multiple transducers 121 on the hemispherical shell. In this case, the directional axes of the transducers 121 deployed in the support member 122 converge near the center of curvature of the hemisphere. Then, when imaging is performed using the signals output from the multiple transducers 121, the image quality near the center of curvature is improved. In addition, the support member 122 can adopt any configuration as long as it can support the transducer 121. The support member 122 can be configured so that multiple transducers are arranged side by side in a plane or curved surface called a 1D array, a 1.5D array, a 1.75D array or a 2D array. Multiple transducers 121 correspond to multiple receiving components.

[0066] In addition, the support member 122 may be used as a container for storing the acoustic matching material. That is, the support member 122 may be used as a container for disposing the acoustic matching material between the transducer 121 and the object 100.

[0067] In addition, the receiving unit 120 may include an amplifier that amplifies the time-series analog signal output from the transducer 121. In addition, the receiving unit 120 may include an A / D converter that converts the time-series analog signal output from the transducer 121 into a time-series digital signal. That is, the receiving unit 120 may include the signal collecting unit 140 described later.

[0068] The space between the receiving unit 120 and the object 100 is filled with a medium capable of propagating photoacoustic waves. As the medium, a material capable of propagating sound waves, matching the acoustic characteristics at the interface between the object 100 and the transducer 121, and having a photoacoustic wave transmittance as high as possible is used. For example, water, ultrasound gel, etc. can be used as the medium.

[0069] Figure 4 A side view of the probe 180 is shown. The probe 180 according to the present embodiment includes a receiving unit 120 in which a plurality of transducers 121 are three-dimensionally arranged in a hemispherical support 122 having an opening. In addition, a light projecting unit of the optical system 112 is disposed at the bottom of the support 122 .

[0070] In this embodiment, if Figure 4 As shown in FIG. 2 , when the object 100 is in contact with the holder 200 , the shape of the object 100 is maintained.

[0071] The space between the receiving unit 120 and the holder 200 is filled with a medium capable of propagating photoacoustic waves. As the medium, a material capable of propagating sound waves, matching the acoustic characteristics at the interface between the measured body 100 and the transducer 121, and having a photoacoustic wave transmittance as high as possible is used. For example, water, ultrasound gel, etc. can be used as the medium.

[0072] The holder 200 as a holding member is used to hold the shape of the object 100 during measurement. By holding the object 100 with the holder 200, the movement of the object 100 can be suppressed and the position of the object 100 can be held in the holder 200. As a material of the holder 200, a resin material such as polycarbonate, polyethylene, or polyethylene terephthalate can be used.

[0073] The holder 200 is attached to the mounting portion 201. The mounting portion 201 may be configured so that a plurality of types of holders 200 can be replaced according to the size of the measured object. For example, the mounting portion 201 may be configured so that holders having different curvature radii and different curvature centers can be replaced.

[0074] (Drive unit 130)

[0075] The driving unit 130 is a part that changes the relative position of the measured object 100 and the receiving unit 120. The driving unit 130 includes a motor such as a stepping motor that generates a driving force, a driving mechanism that transmits the driving force, and a position sensor that detects the position information of the receiving unit 120. As the driving mechanism, a lead screw mechanism, a connecting rod mechanism, a gear mechanism, a hydraulic mechanism, etc. can be used. In addition, as the position sensor, a potentiometer using an encoder, a variable resistor, a linear scale, a magnetic sensor, an infrared sensor, an ultrasonic sensor, etc. can be used.

[0076] In addition, the driving unit 130 is not limited to changing the relative position of the object 100 and the receiving unit 120 in the XY directions (two-dimensionally), but may change the relative position one-dimensionally or three-dimensionally.

[0077] In addition, the driving unit 130 can fix the receiving unit 120 and move the object 100 as long as it can change the relative position of the object 100 and the receiving unit 120. In the case of moving the object 100, it is conceivable to move the configuration of the object 100 by moving the holder holding the object 100. In addition, both the object 100 and the receiving unit 120 can be moved.

[0078] The drive unit 130 may move the relative position continuously or in a step-and-repeat manner. The drive unit 130 may be an electric stage or a manual stage that enables movement along a programmed trajectory.

[0079] Furthermore, although the driving unit 130 performs scanning by simultaneously driving the light irradiation unit 110 and the receiving unit 120 in the present embodiment, the driving unit 130 may drive only the light irradiation unit 110 or only the receiving unit 120 .

[0080] In addition, in the case where the probe 180 is a handheld type equipped with a grip portion, the photoacoustic apparatus 1100 may not include the driving unit 130 .

[0081] (Signal Collection Unit 140)

[0082] The signal collection unit 140 includes an amplifier that amplifies the electrical signal as an analog signal output from the transducer 121 and an A / D converter that converts the analog signal output from the amplifier into a digital signal. The digital signal output from the signal collection unit 140 is stored in the computer 150. The signal collection unit 140 is also referred to as a data acquisition system (DAS). The electrical signal in this specification is a concept that includes both analog signals and digital signals. In addition, a light detection sensor such as a photodiode can detect the light projection from the light irradiation unit 110, and the signal collection unit 140 can start the above-mentioned processing by synchronizing the detection result with a trigger.

[0083] (Computer 150)

[0084] The computer 150 as an information processing device is configured as hardware similar to the image processing device 1300. That is, the unit that performs the operation function of the computer 150 may be composed of a processor such as a CPU or a graphics processing unit (GPU) and an operation circuit such as a field programmable gate array (FPGA). These units may be composed not only of a single processor and a single operation circuit, but also of a plurality of processors and a plurality of operation circuits.

[0085] The unit that performs the storage function of the computer 150 may be a volatile medium such as a random access memory (RAM). In addition, the storage medium storing the program is a non-transitory storage medium. In addition, the unit that performs the storage function of the computer 150 may be configured not only as a single storage medium but also as a plurality of storage media.

[0086] The unit that performs the control function of the computer 150 is configured as an operation element such as a CPU. The unit that performs the control function of the computer 150 controls the operation of each component of the photoacoustic apparatus. The unit that performs the control function of the computer 150 can receive an instruction signal of various operations such as the start of measurement from the input unit 170 and control each component of the photoacoustic apparatus. In addition, the unit that performs the control function of the computer 150 can read a program code stored in the unit that performs a storage function and control the operation of each component of the photoacoustic apparatus. That is, the computer 150 can be used as a control device of the system according to the present embodiment.

[0087] In addition, the computer 150 and the image processing apparatus 1300 may be configured as the same hardware. A single hardware may perform the functions of both the computer 150 and the image processing apparatus 1300. That is, the computer 150 may perform the functions of the image processing apparatus 1300. In addition, the image processing apparatus 1300 may perform the functions of the computer 150 as an information processing apparatus.

[0088] (Display unit 160)

[0089] The display unit 160 is a display such as a liquid crystal display or an organic electroluminescent (EL) device. In addition, the display unit 160 may display a GUI for operating an image or a device.

[0090] In addition, the display unit 160 and the display device 1400 may be the same display. That is, a single display may perform the functions of both the display unit 160 and the display device 1400.

[0091] (Input unit 170)

[0092] As the input unit 170 , an operation console composed of a mouse, a keyboard, etc. that can be operated by a user may be adopted. In addition, the display unit 160 may be configured as a touch panel, and the display unit 160 may be used as the input unit 170 .

[0093] In addition, the input unit 170 and the input device 1500 may be the same device. That is, a single device may perform the functions of both the input unit 170 and the input device 1500.

[0094] (Injection unit 190)

[0095] The injection unit 190 is configured so that a contrast agent can be injected into the subject 100 from the outside of the subject 100. For example, the injection unit 190 may include a contrast agent container and an injection needle that is inserted into the subject. However, the injection unit 190 is not limited thereto and can be applicable to various types as long as they can inject the contrast agent into the subject 100. In this case, for example, the injection unit 190 can be a known injection system or a syringe. In addition, the computer 150 as a control device can inject the contrast agent into the subject 100 by controlling the operation of the injection unit 190. In addition, the user can inject the contrast agent into the subject 100 by operating the injection unit 190.

[0096] (Test object 100)

[0097] Although the object 100 does not constitute a system, it will be described below. The system according to the present embodiment can be used for the purpose of diagnosing malignant tumors, vascular diseases, etc. of humans or animals and observing the process of chemotherapy. Therefore, as the object 100, it is conceivable that the object part of the diagnosis is a living body, specifically the breast, various organs, vascular network, head, neck, abdomen, limbs including fingers or toes, etc. of the human body or animal. For example, if the human body is taken as the measurement object, oxygenated hemoglobin or deoxygenated hemoglobin, blood vessels containing a large amount of these substances, new blood vessels formed near the tumor, etc. can be used as the object of the light absorber. In addition, plaques of the carotid artery wall, etc. can be used as the object of the light absorber. In addition, melanin, collagen, lipids, etc. contained in the skin can be used as the object of the light absorber. In addition, the contrast agent injected into the object 100 can be used as a light absorber. As a contrast agent for photoacoustic imaging, dyes such as indocyanine green (ICG) or methylene blue (MB), gold particles, mixtures thereof, or substances introduced from the outside obtained by integrating or chemically modifying these materials can be used. Furthermore, a phantom that simulates a living body may be used as the subject 100 .

[0098] In addition, the components of the photoacoustic apparatus may be configured as separate apparatuses or as an integrated single apparatus. In addition, at least some components of the photoacoustic apparatus may be configured as an integrated single apparatus.

[0099] In addition, each device constituting the system according to the present embodiment may be configured as separate hardware, or all devices may be configured as a single hardware. The function of the system according to the present embodiment may be configured using any hardware.

[0100] Next, we will use Figure 5 The image generation method according to this embodiment is described by the flowchart shown in Figure 5The flowchart shown in includes a process representing the operation of the system according to the present embodiment and a process representing the operation of a user such as a doctor.

[0101] (S100: Process of obtaining checklist information)

[0102] The computer 150 of the photoacoustic apparatus 1100 acquires examination order information transmitted from an in-hospital information system such as a hospital information system (HIS) or a radiology information system (RIS). The examination order information includes information such as the modality type used for the examination and the contrast agent used for the examination.

[0103] (S200: Process of acquiring information about contrast medium based on user's instruction or examination order information)

[0104] The computer 150 as a contrast agent information acquisition component acquires information about the contrast agent. The user can use the input unit 170 to indicate the type and concentration of the contrast agent used for the inspection. In this case, the computer 150 can acquire information about the contrast agent through the input unit 170. In addition, in the case where the inspection order information acquired in S100 includes information about the contrast agent, the computer 150 can acquire information about the contrast agent by reading the information about the contrast agent from the inspection order information. The computer 150 can acquire information about the contrast agent based on at least one of the user's instructions and the inspection order information. For example, as information about the contrast agent representing the condition of the contrast agent, the type of the contrast agent, the concentration of the contrast agent, etc. can be thought of.

[0105] Fig.10 An example of a GUI displayed on the display unit 160 is illustrated. Item 2500 of the GUI displays examination order information such as a patient ID, an examination ID, and an imaging date and time. Item 2500 may include a display function for displaying the examination order information acquired from an external device such as a HIS or RIS and an input function for enabling a user to input the examination order information using the input unit 170. Item 2600 of the GUI displays information about a contrast agent such as a type of contrast agent and a concentration of the contrast agent. Item 2600 may include a display function for displaying the information about a contrast agent acquired from an external device such as a HIS or RIS and an input function for enabling a user to input the information about the contrast agent using the input unit 170. In item 2600, information about a contrast agent such as a type and concentration of a contrast agent may be input from a plurality of selections by a method such as a pull-down list. In addition, a list of items may be displayed on the display device 1400. Fig.10The GUI shown in .

[0106] In addition, in the case where the image processing device 1300 has not received an input instruction of information about the contrast agent from the user, the information about the contrast agent set as the default value can be obtained from multiple pieces of information about the contrast agent. In the case of the present embodiment, a case where ICG is set as the default contrast agent type and 1.0 mg / mL is set as the default contrast agent concentration is described. Although the type and concentration of the contrast agent set as the default value are displayed in item 2600 of the GUI in the present embodiment, the information about the contrast agent may not be set as the default value. In this case, the information about the contrast agent may not be displayed in item 2600 of the GUI on the initial screen.

[0107] (S300: Process of injecting contrast agent)

[0108] The injection unit 190 injects the contrast agent into the subject. When the user injects the contrast agent into the subject using the injection unit 190, the user can send a signal indicating that the contrast agent has been injected from the input unit 170 to the computer 150 as a control device by operating the input unit 170. In addition, the injection unit 190 can send a signal indicating that the contrast agent has been injected into the subject 100 to the computer 150. In addition, the contrast agent can be injected into the subject without using the injection unit 190. For example, the contrast agent can be injected into the living body in a manner that the living body as the subject inhales the sprayed contrast agent.

[0109] After the contrast agent is injected, S400 described later may be performed after the time when the contrast agent is diffused to the contrast object in the subject 100 .

[0110] (S400: Process of determining wavelength of irradiation light)

[0111] The computer 150 as the wavelength determination means determines the wavelength of the irradiation light based on the information about the contrast agent acquired in S200. In the present embodiment, the computer 150 determines a plurality of wavelengths based on the information about the contrast agent to generate a spectral image. Hereinafter, a combination of wavelengths for easily identifying an area corresponding to the contrast agent in the spectral image will be described.

[0112] In the present embodiment, it is assumed that an image according to formula (1) is generated as a spectral image in S800 described later. According to formula (1), for the region of the blood vessel in the spectral image, an image value in response to the actual oxygen saturation is calculated. However, for the region of the contrast agent in the spectral image, the image value changes significantly depending on the wavelength used. In addition, for the region of the contrast agent in the spectral image, the image value also changes significantly depending on the absorption coefficient spectrum of the contrast agent. Therefore, there is a case where the image value of the region of the contrast agent in the spectral image becomes a value that cannot be distinguished from the image value of the region of the blood vessel. In addition, in order to ascertain the three-dimensional distribution of the contrast agent, it is preferred that the image value of the region of the contrast agent in the spectral image is a value that can be distinguished from the image value of the region of the blood vessel.

[0113] Therefore, the inventors have conceived a method of adaptively changing the wavelength of the irradiation light according to the condition of the contrast agent used for examination, thereby controlling the image value of the area of ​​the contrast agent in the spectral image. That is, the inventors have designed a method in which the information processing device determines the wavelength of the irradiation light that enables the area of ​​the contrast agent in the spectral image to be distinguished from the area of ​​the blood vessel based on the information about the contrast agent.

[0114] Specifically, in the case of generating an image using formula (1) as a spectral image, the wavelength of the irradiation light can be determined using the fact that the oxygen saturation of the artery and vein falls within the range of about 60% to 100% expressed as a percentage. That is, the computer 150 as an information processing device can determine two wavelengths that make the value of formula (1) corresponding to the contrast agent in the spectral image less than 60% or greater than 100% based on the information about the contrast agent. In addition, the computer 150 can determine two wavelengths that make the sign of the image value of the area corresponding to the contrast agent in the spectral image opposite to the sign of the image value of other areas based on the information about the contrast agent.

[0115] Next, a description will be given of a change in an image value corresponding to a contrast agent when the concentration of the contrast agent, which is information on the contrast agent, has changed. Figure 6 is a spectrogram illustrating changes in the absorption coefficient spectrum when the concentration of ICG as a contrast agent has been changed. Figure 6 The spectra of ICG at concentrations of 5.04 μg / mL, 50.4 μg / mL, 0.5 mg / mL, and 1.0 mg / mL are shown in order from the bottom. Figure 6As shown in , it can be understood that as the concentration of the contrast agent increases, the degree of absorption of light increases. In addition, it can be understood that since the ratio of the absorption coefficients corresponding to the two wavelengths changes in response to the concentration of the contrast agent, the image value corresponding to the contrast agent in the spectral image changes in response to the concentration of the contrast agent. As is the case when the concentration of the contrast agent has changed, when the type of the contrast agent has changed, the ratio of the absorption coefficients corresponding to the two wavelengths also changes. Therefore, it can be understood that the image value corresponding to the contrast agent in the spectral image also changes in response to the type of the contrast agent.

[0116] Here, a spectral image obtained by imaging a living body into which ICG has been injected using a photoacoustic apparatus will be described. Fig.11 A to Fig.13 B illustrates a spectral image obtained by imaging when ICG is injected while changing the concentration. In all imaging operations, 0.1 mL of ICG was injected under the skin or into the skin of the hand or foot. The ICG injected under the skin or into the skin selectively enters the lymphatic vessels, thereby imaging the lumen of the lymphatic vessels. In addition, in all imaging operations, imaging was performed within 5 minutes to 60 minutes from the injection of ICG. In addition, all spectral images are spectral images generated from photoacoustic images obtained by irradiating a living body with light having a wavelength of 797 nm and light having a wavelength of 835 nm.

[0117] Fig.11 A shows the spectral image of the right forearm extensor side before ICG injection. Fig.11 Figure B shows the spectral image of the right forearm extensor side when ICG was injected at a concentration of 2.5 mg / mL. Fig.11 Lymphatic vessels are depicted in the area indicated by dotted lines and arrows in B.

[0118] Fig.12 A shows the spectral image of the extensor side of the left forearm when ICG was injected at a concentration of 1.0 mg / mL. Fig.12 Figure B shows the spectral image of the left forearm extensor side when ICG was injected at a concentration of 5.0 mg / mL. Fig.12 Lymphatic vessels are depicted in the area indicated by dotted lines and arrows in B.

[0119] Fig.13 A shows a spectral image of the inner side of the right calf when ICG was injected at a concentration of 0.5 mg / mL. Fig.13 Figure B shows the spectral image of the inner side of the left calf when ICG was injected at a concentration of 5.0 mg / mL. Fig.13 Lymphatic vessels are depicted in the area indicated by dotted lines and arrows in B.

[0120] according to Fig.11 A to Fig.13From the spectral image shown in B, it can be understood that the visibility of lymphatic vessels in the spectral image improves with the increase of ICG concentration. Fig.11 A to Fig.13 B, it can be understood that when the concentration of ICG is at least 2.5 mg / mL, the lymphatic vessels can be satisfactorily depicted. That is, when the concentration of ICG is at least 2.5 mg / mL, the lymphatic vessels on the line can be visually clearly identified. Therefore, when ICG is used as a contrast agent, its concentration can be at least 2.5 mg / mL. In addition, considering the dilution of ICG in vivo, the concentration of ICG can be greater than 5.0 mg / mL. However, when considering the solubility of indocyanine green injection (Diagnogreen), it is difficult to melt it in an aqueous solution at a concentration of at least 10.0 mg / mL.

[0121] As described above, the concentration of ICG injected into the living body may be at least 2.5 mg / mL and not more than 10.0 mg / mL, and preferably at least 5.0 mg / mL and not more than 10.0 mg / mL.

[0122] Therefore, the computer 150 may be configured to Fig.10 In item 2600 of the GUI shown in , in the case where ICG is input as the contrast agent type, an indication from the user indicating an ICG concentration within the above-mentioned numerical range is selectively received. That is, in this case, the computer 150 can be configured so that it does not receive an indication from the user indicating that the ICG concentration is not within the above-mentioned numerical range. Therefore, the computer 150 can be configured so that, in the case where information indicating that the contrast agent type is ICG is obtained, an indication from the user indicating that the ICG concentration is less than 2.5 mg / mL or greater than 10.0 mg / mL is not received. In addition, the computer 150 can be configured so that, in the case where information indicating that the contrast agent type is ICG is obtained, an indication from the user indicating that the ICG concentration is less than 5.0 mg / mL or greater than 10.0 mg / mL is not received.

[0123] The computer 150 may configure the GUI so that the user cannot indicate an ICG concentration that does not fall within the above-mentioned numerical range on the GUI. That is, the computer 150 may display the GUI so that the user cannot indicate an ICG concentration that does not fall within the above-mentioned numerical range on the GUI. For example, the computer 150 may display a drop-down list through which the ICG concentration within the above-mentioned numerical range can be selectively indicated on the GUI. The computer 150 may configure the GUI so that the ICG concentration within the above-mentioned numerical range that does not fall within the drop-down list is displayed in gray and the gray concentration cannot be selected.

[0124] Furthermore, when the user has indicated an ICG concentration that does not fall within the above numerical range on the GUI, the computer 150 may notify an alarm. As a notification method, any method such as display of an alarm on the display unit 160, sound, and lighting of a lamp may be employed.

[0125] Furthermore, when ICG has been selected as the contrast medium type on the GUI, the computer 150 may cause the display unit 160 to display the above-mentioned numerical range as the concentration of ICG to be injected into the subject.

[0126] In addition, the concentration of the contrast agent injected into the subject is not limited to the numerical range indicated here, and an appropriate concentration that meets the purpose can be used. In addition, although an example of the case where the contrast agent type is ICG has been described here, the above configuration can be applied to other contrast agents in the same manner.

[0127] By configuring the GUI in this manner, it is possible to support the user in injecting a contrast medium of an appropriate concentration into the subject according to the type of contrast medium expected to be injected into the subject.

[0128] Next, changes in image values ​​corresponding to the contrast agent in the spectral image when the combination of wavelengths has been changed will be described. Figure 7 A to Figure 7 D illustrates the simulation result of the image value (oxygen saturation value) corresponding to the contrast agent in the spectral image in the combination of two wavelengths. Figure 7 A to Figure 7 The vertical axis and horizontal axis of D represent the first wavelength and the second wavelength. Figure 7 A to Figure 7 D illustrates contour lines of image values ​​corresponding to the contrast agent in the spectral image. Figure 7 A to 7D illustrate the image values ​​corresponding to the contrast agent in the spectral images when the ICG concentration is 5.04 μg / mL, 50.4 μg / mL, 0.5 mg / mL, and 1.0 mg / mL, respectively. Figure 7 A to Figure 7 As shown in D, there is a case where the image value corresponding to the contrast agent in the spectral image becomes 60% to 100% depending on the selected wavelength combination. As described above, when such a wavelength combination is selected, it is difficult to distinguish the area of ​​the blood vessel and the area of ​​the contrast agent in the spectral image. Therefore, it is preferable to select the image value corresponding to the contrast agent in the spectral image from the image value corresponding to the contrast agent. Figure 7 A to Figure 7 Among the wavelength combinations shown in D, a wavelength combination is selected so that the image value corresponding to the contrast agent in the spectral image becomes less than 60% or greater than 100%. In addition, it is preferred to select Figure 7 A to Figure 7 Among the wavelength combinations shown in D, a wavelength combination is selected that makes the image value corresponding to the contrast agent in the spectral image a negative value.

[0129] For example, a case where 797 nm is selected as the first wavelength and 835 nm is selected as the second wavelength can be envisaged here. Figure 8 : is a graph showing the relationship between the ICG concentration and the image value (the value of formula (1)) corresponding to the contrast agent in the spectral image when 797 nm is selected as the first wavelength and 835 nm is selected as the second wavelength. Figure 8 , when 797 nm is selected as the first wavelength and 835 nm is selected as the second wavelength, the image value corresponding to the contrast agent in the spectral image is a negative value for any concentration in the range of 5.04 μg / mL to 1.0 mg / mL. Therefore, when a spectral image is generated according to such a wavelength combination, the blood vessel area can be clearly distinguished from the contrast agent area because the oxygen saturation of the blood vessel is not a negative value in principle.

[0130] In addition, although it has been described that the wavelength is determined based on the information on the contrast agent, the absorption coefficient of hemoglobin may be considered in determining the wavelength. Fig. 9 The spectra of the molar absorption coefficient of oxygenated hemoglobin (dotted line) and the molar absorption coefficient of deoxygenated hemoglobin (solid line) are shown. Fig. 9 In the wavelength range shown in , the magnitude relationship between the molar absorption coefficient of oxyhemoglobin and the molar absorption coefficient of deoxyhemoglobin is reversed at 797nm. That is, it can be said that veins are easily identified at wavelengths shorter than 797nm, while arteries are easily identified at wavelengths longer than 797nm. However, in the treatment of lymphedema, lymphatico-venous anastomosis (lymphatico-venous anastomosis) that creates a bypass between lymphatic vessels and veins is used. For its preoperative examination, it is conceivable to use photoacoustic imaging to image both veins and lymphatic vessels that have accumulated contrast agents. In this case, the veins can be imaged more clearly by setting at least one of the multiple wavelengths to a wavelength shorter than 797nm. In addition, setting at least one of the multiple wavelengths to a wavelength at which the molar absorption coefficient of deoxyhemoglobin becomes greater than the molar absorption coefficient of oxyhemoglobin is beneficial for imaging of veins. Furthermore, in the case of generating a spectral image from photoacoustic images corresponding to two wavelengths, setting both wavelengths to wavelengths at which the molar absorption coefficient of deoxyhemoglobin becomes greater than the molar absorption coefficient of oxyhemoglobin is advantageous for imaging of veins. By selecting these wavelengths, both lymphatic vessels and veins injected with contrast agents can be imaged with high accuracy in preoperative examination of lymphovenous anastomosis.

[0131] However, if all of the multiple wavelengths are wavelengths where the absorption coefficient of the contrast agent is greater than the absorption coefficient of the blood, the accuracy of the oxygen saturation of the blood is reduced due to artifacts derived from the contrast agent. Therefore, in order to reduce artifacts derived from the contrast agent, at least one of the multiple wavelengths may be a wavelength where the absorption coefficient of the contrast agent is less than the absorption coefficient of the blood.

[0132] Here, although the case of generating a spectral image according to formula (1) has been described, the present invention can also be applied to the case of generating a spectral image in which the image values ​​corresponding to the contrast agent in the spectral image change in response to the conditions of the contrast agent or the wavelength of the irradiated light.

[0133] (S500: Light irradiation process)

[0134] The light irradiation unit 110 sets the wavelength determined in S400 in the light source 111. The light source 111 emits light having the wavelength determined in S400. The light generated from the light source 111 is irradiated to the subject 100 as pulse light through the optical system 112. Then, the pulse light is absorbed in the subject 100 to generate photoacoustic waves according to the photoacoustic effect. Here, the injected contrast agent also absorbs the pulse light to generate photoacoustic waves. In addition to the transmission of the pulse light, the light irradiation unit 110 can also send a synchronization signal to the signal collection unit 140. In addition, the light irradiation unit 110 performs irradiation of light in the same manner for multiple wavelengths.

[0135] The user can use the input unit 170 to specify control parameters such as the irradiation conditions of the light irradiation unit 110 (repetition frequency, wavelength, etc. of the irradiation light) and the position of the probe 180. The computer 150 can set the control parameters determined based on the user's instructions. In addition, the computer 150 can control the drive unit 130 based on the specified control parameters to move the probe 180 to the specified position. In the case of imaging at multiple positions, the drive unit 130 first moves the probe 180 to the initial specified position. In addition, the drive unit 130 can move the probe 180 to a pre-programmed position when the measurement start instruction is given.

[0136] (S600: Process of receiving photoacoustic waves)

[0137] When receiving the synchronization signal transmitted from the light irradiation unit 110, the signal collection unit 140 starts the signal collection operation. That is, the signal collection unit 140 generates an amplified digital electric signal by performing amplification and AD conversion on the analog electric signal derived from the photoacoustic wave output from the receiving unit 120, and outputs the amplified digital electric signal to the computer 150. The computer 150 stores the signal transmitted from the signal collection unit 140. In the case where imaging at a plurality of scanning positions is specified, the processes of S500 and S600 are repeatedly performed at the specified scanning positions to repeat the irradiation of the pulsed light and the generation of the digital signal derived from the acoustic wave. In addition, the computer 150 can use the emission of light as a trigger to acquire the position information of the receiving unit 120 at the time of the emission of light based on the output of the position sensor from the driving unit 130, and store the position information.

[0138] In addition, although an example of irradiating light having multiple wavelengths in a time-division manner has been described in this embodiment, the method of irradiating light is not limited to this, as long as signal data corresponding to multiple wavelengths can be acquired. For example, in the case of performing encoding using irradiation of light, there may be a timing of irradiating light having multiple wavelengths almost simultaneously.

[0139] (S700: Process of Generating Photoacoustic Image)

[0140] The computer 150 as the photoacoustic image acquisition means generates a photoacoustic image based on the stored signal data. The computer 150 outputs the generated photoacoustic image to the storage device 1200 so that the photoacoustic image is stored therein.

[0141] As a reconstruction algorithm for converting signal data into a two-dimensional or three-dimensional spatial distribution, an analytical reconstruction method such as a back-projection method in the time domain and a back-projection method in the Fourier domain or a model-based method (repeated calculation method) can be adopted. For example, as a back-projection method in the time domain, universal back-projection (UBP), filtered back-projection (FBP), delay-and-sum, etc. can be conceived.

[0142] The computer 150 generates initial sound pressure distribution information (generated sound pressure at multiple positions) as a photoacoustic image by performing reconstruction processing on the signal data. In addition, the computer 150 can obtain absorption coefficient distribution information as a photoacoustic image by calculating the light integral flux distribution in the object 100 of the light irradiated to the object 100 and dividing the initial sound pressure distribution by the light integral flux distribution. A known method can be used as a calculation method of the light integral flux distribution. In addition, the computer 150 can generate photoacoustic images corresponding to each light having a plurality of wavelengths. Specifically, the computer 150 can perform reconstruction processing on the signal data obtained by irradiation with light having a first wavelength, thereby generating a first photoacoustic image corresponding to the first wavelength. In addition, the computer 150 can perform reconstruction processing on the signal data obtained by irradiation with light having a second wavelength, thereby generating a second photoacoustic image corresponding to the second wavelength. In this way, the computer 150 can generate a plurality of photoacoustic images corresponding to light having a plurality of wavelengths.

[0143] In this embodiment, the computer 150 acquires absorption coefficient distribution information corresponding to light having multiple wavelengths as a photoacoustic image. Assume that the absorption coefficient distribution information corresponding to the first wavelength is the first photoacoustic image, and the absorption coefficient distribution information corresponding to the second wavelength is the second photoacoustic image.

[0144] In addition, although an example has been described in the present embodiment in which the system includes the photoacoustic device 1100 that generates a photoacoustic image, the present invention can also be applied to a system that does not include the photoacoustic device 1100. The present invention can be applied to any system as long as the image processing device 1300 as the photoacoustic image acquisition unit can acquire a photoacoustic image. For example, the present invention can also be applied to a system that includes the storage device 1200 and the image processing device 1300 but does not include the photoacoustic device 1100. In this case, the image processing device 1300 as the photoacoustic image acquisition unit can read a specified photoacoustic image from the photoacoustic image group pre-stored in the storage device 1200 to acquire the photoacoustic image.

[0145] (S800: Process of generating a spectral image)

[0146] The computer 150 as a spectral image acquisition component generates a spectral image based on a plurality of photoacoustic images corresponding to a plurality of wavelengths. The computer 150 outputs the spectral image to the storage device 1200 and causes the storage device 1200 to store the spectral image. As described above, the computer 150 can generate an image representing information corresponding to the concentration of a substance constituting the object (such as glucose concentration, collagen concentration, melanin concentration, and volume fraction of fat or water) as a spectral image. In addition, the computer 150 can generate an image representing the ratio of a first photoacoustic image corresponding to a first wavelength and a second photoacoustic image corresponding to a second wavelength as a spectral image. In this embodiment, an example is described in which the computer 150 generates an oxygen saturation image as a spectral image according to formula (1) using the first photoacoustic image and the second photoacoustic image.

[0147] In addition, the image processing device 1300 as the spectral image acquisition unit can acquire a spectral image by reading a designated spectral image from the spectral image group pre-stored in the storage device 1200. In addition, the image processing device 1300 as the photoacoustic image acquisition unit can acquire a photoacoustic image by reading at least one of a plurality of photoacoustic images used to generate the read spectral image from the photoacoustic image group pre-stored in the storage device 1200.

[0148] (S900: Process of acquiring information about contrast agent based on photoacoustic image or spectral image)

[0149] The image processing device 1300 as contrast agent information acquisition means reads the photoacoustic image or the spectral image from the storage device 1200 , and acquires information on the contrast agent based on the photoacoustic image or the spectral image.

[0150] The information about the contrast agent acquired in S200 may not correspond to the condition of the contrast agent that has actually been injected into the subject 100 and has diffused into the subject 100. Therefore, the image processing device 1300 may perform image processing on the photoacoustic image or the spectral image and calculate the information about the contrast agent from the photoacoustic image or the spectral image. Therefore, the information about the contrast agent that has diffused into the subject 100 can be acquired from the image obtained by capturing the subject 100 in a state where the contrast agent has been injected into the subject 100.

[0151] An example of estimating the contrast agent concentration based on image processing performed on a photoacoustic image in a case where an absorption coefficient distribution image is used as a photoacoustic image and an image having a value of formula (1) is used as a spectral image will be described. First, a user indicates a position in a photoacoustic image or a spectral image where the user wants to obtain a contrast agent concentration. The image processing device 1300 acquires an image value of the photoacoustic image at the designated position. In addition, the image processing device 1300 refers to Figure 6The absorption coefficient spectrum shown in is used to obtain the absorption coefficient of each concentration of the contrast agent corresponding to the wavelength of the irradiated light. Here, the image processing device 1300 can determine the type of contrast agent for which the absorption coefficient is to be obtained based on the information about the type of contrast agent obtained in S200. Then, the image processing device 1300 compares the absorption coefficient of the contrast agent of each concentration with the image value of the photoacoustic image, and obtains the contrast agent concentration with a smaller difference compared with the image value as the information about the contrast agent. In addition, the image processing device 1300 can calculate the concentration when the norm (norm) of the difference between the absorption coefficient of the contrast agent and the image value of the photoacoustic image is less than a predetermined value according to the least squares method as the information about the contrast agent.

[0152] In addition, an example of estimating the contrast agent concentration according to image processing performed on the spectral image will be described. The image processing device 1300 acquires the image value of the spectral image at the specified position. In addition, the image processing device 1300 refers to Figure 6 The absorption coefficient spectrum shown in is used to obtain the absorption coefficient of each concentration of the contrast agent corresponding to the two wavelengths of the irradiated light. In addition, the image processing device 1300 calculates the value corresponding to each concentration according to formula (1) based on the absorption coefficient corresponding to each concentration. Then, the image processing device 1300 compares the value of formula (1) corresponding to each concentration with the image value of the spectral image, and obtains the contrast agent concentration with a smaller difference compared to the image value as information about the contrast agent. In addition, the image processing device 1300 can calculate the concentration when the norm of the difference between the calculated value of formula (1) and the image value of the spectral image is less than a predetermined value according to the least squares method as information about the contrast agent.

[0153] In addition, the computer 150 can read the information about the contrast agent stored as supplementary information associated with the photoacoustic image or the spectral image to obtain the information about the contrast agent. For example, the computer 150 can read the information about the contrast agent stored in the tag of the photoacoustic image or the spectral image as a DICOM image to read the information about the contrast agent. According to this aspect, even when there is no measurement accompanied by photoacoustic waves, the image processing device 1300 can read the image from the storage device 1200 such as PACS and perform the setting of the image display and the setting of the wavelength depending on the condition of the contrast agent associated with the image.

[0154] In addition, the image processing device 1300 can read the contrast agent type from the supplementary information associated with the image and calculate the contrast agent concentration by image processing of the image. In this way, the image processing device 1300 can obtain multiple pieces of information about the contrast agent by a combination of different methods.

[0155] (S1000: Process of determining whether to reset the wavelength)

[0156] The image processing apparatus 1300 determines whether to reset the wavelength. If the image processing apparatus 1300 determines to reset the wavelength, the process returns to S400, and if the image processing apparatus 1300 determines not to reset the wavelength, the process proceeds to S1100.

[0157] For example, in the case of receiving an instruction to reset the wavelength from the user, the image processing device 1300 determines to reset the wavelength. Here, the image processing device 1300 may cause the display device 1400 to display the information about the contrast agent acquired in S900. Then, the user may confirm the information displayed on the display device 1400, and when determining that the wavelength needs to be reset, use the input device 1500 to instruct the resetting of the wavelength. In the case of receiving an instruction to reset the wavelength through the input device 1500, the image processing device 1300 may determine to perform the resetting of the wavelength, and cause the computer 150 to perform the resetting of the wavelength. In addition, the user may instruct the wavelength of the irradiation light itself as an instruction to reset the wavelength.

[0158] Furthermore, the image processing apparatus 1300 may compare the information on the contrast agent acquired in S200 with the information on the contrast agent acquired in S900 , and determine to reset the wavelength if there is a difference between these information.

[0159] In addition, the image processing device 1300 may compare the information about the contrast agent acquired in S200 with the information about the contrast agent acquired in S900, and if there is a difference between these information, cause the display device 1400 to display this fact. In addition, the image processing device 1300 may cause the information about the contrast agent with the difference to be displayed. The user may confirm the information displayed on the display device 1400, and instruct the resetting of the wavelength using the input device 1500 when determining that the wavelength needs to be reset. That is, the image processing device 1300 may cause the display device 1400 to display information based on the information about the contrast agent acquired in S900.

[0160] On the other hand, in the case where the image processing device 1300 does not determine to reset the wavelength, the process proceeds to S1100. For example, in the case where an instruction to reset the wavelength has not been received from the user within a certain time, the image processing device 1300 may determine not to perform the resetting of the wavelength. In addition, in the case where an instruction indicating that the resetting of the wavelength is not performed is received from the user, the image processing device 1300 may determine not to perform the resetting of the wavelength. In addition, in the case where there is no difference between the information about the contrast agent acquired in S200 and the information about the contrast agent acquired in S900, the image processing device 1300 may determine not to perform the resetting of the wavelength. In the case where at least one of these conditions has been received, the image processing device 1300 may determine not to perform the resetting of the wavelength.

[0161] (S1100: Process of displaying spectrum image)

[0162] The image processing device 1300 as a display control unit causes the display device 1400 to display a spectral image based on the information about the contrast agent acquired in S200 or S900, so that the area corresponding to the contrast agent and other areas can be distinguished. In addition, as a rendering method, any method such as maximum intensity projection (MIP), volume rendering, and surface rendering can be adopted. Here, setting conditions such as the display area and the line of sight direction when rendering a three-dimensional image in two dimensions can be arbitrarily specified according to the observation object.

[0163] Here, the case where the wavelengths are set to 797 nm and 835 nm in S400 and a spectrum image is generated according to formula (1) in S800 will be described. Figure 8 As shown in , when these two wavelengths are selected, at any ICG concentration, the image values ​​corresponding to the contrast agent in the spectral image generated according to formula (1) are negative values.

[0164] like Fig.10As shown in , the image processing device 1300 displays a color bar 2400 as a color scale on the GUI, which indicates the relationship between the image value of the spectral image and the display color. The image processing device 1300 can determine the numerical range of the image value assigned to the color scale based on information about the contrast agent (for example, information indicating that the contrast agent type is ICG) and information indicating the wavelength of the irradiated light. For example, the image processing device 1300 can determine the numerical range of the image value including the oxygen saturation of the artery according to formula (1), the oxygen saturation of the vein, and the negative value corresponding to the contrast agent. The image processing device 1300 can determine the numerical range of -100% to 100%, and set the color bar 2400 that assigns -100% to 100% to the color gradation that changes from blue to red. According to this display method, arteries and veins can be identified and also the area with negative values ​​corresponding to the contrast agent can be identified. In addition, the image processing device 1300 can display an indicator 2410 indicating the numerical range of the image value corresponding to the contrast agent based on the information about the contrast agent and the information indicating the wavelength of the irradiation light. Here, in the color bar 2400, the indicator 2410 is used to indicate a region having negative values ​​as the numerical range of the image value corresponding to ICG. By displaying the colorimetric scale in this manner so that the display color corresponding to the contrast agent can be identified, the region corresponding to the contrast agent in the spectral image can be easily identified.

[0165] The image processing device 1300 as a region determination component can determine the region corresponding to the contrast agent in the spectral image based on the information about the contrast agent and the information indicating the wavelength of the irradiated light. For example, the image processing device 1300 can determine the region with negative image values ​​in the spectral image as the region corresponding to the contrast agent. Then, the image processing device 1300 can cause the display device 1400 to display the spectral image so that the region corresponding to the contrast agent and other regions can be distinguished. The image processing device 1300 can adopt an identification representation, such as making the display color of the region corresponding to the contrast agent different from the display color of other regions, making the region corresponding to the contrast agent flash, or displaying an indicator (e.g., a box) indicating the region corresponding to the contrast agent.

[0166] In addition, you can indicate Fig.10, to switch to a display mode that selectively displays image values ​​corresponding to ICG. For example, in a case where a user selects item 2730 corresponding to the display of ICG, the image processing device 1300 may selectively display an area of ​​ICG by selecting voxels having negative image values ​​from the spectral image and selectively rendering the selected voxels. Similarly, a user may select item 2710 corresponding to the display of arteries or item 2720 corresponding to the display of veins. The image processing device 1300 may switch to a display mode that selectively displays image values ​​corresponding to arteries (e.g., at least 90% and not more than 100%) or image values ​​corresponding to veins (e.g., at least 60% and not more than 90%) based on the user's instructions. The numerical ranges of the image values ​​corresponding to arteries and the image values ​​corresponding to veins may be changed based on the user's instructions.

[0167] In addition, an image obtained by assigning at least one of hue, brightness, and chromaticity to the image value of the spectral image and assigning the remaining parameters of hue, brightness, and chromaticity to the image value of the photoacoustic image may be displayed as a spectral image. For example, an image obtained by assigning hue and chromaticity to the image value of the spectral image and assigning brightness to the image value of the photoacoustic image may be displayed as a spectral image. Here, when the image value of the photoacoustic image corresponding to the contrast agent is greater than or less than the image value of the photoacoustic image corresponding to the blood vessel, there is a case where it is difficult to visually identify both the blood vessel and the contrast agent when the brightness is assigned to the image value of the photoacoustic image. Therefore, a conversion table for converting from the image value of the photoacoustic image to the brightness may be changed in response to the image value of the spectral image. For example, in the case where the image value of the spectral image is included in the numerical range of the image value corresponding to the contrast agent, the brightness corresponding to the image value of the photoacoustic image may be reduced to be less than the brightness corresponding to the blood vessel. That is, if the image value of the photoacoustic image is the same when the region of the contrast agent is compared with the region of the blood vessel, the brightness of the region of the contrast agent may be reduced to be less than the brightness of the region of the blood vessel. Here, the conversion table is a table indicating brightness corresponding to a plurality of image values. In addition, in the case where the image value of the spectral image is included in the numerical range of the image value corresponding to the contrast agent, the brightness corresponding to the image value of the photoacoustic image may be increased to be greater than the brightness corresponding to the blood vessel. That is, if the image value of the photoacoustic image is the same when the region of the contrast agent is compared with the region of the blood vessel, the brightness of the region of the contrast agent may be increased to be greater than the brightness of the region of the blood vessel. In addition, the numerical range of the image value of the photoacoustic image, which does not convert the image value of the photoacoustic image into brightness, may vary according to the image value of the spectral image.

[0168] The conversion table can be changed to an appropriate table according to the type and concentration of the contrast agent or the wavelength of the irradiation light. Therefore, the image processing device 1300 can determine a conversion table for converting from the image value of the photoacoustic image to the brightness based on the information about the contrast agent and the information indicating the wavelength of the irradiation light. In the case where it is estimated that the image value of the photoacoustic image corresponding to the contrast agent is greater than the image value of the photoacoustic image corresponding to the blood vessel, the image processing device 1300 can reduce the brightness of the image value of the photoacoustic image corresponding to the contrast agent to be less than the brightness of the image value of the photoacoustic image corresponding to the blood vessel. On the other hand, in the case where it is estimated that the image value of the photoacoustic image corresponding to the contrast agent is less than the image value of the photoacoustic image corresponding to the blood vessel, the image processing device 1300 can increase the brightness of the image value of the photoacoustic image corresponding to the contrast agent to be greater than the brightness of the image value of the photoacoustic image corresponding to the blood vessel.

[0169] Fig.10 The GUI shown in shows an absorption coefficient image (first photoacoustic image) 2100 corresponding to a wavelength of 797 nm, an absorption coefficient image (second photoacoustic image) 2200 corresponding to a wavelength of 835 nm, and an oxygen saturation image (spectral image) 2300. The GUI can display the image according to which wavelength of light each image is generated. Although both the photoacoustic image and the spectral image are displayed in the present embodiment, only the spectral image may be displayed. In addition, the image processing device 1300 can switch between the display of the photoacoustic image and the display of the spectral image based on the user's instruction.

[0170] In addition, the display unit 160 can display a moving image. For example, the image processing device 1300 generates at least any one of the first photoacoustic image 2100, the second photoacoustic image 2200, and the spectral image 2300 in time series, generates moving image data based on the generated time series image, and outputs the moving image data to the display unit 160. In addition, in view of the relatively small number of times the lymph flows, it is preferred to display a still image or a time-compressed moving image to reduce the user's judgment time. In addition, in the display of the moving image, the lymph flow state can be repeatedly displayed. The moving image speed can be a predetermined speed defined in advance or a predetermined speed specified by the user.

[0171] Furthermore, in the display unit 160 capable of displaying a moving image, it is preferable that the frame rate of the moving image is variable. In order to set a variable frame rate, a window for the user to manually input a frame rate, a slide bar for changing the frame rate, etc. may be added to the display unit 160. Fig.10GUI. Here, since lymph flows intermittently in the lymphatic vessels, only a portion of the acquired time series volume data can be used to confirm the flow of lymph. Therefore, there is a situation where efficiency is reduced when performing real-time display when confirming the flow of lymph. Therefore, by setting a variable frame rate of the moving image displayed on the display unit 160, the moving image can be displayed in a fast-forward manner, and the user can confirm the state of the fluid in the lymphatic vessels in a short time.

[0172] In addition, the display unit 160 may repeatedly display the moving image within a predetermined time range. Fig.10 A GUI such as a window or a slide bar for enabling the user to designate a range in which repeated display is performed is added. Thus, the user can easily ascertain the state of the fluid flowing in the lymphatic vessels, for example.

[0173] As described above, at least one of the image processing device 1300 and the computer 150 as an information processing device is used as a device including at least one of a spectral image acquisition component, a contrast agent information acquisition component, a region determination component, a photoacoustic image acquisition component, and a display control component. In addition, each component may be configured as different hardware or a single hardware. In addition, a plurality of components may be configured as a single hardware.

[0174] Although in this embodiment, the contrast agent and the blood vessel can be distinguished by selecting a wavelength that makes the value corresponding to the contrast agent according to formula (1) a negative value, the image value corresponding to the contrast agent can be any value as long as the contrast agent and the blood vessel can be distinguished using the image value corresponding to the contrast agent. For example, in the case where the image value of the spectral image (oxygen saturation image) corresponding to the contrast agent is less than 60% or greater than 100%, the image processing described in this process can also be applied.

[0175] Although an example of a case where ICG is used as a contrast agent has been described in this embodiment, the image processing according to this embodiment can also be applied to any contrast agent other than ICG. In addition, the image processing device 1300 can perform image processing depending on the type of contrast agent based on information on the type of contrast agent injected into the subject 100 among multiple types of contrast agents.

[0176] In the present embodiment, a case where an image processing method is determined based on the acquired information about the contrast agent among the plurality of pieces of information about the contrast agent has been described. However, in the case where the condition of the contrast agent used for imaging has been uniquely determined, image processing corresponding to the condition of the contrast agent may be preset. In this case, the above-described image processing according to the present embodiment may also be applied.

[0177] Although an example of applying image processing to a spectral image based on a photoacoustic image corresponding to a plurality of wavelengths has been described in the present embodiment, the image processing according to the present embodiment may also be applied to a photoacoustic image corresponding to a single wavelength. That is, the image processing apparatus 1300 may determine a region corresponding to a contrast agent in a photoacoustic image based on information about the contrast agent, and display the photoacoustic image so that the region corresponding to the contrast agent and other regions can be distinguished. In addition, the image processing apparatus 1300 may display a spectral image or a photoacoustic image so that a region having a numerical range of image values ​​corresponding to a contrast agent set in advance can be distinguished from other regions.

[0178] Although an example in which the computer 150 as an information processing device irradiates light having a plurality of wavelengths to generate a spectral image is described in the present embodiment, in the case of irradiating only light having a single wavelength to generate a photoacoustic image, the wavelength can also be determined by the wavelength determination method according to the present invention. That is, the computer 150 can determine the wavelength of the irradiated light based on information about the contrast agent. In this case, it is preferable that the computer 150 determines a wavelength that enables the image value of the contrast agent region in the photoacoustic image to be distinguished from the image value of the blood vessel region.

[0179] In addition, the light irradiation unit 110 can irradiate the object 100 with light having a preset wavelength so that the image value of the contrast agent region in the photoacoustic image can be distinguished from the image value of the blood vessel region. In addition, the light irradiation unit 110 can irradiate the object 100 with light having a plurality of preset wavelengths so that the image value of the contrast agent region in the spectral image can be distinguished from the image value of the blood vessel region.

[0180] (Other embodiments)

[0181] In addition, the present invention is also implemented by executing the following processing. That is, the software (program) for implementing the functions of the above-mentioned embodiments is provided to a system or device through a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program.

[0182] The present invention is not limited to the above-described embodiments, and may be modified and altered in various ways without departing from the spirit and scope of the present invention. Therefore, the following claims are appended in order to disclose the scope of the present invention.

[0183] The present invention claims priority from Japanese Patent Application No. 2018-155033 filed on August 21, 2018, the contents of which are hereby incorporated by reference.

[0184] Reference numerals list

[0185] 1100 Photoacoustic Device

[0186] 1200 Storage Device

[0187] 1300 Image processing device

[0188] 1400 Display Device

[0189] 1500 Input Device

Claims

1. An image processing device, characterized in that: include: a spectral image acquisition unit that acquires a spectral image having spectral image signals obtained by using photoacoustic signals corresponding to a plurality of different wavelengths, wherein the photoacoustic signals are generated by alternately irradiating a subject having both a blood vessel region and a lymphatic vessel region into which a contrast agent has been injected with light having the plurality of different wavelengths; a region determining component, the region determining component determining a region corresponding to a first value range corresponding to the contrast agent in the spectral image signal as a lymphatic vessel region, and determining a region corresponding to a second value range corresponding to hemoglobin in the spectral image signal as a blood vessel region; as well as A display control section causes the spectral image to be displayed by assigning colors to image values ​​of the spectral image signal included in the first numerical range and the second numerical range so that a lymphatic vessel region and a blood vessel region can be distinguished from each other.

2. The image processing device according to claim 1, characterized in that The region determination section determines the numerical range of image values ​​of the spectral image to which colors are to be assigned based on information on the contrast agent.

3. The image processing device according to claim 1, characterized in that The sign of the image value of the region corresponding to the contrast agent is opposite to the sign of the image value of the region other than the region corresponding to the contrast agent.

4. The image processing device according to claim 1, characterized in that: The region determination section determines a region corresponding to the contrast agent in the spectral image based on the information on the contrast agent and the information on the plurality of wavelengths.

5. The image processing device according to claim 1, characterized in that: The display control component causing a colorimetric scale representing the relationship between image values ​​of the spectral image and displayed colors to be displayed, and The color scale is displayed so that a displayed color corresponding to the contrast agent can be identified.

6. The image processing device according to claim 1, characterized in that: Also includes: a photoacoustic image acquisition unit that acquires a plurality of photoacoustic images corresponding to the plurality of wavelengths, the plurality of photoacoustic images being generated based on photoacoustic waves generated by irradiating a subject having both a blood vessel region and a lymphatic vessel region into which a contrast agent has been injected with light having the plurality of wavelengths, wherein: The display control component determining the brightness of the spectral image based on an image value of one of the plurality of photoacoustic images, and A conversion table for converting the image value of the photoacoustic image into brightness is determined based on the image value of the spectral image.

7. The image processing device according to claim 1, characterized in that: Information about the contrast agent is obtained from supplementary information associated with the spectral image.

8. The image processing device according to claim 1, characterized in that: The information on the contrast agent is information on the type or concentration of the contrast agent.

9. The image processing device according to claim 1, characterized in that: Also includes: a photoacoustic image acquisition unit that acquires a first photoacoustic image based on a photoacoustic wave generated by irradiation with light having a first wavelength and a second photoacoustic image based on a photoacoustic wave generated by irradiation with light having a second wavelength, wherein The spectral image acquisition section generates an image based on a ratio of the first photoacoustic image to the second photoacoustic image as the spectral image.

10. The image processing device according to claim 1, characterized in that: The measured value of the photoacoustic wave generated by irradiation with light having the first wavelength λ1 is I λ 1(r), based on the measurement value of the photoacoustic wave generated by irradiation with light having the second wavelength λ2 being I λ 2(r), the molar absorption coefficient of deoxyhemoglobin corresponding to the first wavelength λ1 is ε Hb λ 1. The molar absorption coefficient of deoxyhemoglobin corresponding to the second wavelength λ2 is ε Hb λ 2. The molar absorption coefficient of oxygenated hemoglobin corresponding to the first wavelength λ1 is ε HbO λ 1. The molar absorption coefficient of oxygenated hemoglobin corresponding to the second wavelength λ2 is ε HbO λ 2 and r is the position, The spectral image acquisition component generates a calculated value Is(r) as the image value of the spectral image according to the following formula:

11. The image processing device according to claim 10, characterized in that: The measured value is either the absorption coefficient or the initial sound pressure.

12. The image processing device according to claim 1, characterized in that: The contrast agent is ICG having a concentration of at least 2.5 mg / mL and not more than 10.0 mg / mL.

13. The image processing device according to claim 1, characterized in that: Information indicating the concentration of the contrast medium is acquired as information on the contrast medium based on an instruction from a user, and In a case where information indicating that the type of the contrast medium is ICG is acquired as the information on the contrast medium, an instruction from the user indicating an ICG concentration of less than 2.5 mg / mL or greater than 10.0 mg / mL is not received.

14. The image processing device according to claim 12, characterized in that: The plurality of wavelengths include 797 nm as a first wavelength and 835 nm as a second wavelength.

15. The image processing device according to claim 1, characterized in that: The display control section causes a plurality of spectral images generated in time series to be displayed as a moving image.

16. The image processing device according to claim 15, characterized in that: The display control section can cause the moving image to be displayed in a fast-forward manner.

17. The image processing device according to claim 15, characterized in that: The display control section can cause the moving image to be repeatedly displayed.

18. An image processing method, characterized in that: include: Acquiring a spectral image having spectral image signals obtained by using photoacoustic signals corresponding to a plurality of different wavelengths, wherein the photoacoustic signals are generated by alternately irradiating a subject having both a blood vessel region and a lymphatic vessel region into which a contrast agent has been injected with light having the plurality of different wavelengths; determining a region corresponding to a first value range corresponding to the contrast agent in the spectral image signal as a lymphatic vessel region, and determining a region corresponding to a second value range corresponding to hemoglobin in the spectral image signal as a blood vessel region; and The spectral image is displayed by assigning colors to image values ​​of the spectral image signal included in the first numerical range and the second numerical range so that a lymphatic vessel region and a blood vessel region can be distinguished from each other.

19. The image processing method according to claim 18, characterized in that: The contrast agent is ICG, and the plurality of wavelengths includes 797 nm as a first wavelength and 835 nm as a second wavelength. 20 . A non-transitory computer-readable medium storing a program for causing a computer to execute the image processing method according to claim 18 .