Image processing device, image processing method, image processing program, endoscope device, and endoscope image processing system

Abstract

This image processing device acquires an image obtained by irradiating an area of a living body with light having a wavelength of 955 to 2025 [nm]. The image processing device inputs the acquired image to a statistical model or a learned model which is generated in advance to detect a tumor that is present in an area from the image, and determines whether a tumor is present in various places in the image.

Description

[Technical Field]

[0001] The technologies disclosed herein relate to image processing devices, image processing methods, image processing programs, endoscope devices, and endoscope image processing systems. [Background technology]

[0002] Conventionally, biological tissue identification devices that distinguish between normal and abnormal biological tissues are known (see, for example, Japanese Patent Publication No. 2009-300131). The biological tissue identification device of Japanese Patent Publication No. 2009-300131 irradiates in the wavelength range of 900 nm to 1700 nm (paragraph

[0025] ) and distinguishes between normal and abnormal biological tissues based on a spectral distribution curve in the range of 1200 to 1320 nm (paragraph

[0021] ). This biological tissue identification device targets the inner wall of gastric cancer, which is the surface of biological tissue (paragraph

[0035] ).

[0003] Furthermore, there is a known biomedical device that quantifies and evaluates the change in spectral shape between cancer cells and normal cells in at least one of the wavelength ranges of 1510nm to 1530nm and 1480nm to 1500nm, obtained by irradiating biological tissue with near-infrared light, as a second derivative value (see, for example, Japanese Patent Application Publication No. 2015-102542). [Overview of the Initiative] [Problems that the invention aims to solve]

[0004] As disclosed in Japanese Patent Publication No. 2009-300131 and Japanese Patent Publication No. 2015-102542, a technique is known for diagnosing biological tissue by irradiating it with near-infrared light (for example, light with a wavelength of around 800-2500 nm) and analyzing the resulting image. Near-infrared light has many features that are useful for observing the inside of the human body. However, because the wavelength range of near-infrared light is broad, there is a challenge in that it is difficult to mount an imaging device capable of acquiring features of all frequency bands on an endoscope.

[0005] This disclosure is made in view of the above circumstances and aims to detect the presence or absence of tumors using images captured by irradiating a specific wavelength of light onto a part of the living body. [Means for solving the problem]

[0006] A first aspect of this disclosure is an image processing device comprising: an image acquisition unit that acquires an image obtained by irradiating a part of a living body with light of a wavelength of 955 [nm] to 2025 [nm]; and a determination unit that inputs the image acquired by the image acquisition unit into a pre-generated trained model or statistical model for detecting tumors present in the part from the image, and determines whether or not a tumor is present at each location of the image acquired by the image acquisition unit.

[0007] A second aspect of this disclosure is an image processing program that causes a computer to function as an image acquisition unit that acquires an image obtained by irradiating a part of a living organism with light of a wavelength of 955 [nm] to 2025 [nm], and as a determination unit that inputs the image acquired by the image acquisition unit into a pre-generated trained model or statistical model for detecting tumors present in the part from the image, and determines whether or not a tumor is present in each part of the image acquired by the image acquisition unit.

[0008] A third aspect of this disclosure is an image processing method in which a computer performs a process to acquire an image obtained by irradiating a part of a living body with light of a wavelength of 955 [nm] to 2025 [nm], input the acquired image into a pre-generated trained model or statistical model for detecting tumors present in the part from the image, and determine whether or not a tumor is present in each part of the acquired image.

[0009] A fourth aspect of this disclosure is an endoscope device comprising an optical output unit that outputs light with wavelengths of 955 nm to 2025 nm, and an imaging device that captures an image of a part of a living body when light is irradiated from the optical output unit.

[0010] A fifth aspect of the present disclosure is an image processing apparatus including an image acquisition unit that acquires an image obtained by irradiating a gastrointestinal tract site in a living body with light having a wavelength of 1,000 [nm] to 1,500 [nm], and a determination unit that inputs the image acquired by the image acquisition unit into a pre-generated learned model or statistical model for detecting gastrointestinal stromal tumors existing inside the gastrointestinal tract site in the image, and determines whether or not a gastrointestinal stromal tumor exists at each location in the image acquired by the image acquisition unit.

Advantages of the Invention

[0011] According to the present disclosure, there is an effect that the presence or absence of a tumor can be detected using an image captured by irradiating a site in a living body with light of a specific wavelength.

Brief Description of the Drawings

[0012] [Figure 1] It is a diagram showing a schematic configuration of an endoscopic image processing system according to an embodiment of the present disclosure. [Figure 2] It is a diagram for explaining GIST. [Figure 3] It is an enlarged view of the tip of the insertion portion of the endoscope device. [Figure 4] It is a diagram for explaining an image generated in the present embodiment. [Figure 5] It is a diagram showing a functional configuration example of the image processing apparatus according to the present embodiment. [Figure 6] It is a diagram showing an example of the learned model of the present embodiment. [Figure 7] It is a diagram showing a hardware configuration of the image processing apparatus and the control apparatus according to the present embodiment. [Figure 8] It is an example of an image processing routine according to the present embodiment. [Figure 9] It is a diagram for explaining an example. [Figure 10] It is a diagram for explaining an example. [Figure 11] It is a diagram for explaining an example. [Figure 12]This is a diagram illustrating an example. [Figure 13] This is a diagram illustrating an example. [Figure 14] This is a diagram illustrating an example. [Figure 15] This is a diagram illustrating an example. [Figure 16] This is a diagram illustrating an example. [Figure 17] This is a diagram illustrating an example. [Figure 18] This is a diagram illustrating an example. [Figure 19] This is a diagram illustrating an example. [Figure 20] This is a diagram illustrating an example. [Figure 21] This is a diagram illustrating an example. [Figure 22] This is a diagram illustrating an example. [Figure 23] This is a diagram illustrating an example. [Figure 24] This is a diagram illustrating an example. [Figure 25] This is a diagram illustrating an example. [Figure 26] This is a diagram illustrating an example. [Figure 27] This is a diagram illustrating an example. [Modes for carrying out the invention]

[0013] Hereinafter, an example of an embodiment of this disclosure will be described with reference to the drawings. In each drawing, identical or equivalent components and parts are given the same reference numerals. Also, the dimensional ratios in the drawings are exaggerated for illustrative purposes and may differ from the actual ratios.

[0014] (Configuration of Endoscopic Image Processing System 1)

[0015] Figure 1 is a diagram showing the schematic configuration of an endoscopic image processing system 1 according to an embodiment of the present disclosure. As shown in Figure 1, the endoscopic image processing system 1 of this embodiment comprises an endoscope system 10 and an image processing device 30. The endoscope system 10 and the image processing device 30 are connected via a predetermined communication line 5.

[0016] The endoscopic image processing system 1 of this embodiment detects gastrointestinal stromal tumors (GISTs), which are malignant tumors that occur in the submucosa of the digestive tract, such as the stomach or small intestine. Figure 2 shows a diagram illustrating GISTs. As shown in Figure 2, GISTs are tumors that are difficult to detect early because they occur in the submucosa of the digestive tract.

[0017] Conventionally, near-infrared light across the entire wavelength range (for example, light with wavelengths around 800-2500 nm) was irradiated onto biological tissue, and images of the tissue were captured. In this case, it would be necessary to mount an endoscope with a camera capable of capturing images of near-infrared light across the entire wavelength range (for example, a near-infrared hyperspectral camera). However, mounting such a camera on an endoscope is difficult.

[0018] Therefore, in this embodiment, a specific wavelength of light useful for identifying GISTs from near-infrared light is selected. The endoscopic image processing system 1 of this embodiment irradiates the digestive tract area with light of a pre-selected specific wavelength and captures an image of the digestive tract area at that time. Then, the endoscopic image processing system 1 of this embodiment determines the presence or absence of GISTs in the digestive tract area based on the captured image.

[0019] The following provides a detailed explanation.

[0020] (Endoscopy system)

[0021] As shown in Figure 1, the endoscope system 10 comprises an endoscope device 12 and a control device 19. The endoscope device 12 and the control device 19 are electrically connected to enable communication. The endoscope device 12 takes images of the inside of the human body H. The control device 19 generates an image of the inside of the human body H based on the signals obtained from the imaging.

[0022] The endoscope device 12 includes an insertion section 14 that is inserted into the human body H. The insertion section 14 is attached to an operating section 16. The operating section 16 includes various buttons for commanding the tip 18 of the insertion section 14 to bend vertically and horizontally within a predetermined angular range, for operating a puncture needle attached to the tip 18 of the endoscope device 12 to collect tissue samples, and for spraying chemicals.

[0023] The endoscope device 12 of this embodiment is an endoscope for the digestive tract, and its tip 18 is inserted into the digestive tract of a human body H. The tip 18 of the insertion part 14 of the endoscope device 12 is equipped with a light output unit, and the light emitted from the light output unit is irradiated onto a part of the digestive tract in the living body. The endoscope device 12 then acquires an image of the digestive tract of the subject using an imaging optical system.

[0024] Figure 3 is an enlarged view of the tip 18 of the insertion section 14 of the endoscope device 12. As shown in Figure 3, the tip 18 of the insertion section 14 is equipped with a camera 18A, which is an example of an imaging device, and light guides 18B and 18C that can output light of a specific wavelength. The light output from these light guides 18B and 18C is light guided by optical fibers from a light source device (not shown) provided in the control device 19. Also, as shown in Figure 3, the tip 18 of the insertion section 14 is equipped with a forceps channel 18D and a nozzle 18E. Instruments for performing various medical procedures enter and exit through the forceps channel 18D. Water or air is output from the nozzle 18E.

[0025] In this embodiment, the light source device of the endoscope apparatus 12 outputs light of a specific wavelength, and this light of a specific wavelength is output from the light guides 18B and 18C, which are examples of light output units. Specifically, the light source device is configured to output light with wavelengths from 1000 nm to 1500 nm.

[0026] More specifically, the light source device (not shown) of the control device 19 is configured to output light with wavelengths of 1050 to 1105 nm (hereinafter simply referred to as "first light"), 1145 to 1200 nm (hereinafter simply referred to as "second light"), 1245 to 1260 nm (hereinafter simply referred to as "third light"), and 1350 to 1405 nm (hereinafter simply referred to as "fourth light"). These lights are light of specific wavelengths that have been selected in advance.

[0027] The endoscope device 12 controls the first light to irradiate the digestive tract area within the body, and at that time, the camera 18A captures an image (hereinafter simply referred to as the "first image"). The endoscope device 12 also controls the second light to irradiate the digestive tract area within the body, and at that time, the camera 18A captures an image (hereinafter simply referred to as the "second image"). The endoscope device 12 controls the third light to irradiate the digestive tract area within the body, and at that time, the camera 18A captures an image (hereinafter simply referred to as the "third image"). The endoscope device 12 controls the fourth light to irradiate the digestive tract area within the body, and at that time, the camera 18A captures an image (hereinafter simply referred to as the "fourth image").

[0028] The control device 19 acquires each image captured by the camera of the endoscope device 12. The control device 19 integrates the first image, the second image, the third image, and the fourth image to generate an image Im of the digestive tract region, as shown in Figure 4. As shown in Figure 4, the pixels P of the image Im of the digestive tract region are arranged by arranging the pixels P1 from the first image, P2 from the second image, P3 from the third image, and P4 from the fourth image, which are at the same position in each of the first, second, third, and fourth images.

[0029] The control device 19 then transmits the image Im of the digestive tract to the image processing device 30.

[0030] (Image processing device)

[0031] Figure 5 is a block diagram showing the functional configuration of the image processing device 30. As shown in Figure 5, the image processing device 30 comprises an image acquisition unit 32, an image storage unit 34, a trained model storage unit 36, and a determination unit 38.

[0032] The image acquisition unit 32 acquires an image (Im) of the digestive tract transmitted from the control device 19. The image acquisition unit 32 then temporarily stores the image (Im) of the digestive tract in the image storage unit 34.

[0033] The image storage unit 34 stores an image Im of the digestive tract.

[0034] The trained model memory unit 36 ​​stores pre-generated trained models for detecting GISTs located inside the digestive tract from images of the digestive tract (Im).

[0035] The pre-trained model of this embodiment is implemented, for example, by a known neural network. The pre-trained model of this embodiment is a model that has been pre-generated based on data in which training images of living organisms are associated with information (so-called labels) indicating whether or not GISTs are present inside the digestive tract region shown in the images of living organisms.

[0036] Figure 6 shows an example of a trained model in this embodiment. As shown in Figure 6, in this embodiment, the pixel values ​​P1 to P4 of pixel P in the image Im of the digestive tract are input to the trained model. The trained model outputs a probability indicating whether or not a GIST exists at the location corresponding to pixel P. As shown in Figure 6, for example, the trained model outputs a probability of 0.7 that it is a GIST and a probability of 0.3 that it is not a GIST. For each of the multiple pixels included in the image Im of the digestive tract, it is determined whether or not a GIST exists.

[0037] The determination unit 38 inputs the pixel values ​​of each pixel in the image Im of the digestive tract stored in the image storage unit 34 to the trained model stored in the trained model storage unit 36, and determines whether or not a GIST exists for each pixel in the image Im of the digestive tract.

[0038] For example, when the determination unit 38 inputs a pixel into the trained model, if the probability of it being a GIST is higher than the probability of it not being a GIST, it determines that a GIST exists at the location corresponding to that pixel. Conversely, when the determination unit 38 inputs a pixel into the trained model, if the probability of it being a GIST is less than or equal to the probability of it not being a GIST, it determines that a GIST does not exist at the location corresponding to that pixel.

[0039] The determination unit 38 outputs the determination result regarding the presence or absence of GIST in each pixel of the image Im of the digestive tract region to the display unit (not shown).

[0040] The display unit (not shown) displays the determination result regarding the presence or absence of GIST output from the determination unit 38. The determination result regarding the presence or absence of GIST is output in a format that is superimposed on the image Im of the gastrointestinal region (for example, the area where GIST is present is displayed in red). The user then checks the determination result displayed on the display unit.

[0041] Figure 7 is a block diagram showing the hardware configuration of the computer 20 that constitutes the control device 19 and the image processing device 30. As shown in Figure 7, the computer 20 has a CPU (Central Processing Unit) 21, ROM (Read Only Memory) 22, RAM (Random Access Memory) 23, storage 24, input unit 25, display unit 26, and communication interface (I / F) 27. Each component is connected to the others via a bus 29 so that they can communicate with each other.

[0042] The CPU 21 is a central processing unit that executes various programs and controls various components. Specifically, the CPU 21 reads programs from the ROM 22 or storage 24 and executes them using the RAM 23 as a working area. The CPU 21 controls each of the above components and performs various calculations according to the programs stored in the ROM 22 or storage 24. In this embodiment, the ROM 22 or storage 24 stores various programs that process information input from an input device.

[0043] ROM22 stores various programs and data. RAM23 temporarily stores programs or data as a working area. Storage24 consists of an HDD (Hard Disk Drive) or SSD (Solid State Drive), etc., and stores various programs, including the operating system, and various data.

[0044] The input unit 25 includes a pointing device such as a mouse and a keyboard, and is used for various types of input.

[0045] The display unit 26 is, for example, a liquid crystal display and displays various information. The display unit 26 may also function as an input unit 25 by employing a touch panel system.

[0046] Communication I / F27 is an interface for communicating with other devices such as input devices, and standards such as Ethernet®, FDDI, and Wi-Fi® are used.

[0047] Next, we will explain the operation of the endoscopic image processing system 1.

[0048] In response to user input, the tip 18 of the insertion section 14 of the endoscope device 12 is inserted into the body, and when the tip 18 reaches the digestive tract, imaging of the digestive tract begins.

[0049] The endoscope device 12 controls the first light to irradiate the digestive tract area, and at that time, the camera 18A captures a first image. The endoscope device 12 also controls the second light to irradiate the digestive tract area, and at that time, the camera 18A captures a second image. The endoscope device 12 also controls the third light to irradiate the digestive tract area, and at that time, the camera 18A captures a third image. The endoscope device 12 also controls the fourth light to irradiate the digestive tract area, and at that time, the camera 18A captures a fourth image.

[0050] The control device 19 integrates the first image, the second image, the third image, and the fourth image to generate an image Im of the digestive tract region as shown in Figure 4. The control device 19 then transmits the image Im of the digestive tract region to the image processing device 30.

[0051] When the image acquisition unit 32 of the image processing device 30 acquires an image Im of the digestive tract transmitted from the control device 19, it stores the image Im of the digestive tract in the image storage unit 34.

[0052] Then, when the image processing device 30 receives a signal to start the process of determining whether or not GISTs are present in each part of the image Im of the digestive tract, it executes the image processing routine shown in Figure 8.

[0053] Specifically, image processing is performed by the CPU 21 reading an image processing program from the ROM 22 or storage 24, loading it into the RAM 23, and executing it.

[0054] In step S50, the image acquisition unit 32 reads out the image Im of the digestive tract stored in the image storage unit 34.

[0055] In step S52, the determination unit 38 reads out the trained model stored in the trained model storage unit 36.

[0056] In step S54, the determination unit 38 inputs the pixel values ​​of each pixel of the image Im of the digestive tract region, which was read in step S50, into the trained model read in step S52, and determines whether or not a GIST exists for each pixel of the image Im of the digestive tract region.

[0057] In step S56, the determination unit 38 outputs the determination result regarding the presence or absence of GIST in each pixel of the image Im of the digestive tract region to the display unit 26, and terminates the image processing routine.

[0058] The display unit 26 displays the determination result regarding the presence or absence of GIST output from the determination unit 38.

[0059] As described above, the endoscope device of this embodiment outputs light with wavelengths of 1000 [nm] to 1500 [nm], more specifically, a first light representing a wavelength of 1050 to 1105 [nm], a second light representing a wavelength of 1145 to 1200 [nm], a third light representing a wavelength of 1245 to 1260 [nm], and a fourth light representing a wavelength of 1350 to 1405 [nm], and captures an image of the digestive tract region in the body when this light is irradiated. The image processing device of this embodiment then inputs the image of the digestive tract region into a pre-generated, trained model for detecting GISTs present inside the digestive tract region from the image of the digestive tract region, and determines whether or not GISTs are present at each location in the image. In this way, the presence or absence of GISTs can be detected using images captured by irradiating the digestive tract region in the body with light of a specific wavelength. As a result, the presence or absence of GISTs can be detected without, for example, mounting a large imaging device such as a near-infrared hyperspectral camera on the endoscope device. [Examples]

[0060] (Examples related to GIST) Next, the method for selecting light of a specific wavelength in this embodiment will be described as an example. In this embodiment, when selecting light of a specific wavelength from near-infrared light, a neural network, which is an example of a trained model obtained by machine learning, and partial least squares discriminant analysis (PLS-DA), which is an example of a statistical model obtained by statistical analysis, were used to select light of a wavelength useful for GIST detection.

[0061] Table 1 shows the number of training data points used to generate the neural network and PLS-DA. As mentioned above, in this embodiment, the presence or absence of GIST is determined for each pixel, so the number of training data points corresponds to the number of pixels. In Table 1, "Tumor" represents pixels where GIST is present, and "Normal" represents pixels in normal regions where GIST is not present. The number on the far left of Table 1 represents the date the image was taken; for example, "20160923" represents September 23, 2016.

[0062] [Table 1]

[0063] (Wavelength selection using neural networks)

[0064] Figure 9 shows the configuration of the neural network used for wavelength selection in this embodiment. In Figure 9, "Input" represents the input layer, and "Output" represents the output layer. Also, "fc" in Figure 9 represents a fully connected layer, and the number listed alongside it represents the number of units. "Relu" represents the known activation function ReLU (Rectified Linear Unit). "Dropout" indicates that the known dropout technique was used. "Softmax" represents the known softmax function.

[0065] In this example, the neural network shown in Figure 9 was trained using the training data in Table 1. The contribution of each wavelength of light was then calculated using the weight parameters of the trained neural network. This contribution indicates which wavelengths of light strongly influence the correct identification of the input, and is calculated based on the results of forward propagation calculations performed on an input where all wavelengths except a certain wavelength are set to zero. The detailed steps for calculating the contribution are as follows.

[0066] (1) A trained neural network is generated using a training dataset. One training dataset consists of data where the pixel value of a pixel in an image taken when light of various wavelengths is irradiated onto a part of the digestive tract is associated with a label indicating whether or not that pixel is a GIST. When training the neural network, only the weights of the fully connected layers of the neural network are trained. Furthermore, the neural network is unbiased and uses the ReLU activation function. (2) Select one data point from the training dataset and input the pixel values ​​for each wavelength in that data point into the trained neural network to perform forward propagation calculations. At this time, record the output values ​​for all nodes in the trained neural network. Note that the output values ​​refer to both the values ​​output by each node of the neural network and the values ​​output by the output layer of the neural network. (3) From the pixel values ​​for each wavelength in the data set used in (2) above, select a pixel value corresponding to one wavelength, and perform a pseudo-forward propagation calculation using the trained neural network by setting the pixel values ​​for the other wavelengths to 0. The output of the trained neural network at this time is taken as the contribution of one wavelength in the data set. Note that the ReLU function of the trained neural network is not applied at this time. At this time, for each node of the trained neural network, the output value of the node whose value recorded in (2) above is 0 or less is set to 0 for the calculation. (4) Repeat the above (3) for all wavelengths of a single data point to obtain the contribution of the pixel value corresponding to each wavelength to the input. (5) Repeat steps (2) to (4) above for multiple training datasets to obtain data on the contribution amounts to multiple training datasets.

[0067] The amount of contribution will be explained in detail below.

[0068] The two values ​​that a trained neural network will ultimately output are, for example, {0.7, 0.3} (whether it is a tumor or normal). The larger of the two output values ​​of the trained neural network is selected to determine whether that pixel is a tumor or normal. For example, if the output values ​​when the pixel value of a certain pixel is input to a trained neural network are {0.7, 0.3}, then that pixel is determined to be a tumor.

[0069] If we input the pixel values ​​of pixels corresponding to all wavelengths into a trained neural network, some of those wavelengths will contribute to the correct output, while others will contribute to the incorrect output. For example, consider a case where the correct data for a pixel is {1,0} and that pixel is a tumor. In this case, if we input the pixel values ​​corresponding to all wavelengths of that pixel into the trained neural network, suppose the output is {0.7,0.3}. Wavelengths that direct this output towards {1,0} are wavelengths that contribute to the correct output, and wavelengths that direct this output towards {0,1} are wavelengths that contribute to the incorrect output.

[0070] Therefore, values ​​other than a certain wavelength in one of the training data (the pixel value of one pixel) are set to 0, and this is input into the trained neural network to calculate the final output value. In this case, the output of any node that would cause the final output value to point in the wrong direction is set to 0. This process corresponds to (2) and (3) above.

[0071] Then, for a given wavelength, the sum of the output values ​​calculated as described above for multiple data points (pixel values ​​of multiple pixels) is calculated and taken as the contribution amount for that wavelength. In this case, if the correct data for a pixel is {1,0}, and the pixel value corresponding to a given wavelength is input to a trained neural network and results in {0.8,0.2}, then 0.8 will be the calculated value. The calculated value is then calculated for multiple pixels, and the sum of the calculated values ​​for multiple pixels is taken as the contribution amount. The same calculation is performed for each of the multiple wavelengths to calculate the contribution amount for that wavelength.

[0072] Figure 10 shows the calculated contribution amount. The vertical axis of Figure 10 represents the contribution amount (labeled "Average contribution amount" in the figure), and the horizontal axis represents the wavelength (labeled "Wavelength bands number" in the figure). Each number on the horizontal axis represents a specific wavelength, with number "1" corresponding to a wavelength of 913.78 [nm] and number "193" corresponding to a wavelength of 2126.27 [nm]. Note that for every increment of 1 in the number, the wavelength increases by 6.28 to 6.34 [nm]. Tables 2 and 3 below show the correspondence between the numbers and wavelengths.

[0073] [Table 2]

[0074] [Table 3]

[0075] Wavelengths with larger absolute values ​​of contribution, as shown in Figure 10, are more useful for detecting GISTs. In this example, four wavelengths in the high contribution region were selected from Figure 10. Specifically, one wavelength was selected from each peak of high contribution, resulting in the accuracy shown in Figure 11.

[0076] From this, it can be said that light with wavelengths of 1050-1105 nm, 1145-1200 nm, 1245-1260 nm, and 1350-1405 nm is useful for detecting GISTs.

[0077] (Wavelength selection using PLS-DA)

[0078] In this example, wavelength selection and discrimination were performed using the known statistical method PLS-DA. Specifically, a discrimination model was generated using PLS-DA with the training data shown in Table 1. The contribution of each wavelength of light was calculated using the sum of the factor loadings of each wavelength of light for the first eight principal components of the generated discrimination model. Therefore, the contribution is the sum of the factor loadings of each wavelength of light for the first eight principal components of the generated discrimination model.

[0079] Figure 12 shows the calculated contribution. The vertical axis in Figure 12 represents the contribution (labeled "The coefficient of linear model" in the figure). Similar to wavelength selection by neural networks, peaks with high contributions are formed, and it is thought that GISTs can be detected with high accuracy by selecting wavelengths from these peaks.

[0080] Table 4 below shows the GIST discrimination accuracy of the neural network (labeled "Proposed Method" in Table 4) and the GIST discrimination accuracy of PLS-DA. The numbers in parentheses in Table 4 represent the number of wavelengths. "Dimensionality Reduction" means that four wavelengths were selected from all wavelengths, and the dimension was reduced. As shown in Table 4, by using only the four selected wavelengths of light, detection accuracy almost equivalent to that obtained when all wavelengths were used can be obtained.

[0081] [Table 4]

[0082] As explained above, when GIST is detected using light of the wavelength selected in this embodiment, the detection accuracy is said to be almost the same as when light of the entire range of near-infrared wavelengths is used.

[0083] (Examples related to lung cancer) Next, an example related to lung cancer will be described. By the same method as the above example related to GIST, light with a specific wavelength useful for the detection of lung cancer was selected. The wavelength range is 196 wavelengths from 913.78 [nm] to 2145.15 [nm]. FIG. 13 shows the contribution amounts obtained by calculation. The vertical axis in FIG. 13 represents the contribution amount (denoted as "contribution degree" in the figure), and the horizontal axis represents the wavelength number. Each number on the horizontal axis representing the wavelength corresponds to each wavelength, where number "1" corresponds to the wavelength of 913.78 [nm], and number "193" corresponds to the wavelength of 2126.27 [nm].

[0084] The wavelength with a larger absolute value of the contribution amount shown in FIG. 13 is a more useful wavelength for detecting lung cancer. The dashed line in FIG. 13 represents the contribution amount when discriminating a tumor as a tumor, the dash-dotted line represents the contribution amount when discriminating a normal region as a normal region, and the solid line represents the sum of these contribution amounts.

[0085] In this example, six wavelengths in the region with a high contribution amount were selected from FIG. 13. Specifically, one wavelength was selected from each peak with a high contribution amount, and the light with wavelengths from the wavelength range λ H1 to 977.12 [nm], the light with wavelengths from the wavelength range λ H2 to 1103.74 [nm], the light with wavelengths from the wavelength range λ H3 to 1198.65 [nm], the light with wavelengths from the wavelength range λ H4 to 1350.40 [nm], the light with wavelengths from the wavelength range λ H5 to 1584.13 [nm], and the light with wavelengths from the wavelength range λ H6 to 1893.21 [nm] were selected. Note that the contribution amount corresponding to the wavelength range λ H3 in FIG. 13 is lower than the contribution amounts of other wavelength ranges. However, through trial and error in wavelength selection, since the light in the wavelength range λ H3 was considered useful for the discrimination of lung cancer, the light of 1198.65 [nm] in the wavelength range λ H3 was selected. Note that the wavelength range λ H1 is, for example, wavelengths from 955 to 1020 [nm], the wavelength range λ H2 is, for example, wavelengths from 155 to 1135 [nm], the wavelength range λ H3 is, for example, wavelengths from 135 to 1295 [nm], and the wavelength range λ H4For example, wavelengths are 1295-1510 nm, and wavelength range λ H5 For example, wavelengths are 1510-1645 [nm], and wavelength range λ H6 For example, this refers to wavelengths of 1820-2020 nm. Light with wavelengths of 955-1020 nm is an example of the first type of light, light with wavelengths of 1055-1135 nm is an example of the second type of light, light with wavelengths of 1135-1295 nm is an example of the third type of light, light with wavelengths of 1295-1510 nm is an example of the fourth type of light, light with wavelengths of 1510-1645 nm is an example of the fifth type of light, and light with wavelengths of 1820-2020 nm is an example of the sixth type of light. When images were taken by irradiating the lungs in living organisms with light of these specific wavelengths, the presence or absence of tumors in the lungs was detected, and the accuracy was as shown in the table below.

[0086] [Table 5]

[0087] As shown in the table above, even when the total wavelengths (196 wavelengths) are reduced to 6 wavelengths, the accuracy only decreases by about 5%. From this, it can be said that at least one of the following wavelengths of light is useful for detecting lung cancer: 955-1020 nm, 1055-1135 nm, 1135-1295 nm, 1295-1510 nm, 1510-1645 nm, and 1820-2020 nm.

[0088] Furthermore, Figures 14-15 show the results of lung cancer identification. In the identification results shown in Figures 14-15, tumor C is present in the image of the lung sample (labeled "NIR image" in the figures). In contrast, it can be seen that the identification results are almost the same when tumor C is identified based on an image obtained by irradiating the lung with light of all wavelengths (196 wavelengths) (labeled "196band" in the figures) and when tumor C is identified based on an image obtained by irradiating the lung with light of the 6 wavelengths selected in this example (labeled "6band" in the figures). This suggests that at least one of the following wavelengths of light—955-1020 nm, 1055-1135 nm, 1135-1295 nm, 1295-1510 nm, 1510-1645 nm, and 1820-2020 nm—is a useful wavelength for detecting lung cancer.

[0089] (Examples related to gastric cancer) Next, we will describe an example related to gastric cancer. In the example for GIST described above, the neural network was replaced with an SVM (Support Vector Machine) to generate a trained SVM model. Furthermore, LASSO (Least Absolute Shrinkage and Selection Operator) was used for wavelength selection, and a specific wavelength of light useful for detecting gastric cancer was selected using the same method. When generating the trained SVM model, training data from 6 samples (normal: 405,525 pixels; tumor: 107,078 pixels) were used. Leave-one-out cross-validation was used to evaluate the trained SVM. Figure 16 shows the contribution (regression coefficient) of the model obtained by LASSO. In Figure 16, the vertical axis represents the regression coefficient of LASSO, and the horizontal axis represents the wavelength number. Each wavelength number on the horizontal axis represents a specific wavelength, with number "1" corresponding to a wavelength of 1002.45 [nm] and number "91" corresponding to a wavelength of 1571.5 [nm]. Therefore, in the examples related to gastric cancer, the relationship between the wavelength number and the actual wavelength is not as shown in Tables 2 and 3 above; instead, the number "1" corresponds to a wavelength of 1002.45 [nm], and the number "91" corresponds to a wavelength of 1571.5 [nm].

[0090] In this example, four wavelengths in the high-contribution region were selected from Figure 16. Specifically, one wavelength was selected from each peak with the highest contribution, and the wavelength range λ was selected. S1 Light from 1091.08 [nm] (wavelength number 15), wavelength range λ S2 Light from 1217.52 [nm] (wavelength number 35), wavelength range λ S3 Light from 1287.19 [nm] (wavelength number 46), and wavelength range λ S4 Light with a wavelength of 1400.96 [nm] (wavelength number 64) was selected. The wavelength selection process involved trial and error to select light that was considered useful for identifying gastric cancer. The wavelength range λ S1 For example, wavelengths are 1065-1135 [nm], and wavelength range λ S2 For example, wavelengths are 1180-1230 [nm], and wavelength range λ S3For example, wavelengths are 1255-1325 [nm], and wavelength range λ S4 For example, this corresponds to a wavelength of 1350-1425 [nm]. Light with a wavelength of 1065-1135 [nm] is an example of the first type of light, light with a wavelength of 1180-1230 [nm] is an example of the second type of light, light with a wavelength of 1255-1325 [nm] is an example of the third type of light, and light with a wavelength of 1350-1425 [nm] is an example of the fourth type of light. When images were taken by irradiating the stomach in a living body with light of these specific wavelengths, the presence or absence of tumors in the stomach was detected, and the accuracy shown in the table below was obtained. Note that all wavelengths (95 wavelengths) correspond to wavelengths from 1002.45 [nm] (number "1") to 1596.75 [nm] (number "95").

[0091] [Table 6]

[0092] As shown in the table above, there is no significant difference in accuracy, precision, recall, specificity, and F-measure between all wavelengths (95 wavelengths) and selected wavelengths (4 wavelengths). From this, it can be said that at least one of the following wavelengths is useful for detecting gastric cancer: 1065-1135 nm, 1180-1230 nm, 1255-1325 nm, and 1350-1425 nm.

[0093] Figures 17-20 show the results of gastric cancer identification. Figure 17 is an image of the sample. The numbers in the figure represent the date the image was taken; for example, "20200923" represents September 23, 2020. In Figure 17, the area enclosed by the white line corresponds to the area of ​​non-exposed tumor tissue, the area enclosed by the gray line corresponds to the area of ​​exposed tumor tissue, and the area filled in white corresponds to the area of ​​necrotic tumor tissue.

[0094] Figure 18 is an image of the training data. The white areas in Figure 18 represent normal areas. The gray areas in Figure 18 represent areas corresponding to exposed tumor tissue. Note that necrotic tumor tissue and non-exposed tumor tissue are excluded and not shown in Figure 18.

[0095] Figure 19 shows the estimated tumor area from images obtained by irradiating the stomach with 95 wavelengths of light. The dark gray areas represent areas identified as tumors, and the light gray areas represent areas identified as normal. The table shown in the figure shows the accuracy, precision, recall, specificity, and F-measure of the pixel determination results for each image.

[0096] Figure 20 shows the estimated tumor area from images obtained by irradiating the stomach with four selected wavelengths of light. Dark gray areas represent areas identified as tumors, and light gray areas represent areas identified as normal. The table shown in the figure shows the accuracy, precision, recall, specificity, and F-measure of the pixel determination results for each image.

[0097] Comparing Figure 19 and Figure 20, it can be seen that there is not a significant difference in the judgment results. From this, it can be said that at least one of the following wavelengths of light is useful for detecting gastric cancer: 1065-1135 nm, 1180-1230 nm, 1255-1325 nm, and 1350-1425 nm.

[0098] (Examples of tumor-bearing mice) Next, an example relating to tumor-bearing mice will be described. Using the same method as in the gastric cancer example described above, a specific wavelength of light useful for cancer detection was selected. The tumor-bearing mice in this example are those that use cells derived from human colorectal cancer. In this example, training data from 11 samples (normal: 245,866 pixels, tumor: 107,078 pixels) was used. Leave-one-out cross-validation was used to evaluate the trained SVM. Figure 21 shows the contribution (regression coefficient) of the model obtained by LASSO. As in the gastric cancer example, each number on the horizontal axis represents a wavelength, with number "1" corresponding to a wavelength of 1002.45 [nm] and number "91" corresponding to a wavelength of 1571.5 [nm]. Therefore, in the examples for tumor-bearing mice, the relationship between the wavelength number and the actual wavelength is not as shown in Tables 2 and 3 above; rather, number "1" corresponds to a wavelength of 1002.45 [nm], and number "91" corresponds to a wavelength of 1571.5 [nm].

[0099] In this example, four wavelengths in the high-contribution region were selected from Figure 21. Specifically, one wavelength was selected from each peak with the highest contribution, and the wavelength range λ was selected. C1 Light from 1084.75 [nm] (wavelength number 14), wavelength range λ C2 Light from 1179.67 [nm] (wavelength number 29), wavelength range λ C3 Light from 1382.01 [nm] (wavelength number 61), and wavelength range λ C4 Light with a wavelength of 1470.46 [nm] (wavelength number 75) was selected. The wavelength selection process involved trial and error to select light considered useful for cancer identification. The wavelength range λ C1 For example, wavelengths are 1020-1140 [nm], and wavelength range λ C2 For example, wavelengths are 1140-1260 [nm], and wavelength range λ C3 For example, wavelengths are 1315-1430 [nm], and wavelength range λ C4For example, this refers to wavelengths of 1430-1535 nm. Light with wavelengths of 1020-1140 nm is an example of the first type of light, light with wavelengths of 1140-1260 nm is an example of the second type of light, light with wavelengths of 1315-1430 nm is an example of the third type of light, and light with wavelengths of 1430-1535 nm is an example of the fourth type of light. In selecting the wavelengths, trial and error was performed to select light that was considered useful for identifying cancer in tumor-bearing mice. When tumors were detected using images taken after irradiating tumor-bearing mice with these specific wavelengths of light, the accuracy shown in the table below was obtained.

[0100] [Table 7] As shown in the table above, there is no significant difference in accuracy, precision, recall, specificity, and F-measure between all wavelengths (95) and selected wavelengths (4).

[0101] Figures 22-27 show the results for tumor-bearing mice. Figure 22 is an image of the sample. Figure 23 is an image of the training data. The white areas in Figure 23 are normal areas. The gray areas within the white areas in Figure 23 correspond to tumor tissue.

[0102] Figures 24 and 25 show the estimated tumor areas from images obtained by irradiating tumor-bearing mice with 95 wavelengths of light. White areas represent areas judged as normal, and gray areas represent areas judged as tumors. The table shown in the figures shows the accuracy, precision, recall, specificity, and F-measure of the pixel judgment results for each image.

[0103] Figures 26 and 27 show the estimated tumor areas from images obtained by irradiating tumor-bearing mice with light of four selected wavelengths. White areas represent areas determined to be normal, and gray areas represent areas determined to be tumors. The table shown in the figures shows the accuracy, precision, recall, specificity, and F-measure of the pixel determination results for each image.

[0104] Comparing Figures 24 and 25 with Figures 26 and 27, it can be seen that there is not a significant difference in the judgment results. From this, it can be said that at least one of the following wavelengths of light is useful for detecting human colorectal cancer: 1020-1140 nm, 1140-1260 nm, 1315-1430 nm, and 1430-1535 nm.

[0105] Each of the above-described embodiments is applicable to the above embodiments and can be configured in a similar system configuration.

[0106] In addition, the processes that the CPU reads and executes in the above embodiment may be executed by various processors other than the CPU. Examples of such processors include PLDs (Programmable Logic Devices) such as FPGAs (Field-Programmable Gate Arrays) whose circuit configuration can be changed after manufacturing, and dedicated electrical circuits that are processors with circuit configurations specifically designed to execute specific processes, such as ASICs (Application Specific Integrated Circuits). Furthermore, each process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (for example, multiple FPGAs, and a combination of a CPU and an FPGA). More specifically, the hardware structure of these various processors is an electrical circuit that combines circuit elements such as semiconductor elements.

[0107] This disclosure is not limited to the embodiments described above, and various modifications and applications are possible without departing from the spirit of the invention.

[0108] For example, the above embodiment described the case of detecting GISTs using a neural network, but it is not limited to this. For example, GISTs may be detected using the statistical model described in the embodiment.

[0109] Furthermore, in the above embodiment, the example described was the case in which a first light representing a wavelength of 1050 to 1105 [nm], a second light representing a wavelength of 1145 to 1200 [nm], a third light representing a wavelength of 1245 to 1260 [nm], and a fourth light representing a wavelength of 1350 to 1405 [nm] are irradiated onto the digestive tract and an image is acquired, but the invention is not limited to this. At least one of these four lights may be irradiated onto the digestive tract and an image may be acquired. Similarly, in each of the above embodiments, at least one of each light may be irradiated onto a part of the living body and an image may be acquired.

[0110] Furthermore, although the above embodiment describes the detection of GIST using light of four wavelengths as an example, it is not limited to this. For example, GIST may be detected using light of multiple wavelengths whose contribution amount is above a predetermined threshold, as in the above embodiment. Similarly, in each of the above embodiments, tumors may be detected using light of multiple wavelengths whose contribution amount is above a predetermined threshold.

[0111] Furthermore, although multiple wavelengths of light were selected in each of the above embodiments, any light with a wavelength that can be considered useful from the graph shown in the figure may be selected.

[0112] The disclosure of Japanese Patent Application No. 2020-130535, filed on 31 July 2020, is incorporated herein by reference in its entirety. All documents, patent applications, and technical standards described herein are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated herein by reference.

Claims

1. The first image was captured by irradiating a part of the digestive tract of a living organism with a first light representing a wavelength of 1050-1105 [nm], A second image was captured by irradiating a part of the digestive tract of a living organism with a second light representing a wavelength of 1145-1200 [nm], A third image was captured by irradiating a third light, representing light with a wavelength of 1245-1260 [nm], onto the digestive tract of a living organism, and An image acquisition unit acquires a fourth image of the digestive tract region of a living organism, which is captured by irradiating the digestive tract region of a living organism with a fourth light representing light with a wavelength of 1350 to 1405 [nm], and an image of the digestive tract region generated by integrating these images. A determination unit inputs the image of the gastrointestinal region acquired by the image acquisition unit into a pre-generated trained model or statistical model for detecting tumors present inside the gastrointestinal region from the image of the gastrointestinal region, and determines whether or not a gastrointestinal stromal tumor is present in each part of the image of the gastrointestinal region acquired by the image acquisition unit. An image processing device equipped with the following features.

2. The aforementioned trained model or statistical model is a model that has been pre-generated based on data that associates images of gastrointestinal regions in vivo with information indicating whether or not a gastrointestinal stromal tumor is present within the gastrointestinal region shown in the images of the gastrointestinal regions in vivo. The image processing apparatus according to claim 1.

3. The determination unit inputs the pixel value of each pixel in the image of the gastrointestinal region acquired by the image acquisition unit into the trained model or the statistical model, and determines whether or not a gastrointestinal stromal tumor is present for each pixel in the image of the gastrointestinal region acquired by the image acquisition unit. The image processing apparatus according to claim 1 or claim 2.

4. Imaging is performed by irradiating the lungs of a living organism with a first light source representing light with a wavelength of 955–1020 [nm]. The first image was created, A second image was captured by irradiating the lungs of a living organism with a second light representing a wavelength of 1055–1135 [nm], A third image was captured by irradiating the lungs of a living organism with a third light representing light with a wavelength of 1135-1295 [nm], A fourth image was captured by irradiating the lungs of a living organism with a fourth light representing light with a wavelength of 1295-1510 [nm], A fifth image was captured by irradiating the lungs of a living organism with a fifth type of light representing a wavelength of 1510–1645 [nm], An image acquisition unit acquires a sixth image of the lungs generated by integrating a sixth image, which is captured by irradiating the lungs of a living organism with a sixth light representing light with a wavelength of 1820 to 2020 [nm], A determination unit inputs the lung images acquired by the image acquisition unit into a pre-generated trained model or statistical model for detecting tumors present in the lungs from the lung images, and determines whether or not tumors are present in each part of the lung images acquired by the image acquisition unit. An image processing device equipped with the following features.

5. The pre-trained model or statistical model is a model that has been pre-generated based on data that associates images of the lungs in a living organism with information indicating whether or not a tumor is present in the lungs shown in the images of the lungs in a living organism. The image processing apparatus according to claim 4.

6. The first image was captured by irradiating the stomach of a living organism with a first light representing light with a wavelength of 1065-1135 [nm], The second image was captured by irradiating the stomach of a living organism with a second light representing a wavelength of 1180-1230 [nm], A third image was captured by irradiating the stomach of a living organism with a third light representing light with a wavelength of 1255-1325 [nm], An image acquisition unit acquires a fourth image of the stomach generated by integrating a fourth image, which is captured by irradiating the stomach of a living organism with a fourth light representing light with a wavelength of 1350 to 1425 [nm], A determination unit inputs the image of the stomach acquired by the image acquisition unit into a pre-generated trained model or statistical model for detecting tumors present in the stomach from the image of the stomach, and determines whether or not a tumor is present in each part of the image of the stomach acquired by the image acquisition unit. An image processing device equipped with the following features.

7. The aforementioned trained model or statistical model is a model that has been pre-generated based on data that associates images of the stomach in vivo with information indicating whether or not a tumor is present in the stomach as seen in the images of the stomach in vivo. The image processing apparatus according to claim 6.

8. The first image was captured by irradiating the large intestine of a living organism with a first light representing a wavelength of 1020-1140 [nm], The second image was captured by irradiating the large intestine of a living organism with a second light representing a wavelength of 1140-1260 [nm], A third image was captured by irradiating the large intestine of a living organism with a third light representing light with a wavelength of 1315-1430 [nm], An image acquisition unit acquires a fourth image of the large intestine generated by integrating a fourth image, which is captured by irradiating the large intestine of a living organism with a fourth light representing light with a wavelength of 1430 to 1535 [nm], The image of the large intestine acquired by the image acquisition unit is input into a pre-generated trained model or statistical model for detecting tumors present in the large intestine from the image of the large intestine. A determination unit that determines whether or not a tumor is present in each part of the image of the large intestine acquired by the acquisition unit, An image processing device equipped with the following features.

9. The aforementioned trained model or statistical model is a model that has been pre-generated based on data that associates images of the colon in a living organism with information indicating whether or not a tumor is present in the colon as seen in the images of the colon in a living organism. The image processing apparatus according to claim 8.

10. An image processing program for causing a computer to function as a component of an image processing apparatus according to any one of claims 1 to 9.

11. An image processing method in which a computer performs the processing of each part of the image processing apparatus described in any one of claims 1 to 9.

12. The optical output section emits light, An imaging device that captures an image when light is irradiated from the light output unit onto a part of the digestive tract of a living organism, An endoscope device equipped with, The aforementioned optical output unit is A first light source, representing light with a wavelength of 1050–1105 [nm], is irradiated onto the digestive tract of a living organism. A second light, representing light with a wavelength of 1145-1200 [nm], is irradiated onto the digestive tract of a living organism. A third type of light, representing light with a wavelength of 1245-1260 [nm], is irradiated onto the digestive tract of a living organism. A fourth type of light, representing light with a wavelength of 1350-1405 [nm], is irradiated onto the digestive tract of a living organism. The imaging device is A first image is captured when the first light is irradiated onto a part of the digestive tract of a living organism. A second image is captured when the second light is irradiated onto a part of the digestive tract of a living organism. A third image is captured when the third light is irradiated onto a part of the digestive tract of a living organism. A fourth image is captured when the fourth light is irradiated onto a part of the digestive tract of a living organism. The first, second, third, and fourth images are used to determine whether or not gastrointestinal stromal tumors are present in each location of the gastrointestinal region image generated by integrating these images. Endoscope equipment.

13. The optical output section emits light, An imaging device that captures an image of a living body's lungs when light is irradiated from the aforementioned light output unit, An endoscope device equipped with, The aforementioned optical output unit is The first light, representing light with a wavelength of 955-1020 [nm], is irradiated onto the lungs of a living organism. A second light, representing light with a wavelength of 1055-1135 [nm], is irradiated onto the lungs of a living organism. A third type of light, representing light with a wavelength of 1135–1295 [nm], is irradiated onto the lungs of a living organism. A fourth type of light, representing light with a wavelength of 1295–1510 [nm], is irradiated onto the lungs of a living organism. A fifth type of light, representing light with a wavelength of 1510–1645 [nm], is irradiated onto the lungs of a living organism. The sixth type of light, representing light with a wavelength of 1820-2020 [nm], is irradiated onto the lungs of a living organism. The imaging device is A first image is captured when the first light is irradiated onto the lungs of a living organism. A second image is captured when the second light is irradiated onto the lungs of a living organism. A third image is captured when the third light is irradiated onto the lungs of a living organism. A fourth image is captured when the fourth light is irradiated onto the lungs of a living organism. A fifth image is captured when the fifth light is irradiated onto the lungs of a living organism. A sixth image is captured when the sixth light is irradiated onto the lungs of a living organism. The first, second, third, fourth, fifth, and sixth images are used to determine whether or not a tumor is present in each location of the lung image generated by integrating these images. Endoscope equipment.

14. The optical output section emits light, An imaging device that captures an image of a living body's stomach when light is irradiated from the light output unit, An endoscope device equipped with, The aforementioned optical output unit is The first light, representing light with a wavelength of 1065-1135 [nm], is irradiated onto the stomach of a living organism. A second light, representing light with a wavelength of 1180-1230 [nm], is irradiated onto the stomach of a living organism. A third type of light, representing light with a wavelength of 1255-1325 [nm], is irradiated onto the stomach of a living organism. A fourth type of light, representing light with a wavelength of 1350-1425 [nm], is irradiated onto the stomach of a living organism. The imaging device is A first image is captured when the first light is irradiated onto the stomach of a living organism. A second image is captured when the second light is irradiated onto the stomach of a living organism. A third image is captured when the third light is irradiated onto the stomach of a living organism. A fourth image is captured when the fourth light is irradiated onto the stomach of a living organism. The first, second, third, and fourth images are used to determine whether or not a tumor is present in each location of the stomach image generated by integrating these images. Endoscope equipment.

15. The optical output section emits light, An imaging device that captures an image of the large intestine of a living organism when light is irradiated from the light output unit, An endoscope device equipped with, The aforementioned optical output unit is The first light, representing light with a wavelength of 1020-1140 [nm], is irradiated onto the large intestine of a living organism. A second light, representing light with a wavelength of 1140-1260 [nm], is irradiated onto the large intestine of a living organism. A third type of light, representing light with a wavelength of 1315-1430 [nm], is irradiated onto the large intestine of a living organism. A fourth type of light, representing light with a wavelength of 1430-1535 [nm], is irradiated onto the large intestine of a living organism. The imaging device is A first image is captured when the first light is irradiated onto the large intestine of a living organism. A second image is captured when the second light is irradiated onto the large intestine of a living organism. A third image is captured when the third light is irradiated onto the large intestine of a living organism. A fourth image is captured when the fourth light is irradiated onto the large intestine of a living organism. The first, second, third, and fourth images are used to determine whether or not tumors are present in each location of the colon image generated by integrating these images. Endoscope equipment.

16. The endoscope apparatus described in claim 12 and the image processing apparatus described in claim 1 are included. Endoscopic image processing system.

17. The endoscope apparatus described in claim 13 and the image processing apparatus described in claim 4 are included. Endoscopic image processing system.

18. The endoscope apparatus described in claim 14 and the image processing apparatus described in claim 6 are included. Endoscopic image processing system.

19. The endoscope apparatus described in claim 15 and the image processing apparatus described in claim 8 are included. Endoscopic image processing system.

Images