Endoscopy system

Abstract

The present invention provides an endoscopic system that prevents misidentification of results when recognition processing is performed and when recognition processing is not performed. [Solution] The light source device includes a light source section containing at least a phosphor that emits light when irradiated with excitation light. The processor acquires an endoscopic image obtained by photographing a subject illuminated by illumination light from the light source device with an endoscope. The endoscopic image is input to a trained model that performs recognition processing on parts of the endoscopic image that have specific features. The results of the recognition processing are obtained from the trained model. The recognition processing is set to enable or disable based on the action performed on the subject. The results of the recognition processing are information indicating a lesion included in the endoscopic image, or information indicating the type or progression of the lesion, and information indicating that the recognition processing is enabled or disabled is output to the monitor.

Description

Technical Field

[0001] The present invention relates to an endoscope system that performs recognition processing of a subject using an image captured with an endoscope.

Background Art

[0002] In the medical field, an endoscope system including a light source device, an endoscope, and a processor device has become widespread. The light source device generates illumination light. The endoscope captures an image of a subject using an image sensor. The processor device performs image generation and other image processing.

[0003] An endoscope system may not only capture an image of a subject for observation but also have additional functions. For example, an endoscope system having an "input mode" for operating the position and orientation of a treatment tool with a touch panel is known (Patent Document 1). In the endoscope system of this Patent Document 1, the state of the input mode is displayed on the screen. Also, an endoscope system having a function of displaying an image indicating the bending state of the distal end of the endoscope and a character string notifying that calibration has been completed, etc., on the screen to notify system abnormalities, etc., is known (Patent Document 2). In addition, an endoscope system that displays the on or off state of a foot switch on the screen (Patent Document 3), an endoscope system that displays a mark indicating that air is being supplied on the screen (Patent Document 4), and an endoscope system that displays the on or off state of recording on the screen (Patent Document 5) are known.

[0004] Also, an endoscope system that detects a treatment tool and uses the result is known. For example, an endoscope system that determines the correction intensity of an image using the detection result of a treatment tool is known (Patent Document 6). An endoscope system that stops the autofocus function when a treatment tool is detected is known (Patent Document 7).

[0005] In addition, in recent years, an endoscope system that supports diagnosis by calculating biological function information using an image of a subject has also become known (Patent Document 8). [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2008-245840 [Patent Document 2] Japanese Patent Publication No. 2007-330405 [Patent Document 3] Japanese Patent Publication No. 2005-305574 [Patent Document 4] Japanese Patent Application Publication No. 11-10313 [Patent Document 5] Japanese Patent Application Publication No. 63-259614 [Patent Document 6] Japanese Patent Publication No. 2015-96237 [Patent Document 7] Japanese Patent Publication No. 2013-150658 [Patent Document 8] Japanese Patent Publication No. 2018-51364 [Overview of the project] [Problems that the invention aims to solve]

[0007] When obtaining information to support diagnosis (hereinafter referred to as diagnostic support information) by recognizing a subject or part of a subject with specific characteristics using medical images such as images taken using an endoscope (hereinafter referred to as endoscopic images), it is necessary to use medical images that can be processed by recognition processing when taken under specific conditions. This is because if medical images that cannot be processed by recognition processing are used, even if a result of recognition processing is obtained, the result may be inaccurate.

[0008] However, it is not always possible to obtain medical images in which recognition processing can function effectively. As a result, inaccurate recognition processing, or diagnostic support information calculated using inaccurate recognition processing results, may actually hinder the observation or diagnosis of the subject. For example, in endoscopic systems, the accuracy of recognition processing may decrease if a treatment instrument is visible in the endoscopic image.

[0009] To avoid providing inaccurate recognition processing results as described above, one possible approach is to refrain from performing recognition processing when medical images suitable for recognition processing cannot be acquired. However, simply refraining from performing recognition processing may lead users, such as physicians, to misinterpret the results of recognition processing or the results of not performing recognition processing. For example, if a device that performs recognition processing to detect potential lesions is being used, simply refraining from performing recognition processing may lead physicians to mistakenly believe that no potential lesions were detected as a result of the recognition processing. In other words, physicians may not be able to determine whether the results of recognition processing are not displayed because the processing was not performed, or because there were no objects to recognize as a result of the recognition processing.

[0010] Furthermore, when surgery or other procedures are initiated on a subject, or when a dye is sprayed and detailed observation begins, the recognition process or the display of the results of the recognition process may be automatically disabled to avoid interfering with the surgeon's operations. However, even in this case, as described above, doctors and other medical professionals may misinterpret the results of recognition processing or the results of not performing recognition processing. In addition, there is the problem that if the recognition function is automatically disabled even though the doctor or other medical professional has not explicitly disabled it, their concentration may decrease.

[0011] The present invention aims to provide an endoscope system that prevents misidentification of results in both recognized and unrecognized areas. [Means for solving the problem]

[0012] The present invention relates to an endoscope system comprising an endoscope, a light source device, and a processor, wherein the light source device includes a light source section containing a phosphor that emits light when irradiated with excitation light, and at least one processor acquires an endoscopic image obtained by photographing a subject illuminated by illumination light from the light source device with the endoscope, inputs the endoscopic image into a trained model that performs recognition processing on parts of the endoscopic image having specific features, obtains the result of the recognition processing from the trained model, and sets the recognition processing to be enabled or disabled based on an action performed on the subject, wherein the result of the recognition processing is information indicating a lesion included in the endoscopic image, or information indicating the type or progression of a lesion, and outputs information indicating that the recognition processing is enabled or disabled to a monitor.

[0013] Preferably, at least one processor further outputs the results of the recognition process to a monitor if the recognition process is enabled. Preferably, disabling the recognition process means not executing the recognition process or not reporting the results of the recognition process.

[0014] The information indicating whether the recognition process is effective or ineffective preferably indicates whether the recognition process using a trained model is effective or ineffective. It is preferable that information indicating the location of the lesion is output to the monitor as a result of the recognition process. It is also preferable that information indicating the type or progression of the lesion is output to the monitor as a result of the recognition process. The actions performed on the subject are preferably illumination, use of instruments, spraying of liquids, or cleaning of the subject. It is preferable that the actions performed on the subject are detected from the endoscopic image.

[0015] The recognition process is preferably set to be invalid when a treatment instrument is detected. The treatment instrument is preferably detected from an endoscopic image. It is preferable to detect a plurality of types of treatment instruments from the endoscopic image and set the recognition process to be invalid when a specific type of treatment instrument is detected. The recognition process is preferably set to be valid when no treatment instrument is detected.

[0016] The recognition process includes a first recognition process for acquiring information indicating the position of a lesion included in an endoscopic image, and a second recognition process for acquiring information indicating the type or degree of progression of the lesion. It is preferable that at least one processor independently sets the first recognition process and the second recognition process to be valid or invalid.

[0017] It is preferable that at least one processor outputs to the monitor information indicating whether the first recognition process is valid or invalid and information indicating whether the second recognition process is valid or invalid, respectively. When the recognition process is set to be invalid, it is preferable that at least one processor further outputs to the monitor information indicating the absence or type of an action applied to the subject together with information indicating that the recognition process is invalid.

[0018] The information indicating the type of action applied to the subject is preferably a character string, symbol or icon indicating at least one of illumination light, biopsy, liquid spraying, endoscopic resection, or subject cleaning. In addition to setting the validity or invalidity of the recognition process based on the action applied to the subject, it is preferable that at least one processor can change the setting of the validity or invalidity of the recognition process based on the type of illumination light used for taking the endoscopic image.

Advantages of the Invention

[0019] According to the present invention, an endoscopic system that can prevent misrecognition of the result of performing the recognition process and the result of not performing the recognition process can be provided.

Brief Description of the Drawings

[0020] [Figure 1] It is an external view of an endoscope system. [Figure 2] It is a block diagram of an endoscope system. [Figure 3] It is a block diagram of an image processing unit. [Figure 4] It is a flowchart showing the operation mode of an endoscope system. [Figure 5] It is an example display when the recognition unit is valid. [Figure 6] It is an example display when the recognition unit is invalid. [Figure 7] It is an example display of the second embodiment. [Figure 8] It is a list of operation states of detection and discrimination. [Figure 9] It is an example display of a modification. [Figure 10] It is an example display of operation content. [Figure 11] It is an example display of operation content. [Figure 12] It is an example display of operation content. [Figure 13] It is a block diagram of a processor device when notifying the validity or otherwise of the recognition unit by a method other than display on a monitor. [Figure 14] It is an explanatory diagram showing a medical image processing device. [Figure 15] It is an explanatory diagram showing a diagnostic support device. [Figure 16] It is an explanatory diagram showing a medical operation support device. [Embodiments for Carrying Out the Invention]

[0021] [First Embodiment] As shown in Figure 1, the endoscope system 10 (endoscope device) comprises an endoscope 12, a light source device 14, a processor device 16, a monitor 18, and a console 19. The endoscope 12 photographs the subject. The light source device 14 generates illumination light. The processor device 16 performs system control and image processing of the endoscope system 10. The monitor 18 is a display unit that displays images etc. from the endoscope 12. The console 19 is an input device for inputting settings etc. to the processor device 16, etc.

[0022] The endoscope 12 has an insertion section 12a for insertion into the subject, an operating section 12b provided at the proximal end of the insertion section 12a, a bending section 12c provided at the tip of the insertion section 12a, and a tip section 12d. By operating the angle knob 12e of the operating section 12b, the bending section 12c bends. As a result, the tip section 12d points in the desired direction. In addition to the angle knob 12e, the operating section 12b is also provided with a treatment instrument insertion port 12f, a zoom operating section 13a, and a water supply button 13b. The treatment instrument insertion port 12f is an entrance for inserting treatment instruments such as biopsy forceps, snares, or electrosurgical units. Treatment instruments inserted into the treatment instrument insertion port 12f protrude from the tip section 12d. By operating the zoom operating section 13a, the subject can be magnified or reduced for imaging. Furthermore, by operating the water supply button 13b, water or other liquid stored in the water supply tank 17 is ejected from the tip 12d.

[0023] As shown in Figure 2, the light source device 14 includes a light source unit 20 that emits illumination light and a light source control unit 22 that controls the operation of the light source unit 20.

[0024] The light source unit 20 emits illumination light to illuminate the subject. The emission of illumination light includes the emission of excitation light used to emit the illumination light. The light source unit 20 includes, for example, a laser diode (hereinafter referred to as LD), an LED (Light Emitting Diode), a xenon lamp, or a halogen lamp, and emits at least white illumination light, or excitation light used to emit white illumination light. White includes so-called pseudo-white, which is substantially equivalent to white when photographing a subject using the endoscope 12. The light source unit 20 may optionally include a phosphor that emits light when irradiated with excitation light, or an optical filter that adjusts the wavelength band, spectral spectrum, or light intensity of the illumination light or excitation light. In addition, the light source unit 20 can emit light having a specific wavelength band necessary for capturing images used to calculate biological information such as the oxygen saturation of hemoglobin contained in the subject.

[0025] In this embodiment, the light source unit 20 has four colored LEDs: V-LED20a, B-LED20b, G-LED20c, and R-LED20d. V-LED20a emits violet light VL with a central wavelength of 405nm and a wavelength band of 380-420nm. B-LED20b emits blue light BL with a central wavelength of 460nm and a wavelength band of 420-500nm. G-LED20c emits green light GL with a wavelength band of 480-600nm. R-LED20d emits red light RL with a central wavelength of 620-630nm and a wavelength band of 600-650nm. The central wavelengths of V-LED20a and B-LED20b have a range of approximately ±20nm, preferably from approximately ±5nm to approximately ±10nm.

[0026] The light source control unit 22 controls the timing of turning on, turning off, or shielding each light source constituting the light source unit 20, as well as the amount of light emitted. As a result, the light source unit 20 can emit multiple types of illumination light with different spectral characteristics. In this embodiment, the light source control unit 22 adjusts the spectral characteristics of the illumination light by inputting independent control signals to each of the LEDs 20a to 20d for turning on or off, the amount of light emitted when lit, and inserting or removing the optical filter. As a result, the light source unit 20 emits white light. The light source unit 20 can also emit illumination light consisting of at least narrowband violet light. "Narrowband" means a wavelength band that is substantially almost a single wavelength band in relation to the characteristics of the subject and / or the spectral characteristics of the color filter of the image sensor 48. For example, if the wavelength band is approximately ±20 nm or less (preferably approximately ±10 nm or less) with respect to the center wavelength, this light is narrowband.

[0027] The tip 12d of the endoscope 12 is equipped with an illumination optical system 30a and an imaging optical system 30b. The illumination optical system 30a has an illumination lens 45, and illumination light is emitted toward the subject through this illumination lens 45.

[0028] The imaging optical system 30b includes an objective lens 46, a zoom lens 47, and an image sensor 48. The image sensor 48 captures the subject using reflected light from the subject (including scattered light, fluorescence emitted by the subject, or fluorescence caused by drugs administered to the subject) via the objective lens 46 and the zoom lens 47. The zoom lens 47 moves by operating the zoom control unit 13a, enlarging or reducing the image of the subject.

[0029] The image sensor 48 has one color filter from among multiple color filters for each pixel. In this embodiment, the image sensor 48 is a color sensor having primary color filters. Specifically, the image sensor 48 has R pixels having a red color filter (R filter), G pixels having a green color filter (G filter), and B pixels having a blue color filter (B filter).

[0030] The image sensor 48 can be a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. While the image sensor 48 in this embodiment is a primary color sensor, a complementary color sensor can also be used. A complementary color sensor, for example, has cyan pixels with a cyan color filter, magenta pixels with a magenta color filter, yellow pixels with a yellow color filter, and green pixels with a green color filter. When using a complementary color sensor, the images obtained from the pixels of each color can be converted to images similar to those obtained with a primary color sensor by performing a complementary-to-primary color conversion. The same applies when a primary or complementary color sensor has one or more types of pixels with characteristics other than those described above, such as W pixels (white pixels that receive light across almost the entire wavelength band). Furthermore, while the image sensor 48 in this embodiment is a color sensor, a monochrome sensor without a color filter may also be used.

[0031] The processor device 16 includes a control unit 52, an image acquisition unit 54, an image processing unit 61, a notification unit 65, and a display control unit 66 (see Figure 2).

[0032] The control unit 52 performs overall control of the endoscope system 10, including synchronized control of the illumination timing and the timing of image capture. When various settings are entered using the console 19 or the like, the control unit 52 inputs those settings to the respective parts of the endoscope system 10, such as the light source control unit 22, the image sensor 48, or the image processing unit 61.

[0033] The image acquisition unit 54 acquires an image of the subject. More specifically, the image acquisition unit 54 acquires an image of the subject using pixels of each color from the image sensor 48, i.e., a RAW image. Furthermore, the RAW image is the image before demosaicing is performed. The RAW image also includes images that have undergone arbitrary processing such as noise reduction on the image acquired from the image sensor 48, as long as it is the image before demosaicing is performed.

[0034] The image acquisition unit 54 includes a DSP (Digital Signal Processor) 56, a noise reduction unit 58, and a conversion unit 59 in order to generate an endoscopic image by performing various processing on the acquired RAW image as needed.

[0035] The DSP56 includes, for example, an offset processing unit, a defect correction processing unit, a demosaicing processing unit, an interpolation processing unit, a linear matrix processing unit, and a YC conversion processing unit (none of which are shown in the diagram). The DSP56 uses these to perform various processes on a RAW image or an image generated using a RAW image.

[0036] The offset processing unit performs offset processing on the RAW image. Offset processing is a process that reduces the dark current component from the RAW image and sets an accurate zero level. Offset processing is sometimes referred to as clamping processing. The defect correction processing unit performs defect correction processing on the RAW image. Defect correction processing is a process that corrects or generates the pixel values ​​of the RAW pixels corresponding to the defective pixels of the image sensor 48 when the image sensor 48 contains pixels (defective pixels) that have defects due to the manufacturing process or changes over time. The demosaicing processing unit performs demosaicing processing on the RAW images of each color corresponding to each color filter. Demosaicing processing is a process that generates pixel values ​​that are missing in the RAW image due to the arrangement of the color filters by interpolation. The linear matrix processing unit performs linear matrix processing on the endoscopic image generated by assigning one or more RAW images to each RGB color channel. Linear matrix processing is a process that improves the color reproducibility of the endoscopic image. The YC conversion processing unit converts the endoscopic image generated by assigning one or more RAW images to each RGB color channel into an endoscopic image having a luminance channel Y and chrominance channels Cb and Cr.

[0037] The noise reduction unit 58 applies noise reduction processing to the endoscopic image having a luminance channel Y, a chrominance channel Cb, and a chrominance channel Cr, for example, using a moving average method or a median filter method. The conversion unit 59 converts the luminance channel Y, chrominance channel Cb, and chrominance channel Cr after noise reduction processing back into an endoscopic image having channels for each of the BGR colors.

[0038] The image processing unit 61 performs necessary image processing on the endoscopic image output by the image acquisition unit 54. The image processing unit 61 also performs recognition processing using the endoscopic image to recognize a subject or part of a subject that has specific characteristics. Specifically, as shown in Figure 3, the image processing unit 61 includes an image generation unit 71, a recognition unit 72, a discrimination unit 73, and a setting unit 74, etc.

[0039] The image generation unit 71 acquires endoscopic images from the image acquisition unit 54 and generates endoscopic images for display on the monitor 18, etc. For example, the image generation unit 71 acquires B images taken using B pixels, G images taken using G pixels, and R images taken using R pixels from the image acquisition unit 54, and generates an endoscopic image for display using all or part of these.

[0040] Furthermore, when generating an endoscopic image for display, the image generation unit 71 performs necessary image processing on the endoscopic image acquired from the image acquisition unit 54, or on the image generated using the endoscopic image acquired from the image acquisition unit 54. The image processing performed by the image generation unit 71 is, for example, enhancement processing to highlight the subject or a part of the subject. Enhancement means distinguishing a specific part from other tissues or structures so that information about that part can be obtained. For example, processing such as enclosing a part with specific features in a frame, showing its outline, or changing its color or brightness relative to other parts (e.g., normal mucosa) is an example of enhancement processing. "Making information obtainable" includes making it possible to recognize the position, shape, color or brightness, and / or size (range) of a specific part, as well as making it possible to obtain biological function information (e.g., oxygen saturation or blood vessel density) about a specific part.

[0041] The recognition unit 72 performs recognition processing to recognize the subject using the image of the subject that has been captured. "Recognizing the subject" means detecting the presence or absence of a part of the subject having a specific characteristic (including detecting the entire subject), differentiating the type or progression of the part of the subject having a specific characteristic (including differentiating the entire subject), and / or obtaining (calculating, etc.) biological function information for part or all of the subject. A part of the subject having a specific characteristic is, for example, a lesion, a candidate for a lesion, or a trace of treatment (hereinafter referred to as lesion, etc.). In other words, the recognition unit 72 can recognize the presence or absence of lesion, etc. through recognition processing. The recognition unit 72 can also recognize the type or progression of lesion, etc. through recognition processing. Recognition of the type of lesion, etc. means, for example, if the lesion, etc. is a polyp, differentiating it into adenoma, hyperplastic polyp, or cancer, etc. Recognizing the progression of a lesion, for example, if the lesion is cancer, it means determining the stage of cancer, or differentiating it according to NICE (NBI (Narrow Band Imaging) International Colorectal Endoscopic Classification) classification or JNET (The Japan NBI Expert Team) classification. In this embodiment, the image of the subject is an endoscopic image acquired by the image acquisition unit 54, or an endoscopic image generated by the image generation unit 71. In this embodiment, the recognition unit 72 detects lesions, etc., through recognition processing.

[0042] The recognition unit 72 is, for example, artificial intelligence (AI) with learning capabilities. Specifically, the recognition unit 72 is an AI that has been trained using machine learning algorithms such as neural networks (NN), convolutional neural networks (CNN), adaboost, and random forests. Furthermore, since the recognition unit 72 is trained to perform recognition processing using specific images, even if it can perform recognition processing using other images, the accuracy of the recognition processing results may be low. In this embodiment, the recognition unit 72 is an AI that has been trained to detect lesions, etc., using endoscopic images. "Having learning capabilities" means being able to learn, and includes being trained. Note that instead of being composed of AI, the recognition unit 72 can be configured to calculate feature quantities from images and perform detection, etc., using the calculated feature quantities.

[0043] In this embodiment, the recognition unit 72 comprises a detection unit 76 and a differentiation unit 77. The detection unit 76 is an AI that has been trained to detect lesions, etc., using endoscopic images. The differentiation unit 77 is an AI that has been trained to differentiate the progression of lesions, etc., using endoscopic images.

[0044] The recognition unit 72 inputs the results of the recognition process to the image generation unit 71 or the display control unit 66 according to the content of the recognition process. When the recognition unit 72 inputs the results of the recognition process to the image generation unit 71, the image generation unit 71 generates an endoscope image for display that reflects the results of the recognition process. When the recognition unit 72 inputs the results of the recognition process to the display control unit 66, the display control unit 66 displays the results of the recognition process on the monitor 18 screen along with the endoscope image acquired from the image generation unit 71. The recognition unit 72 inputs the results of the recognition process to the image generation unit 71, for example, when changing the color of the endoscope image for display using the values ​​of biological function information that are the result of the recognition process. The recognition unit 72 inputs the results of the recognition process to the display control unit 66, for example, when indicating the location of lesions, etc., that are the result of the recognition process by displaying a frame superimposed on the endoscope image. In this embodiment, the recognition unit 72 inputs information such as the location of detected lesions, etc., that are the result of the recognition process, to the image generation unit 71. The image generation unit 71 then generates an endoscopic image for display in which areas with lesions or other abnormalities have been enhanced.

[0045] The discrimination unit 73 discriminates operations on the subject. Operations on the subject refer to any action that applies some (arbitrary) effect to the subject. For example, procedures related to the collection of biological tissue for use in biological tissue examination (biopsy), surgery or treatment such as endoscopic mucosal resection (EMR), spraying liquid on the subject, or washing the subject are operations on the subject. Spraying liquid on the subject refers to administering a liquid drug to the subject or spraying water on the subject. Spraying water refers to pouring water on part or all of the subject. Furthermore, drug administration includes spraying dyes such as indigo carmine on the subject, as well as intravenously injecting fluorescent agents such as indocyanine green (ICG) into the subject. Washing the subject refers to washing away residue, residual liquid, or substances that may interfere with observation, such as blood, attached to the subject with water or air, and exposing the subject to be observed to the endoscope 12. Furthermore, even if an action does not ultimately affect the subject, any action that could potentially affect the subject is included in "manipulation of the subject." For example, the act of blowing air to clean the subject is considered an operation of the subject, even if the subject is not ultimately cleaned. In addition, "manipulation of the subject" includes a series of related actions before and after an action is taken on the subject. For example, the act of extending forceps from the endoscope 12 when performing a biopsy is a series of actions related to the biopsy, even before tissue is collected, and is therefore included in "manipulation of the subject."

[0046] The determination of an operation on a subject refers to detecting an operation on the subject, or detecting that an operation has been performed on the subject. Operation determination is performed, for example, by detecting the use of a treatment instrument, detecting treatment marks (including detection of surgical scars, detection of bleeding caused by the procedure, detection of tissue or structures whose color has changed due to the spraying of dyes, etc.), or detection of operation of the water supply button 13b, etc. The determination unit 73 can detect the presence or absence of a treatment instrument, or the type (shape, etc.) of the treatment instrument, using endoscopic images or setting information, etc. The determination unit 73 can detect the above treatment instruments, etc. (including the spraying of water) by analyzing endoscopic images. In addition, the determination unit 73 can detect operation of the water supply button 13b, etc. by acquiring signals or setting information from the control unit 52.

[0047] The determination of an operation on a subject includes determining whether an operation has occurred on the subject and determining the type of operation. Determining whether an operation has occurred includes detecting an "operation on the subject" to be detected, regardless of the type of operation. Furthermore, determining the type of operation on a subject means distinguishing the content of the operation (for example, whether it is a biopsy or drug administration) to determine whether an operation has occurred on the subject. In this embodiment, the determination unit 73 determines whether an operation has occurred on the subject.

[0048] The setting unit 74 uses the determination result of the determination unit 73 to set the recognition unit 72 to be enabled or disabled. The determination result of the determination unit 73 is whether or not an operation was performed on the subject, and / or the type of operation performed on the subject. "Setting the recognition unit 72 to be enabled" means enabling the recognition processing performed by the recognition unit 72, setting the recognition unit 72 to execute the recognition processing, setting it to notify the results of the recognition processing, or setting the recognition unit 72 to output the results of the recognition processing. "Setting the recognition unit 72 to be disabled" means disabling the recognition processing performed by the recognition unit 72, setting the recognition unit 72 not to execute the recognition processing, setting it not to notify the results of the recognition processing, or setting it not to output the results of the recognition processing. In other words, "setting the recognition unit 72 to be enabled or disabled" means enabling or disabling the recognition processing performed by the recognition unit 72, or enabling or disabling the notification of the results of the recognition processing (or output of the results of the recognition processing). "Notification of the results of the recognition process" means making the results of the recognition process available for recognition by a doctor or other medical professional. "Output of the results of the recognition process" means that the recognition unit 72 hands over the results of the recognition process to another processing unit such as the image generation unit 71. In this embodiment, the setting unit 74 sets the recognition process performed by the recognition unit 72 to be enabled or disabled.

[0049] When the discrimination unit 73 determines whether or not an operation has been performed on the subject, the setting unit 74 disables the recognition unit 72 if an operation has been performed on the subject, and enables the recognition unit 72 if no operation has been performed on the subject. This is because if an operation has been performed on the subject, the accuracy of the recognition process may decrease, or the doctor or other person needs to concentrate on the operation.

[0050] When the discrimination unit 73 determines the type of operation performed on the subject, the setting unit 74 disables the recognition unit 72 if a specific operation is performed on the subject. A specific operation is one that reduces the accuracy of the recognition processing performed by the recognition unit 72, or one that requires the doctor or other medical professional to concentrate on the operation. Therefore, when the discrimination unit 73 determines the type of operation performed on the subject, the setting unit 74 can enable the recognition unit 72 depending on the type of operation. This allows for the continuation of appropriate diagnostic support depending on the situation.

[0051] Furthermore, if the recognition unit 72 performs multiple types of recognition processing, the setting unit 74 can enable or disable each recognition processing. For example, when the setting unit 74 enables or disables the recognition unit 72, it can also enable or disable the detection unit 76, and enable or disable the identification unit 77 independently of the enabled or disabled setting of the detection unit 76. Of course, the setting unit 74 can enable or disable the entire recognition unit 72, including both the detection unit 76 and the identification unit 77. In this embodiment, the setting unit 74 enables or disables the entire recognition unit 72, i.e., the detection unit 76 and the identification unit 77, together.

[0052] The notification unit 65, for example, obtains a determination result from the determination unit 73 (or obtains information related to the settings of the recognition unit 72 from the setting unit 74) and notifies the enabled or disabled state of the recognition unit 72. To "notify" the enabled or disabled state of the recognition unit 72 means to make it possible for a user, such as a doctor, to know whether the recognition unit 72 is enabled or disabled. For example, the notification unit 65 can notify the enabled or disabled state of the recognition unit 72 by displaying, not displaying, or changing the display of messages (strings of characters), characters, figures, and / or symbols (including displays of marks, icons, or indicators) on the screen of the monitor 18. In addition, the notification unit 65 can notify the enabled or disabled state of the recognition unit 72 by turning on, turning off, or flashing a lamp, making sounds (including voice), vibrating a component with a vibration function, or changing these. Of course, the notification unit 65 can notify the enabled or disabled status of the recognition unit 72 by combining a string of characters, the illumination of a lamp, etc. In this embodiment, the notification unit 65 displays the enabled or disabled status of the recognition unit 72 on the screen of the monitor 18.

[0053] The display control unit 66 converts the endoscopic image output by the image processing unit 61 into a format suitable for display and outputs it to the monitor 18. As a result, the monitor 18 displays the endoscopic image. In this embodiment, the notification unit 65 inputs information indicating whether the recognition unit 72 is enabled or disabled. Therefore, the display control unit 66 displays this information on the screen of the monitor 18.

[0054] The endoscope system 10 configured as described above operates as follows in notifying the enabled or disabled state of the recognition unit 72. As shown in Figure 4, when a subject is photographed using the endoscope 12 (step S111), the image acquisition unit 54 acquires the endoscope image. Then, the image generation unit 71 performs the necessary image processing to generate an endoscope image for display (step S112).

[0055] Subsequently, or in parallel with the endoscopic image for display, the discrimination unit 73 uses the endoscopic image for display to determine whether an operation has been performed on the subject (step S113). If there is no operation on the subject (step S113: YES), the setting unit 74 enables the recognition unit 72 (step S114). Therefore, the recognition unit 72 performs recognition processing on the endoscopic image for display (step S115). In this embodiment, the recognition unit 72 has a detection unit 76 and a differentiation unit 77, and the setting unit 74 enables or disables them together. Therefore, if there is no operation on the subject, the recognition unit 72 performs recognition processing for both detection and differentiation of lesions, etc. Subsequently, the recognition unit 72 outputs the recognition result to the image generation unit 71. The image generation unit 71 uses the recognition result to generate an endoscopic image for display, for example, with lesions highlighted, and outputs it to the display control unit 66. As a result, the monitor 18 displays the endoscopic image on the screen. Furthermore, the notification unit 65 notifies the system that the recognition unit 72 is enabled (step S116). Here, the setting unit 74 sets the recognition unit 72 to be enabled, so the notification unit 65 displays a string of characters or the like on the monitor 18 screen indicating that the recognition unit 72 is enabled. For example, as shown in Figure 5, the notification unit 65 displays "AI: ON" 122 on the monitor 18 screen that displays the endoscopic image 121. This notifies the system that the recognition unit 72 is enabled. The endoscopic image 121 is an image in which there is no manipulation of the subject and no lesions or other abnormalities are visible.

[0056] On the other hand, if the discrimination unit 73 detects an operation on the subject (step S113: NO), the setting unit 74 disables the recognition unit 72 (step S117). As a result, the recognition unit 72 does not perform either detection or identification, and the image generation unit 71 outputs the generated endoscopic image for display to the display control unit 66. As a result, the monitor 18 displays the endoscopic image on the screen. The notification unit 65 also notifies that the recognition unit 72 is disabled (step S118). For example, as shown in Figure 6, the notification unit 65 displays "AI: OFF" 127 on the screen of the monitor 18 displaying the endoscopic image 126. This notifies that the recognition unit 72 is disabled. Note that the endoscopic image 126 contains a biopsy forceps 128. Therefore, the recognition unit 72 is disabled.

[0057] As described above, the endoscope system 10 uses a discrimination unit 73 to determine operations on the subject, and a setting unit 74 to enable or disable the recognition unit 72 using the discrimination result of the discrimination unit 73. Therefore, because the endoscope system 10 enables or disables the recognition unit 72 according to the observation situation, users such as doctors do not have to manually enable or disable the recognition unit 72 themselves during the observation, which is convenient. However, if the recognition unit 72 is only set to enable or disable automatically, doctors may misinterpret the results of the recognition processing or the results of not performing the recognition processing. For example, if there is a preconceived notion that the recognition unit 72 is enabled, and the recognition unit 72 is automatically disabled and the results of the recognition processing are not displayed, doctors may mistakenly believe that there are no lesions, etc., even if there are, because the recognition unit 72 has performed the recognition processing. Therefore, in the endoscope system 10, a notification unit 65 notifies the enabled or disabled status of the recognition unit 72. Therefore, by looking at the "AI: ON" display 122 or the "AI: OFF" display 127, it is clear whether the recognition unit 72 is performing recognition processing or not, thus preventing the above-mentioned misidentification. As a result, misdiagnosis can be prevented.

[0058] [Second Embodiment] When the setting unit 74 sets the recognition process to be enabled or disabled, the notification unit 65 can notify the enabled or disabled status for each recognition process. For example, if the recognition unit 72 has a detection unit 76 and an identification unit 77, and the setting unit 74 sets the detection unit 76 and the identification unit 77 to be enabled or disabled, as shown in Figure 7, the notification unit 65 can notify the status by displaying an indicator 223 showing the enabled or disabled status of the detection unit 76 and an indicator 224 showing the enabled or disabled status of the identification unit 77 in the display field 222 that shows the enabled or disabled status of the recognition unit 72. For example, the indicator 223 "Detection: ON" indicates that the detection unit 76 is enabled, and the indicator "Detection: OFF" (not shown) indicates that the detection unit 76 is disabled. Similarly, the "Identification: ON" display 224 indicates that the identification unit 77 is enabled, and the "Identification: OFF" (not shown) display indicates that the identification unit 77 is disabled.

[0059] As described above, when the setting unit 74 sets whether to enable or disable each recognition process, it is possible to enable the recognition process appropriate to the observation situation and disable the others. Therefore, the endoscopy system 10 can provide optimal diagnostic support. Furthermore, since the notification unit 65 notifies whether each recognition process is enabled or disabled, physicians and others can accurately understand whether each recognition process is enabled or disabled. Therefore, misinterpretation of the results of recognition processes or the results of not performing recognition processes can be prevented, and as a result, misdiagnosis can be prevented.

[0060] In the second embodiment described above, an example is shown in which both the detection unit 76 and the identification unit 77 are active. However, as shown in Figure 8, depending on the determination status of the discrimination unit 73, it may be appropriate to activate only the detection unit 76, to activate only the identification unit 77, or to disable both the detection unit 76 and the identification unit 77.

[0061] "Discrimination Situation 1" is a situation in which it is appropriate to enable both the detection unit 76 and the identification unit 77, for example, when there is no manipulation of the subject, or when the subject has been washed with water, etc. These are situations in which detection and identification of lesions, etc., are highly likely to be required.

[0062] "Discrimination Situation 2" is a situation in which it is appropriate to enable the detection unit 76 and disable the differentiation unit 77. For example, when performing a biopsy or surgery, bleeding from the subject is the object of discrimination (detection target) of the discrimination unit 73, that is, when detection of bleeding is necessary to confirm hemostasis, but differentiation is unnecessary because surgery or other procedures have already been performed. The discrimination unit 73 can determine the above situation, for example, by the type of operation performed on the subject.

[0063] "Discrimination Situation 3" is a situation in which it is appropriate to disable the detection unit 76 and enable the differentiation unit 77. For example, this is the case when a lesion has already been found and there is no need to detect it again, and when it is desired to receive more detailed diagnostic support from the endoscopy system 10 in diagnosing the discovered lesion. Specifically, this is the case when a dye agent is sprayed on the subject and it is desired to differentiate the progression of the lesion. The discrimination unit 73 can determine the above situation, for example, by the type of operation performed on the subject.

[0064] "Discrimination Situation 4" is a situation in which it is appropriate to disable both the detection unit 76 and the identification unit 77. For example, this is the case when a biopsy or surgery is performed where the detection and identification of lesions, etc., have been completed and the operator needs to concentrate on the operation. The discrimination unit 73 can determine the above situation depending on the type of operation. If the discrimination unit 73 detects bleeding from the subject, for example, the situation becomes discrimination situation 3.

[0065] In the second embodiment described above, the enabled or disabled status of the detection unit 76 and the identification unit 77 is indicated by "ON" or "OFF". However, the enabled or disabled status of the detection unit 76 and the identification unit 77 can be indicated by other indicators. For example, instead of "OFF", an indicator such as "Not Supported" may be used. Also, even if the detection unit 76 or the identification unit 77 is enabled, if the accuracy (certainty or reliability) of the recognition process is low, an indicator such as "Unsupported" can be displayed instead of "ON". For example, in discrimination situation 3, if the identification unit 77 is not capable of identifying a subject to which a dye agent has been sprayed, the accuracy of identification will decrease, so the indicators "Detection: OFF" and "Identification: Unsupported" can be displayed. These changes to the display modes can also be made in the first embodiment.

[0066] [Third Embodiment] In the first and second embodiments described above, the notification unit 65 notifies whether the recognition unit 72 is enabled or disabled. In addition, the notification unit 65 can also notify whether an operation has been determined by the discrimination unit 73, or the type of operation. That is, in addition to the enabled or disabled status of the recognition unit 72, the notification unit 65 can notify the determination result of the discrimination unit 73.

[0067] For example, if the discrimination unit 73 detects an operation on the subject, as shown in Figure 9, the notification unit 65 can notify that an operation on the subject has been detected by displaying "Actions" (operation) 301, in addition to notifying whether the recognition unit 72 is enabled or disabled, such as by displaying "AI: OFF" 127. The endoscopic image 310 is an endoscopic image in which the dye agent 311 has been sprayed on the subject.

[0068] As described above, when the notification unit 65 notifies whether or not an operation has been performed on the subject, doctors and others can recognize the reason for the effectiveness or ineffectiveness of the recognition unit 72. As a result, misidentification of the results of the recognition process or the results of not performing the recognition process can be prevented more reliably, and misdiagnosis can be prevented.

[0069] Furthermore, the notification unit 65 can notify the type of operation identified by the discrimination unit 73. For example, as shown in Figure 10, the notification unit 65 can display a list of options in the operation type display field 313, such as "Biopsy" for biopsy, "Chromo" for dye application, and "Resection" for endoscopic resection, and can also notify the type of operation identified by the discrimination unit 73 by placing a check mark ("✓") next to the operation type identified by the discrimination unit 73 ("Chromo" in Figure 10).

[0070] As described above, when the discrimination unit 73 determines the type of operation, the notification unit 65 notifies the type of operation determined by the discrimination unit 73, allowing doctors and others to understand in detail the reason for the effectiveness or ineffectiveness of the recognition unit 72. As a result, misidentification of the results of the recognition process or the results of not performing the recognition process can be prevented more reliably, and misdiagnosis can be prevented.

[0071] Furthermore, the notification of whether or not an operation was performed on the subject or the type of operation in the third embodiment described above can also be applied when enabling or disabling and notifying for each recognition process, as in the second embodiment. In this case, the monitor 18 should display a display field 222 (see Figure 7) indicating the enabled or disabled status of the recognition unit 72, and an "Actions" display 301 or an operation type display field 313.

[0072] Furthermore, in the third embodiment described above, the presence or absence of an operation on the subject, or the type of operation, can be indicated by a display other than text or strings. For example, as shown in Figure 11, the operation type display field 313 displays a list of icons: an icon 331 indicating biopsy, an icon 332 indicating the application of a dye agent, and an icon 333 indicating endoscopic resection. The type of operation determined by the discrimination unit 73 can be indicated by coloring the icon corresponding to the type of operation determined by the discrimination unit 73. In Figure 11, since there is a biopsy forceps 128 in the endoscopic image 321, the biopsy icon 331 is colored.

[0073] As described above, when the type of operation is indicated by an icon, as shown in Figure 12, the operation type display field 313 can display only the icon corresponding to the type of operation determined by the discrimination unit 73. The same applies when the type of operation on the subject is displayed as a string in the operation type display field 313 (see Figure 10); the operation type display field 313 can display only the string indicating the type of operation determined by the discrimination unit 73.

[0074] In the first, second, and third embodiments, the setting unit 74 enables or disables the recognition processing performed by the recognition unit 72. Alternatively, the setting unit 74 can enable or disable the recognition unit 72 by enabling or disabling the notification of the results of the recognition processing. In this case, when disabling the notification of the results of the recognition processing, the setting unit 74 stops outputting the recognition results to, for example, the image generation unit 71, while keeping the detection unit 76 and the identification unit 77 enabled, so that doctors and others cannot know the recognition results. As a result, the recognition unit 72 can be enabled or disabled more simply and quickly than when enabling or disabling the recognition processing itself.

[0075] In the first, second, and third embodiments, the notification unit 65 notifies the enabled or disabled state of the recognition unit 72 by displaying it on the monitor 18 screen. However, when the enabled or disabled state of the recognition unit 72 is to be notified in a manner other than displaying it on the monitor 18 screen, the processor device 16 may be equipped with a notification device 171, as shown in Figure 13. The notification device 171 is a speaker that emits sound or voice, an indicator composed of light-emitting elements such as LEDs, or a vibrating element such as a motor or piezoelectric element. In addition, the notification unit 65 can use elements provided by the endoscope system 10 as the notification device 171. Furthermore, the notification device 171 may be provided in a device other than the processor device 16, i.e., the endoscope 12 or the light source device 14.

[0076] As shown in Figure 14, the recognition unit 72, discrimination unit 73, setting unit 74, and / or notification unit 65 can be provided in a medical image processing device 901 that communicates with a processor device 16 and cooperates with the endoscope system 10. Also, as shown in Figure 15, the recognition unit 72, discrimination unit 73, setting unit 74, and / or notification unit 65 can be provided in a diagnostic support device 911 that acquires RAW images taken by the endoscope 12, either directly from the endoscope system 10 (including those without a notification unit 65, etc.) or indirectly from a PACS (Picture Archiving and Communication Systems) 910. Furthermore, as shown in Figure 16, the recognition unit 72, discrimination unit 73, setting unit 74, and / or notification unit 65 can be provided in a medical business support device 930 that connects to various inspection devices, including the endoscope system 10, such as the first inspection device 921, the second inspection device 922, ..., and the Kth inspection device 923, via a network 926.

[0077] In other words, the present invention includes a medical image processing device and its operation method, comprising: an image acquisition unit for acquiring an image of a subject; a recognition unit for performing recognition processing to recognize the subject using the image; a discrimination unit for determining an operation on the subject; a setting unit for setting the recognition unit to be enabled or disabled using the discrimination result of the discrimination unit; and a notification unit for notifying the enabled or disabled state of the recognition unit. The present invention also includes a diagnostic support device and its operation method, comprising: an image acquisition unit for acquiring an image of a subject; a recognition unit for performing recognition processing to recognize the subject using the image; a discrimination unit for determining an operation on the subject; a setting unit for setting the recognition unit to be enabled or disabled using the discrimination result of the discrimination unit; and a notification unit for notifying the enabled or disabled state of the recognition unit. Similarly, the present invention includes a medical business support device and its operation method, comprising: an image acquisition unit for acquiring an image of a subject; a recognition unit for performing recognition processing to recognize the subject using the image; a discrimination unit for determining an operation on the subject; a setting unit for setting the recognition unit to be enabled or disabled using the discrimination result of the discrimination unit; and a notification unit for notifying the enabled or disabled state of the recognition unit.

[0078] The present invention also includes an operation method for an endoscope system comprising: an image acquisition unit acquiring an image of a subject; a recognition unit performing recognition processing to recognize the subject using the image; a setting unit comprising a discrimination unit for determining an operation on the subject, and a setting unit for enabling or disabling the recognition unit using the discrimination result of the discrimination unit; and a notification unit for notifying the enabled or disabled state of the recognition unit. The present invention also includes a processor device and an operation method thereof comprising: an image acquisition unit acquiring an image of a subject; a recognition unit performing recognition processing to recognize the subject using the image; a discrimination unit for determining an operation on the subject; a setting unit for enabling or disabling the recognition unit using the discrimination result of the discrimination unit; and a notification unit for notifying the enabled or disabled state of the recognition unit.

[0079] Furthermore, a capsule endoscope can be used as the endoscope 12. In this case, the light source device 14 and part of the processor device 16 can be mounted on the capsule endoscope.

[0080] In the above embodiment, the hardware structure of the processing unit that performs various processes such as the recognition unit 72, the discrimination unit 73, the setting unit 74, or the notification unit 65 is a various type of processor as shown below. These various processors include a CPU (Central Processing Unit), a general-purpose processor that executes software (programs) and functions as various processing units; a GPU (Graphical Processing Unit); a Programmable Logic Device (PLD), a processor whose circuit configuration can be changed after manufacturing, such as an FPGA (Field Programmable Gate Array); and a dedicated electrical circuit, a processor with a circuit configuration specifically designed to perform various processes.

[0081] A single processing unit may be composed of one of these various processors, or it may be composed of a combination of two or more processors of the same or different types (for example, multiple FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). Alternatively, multiple processing units may be composed of a single processor. Examples of composing multiple processing units with a single processor include, firstly, a configuration where one or more CPUs and software are combined to form a single processor, and this processor functions as multiple processing units, as is typical of computers such as clients and servers. Secondly, a configuration using a processor that realizes the functions of the entire system, including multiple processing units, on a single IC (Integrated Circuit) chip, as is typical of a System on a Chip (SoC). Thus, various processing units are configured, in terms of hardware structure, using one or more of the above-mentioned various processors.

[0082] Furthermore, the hardware structure of these various processors is, more specifically, an electrical circuit in the form of a combination of circuit elements such as semiconductor devices.

[0083] Furthermore, the present invention can be used not only in endoscopic systems, processor devices, and other related devices for acquiring endoscopic images, but also in systems or devices for acquiring medical images other than endoscopic images (including video). For example, the present invention can be applied to ultrasound examination devices, X-ray imaging devices (including CT (Computed Tomography) examination devices and mammography devices, etc.), MRI (magnetic resonance imaging) devices, etc. [Explanation of symbols]

[0084] 10 Endoscopy Systems 12 Endoscopes 12a Insertion section 12b Operation section 12c curved section 12d Tip 12e Angle Knob 12f Instrument insertion port 13a Zoom control section 13b Water supply button 14 Light source device 16 Processor Unit 17 Water supply tank 18 monitors 19 Console 20 Light source section 22 Light source control unit 30a illumination optical system 30b Imaging optical system 45 Illumination Lens 46 Objective lens 47 Zoom Lens 48 Image Sensors 52 Control Unit 54 Image acquisition unit 56 DSP 58 Noise Reduction Section 59 Conversion section 61 Image Processing Unit 65 Hochi Department 66 Display Control Unit 71 Image generation unit 72 Recognition part 73 Discrimination part 74 Settings Section 76 Detection unit 77 Identification Department 121, 126, 310, 321 Endoscopic images 122, 127, 223, 224, 301 display 128 Forceps 171 Notification devices 222 Display field 311 Dyeing agents 313 Type display field Icons 331, 332, 333 901 Medical Image Processing Equipment 910 PACS 911 Diagnostic support device 921 First Inspection Device 922 Second Inspection Device 923 K Inspection Device 926 Network 930 Medical Business Support Device S111~S118 Steps of Operation

Claims

1. An endoscope system comprising an endoscope, a light source device, and a processor, The light source device comprises a light source section including at least a phosphor that emits light when irradiated with excitation light, At least one of the processors acquires an endoscopic image obtained by photographing a subject illuminated by illumination light from the light source device with the endoscope, The endoscopic image is input into a trained model that performs recognition processing on parts of the endoscopic image that have specific features. The results of the recognition process are obtained from the aforementioned trained model. The recognition process is enabled or disabled based on an action performed on the subject. The result of the recognition process is information indicating a lesion included in the endoscopic image, or information indicating the type or progression of the lesion. An endoscope system that outputs information to a monitor indicating that the recognition process is effective or that the recognition process is ineffective.

2. At least one of the processors is The endoscope system according to claim 1, wherein if the recognition process is enabled, the result of the recognition process is further output to the monitor.

3. The endoscopic system according to claim 1 or 2, wherein the invalidation of the recognition process means not executing the recognition process or not providing notification of the results of the recognition process.

4. The endoscope system according to any one of claims 1 to 3, wherein the information indicating that the recognition process is effective or the information indicating that the recognition process is ineffective indicates that the recognition process using the trained model is effective or that the recognition process is ineffective.

5. The endoscopic system according to any one of claims 1 to 4, wherein as a result of the recognition process, information indicating the location of the lesion is output to the monitor.

6. The endoscopic system according to any one of claims 1 to 4, wherein as a result of the recognition process, information indicating the type or progression of the lesion is output to the monitor.

7. The endoscopic system according to any one of claims 1 to 6, wherein the action performed on the subject is illumination of the subject, use of a treatment instrument, spraying of liquid, or cleaning of the subject.

8. The endoscopic system according to any one of claims 1 to 7, wherein the act of applying an action to the subject is detected from the endoscopic image.

9. The endoscope system according to any one of claims 1 to 8, wherein the recognition process is configured to be disabled when a treatment instrument is detected.

10. The endoscopic system according to claim 9, wherein the treatment instrument is detected from the endoscopic image.

11. Multiple types of the aforementioned treatment instruments are detected from the endoscopic image, The endoscope system according to claim 9 or 10, configured to disable the recognition process when a specific type of the treatment instrument is detected.

12. The endoscope system according to any one of claims 1 to 8, wherein the recognition process is set to be enabled when no treatment instrument is detected.

13. The aforementioned recognition process is, A first recognition process that acquires information indicating the location of lesions included in the endoscopic image, A second recognition process for obtaining information indicating the type or progression of the lesion, Includes, The endoscopic system according to any one of claims 1 to 12, wherein at least one of the processors enables or disables the first recognition process and the second recognition process independently of each other.

14. At least one of the processors is Information indicating whether the first recognition process is valid or invalid, Information indicating whether the second recognition process described above is enabled or disabled, The endoscopic system according to claim 13, wherein each of these outputs to the monitor.

15. At least one of the processors is The endoscope system according to any one of claims 1 to 14, wherein if the recognition process is set to be disabled, information indicating that the recognition process is disabled, along with information indicating whether or not an action is performed on the subject, is further output to the monitor.

16. The endoscopic system according to claim 15, wherein the information indicating the type of action performed on the subject is a string of characters, symbols, or icons indicating at least one of the following: illumination, biopsy, liquid spraying, endoscopic resection, or washing of the subject.

17. At least one of the processors is The endoscopic system according to any one of claims 1 to 16, wherein, in addition to setting the enable or disable of the recognition process based on an action performed on the subject, the setting of enabling or disabling the recognition process can be changed based on the type of illumination light used to capture the endoscopic image.

Images