Endoscope system and endoscope system operation method

Abstract

This endoscope system includes: a control device for controlling a liquid supply source for supplying a liquid to a tip surface of an objective optical system of an endoscope, and a gas supply device for supplying a gas to the tip surface of the objective optical system of the endoscope; and a conditions determination device for determining whether conditions are such that matter is anticipated to adhere to the tip surface of the objective optical system of the endoscope. When the conditions determination device determines conditions in which matter is anticipated to adhere to the tip surface, the control device controls the liquid supply source so that liquid is supplied to the tip surface, continues the supply of the liquid for a fixed length of time, and subsequently controls the gas supply device so that gas is supplied to the tip surface.

Description

Endoscope System and Method of Operating an Endoscope System

[0001] The present invention relates to an endoscope system and a method of operating an endoscope system.

[0002] An endoscope is a device that is inserted into the body or the like to enable observation of affected parts that cannot be seen from the outside. For example, the endoscope has an elongated and flexible insertion portion that is inserted into a patient's body. The endoscope captures an image of an observation target site with an imaging device provided at the tip of the insertion portion. An image (endoscopic image) obtained by imaging with the endoscope is supplied to an endoscope processor. The endoscopic image processed by the endoscope processor is displayed on the display screen of a monitor. A doctor can perform examinations, treatments, etc. while viewing the image of the inside of the body displayed on the monitor.

[0003] When the insertion portion is inserted into the body, dirt adheres to the objective lens surface of the imaging device provided at the tip of the endoscope. If the attached dirt is left as it is, the dirt will stick and it will be difficult to see the field of view of the endoscope. In order to confirm the presence and condition of a lesion and also to prevent misdiagnosis by a doctor, it is desirable that the endoscopic image being observed and the endoscopic image to be recorded are clear. Therefore, in order to keep the field of view of the endoscope clear, the doctor manually performs water supply to the objective lens surface to wash away the dirt on the objective lens surface, and then performs air supply to remove moisture and dirt from the objective lens surface, thereby cleaning the objective lens surface.

[0004] In addition, Japanese Patent No. 6750152 discloses a technique in which a wiping body made of a microfiber or the like is provided at the tip of the endoscope so as to be able to move forward and backward, protrudes a little from the tip of the endoscope and expands when necessary, and then moves back a little to contact the tip of the endoscope, and the surface of the lens or the like is wiped by swinging in this contact state, thereby cleaning the surface of the lens.

[0005] Patent No. 6750152

[0006] However, since the objective lens surface is not in focus, dirt that cannot be seen by the physician may adhere to the objective lens surface. Also, even if dirt is attached to the objective lens surface, the physician may not be concerned. In these cases, the physician may not perform the objective lens surface cleaning procedure. This leads to the problem that the dirt can become ingrained and cannot be removed even with air and water insufflation. The present invention aims to provide an endoscope system and an operating method for the endoscope system that prevent dirt from adhering during endoscopic examination by maintaining a dirt-free state on the objective lens surface, thereby enabling clear observation of the entire endoscopic image.

[0007] An endoscope system according to one aspect of the present invention includes a control device that controls a liquid supply source that supplies liquid to the tip surface of the objective optical system of the endoscope and an air supply device that supplies gas to the tip surface of the objective optical system of the endoscope, and a state determination device that determines whether or not a state is expected to occur on the tip surface of the objective optical system of the endoscope. If the state determination device determines that a state is expected to occur on the tip surface, the control device controls the liquid supply source to supply liquid to the tip surface, continues supplying the liquid for a certain period of time, and then controls the air supply device to supply gas to the tip surface.

[0008] Another aspect of the present invention provides an endoscope having an objective optical system, a water supply line for supplying liquid to the tip surface of the objective optical system, and an air supply line for supplying gas to the tip surface of the objective optical system; a control device for controlling a liquid supply source that supplies liquid to the water supply line of the endoscope and an air supply device that supplies gas to the air supply line of the endoscope; and a state determination device for determining whether or not a state is expected to occur on the tip surface of the objective optical system of the endoscope. If the state determination device determines that a state is expected to occur on the tip surface, the control device controls the liquid supply source to supply liquid to the tip surface, continues supplying the liquid for a certain period of time, and then controls the air supply device to supply gas to the tip surface.

[0009] An operating method for an endoscope system according to one aspect of the present invention involves acquiring an image based on an optical image of a subject incident through the objective optical system at the tip of the insertion part by an endoscope inserted into a living body, determining whether or not a condition is expected to occur where deposits are likely to form on the tip surface of the objective optical system, and if it is determined that a condition is expected to occur where deposits are likely to form on the tip surface of the objective optical system, supplying liquid to the tip surface of the objective optical system to clean the tip surface, continuing to supply the liquid for a certain period of time and then stopping the supply of the liquid, and after stopping the supply of the liquid, blowing gas onto the tip surface to remove any remaining liquid from the tip surface.

[0010] According to the present invention, by maintaining a state free of dirt on the objective lens surface, it is possible to prevent dirt from adhering during endoscopic examination and to observe the entire endoscopic image in a clear state.

[0011] This is a block diagram showing an endoscope system including an endoscope processor according to the first embodiment of the present invention. This is an explanatory diagram illustrating the relationship between the first to fourth triggers generated by the control unit 11 and the air supply and water supply. This is a flowchart illustrating the operation of the first embodiment. This is an explanatory diagram illustrating the operation of the first embodiment. This is a flowchart illustrating the operation flow adopted in the second embodiment. This is a block diagram illustrating another example of an endoscope system. This is an explanatory diagram illustrating air supply and water supply. This is a block diagram illustrating another example of an endoscope system. This is a block diagram illustrating another example of an endoscope system. This is a flowchart illustrating the operation flow adopted in the third embodiment of the present invention. This is a flowchart illustrating the operation flow adopted in the fourth embodiment of the present invention. This is a block diagram illustrating the fifth embodiment. This is a flowchart illustrating the operation of the fifth embodiment. This is a block diagram illustrating the sixth embodiment. This is a flowchart illustrating the operation of the sixth embodiment. This is a block diagram illustrating the seventh embodiment. This is a flowchart illustrating the operation of the seventh embodiment. This is a block diagram illustrating the arrangement of a pressure gauge. This is an explanatory diagram illustrating another example of the air supply and water supply structure in the insertion section. This is an explanatory diagram illustrating another example of the air supply and water supply structure in the insertion section. This is an explanatory diagram illustrating another example of the air supply and water supply structure in the insertion section. This is an explanatory diagram illustrating another example of the tip of the endoscope insertion section. This is an explanatory diagram illustrating another example of an imaging device including an objective lens.

[0012] Embodiments of the present invention will be described in detail below with reference to the drawings.

[0013] (First Embodiment) Figure 1 is a block diagram showing an endoscope system according to the first embodiment of the present invention. In this embodiment, a first trigger is generated when a condition in which dirt is likely to occur is detected, and water supply is started. Then a second trigger is generated to stop the water supply, and after the water supply is stopped, a third trigger is generated to start air supply. When the water on the objective lens surface is removed, a fourth trigger is generated to stop the air supply. This keeps the objective lens surface, which is the front surface of the objective optical system, clean and prevents conditions in which dirt can accumulate.

[0014] As shown in Figure 1, the endoscope system 1 includes an endoscope processor 10, an endoscope 20, a suction device 30, and a monitor 40. The endoscope 20 has an elongated insertion section and an operating section (not shown). An imaging device 21 is provided in the insertion section of the endoscope 20. The insertion section is inserted into an organ of the subject, such as the stomach, and the imaging device 21 images the organ and outputs an imaging signal.

[0015] An imaging device 21 is provided at the tip of the insertion section, for example, and an operating section with various buttons for operating the endoscope 20 is provided at the base end of the insertion section. This operating section is equipped with a suction button 22 and an air / water supply button 23. An objective lens that guides the optical image of the subject to the imaging surface of the imaging device 21 is provided at the tip of the insertion section, and the surface of the objective lens faces the tip surface of the insertion section. A cable is attached to the operating section, and a connector (reference numeral 39 in Figure 7) attached to the end of the cable connects it to the endoscope processor 10.

[0016] The insertion section is provided with a suction channel (not shown), which communicates with a suction opening on the tip surface of the insertion section and with, for example, an opening in the operating section at the base end of the insertion section. The opening in the operating section is connected to a suction tube 24, which is connected to a drain tank via a strainer (not shown). The endoscope 20 may also be provided with a forceps channel for inserting treatment instruments, etc.

[0017] The suction device 30 includes a control unit 31, a pump 32, a pressure gauge 33, and an interface (IF) 34. The control unit 31 may be composed of a processor using a CPU (Central Processing Unit) or FPGA (Field Programmable Gate Array), and may operate according to a program stored in a memory (not shown) to control each part, or it may implement some or all of its functions with hardware electronic circuits. The control unit 31 comprehensively controls each part of the suction device 30.

[0018] The pump 32 is connected to the suction tube 24 via a strainer. The pump 32 is driven in response to the operation of the suction button 22 and generates a predetermined suction pressure in the suction line formed by the suction channel and the suction tube 24. For example, the pump 32 operates and generates suction pressure during the period when the suction button 22 is pressed. The suction pressure (negative pressure) in the suction tube 24 generated by the pump 32 causes the fluid aspirated from the organs in the body to be discharged into the drainage tank via the suction channel, the suction tube 24 and the strainer.

[0019] The pressure gauge 33 of the suction machine 30 measures the suction pressure in the suction line and outputs the measurement result to the control unit 31. The IF 34 can exchange data with the IF 13 of the endoscope processor 10 via a predetermined transmission line. The control unit 31 outputs the measurement result of the pressure gauge 33 to the endoscope processor 10 via the IF 34. In other words, the control unit 31 and the pressure gauge 33 function as pressure detection devices that detect changes in the pressure in the suction line. Although the example shown illustrates the control unit 31 detecting changes in the pressure in the suction line based on the measurement result of the pressure gauge 33, the control unit 31 can also detect changes in the pressure in the suction line by detecting the electrical load on the suction machine 30.

[0020] The endoscope processor 10 includes a control unit 11, a memory 12, an IF 13, an image processing circuit 14, an inference model unit 15, a timer 16, an input unit 17, and an air and water supply pump 18. The control unit 11, as a control device, may be composed of a processor using a CPU or FPGA, or it may operate according to a program stored in the memory 12 to control each part, or it may implement some or all of its functions with hardware electronic circuits. The control unit 11 comprehensively controls each part of the endoscope processor 10.

[0021] In this embodiment, the memory 12 stores information on one or more conditions (hereinafter referred to as "state determination conditions") for detecting a state in which dirt is likely to occur, that is, a state in which it is assumed that deposits will be deposited on the objective lens surface (hereinafter referred to as the assumed deposit state). Furthermore, the state determination conditions include not only the state determination conditions for generating the first trigger, but also the state determination conditions for generating the second to fourth triggers. The control unit 11 obtains the state determination conditions for generating the first to fourth triggers by reading information on a selected condition from the plurality of state determination conditions held in the memory 12.

[0022] The IF 13 receives an imaging signal from the imaging device 21 of the endoscope 20. The image processing circuit 14 obtains an image signal from the imaging signal input via the IF 13 through predetermined signal processing. The endoscope processor 10 outputs the image signal to the monitor 40. The monitor 40 displays an image (endoscopic image) based on the image signal output by the processor 40.

[0023] The inference model unit 15 receives an endoscopic image from the image processing circuit 14 and includes an inference model that outputs an inference result indicating whether or not liquid or dirt is adhering to the objective lens surface. For example, such an inference model can be constructed by performing machine learning using a large number of endoscopic images obtained when liquid or dirt is adhering to the objective lens surface and when it is not, and outputs an inference result indicating whether the input endoscopic image is an endoscopic image with liquid or dirt adhering to the objective lens surface or an endoscopic image without such adhering.

[0024] The timer 16 counts time and outputs time information to the control unit 11. The input unit 17 may consist of an input device (not shown) such as a keyboard or buttons, which accepts user operations and outputs signals based on those operations to the control unit 11, or it may be an input device configured to receive signals from an external device (not shown) and output the received signals to the control unit 11. The input unit 17 makes it possible to input state determination conditions to be stored in the memory 12. The input unit 17 can also take in a selection signal that instructs the control unit 11 to read a state determination condition from the memory 12 and supply it to the control unit 11. Based on the selection signal input from the outside, the control unit 11 selects the information used to determine the assumed adhesion state from among the state determination conditions recorded in the memory 12. In this way, the generation of the first to fourth triggers can be controlled according to the state determination conditions based on the selection signal from the outside.

[0025] The insertion section of the endoscope 20 is provided with an air and water supply channel (not shown). The air and water supply channel communicates with an air and water supply opening on the tip surface of the insertion section and also communicates with, for example, an opening of a connector on the base end side of the insertion section. An air and water supply tube 25 is inserted through the air and water supply channel, and the air and water supply tube 25 is connected to a water supply tank (not shown) via an air and water supply pump 18. The air and water supply pump 18, which acts as a liquid supply source and air supply device, supplies liquid (physiological saline) or gas stored in the water supply tank into the body through the air and water supply tube 25 inserted into the insertion section 21 and through the air and water supply opening on the tip surface of the insertion section.

[0026] The air and water supply pump 18 operates in response to the operation of the air and water supply button 23 to supply air and water. In addition, the air and water supply pump 18 is controlled by the control unit 11 to supply air and water regardless of the operation of the air and water supply button 23.

[0027] As described above, the tip surface of the insertion section of the endoscope 20 is provided with a suction opening, an air and water supply opening, and the objective lens surface of the imaging device 21. An air and water supply nozzle (not shown) is provided in the air and water supply opening, and the air and water supply nozzle allows the supplied gas and supplied liquid to flow out near the objective lens surface.

[0028] Although the example of supplying water from an air-supplying nozzle has been described, air-supplying and water supply may also be performed using, for example, a second nozzle dedicated to automatic water supply, a second nozzle utilizing auxiliary water supply, or a hood with a water supply function (an externally attached water conduit).

[0029] In this embodiment, the control unit 11 generates the first to fourth triggers described above and provides these first to fourth triggers to the air and water supply pump 18 as drive signals, thereby enabling air and water supply regardless of the physician's operation.

[0030] Figure 2 is an explanatory diagram illustrating the relationship between the first to fourth triggers generated by the control unit 11 and the air and water supply. Figure 2 uses the horizontal axis as the time axis to show the relationship between the timing of the generation of the first to fourth triggers and the start and end timings of the air and water supply.

[0031] As shown in Figure 2, water supply is started when the control unit 11 generates a first trigger (e.g., a water supply start signal), and water supply is stopped when the control unit 11 generates a second trigger (e.g., a water supply stop signal). Similarly, air supply is started when the control unit 11 generates a third trigger (an air supply start signal), and air supply is stopped when the control unit 11 generates a fourth trigger (an air supply stop signal).

[0032] In this embodiment, the control unit 11, acting as a state determination device, generates a first trigger by detecting a state in which it is assumed that dirt (adhesion) will occur on the objective lens surface. For example, suppose an endoscopy of the stomach is performed. In this case, when inserting the insertion tube, saliva may adhere to the tip surface of the insertion tube, or dirt may adhere when passing through a relatively narrow passage. Also, during a stomach examination, liquids containing cleaning solution or medication may be introduced from the outside. For this reason, various liquids such as cleaning solution, liquids containing medication, mucus, and gastric juice may be aspirated prior to observation with the endoscope. When aspirating, the liquid aspirated through the aspiration opening passes near the surface of the objective lens. At this time, it is conceivable that dirt that the doctor does not notice may adhere to the objective lens surface. In other words, it is conceivable that a state in which dirt (adhesion) adheres to the objective lens surface occurs when aspiration is performed.

[0033] Therefore, in this embodiment, the start of suction is used as the condition for determining the generation of the first trigger for starting water supply. The control unit 11 reads a state determination condition from the memory 12 that uses the start of suction as the condition for detecting the assumed state of adhesion, detects that suction has started, and generates the first trigger. For example, the control unit 11 may determine that suction has started and generate the first trigger when it detects that the suction pressure has exceeded a predetermined value stored in the memory 12 as a state determination condition, or when it detects that the increase in suction pressure has exceeded a predetermined value stored in the memory 12 as a state determination condition. Note that a doctor may press the suction button 22 for a relatively short time to perform suction for a short period of time. In this case, cleaning of the objective lens surface is considered unnecessary. Therefore, the control unit 11 may generate the first trigger when the suction button 22 is pressed for a predetermined period of time or longer. The objective lens surface is cleaned by water supply, and dirt adhering to the objective lens surface is removed.

[0034] Furthermore, after detecting that suction has ended, the control unit 11 generates a second trigger after a predetermined time to stop the water supply. Even if suction has stopped, the liquid near the objective lens surface may still be contaminated, so it is necessary to replace the liquid near the objective lens surface with clean liquid. Therefore, the control unit 11 stops the water supply after a predetermined time has elapsed since suction ended. This predetermined time is also specified by the state determination conditions. The control unit 11 may also determine that suction has ended when it detects that the suction pressure value indicated by the state determination conditions has fallen below a predetermined value, or when it detects that the decrease in suction pressure has exceeded a predetermined value.

[0035] After stopping the water supply, the control unit 11 generates a third trigger and starts supplying air at a timing determined by the state determination condition, for example, a predetermined time after stopping the water supply or simultaneously with stopping the water supply. This air supply removes water and dirt remaining on the objective lens surface.

[0036] In the above description, it was explained that the control unit 31 provides the control unit 11 with the measured value of the suction pressure, and the control unit 11 determines the start and end of suction based on the measured value of the suction pressure. However, the control unit 31 may also determine the start and end of suction based on the measured value of the suction pressure according to the state determination conditions, and provide the determination result to the control unit 11.

[0037] The control unit 11, for example, uses the inference results of the inference model unit 15 to determine whether or not water or dirt remains on the objective lens surface. Based on the state determination conditions, the control unit 11 may generate a fourth trigger and stop the air supply if the inference results of the inference model unit 15 indicate that no water or dirt remains on the objective lens surface. In addition, in order to suppress the rise in internal air pressure, the control unit 11 may stop the air supply after a predetermined time has elapsed from the start of air supply based on the state determination conditions, even if water or dirt remains on the objective lens surface.

[0038] Next, the operation of the embodiment configured in this way will be described with reference to Figure 3. Figure 3 is a flowchart illustrating the operation of the first embodiment. Figure 4 is an explanatory diagram illustrating the operation of the first embodiment.

[0039] Figure 4 shows the state of the objective lens surface 100 in a conventional example where this embodiment is not applied when suction is performed, in the upper section, and the state of the objective lens surface 21a when this embodiment is applied, in the lower section. As shown in the upper section of Figure 4, dirty water 101 comes into contact with the objective lens surface 100 when suction is started. In the conventional example, when suction is completed, water 102 containing dirt that the physician cannot perceive adheres to the objective lens surface 100. If air is insufflated in this state, the water 102 dries and adheres to the objective lens surface 100 as a buildup 103. The physician tries to insufflate the surface several times to remove this buildup, but the buildup 103 cannot be removed. As a result, endoscopic observation is performed with the buildup 103 still attached. Consequently, the field of view of the endoscope becomes unclear.

[0040] In contrast, in this embodiment, water is automatically supplied during suction. After inserting the insertion tube into the desired organ, the physician operates the suction button 22 to start suction (S1 in Figure 3). The operation of the suction button 22 drives the pump 32, and suction pressure is applied to the suction line. As a result, various liquids are drawn out from the suction opening on the tip surface of the insertion tube and discharged from the body. In this case, as shown in Figure 4, dirty water 101 comes into contact with the objective lens surface 21a of the imaging device 21. The pressure gauge 33 measures the suction pressure (S2), and the control unit 31 supplies the measured suction pressure to the control unit 11 of the endoscope processor 10 via IF 34 and IF 13.

[0041] The control unit 11 determines whether the measured suction pressure has changed from the value when no suction is applied to a predetermined threshold (S3). If the pressure change exceeds the threshold (YES in S3), the control unit 11 determines that suction has been performed and generates a first trigger (S4). This first trigger is supplied to the air-water supply pump 18, which starts supplying water in response to the first trigger. The liquid stored in the water supply tank is sent by the air-water supply pump 18 to the air-water supply tube 25 and supplied into the body from the air-water supply opening at the tip of the insertion part. The supplied liquid flows near the objective lens surface through the air-water supply nozzle provided at the air-water supply opening. In Figure 4, arrow 111 indicates the state in which the supplied water is hitting the objective lens surface 21a.

[0042] The control unit 11 may also be configured to notify the operator of the start of water supply, for example, through a monitor display or audio, at the same time as the start of water supply.

[0043] In S5, the control unit 11 determines to stop suction by monitoring whether the suction pressure falls below a threshold. When the suction pressure falls below the threshold (the value when suction is not being performed) (YES in S5), the control unit 11 determines that suction has stopped. After suction stops, the control unit 11 continues to supply water for a predetermined time from the time suction stops in order to replace the liquid near the objective lens surface 21a with clean liquid. When the control unit 11 determines from the output of the timer 16 that a predetermined time (for example, 1 second) has elapsed since suction stopped, it generates a second trigger and supplies water to the air supply pump 18. The air supply pump 18 stops supplying water due to the second trigger (S6). The water supply removes the dirt from the surface of the objective lens surface 21a, and as shown in Figure 4, clean water 112 is present on the objective lens surface 21a.

[0044] The control unit 11 generates a third trigger at the same time as the water supply stops or after a predetermined time has elapsed, and supplies it to the air and water supply pump 18 (S7). The air and water supply pump 18 starts air supply according to the third trigger. By the air and water supply pump 18, gas is sent to the air and water supply tube 25, and air supply is performed from the air and water supply opening at the tip surface of the insertion part. Due to the air and water supply nozzle provided at the air and water supply opening, gas flows in the vicinity of the objective lens surface 21a. Thereby, the water on the objective lens surface 21a is removed.

[0045] In addition, the control unit 11 may be configured to notify the operator of the stop of water supply and the start of air supply, for example, by monitor display or voice, at the same time as the water supply stops.

[0046] The imaging device 21 of the endoscope 20 outputs an imaging signal to the endoscope processor 10, and the image processing circuit 14 of the endoscope processor 10 outputs an endoscope image to the monitor 40 and the inference model unit 15. The inference model unit 15 outputs an inference result as to whether water or dirt adheres to the surface of the objective lens surface 21a from the input endoscope image.

[0047] The control unit 11 determines the stop of air supply, that is, the end of cleaning, based on the inference result of the inference model unit 15 (S8). When the inference result of the inference model unit 15 indicates that no water or dirt adheres to the surface of the objective lens surface 21a (YES in S8), the control unit 11 generates a fourth trigger and outputs it to the air and water supply pump 18. The air and water supply pump 18 stops air supply according to the fourth trigger (S9). The water and dirt on the surface of the objective lens surface 21a are removed by air supply, and as shown in FIG. 4, the objective lens surface 21a becomes a clear surface 113 from which water and dirt have been removed. The control unit 11 may be configured to notify the operator of the stop of air supply, for example, by monitor display or voice, at the same time as the air supply stops.

[0048] Thus, in this embodiment, by detecting the suction pressure, it is determined that suction causing dirt adhesion is being performed, the first trigger is generated to start water supply, and after the suction ends, the second trigger is generated to stop water supply. As a result, clean water is flowed over the objective lens surface for cleaning. Further, after stopping the water supply, the third trigger is generated to start air supply, and when the water on the objective lens surface can be removed, the fourth trigger is generated to stop air supply, thereby cleaning the objective lens surface and preventing a situation where dirt adheres stubbornly. By such automatic start and stop of water supply and air supply, even when dirt that the doctor does not recognize adheres, it is possible to suppress the remaining of dirt on the objective lens surface, prevent the adhesion of dirt, and obtain a clear endoscope image.

[0049] (Second Embodiment) FIG. 5 is a flowchart showing an operation flow adopted in the second embodiment. In FIG. 5, the same steps as those in FIG. 3 are denoted by the same reference numerals and the description thereof is omitted. The hardware configuration in the second embodiment is the same as that in the first embodiment. In the first embodiment, by detecting the start of suction, a state in which dirt would occur was detected, and the first trigger was generated to start water supply. In contrast, in this embodiment, by detecting that suction has started and further that suction has ended, the first trigger is generated to start water supply. The generation of the second trigger to the fourth trigger is the same as that in the first embodiment.

[0050] [[ID=...]]

[0051] The flow in FIG. 5 is different from the flow in FIG. 3 in that S41 and S42 are adopted instead of S3, and S43 is adopted instead of S5.

[0052] ​In this embodiment, water is automatically supplied once suction is started and then finished. First, the physician inserts the insertion tube into the desired organ and then operates the suction button 22 to start suction (S1 in Figure 5). The operation of the suction button 22 drives the pump 32, and suction pressure is applied to the suction line. As a result, various liquids are drawn out from the suction opening on the tip surface of the insertion tube and discharged from the body. Due to this suction, as shown in Figure 4, dirty water 101 comes into contact with the objective lens surface 21a of the imaging device 21. The pressure gauge 33 measures the suction pressure (S2), and the control unit 31 supplies the measured suction pressure to the control unit 11 of the endoscope processor 10 via IF 34 and IF 13.

[0053] The control unit 11 determines whether the measured suction pressure has changed from the value when no suction is being applied to a predetermined threshold, and whether a predetermined time has elapsed in the state where the pressure change > threshold (S41). If the pressure change exceeds the threshold and a predetermined time has elapsed in that state (YES in S41), the control unit 11 determines that suction has been performed.

[0054] The physician stops the pump 32 by operating the suction button 22. This reduces the suction pressure in the suction line, ending the suction. In S42, the control unit 11 determines whether the suction pressure has fallen below a predetermined threshold. The suction pressure is measured by the pressure gauge 33, and the measurement result is supplied to the control unit 11 via IF 34 and IF 13a. When the pressure becomes less than or equal to the threshold (YES in S42), the control unit 11 generates a first trigger (S4). This first trigger starts water supply. That is, water supply starts after the suction has ended.

[0055] The liquid stored in the water supply tank is sent to the air supply tube 25 by the air supply water pump 18 and delivered into the body through the air supply water opening at the tip of the insertion part. The delivered liquid flows near the objective lens surface through the air supply water nozzle provided at the air supply water opening. In Figure 4, arrow 111 indicates the state in which the delivered water is hitting the objective lens surface 21a.

[0056] After suction stops, the control unit 11 continues to supply water for a predetermined time from the suction stop in order to replace the liquid near the objective lens surface 21a with clean liquid. In S43, the control unit 11 determines whether a predetermined time (for example, 1 second) has elapsed since the first trigger occurred. If the control unit 11 determines that the predetermined time has elapsed based on the output of the timer 16 (YES in S43), it generates a second trigger and stops the water supply. This water supply removes the dirt from the surface of the objective lens surface 21a, and as shown in Figure 4, clean water 112 is present on the objective lens surface 21a.

[0057] Although it has been explained that the control unit 11 detects that a predetermined time has elapsed since the first trigger and generates a second trigger to determine the end of water supply, it is also possible that the control unit 11 determines whether the liquid near the objective lens surface 21a has become clean by image analysis or inference processing by the inference model unit 15, and determines the timing of the second trigger based on this determination result.

[0058] Other effects are the same as in the first embodiment.

[0059] In this embodiment, the start and subsequent termination of suction is detected by a change in suction pressure, thereby generating a first trigger for starting water supply. This allows for the flow of clean water to the objective lens surface for cleaning, even if suction is performed in a way that causes dirt to adhere.

[0060] (Other examples of endoscope systems) Figure 6 is a block diagram showing other examples of endoscope systems. In Figure 6, components identical to those in Figure 1 are denoted by the same reference numerals and their descriptions are omitted. The example in Figure 6 shows a more specific configuration example regarding air and water supply.

[0061] The endoscope processor 10A employs IFs 13a, 13b, and 13c, as well as an air supply pump 18A. IF 13a communicates with IF 34 of the suction device 30, IF 13b communicates with IF 27 of the endoscope 20A, and IF 13c communicates with the interface configured on the air supply / water supply button 23 of the endoscope 20A.

[0062] The air supply pump 18 can be connected to the air supply pipeline 25a and can supply gas to the air supply pipeline 25a. In addition, a carbon dioxide gas supply device 18B may be provided separately from the air supply pump 18A. The carbon dioxide gas supply device 18A is connected to the air supply pipeline 25a and the water supply pipeline 25b via the water supply tank 35. The air supply pipeline 25a is connected to the air supply and water supply system 28 via the air supply pipeline valve 26a. The air supply and water supply system 28 is equipped with an air supply and water supply pipeline inserted into an insertion part and a nozzle, and it supplies liquid from the water supply pipeline 25b through the nozzle to guide it to the objective lens surface, and also supplies gas from the air supply pipeline 25a through the nozzle to guide it to the objective lens surface. A pressure gauge 38 for measuring the pressure in the air supply pipeline 25a may also be provided.

[0063] Figure 7 is an explanatory diagram illustrating the air supply and water supply. Figure 7 shows the cross-sectional shape of the endoscope 20A. As shown in Figure 7, an air supply line 25a and a water supply line 25b are inserted into the endoscope 20A from the proximal end to the tip 28a of the insertion section. The air supply line 25a and the water supply line 25b are attached to the water supply tank 35 at the proximal end of the endoscope 20A. Liquid 35a is stored in the water supply tank 35, and the opening of the water supply line 25b is located within the liquid 35a in the water supply tank 35, while the opening of the air supply line 25a is located in a position that does not come into contact with the liquid 35a in the water supply tank 35.

[0064] An objective lens 28b is provided at the tip 28a of the endoscope 20A. The air supply line 25a and the water supply line 25b merge at the tip of the endoscope 20A and are then guided to a nozzle 28c provided at the tip 28a so that the surface of the objective lens 28b can be cleaned. Inside the endoscope 20A, solenoid valves, an air supply line valve 26a and a water supply line valve 26b, are provided in the middle of the air supply line 25a and water supply line 25b. The air supply line valve 26a controls the flow of air in the air supply line 25a by opening and closing, and the water supply line valve 26b controls the flow of liquid in the water supply line 25b by opening and closing.

[0065] The water supply tank 35 is pressurized when carbon dioxide gas flows in from the carbon dioxide gas supply device 18B connected to the water supply tank 35. When the gas supply line valve 26a is open, gas is sent from the carbon dioxide gas supply device 18B to the water supply tank 35, and this gas is delivered to the surface of the objective lens 28b from the nozzle 28c via the gas supply line 25a. The gas supply line 25a can also be connected to the processor 10A at the base end connector 39, and gas from the gas supply pump 18A of the processor 10A may be supplied to the gas supply line 25a instead of the carbon dioxide gas supply device 18B.

[0066] Furthermore, when gas is supplied from the carbon dioxide gas supply device 18B to the water supply tank 35 with the air supply valve 26a closed and the water supply valve 26b open, the pressure inside the water supply tank 35 increases due to this gas, causing liquid 35a to flow into the water supply pipe 25b through its opening. The liquid 35a is then sent to the tip 28a of the endoscope 20A via the water supply pipe 25b and delivered to the surface of the objective lens 28b from the nozzle 28c.

[0067] Although the air supply valve 26a and water supply valve 26b that control the air and water supply are shown as being installed inside the endoscope 20A, they may also be installed between the endoscope 20A and the water supply tank 35.

[0068] The control unit 11 can control water and air supply by controlling the air supply valve 26a and the water supply valve 26b via IF 13b and IF 27. When a user operates the air / water supply button 23, an operation signal based on this operation is supplied to the control unit 11 via IF 13c. The control unit 11 can open and close the air supply valve 26a and the water supply valve 26b based on the received operation signal, and the doctor can also arbitrarily open the air supply pipe 25a and the water supply pipe 25b using the air / water supply button 23.

[0069] Other configurations and operations are the same as in the first or second embodiment. That is, the flow shown in Figures 3 and 5 can also be performed in the endoscope system of Figure 6. In this way, in the endoscope system of Figure 6, it is possible to detect when suction that causes dirt to adhere has occurred and to automatically supply water and air, thereby keeping the objective lens surface clean, preventing the situation in which dirt adheres, and enabling the acquisition of clear endoscopic images.

[0070] (Other examples of endoscope systems) Figure 8 is a block diagram showing other examples of endoscope systems. In Figure 8, components identical to those in Figure 6 are denoted by the same reference numerals and their descriptions are omitted. The example in Figure 8 realizes the functions of the air supply valve 26a and water supply valve 26b in Figure 6 by an external mechanism of the endoscope 20B.

[0071] Endoscope 20B differs from endoscope 20A in Figure 6 in that it omits the air supply valve 26a, the water supply valve 26b, and the IF 27. Outside of endoscope 20B, an actuator-based opening and closing mechanism 26 for the air supply and water supply lines is provided on the air supply line 25a and water supply line 25b, which connect the air supply and water supply system 28 to the water supply tank 35. The opening and closing mechanism 26 is controlled by an actuator (not shown) that is controlled by an opening and closing signal transmitted from the control unit 11 of the endoscope processor 10A via the IF 13b, allowing the air supply line 25a and water supply line 25b to be opened and closed individually.

[0072] With this configuration, the control unit 11 can control the drive of the carbon dioxide supply device 18B and the opening and closing of the opening / closing mechanism 26 based on the first to fourth trigger signals, thereby starting and stopping water supply and air supply. Air supply and water supply can also be initiated by the user operating the air supply / water supply button 23.

[0073] Other configurations and effects are the same as those of the first and second embodiments.

[0074] Thus, in the example shown in Figure 8, the flows in Figures 3 and 5 can be implemented, and the same effects as in the first and second embodiments can be obtained.

[0075] (Other examples of endoscope systems) Figure 9 is a block diagram showing another example of an endoscope system. In Figure 9, components identical to those in Figures 6 and 8 are denoted by the same reference numerals and their descriptions are omitted. The example in Figure 9 includes an air and water supply control device 100, which controls the supply of air and water.

[0076] The example in Figure 9 includes a carbon dioxide gas supply device 110 and an air and water supply control device 100 that controls the supply of air and water. In Figure 9, an endoscope processor 10B is adopted, which is the same as the endoscope processor 10A in Figure 6 but with the control unit 11, memory 12, IFs 13a, 13b, 13c, inference model unit 15, timer 16, input unit 17 and air pump 18A omitted, and with the addition of IF 13e. An air and water supply control device 100 is provided, which includes the control unit 11, memory 12, IFs 13a, 13c, inference model unit 15, timer 16 and input unit 17, as well as IF 13d, air supply pipe valve 26a and water supply pipe valve 26b.

[0077] The IF 13e in the endoscope processor 10B communicates with the IF 13d in the air supply / water supply control device 100. The functions of the control unit 11, memory 12, IFs 13a, 13c, inference model unit 15, timer 16, and input unit 17 in the air supply / water supply control device 100 are the same as the functions of the control unit 11, memory 12, IFs 13a, 13c, inference model unit 15, timer 16, and input unit 17 in the endoscope processor 10A in Figure 6. In addition, the air supply / water supply control device 100 is provided with an air supply pipe valve 26a and a water supply pipe valve 26b that have the same functions as the air supply pipe valve 26a and water supply pipe valve 26b of the endoscope 20A in Figure 6.

[0078] Specifically, an air supply valve 26a and a water supply valve 26b are provided on the air supply pipe 25a and water supply pipe 25b, which connect the air supply and water supply system 28 in the endoscope 20B to the air supply and water supply tank 111. The air supply valve 26a and the water supply valve 26b are controlled by an opening / closing signal from the control unit 11 in the air supply and water supply control device 100, allowing the air supply pipe 25a and the water supply pipe 25b to be opened and closed individually.

[0079] The carbon dioxide supply device 110 can supply carbon dioxide generated from a carbon dioxide cylinder (not shown) to the air supply and water tank 111. Liquid is stored in the air supply and water tank 111, and pressure is applied to the air supply and water tank 111 when carbon dioxide flows in from the carbon dioxide supply device 110 connected to the air supply and water tank 111. The opening of the water supply pipeline 25b is located in the liquid of the air supply and water tank 111, and as the pressure inside the air supply and water tank 111 increases, the liquid flows into the pipeline through the opening of the water supply pipeline 25b and is supplied to the air supply and water system 28 of the endoscope 20B.

[0080] When the air supply valve 26a is open and gas is sent from the carbon dioxide supply device 110 to the air supply and water tank 111, this gas is guided to the air supply and water system 28 via the air supply pipe 25a. Also, when the air supply valve 26a is closed and the water supply valve 26b is open and gas is sent from the carbon dioxide supply device 110 to the air supply and water tank 111, this gas increases the pressure inside the air supply and water tank 111, and the liquid is guided to the air supply and water system 28 of the endoscope 20B via the water supply pipe 25b.

[0081] With this configuration, the control unit 11 in the air and water supply control device 100 can control the driving of the carbon dioxide gas supply device 110 and the opening and closing of the air supply pipe valve 26a and water supply pipe valve 26b based on the first to fourth trigger signals, thereby enabling the start and end of water supply and air supply. The air supply pipe valve 26a and water supply pipe valve 26b are located within the air and water supply control device 100, but they may be located in any position on the air supply pipe 25a and water supply pipe 25b, such as within the carbon dioxide gas supply device 110 or within the endoscope 20B.

[0082] Other configurations and effects are the same as those of the first and second embodiments.

[0083] Thus, the flowcharts in Figures 3 and 5 can also be implemented in the endoscopic system of Figure 9, and the same effects as in the first and second embodiments can be obtained.

[0084] (Third Embodiment) Figure 10 is a flowchart showing the operation flow adopted in the third embodiment of the present invention. The hardware configuration of the third embodiment is the same as in Figures 1, 6, 8, or 9. In the first and second embodiments, the start and end of suction were determined based on the pressure measurement results of the pressure gauge 33, whereas in this embodiment, the start and end of suction are determined from the endoscopic image. The inference model unit 15 in this embodiment includes not only an inference model that infers the presence of water or dirt on the objective lens surface, as in the first embodiment, but also an inference model that infers the start and end of suction. For example, such an inference model can be constructed by performing machine learning using a large number of endoscopic images obtained during suction, such as images showing water accumulating on the objective lens or images showing the objective lens submerged in water, and endoscopic images obtained at times other than during suction, and outputs an inference result of whether the input endoscopic image is an image obtained during the suction operation or an image obtained at a time other than during the suction operation.

[0085] The control unit 11 may also determine when suction has started and when suction has ended by performing image analysis on the endoscopic image from the image processing circuit 14. The control unit 11 reads the state determination conditions stored in the memory 12 and decides to use the inference results of the inference model unit 15 to determine when the first trigger has occurred.

[0086] Next, the operation of the embodiment configured in this way will be described with reference to Figure 10. In Figure 10, the same reference numerals are used for the same steps as in Figure 3, and their explanations are omitted.

[0087] In the third embodiment, the start and end of suction are determined not based on the measurement results of the suction pressure, but by inference by the inference model unit 15, which is different from the first embodiment. That is, when the inference model unit 15 reaches the target site of the insertion section, it starts inferring suction and outputs an inference result indicating whether or not the input endoscopic image is an image obtained during the suction operation (S11). The inference result of the inference model unit 15 is given to the control unit 11, and the control unit 11 determines, based on the inference result of the inference model unit 15, that the input endoscopic image was obtained during the suction operation, that is, whether or not the inference model unit 15 has indicated the start of suction (S12). If the inference result of the inference model unit 15 indicates the start of suction (YES in S12), the control unit 11 generates a first trigger in S4 and starts water supply.

[0088] Furthermore, the control unit 11 determines whether or not the inference result of the inference model unit 15 indicates the end of suction (S13). If the inference result of the inference model unit 15 indicates the end of suction (YES in S13), the control unit 11 generates a second trigger in S6 a predetermined time after the end of suction to stop the water supply.

[0089] Other effects are the same as in the first embodiment.

[0090] Thus, the same effects as in the first embodiment can be obtained in this embodiment as well.

[0091] (Fourth Embodiment) Figure 11 is a flowchart showing the operation flow adopted in the fourth embodiment of the present invention. In Figure 11, the same reference numerals are used for the same steps as in Figure 10, and their descriptions are omitted. The hardware configuration of the fourth embodiment is the same as in Figures 1, 6, 8, or 9. In the third embodiment, the first trigger was generated by the start of suction, whereas in this embodiment, the first trigger is generated after the determination of the start and end of suction. The inference model unit 15 in this embodiment also includes not only an inference model that infers the presence of water or dirt on the objective lens surface, as in the third embodiment, but also an inference model that infers the start and end of suction.

[0092] The control unit 11 may also determine when suction has started and when suction has ended by performing image analysis on the endoscopic image from the image processing circuit 14. The control unit 11 reads the state determination conditions stored in the memory 12 and decides to use the inference results of the inference model unit 15 to determine when the first trigger has occurred.

[0093] Next, the operation of the embodiment configured in this way will be described with reference to Figure 11.

[0094] In the fourth embodiment, the inference model unit 15 determines the start and end of suction through inference and generates a first trigger. That is, when the insertion part reaches the target site, the inference model unit 15 starts inferring suction and outputs an inference result indicating whether or not the input endoscopic image was obtained during the suction operation (S11). The inference result of the inference model unit 15 is provided to the control unit 11, and the control unit 11 determines, based on the inference result of the inference model unit 15, that the input endoscopic image was obtained during the suction operation, that is, whether or not the inference model unit 15 has indicated the start of suction (S12).

[0095] When the inference result of the inference model unit 15 indicates the start of suction (YES in S12), the inference model unit 15 performs an inference on the end of suction and outputs an inference result indicating whether or not the input endoscopic image is an image obtained after the end of the suction operation (S14). The control unit 11 determines, based on the inference result of the inference model unit 15, whether or not the input endoscopic image was obtained after the end of the suction operation, that is, whether or not the inference model unit 15 has indicated the end of suction (S15). When the inference result of the inference model unit 15 indicates the end of suction (YES in S15), the control unit 11 generates a first trigger in S4 and starts water supply.

[0096] Furthermore, the control unit 11 determines whether a predetermined time has elapsed since the first trigger occurred (S16). If the predetermined time has elapsed (YES in S16), the control unit 11 generates a second trigger in S6, a predetermined time after the start of water supply, to stop the water supply. The second trigger may be generated by detecting that the dirty liquid near the objective lens surface has been replaced with clean water.

[0097] Other effects are the same as in the second embodiment.

[0098] Thus, the same effects as in the second embodiment can be obtained in this embodiment as well.

[0099] (Fifth Embodiment) Figure 12 is a block diagram showing the fifth embodiment. In Figure 12, the same reference numerals are used for components that are the same as those in Figure 1, and their descriptions are omitted.

[0100] In this embodiment, the start and end timing of water delivery are determined from the endoscopic image. To detect tumors, a staining solution may be sprayed into the body. For example, the staining solution is sprayed into the body via a special tube at the insertion site. At the tip of the insertion site, the objective lens surface is located relatively close to the nozzle of the special tube, making it easy for the staining solution to contaminate the objective lens surface. This staining solution easily adheres to the dirt on the objective lens surface, causing a significant deterioration of the endoscope's field of view.

[0101] Therefore, in this embodiment, the start of the spraying of the dye solution is used as the condition for determining the generation of the first trigger for starting water supply. The control unit 11 reads from the memory 12 the condition for determining the state in which adhesion is assumed when the spraying of the dye solution has started. Based on the read condition, the control unit 11 generates the first trigger to start water supply when it determines that the spraying of the dye solution has started, and generates the second trigger to stop water supply based on the determination result of the end of the spraying of the dye solution.

[0102] This embodiment differs from Figure 1 in that it employs a staining solution dispenser 36 and a tube 37 for delivering the staining solution into the body instead of a suction device 30. The tube 37 is inserted into the insertion section, and its tip faces the opening at the tip surface of the insertion section. The dispenser 36 dispenses the staining solution, which is stored in a tank (not shown), into the body through the tube 37 from the opening at the tip surface of the insertion section.

[0103] The inference model unit 15 in this embodiment includes not only an inference model that infers the presence of water or dirt on the objective lens surface, similar to the first embodiment, but also an inference model that infers the start and end of staining solution spraying. For example, such an inference model can be constructed by performing machine learning using a large number of endoscopic images obtained when staining solution is sprayed, such as images showing the staining solution gathering around the objective lens, images showing the tube 37 coming out of the forceps channel and the staining solution continuously coming out of the tip of the tube 37, and images showing the staining solution coming out of the forceps channel, as well as endoscopic images obtained at times other than when staining solution is sprayed. The inference model constructed in this way outputs an inference result indicating whether the input endoscopic image is an image obtained at times when staining solution is sprayed or an image obtained at times other than when staining solution is sprayed.

[0104] The control unit 11 may also be configured to determine when the dispensing of the staining solution has started and when it has finished by performing image analysis on the endoscopic image from the image processing circuit 14.

[0105] Next, the operation of the embodiment configured in this way will be described with reference to Figure 13. Figure 13 is a flowchart for explaining the operation of the third embodiment. In Figure 13, the same reference numerals are used for the same steps as in Figure 3, and their explanations are omitted.

[0106] In the third embodiment, the start and end of staining solution spraying are determined by inference by the inference model unit 15. The doctor starts spraying the staining solution at any time after the insertion part reaches the target site (S21). Meanwhile, in S22, the inference model unit 15 infers whether or not staining solution spraying is taking place and outputs the inference result. The inference result of the inference model unit 15 is given to the control unit 11, and the control unit 11 determines whether or not the inference result of the inference model unit 15 indicates the start of staining solution spraying (S23). If the inference result of the inference model unit 15 indicates the start of staining solution spraying (YES in S23), the control unit 11 generates a first trigger in S4 and starts water supply. This washes the objective lens surface with the supplied water and prevents staining solution from adhering to it.

[0107] Furthermore, the control unit 11 determines whether the inference result of the inference model unit 15 indicates the end of the staining solution spraying (S24). If the inference result of the inference model unit 15 indicates the end of the staining solution spraying (YES in S24), the control unit 11 counts a predetermined time and then generates a second trigger to stop the water supply (S6). For a predetermined time after the end of the staining solution spraying, the staining solution near the objective lens surface is replaced with clean water, and then the water supply is stopped.

[0108] Other effects are the same as in the first embodiment.

[0109] Thus, the same effects as in the first embodiment can be obtained in this embodiment as well.

[0110] (Sixth Embodiment) Figure 14 is a block diagram of the sixth embodiment. In Figure 14, the same reference numerals are used for components that are the same as those in Figures 6 and 12, and their descriptions are omitted. In the fifth embodiment, the start of spraying the staining solution was used as the condition for determining the occurrence of the first trigger for starting water supply, but in this embodiment, the completion of spraying the staining solution is used as the condition for determining the occurrence of the first trigger for starting water supply.

[0111] Specifically, after the spraying of the staining solution has started, the control unit 11 reads from the memory 12 a state determination condition that indicates the state in which the staining solution is assumed to be attached when the spraying has finished. Based on the read state determination condition, the control unit 11 determines the start and end of the spraying of the staining solution, generates a first trigger to start water supply, and after a predetermined time, or after the staining solution near the objective lens surface has been replaced with clean water, generates a second trigger to stop water supply.

[0112] In this embodiment as well, the start and end timings of water supply are determined from the endoscopic image.

[0113] This embodiment differs from Figure 6 in that it employs a staining solution dispenser 36 and a tube 37 for delivering the staining solution into the body. The tube 37 is inserted into the insertion section via the forceps opening 29, and the tip of the tube 37 faces the opening on the tip surface of the insertion section. The dispenser 36 dispenses the staining solution, which is stored in a tank (not shown), into the body through the tube 37 from the opening on the tip surface of the insertion section.

[0114] The inference model unit 15 in this embodiment includes not only an inference model that infers the presence of water or dirt on the objective lens surface, similar to the second embodiment, but also an inference model that infers the start and end of staining solution spraying. For example, such an inference model can be constructed by performing machine learning using a large number of endoscopic images obtained when staining solution is sprayed, such as images showing the staining solution gathering around the objective lens, images showing the tube 37 coming out of the forceps channel and the staining solution continuously coming out of the tip of the tube 37, and images showing the staining solution coming out of the forceps channel, as well as endoscopic images obtained at times other than when staining solution is sprayed. The inference model constructed in this way outputs an inference result indicating whether the input endoscopic image is an image obtained at the time of staining solution spraying or an image obtained at a time other than when staining solution is sprayed.

[0115] The control unit 11 may also be configured to determine when the dispensing of the staining solution has started and when it has finished by performing image analysis on the endoscopic image from the image processing circuit 14.

[0116] Next, the operation of the embodiment configured in this way will be described with reference to Figure 15. Figure 15 is a flowchart for explaining the operation of the sixth embodiment. In Figure 15, the same reference numerals are used for the same steps as in Figure 13, and their explanations are omitted.

[0117] In the sixth embodiment, the start and end of staining solution spraying are determined by inference by the inference model unit 15. The doctor starts spraying the staining solution at any time after the insertion part reaches the target site (S21). Meanwhile, in S22, the inference model unit 15 infers whether or not staining solution spraying is taking place and outputs the inference result. The inference result of the inference model unit 15 is provided to the control unit 11, and the control unit 11 determines whether or not the inference result of the inference model unit 15 indicates the start of staining solution spraying (S23). If the inference result of the inference model unit 15 indicates the start of staining solution spraying (YES in S23), the control unit 11 determines in S24 whether or not the inference result of the inference model unit 15 indicates the end of staining solution spraying (S24).

[0118] When the inference result of the inference model unit 15 indicates that the dispensing of the staining solution has ended (YES in S24), the control unit 11 generates a first trigger in S4 to start supplying water. This washes the objective lens surface with the supplied water, preventing staining solution from adhering to it.

[0119] Furthermore, the control unit 11 determines whether a predetermined time has elapsed, or determines whether the staining solution near the objective lens surface has been replaced with clean water based on the inference results of the inference model unit 15 (S25). When the control unit 11 indicates that a predetermined time has elapsed or that the staining solution near the objective lens surface has been replaced with clean water (YES in S25), the control unit 11 generates a second trigger and stops the water supply (S6).

[0120] Other effects are the same as in the second embodiment.

[0121] Thus, the same effects as in the second embodiment can be obtained in this embodiment as well.

[0122] Although this embodiment describes an example in which a sprayer is added to the endoscope system of Figure 6, it is clear that a similar configuration is possible when a sprayer is added to the endoscope systems of Figures 8 and 9. That is, in contrast to the example of Figure 6, the air supply line 25a and the water supply line 25b may be placed outside the endoscope, as in the example of Figure 8, or an air and water supply control device 100 may be provided, as in the example of Figure 9, and the control system related to air and water supply may be moved from the endoscope processor to the air and water supply control device 100. In this case as well, it is possible to prevent dirt from adhering to the objective lens surface by the staining solution from the sprayer.

[0123] (Seventh Embodiment) Figure 16 is a block diagram of the seventh embodiment. In Figure 16, the same reference numerals are used for components that are the same as those in Figure 1, and their descriptions are omitted. The endoscope system of this embodiment differs from the embodiment of Figure 1 in that the suction device 30 is omitted. In this embodiment, the start and end timing of water supply is determined from the endoscope image. During the process of inserting the insertion part of the endoscope into the body, foreign matter such as biological mucosa, blood, mucus, mist, and other liquids (condensation is also included in the broad sense as liquid) may come into contact with the objective lens surface. It is conceivable that dirt may adhere to the objective lens surface due to these foreign matter.

[0124] Therefore, in this embodiment, contact of biological tissue or foreign matter with the objective lens surface is used as the condition for generating the first trigger. The control unit 11 reads from the memory 12 a state determination condition that indicates an adhesion state when biological tissue or foreign matter comes into contact with the objective lens surface. Based on the state determination condition, the control unit 11 generates a first trigger and starts water supply when it determines that biological tissue or foreign matter has come into contact with the objective lens surface, and generates a second trigger and stops water supply based on the determination result that the foreign matter is not in contact with the objective lens surface.

[0125] The inference model unit 15 in this embodiment includes not only an inference model that infers the presence of water or dirt on the objective lens surface, similar to the first embodiment, but also an inference model that infers whether or not biological tissue or foreign matter is in contact with the objective lens surface. For example, such an inference model can be constructed by performing machine learning using a large number of endoscopic images other than those mentioned above, such as images where the entire endoscopic image is a red dot, images where part of the endoscopic image is a red dot, out-of-focus images, images where the brightness is momentarily reduced, and images with reduced contrast, obtained when biological tissue or foreign matter is in contact with the objective lens surface. The inference model constructed in this way outputs an inference result indicating whether or not the input endoscopic image is an image obtained when foreign matter is in contact with the objective lens surface.

[0126] The control unit 11 may also be configured to determine whether a foreign object is in contact with the objective lens surface or not by performing image analysis on the endoscopic image from the image processing circuit 14.

[0127] Next, the operation of the embodiment configured in this way will be described with reference to Figure 17. Figure 17 is a flowchart illustrating the operation of the seventh embodiment. In Figure 17, the same reference numerals are used for the same steps as in Figure 3, and their explanations are omitted.

[0128] In the seventh embodiment, the inference model unit 15 determines whether or not foreign matter is attached to the objective lens surface (attachment and removal of foreign matter) through inference. When the doctor starts inserting the insertion part into the body (S31), the inference model unit 15 starts inferring whether or not foreign matter is attached to the objective lens surface (S32). The inference result of the inference model unit 15 is provided to the control unit 11, and the control unit 11 determines whether or not the inference result of the inference model unit 15 indicates that foreign matter has come into contact with the objective lens surface (S33). If the inference result of the inference model unit 15 indicates that foreign matter has come into contact with the objective lens surface (YES in S33), the control unit 11 generates a first trigger in S4 and starts supplying water. As a result, the objective lens surface is washed with the supplied water, preventing foreign matter from adhering to the objective lens surface.

[0129] The control unit 11 determines whether the inference result of the inference model unit 15 indicates that contact with biological tissue or foreign matter on the objective lens surface has ended (S34). If the inference result of the inference model unit 15 indicates that contact with biological tissue or foreign matter has ended (YES in S34), the control unit 11 counts a predetermined time and then generates a second trigger to stop the water supply (S6). For a predetermined time from the moment it is indicated that no foreign matter is in contact with the objective lens surface, clean water flows near the objective lens surface, ensuring that foreign matter is reliably removed from the objective lens surface.

[0130] Other effects are the same as in the first embodiment.

[0131] Thus, the same effects as in the first embodiment can be obtained in this embodiment as well.

[0132] Although this embodiment was described using the endoscope system shown in Figure 16, it is clear that it is also applicable to the endoscope systems shown in Figures 1, 6, 8, 9, 12, and 14. In any example to which this embodiment is applied, it is possible to remove foreign matter adhering to the objective lens surface and prevent dirt from sticking to the objective lens surface.

[0133] In each of the above embodiments, the control unit 11 decided whether or not to supply water when the expected adhesion state was determined. However, for example, if the endoscope is in a state where it is approaching the tissue and performing diagnostic-level observation (magnified observation state), or if the endoscope is using a treatment instrument, the control unit 11 may prohibit the supply of water that would obstruct the view. The determination of whether or not the endoscope is in a magnified observation state or whether or not a treatment instrument is being used may be achieved by inference using an inference model. For example, such an inference model can output inference results such as whether the input endoscope image is an image obtained through magnified observation or an image obtained while using a treatment instrument by performing machine learning using a large number of endoscope images including the magnified observation state and the endoscope images including the use of a treatment instrument.

[0134] Figure 18 is a block diagram showing the arrangement of pressure gauges. In each of the above embodiments, if the inference model unit 15 provides an inference result indicating that no water or dirt remains on the objective lens surface, the control unit 11 stops supplying air. However, to prevent over-supplying, the control unit 11 may provide a pressure gauge 38 as shown in Figure 18 on the air supply tube 25 that supplies gas from the air supply pump 18 to the tip of the insertion part, receive the measurement result from this pressure gauge 38, and stop supplying air from the air supply pump 18 when the pressure reaches a predetermined threshold, regardless of the inference result of the inference model unit 15. Alternatively, the control unit 11 may stop supplying air when the supply time reaches a predetermined time, regardless of the inference result of the inference model unit 15, to prevent unnecessary air supply.

[0135] Furthermore, not only in the example shown in Figure 18, but also in the endoscopic systems shown in Figures 6, 8, 9, and 14, the measurement results of the pressure gauge 38 can be used to prevent unnecessary air supply.

[0136] Furthermore, generally, dirt on the objective lens surface is removed by water supply, and often only clean water remains near the objective lens surface before air supply. However, if there is stubborn residue on the objective lens surface, the inference model unit 15 will provide an inference result indicating that dirt remains. In this case, since it is possible that the residue cannot be removed by air supply and water supply, the system may be controlled not to perform water supply and air supply again in each of the above embodiments. In this case, the control unit 11 may, for example, notify the operator by monitor display or voice that there is dirt on the objective lens surface that cannot be removed by water supply and air supply. Note that automatic cleaning can be resumed by any operation by the user (such as canceling an alert).

[0137] Furthermore, in each of the above embodiments, the control unit 11 was described as selecting a state determination condition from the memory 12 to determine the expected adhesion state in which an object is expected to adhere to the objective lens surface, and generating the first to fourth triggers. However, the control unit may also use a plurality of state determination conditions recorded in the memory 12 sequentially or simultaneously to determine the expected adhesion state and generate the first to fourth triggers.

[0138] (Air and Water Supply Structure) Figures 19 to 21 are explanatory diagrams illustrating other examples of the air and water supply structure in the insertion section. In Figures 19 to 21, the same components are denoted by the same reference numerals, and redundant explanations are omitted.

[0139] In the example shown in Figure 19, conduits 51 and 52 are provided in the insertion section 50. Conduits 51 and 52 communicate with the respective openings on the base end side of the insertion section 50, as well as with the opening on the tip surface 50a of the insertion section 50. Conduit 51 has an opening on the tip surface 50a of the insertion section 50, and conduit 52 is connected to conduit 51 near the tip of the insertion section 50. A nozzle 53 is provided in the opening of conduit 51, and the nozzle 53 is capable of directing the fluid sent through conduits 51 and 52 toward an objective lens surface (not shown) exposed on the tip surface 50a.

[0140] The liquid stored in the water supply tank is supplied by the air supply and water supply pump 18 through the opening at the base end of the insertion section 50, via the pipeline 51 inside the insertion section 21, and out of the nozzle 53 on the tip surface 50a. The air supply and water supply pump 18 can also supply air through the opening at the base end of the insertion section 50, via the pipeline 52 inside the insertion section 50, and out of the nozzle 53 on the tip surface 50a. By moving the mechanical switch 54, the supplied fluid can be switched between water and air, and water and air can be supplied using the pipelines 51 and 52.

[0141] In the example shown in Figure 19, the confluence of water and air is located inside the insertion section 50, but it is also possible to configure the confluence to be located outside the endoscope. Figure 20 shows the air-water supply structure in this case.

[0142] As shown in Figure 20, a conduit 61 is provided in the insertion section 60. The conduit 61 communicates with the opening on the base end side of the insertion section 60 and also with the opening on the tip surface 50a of the insertion section 60. The conduit 61 is led to the control device 65 at the base end side, and at the junction 64 in the control device 65, it is branched into a water supply pipe 61a and an air supply pipe 61b, which are connected to the air supply and water supply control device 66. The air supply and water supply control device 66 is equipped with an air supply and water supply pump (not shown) and is controlled by a control board 67 to supply air and water. The control board 67 is connected to an electronic switch 69 via an IF 68, and by operating the electronic switch 69, it can generate control signals to perform air supply and water supply processing of the air supply and water supply control device 66 and output them to the air supply and water supply control device 66. The air supply and water supply control device 66 is controlled by the control signals from the control board 67 and switches between supplying water and supplying air by controlling a solenoid valve.

[0143] The electronic switch 69 can be installed, for example, on the endoscope control unit. Therefore, in the example shown in Figure 20, the physician can easily supply water and air to the objective lens surface by operating the electronic switch 69 on the control unit.

[0144] Thus, in the example of Figure 19, switching between water and air supply requires manually switching a mechanical switch 54. In contrast, in the example of Figure 20, the start and end of air and water supply can be easily switched by operating an electronic switch 69 located on the endoscope control unit. Furthermore, in the example of Figure 20, air and water supply is possible via the conduit 61, and the number of conduits can be reduced, making it possible to reduce the diameter of the insertion section 60.

[0145] In the example shown in Figure 21, the insertion section 70 includes a pipeline 71 for supplying air and water, in addition to the pipelines 61 for supplying air. The pipeline 61 is branched into a water supply pipe 61a and an air supply pipe 61b at the junction 64 in the control device 75 and connected to the air supply and water supply control device 76. The pipeline 71 is also connected to the air supply and water supply control device 76 via a pipeline 77 in the control device 75. The control board 67 can independently control the supply of water to the water supply pipe 61a and the supply of air to the air supply pipe 61b by providing control signals to the air supply and water supply control device 76 in response to the operation of the electronic switch 69. The air supply may also be mechanical. Air is constantly supplied to the pipeline 71 by the air supply and water supply control device 76 or a pump (not shown). The air in the pipeline 71 can always flow out through the opening of the electronic switch 69. The airflow through the conduit 71 is controlled by opening and closing the opening of this electronic switch 69. Specifically, closing the opening of the electronic switch 69 allows air to flow into the conduit 71, and opening it prevents air from flowing into the conduit 71, allowing it to flow out.

[0146] During endoscopic observation of the lumen, air is introduced into the lumen to inflate it and facilitate observation. However, if air is insufflated through the nozzle 53 for a relatively long time, the objective lens surface may dry out, and dirt adhering to the objective lens surface may become stuck. Therefore, air insufflation through the nozzle 53 is performed only when automatic air insufflation is performed by the third trigger. When inflating the lumen, air is insufflated through the tube 71, which does not inflate the objective lens surface. By operating the electronic switch 69, the physician can inflate the tube 71 without drying the objective lens surface.

[0147] Furthermore, the conduit 71 can utilize either the forceps port or the auxiliary water supply conduit, and in the example shown in Figure 21, the diameter of the insertion section 70 can be reduced.

[0148] (Tip surface structure) Figure 22 is an explanatory diagram illustrating another example of the tip of the endoscope insertion section.

[0149] On the tip surface 81 of the insertion section 80, for example, the objective lens surface 82 of the objective lens for guiding the optical image of the subject to the light-receiving surface of the imaging device is positioned approximately in the center of the tip surface 81. A forceps channel 83 is also positioned on the tip surface 81. Furthermore, a nozzle 84 is positioned in an opening (not shown) for supplying air or water at a location close to the objective lens surface 82 on the tip surface 81. The nozzle 84 can supply water or air towards the objective lens surface 82.

[0150] In the example shown in Figure 22, a groove 85 is formed on the tip surface 81 to check the current flow, and a pair of electrodes 86 are provided in the groove 85, spaced a predetermined distance apart from each other. A resistance meter (conductivity meter) (not shown) is connected to the pair of electrodes 86, and the measurement results from this meter are supplied to the control unit 11 of the endoscope processor 10.

[0151] The water discharged from the nozzle 84 is trapped in the groove 85. Clean water has a sufficiently high resistance, while dirty water has a relatively low resistance. Therefore, by measuring the resistance (conductivity) between the pair of electrodes 86, it is possible to determine whether the water trapped in the groove 85 is clean or dirty. That is, according to the configuration of the tip surface 81 in Figure 22, the control unit 11 can determine whether the water near the objective lens surface 82 has been replaced with clean water by the water supply, based on the measurement result of the resistance (conductivity), and this can be used as a criterion for generating a second trigger. That is, the control unit 11 continues to supply liquid by the air-water pump 18 for a certain period of time, and then stops the supply of the fluid when the conductivity of the liquid that has come into contact with and passed over the objective lens surface falls below a predetermined value.

[0152] (Structure of the objective lens) Figure 23 is an explanatory diagram illustrating another example of an imaging device including an objective lens.

[0153] The imaging device 90 shown in Figure 23 includes an objective lens composed of multiple lenses 91 to 93, a prism 94, and sensors 95 and 96. Lens 91 is positioned at the tip of the insertion section, with its objective lens surface 91a facing the tip surface of the insertion section. The arrows in Figure 23 indicate the progression of the optical image of the subject. Light incident from the objective lens surface 91a passes through the objective lens formed by lenses 91 to 93 and the prism 94, and is then imaged onto the imaging surface of the sensor 95. The sensor 95 generates an imaging signal based on the optical image of the subject by photoelectric conversion and outputs it to the endoscope processor 10.

[0154] As described above, in a typical imaging device, the focus is not on the objective lens surface 91a, making it difficult to observe dirt adhering to the objective lens surface 91a from the captured image. Therefore, in Figure 23, a prism 94 is employed. The prism 94 is configured to guide the optical image of the subject to the imaging surface of the sensor 96, and to focus the light guided to the imaging surface of the sensor 96 onto the objective lens surface 91a. As a result, the sensor 96 can image the dirt adhering to the objective lens surface 91a.

[0155] The endoscope processor 10 performs predetermined signal processing on the imaging signal from the sensor 95 to obtain an endoscope image. This endoscope image is supplied to the monitor 40 and displayed. The endoscope processor 10 also receives an imaging signal from the sensor 96, performs predetermined signal processing on it, and provides the resulting image to the control unit 11. The control unit 11 can determine the state of contamination on the objective lens surface 91a from the image acquired by the sensor 96.

[0156] For example, the control unit 11 can determine whether or not there is stubborn dirt that cannot be removed by automatic cleaning triggered by the first to fourth triggers, based on image analysis of the image captured by the sensor 96 and the inference results of the inference model unit 15. If the control unit 11 determines that stubborn dirt is present on the objective lens surface 91a, it may notify the operator of the presence of such dirt, for example, by displaying it on a monitor or by sound. The control unit 11 may also use the determination of dirt based on the image captured by the sensor 96 to generate the first trigger.

[0157] The present invention is not limited to the embodiments described above, and the components can be modified and implemented in practice without departing from the spirit of the invention. Furthermore, various inventions can be formed by appropriately combining the multiple components disclosed in the embodiments described above. For example, some components of all the components shown in the embodiments may be deleted. Moreover, components from different embodiments may be appropriately combined.

Claims

1. An endoscope system comprising: a control device that controls a liquid supply source that supplies liquid to the tip surface of the objective optical system of the endoscope and an air supply device that supplies gas to the tip surface of the objective optical system of the endoscope; and a state determination device that determines whether or not a condition is expected to occur on the tip surface of the objective optical system of the endoscope, wherein the control device controls the liquid supply source to supply liquid to the tip surface when the state determination device determines that a condition is expected to occur on the tip surface, and after continuing to supply the liquid for a certain period of time, controls the air supply device to supply gas to the tip surface.

2. The endoscope system according to claim 1, further comprising a memory that records state determination conditions for determining the state in which the deposit is expected to occur, wherein the state determination device determines the state based on the state determination conditions recorded in the memory.

3. The endoscope system according to claim 2, further comprising an input device for transferring the state determination conditions to the memory.

4. The endoscope system according to claim 2, wherein the state determination device selects information to be used for determining the state from among the state determination conditions recorded in the memory, based on a selection signal input from an external source.

5. The endoscope system according to claim 2, wherein the state determination device performs the determination of the state using a plurality of state determination conditions recorded in the memory sequentially or simultaneously.

6. The endoscope system according to claim 1, wherein the state determination device determines whether or not a state in which deposits are expected to form is present, as well as whether or not the endoscope is in a magnified observation state, or whether or not a treatment instrument is being used on the endoscope, and the control device prohibits the supply of liquid from the liquid supply source if it is determined that the endoscope is in a magnified observation state or that a treatment instrument is being used on the endoscope.

7. The endoscope system according to claim 6, wherein the state determination device acquires information from a pressure detection device that detects changes in the pressure of the suction tube of the endoscope, and determines whether the pressure of the suction tube has changed to a predetermined value or not, and the control device, when it is indicated that the pressure of the suction tube has changed to a predetermined value and continues for a predetermined time, controls the liquid supply source to supply liquid to the tip surface.

8. The endoscope system according to claim 6, wherein the state determination device acquires information from a pressure detection device that detects changes in pressure in the suction line of the endoscope or changes in electrical load, and determines whether the pressure in the suction line has changed beyond a predetermined value and subsequently the pressure in the supply line has fallen below a predetermined value, and the control device determines that suction has ended when it is indicated that the pressure in the suction line has fallen below the predetermined value, and controls the liquid supply source to supply liquid to the tip surface.

9. The endoscope system according to claim 1, wherein the state determination device has an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not the input image is an image obtained during a suction operation, and the control device controls the liquid supply source to supply liquid to the tip surface when the inference model infers that a suction operation is in progress.

10. The endoscope system according to claim 1, wherein the state determination device has an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not the input image is an image obtained when a suction operation has been performed and then the suction operation has ended, and the control device controls the liquid supply source to supply liquid to the tip surface when the inference model infers that the suction operation has ended.

11. The endoscope system according to claim 1, wherein the state determination device has an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not the input image shows a state in which staining solution has been sprayed into the living body, and the control device controls the liquid supply source to supply liquid to the tip surface when the inference model infers that staining solution has been sprayed.

12. The endoscope system according to claim 1, wherein the state determination device has an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not the input image shows a state in which staining solution has been sprayed into a living body and the spraying has been completed, and the control device controls the liquid supply source to supply liquid to the tip surface when the inference model infers that the spraying of the staining solution has been completed.

13. The endoscope system according to claim 1, wherein the state determination device has an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not the input image shows that the tip surface of the objective optical system has come into contact with biological tissue, and the control device controls the liquid supply source to supply liquid to the tip surface when the inference model infers that the tip surface of the objective optical system has come into contact with biological tissue.

14. The endoscope system according to claim 1, wherein the control device stops supplying the fluid after continuing to supply the liquid from the liquid supply source for a certain period of time.

15. The endoscope system according to claim 1, wherein the control device starts supplying gas by the air supply device after stopping the supply of the fluid by the liquid supply source.

16. The endoscope system according to claim 1, wherein the control device stops the supply of gas by the air supply device after continuing to supply gas for a certain period of time.

17. The endoscope system according to claim 1, wherein the control device continues to supply the liquid from the liquid supply source for a certain period of time, and then stops supplying the fluid when the conductivity of the liquid that has come into contact with and passed over the tip surface falls below a predetermined value.

18. The endoscope system according to claim 16, further comprising an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not a foreign object is present on the tip surface of the objective optical system based on the input image, wherein the control device does not supply liquid to the tip surface by the liquid supply source when the inference model infers that a foreign object is present on the tip surface of the objective optical system, during treatment, magnified observation, pharyngeal observation, or when there is an instruction to prohibit water supply.

19. The endoscope system according to claim 16, further comprising an inference model that learns images acquired by the endoscope and outputs an inference result of whether or not a foreign object is present on the tip surface of the objective optical system based on the input image, wherein the control device issues a notification via a monitor or an audible warning when the inference model infers that a foreign object is present on the tip surface of the objective optical system.

20. An endoscope system comprising: an endoscope having an objective optical system; a water supply line for supplying liquid to the tip surface of the objective optical system; and an air supply line for supplying gas to the tip surface of the objective optical system; a control device for controlling a liquid supply source that supplies liquid to the water supply line of the endoscope and an air supply device that supplies gas to the air supply line of the endoscope; and a state determination device for determining whether or not a state is expected to occur on the tip surface of the objective optical system of the endoscope, wherein if the state determination device determines that a state is expected to occur on the tip surface, the control device controls the liquid supply source to supply liquid to the tip surface, continues supplying the liquid for a certain period of time, and then controls the air supply device to supply gas to the tip surface.

21. An operation method for an endoscope system, comprising: acquiring an image based on an optical image of a subject incident through the objective optical system at the tip of the insertion part of an endoscope inserted into a living body; determining whether or not a condition is expected to occur in which deposits are likely to form on the tip surface of the objective optical system; if it is determined that a condition is expected to occur in which deposits are likely to form on the tip surface of the objective optical system, supplying liquid to the tip surface of the objective optical system to clean the tip surface; continuing to supply the liquid for a certain period of time and then stopping the supply of the liquid; and after stopping the supply of the liquid, blowing gas onto the tip surface to remove the liquid remaining on the tip surface.

Images