Endoscope system and its working method
The endoscope system dynamically adjusts and displays light intensity and emphasis suppression modes using a display control unit, improving image quality by tailoring light sources to the observation object's needs.
Patent Information
- Application Number
- CN202010950565.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-09-11
- Filing Date
- 2020-09-10
- Publication Date
- 2025-07-15
- Estimated Expiration
- 2040-09-10
AI Technical Summary
When using multiple semiconductor light sources in the existing endoscope system, it is impossible to effectively change the amount of light of each illumination light according to the emphasis suppression amount of the observation object, resulting in poor observation effect.
The endoscope system is equipped with a display control unit, which can display a light quantity display screen and an emphasis suppression mode selection screen on the display, and dynamically adjust the light quantity ratio of each semiconductor light source through the light quantity adjustment command and an emphasis suppression setting command, and change the white balance gain coefficient in conjunction with the image processing unit to optimize image display.
The display of light quantity of each semiconductor light source dynamically adjusts the amount of light quantity displayed according to the emphasis of the observation object, and improves the observation effect and image quality.
Smart Images

Figure CN112472011B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an endoscope system having a plurality of semiconductor light sources and a method of operating the same. Background Art
[0002] In recent years, endoscope systems (for example, Patent Documents 1 and 2) having a light source device, an endoscope, and a processor device have been widely used. In an endoscope system, illumination light is irradiated onto an observation target from the endoscope, and an image of the observation target is displayed on a display based on an RGB image signal obtained by photographing the observation target illuminated by the illumination light through an imaging element of the endoscope.
[0003] Moreover, an endoscope system having a light source device provided with a plurality of semiconductor light sources that emit illumination light of a plurality of wavelength bands is being used. In such an endoscope system, by adjusting the light quantity ratio of the illumination light of the plurality of wavelength bands, illumination light of various colors can be emitted. For example, Patent Document 1 describes illuminating an observation target using an LED for visible light and an LED for ultraviolet light.
[0004] Patent Document 1: Japanese Patent Application Laid-Open No. 2007-139822
[0005] Patent Document 2: Japanese Patent Application Laid-Open No. 2009-201593
[0006] In Patent Document 1, indicators for displaying the light quantity levels of the LED for visible light and the LED for ultraviolet light are respectively displayed in stages. As in Patent Document 1, in the case of using semiconductor light sources of a plurality of colors, it is also preferable to display the light quantity of the illumination light emitted from each semiconductor light source by a light quantity display unit. Further, in the case of changing the emphasis suppression amount of an observation target such as blood vessel emphasis by adjusting the light quantity ratio of the illumination light, it is also preferable to change the display content of the light quantity display unit for each illumination light according to the emphasis suppression amount of the observation target. However, Patent Document 1 does not describe or suggest changing the display content of the light quantity display unit for each illumination light according to the emphasis suppression amount. Also, although Patent Document 2 describes displaying the emphasis suppression amount of an observation target such as IHb emphasis or infrared emphasis in stages, it does not describe or suggest changing the display content of the light quantity display unit for each illumination light according to the emphasis suppression amount. Summary of the Invention
[0007] An object of the present invention is to provide an endoscope system and a method of operating the same that can change the display content of a light quantity display unit for each illumination light emitted from each semiconductor light source according to the emphasis suppression amount of an observation target when using a plurality of semiconductor light sources.
[0008] The endoscope system of the present invention includes a display control unit that can display at least one of the following screens on a display unit: a light quantity display screen for displaying a light quantity ratio indicating the relative light quantity of illumination light in a plurality of wavelength bands emitted from a plurality of semiconductor light sources, and having a light quantity size display unit indicating the size of the light quantity of each illumination light, and changing the display content of the light quantity size display unit including the size of the light quantity according to a light quantity adjustment command; and an emphasis suppression mode selection screen for selecting a specific emphasis suppression mode from a plurality of emphasis suppression modes, and having an emphasis suppression quantity display unit indicating the emphasis quantity in the emphasis suppression mode, and changing the display content of the emphasis suppression quantity display unit according to an emphasis suppression quantity setting command. The display control unit performs at least any one of the operations of changing the display content of the light quantity size display unit in association with the selection of a specific emphasis suppression mode, changing the display content of the light quantity size display unit in association with the change of the display content of the emphasis suppression quantity display unit, or changing the display content of the emphasis suppression quantity display unit in association with the change of the display content of the light quantity size display unit.
[0009] The display unit preferably selects both the light quantity display screen and the emphasis suppression mode selection screen. When the emphasis suppression mode selection screen can be operated, the display control unit preferably changes the display content of the light quantity size display unit in association with the selection of a specific emphasis suppression mode or changes the display content of the light quantity size display unit in association with the change of the display content of the emphasis suppression quantity display unit. When the light quantity display screen can be operated, the display control unit preferably performs an operation of changing the display content of the emphasis suppression quantity display unit in association with the change of the display content of the light quantity size display unit.
[0010] Preferably, there are a plurality of light emission modes in which the light quantity ratios of a plurality of illumination lights are different from each other. The light quantity display screen is provided for each light emission mode, and the display control unit changes the display content of the light quantity size display unit in the light quantity display screen corresponding to the light emission mode in association with the switching of the light emission mode.
[0011] Preferably, it includes an image acquisition unit that acquires an image signal obtained by photographing an observation object illuminated by a plurality of illumination lights emitted from a plurality of semiconductor light sources, and an image processing content change unit that changes the content of image processing of the image signal when a light quantity adjustment command is executed. The image processing content change unit preferably changes the R white balance gain coefficient, G white balance gain coefficient, and B white balance gain coefficient multiplied by the image signal as the content of image processing.
[0012] Preferably, the apparatus comprises: a monochrome white balance gain storage unit for storing monochrome R white balance gain coefficients, monochrome G white balance gain coefficients, and monochrome B white balance gain coefficients obtained when only each semiconductor light source is emitted; and a white balance gain calculation unit for calculating R white balance gain coefficients, G white balance gain coefficients, and B white balance gain coefficients based on the changed light amount ratio and the monochrome R white balance gain coefficients, monochrome G white balance gain coefficients, and monochrome B white balance gain coefficients when the light amount ratio of the plurality of illumination lights is changed due to the light amount adjustment command. Preferably, the image processing content changing unit changes the mucous membrane color adjustment R gain coefficient, mucous membrane color adjustment G gain coefficient, and mucous membrane color adjustment B gain coefficient multiplied to the image signal as the content of the image processing.
[0013] Preferably, a specific light quantity ratio calculation unit is provided for analyzing the image signal and obtaining a specific light quantity ratio corresponding to the observation object, and the light quantity ratio of the illumination light is set to the specific light quantity ratio according to the light quantity adjustment command. The plurality of semiconductor light sources preferably include V-LED, B-LED, G-LED and R-LED.
[0014] The working method of the endoscope system of the present invention has a step in which a display control unit is able to display at least one of the following screens on the display unit: a light quantity display screen, which is used to display a light quantity ratio indicating the relative light quantity size of illumination lights of multiple bands emitted from multiple semiconductor light sources, and has a light quantity size display unit indicating the size of the light quantity of each illumination light, and the display content of the light quantity size display unit including the size of the light quantity is changed according to a light quantity adjustment command; and an emphasis suppression mode selection screen, which is used to select a specific emphasis suppression mode from multiple emphasis suppression modes, and has an emphasis suppression amount display unit indicating the emphasis amount in the emphasis suppression mode, and the display content of the emphasis suppression amount display unit is changed according to an emphasis suppression amount setting command. In the step of controlling by the display control unit, at least any one of the following operations is performed: changing the display content of the light quantity size display unit in conjunction with the selection of a specific emphasis suppression mode, changing the display content of the light quantity size display unit in conjunction with the change of the display content of the emphasis suppression amount display unit, or changing the display content of the emphasis suppression amount display unit in conjunction with the change of the display content of the light quantity size display unit.
[0015] Effects of the Invention
[0016] According to the present invention, when a plurality of semiconductor light sources are used, the display content of the light quantity display unit of each illumination light emitted from each semiconductor light source can be changed according to the emphasis suppression amount of the observation object. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 This is an external view of the endoscope system.
[0018] Figure 2 It is a block diagram showing the functions of the endoscope system.
[0019] Figure 3 It is a graph showing the emission spectra of purple light V, blue light B, green light G, and red light R.
[0020] Figure 4 It is an image diagram of the display showing the light quantity display screen.
[0021] Figure 5 It is an image diagram of the display showing the light quantity display screen when the light emission mode is switched.
[0022] Figure 6 It is an image diagram of the display showing the emphasis suppression mode selection screen.
[0023] Figure 7 It is an explanatory diagram showing the light quantity adjustment amount with respect to the reference light quantity of each emphasis suppression mode in the normal light emission mode.
[0024] Figure 8 It is an explanatory diagram showing the light quantity adjustment amount with respect to the reference light quantity of each emphasis suppression mode in the first illumination light emission mode.
[0025] Figure 9 It is an explanatory diagram showing the light quantity adjustment amount with respect to the reference light quantity of each emphasis suppression mode in the second illumination light emission mode.
[0026] Figure 10 It is an explanatory diagram showing that the display content of the light quantity size display section of the light quantity display screen changes in association with the selection of a specific emphasis suppression mode and that the display content of the light quantity size display section of the light quantity display screen changes in association with an emphasis suppression amount setting command.
[0027] Figure 11 It is an explanatory diagram showing that the display content of the emphasis suppression amount display section of the emphasis suppression mode selection screen changes in association with a light quantity adjustment command.
[0028] Figure 12 It is a block diagram showing the functions of the white balance processing section.
[0029] Figure 13 It is an explanatory diagram showing the white balance gain coefficient for monochromatic use R, the white balance gain coefficient for monochromatic use G, and the white balance gain coefficient for monochromatic use B.
[0030] Figure 14 It is a block diagram of an endoscope system equipped with a mucosal color adjustment processing section.
[0031] Figure 15 It is a block diagram of an endoscope system equipped with a specific light quantity ratio calculation section.
[0032] Figure 16 is a flowchart showing a series of processes of the present invention.
[0033] Symbol Explanation
[0034] 10 - Endoscope system, 12 - Endoscope, 12a - Insertion portion, 12b - Operation portion, 12c - Bending portion, 12d - Tip portion, 12e - Bend angle knob, 13a - Light emission mode switching SW, 13b - Emphasis suppression mode switching SW, 13c - Still image acquisition command section, 14 - Light source device, 16 - Processor device, 18 - Display, 19 - User interface, 20 - Light source section, 20a - V - LED, 20b - B - LED, 20c - G - LED, 20d - R - LED, 21 - Light source control section, 23 - Optical path combining section, 30a - Illumination optical system, 30b - Imaging optical system, 41 - Light guide, 45 - Illumination lens, 46 - Objective lens, 48 - Imaging sensor, 50 - CDS / AGC circuit, 51 - A / D converter, 52 - Image acquisition section, 54 - DSP, 58 - Denoising section, 60 - White balance processing section, 60a - Monochromatic white balance gain storage section, 60b - White balance gain calculation section, 61 - Mucosal color adjustment processing section, 62 - Image processing section, 70 - Display control section, 72 - Light quantity adjustment command generation section, 74 - Emphasis suppression mode selection section, 76 - Emphasis suppression amount setting command generation section, 78 - Image processing content change section, 80 - Light quantity display screen, 82 - Light quantity size display section, 82a - V light quantity size display section, 82b - B light quantity size display section, 82c - G light quantity size display section, 82d - R light quantity size display section, 84 - Emphasis suppression mode selection screen, 85 - Check box, 86 - Emphasis suppression amount display section, 90 - Specific light quantity ratio calculation section, SLx, Sly - Reference lines. Detailed Description of the Invention
[0035] As Figure 1 shown, the endoscope system 10 includes an endoscope 12, a light source device 14, a processor device 16, a display 18 (display section), and a user interface 19. The endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16. The endoscope 12 has an insertion portion 12a inserted into the subject's body, an operation portion 12b provided at the proximal end portion of the insertion portion 12a, and a bending portion 12c and a tip portion 12d provided on the front end side of the insertion portion 12a. By operating the bend angle knob 12e of the operation portion 12b, the bending portion 12c performs a bending action. Along with this bending action, the tip portion 12d faces the desired direction. In addition, the user interface 19 includes a mouse etc. in addition to the illustrated keyboard.
[0036] Also, in the operation unit 12b, in addition to the angulation button 12e, there are also provided a light emission mode switching SW (Switch) 13a, an emphasis suppression mode switching SW (Switch) 13b, and a still image acquisition command unit 13c. In the endoscope system 10, there are provided a plurality of light emission modes with different light quantity ratios of illumination light. The light emission mode switching SW 13a is used for switching operations among three light emission modes: a normal light emission mode, a first special light emission mode, and a second special light emission mode. In addition, by operating the still image acquisition command unit 13c, a still image of the image is stored in a still image storage unit (not shown) in the processor device 16.
[0037] The normal light emission mode is a mode in which a normal image obtained by photographing an observation object illuminated by normal light equivalent to white light is displayed on the display 18. The first illumination light emission mode is a mode in which a first image obtained by photographing an observation object illuminated by a first illumination light having a larger light quantity of short-wavelength light such as purple light than that of light of other wavelengths is displayed on the display 18. The second illumination light emission mode is a mode in which a second image obtained by photographing an observation object illuminated by a second illumination light having a larger light quantity of short-wavelength or medium-wavelength light such as green light than that of light of other wavelengths is displayed on the display 18.
[0038] In the endoscope system 10, there are provided a plurality of emphasis suppression modes for emphasizing or suppressing a specific observation object or region of interest from among a plurality of observation objects or regions of interest by finely adjusting the light quantity ratio in each light emission mode. The emphasis suppression mode switching SW 13b is used for switching operations among emphasis suppression modes such as a blood vessel emphasis mode, a residue suppression mode, a surface structure emphasis mode, a stomach observation mode, and a CV (crystal violet) emphasis mode.
[0039] The blood vessel emphasis mode is a mode in which the visual recognition degree of blood vessels in an image is increased by making the light quantity of light having a wavelength of 410 nm or 550 nm, which has a larger light absorption amount of hemoglobin contained in the blood vessels, larger than the light quantity in a reference state. The residue suppression mode is a mode in which the visual recognition degree of residues in an image is reduced by making the light quantity of light having a wavelength of 410 nm or 550 nm, which has a larger light absorption amount of the residues, smaller than the light quantity in a reference state because residues such as bile often interfere with diagnosis. The surface structure emphasis mode is a mode in which the visual recognition degree of surface structures such as glandular duct microstructures is increased by making the light quantity of light having a wavelength of 410 nm or 550 nm larger than the light quantity in a reference state.
[0040] The stomach observation mode is a mode that enables the internal part of the stomach to be observed in a bright state by making the amount of light in the green band greater than the amount of light in other wavelength regions. The CV emphasis mode is a mode in which, when crystal violet (methyl violet) having a light reflectance of a certain level or more is used for emphasizing abnormal parts such as a lesion part in a wavelength band of 470 nm or less and a wavelength band of 640 nm or more, the visual recognition of crystal violet is improved by increasing the amount of light of the component in the red band.
[0041] The processor device 16 is electrically connected to the display 18 and the user interface 19. The display 18 outputs display image information and the like. The user interface 19 receives input operations such as function settings. In addition, an external recording unit (not shown) for recording image information and the like may also be connected to the processor device 16.
[0042] As Figure 2 shown, the light source device 14 includes a light source unit 20, a light source control unit 21, and an optical path combining unit 23. The light source unit 20 includes a plurality of semiconductor light sources that emit illumination light in a plurality of bands. Specifically, the light source unit 20 includes a V-LED (Violet Light Emitting Diode) 20a, a B-LED (Blue Light Emitting Diode) 20b, a G-LED (Green Light Emitting Diode) 20c, and an R-LED (Red Light Emitting Diode) 20d. The light source control unit 21 controls the driving of the LEDs 20a to 20d. The optical path combining unit 23 combines the optical paths of the four-color light emitted from the four-color LEDs 20a to 20d. The light combined by the optical path combining unit 23 is irradiated into the subject through an optical waveguide 41 and an illumination lens 45 inserted and penetrating through the insertion portion 12a. In addition, an LD (Laser Diode) may be used instead of the LED.
[0043] As Figure 3 shown, the V-LED 20a generates purple light V having a center wavelength of 405 ± 10 nm and a wavelength range of 380 to 420 nm. The B-LED 20b generates blue light B having a center wavelength of 460 ± 10 nm and a wavelength range of 420 to 500 nm. The G-LED 20c generates green light G having a wavelength range of 480 to 600 nm. The R-LED 20d generates red light R having a center wavelength of 620 to 630 nm and a wavelength range of 600 to 650 nm.
[0044] The light source control unit 21 controls the V-LED 20a, B-LED 20b, G-LED 20c, and R-LED 20d. Moreover, when in the normal light emission mode, the light source control unit 21 controls each of the LEDs 20a to 20d such that the reference light quantity ratio among the purple light V, blue light B, green light G, and red light R emitted as the illumination light for the normal light emission mode becomes the normal light of Vc∶Bc∶Gc∶Rc. In addition, the light quantity ratio of the normal light can be adjusted with respect to the reference light quantity ratio Vc∶Bc∶Gc∶Rc.
[0045] Moreover, when in the first illumination light emission mode, the light source control unit 21 controls each of the LEDs 20a to 20d such that the reference light quantity ratio among the purple light V, blue light B, green light G, and red light R emitted as the illumination light for the first illumination light emission mode becomes the first illumination light of Vs1∶Bs1∶Gs1∶Rs1. The first illumination light preferably has a greater light intensity of the purple light V than the light intensities of the other blue light B, green light G, and red light R. In addition, the light quantity ratio of the first illumination light can be adjusted with respect to the reference light quantity ratio Vs1∶Bs1∶Gs1∶Rs1.
[0046] Moreover, when in the second illumination light emission mode, the light source control unit 21 controls each of the LEDs 20a to 20d such that the reference light quantity ratio among the purple light V, blue light B, green light G, and red light R emitted as the illumination light for the second illumination light emission mode becomes the second illumination light of Vs2∶Bs2∶Gs2∶Rs2. The second illumination light preferably has a greater light intensity of the blue light B or green light G than the light intensities of the other purple light V or red light R. In addition, the light quantity ratio of the second illumination light can be adjusted with respect to the reference light quantity ratio Vs2∶Bs2∶Gs2∶Rs2.
[0047] In addition, in this specification, the light quantity ratio includes the case where the ratio of at least one LED is 0 (zero). Therefore, it includes the case where any one or two or more of the semiconductor light sources do not emit light. For example, assume that the light quantity ratio among the purple light V, blue light B, green light G, and red light R is 1∶0∶0∶0. Even when only one of the semiconductor light sources emits light and the other three do not emit light, there is still a light quantity ratio.
[0048] When a light quantity adjustment command for adjusting at least any one of the light quantities of the purple light V, blue light B, green light G, or red light R is executed from the processor device 16 to the light source device 14, the light source control unit 21 performs light source control corresponding to the light quantity adjustment command in each emission mode, that is, controls the light intensities of the V-LED 20a, B-LED 20b, G-LED 20c, and R-LED 20d.
[0049] As Figure 2As shown, the light guide 41 is built into the endoscope 12 and the general cord (the cord connecting the endoscope 12 to the light source device 14 and the processor device 16), and propagates the light combined by the optical path coupling portion 23 to the distal end portion 12d of the endoscope 12. In addition, as the light guide 41, a multimode optical fiber can be used. As an example, an optical cable with a core diameter of 105 μm, a cladding diameter of 125 μm, and a diameter φ0.3 to 0.5 mm including a protective layer as the outer skin can be used.
[0050] The distal end portion 12d of the endoscope 12 is provided with an illumination optical system 30a and an imaging optical system 30b. The illumination optical system 30a has an illumination lens 45, and the light from the light guide 41 is irradiated onto the observation object via the illumination lens 45. The imaging optical system 30b has an objective lens 46 and an imaging sensor 48. The reflected light from the observation object is incident on the imaging sensor 48 via the objective lens 46. Thus, a reflected image of the observation object is formed on the imaging sensor 48.
[0051] The imaging sensor 48 is a color imaging sensor, and captures the reflected image of the subject and outputs an image signal. The imaging sensor 48 is preferably a CCD (Charge Coupled Device) imaging sensor or a CMOS (Complementary Metal - Oxide Semiconductor) imaging sensor or the like. The imaging sensor 48 used in the present invention is a color imaging sensor for obtaining RGB image signals of three colors, R (red), G (green), and B (blue), that is, a so - called RGB imaging sensor having an R pixel provided with an R filter, a G pixel provided with a G filter, and a B pixel provided with a B filter.
[0052] In addition, as the imaging sensor 48, instead of an RGB color imaging sensor, it can also be a so - called complementary color imaging sensor having complementary color filters of C (cyan), M (magenta), Y (yellow), and G (green). When using a complementary color imaging sensor, image signals of four colors, CMYG, are output, so it is necessary to convert the CMYG image signals into RGB image signals through complementary - primary color conversion. Also, the imaging sensor 48 can be a monochromatic imaging sensor without a color filter provided. In this case, the light source control unit 21 needs to turn on the blue light B, green light G, and red light R in a time - sharing manner, and add synchronization processing in the processing of the imaging signal.
[0053] The image signal output from the imaging sensor 48 is sent to the CDS / AGC circuit 50. The CDS / AGC circuit 50 performs correlated double sampling (CDS) or automatic gain control (AGC) on the analog signal, i.e., the image signal. The image signal that has passed through the CDS / AGC circuit 50 is converted into a digital image signal by an A / D converter (A / D (Analog / Digital) converter) 51. The digital image signal that has been A / D-converted is input to the processor device 16.
[0054] The processor device 16 includes an image acquisition unit 52, a DSP (Digital Signal Processor) 54, a denoising unit 58, an image processing unit 62, a display control unit 70, a light amount adjustment command generation unit 72, an emphasis suppression mode selection unit 74, an emphasis suppression amount setting command generation unit 76, and an image processing content change unit 78.
[0055] The image acquisition unit 52 acquires an observation image obtained by photographing an observation object with the endoscope 12. Specifically, as the observation image, a digital color image signal from the endoscope 12 is input to the image acquisition unit 52. The color image signal is composed of a red signal output from the R pixel of the imaging sensor 48, a green signal output from the G pixel of the imaging sensor 48, and a blue signal output from the B pixel of the imaging sensor 48.
[0056] The image acquisition unit 52 acquires an ordinary light image signal obtained by photographing an observation object illuminated by ordinary light in the ordinary light emission mode. Further, the image acquisition unit 52 acquires a first image signal obtained by photographing an observation object illuminated by the first illumination light in the first illumination light emission mode. Further, the image acquisition unit 52 acquires a second image signal obtained by photographing an observation object illuminated by the second illumination light in the second illumination light emission mode.
[0057] The DSP 56 performs various signal processes such as defect correction processing, offset processing, white balance processing, demosaicking processing, linear matrix processing, or gamma conversion processing on the received image signal. In the defect correction processing, the signal of the defective pixel of the imaging sensor 48 is corrected. In the offset processing, the dark current component is removed from the image signal that has undergone the defect correction processing, and an accurate zero level is set. The white balance processing is performed by the white balance processing unit 60, and the signal level is adjusted by multiplying the image signal after the offset processing by a gain coefficient.
[0058] The demosaicing process (also known as isotropic processing and synchronization processing) is performed on the image signal after white balance processing, and signals for the missing colors in each pixel are generated through interpolation. Through this demosaicing process, all pixels have signals for each color. A linear matrix process for improving color reproducibility is performed on the image signal after demosaicing. Then, the brightness or chroma is adjusted through gamma conversion processing.
[0059] The noise reduction unit 58 performs noise reduction processing (such as the moving average method or median filtering method, etc.) on the image signal that has undergone gamma correction and the like by the DSP 56, thereby removing noise from the image signal. The image signal from which noise has been removed is sent to the image processing unit 62.
[0060] When set to the normal light emission mode, the image processing unit 62 performs normal image processing on the normal light image signal. Normal image structure enhancement processing or tone enhancement processing, etc. are included in the normal image processing. The normal light image signal on which normal image processing has been performed is input to the display control unit 70 as a normal image. And when set to the first illumination light emission mode, the image processing unit 62 performs first image processing on the first image signal. First image structure enhancement processing or tone enhancement processing, etc. are included in the first image processing. The first image signal on which first image processing has been performed is input to the display control unit 70 as the first image. And when set to the second illumination light emission mode, the image processing unit 62 performs second image processing on the second image signal. Second image structure enhancement processing or tone enhancement processing, etc. are included in the second image processing. The second image signal on which second image processing has been performed is input to the display control unit 70 as the second image.
[0061] The display control unit 70 performs control for displaying the normal image, the first image, and / or the second image input from the image processing unit 62 as an image that can be displayed on the display 18. Through the control based on the display control unit 70, an image corresponding to each mode is displayed. In the case of the normal light emission mode, the normal image is displayed on the display 18. And in the case of the first illumination light emission mode, the first image is displayed on the display 18. And in the case of the second illumination light emission mode, the second image is displayed on the display 18.
[0062] When a light quantity adjustment command is executed through the user interface 19, the light quantity adjustment command generation unit 72 generates a light quantity adjustment command for adjusting the light quantity ratio of the normal light, the first illumination light, or the second illumination light of the light source device 14. In this case, the display control unit 70 displays a light quantity display screen for displaying the light quantity ratio indicating the relative light quantity of the illumination lights of multiple bands on the display 18, and the user observes the light quantity display screen and operates the user interface 19, thereby executing the light quantity adjustment command. If the light quantity adjustment command is executed, the display content of the light quantity display screen including the light quantity size changes. Further, the light quantity adjustment command is sent to the light source device 14, and the light source control unit 21 controls the light emission intensity of the V-LED 20a, B-LED 20b, G-LED 20c, or R-LED 20d according to the light quantity adjustment command.
[0063] As Figure 4 shown, the light quantity display screen 80 has a light quantity size display unit 82 for indicating the light quantity size of each illumination light. The light quantity size display unit 82 includes a V light quantity size display unit 82a for displaying the light quantity size of the purple light V emitted from the V-LED 20a, a B light quantity size display unit 82b for displaying the light quantity size of the blue light B emitted from the B-LED 20b, a G light quantity size display unit 82c for displaying the light quantity size of the green light G emitted from the G-LED 20c, and an R light quantity size display unit 82d for displaying the light quantity size of the red light R emitted from the R-LED 20d. Each of the light quantity size display units 82a to 82d is displayed as an indicator for displaying the light quantity size in stages.
[0064] In the present embodiment, a light quantity display frame LB that divides the light quantity size into six stages is arranged vertically on the light quantity display screen 80, and the light quantity size is indicated by the lighting (hatched) or extinguishing (non-hatched) of the light quantity display frame LB. Further, in the present embodiment, in order to indicate the stage of how much more or less the light quantity is relative to the reference state, when half (three, the light quantity display frames LB in the first to third stages from the bottom) of the six light quantity display frames are lit, it indicates that the light quantity of each illumination light is the reference state. In this case, “±0” is displayed on the light quantity display screen 80.
[0065] In contrast, when the light quantity display frame LB is lit less than half, it indicates a light quantity less than the reference state. In this case, "-P%" (P is a positive integer indicating the degree of difference from the reference state) is displayed on the light quantity display screen 80. Also, when the light quantity display frame LB is lit more than half, it indicates a light quantity greater than the reference state. In this case, "+P%" (P is a positive integer indicating the degree of difference from the reference state) is displayed on the light quantity display screen 80. In addition, in order to make the lighting of the light quantity display frames LB of the 1st to 3rd stages indicate the light quantity of the reference state, a reference line SLx is provided between the light quantity display frames LB of the 3rd and 4th stages.
[0066] The user operates the user interface 19 to issue a light quantity adjustment command to increase or decrease the light quantity of the purple light V, blue light B, green light G, and red light R in the reference state between the first and third stages. The light quantity display frames LB in each light quantity display unit 82a to 82d are lit or extinguished in conjunction with the light quantity adjustment command. For example, when the light quantity of the purple light V included in the ordinary light is increased by one stage from the light quantity of the reference state, in addition to lighting the light quantity display frames LB in the first to third stages from the bottom, the light quantity display frame LB in the fourth stage from the bottom in the V light quantity display unit 82a is also switched from extinguished to lit. In addition, the light quantity adjustment command related to increasing the light quantity of the purple light V by one stage from the light quantity of the reference state is sent to the light source device 14. The light source control unit 21 controls the V-LED 20a and controls the intensity of the purple light V to be increased according to the light quantity adjustment command.
[0067] In addition, since a reference light quantity ratio is set in each lighting mode, the display content of the light quantity display screen 80 at the reference light quantity ratio is the same in any lighting mode (the light quantity display frame LB of the first to third stages is lit). That is, even when the lighting mode is switched, the light quantity display screen 80 is not displayed except for the portion indicating the lighting mode (in the Figure 4 Same as above except for “normal light emission mode”.
[0068] In addition, the reference light quantity ratio of any one of the plurality of light emission modes may be set as the reference light quantity ratio of the other light emission modes. For example, the reference light quantity ratio of the normal light may be set as the reference light quantity ratio of the first illumination light and the second illumination light. In this case, the display contents of the reference light quantity ratio in each light emission mode are different. For example, Figure 5As shown, in the light quantity display screen 80 in the normal light emission mode, in the case of the reference light quantity ratio, the light quantity display frames LB in the first to third stages are lit in each of the light quantity size display units 82a to 82d. In contrast, by switching to the first illumination light emission mode, even in the case of the reference light quantity ratio, with respect to the B light quantity size display unit 82b, the G light quantity size display unit 82c, and the R light quantity size display unit 82d, the light quantity display frames LB in the first to third stages are lit. On the other hand, with respect to the V light quantity size display unit 82a, the light quantity display frames LB in the first to fourth stages are lit. This is because the reference light quantity ratio of the first illumination light has a higher light quantity of purple light V than the reference light quantity ratio of the normal light.
[0069] The emphasis suppression mode selection unit 74 receives a user operation based on the emphasis suppression mode switching SW13b and selects a specific emphasis suppression mode from a plurality of emphasis suppression modes. As Figure 6 shown, the plurality of emphasis suppression modes to be selected are displayed on the emphasis suppression mode selection screen 84 on the display 18. The user observes the emphasis suppression mode selection screen 84 and operates the emphasis suppression mode switching SW13b, thereby selecting a specific emphasis suppression mode. In the emphasis suppression mode selection screen 84, the check box 85 indicating the currently selected emphasis suppression mode is displayed on the left side.
[0070] For example, in Figure 6 this case, since the check box 85 is displayed on the left side of the "residue suppression mode", it indicates that the "residue suppression mode" is selected. Specifically, each time the emphasis suppression mode switching SW13b is pressed once, the selected emphasis suppression mode is switched to another emphasis suppression mode. Moreover, when the selected emphasis suppression mode is determined, by long-pressing the emphasis suppression mode switching SW13b for a certain period of time, the selected emphasis suppression mode is selected by the emphasis suppression mode selection unit 74 and determined as a specific emphasis suppression mode. In addition, the switching order is, for example, the blood vessel emphasis mode, the residue suppression mode, the surface structure emphasis mode, the stomach observation mode, the CV emphasis mode, but it is not limited to this order.
[0071] The emphasis suppression amount setting command generation unit 76 receives a user operation based on the emphasis suppression mode switching SW13b and adjusts the light quantity of the illumination light for a specific emphasis suppression mode, thereby generating a command for setting the emphasis suppression amount for emphasizing or suppressing a specific observation object or region of interest, that is, the emphasis suppression amount setting command. The user observes the emphasis suppression amount of the selected specific emphasis suppression mode displayed on the emphasis suppression amount display unit 86 of the emphasis suppression mode selection screen 84 and operates the emphasis suppression mode switching SW13b, thereby executing the emphasis suppression amount setting command. In this case, if the emphasis suppression amount setting command is executed, the display content of the emphasis suppression mode selection screen 84 changes.
[0072] Specifically, when the selected specific emphasis suppression mode is the residue suppression mode, on the emphasis suppression mode selection screen 84, a frame EB for the emphasis suppression amount divided into six stages is horizontally displayed to the right of the residue suppression mode. The emphasis suppression amount is represented by the lighting (with hatched lines) or extinguishing (without hatched lines) of the frame EB for the emphasis suppression amount. And, when half (three. The first to third frame FBs for the emphasis suppression amount from the left) of the six frames EB for the emphasis suppression amount are lit to indicate the stage of how much more or less than the reference emphasis suppression amount, it indicates that the emphasis suppression amount is the reference emphasis suppression amount. In this case, it is displayed as "±0" on the emphasis suppression mode selection screen 84.
[0073] In contrast, when the lit frame EB for the emphasis suppression amount is less than half, it indicates less than the reference emphasis suppression amount. In this case, it is displayed as "-Q%" (Q is a positive integer indicating the stage of how much different from the reference emphasis suppression amount) on the emphasis suppression mode selection screen 84. When the lit frame EB for the emphasis suppression amount is more than half, it indicates more than the reference emphasis suppression amount. In this case, it is displayed as "+Q%" (Q is a positive integer indicating the stage of how much different from the reference emphasis suppression amount) on the emphasis suppression mode selection screen 84.
[0074] In addition, in order to make the lighting up to the first to third frame EB for the emphasis suppression amount from the left indicate the reference emphasis suppression amount, a reference line Sly is provided between the third and fourth frame EB for the emphasis suppression amount. And, when the emphasis suppression mode switch SW13b can be operated in two steps of half-press and full-press, it is preferably set such that when the emphasis suppression mode switch SW13b is half-pressed, the emphasis suppression amount becomes greater than the reference emphasis suppression amount, and when the emphasis suppression mode switch SW13b is fully pressed, the emphasis suppression amount becomes less than the reference emphasis suppression amount.
[0075] And, the emphasis suppression amount setting command generated by the emphasis suppression amount setting command generation unit 76 is sent to the light amount adjustment command generation unit 72. The light amount adjustment command generation unit 72 generates a light amount adjustment command based on the emphasis suppression amount setting command. The light amount adjustment command is generated for each light emission mode. Specifically, when it is the normal light emission mode and the emphasis suppression amount in the emphasis suppression amount setting command is the reference emphasis suppression amount, the light amount adjustment amount relative to the light amount in the reference state under each emphasis suppression mode is as Figure 7 shown. In addition, after the light amount adjustment command is stopped, similarly to the above, the light source control unit 21 controls the light emission intensity of the V-LED 20a, B-LED 20b, G-LED 20c, or R-LED 20d according to the light amount adjustment command.
[0076] In Figure 7The adjustment rates ΔV, ΔB, ΔG, and ΔR of the light amounts of the violet light V, blue light B, green light G, and red light R with respect to the reference light amount ratio Vc∶Bc∶Gc∶Rc of the ordinary light are shown for each mode. Among these light amount adjustment rates, “±0%” indicates that the reference light amount ratio is directly used without adjusting the light amount ratio. On the other hand, “+X%” (X is a positive integer) indicates that an X% light amount adjustment portion of the reference light amount ratio is added to the reference light amount ratio. For example, “10%” of the light amount adjustment rate ΔV in the blood vessel emphasis mode means that 10% of the reference light amount ratio Vc is added to the reference light amount ratio Vc. Also, “-Y%” (Y is a positive integer) indicates that a Y% light amount adjustment portion of the reference light amount ratio is subtracted from the reference light amount ratio. For example, “-10%” of the light amount adjustment rate ΔV in the residue suppression mode means that 10% of the reference light amount ratio Vc is subtracted from the reference light amount ratio Vc.
[0077] In addition, when the emphasis suppression amount in the emphasis suppression amount setting command is greater than the reference emphasis suppression amount, the light amount adjustment rates ΔV, ΔB, ΔG, and ΔR that are increased corresponding to the difference between the reference emphasis suppression amount and the emphasis suppression amount are used with respect to Figure 7 the light amount adjustment rates ΔV, ΔB, ΔG, and ΔR. On the other hand, when the emphasis suppression amount in the emphasis suppression amount setting command is less than the reference emphasis suppression amount, the light amount adjustment rates ΔV, ΔB, ΔG, and ΔR that are decreased corresponding to the difference between the reference emphasis suppression amount and the emphasis suppression amount are used with respect to Figure 7 the light amount adjustment rates ΔV, ΔB, ΔG, and ΔR.
[0078] In the blood vessel emphasis mode, in order to increase the absorption amount of hemoglobin, the light amount adjustment amount is such that the light amount ratios of the violet light V and the green light G are increased with respect to the reference light amount ratio of the ordinary light. In the residue suppression mode, in order to suppress the absorption amount of the residue, the light amount adjustment amount is such that the light amount ratios of the violet light V and the green light G are decreased with respect to the reference light amount ratio of the ordinary light. In the surface structure emphasis mode, in order to improve the visual recognition of the surface structure, the light amount adjustment amount is such that the light amount ratios of the violet light V and the blue light B are increased with respect to the reference light amount ratio of the ordinary light. In the stomach observation mode, in order to be able to observe the inside of the stomach in a bright state, the light amount adjustment amount is such that the light amount ratios of the green light G and the red light R, which have a relatively high mucosal reflectance in the digestive tract, are increased with respect to the reference light amount ratio of the ordinary light. In the CV emphasis mode, in order to increase the component of the reflected light in the red band, the light amount adjustment amount is such that the light amount ratio of the red light R is increased or decreased with respect to the reference light amount ratio of the ordinary light.
[0079] Also, when it is the first illumination light emission mode and the emphasis suppression amount in the emphasis suppression amount setting command is the reference emphasis suppression amount, the light amount adjustment amount with respect to the light amount in the reference state in each emphasis suppression mode is as Figure 8 shown. In Figure 8In [description], in the blood vessel emphasis mode, residue suppression mode, and surface structure emphasis mode, although there are some differences in the light quantity ratio adjustment rate, it is the same as in the case of the normal light emission mode. On the other hand, regarding the stomach emphasis mode, not only the green light G but also the light quantity adjustment amounts of the purple light V and blue light B are increased, making it brighter. And regarding the CV emphasis mode, the intensity of the purple light V contained in the first illumination light is large enough without increasing the light quantity of the red light, so the light quantity ratio of the red light R is not adjusted.
[0080] And when it is the second illumination light emission mode and the emphasis suppression amount in the emphasis suppression amount setting command is the reference emphasis suppression amount, the light quantity adjustment amounts with respect to the light quantity in the reference state in each emphasis suppression mode are as Figure 9 shown. In Figure 9 In [description], in the blood vessel emphasis mode, residue suppression mode, and surface structure emphasis mode, although there are some differences in the light quantity ratio adjustment rate, it is the same as in the case of the normal light emission mode. On the other hand, regarding the stomach emphasis mode, not only the green light G but also the light quantity adjustment amounts of the purple light V, blue light B, and red light R are increased, making it brighter. And regarding the CV emphasis mode, the intensity of the purple light V contained in the second illumination light is large enough without increasing the light quantity of the red light, so the light quantity ratio of the red light R is not adjusted.
[0081] In the above, the light quantity display screen 80 and the emphasis suppression mode selection screen 84 are separately displayed on the display 18. However, in order to easily grasp the selection of a specific emphasis suppression mode or the change in the display content of the light quantity display screen 80 and the emphasis suppression mode selection screen 84 based on the emphasis suppression amount setting command, as Figure 10 and Figure 11 shown, the light quantity display screen 80 and the emphasis suppression mode selection screen 84 can also be displayed on the display 18.
[0082] When the light quantity display screen 80 and the emphasis suppression mode selection screen 84 are both displayed on the display 18, the display control unit 70 preferably performs at least any one of the operations of changing the display content of the light quantity size display unit in the light quantity display screen 80 in association with the selection of a specific emphasis suppression mode in the emphasis suppression mode selection screen 84, changing the display content of the light quantity size display unit in the light quantity display screen 80 in association with the change in the display content of the emphasis suppression amount display unit 86 in the emphasis suppression mode selection screen 84, or changing the display content of the emphasis suppression amount display unit in the emphasis suppression mode selection screen 84 in association with the change in the display content of the light quantity size display unit in the light quantity display screen 80.
[0083] Specifically, as Figure 10 (A) shows, when the user can operate on the emphasis suppression mode selection screen 84 (in Figure 10In [it], it is displayed with a double frame. Figure 11 is the same), and the user cannot operate on the light quantity display screen 80 (in Figure 10 In [it], it is displayed with a dotted frame. Figure 11 is the same), when emphasizing the operation of the suppression mode switching SW13b, if the blood vessel emphasis mode is selected as a specific emphasis mode, then as Figure 10 (B) shows, on the light quantity display screen 80, the V light quantity size display section 82a, B light quantity size display section 82b, G light quantity size display section 82c, and R light quantity size display section 82d of the normal light corresponding to the blood vessel emphasis mode are displayed as the display content of the light quantity size display section. Here, since the emphasis suppression amount in the emphasis suppression mode selection screen 84 is the reference emphasis suppression amount, for each of the light quantity size display sections 82a to 82d, the light quantity display frames LB of the first to third stages are lit.
[0084] Moreover, by operating the emphasis suppression mode switching SW13b to execute the emphasis suppression amount setting command, a light quantity adjustment command corresponding to the emphasis suppression amount setting command is generated. And by executing the emphasis suppression amount setting command, the display content of the emphasis suppression amount display section 86 in the emphasis suppression mode selection screen 84 changes. For example, when increasing the reference emphasis suppression amount by one stage according to the emphasis suppression amount setting command, the first to fourth emphasis suppression amounts from the left are lit with the frame EB.
[0085] And, according to the light quantity adjustment command based on the emphasis suppression amount setting command, the light quantity adjustment amount is set.
[0086] According to the set light quantity adjustment amount, the display content of the light quantity display screen 80 changes. For example, by increasing the reference emphasis suppression amount by one stage according to the emphasis suppression amount setting command, as Figure 10 (C) shows, on the light quantity display screen 80, for the V light quantity size display section 82a and G light quantity size display section 82c, in addition to the light quantity display frames LB of the first to fourth stages, the light quantity display frame LB of the fifth stage is also lit. For the B light quantity size display section 82b and R light quantity size display section 82d, in addition to the light quantity display frames LB of the first to third stages, the light quantity display frame LB of the fourth stage is also lit.
[0087] On the other hand, as Figure 11As shown in (A), when the user can operate the light quantity display screen 80 but cannot operate the emphasis suppression mode selection screen 84, the light emission mode switching SW13a is set to the normal light emission mode, for example. In this case, on the light quantity display screen 80, the display contents of the V light quantity display section 82a, B light quantity display section 82b, G light quantity display section 82c, and R light quantity display section 82d corresponding to the normal light emission mode are displayed as the display contents of the light quantity size display section. Here, when it is the reference light quantity ratio, the light quantity display frames LB in the 1st to 3rd stages are lit in each of the light quantity size display sections 82a to 82d. On the other hand, on the emphasis suppression mode selection screen 84, for the emphasis suppression amount display section 86 of the blood vessel emphasis mode, the 1st to 3rd emphasis suppression amount frames EB are lit.
[0088] Moreover, when a light quantity adjustment command for increasing the light quantity of the purple light V, blue light B, green light G, and red light R by one stage is executed through the user interface 19, as Figure 11 shown in (B), the light quantity display frames LB in the 1st to 4th stages in the B light quantity display section 82b and the R light quantity display section 82d are lit, and the light quantity display frames LB in the 1st to 5th stages in the V light quantity display section 82a and the G light quantity display section 82c are lit.
[0089] Moreover, in conjunction with the change in the display contents of each light quantity size display section on the light quantity display screen 80, the display contents of the emphasis suppression amount display section 86 on the emphasis suppression mode selection screen 84 change. For example, as Figure 11 shown in (B), when the lighting state of each of the light quantity size display sections 82a to 82d changes, on the emphasis suppression mode selection screen 84, in addition to the 1st to 3rd emphasis suppression amount frames EB being lit, the 4th emphasis suppression amount frame EB is also lit.
[0090] When a light quantity adjustment command is executed by the light quantity adjustment command generation unit 72, the image processing content change unit 78 changes the content of the image processing of the image signal. Specifically, as the content of the image processing, the image processing content change unit 78 changes the R white balance gain coefficient multiplied by the red signal, the G white balance gain coefficient multiplied by the green signal, and the B white balance gain coefficient multiplied by the blue signal through the white balance processing unit 60. For example, in the normal light emission mode, when the intensity ratio of the purple light V and the green light G is increased according to the light quantity adjustment command, the G white balance gain coefficient and the B white balance gain coefficient are decreased, while the R white balance gain coefficient is increased.
[0091] In addition, in the image processing content change unit 78, the R white balance gain coefficient, etc. are changed, but the processing content of the linear matrix processing performed by the DSP56 can also be changed according to the light quantity adjustment command.
[0092] Here, as a method for changing the white balance gain coefficient of RGB, there are the following methods. For example, as Figure 12 shown, in the monochromatic white balance gain storage unit 60a of the white balance processing unit 60, the monochromatic R white balance gain coefficient, the monochromatic G white balance gain coefficient, and the monochromatic B white balance gain coefficient obtained only when the light of each semiconductor light source emits light are stored. Moreover, the white balance gain calculation unit 60b calculates the R white balance gain coefficient, the G white balance gain coefficient, and the B white balance gain coefficient changed by the image processing content change unit 78 based on the light quantity ratio of a plurality of illumination lights changed due to the light quantity adjustment command and the monochromatic R white balance gain coefficient, the monochromatic G white balance gain coefficient, and the monochromatic B white balance gain coefficient.
[0093] The monochromatic R white balance gain coefficient (referred to as "monochromatic R gain" in Figure 13 ) includes the V-light R white balance gain coefficient GRv (referred to as "1.2" in Figure 13 ) obtained by irradiating a white subject with purple light V, the B-light R white balance gain coefficient GRb (referred to as "1.2" in Figure 13 ) obtained by irradiating a white subject with blue light B, the G-light R white balance gain coefficient GRg (referred to as "2.1" in Figure 13 ) obtained by irradiating a white subject with green light G, and the R-light R white balance gain coefficient GRr (referred to as "0.3" in Figure 13 ).
[0094] The monochromatic G white balance gain coefficient (referred to as "monochromatic G gain" in Figure 13 ) includes the V-light G white balance gain coefficient GGv (referred to as "1.0" in Figure 13 ), the B-light G white balance gain coefficient GGb (referred to as "1.0" in Figure 13 ), the G-light G white balance gain coefficient GGg (referred to as "1.0" in Figure 13 ), and the R-light G white balance gain coefficient GGr (referred to as "1.0" in Figure 13 ). And the monochromatic B white balance gain coefficient (referred to as "monochromatic B gain" in Figure 13 ) includes the V-light B white balance gain coefficient GBv (referred to as "0.3" in Figure 13 ), the B-light B white balance gain coefficient GBb (referred to as "0.2" in Figure 13 ), the G-light B white balance gain coefficient GBg (referred to as "2.3" in Figure 13 ), and the R-light B white balance gain coefficient GBr (referred to as "2.2" in Figure 13 ).
[0095] When the light quantity ratios of a plurality of illumination lights changed due to a light quantity adjustment command are set to Vm∶Bm∶Gm∶Rm, a white balance gain calculation unit 60b calculates an R white balance gain coefficient GR, a G white balance gain coefficient GG, and a B white balance gain coefficient GB changed by an image processing content change unit 78 according to the following formulas (XR), (XG), and (XB).
[0096] Formula (XR): GR = (Vm × GRv + Bm × GRb + Gm × GRg + Rm × GRr) / (Vm × GGv + Bm × GGb + Gm × GGg + Rm × GGr)
[0097] Formula (XG): GG = (Vm × GGv + Bm × GGb + Gm × GGg + Rm × GGr) / (Vm × GGv + Bm × GGb + Gm × GGg + Rm × GGr)
[0098] Formula (XB): GB = (Vm × GBv + Bm × GBb + Gm × GBg + Rm × GBr) / (Vm × GGv + Bm × GGb + Gm × GGg + Rm × GGr)
[0099] For example, when Vm∶Bm∶Gm∶Rm is “1∶1∶1∶1” and the white balance gain coefficients shown Figure 13 are used, GR becomes “1.2”, GG becomes “1.0”, and GB becomes “1.3”.
[0100] In addition, in the above, in the image processing content change unit 78, the R white balance gain coefficient etc. used in the white balance processing unit 60 are changed. However, as shown Figure 14 here, when a mucosal color adjustment processing unit 61 that matches the tone of the entire image with the mucosal color with a reddish tone is used instead of the white balance processing unit 60, the image processing content change unit 78 can also change the processing content in the mucosal color adjustment processing unit 61.
[0101] In this case, the mucosal color adjustment unit 61 multiplies the red signal by the mucosal color adjustment R gain coefficient, multiplies the green signal by the mucosal color adjustment G gain coefficient, and multiplies the blue signal by the mucosal color adjustment R gain coefficient. The mucosal color adjustment R gain coefficient is obtained by dividing the red signal obtained by photographing a mucosal color adjustment calibration sheet having the reflection spectrum of mucosal color such as the reflection spectrum of hemoglobin by the green signal obtained by photographing the mucosal color adjustment calibration sheet with the imaging sensor 48. The mucosal color adjustment G gain coefficient is obtained by dividing the green signal obtained by photographing the mucosal color adjustment calibration sheet with the imaging sensor 48 by the green signal obtained by photographing the mucosal color adjustment calibration sheet with the imaging sensor 48. The mucosal color adjustment R gain coefficient is obtained by dividing the blue signal obtained by photographing the mucosal color adjustment calibration sheet with the imaging sensor 48 by the green signal obtained by photographing the mucosal color adjustment calibration sheet with the imaging sensor 48.
[0102] The image processing content change unit 78 changes the mucosal color adjustment R gain coefficient, the mucosal color adjustment G gain coefficient, and the mucosal color adjustment B gain coefficient as the content of image processing. For example, in the normal light emission mode, when the intensity ratio of the purple light V and the green light G is increased according to the light amount adjustment command, the mucosal color adjustment G gain coefficient and the mucosal color adjustment R gain coefficient are decreased, and on the other hand, the mucosal color adjustment R gain coefficient is increased.
[0103] In addition, similar to the above R white balance gain coefficient, etc., the mucosal color adjustment R gain coefficient, the mucosal color adjustment G gain coefficient, and the mucosal color adjustment B gain coefficient can also be calculated based on the light amount ratio of a plurality of illumination lights changed due to the light amount adjustment command and the mucosal color adjustment R gain coefficient for monochromatic use, the mucosal color adjustment G gain coefficient for monochromatic use, and the mucosal color adjustment B gain coefficient for monochromatic use obtained only when each semiconductor light source emits light.
[0104] In addition, in the above, the light amount of each illumination light is adjusted based on the display content of the light amount display screen 80, etc. by using the user operation of the user interface 19, but the light amount of each illumination light can also be automatically adjusted according to the image signal obtained by photographing the observation object. For example, as Figure 15As shown, the specific light quantity ratio calculation unit 90 disposed within the processor device 16 analyzes the image signal and calculates a specific light quantity ratio representing the light quantity ratio of appropriate illumination light corresponding to the observation object. For example, the structural information within the observation object is grasped from the image signal, and the observation part (such as the stomach) is determined from the structural information. Moreover, the light quantity ratio suitable for the determined observation part is calculated (for example, in the case of the stomach, the light quantities of the green light G and the red light R are made greater than the light quantities of other colors). In the light quantity adjustment command generation unit 72, a light quantity adjustment command is generated based on the specific light quantity ratio. The display control unit 70 changes the display content of each light quantity size display unit 82a to 82d according to the light quantity adjustment command so as to be the specific light quantity ratio. The specific light quantity ratio obtained by the specific light quantity ratio calculation unit 90 is sent to the light source control unit 21. The light source control unit 21 controls the V-LED 20a, B-LED 20b, G-LED 20c, and R-LED 20d so as to be the specific light quantity ratio.
[0105] Next, a series of processes of the present invention will be described according to the Figure 16 flowchart shown. By operating the operation user interface 19, the emphasis suppression mode selection screen 84 is displayed on the display 18. A plurality of emphasis suppression modes are displayed on the emphasis suppression mode selection screen 84. The user operates the emphasis suppression mode switching SW13b to select a specific emphasis suppression mode to be used from the plurality of emphasis suppression modes. If a specific emphasis suppression mode is selected, the display control unit 70 displays the check box 85 on the display 18 in the selected specific emphasis suppression mode.
[0106] Moreover, if a specific emphasis suppression mode is selected, the display control unit 70 displays the emphasis suppression amount display unit 86 on the emphasis suppression mode selection screen 84. The user operates the emphasis suppression mode switching SW13b to change the display content of the emphasis suppression amount display unit 86 so as to be the target emphasis suppression amount. When the target emphasis suppression amount is reached, by operating the emphasis suppression mode switching SW13b, an emphasis suppression amount setting command is executed. The emphasis suppression amount setting command is sent to the light quantity adjustment command generation unit 72, and the light quantity adjustment command generation unit 72 generates a light quantity adjustment command based on the emphasis suppression amount setting command.
[0107] If a light quantity adjustment command is generated, the display control unit 70 changes the display content of each light quantity size display unit 82a to 82d according to the light quantity adjustment command in the light quantity display screen 80. Moreover, the light quantity adjustment command is sent to the light source device 14. The light source control unit 21 performs light source control to adjust the light emission intensity of the V-LED 20a, B-LED 20b, G-LED 20c, or R-LED 20d according to the light quantity adjustment command.
[0108] In addition, in the endoscope system 10, when switching to the multi-observation mode in which the first illumination light and the second illumination light are emitted at a specific frame interval, the first color image and the second color image can also be switched and displayed on the display 18 according to the light emission periods of the first illumination light and the second illumination light. For example, when the light emission period K(N) is 2 frames and the light emission period L(N) is 3 frames, the first image is continuously displayed for 2 frames, and the second image is continuously displayed for 3 frames.
[0109] In the above embodiment, the hardware structures of the processing units (processing unit) included in the processor device 16 such as the image acquisition unit 52, the DSP 54, the denoising unit 58, the white balance processing unit 60, the monochrome white balance gain storage unit 60a, the white balance gain calculation unit 60b, the mucosal color adjustment processing unit 61, the image processing unit 62, the display control unit 70, the light amount adjustment command generation unit 72, the emphasis suppression mode selection unit 74, the emphasis suppression amount setting command generation unit 76, the image processing content change unit 78, and the specific light amount ratio calculation unit 90 are various processors as follows. Among the various processors, there are a general-purpose processor that executes software (program) and functions as various processing units, that is, a CPU (Central Processing Unit / central processing unit), a processor that can change the circuit structure after manufacturing, such as an FPGA (Field Programmable Gate Array / field programmable gate array), that is, a programmable logic device (Programmable Logic Device: PLD), a GPU (Graphical Processing Unit / graphical processing unit), and a dedicated electrical circuit that is a processor having a circuit structure designed specifically for executing various processes.
[0110] One processing unit may be constituted by one of these various processors, or may be constituted by a combination of two or more processors of the same type or different types (for example, multiple FPGAs, a combination of a CPU and an FPGA, a combination of a CPU and a GPU). Also, multiple processing units may be constituted by one processor. As an example of constituting multiple processing units by one processor, first, there is a method in which, typified by a computer such as a client or a server, a combination of one or more CPUs and software constitutes one processor, and this processor functions as multiple processing units. Second, there is a method in which, typified by a system on chip (System On Chip: SoC), a processor that realizes the functions of an entire system including multiple processing units by one IC (Integrated Circuit / integrated circuit) chip is used. Thus, the various processing units are constituted by using one or more of the above various processors as the hardware structure.
[0111] Moreover, more specifically, the hardware structure of these various processors is an electrical circuitry in a form that combines circuit elements such as semiconductor elements. And, the hardware structure of the storage unit is a storage device such as an HDD (hard disc drive) or an SSD (solid state drive).
[0112] In addition, the present invention can be applied not only to the processor device assembled in the endoscope system as described in the above embodiment, but also to the processor device assembled in a capsule endoscope system or various medical image processing devices.
[0113] In addition, as another aspect of the present invention, there is an endoscope system as follows, that is,
[0114] The processor device can display at least one of the following screens on the display unit through the display control unit:
[0115] A light quantity display screen for displaying a light quantity ratio indicating the balance of the magnitudes of the illumination lights of a plurality of wavelength bands emitted from a plurality of semiconductor light sources, having a light quantity magnitude display unit indicating the magnitude of the light quantity of each illumination light, and changing the magnitude of the light quantity and the display content of the light quantity magnitude display unit according to a light quantity adjustment command; and
[0116] An emphasis suppression mode selection screen for selecting a specific emphasis suppression mode from a plurality of emphasis suppression modes, having an emphasis suppression amount display unit indicating the emphasis amount in the emphasis suppression mode, and changing the display content of the emphasis suppression amount display unit according to an emphasis suppression amount setting command, and,
[0117] At least any one of the operations of changing the display content of the light quantity magnitude display unit in association with selecting a specific emphasis suppression mode, changing the display content of the light quantity magnitude display unit in association with changing the display content of the emphasis suppression amount display unit, or changing the display content of the emphasis suppression amount display unit in association with changing the display content of the light quantity magnitude display unit is performed through the display control unit.
Claims
1. An endoscope system includes a display control unit capable of displaying at least one of the following screens on a display unit: A light quantity display screen for displaying a light quantity ratio indicating the relative light quantity of illumination lights in a plurality of wavelength bands emitted from a plurality of semiconductor light sources, having a light quantity size display unit indicating the size of the light quantity of each illumination light, and changing the display content of the light quantity size display unit including the size of the light quantity according to a light quantity adjustment command; and An emphasis suppression mode selection screen for selecting a specific emphasis suppression mode from a plurality of emphasis suppression modes, having an emphasis suppression quantity display unit indicating the emphasis quantity in the emphasis suppression mode, and changing the display content of the emphasis suppression quantity display unit according to an emphasis suppression quantity setting command, The display control unit performs any one of the following operations: Changing the display content of the light quantity size display unit in association with the selection of the specific emphasis suppression mode; Changing the display content of the light quantity size display unit in association with the change in the display content of the emphasis suppression quantity display unit; and Changing the display content of the emphasis suppression quantity display unit in association with the change in the display content of the light quantity size display unit.
2. The endoscope system according to claim 1, wherein The display unit displays both the light quantity display screen and the emphasis suppression mode selection screen.
3. The endoscope system according to claim 1, wherein The display control unit, When the emphasis suppression mode selection screen can be operated, changes the display content of the light quantity size display unit in association with the selection of the specific emphasis suppression mode or changes the display content of the light quantity size display unit in association with the change in the display content of the emphasis suppression quantity display unit, When the light quantity display screen can be operated, changes the display content of the emphasis suppression quantity display unit in association with the change in the display content of the light quantity size display unit.
4. The endoscope system according to claim 2, wherein The display control unit, When the emphasis suppression mode selection screen can be operated, changes the display content of the light quantity size display unit in association with the selection of the specific emphasis suppression mode or changes the display content of the light quantity size display unit in association with the change in the display content of the emphasis suppression quantity display unit, When the light quantity display screen can be operated, changes the display content of the emphasis suppression quantity display unit in association with the change in the display content of the light quantity size display unit.
5. The endoscope system according to claim 1, wherein The endoscope system has: A plurality of light emission modes with different light quantity ratios of a plurality of illumination lights, The light quantity display screen is provided for each of the light emission modes, The display control unit changes the display content of the light quantity size display unit in the light quantity display screen corresponding to the light emission mode in association with the switching of the light emission mode.
6. The endoscope system according to claim 2, wherein The endoscope system has: Multiple light emission modes, with different light quantity ratios of multiple illumination lights to each other, The light quantity display screen is set for each of the light emission modes, The display control unit changes the display content of the light quantity size display unit in the light quantity display screen corresponding to the light emission mode in association with the switching of the light emission mode.
7. The endoscope system according to claim 3, wherein, The endoscope system has: Multiple light emission modes, with different light quantity ratios of multiple illumination lights to each other, The light quantity display screen is set for each of the light emission modes, The display control unit changes the display content of the light quantity size display unit in the light quantity display screen corresponding to the light emission mode in association with the switching of the light emission mode.
8. The endoscope system according to claim 4, wherein, The endoscope system has: Multiple light emission modes, with different light quantity ratios of multiple illumination lights to each other, The light quantity display screen is set for each of the light emission modes, The display control unit changes the display content of the light quantity size display unit in the light quantity display screen corresponding to the light emission mode in association with the switching of the light emission mode.
9. The endoscope system according to any one of claims 1 to 8, wherein, The endoscope system includes: An image acquisition unit that acquires an image signal obtained by photographing an observation object illuminated by multiple illumination lights emitted from the multiple semiconductor light sources; and An image processing content change unit that changes the content of image processing of the image signal when the light quantity adjustment command is executed.
10. The endoscope system according to claim 9, wherein, The image processing content change unit changes the R white balance gain coefficient, G white balance gain coefficient, and B white balance gain coefficient multiplied by the image signal as the content of the image processing.
11. The endoscope system according to claim 10, wherein, The endoscope system has: A monochromatic white balance gain storage unit that stores the monochromatic R white balance gain coefficient, monochromatic G white balance gain coefficient, and monochromatic B white balance gain coefficient obtained when each semiconductor light source emits light only; And A white balance gain calculation unit that, when the light quantity ratio of the multiple illumination lights changes due to the light quantity adjustment command, calculates the R white balance gain coefficient, G white balance gain coefficient, and B white balance gain coefficient based on the changed light quantity ratio and the monochromatic R white balance gain coefficient, monochromatic G white balance gain coefficient, and monochromatic B white balance gain coefficient.
12. The endoscope system according to claim 9, wherein, The image processing content change unit changes the R gain coefficient for mucosal color adjustment, G gain coefficient for mucosal color adjustment, and B gain coefficient for mucosal color adjustment multiplied by the image signal as the content of the image processing.
13. The endoscope system according to claim 9, wherein, The endoscope system has: A specific light quantity ratio calculation unit that analyzes the image signal and obtains a specific light quantity ratio corresponding to the observation object, According to the light quantity adjustment command, sets the light quantity ratio of the illumination light to the specific light quantity ratio.
14. The endoscope system according to any one of claims 1 to 8, wherein, the plurality of semiconductor light sources include a V-LED, a B-LED, a G-LED, and an R-LED.
15. The endoscope system according to claim 9, wherein, the plurality of semiconductor light sources include a V-LED, a B-LED, a G-LED, and an R-LED.
16. The endoscope system according to any one of claims 10 to 13, wherein, the plurality of semiconductor light sources include a V-LED, a B-LED, a G-LED, and an R-LED.
17. A method of operating an endoscope system, comprising the step of a display control unit displaying at least one of the following screens on a display unit: a light quantity display screen for displaying a light quantity ratio indicating the relative light quantity of illumination light of a plurality of wavelength bands emitted from a plurality of semiconductor light sources, and having a light quantity size display unit indicating the size of the light quantity of each illumination light, and changing the display content of the light quantity size display unit including the size of the light quantity according to a light quantity adjustment command; and an emphasis suppression mode selection screen for selecting a specific emphasis suppression mode from a plurality of emphasis suppression modes, and having an emphasis suppression quantity display unit indicating the emphasis quantity in the emphasis suppression mode, and changing the display content of the emphasis suppression quantity display unit according to an emphasis suppression quantity setting command, in the step of controlling by the display control unit, any one of the following operations is performed: changing the display content of the light quantity size display unit in association with the selection of the specific emphasis suppression mode; changing the display content of the light quantity size display unit in association with the change of the display content of the emphasis suppression quantity display unit; and changing the display content of the emphasis suppression quantity display unit in association with the change of the display content of the light quantity size display unit.
Citation Information
Patent Citations
Endoscopic device
JP2007139822A
Signal processing system
JP2009201593A
Special-light endoscope device
CN107635452A
Endoscope apparatus
JP2016179236A
Calibration method and endoscope system
WO2015064436A1