Medical system, image processing method, and image processing program

Abstract

A medical system 1 comprises a first image processing device 3 which is connected to an imaging device 2 and a second image processing device 4 which is connected to the first image processing device 3. The first image processing device 3 is provided with: a light source unit 33 which supplies, to the imaging device 2, specific light to be emitted to a subject that is imaged by the imaging device 2; and a first image processing unit which executes first image processing on a captured image captured by the imaging device 2. The second image processing device 4 is provided with a second image processing unit which executes second image processing on the captured image after the execution of the first image processing, thereby generating a display image.

Description

Medical system, image processing method, and image processing program

[0001] The present invention relates to a medical system, an image processing method, and an image processing program.

[0002] Conventionally, an endoscopic system for observing the inside of a subject using an endoscope has been known (see, for example, Patent Document 1). The endoscopic system described in Patent Document 1 includes a processing device communicatively connected to the endoscope and to a display device. The processing device performs various image processing on an image captured by the endoscope and generates an endoscopic image to be displayed on the display device.

[0003] Patent No. 6378846

[0004] In the processing device described in Patent Document 1, a processing unit within a single housing is configured to perform various types of image processing. Therefore, when updating only the configuration that performs some of the various image processing, it is necessary to update the entire processing device. Therefore, there is a demand for a technology that can improve convenience by not updating the entire device even when updating only the configuration that performs some of the image processing.

[0005] The present invention has been made in view of the above, and an object of the present invention is to provide a medical system, an image processing method, and an image processing program that can improve convenience.

[0006] In order to solve the above-mentioned problems and achieve the object, the medical system of the present invention comprises a first image processing device connected to an imaging device and a second image processing device connected to the first image processing device, the first image processing device comprising a light source unit that supplies specific light to the imaging device for irradiating a subject to be imaged by the imaging device, and a first image processing unit that performs first image processing on the image captured by the imaging device, and the second image processing device comprising a second image processing unit that generates an image for display by performing second image processing on the image captured after the first image processing has been performed.

[0007] Furthermore, the image processing method of the present invention is an image processing method executed by a medical system, the medical system comprising: a first image processing device connected to an imaging device and having a light source unit that supplies specific light to the imaging device for irradiating a subject imaged by the imaging device; and a second image processing device connected to the first image processing device, and in the image processing method, the first image processing device performs first image processing on an image captured by the imaging device, and the second image processing device performs second image processing on the image after the first image processing has been performed, thereby generating an image for display.

[0008] Furthermore, the image processing program of the present invention is an image processing program executed by a medical system, the medical system comprising: a first image processing device connected to an imaging device and having a light source unit that supplies specific light to the imaging device for irradiating a subject imaged by the imaging device; and a second image processing device connected to the first image processing device, and the image processing program causes the medical system to execute the following steps: a step in which the first image processing device performs first image processing on an image captured by the imaging device; and a step in which the second image processing device performs second image processing on the image after the first image processing has been performed, thereby generating an image for display.

[0009] The medical system, image processing method, and image processing program according to the present invention can improve convenience.

[0010] Fig. 1 is a diagram showing the configuration of an endoscope system according to an embodiment. Fig. 2 is a diagram showing the configuration of an endoscope system according to an embodiment. Fig. 3 is a block diagram showing the configuration of an imaging control subsystem and a video equipment control subsystem. Fig. 4 is a diagram explaining a modified example according to the embodiment.

[0011] Hereinafter, a mode for carrying out the present invention (hereinafter referred to as an embodiment) will be described with reference to the drawings. Note that the present invention is not limited to the embodiment described below. Furthermore, in the description of the drawings, the same parts are given the same reference numerals.

[0012] 1 and 2 are diagrams showing the configuration of an endoscope system 1 according to an embodiment. The endoscope system 1 corresponds to a medical system according to the present invention. This endoscope system 1 is used in the medical field and is a system for observing the inside of a subject (inside a living organism) using an endoscope 2. As shown in FIGS. 1 and 2 , this endoscope system 1 includes an endoscope 2, a light source device 3, a processing device 4, and a display device 5.

[0013] The endoscope 2 corresponds to an imaging device according to the present invention. In this embodiment, the endoscope 2 is a so-called flexible endoscope. A portion of the endoscope 2 is inserted into a living body, images the inside of the living body, and outputs image signals generated by the image capture. As shown in FIG. 1 , the endoscope 2 includes an insertion section 21, an operation section 22, and a universal cord 23.

[0014] The insertion section 21 is a section that is at least partially flexible and is inserted into a living body. As shown in Figures 1 and 2, the insertion section 21 includes a distal end section 24, a freely bendable bending section 25 (Figure 1) composed of a plurality of bending pieces, and a long, flexible flexible tube section 26 (Figure 1) that is connected to the proximal end side of the bending section 25. An imaging section 244 (Figure 2) is built into the distal end section 24. The insertion section 21 is inserted into a living body, and captures an image of a subject (object of observation) such as biological tissue that is located in a position where external light does not reach, using the imaging section 244.

[0015] The operation unit 22 is connected to the base end portion of the insertion section 21. The operation unit 22 receives various operations for the endoscope 2. As shown in Fig. 1 , the operation unit 22 includes a bending knob 221 for bending the bending section 25 in the up-down and left-right directions, a treatment tool insertion section 222 that extends from the operation unit 22 to the tip of the insertion section 21 and inserts treatment tools such as biopsy forceps, an electric scalpel, and an examination probe into the body cavity of the subject, an air supply conduit 223 that extends from the operation unit 22 to the tip of the insertion section 21 and supplies air into the body cavity of the subject, and a plurality of switches 224 for operating peripheral devices such as an air supply device (not shown) and a water supply device (not shown).

[0016] The universal cord 23 incorporates at least a light guide 241 ( FIG. 2 ) and a cable assembly 245 ( FIG. 2 ) that bundles one or more signal lines. The light guide 241 is made of glass fiber or the like and forms a light guide path for light emitted by the light source device 3. As shown in FIG. 1 , the universal cord 23 branches at the end opposite to the end connected to the operation unit 22. A connector 231 that can be detachably attached to the light source device 3 is provided at the branched end of the universal cord 23. A portion of the light guide 241 extends from the end of the connector 231. The universal cord 23 transmits illumination light emitted from the light source device 3 to the distal end 24 via the connector 231 (light guide 241), the operation unit 22, and the flexible tube portion 26. The universal cord 23 also transmits image signals captured by an imaging unit 244 provided at the distal end 24 to the light source device 3. The cable assembly 245 includes a signal line for transmitting an image signal, a signal line for transmitting a drive signal for driving the imaging unit 244, and a signal line for transmitting and receiving information including unique information related to the endoscope 2 (imaging unit 244). Note that, in the present embodiment, the signal lines are described as transmitting electrical signals, but they may also be used to transmit optical signals, or may be used to transmit signals between the endoscope 2 and the light source device 3 by wireless communication.

[0017] The output end side of the light guide 241 is inserted into the tip portion 24. As shown in Fig. 2, the tip portion 24 includes an illumination lens 242, an optical system 243 for collecting light, and an imaging unit 244 that is provided at the imaging position of the optical system 243 and receives the light collected by the optical system 243, photoelectrically converts the light into an electrical signal, and performs predetermined signal processing.

[0018] The optical system 243 is configured using one or more lenses, and forms a subject image on the light receiving surface of an image sensor 244a that configures the imaging unit 244. The optical system 243 may have an optical zoom function that changes the angle of view and a focus function that changes the focus.

[0019] The imaging unit 244 captures an image of the observation target under the control of the light source device 3. As shown in Fig. 2, the imaging unit 244 includes an imaging element 244a and a signal processing unit 244b.

[0020] The image sensor 244a receives the subject image transmitted through the optical system 243 and converts it into an electrical signal (analog signal). Examples of the image sensor 244a include a CMOS (Complementary Metal Oxide Semiconductor), which is a rolling shutter type image sensor in which multiple pixels are arranged two-dimensionally in horizontal line units, and a CCD (Charge Coupled Device), which is a global shutter type image sensor. Examples of the image sensor 244a include a monochrome image sensor without a color filter on its light-receiving surface, and a color image sensor with a color filter on its light-receiving surface. Examples of the color filter include an RGB primary color filter consisting of three colors: red, green, and blue, and a CMYG complementary color filter consisting of four colors: cyan, magenta, yellow, and green. Hereinafter, when the image sensor 244a is a monochrome image sensor (an image sensor that sequentially captures subject images corresponding to red, green, and blue illumination light using a frame sequential method), the image sensor 244a will be referred to as a frame sequential sensor. Furthermore, among color image sensors, an image sensor 244a having an RGB primary color filter on its light receiving surface is referred to as a Bayer sensor, and further, among color image sensors, an image sensor 244a having a CMYG complementary color filter on its light receiving surface is referred to as a complementary color sensor.

[0021] For ease of explanation, the image signal generated by the image sensor 244a capturing an image will be referred to as a captured image below.

[0022] The signal processing unit 244b outputs a captured image (digital signal) by performing signal processing on the captured image (analog signal) generated by the imaging element 244a under the control of the light source device 3. For example, the signal processing unit 244b performs signal processing on the captured image (analog signal) generated by the imaging element 244a, such as processing to remove reset noise, processing to multiply the analog signal by an analog gain that amplifies the analog signal (hereinafter referred to as analog gain adjustment processing), and A / D conversion.

[0023] Here, the endoscope 2 has a storage unit that stores data including identification information of the endoscope 2. The identification information includes the endoscope 2's unique information (ID), model year, specification information, transmission method, information about the imaging unit 244 (imaging element 244a) used in the endoscope 2 (such as the type of the imaging element 244a (e.g., whether the imaging element 244a is a Bayer sensor, a complementary color sensor, or a frame sequential sensor) and characteristics of the imaging element 244a (defective pixels, sensitivity characteristics, etc.)). The storage unit may also temporarily store captured images generated by the imaging unit 244.

[0024] The light source device 3 corresponds to a first image processing device according to the present invention. As shown in FIG. 2, the light source device 3 includes an imaging control subsystem 31, a scope interface subsystem 32, and a light source unit 33.

[0025] The imaging control subsystem 31 performs first image processing on the captured image received through the scope interface subsystem 32. This imaging control subsystem 31 is configured using a general-purpose processor such as a CPU (Central Processing Unit) that executes processing according to a specific program (including the image processing program according to the present invention), or a dedicated processor such as an ASIC (Application Specific Integrated Circuit) or various arithmetic circuits that execute specific functions. The imaging control subsystem 31 may also be configured using an FPGA (Field-Programmable Gate Array). The detailed configuration of the imaging control subsystem 31 will be described later in "Configuration of the Imaging Control Subsystem and the Video Equipment Control Subsystem."

[0026] The scope interface subsystem 32 is a part that connects the endoscope 2 (imaging unit 244) so ​​that captured images and the like can be communicated. The scope interface subsystem 32 is configured using an interface circuit and the like including a connector to which a cable capable of image transmission and communication is connected. The scope interface subsystem 32 receives captured images and transmits control signals and the like to the endoscope 2.

[0027] The light source unit 33 emits light under the control of the scope interface subsystem 32. The light source unit 33 is realized using any light source such as an LED (Light Emitting Diode) light source, a laser light source, a xenon lamp, or a halogen lamp. The light source unit 33 may also include one or more lenses. The light generated by the light source unit 33 passes through the light guide 241 and the illumination lens 242 and is emitted from the tip of the tip unit 24 toward the object of observation.

[0028] Examples of light emitted from the light source unit 33 include light having a wavelength band of visible light (white light), narrowband light having light in a specific wavelength band, or excitation light that excites substances contained in the object of observation.

[0029] The processing device 4 corresponds to a second image processing device according to the present invention. As shown in FIG.

[0030] The video equipment control subsystem 41 is communicatively connected to the display device 5, and performs second image processing on the captured image that has undergone first image processing and that has been received from the imaging control subsystem 31 via the transmission cable 28, to generate a display image. The video equipment control subsystem 41 then outputs the display image to the display device 5. As a result, the display image is displayed on the display device 5. The video equipment control subsystem 41 is configured using a general-purpose processor such as a CPU that executes processing according to a specific program (including the image processing program of the present invention), or a dedicated processor such as an ASIC or various arithmetic circuits that execute specific functions. The video equipment control subsystem 41 may also be configured using an FPGA. The detailed configuration of the video equipment control subsystem 41 will be described later in "Configuration of the Imaging Control Subsystem and the Video Equipment Control Subsystem."

[0031] The display device 5 displays the display image received from the processing device 4 (video device control subsystem 41) via the video cable. The display device 5 is configured using a monitor such as a liquid crystal or organic EL (Electro Luminescence) monitor.

[0032] [Configuration of the Imaging Control Subsystem and the Video Equipment Control Subsystem] Fig. 3 is a block diagram showing the configuration of the imaging control subsystem 31 and the video equipment control subsystem 41. As shown in Fig. 3, the imaging control subsystem 31 includes a first image processing unit 311.

[0033] As shown in FIG. 3, the first image processing unit 311 includes an image processing unit 312 for a Bayer sensor, an image processing unit 313 for a complementary color sensor, and an image processing unit 314 for a frame sequential sensor.

[0034] Here, when the endoscope 2 is connected to the light source device 3, the imaging control subsystem 31 determines the type of the imaging element 244a based on the information (type of the imaging element 244a) obtained from the endoscope 2.

[0035] When the imaging control subsystem 31 determines that the imaging element 244a is a Bayer sensor, the image processing unit 312 for the Bayer sensor performs first image processing appropriate for the Bayer sensor on the captured image received through the scope interface subsystem 32. As shown in FIG. 3 , the image processing unit 312 for the Bayer sensor includes an imaging correction processing unit 312a, an NR processing unit 312b, a synchronization processing unit 312c, and a color adjustment processing unit 312d.

[0036] When the endoscope 2 is connected to the light source device 3, the imaging correction processing unit 312a performs first image processing on the captured image received through the scope interface subsystem 32 based on information acquired from the endoscope 2 (the characteristics of the imaging element 244a), thereby correcting defective pixels and variations in sensitivity characteristics of the imaging element 244a, which is a Bayer sensor.

[0037] When the endoscope 2 is connected to the light source device 3, the NR processing unit 312b performs noise reduction processing (first image processing) to remove random noise and fixed pattern noise in the captured image corrected by the image correction processing unit 312a based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0038] Since the image sensor 244a is a Bayer sensor, the synchronization processing unit 312c performs first image processing (synchronization processing (demosaic processing)) on the captured image on which noise reduction processing has been performed by the NR processing unit 312b.

[0039] When the endoscope 2 is connected to the light source device 3, the color adjustment processing unit 312d performs color adjustment processing (first image processing) to correct color variations in the captured image on which demosaic processing has been performed by the synchronization processing unit 312c, based on information obtained from the endoscope 2 (information regarding the image sensor 244a).

[0040] When the imaging control subsystem 31 determines that the imaging element 244a is a complementary color sensor, the image processing unit 313 for the complementary color sensor performs first image processing for the complementary color sensor on the captured image received through the scope interface subsystem 32. As shown in FIG. 3 , the image processing unit 313 for the complementary color sensor includes an imaging correction processing unit 313a, an NR processing unit 313b, a synchronization processing unit 313c, and a color adjustment processing unit 313d.

[0041] When the endoscope 2 is connected to the light source device 3, the imaging correction processing unit 313a performs first image processing on the captured image received through the scope interface subsystem 32 based on information acquired from the endoscope 2 (the characteristics of the imaging element 244a), thereby correcting defective pixels and variations in sensitivity characteristics of the imaging element 244a, which is a complementary color sensor.

[0042] When the endoscope 2 is connected to the light source device 3, the NR processing unit 313b performs noise reduction processing (first image processing) to remove random noise and fixed pattern noise in the captured image corrected by the image correction processing unit 313a based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0043] Since the image sensor 244a is a complementary color sensor, the demosaic processing unit 313c performs first image processing (synchronization processing (demosaic processing)) on the captured image on which noise reduction processing has been performed by the NR processing unit 313b.

[0044] When the endoscope 2 is connected to the light source device 3, the color adjustment processing unit 313d performs color adjustment processing (first image processing) to correct color variations in the captured image on which demosaic processing has been performed by the synchronization processing unit 313c, based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0045] When the imaging control subsystem 31 determines that the imaging element 244a is a frame sequential sensor, the image processing unit 314 for the frame sequential sensor performs first image processing appropriate for the frame sequential sensor on the captured image received through the scope interface subsystem 32. As shown in FIG. 3 , the image processing unit 314 for the frame sequential sensor includes an imaging correction processing unit 314a, an NR processing unit 314b, a synchronization processing unit 314c, and a color adjustment processing unit 314d.

[0046] When the endoscope 2 is connected to the light source device 3, the imaging correction processing unit 314a corrects defective pixels and variations in sensitivity characteristics of the imaging element 244a, which is a frame sequential sensor, by performing first image processing on the captured image received through the scope interface subsystem 32 based on information acquired from the endoscope 2 (the characteristics of the imaging element 244a).

[0047] When the endoscope 2 is connected to the light source device 3, the NR processing unit 314b performs noise reduction processing (first image processing) to remove random noise and fixed pattern noise in the captured image corrected by the image correction processing unit 314a, based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0048] Since the image sensor 244a is a plane sequential sensor, the synchronization processing unit 314c performs a first image processing (synchronization processing (demosaic processing)) on the captured image on which noise reduction processing has been performed by the NR processing unit 314b, using past frames obtained with illumination light of a different color.

[0049] When the endoscope 2 is connected to the light source device 3, the color adjustment processing unit 314d performs color adjustment processing (first image processing) to correct color variations in the captured image passed through the synchronization processing unit 314c based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0050] The first image processing unit 311 also executes detection processing to calculate, from a specific region of the captured image received through the scope interface subsystem 32, an evaluation value used to control the amount of light supplied from the light source unit 33. The detection processing is processing to detect the contrast and frequency components of the image in the detection region, detect the average brightness value and maximum and minimum pixels in the detection region using a filter or the like, compare the detected values ​​with a threshold, and detect a histogram, etc., based on pixel information (e.g., Y value (luminance signal (Y signal)) for each pixel in the specific detection region out of the entire image region of the captured image. For example, the detection region is a rectangular region centered at the center of the captured image. Then, the first image processing unit 311 controls the amount of light emitted from the light source unit 33 to a target light amount value, based on the evaluation value (contrast, frequency components, average brightness value, maximum and minimum pixels, histogram, etc.) obtained by the detection processing.

[0051] As shown in FIG. 3, the video device control subsystem 41 includes a second image processing unit 411 .

[0052] The second image processing unit 411 performs common second image processing on the captured image after the first image processing is performed by the light source device 3, regardless of the type (Bayer sensor, complementary color sensor, or frame sequential sensor) of the image sensor 244a constituting the endoscope 2 connected to the light source device 3. As shown in FIG. 3 , the second image processing unit 411 includes a gamma processing unit 412, a color reproduction processing unit 413, a structure enhancement processing unit 414, an enlargement / reduction processing unit 415, and a mask OSD (On Screen Display) processing unit 416.

[0053] The gamma processing unit 412 performs gamma processing (second image processing) to adjust the overall contrast of the captured image after the first image processing has been performed.

[0054] The color reproduction processing unit 413 performs color reproduction processing (second image processing) on ​​the captured image on which gamma processing has been performed by the gamma processing unit 412, adjusting the overall color to the target color specified by a user such as a doctor.

[0055] The structure enhancement processing unit 414 performs structure enhancement processing (second image processing) to adjust the overall perceived resolution of the captured image on which the color reproduction processing has been performed by the color reproduction processing unit 413 .

[0056] The scaling processing unit 415 performs a scaling process (second image processing) on ​​the captured image on which the structure enhancement processing has been performed by the structure enhancement processing unit 414, enlarging or reducing the image based on the display size of the display device 5 or the scaling ratio specified by a user such as a doctor.

[0057] The mask OSD processing unit 416 performs mask OSD processing (second image processing) on ​​the captured image that has been enlarged or reduced by the enlargement or reduction processing unit 415, such as forming a final display area and displaying characters on the screen.

[0058] The second image processing unit 411 then generates a display image based on the captured image that has been subjected to the mask OSD processing. The display image is output to the display device 5 and displayed on the display device 5.

[0059] As described above, in this embodiment, the first image processing is processing according to the characteristics of the image sensor 244a that constitutes the endoscope 2 connected to the light source device 3. The second image processing is processing according to a user operation or a mode setting.

[0060] The above-described embodiment provides the following advantages. The endoscopic system 1 according to the embodiment includes a light source device 3 connected to the endoscope 2 and a processing device 4 connected to the light source device 3. The light source device 3 includes a light source unit 33 that supplies specific light to the endoscope 2 for irradiating a subject imaged by the endoscope 2, and a first image processing unit 311 that performs first image processing on an image captured by the endoscope 2. The processing device 4 includes a second image processing unit 411 that generates a display image by performing second image processing on the image captured after the first image processing has been performed. Therefore, for example, when updating only the configuration for performing one of the first and second image processing, it is not necessary to update both the light source device 3 and the processing device 4. In particular, the first image processing is image processing that corresponds to the type of image sensor 244a constituting the endoscope 2. On the other hand, the second image processing is image processing that is common regardless of the type of image sensor 244a. Therefore, when adding a scope with a new image sensor or updating the image processing that corresponds to the type of image sensor 244a in the endoscopic system 1, only the light source device 3 needs to be updated. Therefore, according to the endoscopic system 1 of this embodiment, even when only a portion of the configuration that performs image processing is updated, convenience can be improved without having to update the entire device.

[0061] In the above-described embodiment, the first image processing unit 311 always constitutes the image processing units 312 to 314 for the Bayer sensor, the complementary color sensor, and the frame sequential sensor, but this is not limited to this. For example, the first image processing unit 311 may be constituted by an FPGA, which is a programmable logic device whose processing content can be rewritten according to the configuration. Then, when the endoscope 2 is connected to the light source device 3, the first image processing unit 311 constitutes one of the image processing units 312 to 314 for the Bayer sensor, the complementary color sensor, and the frame sequential sensor according to information (the type of the image sensor 244a) acquired from the endoscope 2.

[0062] (Other Embodiments) Up to this point, the embodiments for carrying out the present invention have been described, but the present invention should not be limited to only the above-described embodiments. Fig. 4 is a diagram showing a modified example of the embodiment. Specifically, Fig. 4 is a block diagram corresponding to Fig. 3. In the above-described embodiment, the configuration of the first and second image processing units 311, 411 may be the configuration according to this modified example shown in Fig. 4.

[0063] As shown in FIG. 4, the first image processing unit 311 according to this modification includes an imaging correction processing unit 311a, a detection processing unit 311b, and a light adjustment control unit 311c.

[0064] When the endoscope 2 is connected to the light source device 3, the imaging correction processing unit 311a performs first image processing on the captured image received through the scope interface subsystem 32 based on information acquired from the endoscope 2 (the characteristics of the imaging element 244a), thereby correcting defective pixels and variations in sensitivity characteristics of the imaging element 244a, which is a Bayer sensor, a complementary color sensor, or a frame sequential sensor.

[0065] The detection processing unit 311b executes detection processing based on the captured image corrected by the image correction processing unit 311a.

[0066] The dimming control unit 311c controls the amount of light emitted from the light source unit 33 to a target light amount value based on the evaluation values ​​(contrast, frequency components, average brightness, maximum and minimum pixels, histogram, etc.) obtained by the detection processing by the detection processing unit 311b.

[0067] As shown in Figure 4, the second image processing unit 411 in this modified example includes an NR processing unit 411a, a synchronization processing unit 411b, a color adjustment processing unit 411c, a gamma processing unit 411d, a color reproduction processing unit 411e, a structural emphasis processing unit 411f, an enlargement / reduction processing unit 411g, and a mask OSD processing unit 411h.

[0068] When the endoscope 2 is connected to the light source device 3, the NR processing unit 411a performs noise reduction processing (second image processing) to remove random noise and fixed pattern noise in the captured image corrected by the image correction processing unit 311a based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0069] When the endoscope 2 is connected to the light source device 3, the synchronization processing unit 411b performs second image processing (synchronization processing (demosaic processing)) on the captured image on which noise reduction processing has been performed by the NR processing unit 411a, based on information (type of image sensor 244a) acquired from the endoscope 2. Note that if the type of image sensor 244a is a frame sequential sensor, the synchronization processing unit 411b performs synchronization processing using past frames obtained with illumination light of different colors.

[0070] When the endoscope 2 is connected to the light source device 3, the color adjustment processing unit 411c performs color adjustment processing (second image processing) to correct color variations in the captured image passed through the synchronization processing unit 314c based on information acquired from the endoscope 2 (information regarding the image sensor 244a).

[0071] The gamma processing unit 411d performs gamma processing (second image processing) to adjust the overall contrast of the captured image that has undergone color adjustment processing by the color adjustment processing unit 411c.

[0072] The color reproduction processing unit 411e performs color reproduction processing (second image processing) on ​​the captured image on which gamma processing has been performed by the gamma processing unit 411d, adjusting the overall color to the target color specified by a user such as a doctor.

[0073] The structure emphasis processing unit 411f performs structure emphasis processing (second image processing) to adjust the overall perceived resolution of the captured image on which the color reproduction processing has been performed by the color reproduction processing unit 411e.

[0074] The scaling processing unit 411g performs a scaling process (second image processing) on ​​the captured image on which the structure enhancement processing has been performed by the structure enhancement processing unit 411f, enlarging or reducing the image based on the display size of the display device 5 or the scaling ratio specified by a user such as a doctor.

[0075] The mask OSD processing unit 411h performs mask OSD processing (second image processing) on ​​the captured image that has been subjected to the enlargement / reduction processing by the enlargement / reduction processing unit 411g, such as forming a final display area and displaying characters on the screen.

[0076] The second image processing unit 411 then generates a display image based on the captured image that has been subjected to the mask OSD processing. The display image is output to the display device 5 and displayed on the display device 5.

[0077] According to the present modified example described above, in addition to the same effects as those of the above-described embodiment, the following effects are achieved. In this modified example, the first image processing is processing that requires feedback to the light source device 3 and the endoscope 2. On the other hand, the second image processing is image processing related to resolution, noise, gradation, and color reproduction, which are basic components of the image quality of the display image. Therefore, when updating the image quality of the display image in the endoscope system 1, it is sufficient to update only the processing device 4.

[0078] In the above-described embodiment and modifications, the second image processing unit 411 may be configured by a server device such as a cloud server.

[0079] REFERENCE SIGNS LIST 1 Endoscope system 2 Endoscope 3 Light source device 4 Processing device 5 Display device 21 Insertion section 22 Operation section 23 Universal cord 24 Tip section 25 Bending section 26 Flexible tube section 28 Transmission cable 31 Imaging control subsystem 32 Scope interface subsystem 33 Light source section 41 Video equipment control subsystem 221 Bending knob 222 Treatment tool insertion section 223 Air supply conduit 224 Switch 231 Connector 241 Light guide 242 Illumination lens 243 Optical system 244 Imaging section 244a Imaging element 244b Signal processing section 245 Collector cable 311 First image processing section 311a Imaging correction processing section 311b Detection processing section 311c Light adjustment control section 312 Image processing section for Bayer sensor 312a Imaging correction processing section 312b NR processing section 312c Synchronization processing unit 312d Color adjustment processing unit 313 Image processing unit for complementary color sensor 313a Imaging correction processing unit 313b NR processing unit 313c Synchronization processing unit 313d Color adjustment processing unit 314 Image processing unit for frame sequential sensor 314a Imaging correction processing unit 314b NR processing unit 314c Synchronization processing unit 314d Color adjustment processing unit 411 Second image processing unit 411a NR processing unit 411b Synchronization processing unit 411c Color adjustment processing unit 411d Gamma processing unit 411e Color reproduction processing unit 411f Structural enhancement processing unit 411g Enlargement / reduction processing unit 411h Mask OSD processing unit 412 Gamma processing unit 413 Color reproduction processing unit 414 Structural enhancement processing unit 415 Enlargement / reduction processing unit 416 Mask OSD processing unit

Claims

1. A medical system comprising: a first image processing device connected to an imaging device; and a second image processing device connected to the first image processing device, wherein the first image processing device comprises: a light source unit that supplies specific light to the imaging device for irradiating a subject to be imaged by the imaging device; and a first image processing unit that performs first image processing on the image captured by the imaging device; and the second image processing device comprises: a second image processing unit that generates an image for display by performing second image processing on the image captured after the first image processing has been performed.

2. The medical system according to claim 1, wherein the first image processing is image processing according to the type of imaging element that constitutes the imaging device.

3. The medical system according to claim 2, wherein the second image processing is a common image processing that is not dependent on the type of the imaging element.

4. The medical system described in claim 1, wherein the first image processing unit comprises: a detection processing unit that performs detection processing to calculate an evaluation value used to control the amount of the specific light supplied from the light source unit from a specific area of ​​the captured image; and a dimming control unit that controls the amount of the specific light supplied from the light source unit based on the evaluation value calculated by the detection processing.

5. An image processing method executed by a medical system, the medical system comprising: a first image processing device connected to an imaging device and having a light source unit that supplies the imaging device with specific light for irradiating a subject imaged by the imaging device; and a second image processing device connected to the first image processing device, wherein the first image processing device executes first image processing on an image captured by the imaging device, and the second image processing device executes second image processing on the image after the first image processing has been executed, thereby generating an image for display.

6. An image processing method according to claim 5, wherein the first image processing is image processing according to the type of imaging element that constitutes the imaging device.

7. The image processing method according to claim 6, wherein the second image processing is a common image processing that is not dependent on the type of the imaging element.

8. The image processing method of claim 5, wherein the first image processing device performs a detection process to calculate an evaluation value used to control the amount of the specific light supplied from the light source unit from a specific area of ​​the captured image, and controls the amount of the specific light supplied from the light source unit based on the evaluation value calculated by the detection process.

9. An image processing program executed by a medical system, the medical system comprising: a first image processing device connected to an imaging device and having a light source unit that supplies the imaging device with specific light for irradiating a subject imaged by the imaging device; and a second image processing device connected to the first image processing device, the image processing program causing the medical system to execute the following steps: a step in which the first image processing device executes first image processing on an image captured by the imaging device; and a step in which the second image processing device executes second image processing on the image after the first image processing has been executed, thereby generating an image for display.

10. An image processing program according to claim 9, wherein the first image processing is image processing according to the type of imaging element that constitutes the imaging device.

11. The image processing program according to claim 10, wherein the second image processing is a common image processing that is not dependent on the type of the imaging element.

12. The image processing program of claim 9, wherein the first image processing device further causes the medical system to execute the following steps: a step of performing a detection process to calculate an evaluation value used to control the amount of the specific light supplied from the light source unit from a specific area of ​​the captured image; and a step of controlling the amount of the specific light supplied from the light source unit based on the evaluation value calculated by the detection process.

Images