Image correction method for electronic endoscope system

By calculating and storing correction parameters for endoscope and processor using a reference system, the method addresses processing and memory challenges in color correction, ensuring efficient image processing in electronic endoscope systems.

JP7760468B2Active Publication Date: 2025-10-27HOYA CORPORATION
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022120393
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-07-28
Publication Date
2025-10-27
Estimated Expiration
2042-07-28

AI Technical Summary

Technical Problem

Existing methods for correcting color information errors between electronic endoscopes and processors require significant processing load and memory due to numerous floating-point operations and large data storage needs.

Method used

A method involving calculating and storing correction parameters for both the endoscope and processor using a reference endoscope and processor, allowing for efficient color correction during image processing by reducing the need for extensive calculations and memory usage.

Benefits of technology

Reduces processing load and memory requirements for color information correction in electronic endoscope systems, enabling efficient image correction across different combinations of endoscopes and processors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007760468000001
    Figure 0007760468000001
  • Figure 0007760468000002
    Figure 0007760468000002
  • Figure 0007760468000003
    Figure 0007760468000003
Patent Text Reader

Abstract

To reduce a processing load in executing correction of color information when using a combination of an arbitrary electronic endoscope and a processor for an electronic endoscope.SOLUTION: There is provided a correction method for correcting a captured image in an electronic endoscope system. The method includes: a step for calculating a first parameter for correction corresponding to a correction object processor using a reference endoscope and a reference processor; a step for causing the calculated first parameter for correction to be stored in the correction object processor; a step for calculating a second parameter for correction corresponding to the correction object endoscope using the reference endoscope and the reference processor; a step for causing the calculated second parameter for correction to be stored in the correction object endoscope; and a step in which the correction object processor executes correction using the first parameter for correction and the second parameter for correction for a captured image captured by an image pick-up device of the correction object endoscope when the correction object endoscope is connected to the correction object processor.SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an image correction method for an electronic endoscope system configured to acquire and process images of biological tissue. [Background technology]

[0002] Electronic endoscope systems are used for observing and treating biological tissues inside the human body. Electronic endoscope systems are equipped with an electronic endoscope (electronic scope) that captures images of biological tissues with an imaging element and transmits the captured images to a processor, and a processor (electronic endoscope processor) that emits illumination light and processes the captured image signals to create images for display. The image sensor in an electronic endoscope (electronic scope) and the light source in a processor each have individual differences in their spectral characteristics, so when an electronic scope and a processor are connected, variations occur in the color information of the displayed image of biological tissue. Methods for correcting such errors (in-machine differences) in color information between individual processors and endoscopes have been proposed.

[0003] For example, Patent Document 1 describes that in order to correct for differences between the processor and the endoscope, a chromaticity correction table is created to apply chromaticity correction to the image signal corresponding to the difference between the spectral characteristics of a standard light predetermined as illumination light and the spectral characteristics of the actual illumination light, and to adjust the image signal to a predetermined reference color tone in accordance with the spectral characteristics of the color filter of the endoscope's imaging element. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5544219 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the correction method described in Patent Document 1 requires a large number of small-scale operations (for example, floating-point operations) to calculate conversion coefficients for converting each of a plurality of spectral characteristics into a reference spectral characteristic in order to create a chromaticity correction table, and also requires a large amount of memory to store data on each spectral characteristic. In other words, the correction method described in Patent Document 1 has the problem of imposing a huge processing load when correcting errors in color information between the processor and individual endoscopes.

[0006] SUMMARY OF THE INVENTION It is therefore an object of the present invention to reduce the processing load when correcting color information when an arbitrary electronic endoscope and an electronic endoscope processor are used in combination. [Means for solving the problem]

[0007] One aspect of the present invention is a correction method for correcting an image in an electronic endoscope system in which an electronic endoscope that captures images of biological tissue with an imaging element and an electronic endoscope processor that performs signal processing on the image captured by the imaging element to create an image for display are connected. This correction method is a step of calculating a first correction parameter corresponding to a correction target processor, which is an electronic endoscope processor that is an object of correction, using a reference endoscope that is an electronic endoscope that serves as a reference for correction and a reference processor that is an electronic endoscope processor that serves as a reference for correction; storing the calculated first correction parameters in the correction target processor; calculating second correction parameters corresponding to an endoscope to be corrected, which is an electronic endoscope to be corrected, using the reference endoscope and the reference processor; a step of storing the calculated second correction parameters in the endoscope to be corrected; When the endoscope to be corrected and the processor to be corrected are connected, the processor to be corrected performs correction using the first correction parameter and the second correction parameter on an image captured by an imaging element of the endoscope to be corrected.

[0008] The step of calculating the first correction parameter includes: a first pixel value that is a pixel value of an image obtained when the reference endoscope and the correction target processor are connected and a predetermined color index is imaged; and based on a second pixel value, which is a pixel value of an image obtained when the reference endoscope and the reference processor are connected and the color index is imaged, The method may include calculating, as the first correction parameter, a parameter for converting the first pixel value into the second pixel value. The step of calculating the second correction parameter includes: a third pixel value which is a pixel value of an image obtained when the endoscope to be corrected and the reference processor are connected and a predetermined color index is imaged; and based on a fourth pixel value, which is a pixel value of an image obtained when the reference endoscope and the reference processor are connected and the color index is imaged, The method may include calculating, as the second correction parameter, a parameter that converts the third pixel value into the fourth pixel value.

[0009] The correction method includes: specifying a first feature amount that is a feature amount obtained from the first pixel value and a second feature amount that is a feature amount obtained from the second pixel value, and calculating a first feature amount correction parameter that converts the first feature amount into the second feature amount; specifying a third feature amount that is a feature amount obtained from the third pixel value and a fourth feature amount that is a feature amount obtained from the fourth pixel value, and calculating a second feature amount correction parameter that converts the third feature amount into the fourth feature amount; The method may further include a step in which, when the endoscope to be corrected and the processor to be corrected are connected, the processor to be corrected performs correction using the first feature correction parameter and the second feature correction parameter on features obtained from pixel values ​​of an image captured by an imaging element of the endoscope to be corrected.

[0010] The color index may be determined from a plurality of color indexes according to a feature amount obtained from pixel values ​​of the captured image. [Effects of the Invention]

[0011] According to the above-described endoscope system, when an arbitrary electronic endoscope and an electronic endoscope processor are used in combination, the processing load when correcting color information can be reduced. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram illustrating a schematic system configuration of an endoscope system according to an embodiment. [Figure 2] 1 is a block diagram showing a main configuration of an endoscope system according to an embodiment of the present invention; [Figure 3] 3A to 3C are diagrams illustrating steps of an image correction method for an electronic endoscope system according to an embodiment. [Figure 4] 10A and 10B are diagrams illustrating a process of calculating a processor matrix in the electronic endoscope system according to an embodiment. [Figure 5] 10A to 10C are diagrams illustrating a process of calculating a scope matrix in the electronic endoscope system according to an embodiment. [Figure 6] 4 is a flowchart showing image processing during diagnosis in the electronic endoscope system of one embodiment. [Figure 7] 10A and 10B are diagrams illustrating a process of calculating a processor matrix in an electronic endoscope system according to another embodiment. [Figure 8] 10A and 10B are diagrams illustrating a process of calculating a scope matrix in an electronic endoscope system according to another embodiment.

[0013] (1) First embodiment An electronic endoscope system and an image correction method therefor according to an embodiment will be described in detail below with reference to the drawings. First, an electronic endoscope system 1 according to one embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a diagram showing a schematic system configuration of the endoscope system 1 according to one embodiment. Fig. 2 is a block diagram showing the main configuration of the endoscope system 1 according to one embodiment. As shown in FIG. 1, the electronic endoscope system 1 is a system specialized for medical use, and includes an electronic scope 10 (an example of an electronic endoscope), a processor 20 (an example of a processor for an electronic endoscope), and a monitor 30.

[0014] As shown in FIG. 1, the tip of the electronic endoscope 10 is provided with a flexible insertion section 120 for insertion into the human body. A bending section 104 is provided near the tip of the insertion section 120, which bends in response to remote control from a handheld operation section 122 connected to the base end of the insertion section 120. The bending mechanism of the bending section 104 is a well-known mechanism incorporated in general endoscopes. The bending structure bends the bending section 104 by pulling an operation wire linked to the rotation of a bending operation knob provided on the handheld operation section 122. A tip section 102 equipped with a solid-state image sensor (hereinafter referred to as image sensor) 14 (see FIG. 2) is connected to the tip of the bending section 104. The orientation of the tip section 102 changes in response to the bending movement of the bending section 104 caused by the rotation of the bending operation knob, thereby moving the imaging area of ​​the electronic endoscope 10.

[0015] An LCB (Light Carrying Bundle) 11 (see FIG. 2) is disposed over substantially the entire length of the electronic scope 10, from the connector 10c to the tip 102. The LCB 11 is an optical fiber bundle that guides the illumination light supplied from the light source device 25 to the tip 102 of the electronic scope 10.

[0016] The processor 20 is a device that processes a video signal of an image of a subject obtained by the imaging element 14 of the electronic scope 10 capturing an image of the subject, and supplies the processed video signal to a monitor 30 (see FIG. 2). 1, the processor 20 is provided with a connector section 20c for connecting to the electronic scope 10. A connector section 10c for connecting to the connector section 20c of the processor 20 is provided at the proximal end of the electronic scope 10. The connector section 10c and the connector section 20c are mechanically connected to electrically connect the electronic scope 10 and the processor 20, and the light source device 25 and the electronic scope 10 are optically connected.

[0017] The information processing device 40 is a device capable of performing predetermined arithmetic processing, such as a computer, a tablet terminal, or a smartphone, and can be electrically connected to the processor 20 via a cable 200. The information processing device 40 calculates parameters for image correction for the electronic scope 10 and / or the processor 20 and records the calculated parameters in the electronic scope 10 and / or the processor 20. In the example shown in Fig. 1, the information processing device 40 is not directly connected to the electronic scope 10 by wire, but if the electronic scope 10 and the processor 20 are electrically connected, the information processing device 40 can write the parameters to the electronic scope 10 via the processor 20. Note that if the information processing device 40 can communicate wirelessly with each of the electronic scope 10 and the processor 20, the information processing device 40 may write the parameters to each of the electronic scope 10 and the processor 20 without using the cable 200. In one embodiment, as described below, the information processing device 40 is configured to calculate a processor matrix and a scope matrix as parameters, write the processor matrix to the matrix memory unit 28 of the processor 20, and write the scope matrix to the matrix memory unit 16 of the electronic scope 10.

[0018] The timing for calculating and writing the processor matrix and / or the scope matrix is ​​not limited, but it is preferable to calculate and write the processor matrix and / or the scope matrix after manufacturing the electronic scope 10 and the processor 20 and before shipping the electronic scope 10 and the processor 20, for example.

[0019] Referring to FIG. 2, the processor 20 includes a system controller 21, an image input processing unit 22, an image memory 23, an image output processing unit 24, a light source device 25, an operation panel 26, a color correction calculation unit 27, a matrix memory unit 28, and a condenser lens 29. The electronic scope 10 includes an LCB 11, a light distribution lens 12, an objective lens 13, an image sensor 14, a driver signal processing circuit 15, and a matrix storage unit 16.

[0020] The system controller 21 executes various programs and comprehensively controls the entire electronic endoscope system 1. The system controller 21 is also connected to an operation panel 26. The system controller 21 changes each operation and parameters for each operation of the electronic endoscope system 1 in response to instructions from the surgeon input to the operation panel 26. The system controller 21 outputs clock pulses to each circuit in the electronic endoscope system 1 to adjust the timing of the operation of each part.

[0021] The light source device 25 emits illumination light L for illuminating a subject, such as biological tissue within a body cavity. The illumination light L includes white light, pseudo-white light, or special light. According to one embodiment, the light source device 25 selects one of a mode in which white light or pseudo-white light is constantly emitted as the illumination light L and a mode in which white light, pseudo-white light, and special light are alternately emitted as the illumination light L, and preferably emits white light, pseudo-white light, or special light based on the selected mode. White light is light with a flat spectral intensity distribution in the visible light band, while pseudo-white light is light with a non-flat spectral intensity distribution that is a mixture of light from multiple wavelength bands. The special light is light in a narrow wavelength band, such as blue or green, within the visible light band. Light in the blue or green wavelength band is used to emphasize and observe specific areas of biological tissue. The illumination light L emitted from the light source device 25 is condensed by the condenser lens 29 onto the incident end face of the LCB 11 and is incident into the LCB 11 of the electronic scope 10 . In the example shown in FIG. 2, the light source device 25 is built into the processor 20, but the light source device 25 may be configured as a separate unit from the processor 20.

[0022] Illumination light L incident on the LCB 11 propagates through the LCB 11 of the electronic endoscope 10. The illumination light L propagates through the LCB 11 and is emitted from the exit end face of the LCB 11 located at the tip 102 of the electronic endoscope 10, and is irradiated onto the subject via the light distributing lens 12. Return light from the subject illuminated by the illumination light L from the light distributing lens 12 forms an optical image on the light receiving surface of the image sensor 14 via the objective lens 13.

[0023] The imaging element 14 is a single-plate color CCD (Charge Coupled Device) image sensor with a Bayer pixel arrangement. The imaging element 14 accumulates an optical image formed at each pixel on its light-receiving surface as an electric charge according to the amount of light, and generates and outputs R (Red), G (Green), and B (Blue) image signals. Note that the imaging element 14 is not limited to a CCD image sensor, and may be replaced with a CMOS (Complementary Metal Oxide Semiconductor) image sensor or other types of imaging devices. The imaging element 14 may also be equipped with a complementary color filter.

[0024] A clock pulse is supplied from the system controller 21 to the driver signal processing circuit 15 of the electronic scope 10. In accordance with the clock pulse supplied from the system controller 21, the driver signal processing circuit 15 drives and controls the image sensor 14 at a timing synchronized with the frame rate of the video processed by the processor 20. The frame rate is, for example, 1 / 30 seconds. The driver signal processing circuit 15 performs predetermined processing, including A / D conversion, on the image signal input from the image sensor 14 and outputs the signal to the image input processing unit 22 of the processor 20.

[0025] The image input processing unit 22 performs predetermined signal processing such as demosaic processing, matrix calculation, etc. on the input image signal. The image input processing unit 22 may also perform predetermined noise reduction processing. The image memory 23 is a memory for buffering the image signal (image) processed by the image input processing unit 22. The image output processing unit 24 sequentially processes the images in the image memory 23 to generate screen data for monitor display, and converts the generated screen data for monitor display into a predetermined video format signal. The converted video format signal is output to the monitor 30. As a result, the image of the subject is displayed on the display screen of the monitor 30.

[0026] The matrix storage unit 28 of the processor 20 and the matrix storage unit 16 of the electronic scope 10 are nonvolatile memories such as SSDs (Solid State Drives), and store the processor matrix and the scope matrix, respectively. As described above, the processor matrix and the scope matrix are written by the information processing device 40. The color correction calculation unit 27 of the processor 20 performs color correction calculations based on the processor matrix and the scope matrix on the image buffered in the image memory 23. The system controller 21 overwrites the image memory 23 with the image calculated by the color correction calculation unit 27. Therefore, the image data for monitor display generated by the image output processing unit 24 is based on the image after color correction.

[0027] Next, an image correction method for the electronic endoscope system according to one embodiment will be described with reference to FIGS. 3 is a diagram showing the steps of an image correction method for an electronic endoscope system according to one embodiment of the present invention, which includes steps S1 to S5. Steps S1 and S2 are steps performed on the processor to be corrected, for example, after the processor is manufactured and before it is shipped. Steps S3 and S4 are steps performed on the electronic scope to be corrected, for example, after the electronic scope is manufactured and before it is shipped. Step S5 is a step performed for each image frame at the time of diagnosis.

[0028] (Process S1) Step S1 is a step of calculating a processor matrix (an example of a first correction parameter) corresponding to the correction target processor 20_Tar, which is the processor to be corrected, using a reference electronic scope 10_Ref, which is the electronic scope that serves as the basis for correction, and a reference processor 20_Ref, which is the processor that serves as the basis for correction. The reference electronic scope 10_Ref is the electronic scope 10 that serves as the master for color correction. For example, the image sensors in electronic scopes generally have individual differences in spectral characteristics, but the reference electronic scope 10_Ref is the electronic scope 10 that is equipped with an image sensor 14 whose spectral characteristics are the median value. The reference processor 20_Ref is the processor 20 that serves as a master for color correction. For example, the illumination light from the light source device provided in a processor generally has individual differences in spectral characteristics, but the reference processor 20_Ref is the processor 20 that is provided with the light source device 25 whose illumination light has a median spectral characteristic.

[0029] FIG. 4 conceptually shows the procedure in step S1. First, the reference electronic scope 10_Ref and the correction target processor 20_Tar are connected, and then an information processing device 40 (not shown in FIG. 4) is connected to the correction target processor 20_Tar. The tip of the reference electronic scope 10_Ref is directed toward the reference color index RC. The color index RC is an index that displays a color that serves as a reference for correction. The color displayed on the color index RC is determined appropriately depending on the subject, but when imaging biological tissue, it is preferable that the color be a strong reddish color that matches the color of the affected area. Multiple color indices RC, each containing different colors, may be used. In step S1, the image IMG1 of the color index RC obtained by combining the reference electron scope 10_Ref and the correction target processor 20_Tar is taken into the information processing device 40. Next, in the same manner, the captured image IMG2 of the color index RC obtained by the combination of the reference electronic scope 10_Ref and the reference processor 20_Ref is taken into the information processing device 40.

[0030] The information processing device 40 calculates a processor matrix M1 for matching the captured image IMG1 with the captured image IMG2. When calculating the processor matrix M1, a matrix for converting a pixel value (RGB value; an example of a first pixel value) of a specific pixel in the captured image IMG1 into a pixel value (an example of a second pixel value) of a corresponding pixel in the captured image IMG2 may be calculated, or a matrix for converting average pixel values ​​(average RGB values) of pixels within corresponding ranges of each captured image may be calculated.

[0031] (Process S2) Step S2 is a step of storing the processor matrix calculated in step S1 in the matrix storage unit 28 of the processor 20_Tar to be corrected. In step S2, the information processing device 40 transmits the processor matrix M1 calculated in step S1 to the processor 20_Tar to be corrected.

[0032] Steps S1 and S2 are typically performed at the manufacturing site of the processor 20 before shipping the processor 20. That is, at least one reference electronic scope 10_Ref and one reference processor 20_Ref are prepared at the manufacturing site of the processor 20, and each of the produced processors 20 is sequentially designated as a correction target processor 20_Tar, and the processor matrix M1 is calculated and stored individually for each processor 20. Note that in FIG. 4, acquiring the captured image IMG2 by combining the reference electronic scope 10_Ref and the reference processor 20_Ref only needs to be performed once, and does not need to be performed sequentially.

[0033] (Process S3) Step S3 is a step of calculating a scope matrix (an example of second correction parameters) corresponding to the correction target scope 10_Tar, which is the electronic scope to be corrected, using the reference electronic scope 10_Ref and the reference processor 20_Ref.

[0034] FIG. 5 conceptually shows the procedure in step S3. First, the scope to be corrected 10_Tar and the reference processor 20_Ref are connected, and further, the information processing device 40 (not shown in Fig. 5) is connected to the reference processor 20_Ref. The tip of the scope to be corrected 10_Tar is directed toward the color index RC serving as the reference. In step S3, the captured image IMG3 of the color index RC obtained by combining the correction target scope 10_Tar and the reference processor 20_Ref is taken into the information processing device 40. Next, in the same manner, the captured image IMG4 of the color index RC obtained by the combination of the reference electronic scope 10_Ref and the reference processor 20_Ref is taken into the information processing device 40.

[0035] The information processing device 40 calculates a scope matrix M2 for matching the captured image IMG3 with the captured image IMG4. When calculating the scope matrix M2, a matrix for converting a pixel value of a specific pixel in the captured image IMG3 (an example of a third pixel value) into a pixel value of a corresponding pixel in the captured image IMG4 (an example of a fourth pixel value) may be calculated, or a matrix for converting average pixel values ​​(average RGB values) of pixels within corresponding ranges of the captured images may be calculated.

[0036] (Process S4) Step S4 is a step of storing the scope matrix calculated in step S3 in the matrix storage unit 16 of the correction target scope 10_Tar. In step S4, the information processing device 40 transmits the scope matrix M2 calculated in step S3 to the correction target scope 10_Tar via the reference processor 20_Ref.

[0037] Steps S3 and S4 are typically performed at the manufacturing site of the electronic scope 10 before shipping the electronic scope 10. That is, at least one reference electronic scope 10_Ref and one reference processor 20_Ref are prepared at the manufacturing site of the electronic scope 10, and each of the multiple electronic scopes 10 produced is sequentially designated as a correction target scope 10_Tar, and the scope matrix M2 is calculated and stored individually for each electronic scope 10. Note that in FIG. 5, acquiring a captured image IMG4 using a combination of the reference electronic scope 10_Ref and the reference processor 20_Ref only needs to be performed once, and does not need to be performed sequentially.

[0038] The reference electronic scope 10_Ref and reference processor 20_Ref used in steps S1 and S2, respectively, do not have to be the same as the reference electronic scope 10_Ref and reference processor 20_Ref used in steps S3 and S4, respectively. If steps S1 and S2 are performed at the same manufacturing site of the processor 20 and steps S3 and S4 are performed at the same manufacturing site of the electronic scope 10, it is advantageous to use different reference devices (reference electronic scope 10_Ref, reference processor 20_Ref). Even in this case, as long as a common color index RC is used, there is almost no variation in the calculated processor matrix M1 and scope matrix M2.

[0039] (Process S5) Step S5 is a step in which, when the scope 10_Tar to be corrected and the processor 20_Tar to be corrected are connected, the processor 20_Tar to be corrected performs correction using the processor matrix M1 and the scope matrix M2 on the image captured by the imaging element 14 of the scope 10_Tar to be corrected. Step S5 differs from steps S1 to S4 in that it is executed when making a diagnosis in a medical setting using an electronic endoscope system 1 connected to a processor 20 in which a processor matrix M1 is stored and an electronic scope 10 in which a scope matrix M2 is stored.

[0040] A flowchart of the process performed by the processor 20 in step S5 is shown in FIG. First, the processor 20 acquires an image of the current frame from the electronic scope 10, performs predetermined image processing, and temporarily stores the image in the image memory 23 (step S10). The processor 20 reads the processor matrix M1 from the matrix storage unit 28 (step S12), and reads the scope matrix M2 from the matrix storage unit 16 of the electronic scope 10 (step S14). Next, processor 20 performs a color correction operation on the image stored in image memory 23 in step S10 (step S16). Specifically, processor 20 obtains pixel values ​​by converting the pixel values ​​of each pixel of the image using a matrix (M1·M2) that is the product of processor matrix M1 and scope matrix M2. Processor 20 then executes image output processing on the image in which the pixel values ​​of each pixel have been converted (step S18). In the image output processing, a screen data image for monitor display is generated based on the image, and the generated screen data for monitor display is converted into a predetermined video format signal and output to monitor 30.

[0041] As described above, in the image correction method for an electronic endoscope system according to one embodiment, the combined electronic scope 10 and processor 20 each store a scope matrix and processor matrix that have been optimized before diagnosis, and color information can be corrected using the scope matrix and processor matrix during diagnosis. This significantly reduces the processing load required for color information correction in conventional systems. The electronic scope 10 and processor 20 only need to store the scope matrix and processor matrix, respectively, and therefore require less memory capacity. In the image correction method for the electronic endoscope system described above, the processor matrix and the scope matrix are determined in a state where the spectral reflectance characteristics of the color index RC corresponding to the object are reflected, so correction can be made to the pixel values ​​(R value, G value, B value) of the image of each frame in accordance with the object's characteristics. For example, if each matrix is ​​determined based on an image captured using the color index RC that displays a strong reddish color that matches the color of the affected area, correction can be made during diagnosis in accordance with the spectral reflectance characteristics of the object (the affected area of ​​the patient). In the image correction method for the electronic endoscope system described above, optimized processor matrices and scope matrices are stored in advance in the electronic scope and processor, so there is no need to consider the combination of electronic scope and processor during diagnosis. In other words, optimal correction can be performed on captured images regardless of the combination of electronic scope and processor used during diagnosis.

[0042] (2) Second embodiment The second embodiment will be described below. The second embodiment differs from the first embodiment in that a processor matrix and a scope matrix are calculated in a form that includes not only the image but also the feature amounts of the image, and image correction is performed based on the processor matrix and the scope matrix. The following description will focus on the differences from the image correction method (FIG. 5) described in the first embodiment. Steps S1 to S5 of the image correction method of this embodiment are as follows.

[0043] FIG. 7 conceptually shows the procedure for calculating the processor matrix M1a including the feature quantities in addition to FIG. 4 in step S1. Referring to Figure 7, in step S1, the correction target processor 20_Tar identifies a feature FTR1 (an example of a first feature) from the pixel value (an example of a first pixel value) of a specific pixel in the captured image IMG1 of the color index RC obtained by combining the reference electronic scope 10_Ref and the correction target processor 20_Tar. The reference processor 20_Ref identifies a feature FTR2 (an example of a second feature) from the pixel value (an example of a second pixel value) of a corresponding pixel in a captured image IMG2 of the color index RC obtained by combining the reference electronic scope 10_Ref and the reference processor 20_Ref. Then, the information processing device 40 calculates a processor matrix M1a including parameters for converting the feature amount FTR1 into the feature amount FTR2 (an example of first feature amount correction parameters) in addition to parameters for converting the captured image IMG1 into the captured image IMG2. In step S2, the processor matrix M1a is stored in the processor 20_Tar to be corrected.

[0044] FIG. 8 conceptually shows the procedure for calculating the scope matrix M2a including the feature amounts in addition to FIG. 5 in step S3. Referring to Figure 8, in step S3, the reference processor 20_Ref identifies a feature FTR3 (an example of a third feature) from the pixel value (an example of a third pixel value) of a specific pixel in the captured image IMG3 of the color index RC obtained by the combination of the correction target scope 10_Tar and the reference processor 20_Ref. The reference processor 20_Ref identifies a feature FTR4 (an example of a fourth feature) from the pixel value (an example of a fourth pixel value) of the corresponding pixel in the captured image IMG4 of the color index RC obtained by combining the reference electronic scope 10_Ref and the reference processor 20_Ref. Then, the information processing device 40 calculates a scope matrix M2a that includes parameters for converting the feature amount FTR3 into the feature amount FTR4 (an example of second feature amount correction parameters) in addition to parameters for converting the captured image IMG3 into the captured image IMG4. In step S4, the scope matrix M2a is stored in the correction target scope 10_Tar.

[0045] In step S5, when the correction target scope 10_Tar and the correction target processor 20_Tar are connected, the correction target processor 20_Tar performs correction using the processor matrix M1a and the scope matrix M2a on the captured image captured by the imaging element 14 of the correction target scope 10_Tar. As a result, the correction target processor 20_Tar also performs correction on the feature amounts obtained from the pixel values ​​of the captured image captured by the imaging element 14 of the correction target scope 10_Tar.

[0046] The method for calculating the feature amount in steps S1 and S3 can be defined as appropriate. For example, the feature amount can be the ratio of pixel values ​​between corresponding pixels (for example, the ratio of G value to R value) as a value representing the degree of inflammation in the inflamed area of ​​the patient, which is the subject. In this embodiment, the processor matrix and the scope matrix each contain parameters for correcting the features, so that the features can be easily corrected by performing color correction calculations on the images of each frame obtained during diagnosis.

[0047] In this embodiment, it is preferable to determine the color index RC used in steps S1 and S3 from among multiple color indices according to the feature obtained from the pixel values ​​of the captured image. By selecting a color index such that the color tone of the subject is more clearly reflected in the feature of the captured image, the calculated processor matrix M1a and scope matrix M2a can be more appropriate values ​​for correcting the feature. For example, as described above, if the ratio of the G value to the R value of a pixel is used as the feature, it is preferable to select a color index that displays red or a color including red from among multiple color indices so that the degree of redness of the subject is more clearly reflected in this feature. [Explanation of symbols]

[0048] 1...Electronic endoscope system 10...Electron scope 11...LCB 12...Light distribution lens 13...Objective lens 14...Solid-state image sensor 15...Driver signal processing circuit 16...Matrix storage section 102...Tip 104...Bend 120...insertion section 122...Hand control unit 20...Electron endoscope processor 21...System controller 22...Image input processing unit 23...Image memory 24...Image output processing unit 25...Light source device 26...Operation panel 27...Color correction calculation section 28...Matrix storage section 29...Condenser lens 30...Monitor 40...Information processing device RC…Color index

Claims

1. 1. A correction method for correcting an image in an electronic endoscope system in which an electronic endoscope that captures images of biological tissue with an image sensor and an electronic endoscope processor that performs signal processing on the image captured by the image sensor to create an image for display are connected, the method comprising: calculating a first correction parameter corresponding to a correction target processor, which is an electronic endoscope processor that is an object of correction, using a reference endoscope that is an electronic endoscope that serves as a reference for correction and a reference processor that is an electronic endoscope processor that serves as a reference for correction; storing the calculated first correction parameters in the correction target processor; calculating second correction parameters corresponding to an endoscope to be corrected, which is an electronic endoscope to be corrected, using the reference endoscope and the reference processor; a step of storing the calculated second correction parameters in the endoscope to be corrected; and when the correction target endoscope and the correction target processor are connected, the correction target processor performs correction using the first correction parameter and the second correction parameter on an image captured by an imaging element of the correction target endoscope. Image correction method for electronic endoscope system.

2. The step of calculating the first correction parameter includes: a first pixel value that is a pixel value of an image obtained when the reference endoscope and the correction target processor are connected and a predetermined color index is imaged; and based on a second pixel value, which is a pixel value of an image obtained when the reference endoscope and the reference processor are connected and the color index is imaged, calculating, as the first correction parameter, a parameter for converting the first pixel value into the second pixel value; The step of calculating the second correction parameters includes: a third pixel value that is a pixel value of an image obtained when the endoscope to be corrected and the reference processor are connected and a predetermined color index is imaged; and based on a fourth pixel value, which is a pixel value of an image obtained when the reference endoscope and the reference processor are connected and the color index is imaged, calculating, as the second correction parameter, a parameter for converting the third pixel value into the fourth pixel value; 2. The image correction method for an electronic endoscope system according to claim 1.

3. specifying a first feature amount that is a feature amount obtained from the first pixel value and a second feature amount that is a feature amount obtained from the second pixel value, and calculating a first feature amount correction parameter that converts the first feature amount into the second feature amount; specifying a third feature amount that is a feature amount obtained from the third pixel value and a fourth feature amount that is a feature amount obtained from the fourth pixel value, and calculating a second feature amount correction parameter that converts the third feature amount into the fourth feature amount; The method further includes a step in which, when the correction target endoscope and the correction target processor are connected, the correction target processor performs correction using the first feature amount correction parameter and the second feature amount correction parameter on a feature amount obtained from a pixel value of an image captured by an image sensor of the correction target endoscope, 3. The image correction method for an electronic endoscope system according to claim 2.

4. determining the color index from among a plurality of color indexes according to a feature amount obtained from pixel values ​​of the captured image; 4. The image correction method for an electronic endoscope system according to claim 3.

Citation Information

Patent Citations

  • Correction system for delay amount

    JP1980044219A

  • Endoscope system

    JP2011087910A

  • Endoscope system including calibration means, and calibration method thereof

    JP2011200410A

  • Electronic endoscope system, and calibration method of the same

    JP2012213612A

  • Endoscope system and operation method of endoscope system

    JP2015061569A