Medical image processing device and method of operation thereof

By combining color and brightness information processing methods in medical image processing equipment, and using color changes in yellow and blue directions, the color distortion problem when shadow information is prominent in the prior art is solved, and effective highlighting of shadow information and preservation of original colors are achieved.

JP7628871B2Active Publication Date: 2025-02-12FUJIFILM CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021064956
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-06
Publication Date
2025-02-12
Estimated Expiration
2041-04-06

AI Technical Summary

Technical Problem

When prior art emphasizes shadow information, it is easy to cause distortion of the original color of the observed object, and it is difficult to effectively highlight shadow information without damaging the original color.

Method used

Through a medical image processing device and method, the combined processing of color information and brightness information is used to adjust the shadow area in the image, and the color changes in the direction of yellow and blue are used to highlight the shadow differences. At the same time, the combination coefficients are used to convert colors and brightness to maintain the accuracy of the original color.

Benefits of technology

It can effectively highlight shadow information without significantly damaging the original color of the observed object and improve the visibility of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007628871000001
    Figure 0007628871000001
  • Figure 0007628871000002
    Figure 0007628871000002
  • Figure 0007628871000003
    Figure 0007628871000003
Patent Text Reader

Abstract

To provide a medical image processing device which can emphasize a minute difference in contrast information without largely impairing an original hue of an observation object and an operation method thereof.SOLUTION: A medical image processing device changes Sa expressing B / G(X1), G / R(Y1) in the first color direction D1 for a pixel in which a first G image signal G(L1) exceeds an upper limit value by referring to B / G(X1), G / R(Y1) and the first G image signal G(L1), changes Sb expressing B / G(X1), G / R(Y1) in the second color direction D2 for a pixel in which the first G image signal G(L1) is less than a lower limit value to acquire B / G(X2), G / R(Y2).SELECTED DRAWING: Figure 6
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a medical image processing apparatus for performing color enhancement processing on an object to be observed, and a method of operating the same. [Background technology]

[0002] In recent years, endoscope systems equipped with a light source device, an endoscope, and a processor device have been widely used in the medical field. In an endoscope system, an observation target is irradiated with illumination light from an endoscope, and an image of the observation target illuminated by the illumination light is captured by an imaging element of the endoscope, based on an RGB image signal obtained, and an image of the observation target is displayed on a monitor.

[0003] In an image of an object observed by an endoscope, diagnosis is performed based on color, shape, and the like. In this regard, in Patent Document 1, a process is performed to expand the color difference between normal and abnormal parts, thereby emphasizing slight color differences between normal and abnormal parts. In Patent Document 2, even when an object to be imaged in which light and dark areas are mixed is imaged, the color balance of, for example, normal mucosa is maintained between the light and dark areas. Although different from the field of endoscopy, in Patent Document 3, brightness information is obtained for each hue region from the image signal of an image obtained by a digital camera or the like, and exposure control is performed based on the obtained brightness information, thereby optimizing the saturation of the image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 5932894 [Patent Document 2] Patent No. 6580778 [Patent Document 3] JP 2013-77879 A Summary of the Invention [Problem to be solved by the invention]

[0005] A common method for image enhancement is to treat brightness and color as independent properties and enhance them. Specifically, it has been common to project a color RGB image into a color space such as Lab, HSV, or LHS, and control brightness, hue, and saturation as independent events. In such cases, when emphasizing shading information such as blood concentration or pigment concentration as the target of image enhancement, it is common to adjust brightness or contrast. However, when there is only a slight difference in shading information, adjusting brightness or contrast alone is insufficient to improve visibility.

[0006] On the other hand, when emphasizing shading information, it is possible to use a pseudo-color display that uses changes in information unrelated to color, such as a heat map. In this case, shading information can be emphasized by assigning colors that make it easier to distinguish slight differences in shading information, but since the original color is lost, it becomes difficult to distinguish information other than shading from the pseudo-color display.

[0007] An object of the present invention is to provide a medical image processing apparatus and an operating method thereof that can emphasize slight differences in shading information without significantly impairing the original color tone of the object being observed. [Means for solving the problem]

[0008] The medical image processing apparatus of the present invention includes a processor, which acquires a first color medical image, acquires first brightness information relating to brightness, which is one of three color attributes, from an image signal value for each pixel constituting the first color medical image, acquires first color information relating to color information remaining after removing brightness from the three color attributes, and refers to the first color information and the first brightness information, if the first brightness information exceeds a predetermined upper limit value, changes the first color information to a first color direction, and if the first brightness information is less than a predetermined lower limit value, changes the first color information to a complementary or inverse color to the first color direction. The first color information is obtained by changing the color direction to a second color direction which has a paired color relationship, the first color information and the second color information are combined according to a first combination coefficient which is set based on the first color information to obtain composite color information, the first brightness information is converted according to a brightness conversion coefficient which is set based on the first color information to obtain second brightness information, the first brightness information and the second brightness information are combined according to a second combination coefficient which is set based on the first color information to obtain composite brightness information, and the composite brightness information and the composite color information are converted into a second color medical image in which pixel signal values ​​are changed.

[0009] It is preferable that the color indicated by the first color direction is yellow, and the color indicated by the second color direction is blue. It is preferable that the first and second synthesis coefficients are determined according to color information within a first color gamut in which the first color information is within a predetermined range, and are fixed values ​​outside the first color gamut. It is preferable that the first and second synthesis coefficients are greater than 0 within the first color gamut, are changed according to a first distance or a first angle determined according to color information, and are set to 0 outside the first color gamut.

[0010] It is preferable that the processor obtains the third color information by changing the second distance or the second angle determined according to the color information within a second color gamut within which the second color information falls within a predetermined range. The first color information is R / G, which is a ratio of a red signal R of the first color medical image to a green signal G of the first color medical image, and B / G, which is a ratio of a blue signal to a green signal G of the first color medical image, color difference signals Cr and Cb obtained from the first color medical image, hue and saturation obtained from the first color medical image, and CIE1976La chromaticity obtained from the first color medical image. * b * Of which a * b * It is preferable that the above-mentioned formula (1) is any one of the formulas (1) and (2).

[0011] The first color gamut is preferably a color gamut corresponding to the color of thick blood.The first color gamut is preferably a color gamut corresponding to the color of pigmented mucous membranes.

[0012] A method of operating a medical image processing device of the present invention includes the steps of: acquiring a first color medical image; acquiring, for each pixel constituting the first color medical image, first brightness information relating to brightness, which is one of three color attributes, from an image signal value; acquiring first color information relating to color information remaining after removing brightness from the three color attributes; and referring to the first color information and the first brightness information, changing the first color information to a first color direction if the first brightness information exceeds a predetermined upper limit value, and changing the first color information to a second color direction which is complementary or opposite to the first color direction if the first brightness information is less than a predetermined lower limit value. the first color information and the second color information in accordance with a first synthesis coefficient set based on the first color information to obtain synthetic color information; the first brightness information is converted in accordance with a brightness conversion coefficient set based on the first color information to obtain second brightness information; the first brightness information and the second brightness information are synthesized in accordance with a second synthesis coefficient set based on the first color information to obtain synthetic brightness information; and a conversion into a second medical image in color with image signal values ​​changed based on the synthetic brightness information and the synthetic color information. Effect of the Invention

[0013] According to the present invention, slight differences in shading information can be emphasized without significantly impairing the original color tone of the object being observed. [Brief description of the drawings]

[0014] [Figure 1] 1 is an external view of an endoscope system according to a first embodiment. [Diagram 2] 1 is a block diagram showing functions of an endoscope system according to a first embodiment. [Diagram 3] 1 is a graph showing emission spectra of purple light V, blue light B, green light G, and red light R. [Figure 4] 13 is a block diagram showing functions of a grayscale information emphasis processing unit when the first color information has a B / G ratio and a G / R ratio. FIG. [Diagram 5] 13 is a block diagram showing functions of a first color change processing unit when the first color information is a B / G ratio and a G / R ratio. FIG. [Figure 6] 13 is an explanatory diagram showing before and after processing in a first color change processing unit when the first color information is a B / G ratio and a G / R ratio. FIG. [Figure 7] 1 is an explanatory diagram showing a first color gamut when the first color information has a B / G ratio and a G / R ratio. [Figure 8] FIG. 11 is an explanatory diagram showing the distribution of a first synthesis coefficient. [Figure 9] FIG. 1 is an explanatory diagram showing a color gamut corresponding to the color of high-density blood. [Figure 10] FIG. 2 is an explanatory diagram showing a color gamut corresponding to the color of a mucous membrane onto which a blue pigment has been sprayed. [Figure 11] FIG. 4 is a block diagram showing the functions of a color information synthesis unit. [Figure 12] 11 is a block diagram showing the functions of a second color change processing unit. FIG. [Figure 13] FIG. 2 is an explanatory diagram showing a second color gamut. [Figure 14] 13 is a graph showing the relationship between a second distance R2in and a second distance R2out. [Figure 15] 11 is a graph showing the relationship between a second angle θ2in and a second angle θ2out. [Figure 16] 3 is an explanatory diagram showing functions of a brightness information acquisition unit, a brightness information synthesis unit, and a color image conversion unit. FIG. [Figure 17] 13 is a flowchart showing a sequence of operations in a special light observation mode. [Figure 18] 11 is a block diagram showing functions of a shading information emphasis processing unit when the first color information is color difference signals Cr, Cb. FIG. [Figure 19] 11A and 11B are explanatory diagrams showing before and after processing in a first color change processing unit when the first color information is color difference signals Cr and Cb; [Figure 20] 1 is an explanatory diagram showing a first color gamut when the first color information is color difference signals Cr and Cb; [Figure 21]13 is a block diagram showing functions of a shading information emphasis processing unit when the first color information is hue H and saturation S. FIG. [Figure 22] 13 is an explanatory diagram showing before and after processing in a first color change processing unit when the first color information has hue H and saturation S; FIG. [Figure 23] 1 is an explanatory diagram showing a first color gamut when the first color information has hue H and saturation S; [Figure 24] FIG. 11 is a block diagram showing the functions of an endoscope system according to a second embodiment. [Diagram 25] 1 is a graph showing an emission spectrum of normal light. [Figure 26] 13 is a graph showing an emission spectrum of special light. [Figure 27] FIG. 11 is a block diagram showing the functions of an endoscope system according to a third embodiment. [Figure 28] FIG. 2 is a plan view showing a rotary filter. [Figure 29] 13 is a graph showing the distribution of a second synthesis coefficient. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] [First embodiment] 1, an endoscopic system 10 of the first embodiment includes an endoscope 12, a light source device 13, a processor device 14, a display 15, and a user interface 16. The endoscope 12 is optically connected to the light source device 13 and electrically connected to the processor device 14. The light source device 13 supplies illumination light to the endoscope 12.

[0016] The endoscope 12 is used to illuminate an observation target with illumination light and capture an image of the observation target to obtain an endoscopic image. The endoscope 12 has an insertion section 12a to be inserted into the body of the observation target, an operation section 12b provided at the base end of the insertion section 12a, and a bending section 12c and a tip section 12d provided at the tip side of the insertion section 12a. The bending section 12c is bent by operating the operation section 12b. The tip section 12d irradiates the observation target with illumination light and receives reflected light from the observation target to capture an image of the observation target. The tip section 12d is directed in a desired direction by the bending operation of the bending section 12c. The operation section 12b is provided with a mode changeover switch 12f used for mode switching operation, a still image acquisition instruction switch 12g used for issuing an instruction to acquire a still image of the observation target, and a zoom operation section 12h used for operating the zoom lens 21b.

[0017] The processor device 14 is electrically connected to the display 15 and the user interface 16. The processor device 14 receives an endoscopic image from the endoscope 12. The display 15 outputs and displays an image or information of the observation target processed by the processor device 14. The user interface 16 has a keyboard, mouse, touch pad, microphone, etc., and has a function of accepting input operations such as function settings. The extended processor device 17 is electrically connected to the processor device 14.

[0018] The endoscope system 10 has a normal observation mode and a special light observation mode, which are switched by a mode changeover switch 12f. The normal observation mode is a mode in which a normal image obtained by illuminating an observation target with normal light such as white light is displayed on the display 15. The special light observation mode is a mode in which a shade-enhanced image in which the shades of bright and dark areas are emphasized is displayed on the display 15, which is obtained by illuminating an observation target with special light including narrow band blue light. In this embodiment, the shade-enhanced image is generated based on a special image signal described later obtained by illuminating an observation target with special light. However, the shade-enhanced image may be generated based on an image signal obtained by illuminating an observation target with illumination light having various wavelength ranges other than special light, such as normal light, instead of special light.

[0019] As shown in Fig. 2, the light source device 13 includes a light source section 20 having a V-LED (Violet Light Emitting Diode) 20a, a B-LED (Blue Light Emitting Diode) 20b, a G-LED (Green Light Emitting Diode) 20c, and an R-LED (Red Light Emitting Diode) 20d, a light source control section 21 that controls the driving of the four color LEDs 20a to 20d, and an optical path combining section 23 that combines the optical paths of the four color lights emitted from the four color LEDs 20a to 20d. The light combined by the optical path combining section 23 is irradiated into the subject via a light guide 24 and an illumination lens 33 inserted into the insertion section 12a. Note that an LD (Laser Diode) may be used instead of the LED.

[0020] The light guide 24 is built in the endoscope 12 and the universal cord (cord connecting the endoscope 12 with the light source device 13 and the processor device 14), and propagates the light coupled at the optical path coupling section 23 to the tip 12d of the endoscope 12. A multimode fiber can be used as the light guide 41. As an example, a thin-diameter fiber cable with a core diameter of 105 μm, a cladding diameter of 125 μm, and a diameter of φ0.3 to 0.5 mm including a protective layer serving as an outer cover can be used.

[0021] The tip 12d of the endoscope 12 is provided with an illumination optical system 30 and an imaging optical system 31. The illumination optical system 30 has an illumination lens 33, and light from the light guide 24 is irradiated onto the observation object via the illumination lens 33. The imaging optical system 31 has an objective lens 35 and an imaging sensor 36. Reflected light from the observation object is incident on the imaging sensor 36 via the objective lens 35. As a result, a reflected image of the observation object is formed on the imaging sensor 36.

[0022] The imaging sensor 36 is a color imaging sensor that captures a reflected image of the subject and outputs an image signal. The imaging sensor 36 is preferably a CCD (Charge Coupled Device) imaging sensor, a CMOS (Complementary Metal-Oxide Semiconductor) imaging sensor, or the like. The imaging sensor 36 used in the present invention is a color imaging sensor for obtaining RGB image signals of three colors, R (red), G (green), and B (blue), that is, a so-called RGB imaging sensor that includes R pixels provided with R filters, G pixels provided with G filters, and B pixels provided with B filters. The R pixels output R image signals, the G pixels output G image signals, and the B pixels output B image signals.

[0023] In the normal observation mode, the image sensor 36 captures an image of an observation target illuminated by normal light, thereby outputting a normal image signal, whereas in the special light observation mode, the image sensor 36 captures an image of an observation target illuminated by special light, thereby outputting a special image signal.

[0024] The imaging sensor 36 may be a so-called complementary imaging sensor equipped with complementary color filters of C (cyan), M (magenta), Y (yellow) and G (green) instead of an RGB color imaging sensor. When a complementary imaging sensor is used, image signals of four colors, CMYG, are output, and therefore it is necessary to convert the four color image signals of CMYG into three color image signals of RGB by complementary color-primary color conversion. The imaging sensor 36 may also be a monochrome imaging sensor without color filters. In this case, the light source control unit 21 must turn on the blue light B, the green light G and the red light R in a time-division manner, and add a synchronization process to the imaging signal processing.

[0025] The image signal output from the imaging sensor 36 is transmitted to a CDS / AGC circuit 40. The CDS / AGC circuit 40 performs correlated double sampling (CDS) and automatic gain control (AGC) on the image signal, which is an analog signal. The image signal that has passed through the CDS / AGC circuit 40 is converted into a digital image signal by an A / D (Analog / Digital) converter 42. The A / D converted digital image signal is input to the processor device 14.

[0026] The processor device 14 includes an image signal input unit 45, a DSP (Digital Signal Processor) 46, a noise removal unit 47, a signal switching unit 48, a normal image processing unit 49, a grayscale information emphasis processing unit 50, and a video signal generating unit 51.

[0027] A digital image signal from the endoscope 12 is input to the image signal input unit 45. The DSP 46 performs various signal processing such as defect correction processing, offset processing, gain processing, matrix processing, gamma conversion processing, and demosaic processing on the received image signal. In the defect correction processing, the signal of a defective pixel of the imaging sensor 36 is corrected. In the offset processing, dark current components are removed from the image signal that has been subjected to the defect correction processing, and an accurate zero level is set. In the gain processing, the signal level is adjusted by multiplying the image signal after the offset processing by a specific gain.

[0028] The gain processing differs between the normal observation mode and the special light observation mode. In the gain processing in the normal observation mode, the R image signal, the G image signal, and the B image signal of the normal image signal are multiplied by the R gain coefficient, the G gain coefficient, and the B gain coefficient for normal observation, respectively. In the gain processing in the special light observation mode, the R image signal, the G image signal, and the B image signal of the special image signal are multiplied by the R gain coefficient, the G gain coefficient, and the B gain coefficient for special observation, respectively.

[0029] The image signal after gain processing is subjected to matrix processing to improve color reproducibility. The matrix processing also differs between the normal observation mode and the special light observation mode. In the normal observation mode, matrix processing for normal observation is performed on the normal image signal. In the special light observation mode, matrix processing for special observation is performed on the special image signal.

[0030] After that, the brightness and saturation are adjusted by gamma conversion processing. The image signal after matrix processing is subjected to demosaic processing (also called isotropic processing or synchronization processing), and the missing color signals for each pixel are generated by interpolation. This demosaic processing ensures that all pixels have signals for each RGB color.

[0031] The noise removal unit 47 removes noise from the image signal by performing noise removal processing (for example, a moving average method or a median filter method) on the image signal that has been subjected to gamma correction and the like by the DSP 46. The image signal from which the noise has been removed is transmitted to the signal switching unit 48.

[0032] When the signal switching unit 48 is set to the normal observation mode by the mode switching SW 13a, it transmits a normal image signal to the normal image processing unit 49, and when it is set to the special light observation mode, it transmits a special image signal to the shading information emphasis processing unit 50.

[0033] The normal image processing unit 49 performs image processing for normal observation on the normal image signal. The image processing for normal observation includes structure emphasis processing for normal observation. The normal image signal that has been subjected to image processing for normal observation is input from the normal image processing unit 49 to the video signal generating unit 51 as a normal image. The shading information emphasis processing unit 50 generates a shading-emphasized image based on the special image signal. The shading information emphasis processing unit 50 will be described in detail later. The shading-emphasized image is input to the video signal generating unit 51.

[0034] The video signal generating unit 51 converts the normal image or the shade-emphasized image input from the normal image processing unit 49 or the shade-emphasized image input from the shade-emphasized image processing unit 50 into a video signal for displaying the normal image or the shade-emphasized image as an image that can be displayed on the display 15. Based on this video signal, the display 15 displays the normal image or the shade-emphasized image.

[0035] As shown in FIG. 3, the light source unit 20, which is provided in the light source device 13 and includes a V-LED 20a, a B-LED 20b, a G-LED 20c, and an R-LED 20d, emits light with the following emission spectrum. The V-LED 20a emits purple light V with a central wavelength of 405±10 nm and a wavelength range of 380 to 420 nm. The B-LED 20b emits blue light B with a central wavelength of 460±10 nm and a wavelength range of 420 to 500 nm. The G-LED 20c emits green light G with a wavelength range of 480 to 600 nm. The R-LED 20d emits red light R with a central wavelength of 620 to 630 nm and a wavelength range of 600 to 650 nm.

[0036] In the normal observation mode, the light source control unit 21 turns on the V-LED 20a, the B-LED 20b, the G-LED 20c, and the R-LED 20d. Thus, a mixture of four colors of light, violet light V, blue light B, green light G, and red light R, is irradiated as normal light to the observation target. In addition, in the normal observation mode, the light source control unit 21 controls each of the LEDs 20a to 20d so that the light intensity ratio between the violet light V, the blue light B, the green light G, and the red light R is Vc:Bc:Gc:Rc. On the other hand, in the special light observation mode, the light source control unit 21 controls each of the LEDs 20a to 20d so that the light intensity ratio between the violet light V, the blue light B, the green light G, and the red light R is Vs:Bs:Gs:Rs.

[0037] In this specification, the light amount ratio includes the case where the ratio of at least one semiconductor light source is 0 (zero). Therefore, it includes the case where one or more of the semiconductor light sources are not lit. For example, the light amount ratio is also included when only one of the semiconductor light sources is lit and the other three are not lit, such as when the light amount ratio between the purple light V, the blue light B, the green light G, and the red light R is 1:0:0:0.

[0038] As shown in FIG. 4, the shading information emphasis processing unit 50 includes an image acquisition unit 60, a color and brightness information acquisition unit 61, a first color change processing unit 62, a synthesis coefficient setting unit 63, a color information synthesis unit 65, a second color change processing unit 66, a brightness information acquisition unit 67, a brightness information synthesis unit 68, and a color image conversion unit 69.

[0039] Programs relating to various processes of the shading information emphasis processing unit are incorporated in a program memory of the processor device 14. The programs are executed by a control unit (not shown) constituted by a processor to realize the functions of an image acquisition unit 60, a color and brightness information acquisition unit 61, a first color change processing unit 62, a synthesis coefficient setting unit 63, a color information synthesis unit 65, a second color change processing unit 66, a brightness information acquisition unit 67, a brightness information synthesis unit 68, and a color image conversion unit 69.

[0040] The image acquiring unit 60 acquires an R image signal, a G image signal, and a B image signal of special image signals as a first color medical image. Of the special image signals acquired by the image acquiring unit 60, the R image signal is regarded as a first R image signal, the G image signal is regarded as a first G image signal, and the B image signal is regarded as a first B image signal. The image acquiring unit 60 transmits the special image signals to the color and brightness information acquiring unit 61.

[0041] The images acquired by the image acquisition unit 60 may be the first R image signal, the first G image signal, and the first B image signal of the special image signals which are color endoscopic images acquired by the endoscope 12, or may be color first medical images acquired by various medical devices, such as color ultrasound images acquired by an ultrasound diagnostic device. Therefore, the medical image processing device of the present invention includes an ultrasound processor device for processing ultrasound images, in addition to the endoscope processor device 14 shown in this embodiment.

[0042] The color and brightness information acquisition unit 61 acquires, for each pixel constituting the special image signal, first brightness information related to brightness, which is one of the three color attributes, from the image signal value, and acquires first color information related to color information remaining after removing brightness from the three color attributes. The color and brightness information acquisition unit 61 has a signal ratio calculation unit 61a for acquiring the first color information. In the color and brightness information acquisition unit 61, when the signal ratio calculation unit 61a acquires the first color information, it is preferable that the first brightness information is an image signal suitable for expressing the brightness of each pixel in the special image signal. In this embodiment, the first brightness information is the first G image signal of the special image signal, and is hereinafter represented as G(L1) (see FIG. 5) to distinguish it from other brightness information (second brightness information).

[0043] The signal ratio calculation unit 61a calculates a B / G ratio (-log(B / G) without "-log" is referred to as "B / G ratio") by performing differential processing (logG-logB = logG / B = -log(B / G)) based on the first G image signal and the first B image signal that have been Log converted. The signal ratio calculation unit 61a also calculates a G / R ratio by performing differential processing (logR-logG = logR / G = -log(G / R)) based on the first R image signal and the first G image signal that have been Log converted. The G / R ratio, like the B / G ratio, is represented by -log(G / R) without "-log". The B / G ratio and the G / R ratio calculated by the signal ratio calculation unit 61a are defined as first color information. Hereinafter, the B / G ratio and G / R ratio calculated by the signal ratio calculation unit 61a will be expressed as the B / G ratio (X1) and the G / R ratio (Y1) (see FIG. 5) to distinguish them from other color information (second and third color information).

[0044] The B / G ratio and G / R ratio are calculated for each pixel from the pixel values ​​of pixels at the same position in the B, G, and R image signals. The B / G ratio and G / R ratio are calculated for each pixel. Since the B / G ratio correlates with blood vessel depth (the distance from the mucosal surface to the position of a specific blood vessel), if the blood vessel depth differs, the B / G ratio also varies accordingly. Since the G / R ratio correlates with blood volume (hemoglobin index), if there is a change in blood volume, the G / R ratio also varies accordingly. In place of the B / G ratio and G / R ratio, the CIE1976La obtained from the first color medical image is used. * b * A * b * In this case, La * b * Of these, a * b * corresponds to the first color information, and L corresponds to the first brightness information.

[0045] The first color change processing unit 62 refers to the first color information and the first brightness information, and if the first brightness information exceeds a predetermined upper limit value, changes the first color information in a first color direction, and if the first brightness information is less than a predetermined lower limit value, changes the first color information in a second direction that is complementary or opposite to the first color direction, thereby acquiring second color information.

[0046] Specifically, as shown in Fig. 5 and Fig. 6, for a pixel Pa whose pixel value of the G image signal G(L1) exceeds the upper limit, the first color change processing unit 62 changes the value Sa representing the B / G ratio and G / R ratio corresponding to the pixel Pa in the first color direction D1. * It is preferable that the first color direction D1 is changed by changing the radius and angle in a space obtained by polar coordinate conversion of the B / G ratio and the G / R ratio.

[0047] The first color change processing unit 62 also refers to the pixel values ​​of the G image signal G(L1), and for pixels Pb whose pixel values ​​indicating brightness are less than the lower limit, changes the values ​​Sb representing the B / G ratio and G / R ratio corresponding to the pixel Pa in the second color direction D2. * The B / G ratio and G / R ratio obtained by the change in the first direction D1 in the first color change processing unit 62 are set as the B / G ratio (X2) and the G / R ratio (Y2). This makes it possible to realize color changes for enhancing shading to emphasize color changes in shading information such as a color gamut corresponding to the color of highly concentrated blood or a color gamut corresponding to the color of a mucous membrane onto which a dye has been sprayed.

[0048] In order to emphasize a shading region where both the color of the bright part and the color of the dark part exist, it is preferable that the color indicated by the first color direction D1 is a complementary color or an opposite color to the color indicated by the second color direction D2. For example, it is preferable that the color indicated by the first color direction is yellow, and the color indicated by the second color direction is blue. As for the brightness of the color itself, since yellow is perceived as bright, it is preferable to change it toward yellow in order to increase the brightness in a bright pixel region such as pixel Pa. On the other hand, since blue is perceived as dark, it is preferable to change it toward blue in order to suppress the brightness in a dark pixel region such as pixel Pb. In this way, the change in the shading between the bright part and the dark part is expressed by taking into account a combination of colors such as hue or saturation, making it easier to recognize the change in the shading.

[0049] The synthesis coefficient setting unit 63 sets a first synthesis coefficient used for synthesizing the first color information with second color information described later, or a second synthesis coefficient used for synthesizing the first brightness information with second brightness information described later, based on the first color information. It is preferable that the first synthesis coefficient and the second synthesis coefficient have values ​​determined according to the color information within a first color gamut in which the first color information is within a predetermined range, and are fixed values ​​outside the first color gamut.

[0050] Specifically, as shown in FIG. 7, in a signal ratio space formed by the B / G ratio and the G / R ratio, a first color gamut is defined by first centers XC1, YC1, a first distance R1 from the first centers XC1, YC1, or a first angle θ1 with a first center line CL1 through which the first centers XC1, YC1 pass.

[0051] It is preferable that the first synthesis coefficient f1 and the second synthesis coefficient f2 are greater than 0 within the first color gamut, are changed according to the first distance R1 or the first angle θ1, and are set to 0 outside the first color gamut. For example, as shown in Fig. 8, it is preferable that the first synthesis coefficient f1 is largest at the first centers XC1, YC1 and is smaller as the distance from the first centers XC1, YC1 increases. On the other hand, as shown in Fig. 29, it is preferable that the second synthesis coefficient f2 is largest at the first centers XC1, YC1 and is larger as the distance from the first centers XC1, YC1 increases.

[0052] In addition, when the first color gamut corresponds to the color of high-density blood such as a bleeding area, it is preferable to define the first color gamut in the first quadrant of the signal ratio space consisting of the B / G ratio and the G / R ratio. In this case, as shown in FIG. 9, the first color gamut 72 is preferably an overlapping area of ​​the distance area 72a defined by the first distance R1 and the angle area 72b defined by the first angle θ1 in the first quadrant of the signal ratio space. In addition, when the first color gamut corresponds to the color of mucous membranes on which a blue pigment such as indigo carmine is sprayed, it is preferable to define the first color gamut in the third quadrant of the signal ratio space. In this case, as shown in FIG. 10, the first color gamut 73 is preferably an overlapping area of ​​the distance area 73a defined by the first distance R1 and the angle area 73b defined by the first angle θ1 in the third quadrant of the signal ratio space.

[0053] The color information synthesis unit 65 synthesizes the first color information and the second color information according to the first synthesis coefficient f1 to obtain synthetic color information. Specifically, as shown in FIG. 11, the synthetic color information is obtained by adding the values ​​of the B / G ratio (X1) and the G / R ratio (Y1) for each pixel to f1×B / G ratio (X2) and f1×G / R ratio (Y2) obtained by multiplying the values ​​of the B / G ratio (X2) and the G / R ratio (Y2) for each pixel by the first synthesis coefficient f1. That is, the parts of the B / G ratio (X2) and the G / R ratio (Y2) multiplied by the intra-area coefficient larger than 0 are added to the B / G ratio (X1) and the G / R ratio (Y1). The B / G ratio and the G / R ratio obtained by the color information synthesis unit 65 are referred to as the B / G ratio (MX) and the G / R ratio (MY).

[0054] The second color change processing unit 66 acquires third color information by changing the second distance or the second angle determined according to the color information within the second color gamut in which the second color information falls within a predetermined range. As shown in Fig. 12, the second color change processing unit 66 acquires the B / G ratio (X3) and the G / R ratio (Y3) by changing the second distance R2 or the second angle θ2 in the signal ratio space formed by B / G (MX) and G / R (MY).

[0055] The second color gamut determined by the second distance R2 or the second angle θ2 is a region for emphasizing the color difference of a predetermined color emphasis target. The color emphasis target preferably includes, for example, a region where a color difference occurs from a normal part due to a pathology such as atrophic gastritis (atrophic mucosa, deep blood vessels, redness, etc.). In the second color change processing unit 66, the color change correlated with the difference in shading is further emphasized by nonlinearly expanding or contracting the change in hue or saturation, so that the shading information can be made easier to understand.

[0056] The second color gamut is defined in the signal ratio space in the same manner as the first color gamut, by a second distance R2 from the second centers XC2, YC2 or a second angle θ2 from a second center line CL2 passing through the second centers XC2, XC2, as shown in Fig. 13. In the second color change processing unit 66, in order to change the second distance R2 or the second angle θ2, it is necessary to perform polar coordinate conversion of the B / G ratio (MX) and the G / R ratio (MY).

[0057] The second distance change process for changing the second distance R2 is preferably performed as follows. As shown in Fig. 14, the second distance R2out is output for an input of the second distance R2in of coordinates included in the second gamut. The smaller the second distance R2, the lower the saturation, and the larger the second distance R2, the higher the saturation. The second distance change process uses an S-shaped conversion curve TR that represents the relationship between input and output.

[0058] In the second distance change process, in the low saturation range LR in the second gamut where the second distance R2 is small, the output value R2out is made smaller than the input value R2in, while in the high saturation range HR, the output value R2out is made larger than the input value R2in. This makes it possible to lower the saturation of the observation object included in the low saturation range, while making the saturation of the observation object included in the high saturation range higher. This saturation emphasis makes it possible to increase the saturation difference between multiple observation object ranges. Note that outside the second gamut, the output value R2out is the same as the input value R2in.

[0059] The second angle change process for changing the second angle θ2 is preferably performed as follows. As shown in Fig. 15, the second angle θ2out is output in response to the input of the second angle θ2in of the coordinates included in the second gamut. The difference in hue between the second center XC2 and XC2 increases as the second angle θ2 moves away from 0. The second angle change process uses an S-shaped conversion curve TA that represents the relationship between input and output.

[0060] In the second angle change process, in the second gamut, in the hue range RA indicated by the second angle θ2 on the negative side, the output value θ2out is made smaller than the input value θ2in, while in the hue range RB indicated by the second angle θ2 on the positive side, the output value θ2out is made larger than the input value θ2in. This makes it possible to increase the difference in hue between the object of observation included in the hue range RA on the negative side and the object of observation included in the hue range RB on the positive side. Note that outside the second gamut, the output value θ2out is the same as the input value θ2in.

[0061] 16, the brightness information acquisition unit 67 acquires the second brightness information by converting the first brightness information according to a brightness conversion coefficient set based on the first color information. The brightness conversion coefficient Tc is preferably the same as the first synthesis coefficient f1. Specifically, the brightness conversion coefficient Tc is multiplied by the pixel value of each pixel of the G image signal G(L1) to calculate the G image signal G(L2) which is the second brightness information (G(L2)=Tc×G(L1)).

[0062] The brightness information synthesis unit 68 synthesizes the first brightness information and the second brightness information according to a second synthesis coefficient set based on the first color information to obtain synthetic brightness information. Specifically, the G image signal G(LM) is calculated as synthetic brightness information by adding the pixel value of each pixel of the G image signal (L1), which is the first brightness information, to a value obtained by multiplying the pixel value of each pixel of the G image signal G(L2) by the second synthesis coefficient f2 (G(L1)+f2×G(L2).

[0063] The color image conversion unit 69 converts the second medical image into a color image based on the third color information and the composite brightness information. Specifically, the B / G ratio (X3) is converted into a second B image signal by performing a calculation based on the G image signal G(LM) and the B / G ratio (X3). The G / R ratio (Y3) is converted into a second R image signal by performing a calculation based on the G image signal G(LM) and the G / R ratio (Y3). The G image signal G(LM) is output as a second G image signal without any special conversion. The second B image signal, the second G image signal, and the third image signal become the second medical image in color. The color image conversion unit 69 outputs the second medical image in color as a gray-scale-enhanced image.

[0064] Next, a series of steps in the special light observation mode will be described with reference to the flowchart in FIG. 17. The mode changeover switch 12f is operated to switch to the special light observation mode. This illuminates the observation object with special light. The observation object is imaged by the imaging sensor 36 to obtain a special image signal. The image acquisition unit 60 acquires the first R image signal, the first G image signal, and the first B image signal of the special image signal as a first color medical image.

[0065] The color and brightness information acquisition unit 61 acquires the B / G ratio (X1) and the G / R ratio (Y1) as first color information from the first R image signal, the first G image signal, and the first B image signal of the special image signal. The color and brightness information acquisition unit 61 also acquires the first G image signal G (L1) as first brightness information.

[0066] The first color change processing unit 62 refers to the B / G ratio (X1), the G / R ratio (Y1) and the first G image signal G(L1), and when the first G image signal G(L1) exceeds the upper limit, changes the values ​​representing the B / G ratio (X1) and the G / R ratio (Y1) in the first color direction (yellow direction), and when the first G image signal G(L1) is below the lower limit, changes the values ​​representing the B / G ratio (X1) and the G / R ratio (Y1) in the second color direction (blue direction). This obtains the B / G ratio (X2) and the G / R ratio (Y2) as second color information.

[0067] The color information synthesis unit 65 synthesizes the B / G ratio (X1), G / R ratio (Y1) and the B / G ratio (X2), G / R ratio (Y2) according to a preset first synthesis coefficient f1 to obtain the B / G ratio (MX) and G / R ratio (MY) as synthesized color information. The color image conversion unit 69 converts the B / G ratio (MX) and G / R ratio (MY) into a second color medical image based on the B / G ratio (MX) and G / R ratio (MY). The second color medical image is displayed on the display 15 as a gray-scale enhanced image. The above series of processes are repeated while the special light observation mode continues.

[0068] In the above embodiment, the B / G ratio (X1), the G / R ratio (Y1), and the first G image signal G (L1) calculated by the signal ratio calculation unit 61a are used to obtain a shade-enhanced image, but the shade-enhanced image may be obtained using other first color information and first brightness information.

[0069] For example, from a first color medical image, color difference signals Cr and Cb may be obtained as the first color information, and a luminance signal Y may be obtained as the first brightness information. As shown in Fig. 18, the color difference signals Cr and Cb and the luminance signal Y are obtained by a luminance color difference signal converter 61b. Except for the fact that the color difference signals Cr, Cb and the luminance signal Y are obtained by the luminance color difference signal converter 61b, the present embodiment is similar to the above embodiment using the B / G ratio and the G / R ratio. Therefore, the color difference signals Cb and Cr correspond to the B / G ratio and the G / R ratio, and the luminance signal Y corresponds to the first G image signal.

[0070] In the case where the color difference signals Cr, Cb and the luminance signal Y are used, as shown in Fig. 19, the first color change processing unit 62 refers to the pixel value of the luminance signal Y, and for a pixel Pa whose pixel value indicating brightness exceeds an upper limit value, changes the value Sa representing the color difference signals Cr, Cb corresponding to the pixel Pa in the first color direction D1. * It is preferable that the first color direction is changed by changing the radius and angle in a space obtained by polar coordinate conversion of the color difference signals Cr and Cb.

[0071] The first color change processing unit 62 also refers to the pixel values ​​of the luminance signal Y, and for pixels Pb whose pixel values ​​indicating brightness are less than the lower limit, changes the value Sb representing the color difference signals Cr and Cb corresponding to the pixel Pb in the second color direction D2. * Let us assume that.

[0072] When the color gamut corresponding to the color of high-density blood is defined as the first color gamut, it is preferable to define the first color gamut 72 in the second quadrant of the Cr, Cb space. As shown in Fig. 20, it is preferable that the first color gamut 72 is defined as an overlapping region of a distance region 72a defined by the first distance R1 and an angle region 72b defined by the first angle θ1 in the second quadrant of the Cr, Cb space.

[0073] Also, from the first color medical image, hue H and saturation S may be acquired as the first color information, and value V may be acquired as the first brightness information. As shown in Fig. 21, the acquisition of the hue H, saturation S, and value V is performed by the HSV conversion unit 61c. Except for the fact that the HSV conversion unit 61c acquires the hue H, saturation S, and value V, the present embodiment is similar to the above embodiment using the B / G ratio and the G / R ratio. Therefore, the hue H and saturation S correspond to the B / G ratio and the G / R ratio, and the value V corresponds to the first G image signal.

[0074] In the case where hue H, saturation S, and lightness V are used, as shown in Fig. 22, the first color change processing unit 62 refers to the pixel value of lightness V, and for a pixel Pa whose pixel value indicating brightness exceeds an upper limit value, changes the value Sa representing the hue H and saturation S corresponding to the pixel Pa in the first color direction D1. * Let us assume that.

[0075] The first color change processing unit 62 also refers to the pixel value of the brightness V, and for pixels Pb whose pixel value indicating brightness is less than the lower limit, changes the value Sb representing the hue H and saturation S corresponding to the pixel Pb in the second color direction D2. *Let us assume that.

[0076] When the color gamut corresponding to the color of thick blood is defined as the first color gamut, it is preferable to define the first color gamut 72 in the second quadrant of the HS space. As shown in Fig. 23, it is preferable that the first color gamut 72 is an area in the HS space having the hue range and saturation range of the color gamut corresponding to the color of thick blood.

[0077] [Second embodiment] In the second embodiment, a laser light source and a phosphor are used to illuminate the observation target instead of the four color LEDs 20a to 20d shown in the first embodiment.

[0078] 24, in the endoscope system 100 of the second embodiment, a blue laser light source (indicated as "445LD" in FIG. 24) 104 emitting blue laser light with a central wavelength of 445±10 nm and a blue-violet laser light source (indicated as "405LD" in FIG. 24) 106 emitting blue-violet laser light with a central wavelength of 405±10 nm are provided in the light source device 13, instead of the four color LEDs 20a to 20d. Light emission from the semiconductor light emitting elements of each of these light sources 104 and 106 is individually controlled by a light source control unit 108, and the light intensity ratio between the light emitted from the blue laser light source 104 and the light emitted from the blue-violet laser light source 106 is freely changeable.

[0079] In the normal observation mode, the light source control unit 108 drives the blue laser light source 104. In contrast, in the special light observation mode, the light source control unit 108 drives both the blue laser light source 104 and the blue-violet laser light source 106. The laser light emitted from each of the light sources 104 and 106 enters the light guide 24 via optical members such as a condenser lens, an optical fiber, or a multiplexer (none of which are shown).

[0080] The half-width of the blue laser light or the blue-violet laser light is preferably about ±10 nm. The blue laser light source 104 and the blue-violet laser light source 106 can be broad-area InGaN-based laser diodes, and can also be InGaNAs-based laser diodes or GaNAs-based laser diodes. The light sources may be configured to use light emitters such as light-emitting diodes.

[0081] In addition to the illumination lens 33, the illumination optical system 30 is provided with a phosphor 110 into which blue laser light or blue-violet laser light from the light guide 24 is incident. When the blue laser light is irradiated onto the phosphor 110, fluorescence is emitted from the phosphor 110. Furthermore, a portion of the blue laser light passes through the phosphor 110 as is. The blue-violet laser light passes through the phosphor 110 without exciting it. The light emitted from the phosphor 110 is irradiated onto the observation object via the illumination lens 33.

[0082] Here, in the normal observation mode, mainly blue laser light is incident on phosphor 110, so that the observation object is irradiated with normal light obtained by combining blue laser light and fluorescence excited and emitted from phosphor 110 by blue laser light, as shown in Fig. 25. On the other hand, in the special light observation mode, both blue-violet laser light and blue laser light are incident on phosphor 110, so that the observation object is irradiated with special light obtained by combining excitation light, which is blue-violet laser light, blue laser light, and fluorescence excited and emitted from phosphor 110 by blue laser light, as shown in Fig. 26.

[0083] The phosphor 110 is made of a plurality of types of phosphors (e.g., YAG phosphors or BAM (BaMgAl 10 O 17 It is preferable to use a semiconductor light emitting element that includes a phosphor such as a phosphor 110. If a semiconductor light emitting element is used as an excitation light source for the phosphor 110 as in this configuration example, it is possible to obtain high intensity white light with high luminous efficiency, and the intensity of the white light can be easily adjusted, and changes in the color temperature and chromaticity of the white light can be suppressed to a small extent.

[0084] [Third embodiment] In the third embodiment, instead of the four color LEDs 20a to 20d shown in the first embodiment, a broadband light source such as a xenon lamp and a rotary filter are used to illuminate the observation object. Also, instead of the color imaging sensor 36, an image of the observation object is captured by a monochrome imaging sensor. Also, the processor device 14 does not include a signal switching unit 48, and the image signal output from the noise removal unit 47 is input to a normal image processing unit 49 and a grayscale information emphasis processing unit 50 directly connected to the normal image processing unit 49.

[0085] In the third embodiment, in the normal observation mode, the normal image processing unit 49 operates, and the shading information emphasis processing unit 50 transmits the normal image output from the normal image processing unit 49 as is to the video signal generating unit 51. On the other hand, in the special light observation mode, the shading information emphasis processing unit 59 operates, and the normal image processing unit 49 transmits the special image signal output from the noise removal unit 47 as is to the shading information emphasis processing unit 50. Other than the above, the third embodiment is the same as the first embodiment.

[0086] 27, in an endoscope system 200 of the third embodiment, a broadband light source 202, a rotary filter 204, and a filter switching unit 205 are provided in place of the four color LEDs 20a to 20d in a light source device 13. Also, in an imaging optical system 30b, a monochrome imaging sensor 206 not provided with a color filter is provided in place of the color imaging sensor 36.

[0087] The broadband light source 202 is a xenon lamp, a white LED, or the like, and emits white light whose wavelength range is from blue to red. The rotating filter 204 includes a filter 208 for normal observation mode provided on the inside and a filter 209 for special light observation mode provided on the outside (see FIG. 28). The filter switching unit 205 moves the rotating filter 204 in the radial direction, and when the normal observation mode is set by the mode switching SW 13a, the filter 208 for normal observation mode of the rotating filter 204 is inserted into the optical path of the white light, and when the special light observation mode is set, the filter 209 for special light observation mode of the rotating filter 204 is inserted into the optical path of the white light.

[0088] 28, the normal observation mode filter 208 is provided with a B filter 208a that transmits blue light of the white light, a G filter 208b that transmits green light of the white light, and an R filter 208c that transmits red light of the white light, arranged in the circumferential direction. Therefore, in the normal observation mode, the rotating filter 204 rotates to alternately irradiate the observation target with blue light, green light, and red light.

[0089] The filter 209 for special light observation mode is provided with a Bn filter 209a that transmits blue narrowband light of a specific wavelength from among white light, a G filter 209c that transmits green light from among white light, and an R filter 209d that transmits red light from among white light, along the circumferential direction. Therefore, in the special light observation mode, the rotating filter 204 rotates so that the observation target is alternately irradiated with blue narrowband light, green light, and red light. The image signal based on the blue narrowband light is used as the B image signal of the special image signal. The image signal based on the green light is used as the G image signal of the special image signal, and the image signal based on the red light is used as the R image signal of the special image signal.

[0090] In the above embodiment, the first color change processing unit 62 or the second color change processing unit 66 may use a two-dimensional LUT (Look Up Table) that outputs a corresponding output value (two types of color information such as B / G ratio, G / R ratio, etc.) when an input value (two types of color information such as B / G ratio, G / R ratio, etc.) is input.

[0091] In the above embodiment, the hardware structure of the processing units such as the normal image processing unit 49, the shading information emphasis processing unit 50, the video signal generating unit 51, the image acquiring unit 60, the color and brightness information acquiring unit 61, the first color change processing unit 62, the synthesis coefficient setting unit 63, the color information synthesizing unit 65, the second color change processing unit 66, the brightness information acquiring unit 67, the brightness information synthesizing unit 68, the color image converting unit 69, the signal ratio calculating unit 61a, the luminance and color difference signal converting unit 61b, the HSV converting unit 61c, and the light source control unit 108 is various processors as shown below. The various processors include a CPU (Central Processing Unit) which is a general-purpose processor that executes software (programs) and functions as various processing units, a programmable logic device (PLD) which is a processor whose circuit configuration can be changed after manufacturing such as an FPGA (Field Programmable Gate Array), and a dedicated electric circuit which is a processor having a circuit configuration designed exclusively for executing various processes.

[0092] One processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same type or different types (for example, multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple processing units may be configured with one processor. As an example of configuring multiple processing units with one processor, first, as represented by a computer such as a client or server, one processor is configured with a combination of one or more CPUs and software, and this processor functions as multiple processing units. Second, as represented by a system on chip (SoC), there is a form in which a processor is used that realizes the functions of the entire system including multiple processing units with one IC (Integrated Circuit) chip. In this way, the various processing units are configured using one or more of the above various processors as a hardware structure.

[0093] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit (circuitry) in the form of a combination of circuit elements such as semiconductor elements, etc. Also, the hardware structure of the memory unit is a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid Stage Drive). [Explanation of symbols]

[0094] 10 Endoscope System 12 Endoscopy 12a Insertion part 12b Operation section 12c Curved section 12d Tip 12f Mode Switch 12g Still image capture switch 12h Zoom operation section 13 Light source device 14 Processor Unit 15 Display 16 User Interface 20 Light source section 20a V-LED 20b B-LED 20c G-LED 20d R-LED 21 Light source control unit 23 Optical path coupling section 24 Light Guide 30 Illumination optical system 31 Imaging optical system 33 Lighting Lens 35 Objective Lens 36 Image sensor 40 CDS / AGC circuit 42 A / D converter 45 Image signal input section 46 DSP 47 Noise Removal Section 48 Signal Switching Section 49 Normal image processing section 50 Gray-scale information emphasis processing section 51 Video signal generator 60 Image acquisition unit 61 Color and brightness information acquisition unit 61a Signal ratio calculation section 61b Luminance and color difference signal conversion unit 61c HSV conversion section 62 First color change processing section 63 Synthesis coefficient setting section 65 Color information synthesis section 66 Second color change processing section 67 Brightness information acquisition unit 68 Brightness information synthesis section 69 Color Image Conversion Unit 72, 73 First color gamut 72a, 73a distance area 72b, 73b angular area 100 Endoscope system 104 Blue laser light source 106 Blue-violet laser light source 108 Light source control unit 110 Phosphor 200 Endoscope System 202 Broadband Light Source 204 Rotating Filter 205 Filter switching section 206 Image Sensor 208 Filter for normal observation mode 208a B Filter 208b G filter 208c R filter 209 Filter for special light observation mode 209a Bn Filter 209b G Filter 209c R Filter Sa, Sa * value Sb, Sb * value D1 1st color direction D2 2nd color direction XC1, YC1 1st center R1 First distance θ1 1st angle CL1 1st center line XC2, YC2 2nd center R2 2nd distance θ2 2nd angle CL2 2nd center line TR, TA S-shaped conversion curve LR Low saturation range HR High saturation range RA negative side hue range RB positive hue range

Claims

1. A processor is provided. The processor, acquiring a first medical image in color; For each pixel constituting the first color medical image, first brightness information relating to brightness, which is one of three color attributes, is obtained from the image signal value, and first color information relating to color information remaining after removing brightness from the three color attributes is obtained; With reference to the first color information and the first brightness information, the first color information, of which the first brightness information exceeds a predetermined upper limit value, is changed to a first color direction, and the first color information, of which the first brightness information is less than a predetermined lower limit value, is changed to a second color direction that is a complementary color or an opposite color to the first color direction, thereby acquiring second color information; obtaining composite color information by combining the first color information with the second color information multiplied by a first combination coefficient set based on the first color information; converting the image signal values ​​into a second medical image having a modified color based on the first brightness information and the composite color information; the color indicated in the first color direction is yellow, and the color indicated in the second color direction is blue; the first blending coefficient has a value determined according to the color information within a first color gamut in which the first color information is within a predetermined range, and has a fixed value outside the first color gamut; the first synthesis coefficient is greater than 0 within the first color gamut, and is changed according to a first distance or a first angle determined according to the color information, and is set to 0 outside the first color gamut; The first color gamut is a color gamut corresponding to the color of high-density blood.

2. The first color information is R / G, which is a ratio of a red signal R of the first color medical image to a green signal G of the first color medical image, and B / G, which is a ratio of a blue signal B of the first color medical image to the green signal G, color difference signals Cr and Cb obtained from the first color medical image, hue and saturation obtained from the first color medical image, and CIE1976La, which is a ratio of a blue signal B of the first color medical image to the green signal G of the first color medical image. * b * Of which a * b * 2. The medical image processing apparatus according to claim 1, wherein the medical image processing apparatus is any one of the above.

3. The processor: acquiring a first medical image in color; obtaining, for each pixel constituting the first color medical image, first brightness information relating to brightness, which is one of three color attributes, from an image signal value, and obtaining first color information relating to color information remaining after removing brightness from the three color attributes; a step of acquiring second color information by referring to the first color information and the first brightness information, changing, in the first color information, the first brightness information of which exceeds a predetermined upper limit value, in a first color direction, and changing, in the first color information, the first brightness information of which is less than a predetermined lower limit value, in a second color direction that is a complementary color or an opposite color to the first color direction; obtaining composite color information by combining the first color information with the second color information multiplied by a first combination coefficient set based on the first color information; converting the image signal values ​​into a modified color second medical image based on the first brightness information and the composite color information; the color indicated in the first color direction is yellow, and the color indicated in the second color direction is blue; the first blending coefficient has a value determined according to the color information within a first color gamut in which the first color information is within a predetermined range, and has a fixed value outside the first color gamut; the first synthesis coefficient is greater than 0 within the first color gamut, and is changed according to a first distance or a first angle determined according to the color information, and is set to 0 outside the first color gamut; A method of operating a medical image processing apparatus, wherein the first color gamut is a color gamut corresponding to a thick blood color.

Citation Information

Patent Citations

  • Nuclear fuel hanging and transporting device

    JP1984032894A

  • Endoscope processor and endoscope system

    JP2009279150A

  • Imaging device, imaging method and program

    JP2013077879A

  • Image processing device and operation method thereof

    JP2017176856A

  • Endoscopic image signal processing device and program

    JP6580778B2