Endoscope processor and endoscope system

Abstract

We provide an endoscope processor 30 that can be applied to many subjects and other objects. [Solution] The endoscope processor 30 comprises an image processing unit 31, a calculation unit 32 that calculates an index for a pixel, an identification unit 33 that uses a plurality of thresholds to identify one of a plurality of symptom levels based on the index, a display color acquisition unit 34 that acquires a display color including the identification color corresponding to the symptom level, and an image generation circuit 35 that generates an identification image by applying the display color to the pixel, wherein the display color includes an error color to be applied to a first error pixel and a second error pixel, and the image generation unit generates the identification image using the error color for the first error pixel and the second error pixel.

Description

Technical Field

[0004] ,

[0006] , , , , , ,

[0005] , , ,

[0003] , , , ,

[0001] The present invention relates to an endoscope processor and an endoscope system for imaging a subject inside the body.

Background Art

[0002] International Publication No. 2018 / 230130 discloses an endoscope device that calculates an index indicating the degree of abnormality of a subject according to the color included in the subject image captured by the endoscope and discriminatively displays the index according to a threshold value.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above-described endoscope device, the degree of abnormality indicated by the index was either abnormal or normal. In addition, since the setting of the threshold value for identifying the index was simple, there was a risk that applicable subjects and the like were limited.

[0005] An object of the present invention is to provide an endoscope processor that discriminatively displays according to three or more types of symptom levels. Another object of the present invention is to provide an endoscope system applicable to many subjects and the like.

Means for Solving the Problems

[0006] The endoscope processor according to an embodiment of the present invention comprises: an image processing unit that generates a subject image from an image signal; a calculation unit that calculates an index for one or more pixels of the subject image by normalizing the sum of the red pixel value and the green pixel value by the blue pixel value; an identification unit that identifies a pixel using a plurality of thresholds for identifying it to one of a plurality of symptom levels based on the index; a display color acquisition unit that acquires a display color including an identification color corresponding to the symptom level; and an image generation unit that generates an identification image by applying the display color to the pixel, wherein the display color includes an error color to be applied to a first error pixel whose red pixel value, the green pixel value, and the blue pixel value are below a predetermined lower limit pixel value or above a predetermined upper limit pixel value, and a second error pixel whose index is below a predetermined lower limit threshold or above a predetermined upper limit threshold, wherein the error color is a different color from the identification color, and the image generation unit generates the identification image using the error color for the first error pixel and the second error pixel.

[0007] An endoscope processor according to an embodiment of the present invention comprises: an image processing unit that generates a subject image from an image signal; a calculation unit that calculates an index for a pixel by normalizing the sum of the red pixel value and the green pixel value of one or more pixels in at least a portion of the subject image region by the blue pixel value; an identification unit that identifies a pixel using a plurality of thresholds for identifying it to one of a plurality of symptom levels based on the index; an identification color acquisition unit that acquires an identification color corresponding to the symptom level; and an image generation unit that generates an identification image using the identification color of the pixel. The image generation unit outputs a past image, which is an identification image generated based on past subject images taken from the same subject, along with the identification image.

[0008] The endoscope processor according to an embodiment of the present invention comprises: an image processing unit that generates a subject image from an image signal; a calculation unit that calculates an index for one or more pixels of the subject image by normalizing the sum of the red pixel value and the green pixel value by the blue pixel value; an identification unit that identifies a pixel using a plurality of thresholds for identifying it to one of a plurality of symptom levels based on the index; an identification color acquisition unit that acquires an identification color corresponding to the symptom level; and an image generation unit that generates an identification image to be displayed on a monitor using the identification color, wherein only pixels corresponding to the selected identification color are displayed in color, and pixels that do not correspond are displayed in white.

[0009] An endoscope processor according to an embodiment of the present invention includes: an image processing unit that generates a subject image from an image signal; a calculation unit that calculates an index for one or more pixels of the subject image by normalizing the sum of the red pixel value and the green pixel value by the blue pixel value; an identification unit that identifies a pixel using a plurality of thresholds for identifying it to one of a plurality of symptom levels based on the index; an identification color acquisition unit that acquires an identification color corresponding to the symptom level; and an image generation unit that generates an identification image by applying the identification color to the pixels, and further superimposes the identification image onto the subject image by making it semi-transparent.

[0010] An endoscope system according to an embodiment of the present invention includes an endoscope processor, an endoscope connected to the endoscope processor, a memory connected to the endoscope processor, and a monitor connected to the endoscope processor, wherein the endoscope processor includes an image processing unit that generates a subject image from an image signal, a calculation unit that calculates an index for one or more pixels of the subject image by normalizing the sum of the red pixel value and the green pixel value by the blue pixel value, an identification unit that identifies the subject image using a plurality of thresholds for identifying it to one of a plurality of symptom levels based on the index, a display color acquisition unit that acquires a display color including an identification color corresponding to the symptom level, and the pixel The endoscope comprises an image generation unit that generates an identification image to which a display color is applied, wherein the display color includes an error color to be applied to a first error pixel whose pixel value is below a predetermined lower limit pixel value or above a predetermined upper limit pixel value, and a second error pixel whose index is below a predetermined lower threshold or above a predetermined upper threshold, the error color being a different color from the identification color, the image generation unit generates the identification image using the error color for the first and second error pixels, the endoscope outputs the image signal, and the memory stores the threshold and the identification color. [Effects of the Invention]

[0011] According to the present invention, it is possible to provide an endoscope processor that identifies and displays symptoms according to three or more different levels. Furthermore, according to the present invention, it is possible to provide an endoscope processor that can be applied to many different subjects. [Brief explanation of the drawing]

[0012] [Figure 1] Figure 1 shows the configuration of an endoscope device according to an embodiment of the present invention. [Figure 2] Figure 2 illustrates the relationship between the absorbance characteristics of plasma and the luminescence characteristics of a light source. [Figure 3] Figure 3 is a diagram illustrating the absorbance characteristics of the subject. [Figure 4]FIG. 4 is a diagram for explaining the calculation formula of the index of the endoscope apparatus according to an embodiment of the present invention. [Figure 5] FIG. 5 is a diagram for explaining the calculation formula of the index of the endoscope apparatus according to an embodiment of the present invention. [Figure 6] FIG. 6 is a flowchart of an operation method of the endoscope apparatus according to an embodiment of the present invention. [Figure 7] FIG. 7 is a diagram showing the relationship between the symptom level and the threshold value in the endoscope apparatus according to an embodiment of the present invention. [Figure 8] FIG. 8 is a diagram showing the relationship between the symptom level and the threshold value set in the endoscope apparatus according to an embodiment of the present invention. [Figure 9] FIG. 9 is a diagram showing the relationship between the symptom level and the identification color in the endoscope apparatus according to an embodiment of the present invention. [Figure 10] FIG. 10 is a first display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention. [Figure 11] FIG. 11 is a second display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention. [Figure 12] FIG. 12 is a third display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention. [Figure 13] FIG. 13 is a fourth display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention. [Figure 14] FIG. 14 is a fifth display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention. [Figure 15] FIG. 15 is a sixth display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention. [Figure 16] FIG. 16 is a seventh display example of the monitor screen in the endoscope apparatus according to an embodiment of the present invention.

MODE FOR CARRYING OUT THE INVENTION

[0013] <Configuration of Endoscope Apparatus> As shown in FIG. 1, the endoscope apparatus 1 includes an endoscope 10, a light source device 20, an endoscope processor 30 (hereinafter referred to as "processor 30"), a monitor 40, and a memory 50.

[0014] The endoscope 10 has a long and slender insertion portion 11 to be inserted into a subject 90, an operation portion 12 provided at the proximal end of the insertion portion 11, a universal cord 13 extending from the operation portion 12, and a connector 14. The operation portion 12 has a plurality of buttons 12A and the like which are endoscope setting portions for operating endoscope functions and imaging functions. The insertion portion 11 of the endoscope 10 has, in order from the distal end side, a distal end portion 11A, a bending portion 11B provided at the proximal end of the distal end portion 11A, and a long and slender flexible tube 11C provided at the proximal end of the bending portion 11B. An imaging unit 15 which is an imaging portion and a lighting unit 16 which is a lighting portion are provided at the distal end portion 11A.

[0015] The connector 14 of the endoscope 10 is connected to the light source device 20 and the processor 30. The illumination light L generated by the light source device 20 is guided to the lighting unit 16 at the distal end portion 11A of the insertion portion 11 to illuminate a subject 91 in the body of the subject 90. The imaging unit 15 has an imaging element such as a CCD. The imaging unit 15 converts the reflected light R from the subject 91 into an electrical signal and outputs a subject image to the processor 30.

[0016] The light source device 20 includes a light source control portion 22, a light source 23, and a multiplexer 24.

[0017] The light source control portion 22 is connected to the light source 23 and is a light source control circuit that controls the light source 23 in accordance with a control signal from the processor 30.

[0018] The light source 23 has multiple light-emitting elements, such as LEDs. The light source 23 has an R element 23R, a G element 23G, and a B element 23B. The R element 23R emits red light Br in the normal bandwidth. The G element 23G emits green light Bg in the normal bandwidth. The B element 23B emits blue light Bb in the normal bandwidth. In addition to normal bandwidth blue light Bb, the B element 23B narrows the blue light by, for example, a narrowband light filter (not shown) and outputs narrowband blue light Nb.

[0019] The multiplexer 24 combines multiple light sources input from the light source 23 and outputs illumination light L to the illumination unit 16.

[0020] The processor 30 includes an image processing unit 31, a calculation unit 32, an identification unit 33, a display color acquisition unit (hereinafter referred to as the "identification color acquisition unit 34"), an image generation unit 35, and a setting unit 36. The processor 30, which consists of a CPU, controls the entire endoscope device 1 and generates an endoscopic image based on the image signal input from the endoscope 10, and generates an identification image based on the endoscopic image, as will be described later. The endoscope 10 is an imaging device that outputs an image signal.

[0021] The setting circuit, the setting unit 36, consists of buttons or the like that the user inputs various instructions. The setting unit 36 ​​may be a separate touch panel, keyboard, foot switch, or button 12A on the endoscope 10, separate from the processor 30. For example, instructions such as bending instructions for the bending section, driving instructions for the light source device 20, the type of illumination light L that illuminates the subject 91, the type of observation area of ​​the subject 91, and the image to be displayed on the monitor 40 are input from the setting unit 36.

[0022] The configurations of the image processing unit 31, calculation unit 32, identification unit 33, identification color acquisition unit 34, and image generation unit 35 will be described later.

[0023] At least one of the multiple configurations of the processor 30 and the light source control unit 22 may be configured by a software-operated processor 30 or an internal circuit (CPU) of the light source device, or by a dedicated hardware circuit.

[0024] The monitor 40 is, for example, an LCD or CRT that displays a color image. The monitor 40 displays the image instructed by the processor 30. The monitor 40, which has touch panel functionality, may also constitute part of the setting unit 36.

[0025] Memory 50 is a RAM, ROM, or hard disk drive device in which data such as the operating conditions of the processor 30, programs, etc. are stored. Memory 50 may also be the internal memory of the processor 30 in which data, etc., is transferred and stored from a non-temporary computer-readable storage medium such as a CD or DVD. The processor 30 performs predetermined processing based on the programs and data stored in memory 50. In addition, past examination data of the patient 90, etc., stored on a separate server, for example, may be transferred to memory 50 via an internet connection or the like.

[0026] <Indicators> The calculation unit 32 is a calculation circuit that calculates an index VI for each of the multiple pixels of the subject image output by the imaging unit. The index VI, which quantitatively indicates the symptom level of the subject 91, is calculated using a predetermined calculation formula.

[0027] The following explains the process for selecting the calculation formula. Figure 2 illustrates the relationship between the absorption characteristics W of plasma and the wavelength of light emitted by the light source 23. Figure 2 shows the normal-band red light Br, normal-band green light Bg, normal-band blue light Bb, narrow-band blue light Nb, the absorption characteristics W of plasma, and the peak wavelength Wp of the plasma extinction coefficient.

[0028] As shown in Figure 2, the absorbance characteristic W of plasma is low around 415 nm, peaks around 465 nm, and approaches zero around 550 nm.

[0029] Therefore, while blue light Bb may be in the normal bandwidth, it is particularly preferable to narrow the bandwidth so that the central wavelength is the same as the peak wavelength Wp of the plasma absorption coefficient in order to clearly detect plasma. For example, blue light Bb is narrowed so that the central wavelength is around 465 nm and used as narrowband blue light Nb. Blue light Bb may also be narrowed so that the central wavelength is 460 nm to 470 nm. Furthermore, blue light Bb may also be narrowed so that the central wavelength is 415 nm to 495 nm.

[0030] When plasma is irradiated with special light containing red light (Br), green light (Bg), and narrowband blue light (Nb), it absorbs more blue light than red and green light, resulting in a stronger yellowish tint compared to when irradiated with normal light containing normal blue light (Bb).

[0031] Next, Figure 3 schematically represents a cross-section of the mucosa. In Figure 3, normal mucosa N, edema M, polyp S, blood vessel Bv, and illumination light L are shown. Here, illumination light L is a short-wavelength monochromatic light such as narrowband blue light Nb. The intramucosal pigment is plasma.

[0032] As shown in the light penetration region L1, in normal mucosa N, the penetration of illuminating light L is high, and the reflected light R appears pale yellow due to mucosal pigments with a higher absorption coefficient on the shorter wavelength side than on the longer wavelength side.

[0033] As shown in the light penetration region L2, the penetration of illuminating light L is reduced in edema M compared to normal mucosa N. More specifically, in edema M, illuminating light L is scattered more by the thickened epithelium on the short-wavelength side than on the long-wavelength side, and is reflected without being absorbed by the mucosal pigments. Therefore, in edema M, reflected light R appears whiter than in normal mucosa N.

[0034] As shown in the light penetration region L3, the degree of light penetration in polyp S is even lower than in edema M, and the reflected light R appears even whiter than in edema M.

[0035] Figure 4 shows the index VI, which is a normalized representation of the green pixel value Vg, red pixel value Vr, blue pixel value Vb, or the sum of the green pixel value Vg and the red pixel value Vr for each pixel in an endoscopic image. The pixel value V is acquired, for example, as 8-bit data (0-255).

[0036] Figure 4 shows the differences in index VI between normal mucosa N, edema M, and polyp S, due to differences in the calculation formula for index VI. In Figure 4, the X-axis shows the calculation formulas for index VI, such as "Vg / Vb", "Vr / Vb", "Vr / Vg", and "(Vr+Vg) / 2Vb", while the Y-axis shows the index VI normalized by each calculation formula.

[0037] Solid lines represent normal mucosa (N), single-dotted lines represent edema (M), and double-dotted lines represent polyps (S). Hereafter, edema (M) and polyps (S) will be referred to as abnormal mucosa.

[0038] In the mucous membranes of the body, such as those of the nose and paranasal sinuses, the severity of symptoms increases in the order of normal mucosa (N), edema (M), and polyp (S). There is a difference in color between normal mucosa (N) and abnormal mucosa; as the severity of symptoms increases, the mucosal epithelium thickens and the whiteness of the appearance increases. For this reason, the formula that yields the highest values ​​for the index VI of normal mucosa (N) and the index VI of polyp (S) is "(Vr + Vg) / 2Vb".

[0039] Figure 5 shows the index VIN for edema M and polyp S, which is the same index VI for edema M and polyp S as in Figure 4, normalized by the index VI for normal mucosa N. In Figure 5, the X axis shows the calculation formula used to calculate index VIN normalized by the index VI for normal mucosa N, and the Y axis shows index VIN.

[0040] As shown in Figures 4 and 5, in normal mucosa N and polyp S, the indices VI and VIN calculated using the formula "(Vr+Vg) / 2Vb" are larger than the indices VI and VIN calculated using other formulas.

[0041] In other words, the indices VI and VIN, calculated using the formula "(Vr+Vg) / 2Vb", largely represent the difference between the color of normal mucosa N and the color of abnormal mucosa.

[0042] <How to operate an endoscope> The operation method of the endoscope device 1 will be explained using the flowchart in Figure 6.

[0043] <Step S10> Illumination light irradiation The insertion section 11 of the endoscope 10 is inserted into the body of the subject 90, for example, into the nasal cavity. Illumination light L from the light source device 20 is irradiated onto the mucous membrane, which is the subject 91, via the illumination unit 16 at the tip section 11A. The illumination light L consists of red light Br, green light Bg, and blue light Bb.

[0044] <Step S20> Image Signal Output The imaging unit 15 at the tip 11A receives reflected light R from the subject 91, converts it into an electrical signal, and outputs the imaging signal (image signal) to the processor 30.

[0045] <Step S30> Image Processing The image processing unit 31 is an image processing circuit that generates an endoscopic image, which is the subject image, by performing image processing such as gain adjustment, white balance adjustment, gamma correction, edge enhancement correction, and scaling adjustment based on the image signal.

[0046] <Step S40> Indicator Calculation The calculation unit 32 calculates the index VI for each pixel by normalizing the sum of the red pixel value Vr and the green pixel value Vg for each of the multiple pixels of the subject image by twice the value of the blue pixel value Vb(Nb). In other words, the calculation unit 32 calculates the index VI for multiple regions (pixels) of the subject.

[0047] In Figures 4 and 5, the formula "(Vr+Vg) / 2Vb" was used to calculate the index VI by normalizing the pixel values. However, any formula that normalizes the sum of the red and green pixel values ​​by the blue pixel value can be modified as appropriate.

[0048] For example, you can convert the index VI into 8-bit (0-255) data, add more values ​​to the 8-bit data, or even change the value of k in the calculation formula "(Vr+Vg) / kVb". Below, the index VI was calculated using formula 1 (k=2).

[0049] <Expression 1> VI = 32 × log2[(Vr + Vg) / 2Vb] + 256

[0050] The calculation unit 32 preferably calculates the index VI using one of several calculation formulas corresponding to each of the multiple subjects 91 (for example, the nose, paranasal sinuses, and digestive tract).

[0051] <Step S50> Identification of multiple types of symptom levels The identification unit 33 is an identification circuit that identifies the symptom level of each pixel based on the index VI using multiple thresholds T.

[0052] In Endoscopy Device 1, there are five symptom levels: "normal / mild / moderate / severe / very severe." If there are three or more symptom levels, it is easier to make a detailed assessment of the symptoms than when there are only two levels: "normal / abnormal."

[0053] To distinguish between the five symptom levels, four thresholds T are necessary (the first threshold T1 for normal and mild symptoms, the second threshold T2 for mild and moderate symptoms, the third threshold T3 for moderate and severe symptoms, and the fourth threshold T4 for severe and very severe symptoms). The thresholds T are predetermined and set appropriately based on the judgment of multiple experts. It goes without saying that the relative magnitudes of the four thresholds T, each set within a predetermined range, are in the order of T1-T4.

[0054] Figure 7 shows an example of a threshold T. It is preferable that the difference ΔT between multiple thresholds is approximately the same. For example, it is preferable that the difference ΔT3 (threshold T4 - threshold T3) is 80% to 120% of the difference ΔT2 (threshold T3 - threshold T2).

[0055] However, under certain conditions, the first threshold difference ΔT1 between the first threshold T1 and the second threshold T2 may be greater than the second threshold difference ΔT2 between the second threshold T2 and the third threshold T3, and the second threshold difference ΔT2 may be greater than the third threshold difference ΔT3 between the third threshold T3 and the fourth threshold T4. Conversely, the first threshold difference ΔT1 may be less than the second threshold difference ΔT2, and the second threshold difference ΔT2 may be less than the third threshold difference ΔT3.

[0056] Furthermore, depending on the system being combined and the image sensor installed, the threshold difference ΔT may increase as the severity of the condition increases.

[0057] The memory 50 stores multiple threshold sets, each consisting of multiple thresholds, corresponding to each of the multiple subjects 91, and the identification unit 33 identifies the subject 91 using the threshold set corresponding to it. The threshold sets used by the identification unit 33 may be acquired automatically or set by the setting unit 36.

[0058] As shown in Figure 8, each threshold T(T1-T4) included in the multiple threshold sets has variability (variance), but it is preferable that the variability of each threshold T(T1-T4) is set within a predetermined range. For example, the maximum value of threshold T1 is 313, and the minimum value of threshold T1 is 291. In contrast, the maximum value of threshold T4 is 273, and the minimum value is 267. That is, the variability LT1 (=6) of threshold T4 is smaller than the variability LT2 (=22) of threshold T1.

[0059] The cause of this is the color balance calibration performed by the image processing unit 31. In other words, the image processing unit 31 performs white balance calibration, using white, which is close to the color of the most severe region, as the reference.

[0060] By changing the colors used in color balance calibration or by using multiple colors for calibration, it is possible to adjust the variation in threshold T. For example, by performing color balance calibration using colors in the normal range (red-yellow), the variation in threshold T1 (LT2) can be reduced. Furthermore, by performing color balance calibration using intermediate colors between the most severe range and the normal range (red-yellow), the variation in multiple threshold T values ​​can be reduced and averaged out.

[0061] <Step S60> Identification Color Acquisition Unit The identification color acquisition unit 34 acquires identification colors corresponding to multiple types of symptom levels for the pixels acquired by the identification unit 33.

[0062] Figure 9 shows the identification colors corresponding to the symptom levels. The index VI is, for example, 8-bit data with 256 added to it, resulting in data in the range of (0-511). Multiple thresholds T and identification colors are stored in memory 50.

[0063] In the example shown in Figure 9, the identification color acquisition unit 34 acquires multiple colors with different hues, but it is also acceptable for it to acquire multiple saturations with different vividness, multiple brightness levels with different brightness, multiple hatching patterns with different spacing, or multiple patterns with different designs.

[0064] Furthermore, endoscopic images may contain pixels with color error pixel values ​​that do not occur in normal imaging. In the endoscope device 1, pixels with a pixel value V in which at least one of the red pixel value, green pixel value, and blue pixel value is below a predetermined lower limit pixel value or above a predetermined upper limit pixel value are designated as first error pixels. For example, pixels with a pixel value V in the range of (0-255) that is 5 or less or 250 or more are designated as first error pixels.

[0065] Furthermore, pixels of index VI that are below a predetermined lower threshold or above a predetermined upper threshold are designated as second error pixels. For example, in the example shown in Figure 9, pixels of index VI that are below a lower threshold of 10 or above a upper threshold of 500 are designated as second error pixels.

[0066] The identification color acquisition unit 34 acquires an error color for error pixels (the first error pixel and the second error pixel). The image generation unit generates an identification image using the error color for the error pixels. The error color is not limited to white / black as exemplified in Figure 9, but may also be gray, for example. Furthermore, the color of pixels below the lower limit and above the upper limit of the threshold may be the same error color (for example, white). The numerical value of the judgment criterion for error pixels and the error color data are stored in the memory 50.

[0067] Furthermore, the processor 30 may issue a warning if the error ratio (the ratio of the number of error pixels to the total number of pixels) is calculated and the error ratio is greater than or equal to a predetermined value. The number of error pixels is either the number of first error pixels, the number of second error pixels, or the total number of error pixels. In other words, if, for a predetermined number of pixels or more, the sum of the red pixel values ​​and green pixel values ​​is normalized by the blue pixel value, and the ratio of the number of first error pixels, the number of second error pixels, or the sum of the number of first error pixels and the number of second error pixels to the total number of pixels is greater than a predetermined ratio, the processor 30 will output a warning. The warning may be displayed on the monitor 40, for example, as text or a graphic.

[0068] Based on the warning, for example, modifying the threshold set can make it easier to identify the symptom level. The threshold set can be modified automatically or manually by the user.

[0069] <Step S70> Recognition Image Generation The identification color acquisition unit 34 acquires an identification color corresponding to the symptom level of each pixel. The image generation unit 35 is an identification color acquisition circuit that generates an identification image using the identification colors of multiple pixels.

[0070] <Step S80> Display The monitor 40 displays the identification image in various forms.

[0071] <Example 1> Figure 10 shows an example of the display image on the monitor 40. In Figure 10, a portion of the color-displayed endoscopic image 40A is replaced with the identification image 40B. In other words, a superimposed image is displayed in which the identification image 40B is superimposed on the endoscopic image 40A. The area displayed as the identification image 40B is indicated by a frame within the endoscopic image 40A.

[0072] From the viewpoint of visibility and operability, it is preferable that the area of ​​the identification image 40B be between 20% and 70% of the total area of ​​the endoscopic image 40A. The area of ​​the identification image 40B can be changed, for example, by operating the setting unit 36.

[0073] Furthermore, the monitor 40 displays the average value 40D of the indicators along with the identification color list display 40C. In other words, the calculation unit 32 calculates the average value 40D of the indicators of multiple pixels, and the monitor 40 displays the average value 40D of the indicators.

[0074] Users can easily understand the subject's symptoms based on the average value of the indicator, 40D.

[0075] <Example 2> As shown in Figure 11, the monitor 40 displays an identification image 40B instead of the endoscopic image 40A. In other words, the calculation unit 32 may calculate an index from multiple pixels of the entire area of ​​the subject image, the endoscopic image 40A, and the image generation unit 35 may generate an identification image corresponding to the entire area of ​​the endoscopic image 40A.

[0076] <Example 3> As shown in Figure 12, on the monitor 40, an identification image 40B of a region enclosed by a frame within the endoscopic image 40A is displayed in a separate area from the endoscopic image 40A. At least one of the position and range (area) of a portion of the region that generates the identification image 40B within the entire area of ​​the subject image, the endoscopic image 40A, can be appropriately selected by operating the setting unit 36.

[0077] In narrow passages, it can be difficult to orient the center of the endoscopic image 40A (the center of the field of view of the imaging unit 15) towards the area of ​​interest. However, by selecting at least one of the position and range of the area where the identification image 40B is displayed, the user can easily identify the area of ​​interest.

[0078] <Example 4> As shown in Figure 13, the monitor 40 displays the endoscopic image 40A and the identification image 40B, along with the identification image 40BP, which is a past image of the subject 90 from a previous examination that is similar in range to the identification image 40B, and the average value of the index 40DP.

[0079] To select the range of past identification image 40BP based on identification image 40B, this is done using endoscopic images, pattern matching of identification images, or the conditions at the time of examination (e.g., the position and direction of the endoscope tip).

[0080] The display screen for the endoscopic image 40A and identification image 40B during the examination, and the display screen for past endoscopic images and identification images 40BP, may be switched between or displayed on separate monitors. It is preferable that the display range and position of the past identification images 40BP can also be changed as appropriate. Identification images 40BP, etc., from past examinations of the subject 90 are stored, for example, on a server within the hospital and transferred to the processor 30.

[0081] Alternatively, the difference between the past identification image 40BP and the identification image 40B at the time of examination can be calculated and the difference can be visualized. For example, by displaying only the pixels where the difference in index VI of each pixel has increased by a predetermined value or more, areas where the disease condition has changed can be clearly indicated.

[0082] <Example 5> The screen of monitor 40 in Figure 14 is similar to that in Figure 10, but in the identification image 40B, only the red area, representing the most severe level, is displayed in color, while the areas from normal to severe levels are displayed in monochrome white or gray. Alternatively, the areas from normal to severe levels may be displayed as a normal endoscopic image illuminated with white light.

[0083] The color-displayed level (color) range may be pre-set, but it is preferable that it be configurable as needed. For example, clicking each of the five color ranges in the identification color list display 40C once will change that level range from displaying the identification color to displaying white, and clicking it again will change it back from displaying white to displaying color. There may be multiple level ranges that are displayed in color. Also, a normal endoscopic image illuminated with white light may be displayed in the identification image range that is displayed in white.

[0084] <Example 6> The screen of monitor 40 in Figure 15 is similar to that in Figure 10, but unlike Figure 10, the identification image 40B is made semi-transparent by setting the transmittance and is superimposed on the endoscopic image 40A. When the transmittance is 0%, only the identification image is displayed and the endoscopic image 40A is not displayed, and when the transmittance is 100%, only the endoscopic image 40A is displayed and the identification image 40B is not displayed.

[0085] Furthermore, the transmittance of each of the five color regions in the identification image 40B can be set individually for each identification color. Of course, it is also acceptable for only the selected identification color to be made semi-transparent.

[0086] The setting for making the identification image 40B semi-transparent is, for example, if the monitor 40 is a touch panel, pressing and holding each of the five color areas of the identification color list display 40C and sliding to the left increases the transparency of the identification color in that level area, and sliding to the right decreases the transparency of that identification color.

[0087] (Table 1) TIFF2026082665000002.tif46159

[0088] In Case A of Table 1 above, all identification colors (levels) are set to a transmittance of 50%. In Case B of Table 1 above, the transmittance decreases as the severity level changes from the most severe to the moderate level, and is set to 0% at the mild and normal levels. Figure 15 shows the screen of monitor 40 in the case of Case B. In Case C of Table 1 above, only the heaviest level has a transmittance of 50%, while the other levels are set to a transmittance of 0%.

[0089] Furthermore, if there is an area set to 100% transmittance, only the endoscopic image 40A will be displayed in that area, making it impossible to determine which part of the image the identification image 40B is displayed in. For this reason, it is acceptable to display it as in Cases 1-3 below.

[0090] (Case 1) As shown in Figure 14, if an identification image 40B is superimposed on the endoscopic image 40A, where only the central part has a region of 100% transmittance, the boundary of the identification image 40B is indicated by a solid or dashed line. (Case 2) Although not shown in the diagram, if only the most severely affected area (red) has a transmittance of 50% and the other levels have a transmittance of 100%, the boundary between the most severely affected area and the other areas will be shown with a solid or dashed line. (Case 3) When multiple levels are set to have a transmittance of 100%, such as when moderate to normal levels are set to 100%, the boundaries between the multiple level areas are not visible on the screen. Although not shown in the diagram, the boundaries between multiple level areas are displayed as solid or dashed lines. For example, by displaying the boundary between the moderate and mild areas, and the boundary between the mild and normal areas, as a solid line, the boundaries between the areas become clear even when multiple levels have a transmittance of 100%.

[0091] <Example 7> The screen of monitor 40 in Figure 16 is similar to that in Figure 13, displaying endoscopic image 40A and identification image 40B, along with identification image 40BP from a past examination of the subject 90, covering a similar range to identification image 40B. However, unlike in Figure 13, in identification image 40B, only the red area, representing the most severe level, is displayed in color, while the areas from normal to severe levels are displayed in white.

[0092] The most severe level is the level with the highest number of pixels in past identification images 40BP, or in other words, the largest area. The level at which color is displayed in identification image 40B is not limited to the most severe level, but can be set as appropriate.

[0093] Furthermore, the range of the numerical values ​​described above, for example, the wavelength, is not limited to the range described above and can be increased or decreased as appropriate. Also, the endoscope 10 may be a rigid endoscope with a rigid insertion section 11. The present invention is not limited to the embodiments described above, and various changes and modifications can be made without altering the gist of the present invention. [Explanation of Symbols]

[0094] 1. Endoscope equipment 3. Insertion part 9. Endoscope 10. Endoscope 11. Insertion part 11A...Tip 11B ··Curved section 11C...Soft tube 12...Operation unit 12A Button 13. Universal Code 14. Connector 15. Imaging Unit 16. Lighting Unit 20...Light source device 22. Light source control unit (light source control circuit) 23...Light source 23B··B element 23G··G this 23R··R element 24...Multiplexer 30 Endoscope Processor 31. Image Processing Unit (Image Processing Circuit) 32. Calculation Unit (Calculation Circuit) 33. Identification unit (identification circuit) 34. Display color acquisition unit (identification color acquisition unit: identification color acquisition circuit) 35. Image generation unit (image generation circuit) 36. Settings Section 40-inch monitor 40A · Endoscopic image 40B, 40BP... Identification image 40C ·· Identification Color List Display 40D ··Average value 50 memory 90. Subject 91. Subject

Claims

1. An image processing unit that generates a subject image from an image signal, A calculation unit calculates an index for a pixel by normalizing the sum of the red pixel value and the green pixel value of one or more pixels in the subject image by the blue pixel value. An identification unit that identifies a symptom level based on the aforementioned indicator using multiple thresholds to distinguish it from one of several types of symptom levels, A display color acquisition unit that acquires a display color including an identification color corresponding to the symptom level, An image generation unit that generates an identification image by applying the display color to the aforementioned pixels, It is equipped with, The display color includes an error color for applying to a first error pixel where at least one of the red pixel value, the green pixel value, and the blue pixel value is below a predetermined lower limit pixel value or above a predetermined upper limit pixel value, and to a second error pixel where the index is below a predetermined lower threshold or above a predetermined upper threshold. The aforementioned error color is a different color from the aforementioned identification color. The endoscope processor is characterized in that the image generation unit generates the identification image using the error color for the first error pixel and the second error pixel.

2. When the sum of the red pixel value and the green pixel value is normalized by the blue pixel value for a predetermined number or more of the aforementioned pixels, The endoscope processor according to claim 1, characterized in that it outputs a warning when the ratio of the number of first error pixels, the number of second error pixels, or the sum of the number of first error pixels and the number of second error pixels to the total number of pixels is greater than a predetermined ratio.

3. An image processing unit that generates a subject image from an image signal, A calculation unit calculates an index for a pixel by normalizing the sum of the red pixel value and the green pixel value of one or more pixels in at least a portion of the subject image region by the blue pixel value. An identification unit that identifies a symptom level based on the aforementioned indicator using multiple thresholds to distinguish it from one of several types of symptom levels, An identification color acquisition unit that acquires an identification color corresponding to the symptom level, An image generation unit that generates an identification image using the identification color of the aforementioned pixels, It is equipped with, The endoscope processor is characterized in that the image generation unit outputs, along with the identification image, a past image which is an identification image generated based on past subject images taken from the same subject.

4. The endoscope processor according to claim 3, characterized in that, of the aforementioned past image, only pixels of the selected identification color are displayed as identification images, and the other pixels are displayed in white or as an endoscopic image.

5. The endoscope processor according to claim 4, characterized in that the identification image is made semi-transparent with different transmittances for each of the multiple identification colors.

6. The endoscope processor according to claim 5, characterized in that only the identification color selected from the plurality of identification colors is made semi-transparent.

7. An image processing unit that generates a subject image from an image signal, A calculation unit calculates an index for a pixel by normalizing the sum of the red pixel value and the green pixel value of one or more pixels in the subject image by the blue pixel value. An identification unit that identifies a symptom level based on the aforementioned indicator using multiple thresholds to distinguish it from one of several types of symptom levels, An identification color acquisition unit that acquires an identification color corresponding to the symptom level, The system comprises an image generation unit that generates an identification image to be displayed on a monitor using the aforementioned identification color, An endoscope processor characterized in that only pixels corresponding to the selected identification color are displayed in color, and pixels that do not correspond to the color are displayed in white.

8. An image processing unit that generates a subject image from an image signal, A calculation unit calculates an index for a pixel by normalizing the sum of the red pixel value and the green pixel value of one or more pixels in the subject image by the blue pixel value. An identification unit that identifies a symptom level based on the aforementioned indicator using multiple thresholds to distinguish it from one of several types of symptom levels, An identification color acquisition unit that acquires an identification color corresponding to the symptom level, An endoscope processor characterized by including an image generation unit that generates an identification image by applying the identification color to the pixels, and further makes the identification image semi-transparent and superimposes it on the subject image.

9. The endoscope processor according to claim 1, The endoscope connected to the aforementioned endoscope processor, A memory connected to the endoscope processor, Includes a monitor connected to the endoscope processor, The endoscope outputs the image signal, The memory is an endoscope system that stores the threshold and the identification color.

Images